2024-04-17T19:29:47.636 INFO:root:teuthology version: 0.0.1.dev267+g6c63784 2024-04-17T19:29:47.636 DEBUG:teuthology.run:Teuthology command: teuthology --archive /home/teuthworker/archive/pdonnell-2024-04-17_17:06:06-fs-wip-pdonnell-testing-20240417.021458-debug-distro-default-smithi/7660526 --name pdonnell-2024-04-17_17:06:06-fs-wip-pdonnell-testing-20240417.021458-debug-distro-default-smithi --description fs/thrash/workloads/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a5s-mds-1c-client conf/{client mds mgr mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} msgr-failures/none objectstore-ec/bluestore-comp-ec-root overrides/{client-shutdown frag ignorelist_health ignorelist_wrongly_marked_down pg_health prefetch_dirfrags/no prefetch_dirfrags/yes prefetch_entire_dirfrags/no prefetch_entire_dirfrags/yes races session_timeout thrashosds-health} ranks/5 tasks/{1-thrash/mon 2-workunit/fs/trivial_sync}} --verbose --owner scheduled_pdonnell@teuthology -- /home/teuthworker/archive/pdonnell-2024-04-17_17:06:06-fs-wip-pdonnell-testing-20240417.021458-debug-distro-default-smithi/7660526/orig.config.yaml 2024-04-17T19:29:47.694 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-17T19:29:47.784 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/pdonnell-2024-04-17_17:06:06-fs-wip-pdonnell-testing-20240417.021458-debug-distro-default-smithi/7660526 branch: wip-pdonnell-testing-20240417.021458-debug description: fs/thrash/workloads/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a5s-mds-1c-client conf/{client mds mgr mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} msgr-failures/none objectstore-ec/bluestore-comp-ec-root overrides/{client-shutdown frag ignorelist_health ignorelist_wrongly_marked_down pg_health prefetch_dirfrags/no prefetch_dirfrags/yes prefetch_entire_dirfrags/no prefetch_entire_dirfrags/yes races session_timeout thrashosds-health} ranks/5 tasks/{1-thrash/mon 2-workunit/fs/trivial_sync}} email: pdonnell@redhat.com first_in_suite: false job_id: '7660526' kernel: client: branch: testing kdb: true sha1: distro ktype: upstream last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi mgrmodules: sequential: - print: Enabling mgr modules name: pdonnell-2024-04-17_17:06:06-fs-wip-pdonnell-testing-20240417.021458-debug-distro-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: ubuntu os_version: '22.04' overrides: admin_socket: branch: wip-pdonnell-testing-20240417.021458-debug ceph: cephfs: ec_profile: - m=2 - k=2 - crush-failure-domain=osd max_mds: 5 session_timeout: 300 conf: client: client mount timeout: 600 client_shutdown_timeout: 120 debug client: 20 debug ms: 1 rados mon op timeout: 900 rados osd op timeout: 900 global: ms die on skipped message: false mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds bal fragment size max: 10000 mds bal merge size: 5 mds bal split bits: 3 mds bal split size: 100 mds debug frag: true mds debug scatterstat: true mds oft prefetch dirfrags: true mds op complaint time: 180 mds verify scatter: true mds_dir_prefetch: true mds_sleep_rank_change: 5000000.0 osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug client: 20 debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon down mkfs grace: 300 mon op complaint time: 120 osd: bluestore block size: 96636764160 bluestore compression mode: aggressive bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug ms: 1 debug osd: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd blocked scrub grace period: 3600 osd failsafe full ratio: 0.95 osd max markdown count: 1000 osd objectstore: bluestore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - FS_DEGRADED - FS_INLINE_DATA_DEPRECATED - FS_WITH_FAILED_MDS - MDS_ALL_DOWN - MDS_DAMAGE - MDS_DEGRADED - MDS_FAILED - MDS_INSUFFICIENT_STANDBY - MDS_UP_LESS_THAN_MAX - filesystem is online with fewer MDS than max_mds - POOL_APP_NOT_ENABLED - do not have an application enabled - overall HEALTH_ - Replacing daemon - deprecated feature inline_data - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - PG_AVAILABILITY - PG_DEGRADED - Reduced data availability - overall HEALTH_ - \(OSDMAP_FLAGS\) - \(OSD_ - \(PG_ - \(POOL_ - \(CACHE_POOL_ - \(SMALLER_PGP_NUM\) - \(OBJECT_ - \(SLOW_OPS\) - \(REQUEST_SLOW\) - \(TOO_FEW_PGS\) - slow request - timeout on replica - late reservation from - MON_DOWN - OSDMAP_FLAGS - OSD_DOWN - PG_DEGRADED - PG_AVAILABILITY - POOL_APP_NOT_ENABLED - mons down - mon down - out of quorum - overall HEALTH_ - \(MON_DOWN\) sha1: f3a98d3f110319c567ec86bf70955c141495ccf6 ceph-deploy: conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} check-counter: counters: mds: - mds.exported - mds.imported install: ceph: flavor: default sha1: f3a98d3f110319c567ec86bf70955c141495ccf6 kclient: syntax: v2 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-pdonnell-testing-20240417.021458-debug sha1: f3a98d3f110319c567ec86bf70955c141495ccf6 owner: scheduled_pdonnell@teuthology priority: 80 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mgr.y - mds.a - mds.c - mds.e - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - - mon.b - mon.c - mgr.x - mds.b - mds.d - mds.f - osd.4 - osd.5 - osd.6 - osd.7 seed: 4494 sha1: f3a98d3f110319c567ec86bf70955c141495ccf6 sleep_before_teardown: 0 subset: 496/512 suite: fs suite_branch: wip-pdonnell-testing-20240417.021458-debug suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_f3a98d3f110319c567ec86bf70955c141495ccf6/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph-ci.git suite_sha1: f3a98d3f110319c567ec86bf70955c141495ccf6 syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi044.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBBFkJ52XrASwbXBJkhLYHXC9lUsFKGmEAu0c2ILuh+RkEqHiJJKqimKzB25NswwXGPZ9OowOod9ggq0azou+vy4= smithi062.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBBdPDDmhHCrLcO4+cuZnbcbQZ04BH+g04+WSXZceFtgUShLqoqRSQZVduVFjnxHeEaOXOhi3T1ptKeKEZYh4LJ4= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - ceph: create_rbd_pool: false - sequential: - mgrmodules - kclient: null - mon_thrash: check_mds_failover: true revive_delay: 20 thrash_delay: 10 - workunit: clients: all: - fs/misc/trivial_sync.sh teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return yaml.ktype == 'upstream' end - local function is_kdistro() return yaml.ktype == 'distro' end - local function is_fuse() return false end - local function syntax_version() return yaml.overrides.kclient.syntax end teuthology_branch: main teuthology_sha1: 6c637841c215537a4502385240412f1966e0faab timestamp: 2024-04-17_17:06:06 tube: smithi user: pdonnell verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885 2024-04-17T19:29:47.784 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_f3a98d3f110319c567ec86bf70955c141495ccf6/qa; will attempt to use it 2024-04-17T19:29:47.785 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_f3a98d3f110319c567ec86bf70955c141495ccf6/qa/tasks 2024-04-17T19:29:47.785 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-04-17T19:29:47.787 INFO:teuthology.task.internal:Checking packages... 2024-04-17T19:29:47.811 INFO:teuthology.task.internal:Checking packages for os_type 'ubuntu', flavor 'default' and ceph hash 'f3a98d3f110319c567ec86bf70955c141495ccf6' 2024-04-17T19:29:47.812 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-04-17T19:29:47.812 INFO:teuthology.packaging:ref: None 2024-04-17T19:29:47.812 INFO:teuthology.packaging:tag: None 2024-04-17T19:29:47.812 INFO:teuthology.packaging:branch: wip-pdonnell-testing-20240417.021458-debug 2024-04-17T19:29:47.812 INFO:teuthology.packaging:sha1: f3a98d3f110319c567ec86bf70955c141495ccf6 2024-04-17T19:29:47.812 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&ref=wip-pdonnell-testing-20240417.021458-debug 2024-04-17T19:29:47.955 INFO:teuthology.task.internal:Found packages for ceph version 19.0.0-3146-gf3a98d3f-1jammy 2024-04-17T19:29:47.957 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-04-17T19:29:47.966 INFO:teuthology.task.internal:no buildpackages task found 2024-04-17T19:29:47.966 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-04-17T19:29:47.981 INFO:teuthology.task.internal:Saving configuration 2024-04-17T19:29:48.002 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-04-17T19:29:48.011 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-04-17T19:29:48.038 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi044.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/pdonnell-2024-04-17_17:06:06-fs-wip-pdonnell-testing-20240417.021458-debug-distro-default-smithi/7660526', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-04-17 19:19:08.722101', 'locked_by': 'scheduled_pdonnell@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIKkEDY5/vxOk/Om0I4g6SrZtui4OQvqXQyey7OBrNXfw'} 2024-04-17T19:29:48.066 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi062.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/pdonnell-2024-04-17_17:06:06-fs-wip-pdonnell-testing-20240417.021458-debug-distro-default-smithi/7660526', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-04-17 19:19:08.721090', 'locked_by': 'scheduled_pdonnell@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAILj03ZmupV5KLvL1xMSJoZSyGksD4eYvfKgVTJs4gYaO'} 2024-04-17T19:29:48.066 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-04-17T19:29:48.075 INFO:teuthology.task.internal:roles: ubuntu@smithi044.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'mds.e', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0'] 2024-04-17T19:29:48.075 INFO:teuthology.task.internal:roles: ubuntu@smithi062.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'mds.f', 'osd.4', 'osd.5', 'osd.6', 'osd.7'] 2024-04-17T19:29:48.075 INFO:teuthology.run_tasks:Running task console_log... 2024-04-17T19:29:48.155 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f2c7ee563a0>, signals=[15]) 2024-04-17T19:29:48.155 INFO:teuthology.run_tasks:Running task internal.connect... 2024-04-17T19:29:48.166 INFO:teuthology.task.internal:Opening connections... 2024-04-17T19:29:48.166 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi044.front.sepia.ceph.com 2024-04-17T19:29:48.168 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi044.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T19:29:48.252 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi062.front.sepia.ceph.com 2024-04-17T19:29:48.252 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi062.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T19:29:48.334 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-04-17T19:29:48.344 DEBUG:teuthology.orchestra.run.smithi044:> uname -m 2024-04-17T19:29:48.349 INFO:teuthology.orchestra.run.smithi044.stdout:x86_64 2024-04-17T19:29:48.350 DEBUG:teuthology.orchestra.run.smithi044:> cat /etc/os-release 2024-04-17T19:29:48.396 INFO:teuthology.orchestra.run.smithi044.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2024-04-17T19:29:48.396 INFO:teuthology.orchestra.run.smithi044.stdout:NAME="Ubuntu" 2024-04-17T19:29:48.396 INFO:teuthology.orchestra.run.smithi044.stdout:VERSION_ID="22.04" 2024-04-17T19:29:48.396 INFO:teuthology.orchestra.run.smithi044.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2024-04-17T19:29:48.396 INFO:teuthology.orchestra.run.smithi044.stdout:VERSION_CODENAME=jammy 2024-04-17T19:29:48.396 INFO:teuthology.orchestra.run.smithi044.stdout:ID=ubuntu 2024-04-17T19:29:48.396 INFO:teuthology.orchestra.run.smithi044.stdout:ID_LIKE=debian 2024-04-17T19:29:48.396 INFO:teuthology.orchestra.run.smithi044.stdout:HOME_URL="https://www.ubuntu.com/" 2024-04-17T19:29:48.396 INFO:teuthology.orchestra.run.smithi044.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-04-17T19:29:48.396 INFO:teuthology.orchestra.run.smithi044.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-04-17T19:29:48.396 INFO:teuthology.orchestra.run.smithi044.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-04-17T19:29:48.397 INFO:teuthology.orchestra.run.smithi044.stdout:UBUNTU_CODENAME=jammy 2024-04-17T19:29:48.397 INFO:teuthology.lock.ops:Updating smithi044.front.sepia.ceph.com on lock server 2024-04-17T19:29:48.420 DEBUG:teuthology.orchestra.run.smithi062:> uname -m 2024-04-17T19:29:48.425 INFO:teuthology.orchestra.run.smithi062.stdout:x86_64 2024-04-17T19:29:48.426 DEBUG:teuthology.orchestra.run.smithi062:> cat /etc/os-release 2024-04-17T19:29:48.471 INFO:teuthology.orchestra.run.smithi062.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2024-04-17T19:29:48.471 INFO:teuthology.orchestra.run.smithi062.stdout:NAME="Ubuntu" 2024-04-17T19:29:48.471 INFO:teuthology.orchestra.run.smithi062.stdout:VERSION_ID="22.04" 2024-04-17T19:29:48.471 INFO:teuthology.orchestra.run.smithi062.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2024-04-17T19:29:48.471 INFO:teuthology.orchestra.run.smithi062.stdout:VERSION_CODENAME=jammy 2024-04-17T19:29:48.472 INFO:teuthology.orchestra.run.smithi062.stdout:ID=ubuntu 2024-04-17T19:29:48.472 INFO:teuthology.orchestra.run.smithi062.stdout:ID_LIKE=debian 2024-04-17T19:29:48.472 INFO:teuthology.orchestra.run.smithi062.stdout:HOME_URL="https://www.ubuntu.com/" 2024-04-17T19:29:48.472 INFO:teuthology.orchestra.run.smithi062.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-04-17T19:29:48.472 INFO:teuthology.orchestra.run.smithi062.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-04-17T19:29:48.472 INFO:teuthology.orchestra.run.smithi062.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-04-17T19:29:48.472 INFO:teuthology.orchestra.run.smithi062.stdout:UBUNTU_CODENAME=jammy 2024-04-17T19:29:48.472 INFO:teuthology.lock.ops:Updating smithi062.front.sepia.ceph.com on lock server 2024-04-17T19:29:48.495 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-04-17T19:29:48.506 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-04-17T19:29:48.518 INFO:teuthology.task.internal:Checking for old test directory... 2024-04-17T19:29:48.518 DEBUG:teuthology.orchestra.run.smithi044:> test '!' -e /home/ubuntu/cephtest 2024-04-17T19:29:48.521 DEBUG:teuthology.orchestra.run.smithi062:> test '!' -e /home/ubuntu/cephtest 2024-04-17T19:29:48.525 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-04-17T19:29:48.537 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-04-17T19:29:48.537 DEBUG:teuthology.orchestra.run.smithi044:> test -z $(ls -A /var/lib/ceph) 2024-04-17T19:29:48.569 DEBUG:teuthology.orchestra.run.smithi062:> test -z $(ls -A /var/lib/ceph) 2024-04-17T19:29:48.581 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-04-17T19:29:48.633 INFO:teuthology.run_tasks:Running task kernel... 2024-04-17T19:29:48.655 INFO:teuthology.task.kernel:normalize config orig: {'client': {'branch': 'testing'}, 'kdb': True, 'sha1': 'distro'} 2024-04-17T19:29:48.655 INFO:teuthology.task.kernel:normalize config final: {'client.0': {'branch': 'testing'}} 2024-04-17T19:29:48.655 INFO:teuthology.task.kernel:config {'client.0': {'branch': 'testing'}}, timeout 300 2024-04-17T19:29:48.656 DEBUG:teuthology.orchestra.run.smithi044:> test -f /run/.containerenv -o -f /.dockerenv 2024-04-17T19:29:48.660 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-17T19:29:48.661 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&ref=testing 2024-04-17T19:29:48.828 DEBUG:teuthology.task.kernel:sha1 for client.0 is 3f60ed14f7c110c7ce3c8d83dd2ed0d08e80d0c8 2024-04-17T19:29:48.828 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "3f60ed14f7c110c7ce3c8d83dd2ed0d08e80d0c8"... 2024-04-17T19:29:48.829 DEBUG:teuthology.orchestra.run.smithi044:> uname -r 2024-04-17T19:29:48.834 INFO:teuthology.orchestra.run.smithi044.stdout:5.15.0-56-generic 2024-04-17T19:29:48.834 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-56-generic vs 3f60ed14f7c110c7ce3c8d83dd2ed0d08e80d0c8 2024-04-17T19:29:48.834 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2024-04-17T19:29:48.835 INFO:teuthology.task.kernel:Installing linux-firmware on client.0... 2024-04-17T19:29:48.835 DEBUG:teuthology.orchestra.run.smithi044:> cd /lib/firmware/updates && test -d .git && test '!' -s .git/HEAD && sudo rm -rf .git ; sudo install -d -m0755 /lib/firmware/updates && cd /lib/firmware/updates && sudo git init 2024-04-17T19:29:48.904 INFO:teuthology.orchestra.run.smithi044.stderr:bash: line 1: cd: /lib/firmware/updates: No such file or directory 2024-04-17T19:29:49.048 INFO:teuthology.orchestra.run.smithi044.stderr:hint: Using 'master' as the name for the initial branch. This default branch name 2024-04-17T19:29:49.048 INFO:teuthology.orchestra.run.smithi044.stderr:hint: is subject to change. To configure the initial branch name to use in all 2024-04-17T19:29:49.049 INFO:teuthology.orchestra.run.smithi044.stderr:hint: of your new repositories, which will suppress this warning, call: 2024-04-17T19:29:49.049 INFO:teuthology.orchestra.run.smithi044.stderr:hint: 2024-04-17T19:29:49.049 INFO:teuthology.orchestra.run.smithi044.stderr:hint: git config --global init.defaultBranch 2024-04-17T19:29:49.049 INFO:teuthology.orchestra.run.smithi044.stderr:hint: 2024-04-17T19:29:49.050 INFO:teuthology.orchestra.run.smithi044.stderr:hint: Names commonly chosen instead of 'master' are 'main', 'trunk' and 2024-04-17T19:29:49.050 INFO:teuthology.orchestra.run.smithi044.stderr:hint: 'development'. The just-created branch can be renamed via this command: 2024-04-17T19:29:49.050 INFO:teuthology.orchestra.run.smithi044.stderr:hint: 2024-04-17T19:29:49.050 INFO:teuthology.orchestra.run.smithi044.stderr:hint: git branch -m 2024-04-17T19:29:49.052 INFO:teuthology.orchestra.run.smithi044.stdout:Initialized empty Git repository in /usr/lib/firmware/updates/.git/ 2024-04-17T19:29:49.052 DEBUG:teuthology.orchestra.run.smithi044:> sudo git --git-dir=/lib/firmware/updates/.git config --get remote.origin.url >/dev/null || sudo git --git-dir=/lib/firmware/updates/.git remote add origin git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware.git 2024-04-17T19:29:49.122 DEBUG:teuthology.orchestra.run.smithi044:> sudo git --git-dir=/lib/firmware/updates/.git remote set-url origin git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware.git >/dev/null 2024-04-17T19:29:49.182 DEBUG:teuthology.orchestra.run.smithi044:> cd /lib/firmware/updates && sudo git fetch origin && sudo git reset --hard origin/main 2024-04-17T19:31:45.035 INFO:teuthology.orchestra.run.smithi044.stderr:From git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware 2024-04-17T19:31:45.035 INFO:teuthology.orchestra.run.smithi044.stderr: * [new branch] main -> origin/main 2024-04-17T19:31:45.064 INFO:teuthology.orchestra.run.smithi044.stderr: * [new tag] 20190312 -> 20190312 2024-04-17T19:31:45.065 INFO:teuthology.orchestra.run.smithi044.stderr: * [new tag] 20190416 -> 20190416 2024-04-17T19:31:45.065 INFO:teuthology.orchestra.run.smithi044.stderr: * [new tag] 20190514 -> 20190514 2024-04-17T19:31:45.065 INFO:teuthology.orchestra.run.smithi044.stderr: * [new tag] 20190618 -> 20190618 2024-04-17T19:31:45.065 INFO:teuthology.orchestra.run.smithi044.stderr: * [new tag] 20190717 -> 20190717 2024-04-17T19:31:45.065 INFO:teuthology.orchestra.run.smithi044.stderr: * [new tag] 20190815 -> 20190815 2024-04-17T19:31:45.065 INFO:teuthology.orchestra.run.smithi044.stderr: * [new tag] 20190923 -> 20190923 2024-04-17T19:31:45.065 INFO:teuthology.orchestra.run.smithi044.stderr: * [new tag] 20191022 -> 20191022 2024-04-17T19:31:45.065 INFO:teuthology.orchestra.run.smithi044.stderr: * [new tag] 20191215 -> 20191215 2024-04-17T19:31:45.065 INFO:teuthology.orchestra.run.smithi044.stderr: * [new tag] 20200122 -> 20200122 2024-04-17T19:31:45.065 INFO:teuthology.orchestra.run.smithi044.stderr: * [new tag] 20200316 -> 20200316 2024-04-17T19:31:45.065 INFO:teuthology.orchestra.run.smithi044.stderr: * [new tag] 20200421 -> 20200421 2024-04-17T19:31:45.065 INFO:teuthology.orchestra.run.smithi044.stderr: * [new tag] 20200519 -> 20200519 2024-04-17T19:31:45.072 INFO:teuthology.orchestra.run.smithi044.stderr: * [new tag] 20200619 -> 20200619 2024-04-17T19:31:45.072 INFO:teuthology.orchestra.run.smithi044.stderr: * [new tag] 20200721 -> 20200721 2024-04-17T19:31:45.072 INFO:teuthology.orchestra.run.smithi044.stderr: * [new tag] 20200817 -> 20200817 2024-04-17T19:31:45.072 INFO:teuthology.orchestra.run.smithi044.stderr: * [new tag] 20200918 -> 20200918 2024-04-17T19:31:45.072 INFO:teuthology.orchestra.run.smithi044.stderr: * [new tag] 20201022 -> 20201022 2024-04-17T19:31:45.072 INFO:teuthology.orchestra.run.smithi044.stderr: * [new tag] 20201118 -> 20201118 2024-04-17T19:31:45.073 INFO:teuthology.orchestra.run.smithi044.stderr: * [new tag] 20201218 -> 20201218 2024-04-17T19:31:45.073 INFO:teuthology.orchestra.run.smithi044.stderr: * [new tag] 20210208 -> 20210208 2024-04-17T19:31:45.073 INFO:teuthology.orchestra.run.smithi044.stderr: * [new tag] 20210315 -> 20210315 2024-04-17T19:31:45.073 INFO:teuthology.orchestra.run.smithi044.stderr: * [new tag] 20210511 -> 20210511 2024-04-17T19:31:45.073 INFO:teuthology.orchestra.run.smithi044.stderr: * [new tag] 20210716 -> 20210716 2024-04-17T19:31:45.073 INFO:teuthology.orchestra.run.smithi044.stderr: * [new tag] 20210818 -> 20210818 2024-04-17T19:31:45.073 INFO:teuthology.orchestra.run.smithi044.stderr: * [new tag] 20210919 -> 20210919 2024-04-17T19:31:45.073 INFO:teuthology.orchestra.run.smithi044.stderr: * [new tag] 20211027 -> 20211027 2024-04-17T19:31:45.073 INFO:teuthology.orchestra.run.smithi044.stderr: * [new tag] 20211216 -> 20211216 2024-04-17T19:31:45.073 INFO:teuthology.orchestra.run.smithi044.stderr: * [new tag] 20220209 -> 20220209 2024-04-17T19:31:45.073 INFO:teuthology.orchestra.run.smithi044.stderr: * [new tag] 20220310 -> 20220310 2024-04-17T19:31:45.073 INFO:teuthology.orchestra.run.smithi044.stderr: * [new tag] 20220411 -> 20220411 2024-04-17T19:31:45.073 INFO:teuthology.orchestra.run.smithi044.stderr: * [new tag] 20220509 -> 20220509 2024-04-17T19:31:45.074 INFO:teuthology.orchestra.run.smithi044.stderr: * [new tag] 20220610 -> 20220610 2024-04-17T19:31:45.074 INFO:teuthology.orchestra.run.smithi044.stderr: * [new tag] 20220708 -> 20220708 2024-04-17T19:31:45.074 INFO:teuthology.orchestra.run.smithi044.stderr: * [new tag] 20220815 -> 20220815 2024-04-17T19:31:45.074 INFO:teuthology.orchestra.run.smithi044.stderr: * [new tag] 20220913 -> 20220913 2024-04-17T19:31:45.074 INFO:teuthology.orchestra.run.smithi044.stderr: * [new tag] 20221012 -> 20221012 2024-04-17T19:31:45.074 INFO:teuthology.orchestra.run.smithi044.stderr: * [new tag] 20221109 -> 20221109 2024-04-17T19:31:45.074 INFO:teuthology.orchestra.run.smithi044.stderr: * [new tag] 20221214 -> 20221214 2024-04-17T19:31:45.074 INFO:teuthology.orchestra.run.smithi044.stderr: * [new tag] 20230117 -> 20230117 2024-04-17T19:31:45.074 INFO:teuthology.orchestra.run.smithi044.stderr: * [new tag] 20230210 -> 20230210 2024-04-17T19:31:45.074 INFO:teuthology.orchestra.run.smithi044.stderr: * [new tag] 20230310 -> 20230310 2024-04-17T19:31:45.074 INFO:teuthology.orchestra.run.smithi044.stderr: * [new tag] 20230404 -> 20230404 2024-04-17T19:31:45.075 INFO:teuthology.orchestra.run.smithi044.stderr: * [new tag] 20230515 -> 20230515 2024-04-17T19:31:45.075 INFO:teuthology.orchestra.run.smithi044.stderr: * [new tag] 20230625 -> 20230625 2024-04-17T19:31:45.075 INFO:teuthology.orchestra.run.smithi044.stderr: * [new tag] 20230804 -> 20230804 2024-04-17T19:31:45.075 INFO:teuthology.orchestra.run.smithi044.stderr: * [new tag] 20230919 -> 20230919 2024-04-17T19:31:45.075 INFO:teuthology.orchestra.run.smithi044.stderr: * [new tag] 20231030 -> 20231030 2024-04-17T19:31:45.075 INFO:teuthology.orchestra.run.smithi044.stderr: * [new tag] 20231111 -> 20231111 2024-04-17T19:31:45.075 INFO:teuthology.orchestra.run.smithi044.stderr: * [new tag] 20231211 -> 20231211 2024-04-17T19:31:45.075 INFO:teuthology.orchestra.run.smithi044.stderr: * [new tag] 20240115 -> 20240115 2024-04-17T19:31:45.075 INFO:teuthology.orchestra.run.smithi044.stderr: * [new tag] 20240220 -> 20240220 2024-04-17T19:31:45.075 INFO:teuthology.orchestra.run.smithi044.stderr: * [new tag] 20240312 -> 20240312 2024-04-17T19:31:45.075 INFO:teuthology.orchestra.run.smithi044.stderr: * [new tag] 20240410 -> 20240410 2024-04-17T19:31:49.512 INFO:teuthology.orchestra.run.smithi044.stderr:Updating files: 47% (1732/3609) Updating files: 48% (1733/3609) Updating files: 49% (1769/3609) Updating files: 50% (1805/3609) Updating files: 51% (1841/3609) Updating files: 52% (1877/3609) Updating files: 53% (1913/3609) Updating files: 54% (1949/3609) Updating files: 55% (1985/3609) Updating files: 56% (2022/3609) Updating files: 57% (2058/3609) Updating files: 58% (2094/3609) Updating files: 59% (2130/3609) Updating files: 60% (2166/3609) Updating files: 61% (2202/3609) Updating files: 61% (2216/3609) Updating files: 62% (2238/3609) Updating files: 63% (2274/3609) Updating files: 64% (2310/3609) Updating files: 65% (2346/3609) Updating files: 66% (2382/3609) Updating files: 67% (2419/3609) Updating files: 68% (2455/3609) Updating files: 69% (2491/3609) Updating files: 70% (2527/3609) Updating files: 71% (2563/3609) Updating files: 71% (2573/3609) Updating files: 72% (2599/3609) Updating files: 73% (2635/3609) Updating files: 74% (2671/3609) Updating files: 75% (2707/3609) Updating files: 76% (2743/3609) Updating files: 77% (2779/3609) Updating files: 78% (2816/3609) Updating files: 79% (2852/3609) Updating files: 80% (2888/3609) Updating files: 81% (2924/3609) Updating files: 82% (2960/3609) Updating files: 83% (2996/3609) Updating files: 83% (3016/3609) Updating files: 84% (3032/3609) Updating files: 85% (3068/3609) Updating files: 86% (3104/3609) Updating files: 87% (3140/3609) Updating files: 88% (3176/3609) Updating files: 89% (3213/3609) Updating files: 90% (3249/3609) Updating files: 91% (3285/3609) Updating files: 92% (3321/3609) Updating files: 93% (3357/3609) Updating files: 94% (3393/3609) Updating files: 95% (3429/3609) Updating files: 96% (3465/3609) Updating files: 97% (3501/3609) Updating files: 98% (3537/3609) Updating files: 99% (3573/3609) Updating files: 100% (3609/3609) Updating files: 100% (3609/3609), done. 2024-04-17T19:31:49.517 INFO:teuthology.orchestra.run.smithi044.stdout:HEAD is now at e6786998 Merge branch 'mt7922' into 'main' 2024-04-17T19:31:49.540 INFO:teuthology.task.kernel:Downloading kernel 3f60ed14f7c110c7ce3c8d83dd2ed0d08e80d0c8 on client.0... 2024-04-17T19:31:49.540 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=3f60ed14f7c110c7ce3c8d83dd2ed0d08e80d0c8 2024-04-17T19:31:49.771 INFO:teuthology.task.kernel:fetching, builder baseurl is https://1.chacra.ceph.com/r/kernel/testing/3f60ed14f7c110c7ce3c8d83dd2ed0d08e80d0c8/ubuntu/jammy/flavors/default/pool/main/l/linux-6.9.0-rc3-g3f60ed14f7c1/ 2024-04-17T19:31:49.771 DEBUG:teuthology.orchestra.run.smithi044:> rm -f /tmp/linux-image.deb && echo linux-image-6.9.0-rc3-g3f60ed14f7c1_6.9.0-rc3-g3f60ed14f7c1-1_amd64.deb | wget -nv -O /tmp/linux-image.deb --base=https://1.chacra.ceph.com/r/kernel/testing/3f60ed14f7c110c7ce3c8d83dd2ed0d08e80d0c8/ubuntu/jammy/flavors/default/pool/main/l/linux-6.9.0-rc3-g3f60ed14f7c1/ --input-file=- 2024-04-17T19:31:49.774 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi044.front.sepia.ceph.com to complete... 2024-04-17T19:31:51.470 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17 19:31:51 URL:https://1.chacra.ceph.com/r/kernel/testing/3f60ed14f7c110c7ce3c8d83dd2ed0d08e80d0c8/ubuntu/jammy/flavors/default/pool/main/l/linux-6.9.0-rc3-g3f60ed14f7c1/linux-image-6.9.0-rc3-g3f60ed14f7c1_6.9.0-rc3-g3f60ed14f7c1-1_amd64.deb [44839714/44839714] -> "/tmp/linux-image.deb" [1] 2024-04-17T19:31:51.470 INFO:teuthology.orchestra.run.smithi044.stderr:FINISHED --2024-04-17 19:31:51-- 2024-04-17T19:31:51.470 INFO:teuthology.orchestra.run.smithi044.stderr:Total wall clock time: 1.7s 2024-04-17T19:31:51.470 INFO:teuthology.orchestra.run.smithi044.stderr:Downloaded: 1 files, 43M in 1.5s (27.6 MB/s) 2024-04-17T19:31:51.475 INFO:teuthology.task.kernel:Installing kernel 3f60ed14f7c110c7ce3c8d83dd2ed0d08e80d0c8 on client.0... 2024-04-17T19:31:51.475 DEBUG:teuthology.orchestra.run.smithi044:> sudo dpkg -i /tmp/linux-image.deb 2024-04-17T19:31:51.721 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package linux-image-6.9.0-rc3-g3f60ed14f7c1. 2024-04-17T19:31:53.683 INFO:teuthology.orchestra.run.smithi044.stdout:(Reading database ... 129542 files and directories currently installed.) 2024-04-17T19:31:53.687 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack /tmp/linux-image.deb ... 2024-04-17T19:31:53.789 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking linux-image-6.9.0-rc3-g3f60ed14f7c1 (6.9.0-rc3-g3f60ed14f7c1-1) ... 2024-04-17T19:31:57.505 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up linux-image-6.9.0-rc3-g3f60ed14f7c1 (6.9.0-rc3-g3f60ed14f7c1-1) ... 2024-04-17T19:31:57.622 INFO:teuthology.orchestra.run.smithi044.stderr:update-initramfs: Generating /boot/initrd.img-6.9.0-rc3-g3f60ed14f7c1 2024-04-17T19:32:18.499 INFO:teuthology.orchestra.run.smithi044.stderr:Sourcing file `/etc/default/grub' 2024-04-17T19:32:18.509 INFO:teuthology.orchestra.run.smithi044.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-04-17T19:32:18.524 INFO:teuthology.orchestra.run.smithi044.stderr:Generating grub configuration file ... 2024-04-17T19:32:18.847 INFO:teuthology.orchestra.run.smithi044.stderr:Found linux image: /boot/vmlinuz-6.9.0-rc3-g3f60ed14f7c1 2024-04-17T19:32:18.875 INFO:teuthology.orchestra.run.smithi044.stderr:Found initrd image: /boot/initrd.img-6.9.0-rc3-g3f60ed14f7c1 2024-04-17T19:32:19.171 INFO:teuthology.orchestra.run.smithi044.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-04-17T19:32:19.177 INFO:teuthology.orchestra.run.smithi044.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-04-17T19:32:19.237 INFO:teuthology.orchestra.run.smithi044.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-04-17T19:32:19.243 INFO:teuthology.orchestra.run.smithi044.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-04-17T19:32:19.395 INFO:teuthology.orchestra.run.smithi044.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2024-04-17T19:32:19.395 INFO:teuthology.orchestra.run.smithi044.stderr:Systems on them will not be added to the GRUB boot configuration. 2024-04-17T19:32:19.395 INFO:teuthology.orchestra.run.smithi044.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-04-17T19:32:19.566 INFO:teuthology.orchestra.run.smithi044.stderr:done 2024-04-17T19:32:19.736 DEBUG:teuthology.orchestra.run.smithi044:> dpkg-deb -c /tmp/linux-image.deb 2024-04-17T19:32:19.744 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./ 2024-04-17T19:32:19.745 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./boot/ 2024-04-17T19:32:19.745 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 7002012 2024-04-11 18:50 ./boot/System.map-6.9.0-rc3-g3f60ed14f7c1 2024-04-17T19:32:19.764 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 172073 2024-04-11 18:50 ./boot/config-6.9.0-rc3-g3f60ed14f7c1 2024-04-17T19:32:19.765 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 13120512 2024-04-11 18:50 ./boot/vmlinuz-6.9.0-rc3-g3f60ed14f7c1 2024-04-17T19:32:19.787 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./etc/ 2024-04-17T19:32:19.787 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./etc/kernel/ 2024-04-17T19:32:19.787 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./etc/kernel/postinst.d/ 2024-04-17T19:32:19.787 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./etc/kernel/postrm.d/ 2024-04-17T19:32:19.787 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./etc/kernel/preinst.d/ 2024-04-17T19:32:19.787 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./etc/kernel/prerm.d/ 2024-04-17T19:32:19.787 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/ 2024-04-17T19:32:19.787 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/ 2024-04-17T19:32:19.787 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/ 2024-04-17T19:32:19.788 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/ 2024-04-17T19:32:19.788 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/arch/ 2024-04-17T19:32:19.788 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/arch/x86/ 2024-04-17T19:32:19.788 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/arch/x86/crypto/ 2024-04-17T19:32:19.788 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 507569 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/arch/x86/crypto/aesni-intel.ko 2024-04-17T19:32:19.791 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 28361 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/arch/x86/crypto/blowfish-x86_64.ko 2024-04-17T19:32:19.791 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 34313 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2024-04-17T19:32:19.791 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 35009 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2024-04-17T19:32:19.791 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 97953 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/arch/x86/crypto/camellia-x86_64.ko 2024-04-17T19:32:19.791 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 109905 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2024-04-17T19:32:19.791 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 155249 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2024-04-17T19:32:19.791 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 15241 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/arch/x86/crypto/crc32-pclmul.ko 2024-04-17T19:32:19.791 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 16089 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2024-04-17T19:32:19.791 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 87009 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2024-04-17T19:32:19.791 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 22865 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2024-04-17T19:32:19.791 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 50305 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2024-04-17T19:32:19.791 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 50377 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/arch/x86/crypto/serpent-avx2.ko 2024-04-17T19:32:19.792 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 54513 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2024-04-17T19:32:19.792 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 44657 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/arch/x86/crypto/sha1-ssse3.ko 2024-04-17T19:32:19.792 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 48049 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/arch/x86/crypto/sha256-ssse3.ko 2024-04-17T19:32:19.792 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 62873 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/arch/x86/crypto/sha512-ssse3.ko 2024-04-17T19:32:19.792 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 53569 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2024-04-17T19:32:19.792 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 34761 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2024-04-17T19:32:19.792 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 14809 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/arch/x86/crypto/twofish-x86_64.ko 2024-04-17T19:32:19.792 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/arch/x86/kernel/ 2024-04-17T19:32:19.792 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/arch/x86/kernel/cpu/ 2024-04-17T19:32:19.792 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/arch/x86/kernel/cpu/mce/ 2024-04-17T19:32:19.792 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 49081 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2024-04-17T19:32:19.792 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 15993 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/arch/x86/kernel/cpuid.ko 2024-04-17T19:32:19.792 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 21625 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/arch/x86/kernel/msr.ko 2024-04-17T19:32:19.792 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/arch/x86/kvm/ 2024-04-17T19:32:19.793 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 444425 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/arch/x86/kvm/kvm-amd.ko 2024-04-17T19:32:19.793 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 1035881 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/arch/x86/kvm/kvm-intel.ko 2024-04-17T19:32:19.793 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 2849609 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/arch/x86/kvm/kvm.ko 2024-04-17T19:32:19.810 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/ 2024-04-17T19:32:19.811 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 65025 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/af_alg.ko 2024-04-17T19:32:19.811 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 27961 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/algif_hash.ko 2024-04-17T19:32:19.811 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 25721 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/algif_skcipher.ko 2024-04-17T19:32:19.811 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 20225 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/ansi_cprng.ko 2024-04-17T19:32:19.811 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 21065 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/anubis.ko 2024-04-17T19:32:19.811 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 10929 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/arc4.ko 2024-04-17T19:32:19.811 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/asymmetric_keys/ 2024-04-17T19:32:19.811 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 11457 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/asymmetric_keys/pkcs7_test_key.ko 2024-04-17T19:32:19.811 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/async_tx/ 2024-04-17T19:32:19.811 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 12617 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/async_tx/async_memcpy.ko 2024-04-17T19:32:19.811 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 22609 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/async_tx/async_pq.ko 2024-04-17T19:32:19.811 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 24841 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/async_tx/async_raid6_recov.ko 2024-04-17T19:32:19.812 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 16313 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/async_tx/async_tx.ko 2024-04-17T19:32:19.812 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 20649 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/async_tx/async_xor.ko 2024-04-17T19:32:19.812 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 20737 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/async_tx/raid6test.ko 2024-04-17T19:32:19.812 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 25137 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/authenc.ko 2024-04-17T19:32:19.812 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 27953 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/authencesn.ko 2024-04-17T19:32:19.812 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 24049 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/blake2b_generic.ko 2024-04-17T19:32:19.812 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 13713 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/blowfish_common.ko 2024-04-17T19:32:19.812 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 11617 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/blowfish_generic.ko 2024-04-17T19:32:19.812 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 40889 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/camellia_generic.ko 2024-04-17T19:32:19.812 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 29113 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/cast5_generic.ko 2024-04-17T19:32:19.813 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 20625 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/cast6_generic.ko 2024-04-17T19:32:19.813 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 10489 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/cast_common.ko 2024-04-17T19:32:19.813 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 43281 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/ccm.ko 2024-04-17T19:32:19.813 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 17497 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/cmac.ko 2024-04-17T19:32:19.813 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 11721 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/crc32_generic.ko 2024-04-17T19:32:19.813 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 59129 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/cryptd.ko 2024-04-17T19:32:19.813 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 48113 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/crypto_engine.ko 2024-04-17T19:32:19.813 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 32169 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/crypto_simd.ko 2024-04-17T19:32:19.813 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 30881 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/crypto_user.ko 2024-04-17T19:32:19.813 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 21697 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/cts.ko 2024-04-17T19:32:19.813 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 12481 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/des_generic.ko 2024-04-17T19:32:19.813 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 18561 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/dh_generic.ko 2024-04-17T19:32:19.813 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 12857 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/echainiv.ko 2024-04-17T19:32:19.814 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 30689 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/essiv.ko 2024-04-17T19:32:19.814 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 19209 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/fcrypt.ko 2024-04-17T19:32:19.814 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 28201 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/khazad.ko 2024-04-17T19:32:19.814 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 19089 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/lrw.ko 2024-04-17T19:32:19.814 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 14105 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/lz4.ko 2024-04-17T19:32:19.814 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 14073 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/lz4hc.ko 2024-04-17T19:32:19.814 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 13393 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/md4.ko 2024-04-17T19:32:19.814 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 11249 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/michael_mic.ko 2024-04-17T19:32:19.814 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 12993 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/pcbc.ko 2024-04-17T19:32:19.814 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 23073 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/pcrypt.ko 2024-04-17T19:32:19.814 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 17665 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/rmd160.ko 2024-04-17T19:32:19.814 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 30673 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/seed.ko 2024-04-17T19:32:19.814 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 28865 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/serpent_generic.ko 2024-04-17T19:32:19.814 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 169065 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/tcrypt.ko 2024-04-17T19:32:19.815 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 12945 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/tea.ko 2024-04-17T19:32:19.815 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 29641 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/twofish_common.ko 2024-04-17T19:32:19.815 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 14313 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/twofish_generic.ko 2024-04-17T19:32:19.815 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 19905 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/vmac.ko 2024-04-17T19:32:19.815 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 38209 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/wp512.ko 2024-04-17T19:32:19.815 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 16617 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/xcbc.ko 2024-04-17T19:32:19.815 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 30345 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/xor.ko 2024-04-17T19:32:19.815 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 23833 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/xts.ko 2024-04-17T19:32:19.815 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 11281 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/xxhash_generic.ko 2024-04-17T19:32:19.815 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ 2024-04-17T19:32:19.815 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/acpi/ 2024-04-17T19:32:19.815 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 21121 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/acpi/acpi_extlog.ko 2024-04-17T19:32:19.815 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 31921 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/acpi/acpi_ipmi.ko 2024-04-17T19:32:19.815 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 32281 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/acpi/acpi_pad.ko 2024-04-17T19:32:19.816 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/acpi/apei/ 2024-04-17T19:32:19.816 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 44705 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/acpi/apei/einj.ko 2024-04-17T19:32:19.816 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 14505 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/acpi/ec_sys.ko 2024-04-17T19:32:19.816 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 17705 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/acpi/platform_profile.ko 2024-04-17T19:32:19.816 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 29017 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/acpi/sbs.ko 2024-04-17T19:32:19.816 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 23385 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/acpi/sbshc.ko 2024-04-17T19:32:19.816 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 119033 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/acpi/video.ko 2024-04-17T19:32:19.816 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/ 2024-04-17T19:32:19.817 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 24497 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/acard-ahci.ko 2024-04-17T19:32:19.817 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 96825 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/ahci.ko 2024-04-17T19:32:19.817 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 15857 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/ahci_platform.ko 2024-04-17T19:32:19.817 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 107737 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/libahci.ko 2024-04-17T19:32:19.817 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 42001 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/libahci_platform.ko 2024-04-17T19:32:19.817 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 19665 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_acpi.ko 2024-04-17T19:32:19.817 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 35705 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_ali.ko 2024-04-17T19:32:19.817 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 38329 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_amd.ko 2024-04-17T19:32:19.817 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 24649 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_artop.ko 2024-04-17T19:32:19.817 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 23777 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_atiixp.ko 2024-04-17T19:32:19.817 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 28785 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_atp867x.ko 2024-04-17T19:32:19.818 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 20409 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_cmd640.ko 2024-04-17T19:32:19.818 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 28929 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_cmd64x.ko 2024-04-17T19:32:19.818 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 16633 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_cypress.ko 2024-04-17T19:32:19.818 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 20129 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_efar.ko 2024-04-17T19:32:19.818 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 25209 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_hpt366.ko 2024-04-17T19:32:19.818 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 38913 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_hpt37x.ko 2024-04-17T19:32:19.818 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 26969 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_hpt3x2n.ko 2024-04-17T19:32:19.818 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 19105 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_hpt3x3.ko 2024-04-17T19:32:19.818 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 19201 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_it8213.ko 2024-04-17T19:32:19.818 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 41289 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_it821x.ko 2024-04-17T19:32:19.818 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 14097 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_jmicron.ko 2024-04-17T19:32:19.818 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 60257 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_legacy.ko 2024-04-17T19:32:19.818 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 17017 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_marvell.ko 2024-04-17T19:32:19.819 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 18065 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_mpiix.ko 2024-04-17T19:32:19.819 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 14129 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_netcell.ko 2024-04-17T19:32:19.819 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 18977 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_ninja32.ko 2024-04-17T19:32:19.819 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 16761 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_ns87410.ko 2024-04-17T19:32:19.819 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 20321 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_ns87415.ko 2024-04-17T19:32:19.819 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 18425 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_oldpiix.ko 2024-04-17T19:32:19.819 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 17481 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_opti.ko 2024-04-17T19:32:19.819 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 23681 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_optidma.ko 2024-04-17T19:32:19.819 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 35145 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_pcmcia.ko 2024-04-17T19:32:19.819 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 43009 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_pdc2027x.ko 2024-04-17T19:32:19.819 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 23873 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_pdc202xx_old.ko 2024-04-17T19:32:19.819 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 15609 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_piccolo.ko 2024-04-17T19:32:19.819 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 17257 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_radisys.ko 2024-04-17T19:32:19.819 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 22233 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_rdc.ko 2024-04-17T19:32:19.820 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 17297 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_rz1000.ko 2024-04-17T19:32:19.820 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 15377 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_sch.ko 2024-04-17T19:32:19.820 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 26793 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_serverworks.ko 2024-04-17T19:32:19.820 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 27305 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_sil680.ko 2024-04-17T19:32:19.820 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 22833 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_sl82c105.ko 2024-04-17T19:32:19.820 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 18041 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_triflex.ko 2024-04-17T19:32:19.820 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 35025 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_via.ko 2024-04-17T19:32:19.820 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 26337 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pdc_adma.ko 2024-04-17T19:32:19.820 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 34889 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/sata_inic162x.ko 2024-04-17T19:32:19.820 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 102121 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/sata_mv.ko 2024-04-17T19:32:19.820 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 85409 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/sata_nv.ko 2024-04-17T19:32:19.820 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 44313 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/sata_promise.ko 2024-04-17T19:32:19.820 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 26673 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/sata_qstor.ko 2024-04-17T19:32:19.821 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 34025 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/sata_sil.ko 2024-04-17T19:32:19.821 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 45905 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/sata_sil24.ko 2024-04-17T19:32:19.821 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 20185 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/sata_sis.ko 2024-04-17T19:32:19.821 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 24257 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/sata_svw.ko 2024-04-17T19:32:19.821 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 53353 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/sata_sx4.ko 2024-04-17T19:32:19.821 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 17273 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/sata_uli.ko 2024-04-17T19:32:19.821 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 41049 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/sata_via.ko 2024-04-17T19:32:19.821 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 23257 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/sata_vsc.ko 2024-04-17T19:32:19.821 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/auxdisplay/ 2024-04-17T19:32:19.821 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 19113 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/auxdisplay/ks0108.ko 2024-04-17T19:32:19.821 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/bcma/ 2024-04-17T19:32:19.821 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 163969 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/bcma/bcma.ko 2024-04-17T19:32:19.821 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/block/ 2024-04-17T19:32:19.821 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/block/aoe/ 2024-04-17T19:32:19.822 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 140865 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/block/aoe/aoe.ko 2024-04-17T19:32:19.822 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/block/drbd/ 2024-04-17T19:32:19.822 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 1241657 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/block/drbd/drbd.ko 2024-04-17T19:32:19.866 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 203289 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/block/floppy.ko 2024-04-17T19:32:19.866 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/block/mtip32xx/ 2024-04-17T19:32:19.866 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 115265 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/block/mtip32xx/mtip32xx.ko 2024-04-17T19:32:19.866 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 143433 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/block/nbd.ko 2024-04-17T19:32:19.866 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/block/null_blk/ 2024-04-17T19:32:19.866 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 126617 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/block/null_blk/null_blk.ko 2024-04-17T19:32:19.866 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 119873 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/block/pktcdvd.ko 2024-04-17T19:32:19.866 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 313217 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/block/rbd.ko 2024-04-17T19:32:19.866 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/block/xen-blkback/ 2024-04-17T19:32:19.866 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 117233 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/block/xen-blkback/xen-blkback.ko 2024-04-17T19:32:19.867 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/block/zram/ 2024-04-17T19:32:19.867 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 70385 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/block/zram/zram.ko 2024-04-17T19:32:19.867 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/char/ 2024-04-17T19:32:19.867 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 35377 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/char/applicom.ko 2024-04-17T19:32:19.867 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 13369 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/char/hangcheck-timer.ko 2024-04-17T19:32:19.867 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/char/hw_random/ 2024-04-17T19:32:19.867 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 16137 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/char/hw_random/amd-rng.ko 2024-04-17T19:32:19.867 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 21537 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/char/hw_random/intel-rng.ko 2024-04-17T19:32:19.867 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 15305 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/char/hw_random/timeriomem-rng.ko 2024-04-17T19:32:19.867 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 12801 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/char/hw_random/via-rng.ko 2024-04-17T19:32:19.867 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 19273 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/char/hw_random/virtio-rng.ko 2024-04-17T19:32:19.867 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/char/ipmi/ 2024-04-17T19:32:19.867 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 37257 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/char/ipmi/ipmi_devintf.ko 2024-04-17T19:32:19.868 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 186921 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2024-04-17T19:32:19.868 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 32521 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2024-04-17T19:32:19.868 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 179561 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/char/ipmi/ipmi_si.ko 2024-04-17T19:32:19.868 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 85441 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/char/ipmi/ipmi_ssif.ko 2024-04-17T19:32:19.868 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 65313 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2024-04-17T19:32:19.868 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 43857 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/char/lp.ko 2024-04-17T19:32:19.868 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/char/mwave/ 2024-04-17T19:32:19.868 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 103409 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/char/mwave/mwave.ko 2024-04-17T19:32:19.868 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 31833 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/char/nvram.ko 2024-04-17T19:32:19.868 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 38977 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/char/ppdev.ko 2024-04-17T19:32:19.868 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 59241 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/char/tlclk.ko 2024-04-17T19:32:19.868 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/char/tpm/ 2024-04-17T19:32:19.868 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 18889 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/char/tpm/tpm_atmel.ko 2024-04-17T19:32:19.869 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 18177 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/char/tpm/tpm_i2c_atmel.ko 2024-04-17T19:32:19.869 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 29425 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/char/tpm/tpm_i2c_infineon.ko 2024-04-17T19:32:19.869 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 39193 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/char/tpm/tpm_i2c_nuvoton.ko 2024-04-17T19:32:19.869 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 34169 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/char/tpm/tpm_infineon.ko 2024-04-17T19:32:19.869 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 25961 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/char/tpm/tpm_nsc.ko 2024-04-17T19:32:19.869 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 28497 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/char/tpm/xen-tpmfront.ko 2024-04-17T19:32:19.869 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/char/xillybus/ 2024-04-17T19:32:19.869 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 19225 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/char/xillybus/xillybus_class.ko 2024-04-17T19:32:19.869 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 62545 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/char/xillybus/xillybus_core.ko 2024-04-17T19:32:19.869 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 13929 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/char/xillybus/xillybus_pcie.ko 2024-04-17T19:32:19.869 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/clk/ 2024-04-17T19:32:19.869 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 14537 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/clk/clk-palmas.ko 2024-04-17T19:32:19.869 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 57289 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/clk/clk-si5351.ko 2024-04-17T19:32:19.869 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 13385 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/clk/clk-twl6040.ko 2024-04-17T19:32:19.870 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 24129 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/clk/clk-wm831x.ko 2024-04-17T19:32:19.870 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/cpufreq/ 2024-04-17T19:32:19.870 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 11593 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2024-04-17T19:32:19.870 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 19185 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/cpufreq/p4-clockmod.ko 2024-04-17T19:32:19.870 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 28633 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/cpufreq/speedstep-lib.ko 2024-04-17T19:32:19.870 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/crypto/ 2024-04-17T19:32:19.870 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/crypto/ccp/ 2024-04-17T19:32:19.870 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 89257 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/crypto/ccp/ccp-crypto.ko 2024-04-17T19:32:19.870 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 333657 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/crypto/ccp/ccp.ko 2024-04-17T19:32:19.870 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/crypto/intel/ 2024-04-17T19:32:19.870 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/crypto/intel/qat/ 2024-04-17T19:32:19.870 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/crypto/intel/qat/qat_common/ 2024-04-17T19:32:19.870 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 751713 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2024-04-17T19:32:19.870 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/crypto/intel/qat/qat_dh895xcc/ 2024-04-17T19:32:19.871 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 29497 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2024-04-17T19:32:19.871 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 23169 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/crypto/padlock-aes.ko 2024-04-17T19:32:19.871 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 26721 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/crypto/padlock-sha.ko 2024-04-17T19:32:19.871 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/crypto/virtio/ 2024-04-17T19:32:19.871 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 90441 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/crypto/virtio/virtio_crypto.ko 2024-04-17T19:32:19.871 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/dca/ 2024-04-17T19:32:19.871 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 36105 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/dca/dca.ko 2024-04-17T19:32:19.871 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/dma/ 2024-04-17T19:32:19.871 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/dma/dw/ 2024-04-17T19:32:19.871 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 18593 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/dma/dw/dw_dmac.ko 2024-04-17T19:32:19.871 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/dma/ioat/ 2024-04-17T19:32:19.871 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 146769 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/dma/ioat/ioatdma.ko 2024-04-17T19:32:19.871 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/edac/ 2024-04-17T19:32:19.872 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 96145 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/edac/amd64_edac.ko 2024-04-17T19:32:19.872 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 41993 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/edac/e752x_edac.ko 2024-04-17T19:32:19.872 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 51105 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/edac/edac_mce_amd.ko 2024-04-17T19:32:19.872 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 21017 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/edac/i3000_edac.ko 2024-04-17T19:32:19.872 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 20729 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/edac/i3200_edac.ko 2024-04-17T19:32:19.872 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 26729 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/edac/i5100_edac.ko 2024-04-17T19:32:19.872 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 29593 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/edac/i5400_edac.ko 2024-04-17T19:32:19.872 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 28385 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/edac/i7300_edac.ko 2024-04-17T19:32:19.872 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 64161 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/edac/i7core_edac.ko 2024-04-17T19:32:19.872 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 21289 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/edac/i82975x_edac.ko 2024-04-17T19:32:19.872 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 22369 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/edac/ie31200_edac.ko 2024-04-17T19:32:19.872 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 68697 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/edac/sb_edac.ko 2024-04-17T19:32:19.872 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 20241 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/edac/x38_edac.ko 2024-04-17T19:32:19.872 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/extcon/ 2024-04-17T19:32:19.873 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 14593 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/extcon/extcon-gpio.ko 2024-04-17T19:32:19.873 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 31369 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/extcon/extcon-max14577.ko 2024-04-17T19:32:19.873 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 35601 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/extcon/extcon-max77693.ko 2024-04-17T19:32:19.873 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 29273 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/extcon/extcon-max8997.ko 2024-04-17T19:32:19.873 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 30961 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/extcon/extcon-palmas.ko 2024-04-17T19:32:19.873 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 27201 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/extcon/extcon-rt8973a.ko 2024-04-17T19:32:19.873 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 31993 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/extcon/extcon-sm5502.ko 2024-04-17T19:32:19.873 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/firmware/ 2024-04-17T19:32:19.873 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 42953 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/firmware/dmi-sysfs.ko 2024-04-17T19:32:19.873 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/firmware/efi/ 2024-04-17T19:32:19.873 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 19721 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/firmware/efi/efi-pstore.ko 2024-04-17T19:32:19.873 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 26361 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/firmware/iscsi_ibft.ko 2024-04-17T19:32:19.873 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/gpio/ 2024-04-17T19:32:19.873 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 14281 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/gpio/gpio-adp5520.ko 2024-04-17T19:32:19.874 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 23233 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/gpio/gpio-amd8111.ko 2024-04-17T19:32:19.874 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 17689 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/gpio/gpio-arizona.ko 2024-04-17T19:32:19.874 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 16745 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/gpio/gpio-da9052.ko 2024-04-17T19:32:19.874 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 13993 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/gpio/gpio-da9055.ko 2024-04-17T19:32:19.874 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 26945 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/gpio/gpio-dln2.ko 2024-04-17T19:32:19.874 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 81073 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/gpio/gpio-f7188x.ko 2024-04-17T19:32:19.874 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 40761 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/gpio/gpio-generic.ko 2024-04-17T19:32:19.874 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 22513 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/gpio/gpio-ich.ko 2024-04-17T19:32:19.874 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 14033 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/gpio/gpio-janz-ttl.ko 2024-04-17T19:32:19.874 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 16889 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/gpio/gpio-kempld.ko 2024-04-17T19:32:19.874 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 14681 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/gpio/gpio-lp3943.ko 2024-04-17T19:32:19.874 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 11153 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/gpio/gpio-max7300.ko 2024-04-17T19:32:19.874 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 14817 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/gpio/gpio-max730x.ko 2024-04-17T19:32:19.874 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 24745 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/gpio/gpio-max732x.ko 2024-04-17T19:32:19.875 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 29945 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/gpio/gpio-ml-ioh.ko 2024-04-17T19:32:19.875 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 55505 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/gpio/gpio-pca953x.ko 2024-04-17T19:32:19.875 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 31881 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/gpio/gpio-pcf857x.ko 2024-04-17T19:32:19.875 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 16689 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/gpio/gpio-rdc321x.ko 2024-04-17T19:32:19.875 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 24353 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/gpio/gpio-sch.ko 2024-04-17T19:32:19.875 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 23145 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/gpio/gpio-sch311x.ko 2024-04-17T19:32:19.875 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 14265 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/gpio/gpio-tps65912.ko 2024-04-17T19:32:19.875 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 25009 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/gpio/gpio-twl4030.ko 2024-04-17T19:32:19.875 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 13113 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/gpio/gpio-twl6040.ko 2024-04-17T19:32:19.875 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 24457 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/gpio/gpio-viperboard.ko 2024-04-17T19:32:19.875 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 17897 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/gpio/gpio-vx855.ko 2024-04-17T19:32:19.875 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 19129 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/gpio/gpio-wm831x.ko 2024-04-17T19:32:19.875 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 13665 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/gpio/gpio-wm8350.ko 2024-04-17T19:32:19.875 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 20401 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/gpio/gpio-wm8994.ko 2024-04-17T19:32:19.876 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/ 2024-04-17T19:32:19.876 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 13521 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-a4tech.ko 2024-04-17T19:32:19.876 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 43553 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-apple.ko 2024-04-17T19:32:19.876 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 16881 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-appleir.ko 2024-04-17T19:32:19.876 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 9393 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-aureal.ko 2024-04-17T19:32:19.876 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 17097 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-axff.ko 2024-04-17T19:32:19.876 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 12697 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-belkin.ko 2024-04-17T19:32:19.876 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 11713 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-cherry.ko 2024-04-17T19:32:19.876 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 19089 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-chicony.ko 2024-04-17T19:32:19.876 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 74393 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-cp2112.ko 2024-04-17T19:32:19.876 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 12817 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-cypress.ko 2024-04-17T19:32:19.876 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 18769 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-dr.ko 2024-04-17T19:32:19.876 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 12113 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-elecom.ko 2024-04-17T19:32:19.877 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 20449 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-elo.ko 2024-04-17T19:32:19.877 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 15137 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-emsff.ko 2024-04-17T19:32:19.877 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 11665 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-ezkey.ko 2024-04-17T19:32:19.877 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 16089 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-gaff.ko 2024-04-17T19:32:19.877 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 10681 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-generic.ko 2024-04-17T19:32:19.877 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 19793 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-gt683r.ko 2024-04-17T19:32:19.877 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 14665 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-gyration.ko 2024-04-17T19:32:19.877 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 12081 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-holtek-kbd.ko 2024-04-17T19:32:19.877 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 11921 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-holtek-mouse.ko 2024-04-17T19:32:19.877 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 16433 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-holtekff.ko 2024-04-17T19:32:19.877 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 22889 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-hyperv.ko 2024-04-17T19:32:19.877 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 11889 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-icade.ko 2024-04-17T19:32:19.877 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 10457 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-kensington.ko 2024-04-17T19:32:19.877 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 9529 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-keytouch.ko 2024-04-17T19:32:19.878 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 19169 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-kye.ko 2024-04-17T19:32:19.878 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 12265 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-lcpower.ko 2024-04-17T19:32:19.878 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 24961 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-led.ko 2024-04-17T19:32:19.878 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 54217 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-lenovo.ko 2024-04-17T19:32:19.878 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 37553 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-lg-g15.ko 2024-04-17T19:32:19.878 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 68081 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-logitech-dj.ko 2024-04-17T19:32:19.878 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 121369 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-logitech-hidpp.ko 2024-04-17T19:32:19.878 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 97953 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-logitech.ko 2024-04-17T19:32:19.878 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 36689 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-magicmouse.ko 2024-04-17T19:32:19.878 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 25769 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-microsoft.ko 2024-04-17T19:32:19.878 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 11825 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-monterey.ko 2024-04-17T19:32:19.878 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 59001 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-multitouch.ko 2024-04-17T19:32:19.878 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 39697 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-ntrig.ko 2024-04-17T19:32:19.878 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 9985 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-ortek.ko 2024-04-17T19:32:19.879 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 10177 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-penmount.ko 2024-04-17T19:32:19.879 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 14281 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-petalynx.ko 2024-04-17T19:32:19.879 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 91241 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-picolcd.ko 2024-04-17T19:32:19.879 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 15793 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-pl.ko 2024-04-17T19:32:19.879 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 16817 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-plantronics.ko 2024-04-17T19:32:19.879 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 9417 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-primax.ko 2024-04-17T19:32:19.879 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 42889 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-rmi.ko 2024-04-17T19:32:19.879 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 25177 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-roccat-arvo.ko 2024-04-17T19:32:19.879 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 16321 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-roccat-common.ko 2024-04-17T19:32:19.879 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 38865 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-roccat-isku.ko 2024-04-17T19:32:19.879 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 36305 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-roccat-kone.ko 2024-04-17T19:32:19.879 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 38073 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-roccat-koneplus.ko 2024-04-17T19:32:19.879 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 26097 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-roccat-konepure.ko 2024-04-17T19:32:19.880 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 35625 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-roccat-kovaplus.ko 2024-04-17T19:32:19.880 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 15481 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-roccat-lua.ko 2024-04-17T19:32:19.880 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 35425 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-roccat-pyra.ko 2024-04-17T19:32:19.880 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 35561 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-roccat-ryos.ko 2024-04-17T19:32:19.880 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 23993 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-roccat-savu.ko 2024-04-17T19:32:19.880 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 28001 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-roccat.ko 2024-04-17T19:32:19.880 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 15721 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-saitek.ko 2024-04-17T19:32:19.880 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 42305 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-samsung.ko 2024-04-17T19:32:19.880 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 43609 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-sensor-hub.ko 2024-04-17T19:32:19.880 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 15145 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-sjoy.ko 2024-04-17T19:32:19.880 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 62129 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-sony.ko 2024-04-17T19:32:19.880 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 9353 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-speedlink.ko 2024-04-17T19:32:19.880 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 30017 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-steelseries.ko 2024-04-17T19:32:19.880 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 11185 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-sunplus.ko 2024-04-17T19:32:19.880 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 19289 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-thrustmaster.ko 2024-04-17T19:32:19.881 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 11857 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-tivo.ko 2024-04-17T19:32:19.881 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 16681 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-tmff.ko 2024-04-17T19:32:19.881 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 16537 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-topseed.ko 2024-04-17T19:32:19.881 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 19273 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-twinhan.ko 2024-04-17T19:32:19.881 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 81113 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-uclogic.ko 2024-04-17T19:32:19.881 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 12569 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-waltop.ko 2024-04-17T19:32:19.881 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 184745 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-wiimote.ko 2024-04-17T19:32:19.881 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 9185 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-xinmo.ko 2024-04-17T19:32:19.881 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 14961 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-zpff.ko 2024-04-17T19:32:19.882 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 19201 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-zydacron.ko 2024-04-17T19:32:19.882 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 319921 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid.ko 2024-04-17T19:32:19.882 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 39529 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/uhid.ko 2024-04-17T19:32:19.882 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/usbhid/ 2024-04-17T19:32:19.882 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 153633 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/usbhid/usbhid.ko 2024-04-17T19:32:19.882 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 22361 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/usbhid/usbkbd.ko 2024-04-17T19:32:19.882 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 17457 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/usbhid/usbmouse.ko 2024-04-17T19:32:19.882 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 261945 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/wacom.ko 2024-04-17T19:32:19.882 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hv/ 2024-04-17T19:32:19.882 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 75065 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hv/hv_balloon.ko 2024-04-17T19:32:19.882 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 110681 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hv/hv_utils.ko 2024-04-17T19:32:19.882 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 382033 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hv/hv_vmbus.ko 2024-04-17T19:32:19.882 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/ 2024-04-17T19:32:19.883 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 77153 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/abituguru.ko 2024-04-17T19:32:19.883 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 67009 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/abituguru3.ko 2024-04-17T19:32:19.883 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 42249 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/acpi_power_meter.ko 2024-04-17T19:32:19.883 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 20297 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/ad7414.ko 2024-04-17T19:32:19.883 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 22009 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/ad7418.ko 2024-04-17T19:32:19.883 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 29449 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/adc128d818.ko 2024-04-17T19:32:19.883 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 38097 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/adm1025.ko 2024-04-17T19:32:19.883 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 115057 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/adm1026.ko 2024-04-17T19:32:19.883 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 23321 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/adm1029.ko 2024-04-17T19:32:19.883 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 55225 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/adm1031.ko 2024-04-17T19:32:19.883 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 31441 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/adm9240.ko 2024-04-17T19:32:19.883 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 16257 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/ads7828.ko 2024-04-17T19:32:19.883 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 12249 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/adt7410.ko 2024-04-17T19:32:19.883 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 26505 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/adt7411.ko 2024-04-17T19:32:19.884 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 89025 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/adt7462.ko 2024-04-17T19:32:19.884 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 49153 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/adt7470.ko 2024-04-17T19:32:19.884 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 81473 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/adt7475.ko 2024-04-17T19:32:19.884 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 22913 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/adt7x10.ko 2024-04-17T19:32:19.884 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 48177 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/amc6821.ko 2024-04-17T19:32:19.884 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 68865 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/applesmc.ko 2024-04-17T19:32:19.884 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 60193 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/asb100.ko 2024-04-17T19:32:19.884 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 69009 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/asc7621.ko 2024-04-17T19:32:19.884 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 47977 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/asus_atk0110.ko 2024-04-17T19:32:19.884 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 20321 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/atxp1.ko 2024-04-17T19:32:19.884 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 33641 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/coretemp.ko 2024-04-17T19:32:19.884 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 29401 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/da9052-hwmon.ko 2024-04-17T19:32:19.884 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 19801 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/da9055-hwmon.ko 2024-04-17T19:32:19.884 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 55713 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/dell-smm-hwmon.ko 2024-04-17T19:32:19.885 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 113201 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/dme1737.ko 2024-04-17T19:32:19.885 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 22689 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/ds1621.ko 2024-04-17T19:32:19.885 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 17489 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/ds620.ko 2024-04-17T19:32:19.885 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 33665 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/emc1403.ko 2024-04-17T19:32:19.885 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 40177 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/emc2103.ko 2024-04-17T19:32:19.885 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 34649 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/emc6w201.ko 2024-04-17T19:32:19.885 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 78921 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/f71805f.ko 2024-04-17T19:32:19.885 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 108961 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/f71882fg.ko 2024-04-17T19:32:19.885 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 50697 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/f75375s.ko 2024-04-17T19:32:19.885 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 25361 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/fam15h_power.ko 2024-04-17T19:32:19.885 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 65769 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/fschmd.ko 2024-04-17T19:32:19.885 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 17201 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/g760a.ko 2024-04-17T19:32:19.885 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 30585 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/g762.ko 2024-04-17T19:32:19.885 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 59761 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/gl518sm.ko 2024-04-17T19:32:19.886 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 56313 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/gl520sm.ko 2024-04-17T19:32:19.886 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 15473 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/hih6130.ko 2024-04-17T19:32:19.886 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 12089 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/hwmon-vid.ko 2024-04-17T19:32:19.886 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 13137 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/i5500_temp.ko 2024-04-17T19:32:19.886 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 27633 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/i5k_amb.ko 2024-04-17T19:32:19.886 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 42585 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/ibmaem.ko 2024-04-17T19:32:19.886 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 24945 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/ibmpex.ko 2024-04-17T19:32:19.886 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 28409 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/ina209.ko 2024-04-17T19:32:19.886 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 14537 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/ina2xx.ko 2024-04-17T19:32:19.886 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 156465 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/it87.ko 2024-04-17T19:32:19.886 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 23129 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/jc42.ko 2024-04-17T19:32:19.886 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 28273 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/k10temp.ko 2024-04-17T19:32:19.886 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 15729 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/k8temp.ko 2024-04-17T19:32:19.887 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 21713 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/lineage-pem.ko 2024-04-17T19:32:19.887 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 57769 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/lm63.ko 2024-04-17T19:32:19.887 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 19777 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/lm73.ko 2024-04-17T19:32:19.887 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 44121 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/lm75.ko 2024-04-17T19:32:19.887 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 23241 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/lm77.ko 2024-04-17T19:32:19.887 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 41473 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/lm78.ko 2024-04-17T19:32:19.887 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 37049 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/lm80.ko 2024-04-17T19:32:19.887 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 20545 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/lm83.ko 2024-04-17T19:32:19.887 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 86497 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/lm85.ko 2024-04-17T19:32:19.887 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 55641 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/lm87.ko 2024-04-17T19:32:19.887 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 42249 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/lm90.ko 2024-04-17T19:32:19.887 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 23385 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/lm92.ko 2024-04-17T19:32:19.887 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 131505 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/lm93.ko 2024-04-17T19:32:19.887 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 40225 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/lm95234.ko 2024-04-17T19:32:19.887 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 19137 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/lm95241.ko 2024-04-17T19:32:19.888 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 21689 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/lm95245.ko 2024-04-17T19:32:19.888 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 26393 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/ltc2945.ko 2024-04-17T19:32:19.888 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 15481 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/ltc4151.ko 2024-04-17T19:32:19.888 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 17793 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/ltc4215.ko 2024-04-17T19:32:19.888 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 16633 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/ltc4222.ko 2024-04-17T19:32:19.888 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 18377 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/ltc4245.ko 2024-04-17T19:32:19.888 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 14905 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/ltc4260.ko 2024-04-17T19:32:19.888 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 17113 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/ltc4261.ko 2024-04-17T19:32:19.888 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 36769 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/max16065.ko 2024-04-17T19:32:19.888 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 21585 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/max1619.ko 2024-04-17T19:32:19.888 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 28313 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/max1668.ko 2024-04-17T19:32:19.888 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 22753 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/max197.ko 2024-04-17T19:32:19.888 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 32505 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/max6639.ko 2024-04-17T19:32:19.888 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 27305 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/max6650.ko 2024-04-17T19:32:19.889 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 39729 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/max6697.ko 2024-04-17T19:32:19.889 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 21513 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/mc13783-adc.ko 2024-04-17T19:32:19.889 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 12353 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/mcp3021.ko 2024-04-17T19:32:19.889 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 17873 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/menf21bmc_hwmon.ko 2024-04-17T19:32:19.889 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 56505 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/nct6683.ko 2024-04-17T19:32:19.889 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 141353 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/nct6775-core.ko 2024-04-17T19:32:19.889 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 72737 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/nct6775.ko 2024-04-17T19:32:19.889 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 67841 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/nct7802.ko 2024-04-17T19:32:19.889 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 97777 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/pc87360.ko 2024-04-17T19:32:19.889 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 61921 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/pc87427.ko 2024-04-17T19:32:19.889 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 21825 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/pcf8591.ko 2024-04-17T19:32:19.889 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/pmbus/ 2024-04-17T19:32:19.889 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 24753 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/pmbus/adm1275.ko 2024-04-17T19:32:19.889 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 19313 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/pmbus/lm25066.ko 2024-04-17T19:32:19.890 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 33265 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/pmbus/ltc2978.ko 2024-04-17T19:32:19.890 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 10793 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/pmbus/max16064.ko 2024-04-17T19:32:19.890 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 19841 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/pmbus/max34440.ko 2024-04-17T19:32:19.890 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 11961 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/pmbus/max8688.ko 2024-04-17T19:32:19.890 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 17585 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/pmbus/pmbus.ko 2024-04-17T19:32:19.890 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 101233 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2024-04-17T19:32:19.890 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 9337 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/pmbus/tps40422.ko 2024-04-17T19:32:19.890 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 36177 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/pmbus/ucd9000.ko 2024-04-17T19:32:19.890 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 16873 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/pmbus/ucd9200.ko 2024-04-17T19:32:19.890 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 24441 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/pmbus/zl6100.ko 2024-04-17T19:32:19.890 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 15353 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/powr1220.ko 2024-04-17T19:32:19.890 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 25433 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/sch5627.ko 2024-04-17T19:32:19.890 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 32945 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/sch5636.ko 2024-04-17T19:32:19.890 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 34561 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/sch56xx-common.ko 2024-04-17T19:32:19.891 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 40849 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/sht15.ko 2024-04-17T19:32:19.891 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 15977 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/sht21.ko 2024-04-17T19:32:19.891 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 19337 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/shtc1.ko 2024-04-17T19:32:19.891 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 48713 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/sis5595.ko 2024-04-17T19:32:19.891 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 22401 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/smsc47b397.ko 2024-04-17T19:32:19.891 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 46473 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/smsc47m1.ko 2024-04-17T19:32:19.891 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 44313 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/smsc47m192.ko 2024-04-17T19:32:19.891 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 31417 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/thmc50.ko 2024-04-17T19:32:19.891 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 20089 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/tmp102.ko 2024-04-17T19:32:19.891 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 16441 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/tmp103.ko 2024-04-17T19:32:19.891 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 25185 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/tmp401.ko 2024-04-17T19:32:19.891 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 23097 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/tmp421.ko 2024-04-17T19:32:19.891 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 23033 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/via-cputemp.ko 2024-04-17T19:32:19.892 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 50217 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/via686a.ko 2024-04-17T19:32:19.892 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 59665 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/vt1211.ko 2024-04-17T19:32:19.892 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 62737 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/vt8231.ko 2024-04-17T19:32:19.892 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 71169 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/w83627ehf.ko 2024-04-17T19:32:19.892 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 96577 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/w83627hf.ko 2024-04-17T19:32:19.892 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 85913 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/w83781d.ko 2024-04-17T19:32:19.892 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 75129 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/w83791d.ko 2024-04-17T19:32:19.892 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 83425 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/w83792d.ko 2024-04-17T19:32:19.892 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 116777 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/w83793.ko 2024-04-17T19:32:19.892 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 134441 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/w83795.ko 2024-04-17T19:32:19.892 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 20121 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/w83l785ts.ko 2024-04-17T19:32:19.892 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 43385 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/w83l786ng.ko 2024-04-17T19:32:19.892 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 15481 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/wm831x-hwmon.ko 2024-04-17T19:32:19.892 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 12001 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/wm8350-hwmon.ko 2024-04-17T19:32:19.893 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/ 2024-04-17T19:32:19.893 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/algos/ 2024-04-17T19:32:19.893 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 27353 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2024-04-17T19:32:19.893 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 25273 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2024-04-17T19:32:19.893 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/busses/ 2024-04-17T19:32:19.893 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 33345 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/busses/i2c-ali1535.ko 2024-04-17T19:32:19.893 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 35073 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/busses/i2c-ali1563.ko 2024-04-17T19:32:19.893 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 32905 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/busses/i2c-ali15x3.ko 2024-04-17T19:32:19.893 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 21369 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2024-04-17T19:32:19.893 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 30361 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/busses/i2c-amd756.ko 2024-04-17T19:32:19.893 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 19313 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/busses/i2c-amd8111.ko 2024-04-17T19:32:19.893 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 17737 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/busses/i2c-cbus-gpio.ko 2024-04-17T19:32:19.893 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 7729 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2024-04-17T19:32:19.893 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 15841 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/busses/i2c-cros-ec-tunnel.ko 2024-04-17T19:32:19.894 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 64233 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/busses/i2c-designware-core.ko 2024-04-17T19:32:19.894 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 28161 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2024-04-17T19:32:19.894 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 24233 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2024-04-17T19:32:19.894 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 19905 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2024-04-17T19:32:19.894 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 14409 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/busses/i2c-dln2.ko 2024-04-17T19:32:19.894 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 20257 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/busses/i2c-gpio.ko 2024-04-17T19:32:19.894 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 76969 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/busses/i2c-i801.ko 2024-04-17T19:32:19.894 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 24705 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/busses/i2c-isch.ko 2024-04-17T19:32:19.894 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 52937 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/busses/i2c-ismt.ko 2024-04-17T19:32:19.894 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 20953 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/busses/i2c-kempld.ko 2024-04-17T19:32:19.894 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 21305 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2024-04-17T19:32:19.894 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 25945 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/busses/i2c-nforce2.ko 2024-04-17T19:32:19.894 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 33209 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/busses/i2c-ocores.ko 2024-04-17T19:32:19.894 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 30049 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/busses/i2c-parport.ko 2024-04-17T19:32:19.895 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 20057 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2024-04-17T19:32:19.895 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 57217 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/busses/i2c-piix4.ko 2024-04-17T19:32:19.895 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 17441 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/busses/i2c-robotfuzz-osif.ko 2024-04-17T19:32:19.895 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 21145 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/busses/i2c-scmi.ko 2024-04-17T19:32:19.895 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 13961 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/busses/i2c-simtec.ko 2024-04-17T19:32:19.895 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 24713 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/busses/i2c-sis5595.ko 2024-04-17T19:32:19.895 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 32585 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/busses/i2c-sis630.ko 2024-04-17T19:32:19.895 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 22609 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/busses/i2c-sis96x.ko 2024-04-17T19:32:19.895 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 22825 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/busses/i2c-taos-evm.ko 2024-04-17T19:32:19.895 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 22649 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2024-04-17T19:32:19.895 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 15833 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/busses/i2c-via.ko 2024-04-17T19:32:19.895 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 29993 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/busses/i2c-viapro.ko 2024-04-17T19:32:19.895 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 21793 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/busses/i2c-viperboard.ko 2024-04-17T19:32:19.895 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 59193 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/busses/i2c-xiic.ko 2024-04-17T19:32:19.896 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 27849 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/i2c-mux.ko 2024-04-17T19:32:19.896 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 21873 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/i2c-smbus.ko 2024-04-17T19:32:19.896 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 29577 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/i2c-stub.ko 2024-04-17T19:32:19.896 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/muxes/ 2024-04-17T19:32:19.896 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 17649 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/muxes/i2c-mux-gpio.ko 2024-04-17T19:32:19.896 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 16001 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/muxes/i2c-mux-pca9541.ko 2024-04-17T19:32:19.896 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 36569 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/muxes/i2c-mux-pca954x.ko 2024-04-17T19:32:19.896 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/infiniband/ 2024-04-17T19:32:19.896 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/infiniband/core/ 2024-04-17T19:32:19.896 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 329697 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/infiniband/core/ib_cm.ko 2024-04-17T19:32:19.896 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 1119913 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/infiniband/core/ib_core.ko 2024-04-17T19:32:19.896 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 83905 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/infiniband/core/ib_umad.ko 2024-04-17T19:32:19.896 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 408433 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/infiniband/core/ib_uverbs.ko 2024-04-17T19:32:19.897 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 120921 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/infiniband/core/iw_cm.ko 2024-04-17T19:32:19.897 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 347217 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/infiniband/core/rdma_cm.ko 2024-04-17T19:32:19.897 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 84945 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/infiniband/core/rdma_ucm.ko 2024-04-17T19:32:19.897 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/infiniband/hw/ 2024-04-17T19:32:19.897 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/infiniband/hw/cxgb4/ 2024-04-17T19:32:19.897 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 590929 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2024-04-17T19:32:19.897 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/infiniband/hw/mlx4/ 2024-04-17T19:32:19.897 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 514641 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2024-04-17T19:32:19.897 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/infiniband/hw/mlx5/ 2024-04-17T19:32:19.897 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 911665 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2024-04-17T19:32:19.898 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/infiniband/hw/mthca/ 2024-04-17T19:32:19.898 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 375545 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2024-04-17T19:32:19.898 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/infiniband/hw/ocrdma/ 2024-04-17T19:32:19.898 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 197121 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/infiniband/hw/ocrdma/ocrdma.ko 2024-04-17T19:32:19.898 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/infiniband/hw/usnic/ 2024-04-17T19:32:19.898 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 212553 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/infiniband/hw/usnic/usnic_verbs.ko 2024-04-17T19:32:19.930 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/infiniband/ulp/ 2024-04-17T19:32:19.931 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/infiniband/ulp/ipoib/ 2024-04-17T19:32:19.931 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 334401 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2024-04-17T19:32:19.931 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/infiniband/ulp/iser/ 2024-04-17T19:32:19.931 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 120673 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2024-04-17T19:32:19.931 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/infiniband/ulp/isert/ 2024-04-17T19:32:19.931 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 132585 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2024-04-17T19:32:19.931 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/infiniband/ulp/srp/ 2024-04-17T19:32:19.931 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 157937 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2024-04-17T19:32:19.931 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/infiniband/ulp/srpt/ 2024-04-17T19:32:19.931 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 156673 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2024-04-17T19:32:19.931 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/ 2024-04-17T19:32:19.931 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 12201 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/evbug.ko 2024-04-17T19:32:19.931 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 27609 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/ff-memless.ko 2024-04-17T19:32:19.932 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/gameport/ 2024-04-17T19:32:19.932 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 13401 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/gameport/emu10k1-gp.ko 2024-04-17T19:32:19.932 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 13985 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/gameport/fm801-gp.ko 2024-04-17T19:32:19.932 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 50713 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/gameport/gameport.ko 2024-04-17T19:32:19.932 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 49441 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/joydev.ko 2024-04-17T19:32:19.932 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/keyboard/ 2024-04-17T19:32:19.932 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 15537 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/keyboard/adp5520-keys.ko 2024-04-17T19:32:19.932 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 14753 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/keyboard/adp5588-keys.ko 2024-04-17T19:32:19.932 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 35665 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/keyboard/adp5589-keys.ko 2024-04-17T19:32:19.932 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 28305 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/keyboard/cros_ec_keyb.ko 2024-04-17T19:32:19.933 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 45473 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/keyboard/gpio_keys.ko 2024-04-17T19:32:19.933 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 22257 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/keyboard/gpio_keys_polled.ko 2024-04-17T19:32:19.933 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 25617 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/keyboard/lkkbd.ko 2024-04-17T19:32:19.933 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 31857 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/keyboard/lm8323.ko 2024-04-17T19:32:19.933 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 16761 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/keyboard/lm8333.ko 2024-04-17T19:32:19.933 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 25825 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/keyboard/matrix_keypad.ko 2024-04-17T19:32:19.933 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 21465 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/keyboard/max7359_keypad.ko 2024-04-17T19:32:19.933 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 19257 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/keyboard/mcs_touchkey.ko 2024-04-17T19:32:19.933 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 19121 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/keyboard/mpr121_touchkey.ko 2024-04-17T19:32:19.933 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 13281 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/keyboard/newtonkbd.ko 2024-04-17T19:32:19.933 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 12233 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/keyboard/opencores-kbd.ko 2024-04-17T19:32:19.933 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 17105 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/keyboard/qt1070.ko 2024-04-17T19:32:19.934 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 21561 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/keyboard/qt2160.ko 2024-04-17T19:32:19.934 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 28689 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/keyboard/samsung-keypad.ko 2024-04-17T19:32:19.934 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 13121 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/keyboard/stowaway.ko 2024-04-17T19:32:19.934 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 22337 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/keyboard/sunkbd.ko 2024-04-17T19:32:19.934 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 20649 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/keyboard/tca6416-keypad.ko 2024-04-17T19:32:19.934 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 18921 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/keyboard/tca8418_keypad.ko 2024-04-17T19:32:19.934 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 19569 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/keyboard/twl4030_keypad.ko 2024-04-17T19:32:19.934 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 13457 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/keyboard/xtkbd.ko 2024-04-17T19:32:19.934 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 13137 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/matrix-keymap.ko 2024-04-17T19:32:19.934 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/mouse/ 2024-04-17T19:32:19.934 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 40617 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/mouse/appletouch.ko 2024-04-17T19:32:19.934 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 39553 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/mouse/bcm5974.ko 2024-04-17T19:32:19.934 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 160017 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/mouse/cyapatp.ko 2024-04-17T19:32:19.935 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 114273 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/mouse/elan_i2c.ko 2024-04-17T19:32:19.935 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 15985 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/mouse/gpio_mouse.ko 2024-04-17T19:32:19.935 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 428185 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/mouse/psmouse.ko 2024-04-17T19:32:19.935 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 16937 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/mouse/sermouse.ko 2024-04-17T19:32:19.935 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 27865 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/mouse/synaptics_i2c.ko 2024-04-17T19:32:19.935 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 27193 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/mouse/synaptics_usb.ko 2024-04-17T19:32:19.935 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 18809 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/mouse/vsxxxaa.ko 2024-04-17T19:32:19.935 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/rmi4/ 2024-04-17T19:32:19.935 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 140969 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/rmi4/rmi_core.ko 2024-04-17T19:32:19.935 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/serio/ 2024-04-17T19:32:19.935 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 13721 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/serio/altera_ps2.ko 2024-04-17T19:32:19.935 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 18865 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/serio/arc_ps2.ko 2024-04-17T19:32:19.935 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 20385 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/serio/ct82c710.ko 2024-04-17T19:32:19.935 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 20289 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/serio/hyperv-keyboard.ko 2024-04-17T19:32:19.936 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 18393 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/serio/parkbd.ko 2024-04-17T19:32:19.936 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 15537 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/serio/pcips2.ko 2024-04-17T19:32:19.936 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 23777 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/serio/ps2mult.ko 2024-04-17T19:32:19.936 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 28905 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/serio/serio_raw.ko 2024-04-17T19:32:19.936 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 21721 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/serio/serport.ko 2024-04-17T19:32:19.936 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 16321 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/sparse-keymap.ko 2024-04-17T19:32:19.936 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/leds/ 2024-04-17T19:32:19.936 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 15737 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/leds/leds-88pm860x.ko 2024-04-17T19:32:19.936 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 13161 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/leds/leds-adp5520.ko 2024-04-17T19:32:19.936 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 77265 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/leds/leds-bd2802.ko 2024-04-17T19:32:19.936 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 31097 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/leds/leds-blinkm.ko 2024-04-17T19:32:19.937 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 11897 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/leds/leds-da903x.ko 2024-04-17T19:32:19.937 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 14729 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/leds/leds-da9052.ko 2024-04-17T19:32:19.937 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 20017 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/leds/leds-gpio.ko 2024-04-17T19:32:19.937 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 18721 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/leds/leds-lm3530.ko 2024-04-17T19:32:19.937 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 36705 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/leds/leds-lm3533.ko 2024-04-17T19:32:19.937 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 22873 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/leds/leds-lm355x.ko 2024-04-17T19:32:19.937 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 23833 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/leds/leds-lm3642.ko 2024-04-17T19:32:19.937 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 18769 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/leds/leds-lp3944.ko 2024-04-17T19:32:19.937 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 12809 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/leds/leds-lp8788.ko 2024-04-17T19:32:19.937 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 18041 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/leds/leds-max8997.ko 2024-04-17T19:32:19.937 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 14177 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/leds/leds-mc13783.ko 2024-04-17T19:32:19.937 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 14617 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/leds/leds-menf21bmc.ko 2024-04-17T19:32:19.937 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 25617 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/leds/leds-pca9532.ko 2024-04-17T19:32:19.937 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 23809 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/leds/leds-pca955x.ko 2024-04-17T19:32:19.938 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 21817 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/leds/leds-pca963x.ko 2024-04-17T19:32:19.938 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 38113 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/leds/leds-ss4200.ko 2024-04-17T19:32:19.938 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 28337 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/leds/leds-tca6507.ko 2024-04-17T19:32:19.938 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 18177 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/leds/leds-wm831x-status.ko 2024-04-17T19:32:19.938 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 13633 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/leds/leds-wm8350.ko 2024-04-17T19:32:19.938 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/leds/trigger/ 2024-04-17T19:32:19.938 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 11761 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/leds/trigger/ledtrig-audio.ko 2024-04-17T19:32:19.938 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 12649 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2024-04-17T19:32:19.938 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 10233 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/leds/trigger/ledtrig-camera.ko 2024-04-17T19:32:19.938 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 8641 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2024-04-17T19:32:19.938 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 15073 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/leds/trigger/ledtrig-gpio.ko 2024-04-17T19:32:19.938 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 16601 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2024-04-17T19:32:19.938 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 16769 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2024-04-17T19:32:19.938 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 13961 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/leds/trigger/ledtrig-timer.ko 2024-04-17T19:32:19.939 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 16713 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/leds/trigger/ledtrig-transient.ko 2024-04-17T19:32:19.939 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/md/ 2024-04-17T19:32:19.939 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/md/bcache/ 2024-04-17T19:32:19.939 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 790753 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/md/bcache/bcache.ko 2024-04-17T19:32:19.939 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 49081 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/md/dm-bio-prison.ko 2024-04-17T19:32:19.939 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 116825 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/md/dm-bufio.ko 2024-04-17T19:32:19.939 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 58281 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/md/dm-cache-smq.ko 2024-04-17T19:32:19.939 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 199041 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/md/dm-cache.ko 2024-04-17T19:32:19.939 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 134945 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/md/dm-crypt.ko 2024-04-17T19:32:19.939 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 28897 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/md/dm-delay.ko 2024-04-17T19:32:19.939 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 67497 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/md/dm-era.ko 2024-04-17T19:32:19.939 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 33017 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/md/dm-flakey.ko 2024-04-17T19:32:19.939 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 50457 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/md/dm-log-userspace.ko 2024-04-17T19:32:19.939 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 41145 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/md/dm-log.ko 2024-04-17T19:32:19.940 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 60977 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/md/dm-mirror.ko 2024-04-17T19:32:19.940 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 97209 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/md/dm-multipath.ko 2024-04-17T19:32:19.940 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 19809 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/md/dm-queue-length.ko 2024-04-17T19:32:19.940 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 85689 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/md/dm-raid.ko 2024-04-17T19:32:19.940 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 44289 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/md/dm-region-hash.ko 2024-04-17T19:32:19.940 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 18993 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/md/dm-round-robin.ko 2024-04-17T19:32:19.940 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 20097 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/md/dm-service-time.ko 2024-04-17T19:32:19.940 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 139817 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/md/dm-snapshot.ko 2024-04-17T19:32:19.940 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 22873 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/md/dm-switch.ko 2024-04-17T19:32:19.940 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 234457 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/md/dm-thin-pool.ko 2024-04-17T19:32:19.940 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 66425 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/md/dm-verity.ko 2024-04-17T19:32:19.940 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 9985 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/md/dm-zero.ko 2024-04-17T19:32:19.940 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/md/persistent-data/ 2024-04-17T19:32:19.940 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 264329 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2024-04-17T19:32:19.941 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 43137 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/md/raid0.ko 2024-04-17T19:32:19.941 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 125009 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/md/raid1.ko 2024-04-17T19:32:19.941 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 157681 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/md/raid10.ko 2024-04-17T19:32:19.941 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 444665 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/md/raid456.ko 2024-04-17T19:32:19.941 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/message/ 2024-04-17T19:32:19.941 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/message/fusion/ 2024-04-17T19:32:19.941 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 214841 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/message/fusion/mptbase.ko 2024-04-17T19:32:19.941 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 77985 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/message/fusion/mptctl.ko 2024-04-17T19:32:19.941 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 54785 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/message/fusion/mptfc.ko 2024-04-17T19:32:19.941 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 44633 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/message/fusion/mptlan.ko 2024-04-17T19:32:19.941 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 150761 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/message/fusion/mptsas.ko 2024-04-17T19:32:19.941 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 97281 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/message/fusion/mptscsih.ko 2024-04-17T19:32:19.941 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 63873 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/message/fusion/mptspi.ko 2024-04-17T19:32:19.942 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/mfd/ 2024-04-17T19:32:19.942 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 19977 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/mfd/88pm800.ko 2024-04-17T19:32:19.942 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 14689 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/mfd/88pm805.ko 2024-04-17T19:32:19.942 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 12905 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/mfd/88pm80x.ko 2024-04-17T19:32:19.942 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 12961 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/mfd/arizona-i2c.ko 2024-04-17T19:32:19.942 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 148633 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/mfd/arizona.ko 2024-04-17T19:32:19.942 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 13281 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/mfd/bcm590xx.ko 2024-04-17T19:32:19.942 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 20049 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/mfd/cros_ec_dev.ko 2024-04-17T19:32:19.942 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 41009 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/mfd/dln2.ko 2024-04-17T19:32:19.942 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 18601 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/mfd/janz-cmodio.ko 2024-04-17T19:32:19.942 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 59089 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/mfd/kempld-core.ko 2024-04-17T19:32:19.942 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 31897 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/mfd/lm3533-core.ko 2024-04-17T19:32:19.942 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 17889 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/mfd/lm3533-ctrlbank.ko 2024-04-17T19:32:19.943 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 14633 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/mfd/lp3943.ko 2024-04-17T19:32:19.943 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 60497 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/mfd/lpc_ich.ko 2024-04-17T19:32:19.943 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 13617 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/mfd/lpc_sch.ko 2024-04-17T19:32:19.943 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 21113 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/mfd/max8907.ko 2024-04-17T19:32:19.943 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 35537 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/mfd/mc13xxx-core.ko 2024-04-17T19:32:19.943 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 12937 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/mfd/mc13xxx-i2c.ko 2024-04-17T19:32:19.943 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 13441 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/mfd/menf21bmc.ko 2024-04-17T19:32:19.943 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 20281 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/mfd/pcf50633-adc.ko 2024-04-17T19:32:19.943 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 10449 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/mfd/pcf50633-gpio.ko 2024-04-17T19:32:19.944 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 42297 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/mfd/pcf50633.ko 2024-04-17T19:32:19.944 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 11177 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/mfd/rdc321x-southbridge.ko 2024-04-17T19:32:19.944 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 22913 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/mfd/retu-mfd.ko 2024-04-17T19:32:19.944 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 99425 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/mfd/si476x-core.ko 2024-04-17T19:32:19.944 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 58057 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/mfd/sm501.ko 2024-04-17T19:32:19.944 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 60681 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/mfd/tps65010.ko 2024-04-17T19:32:19.944 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 11785 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/mfd/tps6507x.ko 2024-04-17T19:32:19.944 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 14953 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/mfd/viperboard.ko 2024-04-17T19:32:19.944 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 11753 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/mfd/vx855.ko 2024-04-17T19:32:19.944 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 21137 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/mfd/wl1273-core.ko 2024-04-17T19:32:19.944 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 52361 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/mfd/wm8994.ko 2024-04-17T19:32:19.944 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/ 2024-04-17T19:32:19.944 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 15945 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/ad525x_dpot-i2c.ko 2024-04-17T19:32:19.944 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 64265 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/ad525x_dpot.ko 2024-04-17T19:32:19.945 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/altera-stapl/ 2024-04-17T19:32:19.945 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 57521 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2024-04-17T19:32:19.945 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 22201 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/apds9802als.ko 2024-04-17T19:32:19.945 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 47689 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/apds990x.ko 2024-04-17T19:32:19.945 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 58633 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/bh1770glc.ko 2024-04-17T19:32:19.945 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/c2port/ 2024-04-17T19:32:19.945 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 12825 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/c2port/c2port-duramar2150.ko 2024-04-17T19:32:19.945 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 47449 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/c2port/core.ko 2024-04-17T19:32:19.945 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/cb710/ 2024-04-17T19:32:19.945 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 29721 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/cb710/cb710.ko 2024-04-17T19:32:19.945 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 20401 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/ds1682.ko 2024-04-17T19:32:19.945 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 10153 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/dummy-irq.ko 2024-04-17T19:32:19.945 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/echo/ 2024-04-17T19:32:19.945 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 15905 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/echo/echo.ko 2024-04-17T19:32:19.946 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/eeprom/ 2024-04-17T19:32:19.946 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 43041 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/eeprom/at24.ko 2024-04-17T19:32:19.946 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 18777 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2024-04-17T19:32:19.946 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 15609 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/eeprom/max6875.ko 2024-04-17T19:32:19.946 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 41185 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/enclosure.ko 2024-04-17T19:32:19.946 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/genwqe/ 2024-04-17T19:32:19.946 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 191649 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/genwqe/genwqe_card.ko 2024-04-17T19:32:19.946 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 16537 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/hmc6352.ko 2024-04-17T19:32:19.946 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 37761 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/hpilo.ko 2024-04-17T19:32:19.946 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/ibmasm/ 2024-04-17T19:32:19.946 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 92345 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/ibmasm/ibmasm.ko 2024-04-17T19:32:19.946 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 23961 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/ics932s401.ko 2024-04-17T19:32:19.946 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 26737 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/isl29003.ko 2024-04-17T19:32:19.947 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 18617 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/isl29020.ko 2024-04-17T19:32:19.947 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/lis3lv02d/ 2024-04-17T19:32:19.947 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 54865 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2024-04-17T19:32:19.947 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 17825 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2024-04-17T19:32:19.948 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/mei/ 2024-04-17T19:32:19.948 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 154169 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/mei/mei-me.ko 2024-04-17T19:32:19.948 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 69809 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/mei/mei-txe.ko 2024-04-17T19:32:19.948 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 389033 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/mei/mei.ko 2024-04-17T19:32:19.948 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 37961 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/phantom.ko 2024-04-17T19:32:19.948 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/ti-st/ 2024-04-17T19:32:19.949 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 91145 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/ti-st/st_drv.ko 2024-04-17T19:32:19.949 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 28865 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/tifm_7xx1.ko 2024-04-17T19:32:19.949 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 34457 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/tifm_core.ko 2024-04-17T19:32:19.949 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 22233 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/tsl2550.ko 2024-04-17T19:32:19.949 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 55793 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/vmw_balloon.ko 2024-04-17T19:32:19.949 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/vmw_vmci/ 2024-04-17T19:32:19.949 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 234905 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2024-04-17T19:32:19.949 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ 2024-04-17T19:32:19.949 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/bonding/ 2024-04-17T19:32:19.949 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 620961 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/bonding/bonding.ko 2024-04-17T19:32:19.949 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/dsa/ 2024-04-17T19:32:19.949 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/dsa/b53/ 2024-04-17T19:32:19.949 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 139817 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/dsa/b53/b53_common.ko 2024-04-17T19:32:19.949 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 49545 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/dsa/bcm-sf2.ko 2024-04-17T19:32:19.950 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 18921 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/dsa/mv88e6060.ko 2024-04-17T19:32:19.950 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/dsa/mv88e6xxx/ 2024-04-17T19:32:19.950 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 587065 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2024-04-17T19:32:19.950 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 19553 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/dummy.ko 2024-04-17T19:32:19.950 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 21369 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/eql.ko 2024-04-17T19:32:19.950 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/ 2024-04-17T19:32:19.950 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/3com/ 2024-04-17T19:32:19.950 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 53753 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2024-04-17T19:32:19.950 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 49201 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2024-04-17T19:32:19.950 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 158649 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/3com/3c59x.ko 2024-04-17T19:32:19.951 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 85953 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/3com/typhoon.ko 2024-04-17T19:32:19.951 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/8390/ 2024-04-17T19:32:19.951 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 44161 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/8390/8390.ko 2024-04-17T19:32:19.951 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 73865 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2024-04-17T19:32:19.951 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 33313 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2024-04-17T19:32:19.951 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 109521 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2024-04-17T19:32:19.951 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/adaptec/ 2024-04-17T19:32:19.951 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 64705 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/adaptec/starfire.ko 2024-04-17T19:32:19.951 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/agere/ 2024-04-17T19:32:19.951 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 84329 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/agere/et131x.ko 2024-04-17T19:32:19.951 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/alteon/ 2024-04-17T19:32:19.951 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 70737 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/alteon/acenic.ko 2024-04-17T19:32:19.951 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/altera/ 2024-04-17T19:32:19.952 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 52705 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/altera/altera_tse.ko 2024-04-17T19:32:19.952 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/amd/ 2024-04-17T19:32:19.952 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 65857 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/amd/amd8111e.ko 2024-04-17T19:32:19.952 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 56057 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2024-04-17T19:32:19.952 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 115881 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/amd/pcnet32.ko 2024-04-17T19:32:19.952 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/atheros/ 2024-04-17T19:32:19.952 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/atheros/alx/ 2024-04-17T19:32:19.952 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 124497 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2024-04-17T19:32:19.952 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/atheros/atl1c/ 2024-04-17T19:32:19.952 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 128409 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2024-04-17T19:32:19.952 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/atheros/atl1e/ 2024-04-17T19:32:19.952 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 110345 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2024-04-17T19:32:19.952 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/atheros/atlx/ 2024-04-17T19:32:19.952 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 101857 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2024-04-17T19:32:19.953 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 88953 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2024-04-17T19:32:19.953 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/broadcom/ 2024-04-17T19:32:19.953 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 105633 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/broadcom/b44.ko 2024-04-17T19:32:19.953 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 228985 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2024-04-17T19:32:19.953 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/broadcom/bnx2x/ 2024-04-17T19:32:19.953 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 1733353 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2024-04-17T19:32:19.953 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 167185 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/broadcom/cnic.ko 2024-04-17T19:32:19.953 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/broadcom/genet/ 2024-04-17T19:32:19.953 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 161417 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2024-04-17T19:32:19.953 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 440625 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/broadcom/tg3.ko 2024-04-17T19:32:19.953 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/brocade/ 2024-04-17T19:32:19.953 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/brocade/bna/ 2024-04-17T19:32:19.953 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 432201 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2024-04-17T19:32:19.954 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/chelsio/ 2024-04-17T19:32:19.954 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/chelsio/cxgb/ 2024-04-17T19:32:19.954 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 257201 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2024-04-17T19:32:19.954 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/chelsio/cxgb3/ 2024-04-17T19:32:19.954 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 446177 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2024-04-17T19:32:19.954 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/chelsio/cxgb4/ 2024-04-17T19:32:19.954 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 1311433 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2024-04-17T19:32:19.954 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/chelsio/cxgb4vf/ 2024-04-17T19:32:19.954 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 206689 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2024-04-17T19:32:19.954 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/chelsio/libcxgb/ 2024-04-17T19:32:19.954 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 40161 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2024-04-17T19:32:19.954 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/cisco/ 2024-04-17T19:32:19.954 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/cisco/enic/ 2024-04-17T19:32:19.954 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 269313 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2024-04-17T19:32:19.955 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/dec/ 2024-04-17T19:32:19.955 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/dec/tulip/ 2024-04-17T19:32:19.955 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 85385 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2024-04-17T19:32:19.955 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 77457 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2024-04-17T19:32:19.955 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 169089 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2024-04-17T19:32:19.955 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 65913 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2024-04-17T19:32:19.955 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 76209 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2024-04-17T19:32:19.955 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 38065 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2024-04-17T19:32:19.955 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/dlink/ 2024-04-17T19:32:19.955 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 75945 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/dlink/dl2k.ko 2024-04-17T19:32:19.955 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 78705 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/dlink/sundance.ko 2024-04-17T19:32:19.955 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 52313 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/dnet.ko 2024-04-17T19:32:19.955 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 30409 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/ec_bhf.ko 2024-04-17T19:32:19.955 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/emulex/ 2024-04-17T19:32:19.956 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/emulex/benet/ 2024-04-17T19:32:19.956 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 356377 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2024-04-17T19:32:19.956 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 61737 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/ethoc.ko 2024-04-17T19:32:19.956 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 63185 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/fealnx.ko 2024-04-17T19:32:19.956 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/fujitsu/ 2024-04-17T19:32:19.956 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 51513 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/fujitsu/fmvj18x_cs.ko 2024-04-17T19:32:19.956 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/intel/ 2024-04-17T19:32:19.956 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 115569 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/intel/e100.ko 2024-04-17T19:32:19.956 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/intel/e1000/ 2024-04-17T19:32:19.956 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 366217 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2024-04-17T19:32:19.956 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/intel/e1000e/ 2024-04-17T19:32:19.956 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 755793 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2024-04-17T19:32:19.956 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/intel/fm10k/ 2024-04-17T19:32:19.956 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 324577 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2024-04-17T19:32:19.956 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/intel/i40e/ 2024-04-17T19:32:19.957 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 1196297 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2024-04-17T19:32:19.957 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/intel/iavf/ 2024-04-17T19:32:19.957 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 362593 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2024-04-17T19:32:19.958 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/intel/igb/ 2024-04-17T19:32:19.958 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 671801 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/intel/igb/igb.ko 2024-04-17T19:32:19.958 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/intel/igbvf/ 2024-04-17T19:32:19.958 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 121537 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2024-04-17T19:32:19.958 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/intel/ixgbe/ 2024-04-17T19:32:19.958 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 966705 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2024-04-17T19:32:19.958 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/intel/ixgbevf/ 2024-04-17T19:32:19.958 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 193585 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2024-04-17T19:32:19.959 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 108633 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/jme.ko 2024-04-17T19:32:19.959 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/marvell/ 2024-04-17T19:32:19.959 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 25697 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2024-04-17T19:32:19.959 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 126881 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/marvell/skge.ko 2024-04-17T19:32:19.959 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 150777 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/marvell/sky2.ko 2024-04-17T19:32:19.959 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/mellanox/ 2024-04-17T19:32:19.959 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/mellanox/mlx4/ 2024-04-17T19:32:19.959 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 905033 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2024-04-17T19:32:19.991 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 344145 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2024-04-17T19:32:19.991 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/mellanox/mlx5/ 2024-04-17T19:32:19.991 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/mellanox/mlx5/core/ 2024-04-17T19:32:19.992 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 1412417 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2024-04-17T19:32:19.992 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/micrel/ 2024-04-17T19:32:19.992 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 65913 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/micrel/ks8842.ko 2024-04-17T19:32:19.992 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 54497 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/micrel/ks8851_common.ko 2024-04-17T19:32:19.992 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 22417 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/micrel/ks8851_par.ko 2024-04-17T19:32:19.992 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 117353 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2024-04-17T19:32:19.992 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/myricom/ 2024-04-17T19:32:19.992 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/myricom/myri10ge/ 2024-04-17T19:32:19.992 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 131425 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2024-04-17T19:32:19.992 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/natsemi/ 2024-04-17T19:32:19.992 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 91465 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2024-04-17T19:32:19.992 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 56689 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2024-04-17T19:32:19.992 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/neterion/ 2024-04-17T19:32:19.992 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 181081 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/neterion/s2io.ko 2024-04-17T19:32:19.993 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/nvidia/ 2024-04-17T19:32:19.993 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 171417 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2024-04-17T19:32:19.993 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/packetengines/ 2024-04-17T19:32:19.993 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 58249 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2024-04-17T19:32:19.993 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 50121 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2024-04-17T19:32:19.993 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/qlogic/ 2024-04-17T19:32:19.993 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/qlogic/netxen/ 2024-04-17T19:32:19.993 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 300817 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2024-04-17T19:32:19.993 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 105689 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2024-04-17T19:32:19.993 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/qlogic/qlcnic/ 2024-04-17T19:32:19.993 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 885129 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2024-04-17T19:32:19.993 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/rdc/ 2024-04-17T19:32:19.993 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 52305 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/rdc/r6040.ko 2024-04-17T19:32:19.993 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/realtek/ 2024-04-17T19:32:19.994 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 81641 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/realtek/8139cp.ko 2024-04-17T19:32:19.994 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 100689 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/realtek/8139too.ko 2024-04-17T19:32:19.994 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 34073 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/realtek/atp.ko 2024-04-17T19:32:19.994 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 264161 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/realtek/r8169.ko 2024-04-17T19:32:19.994 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/samsung/ 2024-04-17T19:32:20.002 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/samsung/sxgbe/ 2024-04-17T19:32:20.002 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 142449 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/samsung/sxgbe/samsung-sxgbe.ko 2024-04-17T19:32:20.002 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/sfc/ 2024-04-17T19:32:20.003 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 1350385 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/sfc/sfc.ko 2024-04-17T19:32:20.010 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/silan/ 2024-04-17T19:32:20.010 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 57953 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/silan/sc92031.ko 2024-04-17T19:32:20.010 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/sis/ 2024-04-17T19:32:20.010 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 66505 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/sis/sis190.ko 2024-04-17T19:32:20.011 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 80065 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/sis/sis900.ko 2024-04-17T19:32:20.011 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/smsc/ 2024-04-17T19:32:20.011 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 74289 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/smsc/epic100.ko 2024-04-17T19:32:20.011 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 79457 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2024-04-17T19:32:20.011 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 100785 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2024-04-17T19:32:20.011 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 83441 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2024-04-17T19:32:20.011 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/stmicro/ 2024-04-17T19:32:20.011 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/stmicro/stmmac/ 2024-04-17T19:32:20.011 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 14225 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-generic.ko 2024-04-17T19:32:20.011 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 46985 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2024-04-17T19:32:20.011 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 23345 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac-platform.ko 2024-04-17T19:32:20.011 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 644537 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2024-04-17T19:32:20.011 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/sun/ 2024-04-17T19:32:20.011 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 128497 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/sun/cassini.ko 2024-04-17T19:32:20.011 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 207993 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/sun/niu.ko 2024-04-17T19:32:20.012 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 82633 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/sun/sungem.ko 2024-04-17T19:32:20.012 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 91353 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/sun/sunhme.ko 2024-04-17T19:32:20.012 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/tehuti/ 2024-04-17T19:32:20.012 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 59865 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2024-04-17T19:32:20.012 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/ti/ 2024-04-17T19:32:20.012 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 110729 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/ti/tlan.ko 2024-04-17T19:32:20.012 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/via/ 2024-04-17T19:32:20.012 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 98689 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/via/via-rhine.ko 2024-04-17T19:32:20.012 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 102513 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/via/via-velocity.ko 2024-04-17T19:32:20.012 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/wiznet/ 2024-04-17T19:32:20.012 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 61497 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/wiznet/w5100.ko 2024-04-17T19:32:20.012 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 40609 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/wiznet/w5300.ko 2024-04-17T19:32:20.016 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/xircom/ 2024-04-17T19:32:20.017 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 69913 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2024-04-17T19:32:20.017 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/fddi/ 2024-04-17T19:32:20.017 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 49449 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/fddi/defxx.ko 2024-04-17T19:32:20.017 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/fddi/skfp/ 2024-04-17T19:32:20.017 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 275801 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/fddi/skfp/skfp.ko 2024-04-17T19:32:20.017 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 91105 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/geneve.ko 2024-04-17T19:32:20.017 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/hyperv/ 2024-04-17T19:32:20.017 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 290441 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/hyperv/hv_netvsc.ko 2024-04-17T19:32:20.017 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ieee802154/ 2024-04-17T19:32:20.017 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 21409 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ieee802154/fakelb.ko 2024-04-17T19:32:20.017 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 30001 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ifb.ko 2024-04-17T19:32:20.017 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ipvlan/ 2024-04-17T19:32:20.017 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 108329 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ipvlan/ipvlan.ko 2024-04-17T19:32:20.018 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 78065 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/macvlan.ko 2024-04-17T19:32:20.018 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 19273 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/macvtap.ko 2024-04-17T19:32:20.018 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/mdio/ 2024-04-17T19:32:20.018 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 26105 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2024-04-17T19:32:20.018 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 18209 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/mdio/mdio-bitbang.ko 2024-04-17T19:32:20.018 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 15697 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/mdio/mdio-gpio.ko 2024-04-17T19:32:20.018 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 10025 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/mdio/mdio-regmap.ko 2024-04-17T19:32:20.018 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 20857 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/mdio.ko 2024-04-17T19:32:20.018 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 26417 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/mii.ko 2024-04-17T19:32:20.018 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 62681 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/netconsole.ko 2024-04-17T19:32:20.018 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 13145 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/nlmon.ko 2024-04-17T19:32:20.018 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/pcs/ 2024-04-17T19:32:20.018 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 20585 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/pcs/pcs-lynx.ko 2024-04-17T19:32:20.019 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 48313 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/pcs/pcs_xpcs.ko 2024-04-17T19:32:20.019 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/phy/ 2024-04-17T19:32:20.019 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 12025 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/phy/amd.ko 2024-04-17T19:32:20.019 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 61985 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/phy/bcm-phy-lib.ko 2024-04-17T19:32:20.019 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 52865 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/phy/bcm7xxx.ko 2024-04-17T19:32:20.019 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 14281 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/phy/bcm87xx.ko 2024-04-17T19:32:20.019 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 53409 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/phy/broadcom.ko 2024-04-17T19:32:20.019 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 12289 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/phy/cicada.ko 2024-04-17T19:32:20.019 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 15065 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/phy/davicom.ko 2024-04-17T19:32:20.019 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 10753 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/phy/et1011c.ko 2024-04-17T19:32:20.020 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 31313 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/phy/icplus.ko 2024-04-17T19:32:20.020 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 19177 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/phy/lxt.ko 2024-04-17T19:32:20.020 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 103377 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/phy/marvell.ko 2024-04-17T19:32:20.020 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 96025 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/phy/micrel.ko 2024-04-17T19:32:20.020 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 14049 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/phy/national.ko 2024-04-17T19:32:20.020 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 121105 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/phy/phylink.ko 2024-04-17T19:32:20.020 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 11801 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/phy/qsemi.ko 2024-04-17T19:32:20.020 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 62113 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/phy/realtek.ko 2024-04-17T19:32:20.020 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 35513 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/phy/smsc.ko 2024-04-17T19:32:20.020 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 12681 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/phy/ste10Xp.ko 2024-04-17T19:32:20.020 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 29217 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/phy/vitesse.ko 2024-04-17T19:32:20.020 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/plip/ 2024-04-17T19:32:20.020 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 55353 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/plip/plip.ko 2024-04-17T19:32:20.020 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ppp/ 2024-04-17T19:32:20.021 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 19361 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ppp/bsd_comp.ko 2024-04-17T19:32:20.021 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 36273 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ppp/ppp_async.ko 2024-04-17T19:32:20.021 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 21529 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ppp/ppp_deflate.ko 2024-04-17T19:32:20.021 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 23105 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ppp/ppp_mppe.ko 2024-04-17T19:32:20.021 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 35369 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ppp/ppp_synctty.ko 2024-04-17T19:32:20.021 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 53233 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ppp/pppoe.ko 2024-04-17T19:32:20.021 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 15913 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ppp/pppox.ko 2024-04-17T19:32:20.021 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 40081 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ppp/pptp.ko 2024-04-17T19:32:20.021 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 35937 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/sb1000.ko 2024-04-17T19:32:20.021 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/slip/ 2024-04-17T19:32:20.021 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 52073 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/slip/slip.ko 2024-04-17T19:32:20.021 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 42409 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/sungem_phy.ko 2024-04-17T19:32:20.021 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 80161 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/tap.ko 2024-04-17T19:32:20.021 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/team/ 2024-04-17T19:32:20.022 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 137321 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/team/team.ko 2024-04-17T19:32:20.022 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 16033 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/team/team_mode_activebackup.ko 2024-04-17T19:32:20.022 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 11409 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/team/team_mode_broadcast.ko 2024-04-17T19:32:20.022 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 36209 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/team/team_mode_loadbalance.ko 2024-04-17T19:32:20.022 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 10841 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/team/team_mode_random.ko 2024-04-17T19:32:20.022 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 10473 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/team/team_mode_roundrobin.ko 2024-04-17T19:32:20.022 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 108089 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/veth.ko 2024-04-17T19:32:20.022 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/vmxnet3/ 2024-04-17T19:32:20.022 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 176497 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/vmxnet3/vmxnet3.ko 2024-04-17T19:32:20.022 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/vxlan/ 2024-04-17T19:32:20.022 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 383593 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/vxlan/vxlan.ko 2024-04-17T19:32:20.022 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/xen-netback/ 2024-04-17T19:32:20.022 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 175537 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/xen-netback/xen-netback.ko 2024-04-17T19:32:20.022 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ntb/ 2024-04-17T19:32:20.023 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 25489 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ntb/ntb.ko 2024-04-17T19:32:20.023 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/nvme/ 2024-04-17T19:32:20.023 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/nvme/host/ 2024-04-17T19:32:20.023 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 335857 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/nvme/host/nvme-core.ko 2024-04-17T19:32:20.023 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 126553 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/nvme/host/nvme.ko 2024-04-17T19:32:20.023 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/parport/ 2024-04-17T19:32:20.023 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 168145 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/parport/parport.ko 2024-04-17T19:32:20.023 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 16185 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/parport/parport_cs.ko 2024-04-17T19:32:20.023 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 103889 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/parport/parport_pc.ko 2024-04-17T19:32:20.023 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 30313 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/parport/parport_serial.ko 2024-04-17T19:32:20.023 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/pci/ 2024-04-17T19:32:20.023 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/pci/hotplug/ 2024-04-17T19:32:20.023 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 28489 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2024-04-17T19:32:20.023 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 20201 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/pci/hotplug/cpcihp_generic.ko 2024-04-17T19:32:20.024 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 23889 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/pci/hotplug/cpcihp_zt5550.ko 2024-04-17T19:32:20.024 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 13089 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/pci/pci-stub.ko 2024-04-17T19:32:20.024 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 55329 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/pci/xen-pcifront.ko 2024-04-17T19:32:20.024 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/pcmcia/ 2024-04-17T19:32:20.024 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 31529 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/pcmcia/i82092.ko 2024-04-17T19:32:20.024 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 179961 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/pcmcia/pcmcia.ko 2024-04-17T19:32:20.024 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 78161 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/pcmcia/pcmcia_core.ko 2024-04-17T19:32:20.024 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 41945 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/pcmcia/pcmcia_rsrc.ko 2024-04-17T19:32:20.024 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 40457 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/pcmcia/pd6729.ko 2024-04-17T19:32:20.024 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 133753 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/pcmcia/yenta_socket.ko 2024-04-17T19:32:20.024 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/phy/ 2024-04-17T19:32:20.024 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/phy/broadcom/ 2024-04-17T19:32:20.024 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 12425 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/phy/broadcom/phy-bcm-kona-usb2.ko 2024-04-17T19:32:20.024 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/phy/samsung/ 2024-04-17T19:32:20.025 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 9481 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/phy/samsung/phy-exynos-usb2.ko 2024-04-17T19:32:20.025 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/pinctrl/ 2024-04-17T19:32:20.025 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/pinctrl/intel/ 2024-04-17T19:32:20.025 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 78193 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2024-04-17T19:32:20.025 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/platform/ 2024-04-17T19:32:20.025 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/platform/chrome/ 2024-04-17T19:32:20.025 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 61041 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/platform/chrome/cros-ec-sensorhub.ko 2024-04-17T19:32:20.025 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 29657 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/platform/chrome/cros_ec.ko 2024-04-17T19:32:20.025 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 25521 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/platform/chrome/cros_ec_chardev.ko 2024-04-17T19:32:20.025 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 30217 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/platform/chrome/cros_ec_debugfs.ko 2024-04-17T19:32:20.025 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 31801 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/platform/chrome/cros_ec_lightbar.ko 2024-04-17T19:32:20.025 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 21721 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/platform/chrome/cros_ec_sysfs.ko 2024-04-17T19:32:20.025 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 20153 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/platform/chrome/cros_usbpd_notify.ko 2024-04-17T19:32:20.025 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/platform/x86/ 2024-04-17T19:32:20.029 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 87481 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/platform/x86/acer-wmi.ko 2024-04-17T19:32:20.029 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 44105 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/platform/x86/acerhdf.ko 2024-04-17T19:32:20.029 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 48257 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/platform/x86/apple-gmux.ko 2024-04-17T19:32:20.029 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 73865 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/platform/x86/asus-laptop.ko 2024-04-17T19:32:20.029 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 33321 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/platform/x86/asus-nb-wmi.ko 2024-04-17T19:32:20.029 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 164769 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/platform/x86/asus-wmi.ko 2024-04-17T19:32:20.030 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 46185 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/platform/x86/classmate-laptop.ko 2024-04-17T19:32:20.030 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 62073 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/platform/x86/eeepc-laptop.ko 2024-04-17T19:32:20.030 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 15865 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/platform/x86/eeepc-wmi.ko 2024-04-17T19:32:20.030 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 51881 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/platform/x86/fujitsu-laptop.ko 2024-04-17T19:32:20.030 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 25889 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/platform/x86/fujitsu-tablet.ko 2024-04-17T19:32:20.030 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 42761 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/platform/x86/hdaps.ko 2024-04-17T19:32:20.030 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 22905 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/platform/x86/ibm_rtl.ko 2024-04-17T19:32:20.030 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/platform/x86/intel/ 2024-04-17T19:32:20.030 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 14193 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/platform/x86/intel/intel-rst.ko 2024-04-17T19:32:20.030 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 10033 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/platform/x86/intel/intel-smartconnect.ko 2024-04-17T19:32:20.030 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 54001 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/platform/x86/intel_ips.ko 2024-04-17T19:32:20.031 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 22913 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/platform/x86/msi-wmi.ko 2024-04-17T19:32:20.031 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 12033 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/platform/x86/mxm-wmi.ko 2024-04-17T19:32:20.031 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 43753 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/platform/x86/panasonic-laptop.ko 2024-04-17T19:32:20.031 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 51897 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/platform/x86/samsung-laptop.ko 2024-04-17T19:32:20.031 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 15953 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/platform/x86/samsung-q10.ko 2024-04-17T19:32:20.031 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 20169 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/platform/x86/topstar-laptop.ko 2024-04-17T19:32:20.031 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 15593 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2024-04-17T19:32:20.031 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 20273 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/platform/x86/toshiba_haps.ko 2024-04-17T19:32:20.031 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 11657 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/platform/x86/wmi-bmof.ko 2024-04-17T19:32:20.031 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 61417 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/platform/x86/wmi.ko 2024-04-17T19:32:20.031 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/power/ 2024-04-17T19:32:20.031 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/power/supply/ 2024-04-17T19:32:20.032 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 36513 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/power/supply/88pm860x_battery.ko 2024-04-17T19:32:20.032 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 40425 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/power/supply/88pm860x_charger.ko 2024-04-17T19:32:20.032 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 68833 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/power/supply/bq2415x_charger.ko 2024-04-17T19:32:20.032 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 73073 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/power/supply/bq24190_charger.ko 2024-04-17T19:32:20.032 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 25953 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/power/supply/bq24735-charger.ko 2024-04-17T19:32:20.032 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 20241 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/power/supply/cros_peripheral_charger.ko 2024-04-17T19:32:20.032 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 23233 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/power/supply/da9030_battery.ko 2024-04-17T19:32:20.032 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 23297 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/power/supply/da9052-battery.ko 2024-04-17T19:32:20.032 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 34489 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/power/supply/ds2760_battery.ko 2024-04-17T19:32:20.032 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 28641 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/power/supply/ds2780_battery.ko 2024-04-17T19:32:20.032 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 28809 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/power/supply/ds2781_battery.ko 2024-04-17T19:32:20.032 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 28657 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/power/supply/ds2782_battery.ko 2024-04-17T19:32:20.033 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 24217 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/power/supply/gpio-charger.ko 2024-04-17T19:32:20.033 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 23225 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/power/supply/isp1704_charger.ko 2024-04-17T19:32:20.033 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 24121 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/power/supply/lp8727_charger.ko 2024-04-17T19:32:20.033 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 14009 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/power/supply/max14577_charger.ko 2024-04-17T19:32:20.033 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 37833 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/power/supply/max17042_battery.ko 2024-04-17T19:32:20.033 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 22017 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/power/supply/max8903_charger.ko 2024-04-17T19:32:20.033 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 27689 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/power/supply/max8925_power.ko 2024-04-17T19:32:20.033 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 25833 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/power/supply/pcf50633-charger.ko 2024-04-17T19:32:20.033 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 44841 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/power/supply/sbs-battery.ko 2024-04-17T19:32:20.033 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 34905 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/power/supply/test_power.ko 2024-04-17T19:32:20.033 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 21585 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/power/supply/tps65090-charger.ko 2024-04-17T19:32:20.033 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 13353 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/power/supply/wm831x_backup.ko 2024-04-17T19:32:20.033 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 29081 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/power/supply/wm831x_power.ko 2024-04-17T19:32:20.034 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 27441 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/power/supply/wm8350_power.ko 2024-04-17T19:32:20.034 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/powercap/ 2024-04-17T19:32:20.034 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 73297 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/powercap/intel_rapl_common.ko 2024-04-17T19:32:20.034 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 20433 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/powercap/intel_rapl_msr.ko 2024-04-17T19:32:20.034 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/pps/ 2024-04-17T19:32:20.034 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/pps/clients/ 2024-04-17T19:32:20.034 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 17913 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/pps/clients/pps-gpio.ko 2024-04-17T19:32:20.034 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 15529 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/pps/clients/pps-ldisc.ko 2024-04-17T19:32:20.034 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 18985 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/pps/clients/pps_parport.ko 2024-04-17T19:32:20.034 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 49817 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/pps/pps_core.ko 2024-04-17T19:32:20.034 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ptp/ 2024-04-17T19:32:20.034 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 91393 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ptp/ptp.ko 2024-04-17T19:32:20.035 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 21945 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ptp/ptp_kvm.ko 2024-04-17T19:32:20.035 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ras/ 2024-04-17T19:32:20.035 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ras/amd/ 2024-04-17T19:32:20.035 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ras/amd/atl/ 2024-04-17T19:32:20.035 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 67513 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ras/amd/atl/amd_atl.ko 2024-04-17T19:32:20.035 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 47137 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ras/amd/fmpm.ko 2024-04-17T19:32:20.035 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/ 2024-04-17T19:32:20.035 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 27593 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-88pm80x.ko 2024-04-17T19:32:20.035 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 28969 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-88pm860x.ko 2024-04-17T19:32:20.035 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 18457 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-bq32k.ko 2024-04-17T19:32:20.035 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 24721 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-da9052.ko 2024-04-17T19:32:20.036 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 22569 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-da9055.ko 2024-04-17T19:32:20.036 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 24337 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-da9063.ko 2024-04-17T19:32:20.036 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 19729 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-ds1286.ko 2024-04-17T19:32:20.036 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 82225 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-ds1307.ko 2024-04-17T19:32:20.036 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 24481 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-ds1374.ko 2024-04-17T19:32:20.036 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 21993 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-ds1511.ko 2024-04-17T19:32:20.036 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 20289 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-ds1553.ko 2024-04-17T19:32:20.036 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 16057 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-ds1672.ko 2024-04-17T19:32:20.036 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 15665 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-ds1742.ko 2024-04-17T19:32:20.036 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 18025 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-ds2404.ko 2024-04-17T19:32:20.036 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 29017 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-ds3232.ko 2024-04-17T19:32:20.036 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 13289 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-em3027.ko 2024-04-17T19:32:20.037 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 28665 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-fm3130.ko 2024-04-17T19:32:20.037 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 24097 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-isl12022.ko 2024-04-17T19:32:20.037 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 44129 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-isl1208.ko 2024-04-17T19:32:20.037 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 17145 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-lp8788.ko 2024-04-17T19:32:20.037 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 46913 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-m41t80.ko 2024-04-17T19:32:20.037 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 13961 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-m48t35.ko 2024-04-17T19:32:20.037 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 33969 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-m48t59.ko 2024-04-17T19:32:20.038 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 17337 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-m48t86.ko 2024-04-17T19:32:20.038 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 13985 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-max6900.ko 2024-04-17T19:32:20.038 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 17921 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-max8907.ko 2024-04-17T19:32:20.038 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 18521 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-max8925.ko 2024-04-17T19:32:20.038 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 31337 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-max8997.ko 2024-04-17T19:32:20.038 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 20329 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-max8998.ko 2024-04-17T19:32:20.038 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 22409 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-mc13xxx.ko 2024-04-17T19:32:20.038 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 13153 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-msm6242.ko 2024-04-17T19:32:20.038 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 24329 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-palmas.ko 2024-04-17T19:32:20.038 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 56777 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-pcf2127.ko 2024-04-17T19:32:20.038 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 21601 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-pcf50633.ko 2024-04-17T19:32:20.038 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 32657 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-pcf85063.ko 2024-04-17T19:32:20.039 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 28289 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-pcf8523.ko 2024-04-17T19:32:20.039 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 36065 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-pcf8563.ko 2024-04-17T19:32:20.039 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 14905 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-pcf8583.ko 2024-04-17T19:32:20.039 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 21921 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-rc5t583.ko 2024-04-17T19:32:20.039 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 15209 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-rp5c01.ko 2024-04-17T19:32:20.039 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 40081 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-rs5c372.ko 2024-04-17T19:32:20.040 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 34529 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-rv3029c2.ko 2024-04-17T19:32:20.040 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 29977 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-rx8025.ko 2024-04-17T19:32:20.040 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 22865 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-rx8581.ko 2024-04-17T19:32:20.040 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 26185 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-s35390a.ko 2024-04-17T19:32:20.040 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 20425 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-stk17ta8.ko 2024-04-17T19:32:20.040 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 21697 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-tps6586x.ko 2024-04-17T19:32:20.040 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 25993 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-tps65910.ko 2024-04-17T19:32:20.040 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 24801 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-wm831x.ko 2024-04-17T19:32:20.040 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 25801 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-wm8350.ko 2024-04-17T19:32:20.040 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 33409 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-x1205.ko 2024-04-17T19:32:20.040 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/ 2024-04-17T19:32:20.040 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 90377 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/3w-9xxx.ko 2024-04-17T19:32:20.041 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 69593 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/3w-sas.ko 2024-04-17T19:32:20.041 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 65945 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/3w-xxxx.ko 2024-04-17T19:32:20.041 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 164569 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/BusLogic.ko 2024-04-17T19:32:20.041 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 31617 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/a100u2w.ko 2024-04-17T19:32:20.041 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/aacraid/ 2024-04-17T19:32:20.041 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 340721 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/aacraid/aacraid.ko 2024-04-17T19:32:20.041 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 120337 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/advansys.ko 2024-04-17T19:32:20.041 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/aic7xxx/ 2024-04-17T19:32:20.041 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 468081 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2024-04-17T19:32:20.041 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 380673 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2024-04-17T19:32:20.041 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/aic94xx/ 2024-04-17T19:32:20.041 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 243705 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/aic94xx/aic94xx.ko 2024-04-17T19:32:20.042 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 28841 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/am53c974.ko 2024-04-17T19:32:20.042 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/arcmsr/ 2024-04-17T19:32:20.042 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 135617 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/arcmsr/arcmsr.ko 2024-04-17T19:32:20.042 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 44289 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/atp870u.ko 2024-04-17T19:32:20.042 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/be2iscsi/ 2024-04-17T19:32:20.042 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 304993 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2024-04-17T19:32:20.042 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/bfa/ 2024-04-17T19:32:20.042 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 1527113 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/bfa/bfa.ko 2024-04-17T19:32:20.042 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/bnx2fc/ 2024-04-17T19:32:20.042 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 297801 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2024-04-17T19:32:20.042 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/bnx2i/ 2024-04-17T19:32:20.042 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 144401 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/bnx2i/bnx2i.ko 2024-04-17T19:32:20.043 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 47457 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/ch.ko 2024-04-17T19:32:20.043 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/csiostor/ 2024-04-17T19:32:20.043 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 390713 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/csiostor/csiostor.ko 2024-04-17T19:32:20.043 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/cxgbi/ 2024-04-17T19:32:20.043 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/cxgbi/cxgb3i/ 2024-04-17T19:32:20.043 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 88881 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2024-04-17T19:32:20.043 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/cxgbi/cxgb4i/ 2024-04-17T19:32:20.043 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 117481 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2024-04-17T19:32:20.043 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 173017 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2024-04-17T19:32:20.043 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 91569 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/dc395x.ko 2024-04-17T19:32:20.043 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 45401 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/dmx3191d.ko 2024-04-17T19:32:20.043 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/esas2r/ 2024-04-17T19:32:20.044 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 267577 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/esas2r/esas2r.ko 2024-04-17T19:32:20.044 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 78969 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/esp_scsi.ko 2024-04-17T19:32:20.044 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/fcoe/ 2024-04-17T19:32:20.044 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 95329 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/fcoe/fcoe.ko 2024-04-17T19:32:20.044 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 194017 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/fcoe/libfcoe.ko 2024-04-17T19:32:20.044 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 22617 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/fdomain.ko 2024-04-17T19:32:20.044 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/fnic/ 2024-04-17T19:32:20.044 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 366529 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/fnic/fnic.ko 2024-04-17T19:32:20.044 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 251505 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/hpsa.ko 2024-04-17T19:32:20.044 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 65761 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/hptiop.ko 2024-04-17T19:32:20.044 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 57097 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/hv_storvsc.ko 2024-04-17T19:32:20.044 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 44689 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/imm.ko 2024-04-17T19:32:20.045 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 55153 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/initio.ko 2024-04-17T19:32:20.045 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 327841 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/ipr.ko 2024-04-17T19:32:20.045 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 129785 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/ips.ko 2024-04-17T19:32:20.045 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/isci/ 2024-04-17T19:32:20.045 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 397785 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/isci/isci.ko 2024-04-17T19:32:20.045 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 32017 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2024-04-17T19:32:20.045 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 63121 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/iscsi_tcp.ko 2024-04-17T19:32:20.045 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/libfc/ 2024-04-17T19:32:20.045 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 386849 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/libfc/libfc.ko 2024-04-17T19:32:20.045 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 178177 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/libiscsi.ko 2024-04-17T19:32:20.045 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 64809 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/libiscsi_tcp.ko 2024-04-17T19:32:20.045 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/libsas/ 2024-04-17T19:32:20.045 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 274009 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/libsas/libsas.ko 2024-04-17T19:32:20.046 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/lpfc/ 2024-04-17T19:32:20.046 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 2736001 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/lpfc/lpfc.ko 2024-04-17T19:32:20.100 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/megaraid/ 2024-04-17T19:32:20.100 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 88529 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2024-04-17T19:32:20.101 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 40145 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2024-04-17T19:32:20.101 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 389177 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2024-04-17T19:32:20.101 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 104769 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/megaraid.ko 2024-04-17T19:32:20.101 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/mpt3sas/ 2024-04-17T19:32:20.101 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 836945 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2024-04-17T19:32:20.101 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/mvsas/ 2024-04-17T19:32:20.101 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 158729 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/mvsas/mvsas.ko 2024-04-17T19:32:20.101 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 96537 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/mvumi.ko 2024-04-17T19:32:20.101 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/pcmcia/ 2024-04-17T19:32:20.101 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 101625 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/pcmcia/aha152x_cs.ko 2024-04-17T19:32:20.101 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 13273 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/pcmcia/fdomain_cs.ko 2024-04-17T19:32:20.102 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 23153 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/pcmcia/qlogic_cs.ko 2024-04-17T19:32:20.102 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 28265 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/pcmcia/sym53c500_cs.ko 2024-04-17T19:32:20.102 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/pm8001/ 2024-04-17T19:32:20.102 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 443745 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/pm8001/pm80xx.ko 2024-04-17T19:32:20.102 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 152033 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/pmcraid.ko 2024-04-17T19:32:20.102 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 41625 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/ppa.ko 2024-04-17T19:32:20.102 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 66977 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/qla1280.ko 2024-04-17T19:32:20.102 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/qla2xxx/ 2024-04-17T19:32:20.102 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 2324809 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2024-04-17T19:32:20.102 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 103601 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2024-04-17T19:32:20.103 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/qla4xxx/ 2024-04-17T19:32:20.103 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 697337 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2024-04-17T19:32:20.103 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 23801 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/qlogicfas408.ko 2024-04-17T19:32:20.103 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 18993 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/raid_class.ko 2024-04-17T19:32:20.103 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 322865 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/scsi_debug.ko 2024-04-17T19:32:20.103 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 219857 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/scsi_transport_fc.ko 2024-04-17T19:32:20.103 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 357153 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/scsi_transport_iscsi.ko 2024-04-17T19:32:20.103 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 121185 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/scsi_transport_sas.ko 2024-04-17T19:32:20.103 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 93481 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/scsi_transport_spi.ko 2024-04-17T19:32:20.103 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 55401 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/scsi_transport_srp.ko 2024-04-17T19:32:20.103 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 33009 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/ses.ko 2024-04-17T19:32:20.103 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 138121 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/st.ko 2024-04-17T19:32:20.104 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 57401 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/stex.ko 2024-04-17T19:32:20.104 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/sym53c8xx_2/ 2024-04-17T19:32:20.104 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 205025 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2024-04-17T19:32:20.104 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 55425 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/virtio_scsi.ko 2024-04-17T19:32:20.104 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 59185 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/vmw_pvscsi.ko 2024-04-17T19:32:20.104 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 48777 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/wd719x.ko 2024-04-17T19:32:20.104 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 59417 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/xen-scsifront.ko 2024-04-17T19:32:20.104 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ssb/ 2024-04-17T19:32:20.104 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 174913 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ssb/ssb.ko 2024-04-17T19:32:20.104 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/target/ 2024-04-17T19:32:20.104 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/target/iscsi/ 2024-04-17T19:32:20.104 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 920169 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2024-04-17T19:32:20.105 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/target/loopback/ 2024-04-17T19:32:20.105 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 60321 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/target/loopback/tcm_loop.ko 2024-04-17T19:32:20.105 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 48129 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/target/target_core_file.ko 2024-04-17T19:32:20.105 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 54233 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/target/target_core_iblock.ko 2024-04-17T19:32:20.105 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 1170033 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/target/target_core_mod.ko 2024-04-17T19:32:20.105 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 51897 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/target/target_core_pscsi.ko 2024-04-17T19:32:20.105 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 149721 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/target/target_core_user.ko 2024-04-17T19:32:20.105 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/target/tcm_fc/ 2024-04-17T19:32:20.105 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 90057 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/target/tcm_fc/tcm_fc.ko 2024-04-17T19:32:20.105 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/thermal/ 2024-04-17T19:32:20.105 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/thermal/intel/ 2024-04-17T19:32:20.106 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/thermal/intel/int340x_thermal/ 2024-04-17T19:32:20.106 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 28121 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2024-04-17T19:32:20.106 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 35209 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2024-04-17T19:32:20.106 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 11329 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2024-04-17T19:32:20.106 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 11705 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2024-04-17T19:32:20.106 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 17385 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2024-04-17T19:32:20.106 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 18993 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2024-04-17T19:32:20.106 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 36729 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2024-04-17T19:32:20.106 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 26289 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2024-04-17T19:32:20.106 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 16745 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2024-04-17T19:32:20.106 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 12929 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2024-04-17T19:32:20.107 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 12281 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_power_floor.ko 2024-04-17T19:32:20.107 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 15241 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2024-04-17T19:32:20.107 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 46065 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2024-04-17T19:32:20.107 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 17673 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_hint.ko 2024-04-17T19:32:20.107 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 13345 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_req.ko 2024-04-17T19:32:20.107 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 35913 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/thermal/intel/intel_powerclamp.ko 2024-04-17T19:32:20.107 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 21665 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2024-04-17T19:32:20.107 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 12849 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2024-04-17T19:32:20.107 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 30577 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2024-04-17T19:32:20.107 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/tty/ 2024-04-17T19:32:20.107 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/tty/ipwireless/ 2024-04-17T19:32:20.107 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 99313 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/tty/ipwireless/ipwireless.ko 2024-04-17T19:32:20.108 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 69729 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/tty/moxa.ko 2024-04-17T19:32:20.108 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 61649 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/tty/mxser.ko 2024-04-17T19:32:20.108 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 134401 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/tty/n_gsm.ko 2024-04-17T19:32:20.108 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 37905 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/tty/n_hdlc.ko 2024-04-17T19:32:20.108 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 78969 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/tty/nozomi.ko 2024-04-17T19:32:20.108 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/tty/serial/ 2024-04-17T19:32:20.108 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/tty/serial/8250/ 2024-04-17T19:32:20.108 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 44057 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/tty/serial/8250/8250_dw.ko 2024-04-17T19:32:20.108 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 65121 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/tty/serial/8250/serial_cs.ko 2024-04-17T19:32:20.108 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 23121 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/tty/serial/altera_jtaguart.ko 2024-04-17T19:32:20.108 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 28161 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/tty/serial/altera_uart.ko 2024-04-17T19:32:20.108 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 10673 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/tty/serial/arc_uart.ko 2024-04-17T19:32:20.109 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 91665 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/tty/serial/fsl_lpuart.ko 2024-04-17T19:32:20.109 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/tty/serial/jsm/ 2024-04-17T19:32:20.109 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 120577 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/tty/serial/jsm/jsm.ko 2024-04-17T19:32:20.109 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 35161 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/tty/serial/rp2.ko 2024-04-17T19:32:20.109 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 65641 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/tty/serial/sc16is7xx.ko 2024-04-17T19:32:20.109 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ufs/ 2024-04-17T19:32:20.109 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ufs/core/ 2024-04-17T19:32:20.109 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 693081 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ufs/core/ufshcd-core.ko 2024-04-17T19:32:20.109 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ufs/host/ 2024-04-17T19:32:20.109 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 34449 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ufs/host/ufshcd-pci.ko 2024-04-17T19:32:20.109 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 16697 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ufs/host/ufshcd-pltfrm.ko 2024-04-17T19:32:20.109 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/uio/ 2024-04-17T19:32:20.109 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 55617 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/uio/uio.ko 2024-04-17T19:32:20.110 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 14305 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/uio/uio_aec.ko 2024-04-17T19:32:20.110 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 12961 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/uio/uio_cif.ko 2024-04-17T19:32:20.110 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 20913 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/uio/uio_dmem_genirq.ko 2024-04-17T19:32:20.110 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 15633 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/uio/uio_mf624.ko 2024-04-17T19:32:20.110 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 13913 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/uio/uio_netx.ko 2024-04-17T19:32:20.110 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 12049 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/uio/uio_pci_generic.ko 2024-04-17T19:32:20.110 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 18633 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/uio/uio_pdrv_genirq.ko 2024-04-17T19:32:20.110 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 16025 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/uio/uio_sercos3.ko 2024-04-17T19:32:20.110 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/ 2024-04-17T19:32:20.110 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/c67x00/ 2024-04-17T19:32:20.110 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 90321 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/c67x00/c67x00.ko 2024-04-17T19:32:20.111 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/chipidea/ 2024-04-17T19:32:20.111 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 189209 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/chipidea/ci_hdrc.ko 2024-04-17T19:32:20.111 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 21529 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/chipidea/ci_hdrc_msm.ko 2024-04-17T19:32:20.111 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 15121 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/chipidea/ci_hdrc_npcm.ko 2024-04-17T19:32:20.111 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 14105 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/chipidea/ci_hdrc_pci.ko 2024-04-17T19:32:20.111 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 14777 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/chipidea/ci_hdrc_usb2.ko 2024-04-17T19:32:20.111 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/class/ 2024-04-17T19:32:20.111 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 101545 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/class/cdc-acm.ko 2024-04-17T19:32:20.111 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 63073 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/class/cdc-wdm.ko 2024-04-17T19:32:20.111 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 56721 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/class/usblp.ko 2024-04-17T19:32:20.111 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 107417 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/class/usbtmc.ko 2024-04-17T19:32:20.111 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/common/ 2024-04-17T19:32:20.111 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 29353 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/common/ulpi.ko 2024-04-17T19:32:20.112 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/dwc2/ 2024-04-17T19:32:20.112 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 13097 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/dwc2/dwc2_pci.ko 2024-04-17T19:32:20.112 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/dwc3/ 2024-04-17T19:32:20.112 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 13529 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/dwc3/dwc3-haps.ko 2024-04-17T19:32:20.112 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 33465 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/dwc3/dwc3-pci.ko 2024-04-17T19:32:20.112 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 574593 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/dwc3/dwc3.ko 2024-04-17T19:32:20.113 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/gadget/ 2024-04-17T19:32:20.113 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/gadget/function/ 2024-04-17T19:32:20.113 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 72249 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/gadget/function/u_ether.ko 2024-04-17T19:32:20.113 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 61953 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/gadget/function/u_serial.ko 2024-04-17T19:32:20.113 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 33721 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/gadget/function/usb_f_acm.ko 2024-04-17T19:32:20.113 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 49737 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/gadget/function/usb_f_ecm.ko 2024-04-17T19:32:20.113 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 33041 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/gadget/function/usb_f_ecm_subset.ko 2024-04-17T19:32:20.113 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 43553 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/gadget/function/usb_f_eem.ko 2024-04-17T19:32:20.113 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 131345 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/gadget/function/usb_f_fs.ko 2024-04-17T19:32:20.114 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 62321 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/gadget/function/usb_f_hid.ko 2024-04-17T19:32:20.114 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 146617 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/gadget/function/usb_f_mass_storage.ko 2024-04-17T19:32:20.114 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 70689 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/gadget/function/usb_f_ncm.ko 2024-04-17T19:32:20.114 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 25705 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/gadget/function/usb_f_obex.ko 2024-04-17T19:32:20.114 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 37649 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/gadget/function/usb_f_phonet.ko 2024-04-17T19:32:20.114 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 70017 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/gadget/function/usb_f_printer.ko 2024-04-17T19:32:20.114 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 101249 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/gadget/function/usb_f_rndis.ko 2024-04-17T19:32:20.114 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 22425 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/gadget/function/usb_f_serial.ko 2024-04-17T19:32:20.114 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 71257 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/gadget/function/usb_f_ss_lb.ko 2024-04-17T19:32:20.114 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 84937 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/gadget/function/usb_f_tcm.ko 2024-04-17T19:32:20.114 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/gadget/legacy/ 2024-04-17T19:32:20.114 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 23441 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/gadget/legacy/g_acm_ms.ko 2024-04-17T19:32:20.115 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 20281 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/gadget/legacy/g_cdc.ko 2024-04-17T19:32:20.115 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 20993 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/gadget/legacy/g_dbgp.ko 2024-04-17T19:32:20.115 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 24497 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/gadget/legacy/g_ether.ko 2024-04-17T19:32:20.115 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 33041 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/gadget/legacy/g_ffs.ko 2024-04-17T19:32:20.115 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 21609 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/gadget/legacy/g_hid.ko 2024-04-17T19:32:20.115 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 22385 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/gadget/legacy/g_mass_storage.ko 2024-04-17T19:32:20.115 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 18913 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/gadget/legacy/g_ncm.ko 2024-04-17T19:32:20.115 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 35689 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/gadget/legacy/g_nokia.ko 2024-04-17T19:32:20.115 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 18521 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/gadget/legacy/g_printer.ko 2024-04-17T19:32:20.115 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 21705 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/gadget/legacy/g_serial.ko 2024-04-17T19:32:20.115 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 30345 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/gadget/legacy/g_zero.ko 2024-04-17T19:32:20.116 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 78073 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/gadget/legacy/gadgetfs.ko 2024-04-17T19:32:20.116 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 17505 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/gadget/legacy/tcm_usb_gadget.ko 2024-04-17T19:32:20.116 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 204049 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/gadget/libcomposite.ko 2024-04-17T19:32:20.116 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/gadget/udc/ 2024-04-17T19:32:20.116 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 19569 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/gadget/udc/amd5536udc_pci.ko 2024-04-17T19:32:20.116 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/gadget/udc/bdc/ 2024-04-17T19:32:20.116 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 182561 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/gadget/udc/bdc/bdc.ko 2024-04-17T19:32:20.116 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 45545 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/gadget/udc/goku_udc.ko 2024-04-17T19:32:20.116 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 66513 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/gadget/udc/gr_udc.ko 2024-04-17T19:32:20.116 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 85217 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/gadget/udc/mv_u3d_core.ko 2024-04-17T19:32:20.116 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 69313 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/gadget/udc/mv_udc.ko 2024-04-17T19:32:20.116 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 90313 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/gadget/udc/net2272.ko 2024-04-17T19:32:20.117 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 90361 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/gadget/udc/net2280.ko 2024-04-17T19:32:20.117 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 94841 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/gadget/udc/pch_udc.ko 2024-04-17T19:32:20.117 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 80521 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/gadget/udc/pxa27x_udc.ko 2024-04-17T19:32:20.117 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 87465 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/gadget/udc/r8a66597-udc.ko 2024-04-17T19:32:20.117 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 95441 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/gadget/udc/snps_udc_core.ko 2024-04-17T19:32:20.117 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 195969 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/gadget/udc/udc-core.ko 2024-04-17T19:32:20.117 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/host/ 2024-04-17T19:32:20.117 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 13945 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/host/bcma-hcd.ko 2024-04-17T19:32:20.117 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 108321 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/host/isp116x-hcd.ko 2024-04-17T19:32:20.117 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 104377 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/host/oxu210hp-hcd.ko 2024-04-17T19:32:20.117 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 102273 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/host/r8a66597-hcd.ko 2024-04-17T19:32:20.117 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 60105 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/host/sl811-hcd.ko 2024-04-17T19:32:20.118 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 17505 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/host/sl811_cs.ko 2024-04-17T19:32:20.118 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 16377 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/host/ssb-hcd.ko 2024-04-17T19:32:20.118 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 32553 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/host/xhci-plat-hcd.ko 2024-04-17T19:32:20.118 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/image/ 2024-04-17T19:32:20.118 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 40409 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/image/mdc800.ko 2024-04-17T19:32:20.118 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 25113 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/image/microtek.ko 2024-04-17T19:32:20.118 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/misc/ 2024-04-17T19:32:20.118 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 47353 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/misc/adutux.ko 2024-04-17T19:32:20.118 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 23825 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/misc/appledisplay.ko 2024-04-17T19:32:20.118 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 20257 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/misc/cypress_cy7c63.ko 2024-04-17T19:32:20.118 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 26673 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/misc/cytherm.ko 2024-04-17T19:32:20.119 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 15561 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/misc/ehset.ko 2024-04-17T19:32:20.119 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 17873 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/misc/emi26.ko 2024-04-17T19:32:20.119 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 18881 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/misc/emi62.ko 2024-04-17T19:32:20.119 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 13057 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/misc/ezusb.ko 2024-04-17T19:32:20.119 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 22241 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/misc/idmouse.ko 2024-04-17T19:32:20.119 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 42729 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/misc/iowarrior.ko 2024-04-17T19:32:20.119 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 12993 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/misc/isight_firmware.ko 2024-04-17T19:32:20.119 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 42241 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/misc/ldusb.ko 2024-04-17T19:32:20.119 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 42233 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/misc/legousbtower.ko 2024-04-17T19:32:20.119 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 33641 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/misc/lvstest.ko 2024-04-17T19:32:20.119 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/misc/sisusbvga/ 2024-04-17T19:32:20.119 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 85313 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2024-04-17T19:32:20.120 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 14601 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/misc/trancevibrator.ko 2024-04-17T19:32:20.120 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 24593 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/misc/usb3503.ko 2024-04-17T19:32:20.120 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 29625 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/misc/usblcd.ko 2024-04-17T19:32:20.120 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 27809 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/misc/usbsevseg.ko 2024-04-17T19:32:20.120 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 84265 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/misc/usbtest.ko 2024-04-17T19:32:20.120 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 52065 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/misc/uss720.ko 2024-04-17T19:32:20.120 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 32345 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/misc/yurex.ko 2024-04-17T19:32:20.120 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/mon/ 2024-04-17T19:32:20.120 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 91529 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/mon/usbmon.ko 2024-04-17T19:32:20.120 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/musb/ 2024-04-17T19:32:20.120 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 396209 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/musb/musb_hdrc.ko 2024-04-17T19:32:20.120 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/phy/ 2024-04-17T19:32:20.121 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 25497 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/phy/phy-generic.ko 2024-04-17T19:32:20.121 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 23697 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/phy/phy-gpio-vbus-usb.ko 2024-04-17T19:32:20.121 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 14417 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/phy/phy-isp1301.ko 2024-04-17T19:32:20.121 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 26361 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/phy/phy-tahvo.ko 2024-04-17T19:32:20.121 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/ 2024-04-17T19:32:20.121 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 14761 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/aircable.ko 2024-04-17T19:32:20.121 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 38209 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/ark3116.ko 2024-04-17T19:32:20.121 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 30681 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/belkin_sa.ko 2024-04-17T19:32:20.121 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 44329 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/ch341.ko 2024-04-17T19:32:20.121 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 79681 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/cp210x.ko 2024-04-17T19:32:20.121 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 35137 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/cyberjack.ko 2024-04-17T19:32:20.121 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 66873 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/cypress_m8.ko 2024-04-17T19:32:20.121 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 58329 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/digi_acceleport.ko 2024-04-17T19:32:20.122 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 10625 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/empeg.ko 2024-04-17T19:32:20.122 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 53009 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/f81232.ko 2024-04-17T19:32:20.122 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 188609 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/ftdi_sio.ko 2024-04-17T19:32:20.122 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 61489 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/garmin_gps.ko 2024-04-17T19:32:20.122 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 152305 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/io_edgeport.ko 2024-04-17T19:32:20.122 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 142833 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/io_ti.ko 2024-04-17T19:32:20.122 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 69217 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/ipaq.ko 2024-04-17T19:32:20.122 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 21425 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/ipw.ko 2024-04-17T19:32:20.122 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 29769 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/ir-usb.ko 2024-04-17T19:32:20.122 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 66361 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/iuu_phoenix.ko 2024-04-17T19:32:20.122 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 122329 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/keyspan.ko 2024-04-17T19:32:20.122 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 41297 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/keyspan_pda.ko 2024-04-17T19:32:20.123 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 29465 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/kl5kusb105.ko 2024-04-17T19:32:20.123 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 38049 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/kobil_sct.ko 2024-04-17T19:32:20.123 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 38041 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/mct_u232.ko 2024-04-17T19:32:20.123 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 25569 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/metro-usb.ko 2024-04-17T19:32:20.123 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 79681 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/mos7720.ko 2024-04-17T19:32:20.123 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 89969 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/mos7840.ko 2024-04-17T19:32:20.123 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 65073 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/mxuport.ko 2024-04-17T19:32:20.123 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 15857 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/navman.ko 2024-04-17T19:32:20.123 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 13761 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/omninet.ko 2024-04-17T19:32:20.123 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 28881 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/opticon.ko 2024-04-17T19:32:20.123 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 193857 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/option.ko 2024-04-17T19:32:20.123 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 45337 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/oti6858.ko 2024-04-17T19:32:20.124 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 61761 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/pl2303.ko 2024-04-17T19:32:20.124 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 10321 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/qcaux.ko 2024-04-17T19:32:20.124 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 39985 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/qcserial.ko 2024-04-17T19:32:20.124 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 40529 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/quatech2.ko 2024-04-17T19:32:20.124 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 16993 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/safe_serial.ko 2024-04-17T19:32:20.124 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 59345 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/sierra.ko 2024-04-17T19:32:20.124 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 25225 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/spcp8x5.ko 2024-04-17T19:32:20.124 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 34065 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/ssu100.ko 2024-04-17T19:32:20.124 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 19601 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/symbolserial.ko 2024-04-17T19:32:20.124 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 70497 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2024-04-17T19:32:20.124 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 24297 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/usb-serial-simple.ko 2024-04-17T19:32:20.124 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 11465 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/usb_debug.ko 2024-04-17T19:32:20.125 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 39321 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/usb_wwan.ko 2024-04-17T19:32:20.125 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 151137 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/usbserial.ko 2024-04-17T19:32:20.125 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 32505 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/visor.ko 2024-04-17T19:32:20.125 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 43577 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/whiteheat.ko 2024-04-17T19:32:20.125 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 11945 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/wishbone-serial.ko 2024-04-17T19:32:20.125 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 10257 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/xsens_mt.ko 2024-04-17T19:32:20.125 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/storage/ 2024-04-17T19:32:20.125 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 64049 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/storage/uas.ko 2024-04-17T19:32:20.125 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 30209 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/storage/ums-alauda.ko 2024-04-17T19:32:20.125 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 14369 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/storage/ums-cypress.ko 2024-04-17T19:32:20.125 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 25665 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/storage/ums-datafab.ko 2024-04-17T19:32:20.125 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 41073 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/storage/ums-eneub6250.ko 2024-04-17T19:32:20.126 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 15689 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/storage/ums-freecom.ko 2024-04-17T19:32:20.126 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 22953 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/storage/ums-isd200.ko 2024-04-17T19:32:20.126 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 22769 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/storage/ums-jumpshot.ko 2024-04-17T19:32:20.126 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 15617 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/storage/ums-karma.ko 2024-04-17T19:32:20.126 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 20721 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/storage/ums-onetouch.ko 2024-04-17T19:32:20.126 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 33873 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/storage/ums-realtek.ko 2024-04-17T19:32:20.126 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 33849 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/storage/ums-sddr09.ko 2024-04-17T19:32:20.126 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 22577 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/storage/ums-sddr55.ko 2024-04-17T19:32:20.126 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 41785 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/storage/ums-usbat.ko 2024-04-17T19:32:20.126 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 201193 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/storage/usb-storage.ko 2024-04-17T19:32:20.126 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/usbip/ 2024-04-17T19:32:20.126 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 76041 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/usbip/usbip-core.ko 2024-04-17T19:32:20.127 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 85257 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/usbip/usbip-host.ko 2024-04-17T19:32:20.127 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 122321 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/usbip/vhci-hcd.ko 2024-04-17T19:32:20.127 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/vfio/ 2024-04-17T19:32:20.127 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/vfio/pci/ 2024-04-17T19:32:20.127 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 206921 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/vfio/pci/vfio-pci-core.ko 2024-04-17T19:32:20.127 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 33577 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/vfio/pci/vfio-pci.ko 2024-04-17T19:32:20.127 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 134265 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/vfio/vfio.ko 2024-04-17T19:32:20.127 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 93673 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/vfio/vfio_iommu_type1.ko 2024-04-17T19:32:20.127 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/vhost/ 2024-04-17T19:32:20.127 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 138721 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/vhost/vhost.ko 2024-04-17T19:32:20.127 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 20161 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/vhost/vhost_iotlb.ko 2024-04-17T19:32:20.127 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 71281 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/vhost/vhost_net.ko 2024-04-17T19:32:20.128 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 107905 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/vhost/vhost_scsi.ko 2024-04-17T19:32:20.128 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/video/ 2024-04-17T19:32:20.128 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/video/backlight/ 2024-04-17T19:32:20.128 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 17993 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/video/backlight/88pm860x_bl.ko 2024-04-17T19:32:20.128 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 14433 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/video/backlight/aat2870_bl.ko 2024-04-17T19:32:20.128 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 29153 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/video/backlight/adp5520_bl.ko 2024-04-17T19:32:20.128 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 41169 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/video/backlight/adp8860_bl.ko 2024-04-17T19:32:20.128 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 51745 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/video/backlight/adp8870_bl.ko 2024-04-17T19:32:20.128 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 20305 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/video/backlight/apple_bl.ko 2024-04-17T19:32:20.128 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 19825 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/video/backlight/as3711_bl.ko 2024-04-17T19:32:20.128 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 14737 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/video/backlight/bd6107.ko 2024-04-17T19:32:20.128 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 13337 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/video/backlight/da903x_bl.ko 2024-04-17T19:32:20.129 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 13649 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/video/backlight/da9052_bl.ko 2024-04-17T19:32:20.129 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 13785 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/video/backlight/gpio_backlight.ko 2024-04-17T19:32:20.129 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 17473 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/video/backlight/kb3886_bl.ko 2024-04-17T19:32:20.129 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 26457 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/video/backlight/lcd.ko 2024-04-17T19:32:20.129 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 28209 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/video/backlight/lm3533_bl.ko 2024-04-17T19:32:20.129 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 23393 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/video/backlight/lm3639_bl.ko 2024-04-17T19:32:20.129 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 13689 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/video/backlight/lv5207lp.ko 2024-04-17T19:32:20.129 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 16665 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/video/backlight/max8925_bl.ko 2024-04-17T19:32:20.129 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 13025 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/video/backlight/pandora_bl.ko 2024-04-17T19:32:20.130 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 13057 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/video/backlight/pcf50633-backlight.ko 2024-04-17T19:32:20.130 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 13329 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/video/backlight/platform_lcd.ko 2024-04-17T19:32:20.130 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 15113 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/video/backlight/wm831x_bl.ko 2024-04-17T19:32:20.130 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/w1/ 2024-04-17T19:32:20.130 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/w1/masters/ 2024-04-17T19:32:20.130 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 23033 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/w1/masters/ds2482.ko 2024-04-17T19:32:20.130 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 46801 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/w1/masters/ds2490.ko 2024-04-17T19:32:20.130 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 12945 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/w1/masters/matrox_w1.ko 2024-04-17T19:32:20.130 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 13345 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/w1/masters/w1-gpio.ko 2024-04-17T19:32:20.130 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/w1/slaves/ 2024-04-17T19:32:20.130 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 14001 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/w1/slaves/w1_ds2406.ko 2024-04-17T19:32:20.130 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 27257 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/w1/slaves/w1_ds2408.ko 2024-04-17T19:32:20.131 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 16865 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/w1/slaves/w1_ds2413.ko 2024-04-17T19:32:20.131 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 12121 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/w1/slaves/w1_ds2423.ko 2024-04-17T19:32:20.131 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 16449 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/w1/slaves/w1_ds2431.ko 2024-04-17T19:32:20.131 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 16201 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/w1/slaves/w1_ds2433.ko 2024-04-17T19:32:20.131 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 16401 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/w1/slaves/w1_ds2780.ko 2024-04-17T19:32:20.131 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 16401 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/w1/slaves/w1_ds2781.ko 2024-04-17T19:32:20.131 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 21513 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/w1/slaves/w1_ds28e04.ko 2024-04-17T19:32:20.131 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 8313 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/w1/slaves/w1_smem.ko 2024-04-17T19:32:20.131 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 70369 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/w1/slaves/w1_therm.ko 2024-04-17T19:32:20.131 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 129433 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/w1/wire.ko 2024-04-17T19:32:20.131 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/watchdog/ 2024-04-17T19:32:20.131 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 22337 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/watchdog/acquirewdt.ko 2024-04-17T19:32:20.132 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 23825 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/watchdog/advantechwdt.ko 2024-04-17T19:32:20.132 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 22209 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/watchdog/alim1535_wdt.ko 2024-04-17T19:32:20.132 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 27401 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/watchdog/alim7101_wdt.ko 2024-04-17T19:32:20.132 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 21985 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/watchdog/cpu5wdt.ko 2024-04-17T19:32:20.132 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 16465 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/watchdog/da9052_wdt.ko 2024-04-17T19:32:20.132 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 14625 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/watchdog/da9055_wdt.ko 2024-04-17T19:32:20.132 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 20905 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/watchdog/da9063_wdt.ko 2024-04-17T19:32:20.132 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 24457 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/watchdog/dw_wdt.ko 2024-04-17T19:32:20.132 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 23521 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/watchdog/eurotechwdt.ko 2024-04-17T19:32:20.132 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 26817 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/watchdog/f71808e_wdt.ko 2024-04-17T19:32:20.132 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 32857 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/watchdog/hpwdt.ko 2024-04-17T19:32:20.132 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 18049 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/watchdog/i6300esb.ko 2024-04-17T19:32:20.132 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 12673 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/watchdog/iTCO_vendor_support.ko 2024-04-17T19:32:20.133 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 26737 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/watchdog/iTCO_wdt.ko 2024-04-17T19:32:20.133 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 23289 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/watchdog/ib700wdt.ko 2024-04-17T19:32:20.133 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 21721 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/watchdog/ibmasr.ko 2024-04-17T19:32:20.133 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 22713 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/watchdog/ie6xx_wdt.ko 2024-04-17T19:32:20.133 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 24857 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/watchdog/it8712f_wdt.ko 2024-04-17T19:32:20.133 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 15921 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/watchdog/it87_wdt.ko 2024-04-17T19:32:20.133 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 26441 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/watchdog/kempld_wdt.ko 2024-04-17T19:32:20.133 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 21569 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/watchdog/machzwd.ko 2024-04-17T19:32:20.133 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 17105 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/watchdog/mena21_wdt.ko 2024-04-17T19:32:20.133 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 15001 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/watchdog/menf21bmc_wdt.ko 2024-04-17T19:32:20.133 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 29753 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/watchdog/nv_tco.ko 2024-04-17T19:32:20.134 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 20569 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/watchdog/of_xilinx_wdt.ko 2024-04-17T19:32:20.134 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 27721 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/watchdog/pc87413_wdt.ko 2024-04-17T19:32:20.134 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 46953 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/watchdog/pcwd_pci.ko 2024-04-17T19:32:20.134 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 37193 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/watchdog/pcwd_usb.ko 2024-04-17T19:32:20.134 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 15177 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/watchdog/retu_wdt.ko 2024-04-17T19:32:20.134 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 24433 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/watchdog/sbc60xxwdt.ko 2024-04-17T19:32:20.134 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 16985 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/watchdog/sbc_epx_c3.ko 2024-04-17T19:32:20.134 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 20345 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2024-04-17T19:32:20.134 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 29169 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/watchdog/sc1200wdt.ko 2024-04-17T19:32:20.134 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 27489 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/watchdog/sch311x_wdt.ko 2024-04-17T19:32:20.134 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 25625 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/watchdog/smsc37b787_wdt.ko 2024-04-17T19:32:20.134 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 19721 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/watchdog/softdog.ko 2024-04-17T19:32:20.135 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 26009 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/watchdog/sp5100_tco.ko 2024-04-17T19:32:20.135 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 14865 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/watchdog/twl4030_wdt.ko 2024-04-17T19:32:20.135 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 20177 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/watchdog/via_wdt.ko 2024-04-17T19:32:20.135 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 23393 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/watchdog/w83627hf_wdt.ko 2024-04-17T19:32:20.135 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 24905 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/watchdog/w83877f_wdt.ko 2024-04-17T19:32:20.135 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 32481 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/watchdog/w83977f_wdt.ko 2024-04-17T19:32:20.135 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 22577 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/watchdog/wafer5823wdt.ko 2024-04-17T19:32:20.135 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 33465 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/watchdog/wdt_pci.ko 2024-04-17T19:32:20.135 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 18905 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/watchdog/wm831x_wdt.ko 2024-04-17T19:32:20.135 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 16081 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/watchdog/wm8350_wdt.ko 2024-04-17T19:32:20.135 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 18457 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/watchdog/xen_wdt.ko 2024-04-17T19:32:20.135 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/xen/ 2024-04-17T19:32:20.136 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 30049 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/xen/xen-evtchn.ko 2024-04-17T19:32:20.136 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 30649 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/xen/xen-gntalloc.ko 2024-04-17T19:32:20.136 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 55713 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/xen/xen-gntdev.ko 2024-04-17T19:32:20.136 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/xen/xen-pciback/ 2024-04-17T19:32:20.136 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 213913 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2024-04-17T19:32:20.136 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 47689 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/xen/xen-privcmd.ko 2024-04-17T19:32:20.136 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 85713 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/xen/xen-scsiback.ko 2024-04-17T19:32:20.136 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/xen/xenfs/ 2024-04-17T19:32:20.136 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 23433 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/xen/xenfs/xenfs.ko 2024-04-17T19:32:20.136 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/ 2024-04-17T19:32:20.136 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/9p/ 2024-04-17T19:32:20.136 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 192617 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/9p/9p.ko 2024-04-17T19:32:20.136 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/adfs/ 2024-04-17T19:32:20.137 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 78153 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/adfs/adfs.ko 2024-04-17T19:32:20.137 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/affs/ 2024-04-17T19:32:20.137 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 197849 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/affs/affs.ko 2024-04-17T19:32:20.137 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/afs/ 2024-04-17T19:32:20.137 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 1261113 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/afs/kafs.ko 2024-04-17T19:32:20.137 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/autofs/ 2024-04-17T19:32:20.137 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 127377 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/autofs/autofs4.ko 2024-04-17T19:32:20.137 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/befs/ 2024-04-17T19:32:20.137 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 80521 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/befs/befs.ko 2024-04-17T19:32:20.137 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/bfs/ 2024-04-17T19:32:20.137 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 50473 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/bfs/bfs.ko 2024-04-17T19:32:20.137 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 45561 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/binfmt_misc.ko 2024-04-17T19:32:20.138 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/btrfs/ 2024-04-17T19:32:20.138 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 4489593 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/btrfs/btrfs.ko 2024-04-17T19:32:20.138 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/cachefiles/ 2024-04-17T19:32:20.138 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 376857 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/cachefiles/cachefiles.ko 2024-04-17T19:32:20.138 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/ceph/ 2024-04-17T19:32:20.138 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 1586089 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/ceph/ceph.ko 2024-04-17T19:32:20.138 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/coda/ 2024-04-17T19:32:20.138 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 130073 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/coda/coda.ko 2024-04-17T19:32:20.138 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/configfs/ 2024-04-17T19:32:20.138 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 139081 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/configfs/configfs.ko 2024-04-17T19:32:20.138 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/cramfs/ 2024-04-17T19:32:20.138 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 35665 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/cramfs/cramfs.ko 2024-04-17T19:32:20.139 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/dlm/ 2024-04-17T19:32:20.139 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 813225 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/dlm/dlm.ko 2024-04-17T19:32:20.139 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/efs/ 2024-04-17T19:32:20.139 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 46409 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/efs/efs.ko 2024-04-17T19:32:20.139 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/f2fs/ 2024-04-17T19:32:20.139 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 1906817 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/f2fs/f2fs.ko 2024-04-17T19:32:20.139 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/fat/ 2024-04-17T19:32:20.139 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 35137 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/fat/msdos.ko 2024-04-17T19:32:20.139 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/freevxfs/ 2024-04-17T19:32:20.139 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 52313 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/freevxfs/freevxfs.ko 2024-04-17T19:32:20.139 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/fuse/ 2024-04-17T19:32:20.139 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 29177 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/fuse/cuse.ko 2024-04-17T19:32:20.140 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/gfs2/ 2024-04-17T19:32:20.140 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 1486521 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/gfs2/gfs2.ko 2024-04-17T19:32:20.140 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/hfs/ 2024-04-17T19:32:20.140 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 183305 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/hfs/hfs.ko 2024-04-17T19:32:20.140 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/hfsplus/ 2024-04-17T19:32:20.140 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 282097 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/hfsplus/hfsplus.ko 2024-04-17T19:32:20.140 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/hpfs/ 2024-04-17T19:32:20.140 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 249009 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/hpfs/hpfs.ko 2024-04-17T19:32:20.140 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/isofs/ 2024-04-17T19:32:20.140 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 93033 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/isofs/isofs.ko 2024-04-17T19:32:20.140 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/jfs/ 2024-04-17T19:32:20.140 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 533073 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/jfs/jfs.ko 2024-04-17T19:32:20.140 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/lockd/ 2024-04-17T19:32:20.141 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 361369 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/lockd/lockd.ko 2024-04-17T19:32:20.141 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/minix/ 2024-04-17T19:32:20.141 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 112609 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/minix/minix.ko 2024-04-17T19:32:20.141 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/netfs/ 2024-04-17T19:32:20.141 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 591585 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/netfs/netfs.ko 2024-04-17T19:32:20.141 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nfs/ 2024-04-17T19:32:20.141 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nfs/blocklayout/ 2024-04-17T19:32:20.141 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 102561 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2024-04-17T19:32:20.141 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nfs/filelayout/ 2024-04-17T19:32:20.141 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 74353 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2024-04-17T19:32:20.141 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nfs/flexfilelayout/ 2024-04-17T19:32:20.141 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 147689 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2024-04-17T19:32:20.142 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 1320249 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nfs/nfs.ko 2024-04-17T19:32:20.142 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 82105 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nfs/nfsv2.ko 2024-04-17T19:32:20.142 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 151641 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nfs/nfsv3.ko 2024-04-17T19:32:20.142 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 2518505 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nfs/nfsv4.ko 2024-04-17T19:32:20.142 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nfs_common/ 2024-04-17T19:32:20.142 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 19849 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nfs_common/grace.ko 2024-04-17T19:32:20.142 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 19345 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nfs_common/nfs_acl.ko 2024-04-17T19:32:20.142 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nfsd/ 2024-04-17T19:32:20.142 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 2024049 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nfsd/nfsd.ko 2024-04-17T19:32:20.142 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nilfs2/ 2024-04-17T19:32:20.142 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 734025 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nilfs2/nilfs2.ko 2024-04-17T19:32:20.143 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/ 2024-04-17T19:32:20.143 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 14977 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/mac-celtic.ko 2024-04-17T19:32:20.143 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 14353 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/mac-centeuro.ko 2024-04-17T19:32:20.143 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 14977 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/mac-croatian.ko 2024-04-17T19:32:20.143 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 14049 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/mac-cyrillic.ko 2024-04-17T19:32:20.143 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 14665 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/mac-gaelic.ko 2024-04-17T19:32:20.143 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 14041 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/mac-greek.ko 2024-04-17T19:32:20.143 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 14977 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/mac-iceland.ko 2024-04-17T19:32:20.143 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 14353 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/mac-inuit.ko 2024-04-17T19:32:20.143 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 15281 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/mac-roman.ko 2024-04-17T19:32:20.143 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 14977 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/mac-romanian.ko 2024-04-17T19:32:20.143 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 14977 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/mac-turkish.ko 2024-04-17T19:32:20.143 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 12481 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_ascii.ko 2024-04-17T19:32:20.144 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 13721 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_cp1250.ko 2024-04-17T19:32:20.144 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 13417 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_cp1251.ko 2024-04-17T19:32:20.144 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 14105 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_cp1255.ko 2024-04-17T19:32:20.144 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 13721 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_cp737.ko 2024-04-17T19:32:20.144 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 13721 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_cp775.ko 2024-04-17T19:32:20.144 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 13409 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_cp850.ko 2024-04-17T19:32:20.144 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 13409 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_cp852.ko 2024-04-17T19:32:20.144 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 13409 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_cp855.ko 2024-04-17T19:32:20.144 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 13097 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_cp857.ko 2024-04-17T19:32:20.144 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 14033 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_cp860.ko 2024-04-17T19:32:20.145 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 14345 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_cp861.ko 2024-04-17T19:32:20.145 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 14657 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_cp862.ko 2024-04-17T19:32:20.145 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 14345 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_cp863.ko 2024-04-17T19:32:20.145 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 14033 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_cp864.ko 2024-04-17T19:32:20.145 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 14345 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_cp865.ko 2024-04-17T19:32:20.145 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 13721 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_cp866.ko 2024-04-17T19:32:20.145 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 13409 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_cp869.ko 2024-04-17T19:32:20.145 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 13169 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_cp874.ko 2024-04-17T19:32:20.145 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 95625 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_cp932.ko 2024-04-17T19:32:20.145 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 144209 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_cp936.ko 2024-04-17T19:32:20.145 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 167137 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_cp949.ko 2024-04-17T19:32:20.145 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 119513 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_cp950.ko 2024-04-17T19:32:20.145 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 14049 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_euc-jp.ko 2024-04-17T19:32:20.146 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 12489 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_iso8859-1.ko 2024-04-17T19:32:20.146 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 13113 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_iso8859-13.ko 2024-04-17T19:32:20.146 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 13113 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_iso8859-14.ko 2024-04-17T19:32:20.146 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 13113 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_iso8859-15.ko 2024-04-17T19:32:20.146 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 13105 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_iso8859-2.ko 2024-04-17T19:32:20.146 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 13105 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_iso8859-3.ko 2024-04-17T19:32:20.146 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 13105 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_iso8859-4.ko 2024-04-17T19:32:20.146 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 13105 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_iso8859-5.ko 2024-04-17T19:32:20.146 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 12801 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_iso8859-6.ko 2024-04-17T19:32:20.146 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 13417 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_iso8859-7.ko 2024-04-17T19:32:20.146 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 12801 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_iso8859-9.ko 2024-04-17T19:32:20.146 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 13721 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_koi8-r.ko 2024-04-17T19:32:20.147 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 9833 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_koi8-ru.ko 2024-04-17T19:32:20.147 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 13721 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_koi8-u.ko 2024-04-17T19:32:20.147 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 7521 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_ucs2_utils.ko 2024-04-17T19:32:20.147 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 9601 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_utf8.ko 2024-04-17T19:32:20.147 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/ocfs2/ 2024-04-17T19:32:20.147 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/ocfs2/cluster/ 2024-04-17T19:32:20.147 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 302073 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2024-04-17T19:32:20.148 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/ocfs2/dlm/ 2024-04-17T19:32:20.148 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 548169 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2024-04-17T19:32:20.148 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/ocfs2/dlmfs/ 2024-04-17T19:32:20.148 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 66361 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2024-04-17T19:32:20.148 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 3245617 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/ocfs2/ocfs2.ko 2024-04-17T19:32:20.148 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 22113 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2024-04-17T19:32:20.148 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 39313 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/ocfs2/ocfs2_stack_user.ko 2024-04-17T19:32:20.148 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 43073 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/ocfs2/ocfs2_stackglue.ko 2024-04-17T19:32:20.148 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/omfs/ 2024-04-17T19:32:20.148 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 67489 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/omfs/omfs.ko 2024-04-17T19:32:20.148 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/overlayfs/ 2024-04-17T19:32:20.148 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 462873 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/overlayfs/overlay.ko 2024-04-17T19:32:20.149 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/pstore/ 2024-04-17T19:32:20.149 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 67977 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/pstore/ramoops.ko 2024-04-17T19:32:20.149 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/qnx4/ 2024-04-17T19:32:20.149 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 33209 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/qnx4/qnx4.ko 2024-04-17T19:32:20.149 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/qnx6/ 2024-04-17T19:32:20.149 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 56097 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/qnx6/qnx6.ko 2024-04-17T19:32:20.149 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/quota/ 2024-04-17T19:32:20.149 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 40313 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/quota/quota_tree.ko 2024-04-17T19:32:20.149 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 17513 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/quota/quota_v1.ko 2024-04-17T19:32:20.149 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 28817 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/quota/quota_v2.ko 2024-04-17T19:32:20.149 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/reiserfs/ 2024-04-17T19:32:20.149 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 684841 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/reiserfs/reiserfs.ko 2024-04-17T19:32:20.149 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/romfs/ 2024-04-17T19:32:20.150 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 34673 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/romfs/romfs.ko 2024-04-17T19:32:20.150 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/smb/ 2024-04-17T19:32:20.150 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/smb/client/ 2024-04-17T19:32:20.150 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 3319041 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/smb/client/cifs.ko 2024-04-17T19:32:20.150 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/smb/common/ 2024-04-17T19:32:20.150 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 8073 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/smb/common/cifs_arc4.ko 2024-04-17T19:32:20.150 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 12737 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/smb/common/cifs_md4.ko 2024-04-17T19:32:20.150 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/squashfs/ 2024-04-17T19:32:20.150 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 164185 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/squashfs/squashfs.ko 2024-04-17T19:32:20.150 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/sysv/ 2024-04-17T19:32:20.150 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 115977 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/sysv/sysv.ko 2024-04-17T19:32:20.150 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/udf/ 2024-04-17T19:32:20.151 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 310017 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/udf/udf.ko 2024-04-17T19:32:20.151 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/ufs/ 2024-04-17T19:32:20.151 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 198233 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/ufs/ufs.ko 2024-04-17T19:32:20.151 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/xfs/ 2024-04-17T19:32:20.151 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 5192705 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/xfs/xfs.ko 2024-04-17T19:32:20.193 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/kernel/ 2024-04-17T19:32:20.193 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/kernel/locking/ 2024-04-17T19:32:20.194 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 97625 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/kernel/locking/locktorture.ko 2024-04-17T19:32:20.194 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/kernel/time/ 2024-04-17T19:32:20.194 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 15753 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/kernel/time/test_udelay.ko 2024-04-17T19:32:20.194 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 72665 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/kernel/torture.ko 2024-04-17T19:32:20.195 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/lib/ 2024-04-17T19:32:20.195 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 7313 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/lib/crc-itu-t.ko 2024-04-17T19:32:20.195 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 7081 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/lib/crc7.ko 2024-04-17T19:32:20.195 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 7953 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/lib/crc8.ko 2024-04-17T19:32:20.195 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/lib/crypto/ 2024-04-17T19:32:20.195 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 8009 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/lib/crypto/libarc4.ko 2024-04-17T19:32:20.196 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 38985 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/lib/crypto/libdes.ko 2024-04-17T19:32:20.196 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 14689 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/lib/interval_tree_test.ko 2024-04-17T19:32:20.196 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 9401 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/lib/libcrc32c.ko 2024-04-17T19:32:20.196 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 29065 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/lib/lru_cache.ko 2024-04-17T19:32:20.196 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/lib/lz4/ 2024-04-17T19:32:20.196 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 36169 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/lib/lz4/lz4_compress.ko 2024-04-17T19:32:20.196 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 24729 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/lib/lz4/lz4hc_compress.ko 2024-04-17T19:32:20.196 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/lib/math/ 2024-04-17T19:32:20.196 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 7281 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/lib/math/cordic.ko 2024-04-17T19:32:20.196 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 9169 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/lib/memory-notifier-error-inject.ko 2024-04-17T19:32:20.196 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 12537 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/lib/notifier-error-inject.ko 2024-04-17T19:32:20.197 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 15921 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/lib/percpu_test.ko 2024-04-17T19:32:20.197 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 9249 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/lib/pm-notifier-error-inject.ko 2024-04-17T19:32:20.197 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/lib/raid6/ 2024-04-17T19:32:20.197 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 152025 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/lib/raid6/raid6_pq.ko 2024-04-17T19:32:20.197 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 24481 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/lib/rbtree_test.ko 2024-04-17T19:32:20.197 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/lib/reed_solomon/ 2024-04-17T19:32:20.197 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 21385 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/lib/reed_solomon/reed_solomon.ko 2024-04-17T19:32:20.197 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 40969 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/lib/test-kstrtox.ko 2024-04-17T19:32:20.197 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 4912441 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/lib/test_bpf.ko 2024-04-17T19:32:20.197 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 61169 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/lib/test_firmware.ko 2024-04-17T19:32:20.197 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 7121 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/lib/test_module.ko 2024-04-17T19:32:20.197 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 24937 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/lib/test_user_copy.ko 2024-04-17T19:32:20.197 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 11329 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/lib/ts_bm.ko 2024-04-17T19:32:20.198 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 13289 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/lib/ts_fsm.ko 2024-04-17T19:32:20.198 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 11369 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/lib/ts_kmp.ko 2024-04-17T19:32:20.198 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/lib/xz/ 2024-04-17T19:32:20.198 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 15865 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/lib/xz/xz_dec_test.ko 2024-04-17T19:32:20.198 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/mm/ 2024-04-17T19:32:20.198 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 20529 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/mm/hwpoison-inject.ko 2024-04-17T19:32:20.198 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ 2024-04-17T19:32:20.198 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/6lowpan/ 2024-04-17T19:32:20.198 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 66969 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/6lowpan/6lowpan.ko 2024-04-17T19:32:20.198 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 7577 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/6lowpan/nhc_dest.ko 2024-04-17T19:32:20.198 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 7529 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/6lowpan/nhc_fragment.ko 2024-04-17T19:32:20.199 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 7513 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/6lowpan/nhc_hop.ko 2024-04-17T19:32:20.199 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 7513 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/6lowpan/nhc_ipv6.ko 2024-04-17T19:32:20.199 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 7529 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/6lowpan/nhc_mobility.ko 2024-04-17T19:32:20.199 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 7521 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/6lowpan/nhc_routing.ko 2024-04-17T19:32:20.199 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 17225 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/6lowpan/nhc_udp.ko 2024-04-17T19:32:20.199 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/802/ 2024-04-17T19:32:20.199 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 36729 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/802/garp.ko 2024-04-17T19:32:20.199 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 42297 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/802/mrp.ko 2024-04-17T19:32:20.199 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 9849 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/802/p8022.ko 2024-04-17T19:32:20.199 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 19417 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/802/psnap.ko 2024-04-17T19:32:20.199 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 13537 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/802/stp.ko 2024-04-17T19:32:20.199 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/8021q/ 2024-04-17T19:32:20.199 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 106793 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/8021q/8021q.ko 2024-04-17T19:32:20.200 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/9p/ 2024-04-17T19:32:20.200 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 236793 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/9p/9pnet.ko 2024-04-17T19:32:20.200 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 44449 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/9p/9pnet_fd.ko 2024-04-17T19:32:20.200 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 32209 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/9p/9pnet_rdma.ko 2024-04-17T19:32:20.200 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 39513 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/9p/9pnet_virtio.ko 2024-04-17T19:32:20.200 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/batman-adv/ 2024-04-17T19:32:20.200 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 879697 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/batman-adv/batman-adv.ko 2024-04-17T19:32:20.200 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/bridge/ 2024-04-17T19:32:20.200 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 84761 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/bridge/br_netfilter.ko 2024-04-17T19:32:20.200 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 1030873 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/bridge/bridge.ko 2024-04-17T19:32:20.200 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/bridge/netfilter/ 2024-04-17T19:32:20.200 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 8905 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/bridge/netfilter/ebt_802_3.ko 2024-04-17T19:32:20.201 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 14569 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/bridge/netfilter/ebt_among.ko 2024-04-17T19:32:20.201 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 10457 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/bridge/netfilter/ebt_arp.ko 2024-04-17T19:32:20.201 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 10417 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/bridge/netfilter/ebt_arpreply.ko 2024-04-17T19:32:20.201 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 10953 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/bridge/netfilter/ebt_dnat.ko 2024-04-17T19:32:20.201 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 10001 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/bridge/netfilter/ebt_ip.ko 2024-04-17T19:32:20.201 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 10337 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/bridge/netfilter/ebt_ip6.ko 2024-04-17T19:32:20.201 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 11145 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/bridge/netfilter/ebt_limit.ko 2024-04-17T19:32:20.201 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 15385 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/bridge/netfilter/ebt_log.ko 2024-04-17T19:32:20.201 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 8841 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/bridge/netfilter/ebt_mark.ko 2024-04-17T19:32:20.201 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 8777 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/bridge/netfilter/ebt_mark_m.ko 2024-04-17T19:32:20.201 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 9569 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/bridge/netfilter/ebt_nflog.ko 2024-04-17T19:32:20.202 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 8625 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/bridge/netfilter/ebt_pkttype.ko 2024-04-17T19:32:20.202 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 10913 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/bridge/netfilter/ebt_redirect.ko 2024-04-17T19:32:20.202 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 9953 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/bridge/netfilter/ebt_snat.ko 2024-04-17T19:32:20.202 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 10105 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/bridge/netfilter/ebt_stp.ko 2024-04-17T19:32:20.202 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 13713 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/bridge/netfilter/ebt_vlan.ko 2024-04-17T19:32:20.202 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 13249 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/bridge/netfilter/ebtable_broute.ko 2024-04-17T19:32:20.202 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 11209 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/bridge/netfilter/ebtable_filter.ko 2024-04-17T19:32:20.202 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 11185 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/bridge/netfilter/ebtable_nat.ko 2024-04-17T19:32:20.202 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 70529 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/bridge/netfilter/ebtables.ko 2024-04-17T19:32:20.202 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 16113 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2024-04-17T19:32:20.202 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 16217 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2024-04-17T19:32:20.202 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ceph/ 2024-04-17T19:32:20.203 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 1243505 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ceph/libceph.ko 2024-04-17T19:32:20.203 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/core/ 2024-04-17T19:32:20.203 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 153801 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/core/pktgen.ko 2024-04-17T19:32:20.203 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/dccp/ 2024-04-17T19:32:20.203 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 244889 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/dccp/dccp.ko 2024-04-17T19:32:20.203 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 10273 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/dccp/dccp_diag.ko 2024-04-17T19:32:20.203 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 71033 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/dccp/dccp_ipv4.ko 2024-04-17T19:32:20.203 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 74993 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/dccp/dccp_ipv6.ko 2024-04-17T19:32:20.203 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/dsa/ 2024-04-17T19:32:20.203 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 507705 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/dsa/dsa_core.ko 2024-04-17T19:32:20.203 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 15841 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/dsa/tag_brcm.ko 2024-04-17T19:32:20.203 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 14921 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/dsa/tag_dsa.ko 2024-04-17T19:32:20.203 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 8873 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/dsa/tag_none.ko 2024-04-17T19:32:20.204 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 10465 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/dsa/tag_trailer.ko 2024-04-17T19:32:20.204 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/hsr/ 2024-04-17T19:32:20.204 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 128873 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/hsr/hsr.ko 2024-04-17T19:32:20.204 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ieee802154/ 2024-04-17T19:32:20.204 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ieee802154/6lowpan/ 2024-04-17T19:32:20.204 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 55505 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2024-04-17T19:32:20.204 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 357425 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ieee802154/ieee802154.ko 2024-04-17T19:32:20.204 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 59393 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ieee802154/ieee802154_socket.ko 2024-04-17T19:32:20.204 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/ 2024-04-17T19:32:20.204 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 29041 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/ah4.ko 2024-04-17T19:32:20.204 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 46417 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/esp4.ko 2024-04-17T19:32:20.204 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 60233 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/fou.ko 2024-04-17T19:32:20.205 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 21937 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/gre.ko 2024-04-17T19:32:20.205 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 65665 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/inet_diag.ko 2024-04-17T19:32:20.205 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 75489 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/ip_gre.ko 2024-04-17T19:32:20.205 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 77721 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/ip_tunnel.ko 2024-04-17T19:32:20.205 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 43705 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/ip_vti.ko 2024-04-17T19:32:20.205 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 16513 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/ipcomp.ko 2024-04-17T19:32:20.205 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 34745 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/ipip.ko 2024-04-17T19:32:20.205 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/netfilter/ 2024-04-17T19:32:20.205 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 45521 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/netfilter/arp_tables.ko 2024-04-17T19:32:20.205 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 10137 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/netfilter/arpt_mangle.ko 2024-04-17T19:32:20.205 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 11905 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/netfilter/arptable_filter.ko 2024-04-17T19:32:20.205 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 50169 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/netfilter/ip_tables.ko 2024-04-17T19:32:20.206 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 11369 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/netfilter/ipt_ECN.ko 2024-04-17T19:32:20.206 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 11457 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/netfilter/ipt_REJECT.ko 2024-04-17T19:32:20.206 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 16353 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2024-04-17T19:32:20.206 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 12513 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/netfilter/ipt_ah.ko 2024-04-17T19:32:20.206 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 17289 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2024-04-17T19:32:20.206 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 12993 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/netfilter/iptable_filter.ko 2024-04-17T19:32:20.206 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 13377 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/netfilter/iptable_mangle.ko 2024-04-17T19:32:20.206 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 17297 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/netfilter/iptable_nat.ko 2024-04-17T19:32:20.206 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 13241 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/netfilter/iptable_raw.ko 2024-04-17T19:32:20.206 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 11969 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/netfilter/iptable_security.ko 2024-04-17T19:32:20.206 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 14505 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2024-04-17T19:32:20.206 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 9705 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2024-04-17T19:32:20.207 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 32473 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2024-04-17T19:32:20.207 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 20737 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2024-04-17T19:32:20.207 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 15017 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2024-04-17T19:32:20.207 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 25753 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/netfilter/nf_reject_ipv4.ko 2024-04-17T19:32:20.207 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 10249 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2024-04-17T19:32:20.207 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 17161 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2024-04-17T19:32:20.207 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 11457 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2024-04-17T19:32:20.207 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 19513 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2024-04-17T19:32:20.207 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 10065 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2024-04-17T19:32:20.207 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 14689 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/tcp_bic.ko 2024-04-17T19:32:20.207 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 16113 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/tcp_dctcp.ko 2024-04-17T19:32:20.207 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 19409 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/tcp_diag.ko 2024-04-17T19:32:20.208 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 11017 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/tcp_highspeed.ko 2024-04-17T19:32:20.208 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 14385 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/tcp_htcp.ko 2024-04-17T19:32:20.208 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 11665 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/tcp_hybla.ko 2024-04-17T19:32:20.208 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 13449 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/tcp_illinois.ko 2024-04-17T19:32:20.208 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 11737 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/tcp_lp.ko 2024-04-17T19:32:20.208 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 9601 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/tcp_scalable.ko 2024-04-17T19:32:20.208 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 16721 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/tcp_vegas.ko 2024-04-17T19:32:20.208 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 12105 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/tcp_veno.ko 2024-04-17T19:32:20.208 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 13257 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/tcp_westwood.ko 2024-04-17T19:32:20.208 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 11745 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/tcp_yeah.ko 2024-04-17T19:32:20.208 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 28585 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/tunnel4.ko 2024-04-17T19:32:20.208 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 21137 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/udp_diag.ko 2024-04-17T19:32:20.209 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 54441 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/udp_tunnel.ko 2024-04-17T19:32:20.209 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 13857 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/xfrm4_tunnel.ko 2024-04-17T19:32:20.209 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/ 2024-04-17T19:32:20.209 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 31073 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/ah6.ko 2024-04-17T19:32:20.209 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 47433 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/esp6.ko 2024-04-17T19:32:20.209 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 17113 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/fou6.ko 2024-04-17T19:32:20.209 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 103177 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/ip6_gre.ko 2024-04-17T19:32:20.209 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 118881 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/ip6_tunnel.ko 2024-04-17T19:32:20.209 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 16249 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/ip6_udp_tunnel.ko 2024-04-17T19:32:20.209 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 71089 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/ip6_vti.ko 2024-04-17T19:32:20.209 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 16249 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/ipcomp6.ko 2024-04-17T19:32:20.209 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 23017 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/mip6.ko 2024-04-17T19:32:20.209 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/netfilter/ 2024-04-17T19:32:20.210 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 50673 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/netfilter/ip6_tables.ko 2024-04-17T19:32:20.210 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 13833 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/netfilter/ip6t_NPT.ko 2024-04-17T19:32:20.210 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 11593 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2024-04-17T19:32:20.210 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 16361 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2024-04-17T19:32:20.210 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 15929 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/netfilter/ip6t_ah.ko 2024-04-17T19:32:20.210 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 8721 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2024-04-17T19:32:20.210 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 17953 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/netfilter/ip6t_frag.ko 2024-04-17T19:32:20.210 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 17625 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2024-04-17T19:32:20.210 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 10049 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2024-04-17T19:32:20.210 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 11137 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/netfilter/ip6t_mh.ko 2024-04-17T19:32:20.210 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 12473 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2024-04-17T19:32:20.211 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 12185 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/netfilter/ip6t_rt.ko 2024-04-17T19:32:20.211 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 13001 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/netfilter/ip6table_filter.ko 2024-04-17T19:32:20.211 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 12857 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2024-04-17T19:32:20.211 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 17449 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/netfilter/ip6table_nat.ko 2024-04-17T19:32:20.211 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 13249 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/netfilter/ip6table_raw.ko 2024-04-17T19:32:20.211 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 11977 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/netfilter/ip6table_security.ko 2024-04-17T19:32:20.211 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 46313 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2024-04-17T19:32:20.211 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 9361 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2024-04-17T19:32:20.211 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 29817 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2024-04-17T19:32:20.211 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 10833 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2024-04-17T19:32:20.211 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 17257 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2024-04-17T19:32:20.211 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 11097 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2024-04-17T19:32:20.212 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 18521 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2024-04-17T19:32:20.212 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 10065 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2024-04-17T19:32:20.212 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 94089 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/sit.ko 2024-04-17T19:32:20.212 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 30297 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/tunnel6.ko 2024-04-17T19:32:20.212 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 28369 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/xfrm6_tunnel.ko 2024-04-17T19:32:20.212 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/key/ 2024-04-17T19:32:20.212 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 106369 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/key/af_key.ko 2024-04-17T19:32:20.212 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/l2tp/ 2024-04-17T19:32:20.212 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 153217 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/l2tp/l2tp_core.ko 2024-04-17T19:32:20.212 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 24273 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/l2tp/l2tp_debugfs.ko 2024-04-17T19:32:20.212 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 31985 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/l2tp/l2tp_eth.ko 2024-04-17T19:32:20.213 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 43641 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/l2tp/l2tp_ip.ko 2024-04-17T19:32:20.213 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 44993 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/l2tp/l2tp_ip6.ko 2024-04-17T19:32:20.213 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 42049 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/l2tp/l2tp_netlink.ko 2024-04-17T19:32:20.213 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 66241 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/l2tp/l2tp_ppp.ko 2024-04-17T19:32:20.213 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/lapb/ 2024-04-17T19:32:20.213 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 63345 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/lapb/lapb.ko 2024-04-17T19:32:20.213 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/llc/ 2024-04-17T19:32:20.213 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 27385 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/llc/llc.ko 2024-04-17T19:32:20.213 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 332889 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/llc/llc2.ko 2024-04-17T19:32:20.213 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/mac802154/ 2024-04-17T19:32:20.213 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 388873 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/mac802154/mac802154.ko 2024-04-17T19:32:20.213 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/mpls/ 2024-04-17T19:32:20.214 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 10577 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/mpls/mpls_gso.ko 2024-04-17T19:32:20.214 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/ 2024-04-17T19:32:20.214 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/ipset/ 2024-04-17T19:32:20.214 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 147745 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/ipset/ip_set.ko 2024-04-17T19:32:20.214 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 34473 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2024-04-17T19:32:20.214 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 33073 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2024-04-17T19:32:20.214 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 32553 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2024-04-17T19:32:20.214 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 124041 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2024-04-17T19:32:20.214 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 124345 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2024-04-17T19:32:20.214 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 126681 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2024-04-17T19:32:20.214 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 126473 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2024-04-17T19:32:20.214 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 137833 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2024-04-17T19:32:20.215 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 72353 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2024-04-17T19:32:20.215 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 133681 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2024-04-17T19:32:20.215 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 139073 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2024-04-17T19:32:20.215 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 138265 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2024-04-17T19:32:20.215 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 136177 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2024-04-17T19:32:20.215 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 139897 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2024-04-17T19:32:20.215 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 37129 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/ipset/ip_set_list_set.ko 2024-04-17T19:32:20.215 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/ipvs/ 2024-04-17T19:32:20.215 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 534113 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/ipvs/ip_vs.ko 2024-04-17T19:32:20.215 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 14201 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2024-04-17T19:32:20.215 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 8801 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2024-04-17T19:32:20.215 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 20561 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2024-04-17T19:32:20.215 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 20953 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2024-04-17T19:32:20.216 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 24577 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2024-04-17T19:32:20.216 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 8801 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2024-04-17T19:32:20.216 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 8865 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2024-04-17T19:32:20.216 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 12649 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2024-04-17T19:32:20.216 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 10873 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2024-04-17T19:32:20.216 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 8921 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2024-04-17T19:32:20.216 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 15977 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2024-04-17T19:32:20.216 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 8921 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2024-04-17T19:32:20.216 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 12809 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2024-04-17T19:32:20.216 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 55217 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nf_conncount.ko 2024-04-17T19:32:20.216 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 496817 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nf_conntrack.ko 2024-04-17T19:32:20.217 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 18097 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nf_conntrack_amanda.ko 2024-04-17T19:32:20.217 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 11793 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nf_conntrack_broadcast.ko 2024-04-17T19:32:20.217 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 37865 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nf_conntrack_ftp.ko 2024-04-17T19:32:20.217 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 134377 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nf_conntrack_h323.ko 2024-04-17T19:32:20.217 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 24513 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nf_conntrack_irc.ko 2024-04-17T19:32:20.217 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 9401 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2024-04-17T19:32:20.217 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 140801 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nf_conntrack_netlink.ko 2024-04-17T19:32:20.217 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 38305 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nf_conntrack_pptp.ko 2024-04-17T19:32:20.217 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 18937 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nf_conntrack_sane.ko 2024-04-17T19:32:20.217 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 79873 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nf_conntrack_sip.ko 2024-04-17T19:32:20.217 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 12561 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nf_conntrack_snmp.ko 2024-04-17T19:32:20.217 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 21089 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nf_conntrack_tftp.ko 2024-04-17T19:32:20.218 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 11401 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nf_dup_netdev.ko 2024-04-17T19:32:20.218 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 117201 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nf_flow_table.ko 2024-04-17T19:32:20.218 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 10961 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nf_flow_table_inet.ko 2024-04-17T19:32:20.218 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 46105 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nf_log_syslog.ko 2024-04-17T19:32:20.218 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 118369 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nf_nat.ko 2024-04-17T19:32:20.218 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 11369 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nf_nat_amanda.ko 2024-04-17T19:32:20.218 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 14185 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nf_nat_ftp.ko 2024-04-17T19:32:20.218 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 13345 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nf_nat_irc.ko 2024-04-17T19:32:20.218 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 34609 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nf_nat_sip.ko 2024-04-17T19:32:20.218 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 9889 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nf_nat_tftp.ko 2024-04-17T19:32:20.218 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 53393 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nf_synproxy_core.ko 2024-04-17T19:32:20.218 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 807985 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nf_tables.ko 2024-04-17T19:32:20.219 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 53049 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nfnetlink.ko 2024-04-17T19:32:20.219 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 36481 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nfnetlink_acct.ko 2024-04-17T19:32:20.219 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 37209 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nfnetlink_cttimeout.ko 2024-04-17T19:32:20.219 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 49297 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nfnetlink_log.ko 2024-04-17T19:32:20.219 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 26473 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nfnetlink_osf.ko 2024-04-17T19:32:20.219 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 65145 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nfnetlink_queue.ko 2024-04-17T19:32:20.219 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 11993 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nft_chain_nat.ko 2024-04-17T19:32:20.219 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 41769 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nft_compat.ko 2024-04-17T19:32:20.219 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 50657 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nft_ct.ko 2024-04-17T19:32:20.219 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 11081 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nft_dup_netdev.ko 2024-04-17T19:32:20.219 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 13745 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nft_fib.ko 2024-04-17T19:32:20.219 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 16545 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nft_fwd_netdev.ko 2024-04-17T19:32:20.220 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 17177 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nft_hash.ko 2024-04-17T19:32:20.220 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 25225 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nft_limit.ko 2024-04-17T19:32:20.220 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 17921 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nft_log.ko 2024-04-17T19:32:20.220 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 17449 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nft_masq.ko 2024-04-17T19:32:20.220 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 16873 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nft_nat.ko 2024-04-17T19:32:20.220 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 16473 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nft_numgen.ko 2024-04-17T19:32:20.220 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 13945 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nft_osf.ko 2024-04-17T19:32:20.220 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 16833 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nft_queue.ko 2024-04-17T19:32:20.220 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 16657 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nft_redir.ko 2024-04-17T19:32:20.220 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 12209 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nft_reject.ko 2024-04-17T19:32:20.220 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 11377 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nft_reject_inet.ko 2024-04-17T19:32:20.220 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 15057 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nft_socket.ko 2024-04-17T19:32:20.221 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 24993 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nft_synproxy.ko 2024-04-17T19:32:20.221 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 17641 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nft_tproxy.ko 2024-04-17T19:32:20.221 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 108393 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/x_tables.ko 2024-04-17T19:32:20.221 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 14193 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_AUDIT.ko 2024-04-17T19:32:20.221 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 10865 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_CHECKSUM.ko 2024-04-17T19:32:20.221 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 8625 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_CLASSIFY.ko 2024-04-17T19:32:20.221 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 13409 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_CONNSECMARK.ko 2024-04-17T19:32:20.221 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 21865 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_CT.ko 2024-04-17T19:32:20.221 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 12289 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_DSCP.ko 2024-04-17T19:32:20.221 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 11073 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_HL.ko 2024-04-17T19:32:20.221 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 15745 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_HMARK.ko 2024-04-17T19:32:20.221 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 45217 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_IDLETIMER.ko 2024-04-17T19:32:20.222 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 15937 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_LED.ko 2024-04-17T19:32:20.222 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 13017 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_LOG.ko 2024-04-17T19:32:20.222 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 13377 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_MASQUERADE.ko 2024-04-17T19:32:20.222 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 13321 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_NETMAP.ko 2024-04-17T19:32:20.222 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 10857 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_NFLOG.ko 2024-04-17T19:32:20.222 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 15361 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_NFQUEUE.ko 2024-04-17T19:32:20.222 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 23089 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_RATEEST.ko 2024-04-17T19:32:20.222 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 12553 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_REDIRECT.ko 2024-04-17T19:32:20.222 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 16689 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_SECMARK.ko 2024-04-17T19:32:20.222 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 18985 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_TCPMSS.ko 2024-04-17T19:32:20.222 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 11769 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2024-04-17T19:32:20.222 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 20697 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_TEE.ko 2024-04-17T19:32:20.223 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 19625 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_TPROXY.ko 2024-04-17T19:32:20.223 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 9449 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_TRACE.ko 2024-04-17T19:32:20.223 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 15289 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_addrtype.ko 2024-04-17T19:32:20.223 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 16633 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_bpf.ko 2024-04-17T19:32:20.223 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 20489 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_cgroup.ko 2024-04-17T19:32:20.223 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 12865 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_cluster.ko 2024-04-17T19:32:20.223 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 8465 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_comment.ko 2024-04-17T19:32:20.223 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 11961 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_connbytes.ko 2024-04-17T19:32:20.223 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 12969 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_connlabel.ko 2024-04-17T19:32:20.223 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 10617 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_connlimit.ko 2024-04-17T19:32:20.224 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 15841 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_connmark.ko 2024-04-17T19:32:20.224 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 14209 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_conntrack.ko 2024-04-17T19:32:20.224 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 8913 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_cpu.ko 2024-04-17T19:32:20.224 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 12489 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_dccp.ko 2024-04-17T19:32:20.224 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 9001 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_devgroup.ko 2024-04-17T19:32:20.224 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 10257 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_dscp.ko 2024-04-17T19:32:20.224 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 12657 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_ecn.ko 2024-04-17T19:32:20.224 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 12873 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_esp.ko 2024-04-17T19:32:20.224 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 52817 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_hashlimit.ko 2024-04-17T19:32:20.224 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 12833 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_helper.ko 2024-04-17T19:32:20.224 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 9521 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_hl.ko 2024-04-17T19:32:20.224 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 13241 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_ipcomp.ko 2024-04-17T19:32:20.225 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 12801 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_iprange.ko 2024-04-17T19:32:20.225 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 13409 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_ipvs.ko 2024-04-17T19:32:20.225 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 19193 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_l2tp.ko 2024-04-17T19:32:20.225 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 9137 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_length.ko 2024-04-17T19:32:20.225 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 11521 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_limit.ko 2024-04-17T19:32:20.225 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 8449 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_mac.ko 2024-04-17T19:32:20.225 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 9881 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_mark.ko 2024-04-17T19:32:20.225 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 13417 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_multiport.ko 2024-04-17T19:32:20.225 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 16161 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_nat.ko 2024-04-17T19:32:20.225 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 11433 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_nfacct.ko 2024-04-17T19:32:20.225 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 9433 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_osf.ko 2024-04-17T19:32:20.225 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 11561 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_owner.ko 2024-04-17T19:32:20.226 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 11457 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_physdev.ko 2024-04-17T19:32:20.226 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 8625 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_pkttype.ko 2024-04-17T19:32:20.226 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 13553 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_policy.ko 2024-04-17T19:32:20.226 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 10905 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_quota.ko 2024-04-17T19:32:20.226 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 11881 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_rateest.ko 2024-04-17T19:32:20.226 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 9273 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_realm.ko 2024-04-17T19:32:20.226 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 43465 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_recent.ko 2024-04-17T19:32:20.226 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 14833 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_sctp.ko 2024-04-17T19:32:20.226 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 36489 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_set.ko 2024-04-17T19:32:20.226 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 19777 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_socket.ko 2024-04-17T19:32:20.226 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 10753 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_state.ko 2024-04-17T19:32:20.227 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 10849 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_statistic.ko 2024-04-17T19:32:20.227 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 10025 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_string.ko 2024-04-17T19:32:20.227 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 9593 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_tcpmss.ko 2024-04-17T19:32:20.227 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 18449 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_tcpudp.ko 2024-04-17T19:32:20.227 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 12441 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_time.ko 2024-04-17T19:32:20.227 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 10617 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_u32.ko 2024-04-17T19:32:20.227 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netlink/ 2024-04-17T19:32:20.227 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 17233 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netlink/netlink_diag.ko 2024-04-17T19:32:20.227 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/nsh/ 2024-04-17T19:32:20.227 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 14073 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/nsh/nsh.ko 2024-04-17T19:32:20.227 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/openvswitch/ 2024-04-17T19:32:20.227 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 488825 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/openvswitch/openvswitch.ko 2024-04-17T19:32:20.228 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 12009 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/openvswitch/vport-geneve.ko 2024-04-17T19:32:20.228 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 10873 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/openvswitch/vport-gre.ko 2024-04-17T19:32:20.228 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 13905 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/openvswitch/vport-vxlan.ko 2024-04-17T19:32:20.228 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/packet/ 2024-04-17T19:32:20.228 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 15929 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/packet/af_packet_diag.ko 2024-04-17T19:32:20.228 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/phonet/ 2024-04-17T19:32:20.228 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 142025 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/phonet/phonet.ko 2024-04-17T19:32:20.228 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 68817 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/phonet/pn_pep.ko 2024-04-17T19:32:20.228 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/rds/ 2024-04-17T19:32:20.228 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 318617 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/rds/rds.ko 2024-04-17T19:32:20.228 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 202305 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/rds/rds_rdma.ko 2024-04-17T19:32:20.228 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 85105 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/rds/rds_tcp.ko 2024-04-17T19:32:20.228 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/rxrpc/ 2024-04-17T19:32:20.229 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 1027897 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/rxrpc/rxrpc.ko 2024-04-17T19:32:20.229 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/ 2024-04-17T19:32:20.229 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 39001 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/act_csum.ko 2024-04-17T19:32:20.229 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 28721 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/act_gact.ko 2024-04-17T19:32:20.229 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 45409 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/act_mirred.ko 2024-04-17T19:32:20.229 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 27593 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/act_nat.ko 2024-04-17T19:32:20.229 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 53465 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/act_pedit.ko 2024-04-17T19:32:20.229 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 38705 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/act_police.ko 2024-04-17T19:32:20.229 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 23969 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/act_simple.ko 2024-04-17T19:32:20.229 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 43417 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/act_skbedit.ko 2024-04-17T19:32:20.229 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 45673 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/act_vlan.ko 2024-04-17T19:32:20.229 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 32129 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/cls_basic.ko 2024-04-17T19:32:20.230 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 41457 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/cls_bpf.ko 2024-04-17T19:32:20.230 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 23225 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/cls_cgroup.ko 2024-04-17T19:32:20.230 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 37305 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/cls_flow.ko 2024-04-17T19:32:20.230 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 39601 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/cls_fw.ko 2024-04-17T19:32:20.230 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 49321 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/cls_route.ko 2024-04-17T19:32:20.230 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 79145 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/cls_u32.ko 2024-04-17T19:32:20.230 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 8713 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/em_cmp.ko 2024-04-17T19:32:20.230 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 15385 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/em_ipset.ko 2024-04-17T19:32:20.230 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 48785 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/em_meta.ko 2024-04-17T19:32:20.230 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 9241 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/em_nbyte.ko 2024-04-17T19:32:20.230 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 13369 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/em_text.ko 2024-04-17T19:32:20.231 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 8377 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/em_u32.ko 2024-04-17T19:32:20.231 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 25801 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/sch_choke.ko 2024-04-17T19:32:20.231 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 25097 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/sch_codel.ko 2024-04-17T19:32:20.231 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 43481 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/sch_drr.ko 2024-04-17T19:32:20.231 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 43153 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/sch_fq.ko 2024-04-17T19:32:20.231 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 39177 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/sch_fq_codel.ko 2024-04-17T19:32:20.231 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 42889 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/sch_gred.ko 2024-04-17T19:32:20.231 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 62817 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/sch_hfsc.ko 2024-04-17T19:32:20.231 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 26585 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/sch_hhf.ko 2024-04-17T19:32:20.231 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 81833 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/sch_htb.ko 2024-04-17T19:32:20.231 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 33545 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/sch_ingress.ko 2024-04-17T19:32:20.231 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 36625 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/sch_mqprio.ko 2024-04-17T19:32:20.232 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 12297 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/sch_mqprio_lib.ko 2024-04-17T19:32:20.232 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 33065 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/sch_multiq.ko 2024-04-17T19:32:20.232 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 44793 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/sch_netem.ko 2024-04-17T19:32:20.232 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 32833 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/sch_pie.ko 2024-04-17T19:32:20.232 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 13505 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/sch_plug.ko 2024-04-17T19:32:20.232 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 31801 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/sch_prio.ko 2024-04-17T19:32:20.232 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 60249 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/sch_qfq.ko 2024-04-17T19:32:20.232 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 40889 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/sch_red.ko 2024-04-17T19:32:20.232 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 33433 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/sch_sfb.ko 2024-04-17T19:32:20.232 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 38329 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/sch_sfq.ko 2024-04-17T19:32:20.232 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 35777 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/sch_tbf.ko 2024-04-17T19:32:20.232 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 34161 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/sch_teql.ko 2024-04-17T19:32:20.233 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sctp/ 2024-04-17T19:32:20.233 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 1187313 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sctp/sctp.ko 2024-04-17T19:32:20.233 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 23913 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sctp/sctp_diag.ko 2024-04-17T19:32:20.233 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sunrpc/ 2024-04-17T19:32:20.233 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sunrpc/auth_gss/ 2024-04-17T19:32:20.233 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 432409 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2024-04-17T19:32:20.233 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 70113 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2024-04-17T19:32:20.233 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 1940889 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sunrpc/sunrpc.ko 2024-04-17T19:32:20.233 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sunrpc/xprtrdma/ 2024-04-17T19:32:20.233 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 890729 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2024-04-17T19:32:20.233 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/tipc/ 2024-04-17T19:32:20.233 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 1122337 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/tipc/tipc.ko 2024-04-17T19:32:20.234 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 12153 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/tipc/tipc_diag.ko 2024-04-17T19:32:20.234 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/unix/ 2024-04-17T19:32:20.234 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 18801 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/unix/unix_diag.ko 2024-04-17T19:32:20.234 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/vmw_vsock/ 2024-04-17T19:32:20.234 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 105609 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2024-04-17T19:32:20.234 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 90265 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2024-04-17T19:32:20.234 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 123769 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/vmw_vsock/vsock.ko 2024-04-17T19:32:20.234 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 12905 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/vmw_vsock/vsock_diag.ko 2024-04-17T19:32:20.234 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 20401 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/vmw_vsock/vsock_loopback.ko 2024-04-17T19:32:20.234 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/x25/ 2024-04-17T19:32:20.234 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 165841 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/x25/x25.ko 2024-04-17T19:32:20.235 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/xfrm/ 2024-04-17T19:32:20.235 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 26729 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/xfrm/xfrm_algo.ko 2024-04-17T19:32:20.235 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 23353 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/xfrm/xfrm_ipcomp.ko 2024-04-17T19:32:20.235 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 131865 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/xfrm/xfrm_user.ko 2024-04-17T19:32:20.235 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 644769 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/modules.alias 2024-04-17T19:32:20.235 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 628542 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/modules.alias.bin 2024-04-17T19:32:20.235 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 7706 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/modules.builtin 2024-04-17T19:32:20.235 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 23609 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/modules.builtin.alias.bin 2024-04-17T19:32:20.235 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 9941 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/modules.builtin.bin 2024-04-17T19:32:20.235 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 70990 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/modules.builtin.modinfo 2024-04-17T19:32:20.236 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 146959 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/modules.dep 2024-04-17T19:32:20.236 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 232835 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/modules.dep.bin 2024-04-17T19:32:20.236 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 210 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/modules.devname 2024-04-17T19:32:20.236 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 72602 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/modules.order 2024-04-17T19:32:20.236 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 879 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/modules.softdep 2024-04-17T19:32:20.236 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 258450 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/modules.symbols 2024-04-17T19:32:20.236 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 313019 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/modules.symbols.bin 2024-04-17T19:32:20.236 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./usr/ 2024-04-17T19:32:20.236 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./usr/share/ 2024-04-17T19:32:20.236 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./usr/share/doc/ 2024-04-17T19:32:20.236 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./usr/share/doc/linux-image-6.9.0-rc3-g3f60ed14f7c1/ 2024-04-17T19:32:20.236 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 174 2024-04-11 18:50 ./usr/share/doc/linux-image-6.9.0-rc3-g3f60ed14f7c1/changelog.Debian.gz 2024-04-17T19:32:20.237 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 691 2024-04-11 18:50 ./usr/share/doc/linux-image-6.9.0-rc3-g3f60ed14f7c1/copyright 2024-04-17T19:32:20.242 DEBUG:teuthology.task.kernel:get_image_version: 6.9.0-rc3-g3f60ed14f7c1 2024-04-17T19:32:20.242 INFO:teuthology.task.kernel:searching for kernel 6.9.0-rc3-g3f60ed14f7c1 2024-04-17T19:32:20.242 DEBUG:teuthology.orchestra.run.smithi044:> egrep '(submenu|menuentry.*6.9.0-rc3-g3f60ed14f7c1).*{' /boot/grub/grub.cfg 2024-04-17T19:32:20.250 INFO:teuthology.orchestra.run.smithi044.stdout:submenu 'Advanced options for Ubuntu' $menuentry_id_option 'gnulinux-advanced-7e9e2103-8bb7-4452-b35a-3b1230743254' { 2024-04-17T19:32:20.250 INFO:teuthology.orchestra.run.smithi044.stdout: menuentry 'Ubuntu, with Linux 6.9.0-rc3-g3f60ed14f7c1' --class ubuntu --class gnu-linux --class gnu --class os $menuentry_id_option 'gnulinux-6.9.0-rc3-g3f60ed14f7c1-advanced-7e9e2103-8bb7-4452-b35a-3b1230743254' { 2024-04-17T19:32:20.250 INFO:teuthology.orchestra.run.smithi044.stdout: menuentry 'Ubuntu, with Linux 6.9.0-rc3-g3f60ed14f7c1 (recovery mode)' --class ubuntu --class gnu-linux --class gnu --class os $menuentry_id_option 'gnulinux-6.9.0-rc3-g3f60ed14f7c1-recovery-7e9e2103-8bb7-4452-b35a-3b1230743254' { 2024-04-17T19:32:20.251 INFO:teuthology.task.kernel:submenu_title:Advanced options for Ubuntu> 2024-04-17T19:32:20.251 INFO:teuthology.task.kernel:default_title:Ubuntu, with Linux 6.9.0-rc3-g3f60ed14f7c1 2024-04-17T19:32:20.251 DEBUG:teuthology.orchestra.run.smithi044:> /bin/echo -e 'cat </dev/null && sudo chmod a+x -- '/etc/grub.d/01_ceph_kernel.tmp~' && sudo mv -- '/etc/grub.d/01_ceph_kernel.tmp~' /etc/grub.d/01_ceph_kernel && sudo update-grub && rm /tmp/linux-image.deb && ( sleep 1 && sudo shutdown -r now & ) 2024-04-17T19:32:20.296 DEBUG:teuthology.task.kernel:Waiting for install on ubuntu@smithi044.front.sepia.ceph.com to complete... 2024-04-17T19:32:20.740 INFO:teuthology.orchestra.run.smithi044.stderr:Sourcing file `/etc/default/grub' 2024-04-17T19:32:20.741 INFO:teuthology.orchestra.run.smithi044.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-04-17T19:32:20.751 INFO:teuthology.orchestra.run.smithi044.stderr:Generating grub configuration file ... 2024-04-17T19:32:20.951 INFO:teuthology.orchestra.run.smithi044.stderr:Found linux image: /boot/vmlinuz-6.9.0-rc3-g3f60ed14f7c1 2024-04-17T19:32:20.958 INFO:teuthology.orchestra.run.smithi044.stderr:Found initrd image: /boot/initrd.img-6.9.0-rc3-g3f60ed14f7c1 2024-04-17T19:32:21.212 INFO:teuthology.orchestra.run.smithi044.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-04-17T19:32:21.218 INFO:teuthology.orchestra.run.smithi044.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-04-17T19:32:21.265 INFO:teuthology.orchestra.run.smithi044.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-04-17T19:32:21.271 INFO:teuthology.orchestra.run.smithi044.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-04-17T19:32:21.392 INFO:teuthology.orchestra.run.smithi044.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2024-04-17T19:32:21.392 INFO:teuthology.orchestra.run.smithi044.stderr:Systems on them will not be added to the GRUB boot configuration. 2024-04-17T19:32:21.392 INFO:teuthology.orchestra.run.smithi044.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-04-17T19:32:21.408 INFO:teuthology.orchestra.run.smithi044.stderr:done 2024-04-17T19:32:52.501 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2024-04-17T19:32:52.501 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi044.front.sepia.ceph.com' 2024-04-17T19:32:52.502 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi044.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T19:33:11.073 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.44 2024-04-17T19:33:20.074 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi044.front.sepia.ceph.com' 2024-04-17T19:33:20.075 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi044.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T19:34:20.086 DEBUG:teuthology.orchestra.remote:timed out 2024-04-17T19:34:32.087 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi044.front.sepia.ceph.com' 2024-04-17T19:34:32.088 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi044.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T19:34:32.370 DEBUG:teuthology.orchestra.run.smithi044:> true 2024-04-17T19:34:32.971 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi044.front.sepia.ceph.com' 2024-04-17T19:34:32.972 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.9.0-rc3-g3f60ed14f7c1"... 2024-04-17T19:34:32.972 DEBUG:teuthology.orchestra.run.smithi044:> uname -r 2024-04-17T19:34:33.026 INFO:teuthology.orchestra.run.smithi044.stdout:6.9.0-rc3-g3f60ed14f7c1 2024-04-17T19:34:33.026 DEBUG:teuthology.task.kernel:current kernel version is 6.9.0-rc3-g3f60ed14f7c1 vs 6.9.0-rc3-g3f60ed14f7c1 2024-04-17T19:34:33.026 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-04-17T19:34:33.026 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-04-17T19:34:34.028 DEBUG:teuthology.parallel:result is None 2024-04-17T19:34:34.028 INFO:teuthology.run_tasks:Running task internal.base... 2024-04-17T19:34:34.038 INFO:teuthology.task.internal:Creating test directory... 2024-04-17T19:34:34.039 DEBUG:teuthology.orchestra.run.smithi044:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-04-17T19:34:34.048 DEBUG:teuthology.orchestra.run.smithi062:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-04-17T19:34:34.055 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-04-17T19:34:34.062 INFO:teuthology.run_tasks:Running task internal.archive... 2024-04-17T19:34:34.069 INFO:teuthology.task.internal:Creating archive directory... 2024-04-17T19:34:34.069 DEBUG:teuthology.orchestra.run.smithi044:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-04-17T19:34:34.099 DEBUG:teuthology.orchestra.run.smithi062:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-04-17T19:34:34.124 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-04-17T19:34:34.130 INFO:teuthology.task.internal:Enabling coredump saving... 2024-04-17T19:34:34.130 DEBUG:teuthology.orchestra.run.smithi062:> test -f /run/.containerenv -o -f /.dockerenv 2024-04-17T19:34:34.163 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-17T19:34:34.163 DEBUG:teuthology.orchestra.run.smithi044:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-04-17T19:34:34.167 DEBUG:teuthology.orchestra.run.smithi062:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-04-17T19:34:34.242 INFO:teuthology.orchestra.run.smithi044.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-17T19:34:34.256 INFO:teuthology.orchestra.run.smithi062.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-17T19:34:34.268 INFO:teuthology.orchestra.run.smithi044.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-17T19:34:34.273 INFO:teuthology.orchestra.run.smithi062.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-17T19:34:34.277 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-04-17T19:34:34.285 INFO:teuthology.task.internal:Configuring sudo... 2024-04-17T19:34:34.285 DEBUG:teuthology.orchestra.run.smithi044:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-04-17T19:34:34.291 DEBUG:teuthology.orchestra.run.smithi062:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-04-17T19:34:34.308 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-04-17T19:34:34.318 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-04-17T19:34:34.318 DEBUG:teuthology.orchestra.run.smithi044:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-04-17T19:34:34.359 DEBUG:teuthology.orchestra.run.smithi062:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-04-17T19:34:34.365 DEBUG:teuthology.orchestra.run.smithi044:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-17T19:34:34.421 DEBUG:teuthology.orchestra.run.smithi044:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-17T19:34:34.476 DEBUG:teuthology.orchestra.run.smithi044:> set -ex 2024-04-17T19:34:34.477 DEBUG:teuthology.orchestra.run.smithi044:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-04-17T19:34:34.545 DEBUG:teuthology.orchestra.run.smithi062:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-17T19:34:34.551 DEBUG:teuthology.orchestra.run.smithi062:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-17T19:34:34.601 DEBUG:teuthology.orchestra.run.smithi062:> set -ex 2024-04-17T19:34:34.601 DEBUG:teuthology.orchestra.run.smithi062:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-04-17T19:34:34.666 DEBUG:teuthology.orchestra.run.smithi044:> sudo service rsyslog restart 2024-04-17T19:34:34.670 DEBUG:teuthology.orchestra.run.smithi062:> sudo service rsyslog restart 2024-04-17T19:34:34.803 INFO:teuthology.run_tasks:Running task internal.timer... 2024-04-17T19:34:34.813 INFO:teuthology.task.internal:Starting timer... 2024-04-17T19:34:34.814 INFO:teuthology.run_tasks:Running task pcp... 2024-04-17T19:34:34.853 INFO:teuthology.run_tasks:Running task selinux... 2024-04-17T19:34:34.865 DEBUG:teuthology.task.selinux:Excluding smithi044: OS 'ubuntu' does not support SELinux 2024-04-17T19:34:34.865 DEBUG:teuthology.task.selinux:Excluding smithi062: OS 'ubuntu' does not support SELinux 2024-04-17T19:34:34.866 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-04-17T19:34:34.866 DEBUG:teuthology.task.selinux:Existing SELinux modes: {} 2024-04-17T19:34:34.866 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-04-17T19:34:34.866 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-04-17T19:34:34.881 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-04-17T19:34:34.950 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-04-17T19:34:34.951 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi044.front.sepia.ceph.com,smithi062.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-04-17T19:42:27.037 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi044.front.sepia.ceph.com'), Remote(name='ubuntu@smithi062.front.sepia.ceph.com')] 2024-04-17T19:42:27.039 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi044.front.sepia.ceph.com' 2024-04-17T19:42:27.040 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi044.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T19:42:27.123 DEBUG:teuthology.orchestra.run.smithi044:> true 2024-04-17T19:42:27.233 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi044.front.sepia.ceph.com' 2024-04-17T19:42:27.233 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi062.front.sepia.ceph.com' 2024-04-17T19:42:27.234 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi062.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T19:42:27.315 DEBUG:teuthology.orchestra.run.smithi062:> true 2024-04-17T19:42:27.410 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi062.front.sepia.ceph.com' 2024-04-17T19:42:27.411 INFO:teuthology.run_tasks:Running task clock... 2024-04-17T19:42:27.421 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-04-17T19:42:27.421 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-04-17T19:42:27.422 DEBUG:teuthology.orchestra.run.smithi044:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-17T19:42:27.425 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-04-17T19:42:27.425 DEBUG:teuthology.orchestra.run.smithi062:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-17T19:42:27.461 INFO:teuthology.orchestra.run.smithi044.stdout:17 Apr 19:42:27 ntpd[17121]: ntpd 4.2.8p15@1.3728-o Wed Feb 16 17:13:02 UTC 2022 (1): Starting 2024-04-17T19:42:27.461 INFO:teuthology.orchestra.run.smithi044.stdout:17 Apr 19:42:27 ntpd[17121]: Command line: ntpd -gq 2024-04-17T19:42:27.461 INFO:teuthology.orchestra.run.smithi044.stdout:17 Apr 19:42:27 ntpd[17121]: ---------------------------------------------------- 2024-04-17T19:42:27.461 INFO:teuthology.orchestra.run.smithi044.stdout:17 Apr 19:42:27 ntpd[17121]: ntp-4 is maintained by Network Time Foundation, 2024-04-17T19:42:27.461 INFO:teuthology.orchestra.run.smithi044.stdout:17 Apr 19:42:27 ntpd[17121]: Inc. (NTF), a non-profit 501(c)(3) public-benefit 2024-04-17T19:42:27.461 INFO:teuthology.orchestra.run.smithi044.stdout:17 Apr 19:42:27 ntpd[17121]: corporation. Support and training for ntp-4 are 2024-04-17T19:42:27.461 INFO:teuthology.orchestra.run.smithi044.stdout:17 Apr 19:42:27 ntpd[17121]: available at https://www.nwtime.org/support 2024-04-17T19:42:27.461 INFO:teuthology.orchestra.run.smithi044.stdout:17 Apr 19:42:27 ntpd[17121]: ---------------------------------------------------- 2024-04-17T19:42:27.462 INFO:teuthology.orchestra.run.smithi044.stdout:17 Apr 19:42:27 ntpd[17121]: proto: precision = 0.043 usec (-24) 2024-04-17T19:42:27.462 INFO:teuthology.orchestra.run.smithi044.stdout:17 Apr 19:42:27 ntpd[17121]: basedate set to 2022-02-04 2024-04-17T19:42:27.462 INFO:teuthology.orchestra.run.smithi044.stdout:17 Apr 19:42:27 ntpd[17121]: gps base set to 2022-02-06 (week 2196) 2024-04-17T19:42:27.462 INFO:teuthology.orchestra.run.smithi044.stdout:17 Apr 19:42:27 ntpd[17121]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-04-17T19:42:27.462 INFO:teuthology.orchestra.run.smithi044.stdout:17 Apr 19:42:27 ntpd[17121]: restrict ::: KOD does nothing without LIMITED. 2024-04-17T19:42:27.463 INFO:teuthology.orchestra.run.smithi044.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-04-17T19:42:27.463 INFO:teuthology.orchestra.run.smithi044.stderr:restrict ::: KOD does nothing without LIMITED. 2024-04-17T19:42:27.464 INFO:teuthology.orchestra.run.smithi044.stdout:17 Apr 19:42:27 ntpd[17121]: Listen and drop on 0 v6wildcard [::]:123 2024-04-17T19:42:27.464 INFO:teuthology.orchestra.run.smithi044.stdout:17 Apr 19:42:27 ntpd[17121]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2024-04-17T19:42:27.464 INFO:teuthology.orchestra.run.smithi044.stdout:17 Apr 19:42:27 ntpd[17121]: Listen normally on 2 lo 127.0.0.1:123 2024-04-17T19:42:27.464 INFO:teuthology.orchestra.run.smithi044.stdout:17 Apr 19:42:27 ntpd[17121]: Listen normally on 3 ens1f0 172.21.15.44:123 2024-04-17T19:42:27.464 INFO:teuthology.orchestra.run.smithi044.stdout:17 Apr 19:42:27 ntpd[17121]: Listen normally on 4 lo [::1]:123 2024-04-17T19:42:27.464 INFO:teuthology.orchestra.run.smithi044.stdout:17 Apr 19:42:27 ntpd[17121]: Listen normally on 5 ens1f0 [fe80::ec4:7aff:febd:1572%4]:123 2024-04-17T19:42:27.464 INFO:teuthology.orchestra.run.smithi044.stdout:17 Apr 19:42:27 ntpd[17121]: Listening on routing socket on fd #22 for interface updates 2024-04-17T19:42:27.481 INFO:teuthology.orchestra.run.smithi062.stdout:17 Apr 19:42:27 ntpd[17683]: ntpd 4.2.8p15@1.3728-o Wed Feb 16 17:13:02 UTC 2022 (1): Starting 2024-04-17T19:42:27.481 INFO:teuthology.orchestra.run.smithi062.stdout:17 Apr 19:42:27 ntpd[17683]: Command line: ntpd -gq 2024-04-17T19:42:27.482 INFO:teuthology.orchestra.run.smithi062.stdout:17 Apr 19:42:27 ntpd[17683]: ---------------------------------------------------- 2024-04-17T19:42:27.482 INFO:teuthology.orchestra.run.smithi062.stdout:17 Apr 19:42:27 ntpd[17683]: ntp-4 is maintained by Network Time Foundation, 2024-04-17T19:42:27.482 INFO:teuthology.orchestra.run.smithi062.stdout:17 Apr 19:42:27 ntpd[17683]: Inc. (NTF), a non-profit 501(c)(3) public-benefit 2024-04-17T19:42:27.482 INFO:teuthology.orchestra.run.smithi062.stdout:17 Apr 19:42:27 ntpd[17683]: corporation. Support and training for ntp-4 are 2024-04-17T19:42:27.482 INFO:teuthology.orchestra.run.smithi062.stdout:17 Apr 19:42:27 ntpd[17683]: available at https://www.nwtime.org/support 2024-04-17T19:42:27.482 INFO:teuthology.orchestra.run.smithi062.stdout:17 Apr 19:42:27 ntpd[17683]: ---------------------------------------------------- 2024-04-17T19:42:27.482 INFO:teuthology.orchestra.run.smithi062.stdout:17 Apr 19:42:27 ntpd[17683]: proto: precision = 0.073 usec (-24) 2024-04-17T19:42:27.482 INFO:teuthology.orchestra.run.smithi062.stdout:17 Apr 19:42:27 ntpd[17683]: basedate set to 2022-02-04 2024-04-17T19:42:27.483 INFO:teuthology.orchestra.run.smithi062.stdout:17 Apr 19:42:27 ntpd[17683]: gps base set to 2022-02-06 (week 2196) 2024-04-17T19:42:27.483 INFO:teuthology.orchestra.run.smithi062.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-04-17T19:42:27.483 INFO:teuthology.orchestra.run.smithi062.stdout:17 Apr 19:42:27 ntpd[17683]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-04-17T19:42:27.483 INFO:teuthology.orchestra.run.smithi062.stdout:17 Apr 19:42:27 ntpd[17683]: restrict ::: KOD does nothing without LIMITED. 2024-04-17T19:42:27.484 INFO:teuthology.orchestra.run.smithi062.stderr:restrict ::: KOD does nothing without LIMITED. 2024-04-17T19:42:27.484 INFO:teuthology.orchestra.run.smithi062.stdout:17 Apr 19:42:27 ntpd[17683]: Listen and drop on 0 v6wildcard [::]:123 2024-04-17T19:42:27.485 INFO:teuthology.orchestra.run.smithi062.stdout:17 Apr 19:42:27 ntpd[17683]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2024-04-17T19:42:27.485 INFO:teuthology.orchestra.run.smithi062.stdout:17 Apr 19:42:27 ntpd[17683]: Listen normally on 2 lo 127.0.0.1:123 2024-04-17T19:42:27.485 INFO:teuthology.orchestra.run.smithi062.stdout:17 Apr 19:42:27 ntpd[17683]: Listen normally on 3 enp3s0f1 172.21.15.62:123 2024-04-17T19:42:27.485 INFO:teuthology.orchestra.run.smithi062.stdout:17 Apr 19:42:27 ntpd[17683]: Listen normally on 4 lo [::1]:123 2024-04-17T19:42:27.485 INFO:teuthology.orchestra.run.smithi062.stdout:17 Apr 19:42:27 ntpd[17683]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:febb:d1c3%5]:123 2024-04-17T19:42:27.485 INFO:teuthology.orchestra.run.smithi062.stdout:17 Apr 19:42:27 ntpd[17683]: Listening on routing socket on fd #22 for interface updates 2024-04-17T19:42:28.482 INFO:teuthology.orchestra.run.smithi062.stderr:17 Apr 19:42:28 ntpd[17683]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-17T19:42:28.483 INFO:teuthology.orchestra.run.smithi062.stderr:17 Apr 19:42:28 ntpd[17683]: can't open /var/log/ntpstats/rawstats.20240417: Permission denied 2024-04-17T19:42:28.483 INFO:teuthology.orchestra.run.smithi062.stderr:17 Apr 19:42:28 ntpd[17683]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-17T19:42:28.483 INFO:teuthology.orchestra.run.smithi062.stderr:17 Apr 19:42:28 ntpd[17683]: can't open /var/log/ntpstats/rawstats.20240417: Permission denied 2024-04-17T19:42:28.483 INFO:teuthology.orchestra.run.smithi062.stderr:17 Apr 19:42:28 ntpd[17683]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-17T19:42:28.483 INFO:teuthology.orchestra.run.smithi062.stderr:17 Apr 19:42:28 ntpd[17683]: can't open /var/log/ntpstats/peerstats.20240417: Permission denied 2024-04-17T19:42:29.462 INFO:teuthology.orchestra.run.smithi044.stderr:17 Apr 19:42:29 ntpd[17121]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-17T19:42:29.462 INFO:teuthology.orchestra.run.smithi044.stderr:17 Apr 19:42:29 ntpd[17121]: can't open /var/log/ntpstats/rawstats.20240417: Permission denied 2024-04-17T19:42:29.462 INFO:teuthology.orchestra.run.smithi044.stderr:17 Apr 19:42:29 ntpd[17121]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-17T19:42:29.462 INFO:teuthology.orchestra.run.smithi044.stderr:17 Apr 19:42:29 ntpd[17121]: can't open /var/log/ntpstats/rawstats.20240417: Permission denied 2024-04-17T19:42:29.462 INFO:teuthology.orchestra.run.smithi044.stderr:17 Apr 19:42:29 ntpd[17121]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-17T19:42:29.462 INFO:teuthology.orchestra.run.smithi044.stderr:17 Apr 19:42:29 ntpd[17121]: can't open /var/log/ntpstats/peerstats.20240417: Permission denied 2024-04-17T19:42:29.482 INFO:teuthology.orchestra.run.smithi062.stderr:17 Apr 19:42:29 ntpd[17683]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-17T19:42:29.482 INFO:teuthology.orchestra.run.smithi062.stderr:17 Apr 19:42:29 ntpd[17683]: can't open /var/log/ntpstats/rawstats.20240417: Permission denied 2024-04-17T19:42:29.482 INFO:teuthology.orchestra.run.smithi062.stderr:17 Apr 19:42:29 ntpd[17683]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-17T19:42:29.482 INFO:teuthology.orchestra.run.smithi062.stderr:17 Apr 19:42:29 ntpd[17683]: can't open /var/log/ntpstats/rawstats.20240417: Permission denied 2024-04-17T19:42:29.482 INFO:teuthology.orchestra.run.smithi062.stderr:17 Apr 19:42:29 ntpd[17683]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-17T19:42:29.483 INFO:teuthology.orchestra.run.smithi062.stderr:17 Apr 19:42:29 ntpd[17683]: can't open /var/log/ntpstats/peerstats.20240417: Permission denied 2024-04-17T19:42:30.462 INFO:teuthology.orchestra.run.smithi044.stderr:17 Apr 19:42:30 ntpd[17121]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-17T19:42:30.462 INFO:teuthology.orchestra.run.smithi044.stderr:17 Apr 19:42:30 ntpd[17121]: can't open /var/log/ntpstats/rawstats.20240417: Permission denied 2024-04-17T19:42:30.462 INFO:teuthology.orchestra.run.smithi044.stderr:17 Apr 19:42:30 ntpd[17121]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-17T19:42:30.462 INFO:teuthology.orchestra.run.smithi044.stderr:17 Apr 19:42:30 ntpd[17121]: can't open /var/log/ntpstats/rawstats.20240417: Permission denied 2024-04-17T19:42:30.462 INFO:teuthology.orchestra.run.smithi044.stderr:17 Apr 19:42:30 ntpd[17121]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-17T19:42:30.463 INFO:teuthology.orchestra.run.smithi044.stderr:17 Apr 19:42:30 ntpd[17121]: can't open /var/log/ntpstats/peerstats.20240417: Permission denied 2024-04-17T19:42:30.482 INFO:teuthology.orchestra.run.smithi062.stderr:17 Apr 19:42:30 ntpd[17683]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-17T19:42:30.482 INFO:teuthology.orchestra.run.smithi062.stderr:17 Apr 19:42:30 ntpd[17683]: can't open /var/log/ntpstats/rawstats.20240417: Permission denied 2024-04-17T19:42:30.482 INFO:teuthology.orchestra.run.smithi062.stderr:17 Apr 19:42:30 ntpd[17683]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-17T19:42:30.482 INFO:teuthology.orchestra.run.smithi062.stderr:17 Apr 19:42:30 ntpd[17683]: can't open /var/log/ntpstats/rawstats.20240417: Permission denied 2024-04-17T19:42:30.483 INFO:teuthology.orchestra.run.smithi062.stderr:17 Apr 19:42:30 ntpd[17683]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-17T19:42:30.483 INFO:teuthology.orchestra.run.smithi062.stderr:17 Apr 19:42:30 ntpd[17683]: can't open /var/log/ntpstats/peerstats.20240417: Permission denied 2024-04-17T19:42:31.462 INFO:teuthology.orchestra.run.smithi044.stderr:17 Apr 19:42:31 ntpd[17121]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-17T19:42:31.462 INFO:teuthology.orchestra.run.smithi044.stderr:17 Apr 19:42:31 ntpd[17121]: can't open /var/log/ntpstats/rawstats.20240417: Permission denied 2024-04-17T19:42:31.462 INFO:teuthology.orchestra.run.smithi044.stderr:17 Apr 19:42:31 ntpd[17121]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-17T19:42:31.462 INFO:teuthology.orchestra.run.smithi044.stderr:17 Apr 19:42:31 ntpd[17121]: can't open /var/log/ntpstats/rawstats.20240417: Permission denied 2024-04-17T19:42:31.462 INFO:teuthology.orchestra.run.smithi044.stderr:17 Apr 19:42:31 ntpd[17121]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-17T19:42:31.462 INFO:teuthology.orchestra.run.smithi044.stderr:17 Apr 19:42:31 ntpd[17121]: can't open /var/log/ntpstats/peerstats.20240417: Permission denied 2024-04-17T19:42:31.483 INFO:teuthology.orchestra.run.smithi062.stderr:17 Apr 19:42:31 ntpd[17683]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-17T19:42:31.483 INFO:teuthology.orchestra.run.smithi062.stderr:17 Apr 19:42:31 ntpd[17683]: can't open /var/log/ntpstats/rawstats.20240417: Permission denied 2024-04-17T19:42:31.483 INFO:teuthology.orchestra.run.smithi062.stderr:17 Apr 19:42:31 ntpd[17683]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-17T19:42:31.484 INFO:teuthology.orchestra.run.smithi062.stderr:17 Apr 19:42:31 ntpd[17683]: can't open /var/log/ntpstats/rawstats.20240417: Permission denied 2024-04-17T19:42:31.484 INFO:teuthology.orchestra.run.smithi062.stderr:17 Apr 19:42:31 ntpd[17683]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-17T19:42:31.484 INFO:teuthology.orchestra.run.smithi062.stderr:17 Apr 19:42:31 ntpd[17683]: can't open /var/log/ntpstats/rawstats.20240417: Permission denied 2024-04-17T19:42:31.484 INFO:teuthology.orchestra.run.smithi062.stderr:17 Apr 19:42:31 ntpd[17683]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-17T19:42:31.484 INFO:teuthology.orchestra.run.smithi062.stderr:17 Apr 19:42:31 ntpd[17683]: can't open /var/log/ntpstats/rawstats.20240417: Permission denied 2024-04-17T19:42:31.484 INFO:teuthology.orchestra.run.smithi062.stderr:17 Apr 19:42:31 ntpd[17683]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-17T19:42:31.484 INFO:teuthology.orchestra.run.smithi062.stderr:17 Apr 19:42:31 ntpd[17683]: can't open /var/log/ntpstats/peerstats.20240417: Permission denied 2024-04-17T19:42:31.484 INFO:teuthology.orchestra.run.smithi062.stderr:17 Apr 19:42:31 ntpd[17683]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-17T19:42:31.484 INFO:teuthology.orchestra.run.smithi062.stderr:17 Apr 19:42:31 ntpd[17683]: can't open /var/log/ntpstats/rawstats.20240417: Permission denied 2024-04-17T19:42:31.484 INFO:teuthology.orchestra.run.smithi062.stderr:17 Apr 19:42:31 ntpd[17683]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-17T19:42:31.484 INFO:teuthology.orchestra.run.smithi062.stderr:17 Apr 19:42:31 ntpd[17683]: can't open /var/log/ntpstats/peerstats.20240417: Permission denied 2024-04-17T19:42:32.463 INFO:teuthology.orchestra.run.smithi044.stderr:17 Apr 19:42:32 ntpd[17121]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-17T19:42:32.463 INFO:teuthology.orchestra.run.smithi044.stderr:17 Apr 19:42:32 ntpd[17121]: can't open /var/log/ntpstats/rawstats.20240417: Permission denied 2024-04-17T19:42:32.463 INFO:teuthology.orchestra.run.smithi044.stderr:17 Apr 19:42:32 ntpd[17121]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-17T19:42:32.463 INFO:teuthology.orchestra.run.smithi044.stderr:17 Apr 19:42:32 ntpd[17121]: can't open /var/log/ntpstats/rawstats.20240417: Permission denied 2024-04-17T19:42:32.463 INFO:teuthology.orchestra.run.smithi044.stderr:17 Apr 19:42:32 ntpd[17121]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-17T19:42:32.463 INFO:teuthology.orchestra.run.smithi044.stderr:17 Apr 19:42:32 ntpd[17121]: can't open /var/log/ntpstats/rawstats.20240417: Permission denied 2024-04-17T19:42:32.463 INFO:teuthology.orchestra.run.smithi044.stderr:17 Apr 19:42:32 ntpd[17121]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-17T19:42:32.463 INFO:teuthology.orchestra.run.smithi044.stderr:17 Apr 19:42:32 ntpd[17121]: can't open /var/log/ntpstats/rawstats.20240417: Permission denied 2024-04-17T19:42:32.463 INFO:teuthology.orchestra.run.smithi044.stderr:17 Apr 19:42:32 ntpd[17121]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-17T19:42:32.463 INFO:teuthology.orchestra.run.smithi044.stderr:17 Apr 19:42:32 ntpd[17121]: can't open /var/log/ntpstats/peerstats.20240417: Permission denied 2024-04-17T19:42:32.464 INFO:teuthology.orchestra.run.smithi044.stderr:17 Apr 19:42:32 ntpd[17121]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-17T19:42:32.464 INFO:teuthology.orchestra.run.smithi044.stderr:17 Apr 19:42:32 ntpd[17121]: can't open /var/log/ntpstats/rawstats.20240417: Permission denied 2024-04-17T19:42:32.464 INFO:teuthology.orchestra.run.smithi044.stderr:17 Apr 19:42:32 ntpd[17121]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-17T19:42:32.464 INFO:teuthology.orchestra.run.smithi044.stderr:17 Apr 19:42:32 ntpd[17121]: can't open /var/log/ntpstats/peerstats.20240417: Permission denied 2024-04-17T19:42:32.482 INFO:teuthology.orchestra.run.smithi062.stderr:17 Apr 19:42:32 ntpd[17683]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-17T19:42:32.482 INFO:teuthology.orchestra.run.smithi062.stderr:17 Apr 19:42:32 ntpd[17683]: can't open /var/log/ntpstats/rawstats.20240417: Permission denied 2024-04-17T19:42:32.482 INFO:teuthology.orchestra.run.smithi062.stderr:17 Apr 19:42:32 ntpd[17683]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-17T19:42:32.482 INFO:teuthology.orchestra.run.smithi062.stderr:17 Apr 19:42:32 ntpd[17683]: can't open /var/log/ntpstats/rawstats.20240417: Permission denied 2024-04-17T19:42:32.482 INFO:teuthology.orchestra.run.smithi062.stderr:17 Apr 19:42:32 ntpd[17683]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-17T19:42:32.483 INFO:teuthology.orchestra.run.smithi062.stderr:17 Apr 19:42:32 ntpd[17683]: can't open /var/log/ntpstats/peerstats.20240417: Permission denied 2024-04-17T19:42:33.462 INFO:teuthology.orchestra.run.smithi044.stderr:17 Apr 19:42:33 ntpd[17121]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-17T19:42:33.462 INFO:teuthology.orchestra.run.smithi044.stderr:17 Apr 19:42:33 ntpd[17121]: can't open /var/log/ntpstats/rawstats.20240417: Permission denied 2024-04-17T19:42:33.462 INFO:teuthology.orchestra.run.smithi044.stderr:17 Apr 19:42:33 ntpd[17121]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-17T19:42:33.462 INFO:teuthology.orchestra.run.smithi044.stderr:17 Apr 19:42:33 ntpd[17121]: can't open /var/log/ntpstats/rawstats.20240417: Permission denied 2024-04-17T19:42:33.463 INFO:teuthology.orchestra.run.smithi044.stderr:17 Apr 19:42:33 ntpd[17121]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-17T19:42:33.463 INFO:teuthology.orchestra.run.smithi044.stderr:17 Apr 19:42:33 ntpd[17121]: can't open /var/log/ntpstats/peerstats.20240417: Permission denied 2024-04-17T19:42:33.483 INFO:teuthology.orchestra.run.smithi062.stderr:17 Apr 19:42:33 ntpd[17683]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-17T19:42:33.483 INFO:teuthology.orchestra.run.smithi062.stderr:17 Apr 19:42:33 ntpd[17683]: can't open /var/log/ntpstats/rawstats.20240417: Permission denied 2024-04-17T19:42:33.483 INFO:teuthology.orchestra.run.smithi062.stderr:17 Apr 19:42:33 ntpd[17683]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-17T19:42:33.483 INFO:teuthology.orchestra.run.smithi062.stderr:17 Apr 19:42:33 ntpd[17683]: can't open /var/log/ntpstats/rawstats.20240417: Permission denied 2024-04-17T19:42:33.483 INFO:teuthology.orchestra.run.smithi062.stderr:17 Apr 19:42:33 ntpd[17683]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-17T19:42:33.483 INFO:teuthology.orchestra.run.smithi062.stderr:17 Apr 19:42:33 ntpd[17683]: can't open /var/log/ntpstats/rawstats.20240417: Permission denied 2024-04-17T19:42:33.483 INFO:teuthology.orchestra.run.smithi062.stderr:17 Apr 19:42:33 ntpd[17683]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-17T19:42:33.483 INFO:teuthology.orchestra.run.smithi062.stderr:17 Apr 19:42:33 ntpd[17683]: can't open /var/log/ntpstats/peerstats.20240417: Permission denied 2024-04-17T19:42:33.483 INFO:teuthology.orchestra.run.smithi062.stderr:17 Apr 19:42:33 ntpd[17683]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-17T19:42:33.483 INFO:teuthology.orchestra.run.smithi062.stderr:17 Apr 19:42:33 ntpd[17683]: can't open /var/log/ntpstats/rawstats.20240417: Permission denied 2024-04-17T19:42:33.484 INFO:teuthology.orchestra.run.smithi062.stderr:17 Apr 19:42:33 ntpd[17683]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-17T19:42:33.484 INFO:teuthology.orchestra.run.smithi062.stderr:17 Apr 19:42:33 ntpd[17683]: can't open /var/log/ntpstats/peerstats.20240417: Permission denied 2024-04-17T19:42:34.463 INFO:teuthology.orchestra.run.smithi044.stderr:17 Apr 19:42:34 ntpd[17121]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-17T19:42:34.463 INFO:teuthology.orchestra.run.smithi044.stderr:17 Apr 19:42:34 ntpd[17121]: can't open /var/log/ntpstats/rawstats.20240417: Permission denied 2024-04-17T19:42:34.463 INFO:teuthology.orchestra.run.smithi044.stderr:17 Apr 19:42:34 ntpd[17121]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-17T19:42:34.463 INFO:teuthology.orchestra.run.smithi044.stderr:17 Apr 19:42:34 ntpd[17121]: can't open /var/log/ntpstats/rawstats.20240417: Permission denied 2024-04-17T19:42:34.463 INFO:teuthology.orchestra.run.smithi044.stderr:17 Apr 19:42:34 ntpd[17121]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-17T19:42:34.463 INFO:teuthology.orchestra.run.smithi044.stderr:17 Apr 19:42:34 ntpd[17121]: can't open /var/log/ntpstats/rawstats.20240417: Permission denied 2024-04-17T19:42:34.463 INFO:teuthology.orchestra.run.smithi044.stderr:17 Apr 19:42:34 ntpd[17121]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-17T19:42:34.463 INFO:teuthology.orchestra.run.smithi044.stderr:17 Apr 19:42:34 ntpd[17121]: can't open /var/log/ntpstats/peerstats.20240417: Permission denied 2024-04-17T19:42:34.463 INFO:teuthology.orchestra.run.smithi044.stderr:17 Apr 19:42:34 ntpd[17121]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-17T19:42:34.463 INFO:teuthology.orchestra.run.smithi044.stderr:17 Apr 19:42:34 ntpd[17121]: can't open /var/log/ntpstats/rawstats.20240417: Permission denied 2024-04-17T19:42:34.463 INFO:teuthology.orchestra.run.smithi044.stderr:17 Apr 19:42:34 ntpd[17121]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-17T19:42:34.464 INFO:teuthology.orchestra.run.smithi044.stderr:17 Apr 19:42:34 ntpd[17121]: can't open /var/log/ntpstats/peerstats.20240417: Permission denied 2024-04-17T19:42:34.482 INFO:teuthology.orchestra.run.smithi062.stderr:17 Apr 19:42:34 ntpd[17683]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-17T19:42:34.482 INFO:teuthology.orchestra.run.smithi062.stderr:17 Apr 19:42:34 ntpd[17683]: can't open /var/log/ntpstats/rawstats.20240417: Permission denied 2024-04-17T19:42:34.482 INFO:teuthology.orchestra.run.smithi062.stderr:17 Apr 19:42:34 ntpd[17683]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-17T19:42:34.482 INFO:teuthology.orchestra.run.smithi062.stderr:17 Apr 19:42:34 ntpd[17683]: can't open /var/log/ntpstats/rawstats.20240417: Permission denied 2024-04-17T19:42:34.482 INFO:teuthology.orchestra.run.smithi062.stderr:17 Apr 19:42:34 ntpd[17683]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-17T19:42:34.483 INFO:teuthology.orchestra.run.smithi062.stderr:17 Apr 19:42:34 ntpd[17683]: can't open /var/log/ntpstats/peerstats.20240417: Permission denied 2024-04-17T19:42:34.483 INFO:teuthology.orchestra.run.smithi062.stdout:17 Apr 19:42:34 ntpd[17683]: ntpd: time slew -0.001237 s 2024-04-17T19:42:34.483 INFO:teuthology.orchestra.run.smithi062.stdout:ntpd: time slew -0.001237s 2024-04-17T19:42:34.483 INFO:teuthology.orchestra.run.smithi062.stderr:17 Apr 19:42:34 ntpd[17683]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2024-04-17T19:42:34.483 INFO:teuthology.orchestra.run.smithi062.stderr:17 Apr 19:42:34 ntpd[17683]: can't open /var/log/ntpstats/loopstats.20240417: Permission denied 2024-04-17T19:42:34.565 INFO:teuthology.orchestra.run.smithi062.stdout: remote refid st t when poll reach delay offset jitter 2024-04-17T19:42:34.565 INFO:teuthology.orchestra.run.smithi062.stdout:============================================================================== 2024-04-17T19:42:34.566 INFO:teuthology.orchestra.run.smithi062.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-04-17T19:42:34.566 INFO:teuthology.orchestra.run.smithi062.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-04-17T19:42:34.566 INFO:teuthology.orchestra.run.smithi062.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-04-17T19:42:34.566 INFO:teuthology.orchestra.run.smithi062.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-04-17T19:42:35.462 INFO:teuthology.orchestra.run.smithi044.stderr:17 Apr 19:42:35 ntpd[17121]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-17T19:42:35.462 INFO:teuthology.orchestra.run.smithi044.stderr:17 Apr 19:42:35 ntpd[17121]: can't open /var/log/ntpstats/rawstats.20240417: Permission denied 2024-04-17T19:42:35.462 INFO:teuthology.orchestra.run.smithi044.stderr:17 Apr 19:42:35 ntpd[17121]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-17T19:42:35.462 INFO:teuthology.orchestra.run.smithi044.stderr:17 Apr 19:42:35 ntpd[17121]: can't open /var/log/ntpstats/rawstats.20240417: Permission denied 2024-04-17T19:42:35.462 INFO:teuthology.orchestra.run.smithi044.stderr:17 Apr 19:42:35 ntpd[17121]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-17T19:42:35.462 INFO:teuthology.orchestra.run.smithi044.stderr:17 Apr 19:42:35 ntpd[17121]: can't open /var/log/ntpstats/peerstats.20240417: Permission denied 2024-04-17T19:42:35.462 INFO:teuthology.orchestra.run.smithi044.stdout:17 Apr 19:42:35 ntpd[17121]: ntpd: time slew -0.000755 s 2024-04-17T19:42:35.463 INFO:teuthology.orchestra.run.smithi044.stdout:ntpd: time slew -0.000755s 2024-04-17T19:42:35.463 INFO:teuthology.orchestra.run.smithi044.stderr:17 Apr 19:42:35 ntpd[17121]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2024-04-17T19:42:35.463 INFO:teuthology.orchestra.run.smithi044.stderr:17 Apr 19:42:35 ntpd[17121]: can't open /var/log/ntpstats/loopstats.20240417: Permission denied 2024-04-17T19:42:35.564 INFO:teuthology.orchestra.run.smithi044.stdout: remote refid st t when poll reach delay offset jitter 2024-04-17T19:42:35.565 INFO:teuthology.orchestra.run.smithi044.stdout:============================================================================== 2024-04-17T19:42:35.565 INFO:teuthology.orchestra.run.smithi044.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-04-17T19:42:35.565 INFO:teuthology.orchestra.run.smithi044.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-04-17T19:42:35.565 INFO:teuthology.orchestra.run.smithi044.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-04-17T19:42:35.565 INFO:teuthology.orchestra.run.smithi044.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-04-17T19:42:35.566 INFO:teuthology.run_tasks:Running task install... 2024-04-17T19:42:35.575 DEBUG:teuthology.task.install:project ceph 2024-04-17T19:42:35.575 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': 'f3a98d3f110319c567ec86bf70955c141495ccf6'}} 2024-04-17T19:42:35.575 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': 'f3a98d3f110319c567ec86bf70955c141495ccf6'} 2024-04-17T19:42:35.575 INFO:teuthology.task.install:Using flavor: default 2024-04-17T19:42:35.581 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-04-17T19:42:35.581 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']} 2024-04-17T19:42:35.581 DEBUG:teuthology.orchestra.run.smithi044:> sudo apt-key list | grep Ceph 2024-04-17T19:42:35.582 DEBUG:teuthology.orchestra.run.smithi062:> sudo apt-key list | grep Ceph 2024-04-17T19:42:35.649 INFO:teuthology.orchestra.run.smithi062.stderr:Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)). 2024-04-17T19:42:35.682 INFO:teuthology.orchestra.run.smithi062.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2024-04-17T19:42:35.682 INFO:teuthology.orchestra.run.smithi062.stdout:uid [ unknown] Ceph.com (release key) 2024-04-17T19:42:35.683 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror on remote deb x86_64 2024-04-17T19:42:35.683 INFO:teuthology.task.install.deb:Installing system (non-project) packages: bison, flex, libelf-dev, libssl-dev, network-manager, iproute2, util-linux, dump, indent, libaio-dev, libtool-bin, uuid-dev, xfslibs-dev, postgresql, postgresql-client, postgresql-common, postgresql-contrib on remote deb x86_64 2024-04-17T19:42:35.684 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=f3a98d3f110319c567ec86bf70955c141495ccf6 2024-04-17T19:42:35.715 INFO:teuthology.orchestra.run.smithi044.stderr:Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)). 2024-04-17T19:42:35.768 INFO:teuthology.orchestra.run.smithi044.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2024-04-17T19:42:35.768 INFO:teuthology.orchestra.run.smithi044.stdout:uid [ unknown] Ceph.com (release key) 2024-04-17T19:42:35.769 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror on remote deb x86_64 2024-04-17T19:42:35.769 INFO:teuthology.task.install.deb:Installing system (non-project) packages: bison, flex, libelf-dev, libssl-dev, network-manager, iproute2, util-linux, dump, indent, libaio-dev, libtool-bin, uuid-dev, xfslibs-dev, postgresql, postgresql-client, postgresql-common, postgresql-contrib on remote deb x86_64 2024-04-17T19:42:35.769 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=f3a98d3f110319c567ec86bf70955c141495ccf6 2024-04-17T19:42:35.911 INFO:teuthology.task.install.deb:Pulling from https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240417.021458-debug/f3a98d3f110319c567ec86bf70955c141495ccf6/ubuntu/jammy/flavors/default/ 2024-04-17T19:42:35.911 INFO:teuthology.task.install.deb:Package version is 19.0.0-3146-gf3a98d3f-1jammy 2024-04-17T19:42:36.032 INFO:teuthology.task.install.deb:Pulling from https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240417.021458-debug/f3a98d3f110319c567ec86bf70955c141495ccf6/ubuntu/jammy/flavors/default/ 2024-04-17T19:42:36.033 INFO:teuthology.task.install.deb:Package version is 19.0.0-3146-gf3a98d3f-1jammy 2024-04-17T19:42:36.212 DEBUG:teuthology.orchestra.run.smithi044:> set -ex 2024-04-17T19:42:36.212 DEBUG:teuthology.orchestra.run.smithi044:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2024-04-17T19:42:36.232 DEBUG:teuthology.orchestra.run.smithi044:> sudo apt-get update 2024-04-17T19:42:36.350 DEBUG:teuthology.orchestra.run.smithi062:> set -ex 2024-04-17T19:42:36.350 DEBUG:teuthology.orchestra.run.smithi062:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2024-04-17T19:42:36.365 DEBUG:teuthology.orchestra.run.smithi062:> sudo apt-get update 2024-04-17T19:42:36.423 INFO:teuthology.orchestra.run.smithi044.stdout:Hit:1 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-04-17T19:42:36.423 INFO:teuthology.orchestra.run.smithi044.stdout:Hit:2 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-04-17T19:42:36.435 INFO:teuthology.orchestra.run.smithi044.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-04-17T19:42:36.456 INFO:teuthology.orchestra.run.smithi044.stdout:Hit:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-04-17T19:42:36.537 INFO:teuthology.orchestra.run.smithi062.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-04-17T19:42:36.550 INFO:teuthology.orchestra.run.smithi062.stdout:Hit:2 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-04-17T19:42:36.570 INFO:teuthology.orchestra.run.smithi062.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-04-17T19:42:36.583 INFO:teuthology.orchestra.run.smithi044.stdout:Ign:5 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240417.021458-debug/f3a98d3f110319c567ec86bf70955c141495ccf6/ubuntu/jammy/flavors/default jammy InRelease 2024-04-17T19:42:36.639 INFO:teuthology.orchestra.run.smithi044.stdout:Get:6 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240417.021458-debug/f3a98d3f110319c567ec86bf70955c141495ccf6/ubuntu/jammy/flavors/default jammy Release [7,662 B] 2024-04-17T19:42:36.653 INFO:teuthology.orchestra.run.smithi062.stdout:Hit:4 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-04-17T19:42:36.694 INFO:teuthology.orchestra.run.smithi044.stdout:Ign:7 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240417.021458-debug/f3a98d3f110319c567ec86bf70955c141495ccf6/ubuntu/jammy/flavors/default jammy Release.gpg 2024-04-17T19:42:36.746 INFO:teuthology.orchestra.run.smithi044.stdout:Get:8 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240417.021458-debug/f3a98d3f110319c567ec86bf70955c141495ccf6/ubuntu/jammy/flavors/default jammy/main i386 Packages [3,418 B] 2024-04-17T19:42:36.767 INFO:teuthology.orchestra.run.smithi062.stdout:Ign:5 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240417.021458-debug/f3a98d3f110319c567ec86bf70955c141495ccf6/ubuntu/jammy/flavors/default jammy InRelease 2024-04-17T19:42:36.811 INFO:teuthology.orchestra.run.smithi044.stdout:Get:9 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240417.021458-debug/f3a98d3f110319c567ec86bf70955c141495ccf6/ubuntu/jammy/flavors/default jammy/main amd64 Packages [18.1 kB] 2024-04-17T19:42:36.838 INFO:teuthology.orchestra.run.smithi062.stdout:Get:6 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240417.021458-debug/f3a98d3f110319c567ec86bf70955c141495ccf6/ubuntu/jammy/flavors/default jammy Release [7,662 B] 2024-04-17T19:42:36.910 INFO:teuthology.orchestra.run.smithi062.stdout:Ign:7 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240417.021458-debug/f3a98d3f110319c567ec86bf70955c141495ccf6/ubuntu/jammy/flavors/default jammy Release.gpg 2024-04-17T19:42:36.982 INFO:teuthology.orchestra.run.smithi062.stdout:Get:8 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240417.021458-debug/f3a98d3f110319c567ec86bf70955c141495ccf6/ubuntu/jammy/flavors/default jammy/main i386 Packages [3,418 B] 2024-04-17T19:42:37.033 INFO:teuthology.orchestra.run.smithi044.stdout:Fetched 29.2 kB in 1s (50.8 kB/s) 2024-04-17T19:42:37.067 INFO:teuthology.orchestra.run.smithi062.stdout:Get:9 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240417.021458-debug/f3a98d3f110319c567ec86bf70955c141495ccf6/ubuntu/jammy/flavors/default jammy/main amd64 Packages [18.1 kB] 2024-04-17T19:42:37.168 INFO:teuthology.orchestra.run.smithi062.stdout:Fetched 29.2 kB in 1s (48.6 kB/s) 2024-04-17T19:42:38.036 INFO:teuthology.orchestra.run.smithi044.stdout:Reading package lists... 2024-04-17T19:42:38.050 DEBUG:teuthology.orchestra.run.smithi044:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=19.0.0-3146-gf3a98d3f-1jammy cephadm=19.0.0-3146-gf3a98d3f-1jammy ceph-mds=19.0.0-3146-gf3a98d3f-1jammy ceph-mgr=19.0.0-3146-gf3a98d3f-1jammy ceph-common=19.0.0-3146-gf3a98d3f-1jammy ceph-fuse=19.0.0-3146-gf3a98d3f-1jammy ceph-test=19.0.0-3146-gf3a98d3f-1jammy ceph-volume=19.0.0-3146-gf3a98d3f-1jammy radosgw=19.0.0-3146-gf3a98d3f-1jammy python3-rados=19.0.0-3146-gf3a98d3f-1jammy python3-rgw=19.0.0-3146-gf3a98d3f-1jammy python3-cephfs=19.0.0-3146-gf3a98d3f-1jammy python3-rbd=19.0.0-3146-gf3a98d3f-1jammy libcephfs2=19.0.0-3146-gf3a98d3f-1jammy libcephfs-dev=19.0.0-3146-gf3a98d3f-1jammy librados2=19.0.0-3146-gf3a98d3f-1jammy librbd1=19.0.0-3146-gf3a98d3f-1jammy rbd-fuse=19.0.0-3146-gf3a98d3f-1jammy python3-cephfs=19.0.0-3146-gf3a98d3f-1jammy cephfs-shell=19.0.0-3146-gf3a98d3f-1jammy cephfs-top=19.0.0-3146-gf3a98d3f-1jammy cephfs-mirror=19.0.0-3146-gf3a98d3f-1jammy 2024-04-17T19:42:38.126 INFO:teuthology.orchestra.run.smithi044.stdout:Reading package lists... 2024-04-17T19:42:38.150 INFO:teuthology.orchestra.run.smithi062.stdout:Reading package lists... 2024-04-17T19:42:38.165 DEBUG:teuthology.orchestra.run.smithi062:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=19.0.0-3146-gf3a98d3f-1jammy cephadm=19.0.0-3146-gf3a98d3f-1jammy ceph-mds=19.0.0-3146-gf3a98d3f-1jammy ceph-mgr=19.0.0-3146-gf3a98d3f-1jammy ceph-common=19.0.0-3146-gf3a98d3f-1jammy ceph-fuse=19.0.0-3146-gf3a98d3f-1jammy ceph-test=19.0.0-3146-gf3a98d3f-1jammy ceph-volume=19.0.0-3146-gf3a98d3f-1jammy radosgw=19.0.0-3146-gf3a98d3f-1jammy python3-rados=19.0.0-3146-gf3a98d3f-1jammy python3-rgw=19.0.0-3146-gf3a98d3f-1jammy python3-cephfs=19.0.0-3146-gf3a98d3f-1jammy python3-rbd=19.0.0-3146-gf3a98d3f-1jammy libcephfs2=19.0.0-3146-gf3a98d3f-1jammy libcephfs-dev=19.0.0-3146-gf3a98d3f-1jammy librados2=19.0.0-3146-gf3a98d3f-1jammy librbd1=19.0.0-3146-gf3a98d3f-1jammy rbd-fuse=19.0.0-3146-gf3a98d3f-1jammy python3-cephfs=19.0.0-3146-gf3a98d3f-1jammy cephfs-shell=19.0.0-3146-gf3a98d3f-1jammy cephfs-top=19.0.0-3146-gf3a98d3f-1jammy cephfs-mirror=19.0.0-3146-gf3a98d3f-1jammy 2024-04-17T19:42:38.229 INFO:teuthology.orchestra.run.smithi062.stdout:Reading package lists... 2024-04-17T19:42:38.302 INFO:teuthology.orchestra.run.smithi044.stdout:Building dependency tree... 2024-04-17T19:42:38.303 INFO:teuthology.orchestra.run.smithi044.stdout:Reading state information... 2024-04-17T19:42:38.424 INFO:teuthology.orchestra.run.smithi062.stdout:Building dependency tree... 2024-04-17T19:42:38.424 INFO:teuthology.orchestra.run.smithi062.stdout:Reading state information... 2024-04-17T19:42:38.482 INFO:teuthology.orchestra.run.smithi044.stdout:The following packages were automatically installed and are no longer required: 2024-04-17T19:42:38.483 INFO:teuthology.orchestra.run.smithi044.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-04-17T19:42:38.483 INFO:teuthology.orchestra.run.smithi044.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-04-17T19:42:38.483 INFO:teuthology.orchestra.run.smithi044.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-04-17T19:42:38.483 INFO:teuthology.orchestra.run.smithi044.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-04-17T19:42:38.483 INFO:teuthology.orchestra.run.smithi044.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-04-17T19:42:38.483 INFO:teuthology.orchestra.run.smithi044.stdout:Use 'sudo apt autoremove' to remove them. 2024-04-17T19:42:38.487 INFO:teuthology.orchestra.run.smithi044.stdout:The following additional packages will be installed: 2024-04-17T19:42:38.487 INFO:teuthology.orchestra.run.smithi044.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2024-04-17T19:42:38.488 INFO:teuthology.orchestra.run.smithi044.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd jq 2024-04-17T19:42:38.488 INFO:teuthology.orchestra.run.smithi044.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liblua5.3-dev liboath0 libonig5 2024-04-17T19:42:38.488 INFO:teuthology.orchestra.run.smithi044.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 libradosstriper1 2024-04-17T19:42:38.488 INFO:teuthology.orchestra.run.smithi044.stdout: librdkafka1 libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 2024-04-17T19:42:38.488 INFO:teuthology.orchestra.run.smithi044.stdout: lua-any lua-sec lua-socket lua5.1 luarocks nvme-cli pkg-config 2024-04-17T19:42:38.488 INFO:teuthology.orchestra.run.smithi044.stdout: python-asyncssh-doc python-babel-localedata python-pastedeploy-tpl 2024-04-17T19:42:38.489 INFO:teuthology.orchestra.run.smithi044.stdout: python3-asyncssh python3-babel python3-bcrypt python3-cachetools 2024-04-17T19:42:38.489 INFO:teuthology.orchestra.run.smithi044.stdout: python3-ceph-argparse python3-ceph-common python3-certifi python3-cheroot 2024-04-17T19:42:38.489 INFO:teuthology.orchestra.run.smithi044.stdout: python3-cherrypy3 python3-cmd2 python3-colorama python3-google-auth 2024-04-17T19:42:38.489 INFO:teuthology.orchestra.run.smithi044.stdout: python3-idna python3-iniconfig python3-jaraco.classes 2024-04-17T19:42:38.489 INFO:teuthology.orchestra.run.smithi044.stdout: python3-jaraco.collections python3-jaraco.functools python3-jaraco.text 2024-04-17T19:42:38.489 INFO:teuthology.orchestra.run.smithi044.stdout: python3-jinja2 python3-joblib python3-kubernetes python3-logutils 2024-04-17T19:42:38.490 INFO:teuthology.orchestra.run.smithi044.stdout: python3-mako python3-markupsafe python3-natsort python3-openssl 2024-04-17T19:42:38.490 INFO:teuthology.orchestra.run.smithi044.stdout: python3-paste python3-pastedeploy python3-pastescript python3-pecan 2024-04-17T19:42:38.490 INFO:teuthology.orchestra.run.smithi044.stdout: python3-pluggy python3-portend python3-prettytable python3-psutil python3-py 2024-04-17T19:42:38.490 INFO:teuthology.orchestra.run.smithi044.stdout: python3-pyasn1 python3-pyasn1-modules python3-pygments python3-pyinotify 2024-04-17T19:42:38.490 INFO:teuthology.orchestra.run.smithi044.stdout: python3-pyperclip python3-pytest python3-repoze.lru python3-requests 2024-04-17T19:42:38.491 INFO:teuthology.orchestra.run.smithi044.stdout: python3-requests-oauthlib python3-routes python3-rsa python3-simplegeneric 2024-04-17T19:42:38.491 INFO:teuthology.orchestra.run.smithi044.stdout: python3-simplejson python3-singledispatch python3-sklearn 2024-04-17T19:42:38.491 INFO:teuthology.orchestra.run.smithi044.stdout: python3-sklearn-lib python3-tempita python3-tempora python3-threadpoolctl 2024-04-17T19:42:38.491 INFO:teuthology.orchestra.run.smithi044.stdout: python3-toml python3-urllib3 python3-waitress python3-wcwidth python3-webob 2024-04-17T19:42:38.492 INFO:teuthology.orchestra.run.smithi044.stdout: python3-websocket python3-webtest python3-werkzeug python3-zc.lockfile 2024-04-17T19:42:38.492 INFO:teuthology.orchestra.run.smithi044.stdout: qttranslations5-l10n socat unzip xmlstarlet zip 2024-04-17T19:42:38.493 INFO:teuthology.orchestra.run.smithi044.stdout:Suggested packages: 2024-04-17T19:42:38.493 INFO:teuthology.orchestra.run.smithi044.stdout: python3-influxdb readline-doc python-jinja2-doc python3-beaker 2024-04-17T19:42:38.493 INFO:teuthology.orchestra.run.smithi044.stdout: python-mako-doc python-natsort-doc python-openssl-doc python3-openssl-dbg 2024-04-17T19:42:38.493 INFO:teuthology.orchestra.run.smithi044.stdout: httpd-wsgi libapache2-mod-python libapache2-mod-scgi libjs-mochikit 2024-04-17T19:42:38.493 INFO:teuthology.orchestra.run.smithi044.stdout: python-pecan-doc python-psutil-doc subversion python-pygments-doc 2024-04-17T19:42:38.493 INFO:teuthology.orchestra.run.smithi044.stdout: python-pyinotify-doc python3-socks python-requests-doc python3-dap 2024-04-17T19:42:38.494 INFO:teuthology.orchestra.run.smithi044.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2024-04-17T19:42:38.494 INFO:teuthology.orchestra.run.smithi044.stdout: python-webtest-doc python-werkzeug-doc python3-watchdog 2024-04-17T19:42:38.494 INFO:teuthology.orchestra.run.smithi044.stdout:Recommended packages: 2024-04-17T19:42:38.494 INFO:teuthology.orchestra.run.smithi044.stdout: btrfs-tools 2024-04-17T19:42:38.623 INFO:teuthology.orchestra.run.smithi062.stdout:The following packages were automatically installed and are no longer required: 2024-04-17T19:42:38.623 INFO:teuthology.orchestra.run.smithi062.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-04-17T19:42:38.623 INFO:teuthology.orchestra.run.smithi062.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-04-17T19:42:38.624 INFO:teuthology.orchestra.run.smithi062.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-04-17T19:42:38.624 INFO:teuthology.orchestra.run.smithi062.stdout: python2 python2-dev python2-minimal python2.7 python2.7-dev 2024-04-17T19:42:38.624 INFO:teuthology.orchestra.run.smithi062.stdout: python2.7-minimal 2024-04-17T19:42:38.624 INFO:teuthology.orchestra.run.smithi062.stdout:Use 'sudo apt autoremove' to remove them. 2024-04-17T19:42:38.625 INFO:teuthology.orchestra.run.smithi062.stdout:The following additional packages will be installed: 2024-04-17T19:42:38.625 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2024-04-17T19:42:38.625 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd jq 2024-04-17T19:42:38.625 INFO:teuthology.orchestra.run.smithi062.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liblua5.3-dev liboath0 libonig5 2024-04-17T19:42:38.625 INFO:teuthology.orchestra.run.smithi062.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 libradosstriper1 2024-04-17T19:42:38.626 INFO:teuthology.orchestra.run.smithi062.stdout: librdkafka1 libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 2024-04-17T19:42:38.627 INFO:teuthology.orchestra.run.smithi062.stdout: lua-any lua-sec lua-socket lua5.1 luarocks nvme-cli pkg-config 2024-04-17T19:42:38.627 INFO:teuthology.orchestra.run.smithi062.stdout: python-asyncssh-doc python-babel-localedata python-pastedeploy-tpl 2024-04-17T19:42:38.627 INFO:teuthology.orchestra.run.smithi062.stdout: python3-asyncssh python3-babel python3-bcrypt python3-cachetools 2024-04-17T19:42:38.627 INFO:teuthology.orchestra.run.smithi062.stdout: python3-ceph-argparse python3-ceph-common python3-certifi python3-cheroot 2024-04-17T19:42:38.627 INFO:teuthology.orchestra.run.smithi062.stdout: python3-cherrypy3 python3-cmd2 python3-colorama python3-google-auth 2024-04-17T19:42:38.627 INFO:teuthology.orchestra.run.smithi062.stdout: python3-idna python3-iniconfig python3-jaraco.classes 2024-04-17T19:42:38.627 INFO:teuthology.orchestra.run.smithi062.stdout: python3-jaraco.collections python3-jaraco.functools python3-jaraco.text 2024-04-17T19:42:38.627 INFO:teuthology.orchestra.run.smithi062.stdout: python3-jinja2 python3-joblib python3-kubernetes python3-logutils 2024-04-17T19:42:38.627 INFO:teuthology.orchestra.run.smithi062.stdout: python3-mako python3-markupsafe python3-natsort python3-openssl 2024-04-17T19:42:38.627 INFO:teuthology.orchestra.run.smithi062.stdout: python3-paste python3-pastedeploy python3-pastescript python3-pecan 2024-04-17T19:42:38.627 INFO:teuthology.orchestra.run.smithi062.stdout: python3-pluggy python3-portend python3-prettytable python3-psutil python3-py 2024-04-17T19:42:38.627 INFO:teuthology.orchestra.run.smithi062.stdout: python3-pyasn1 python3-pyasn1-modules python3-pygments python3-pyinotify 2024-04-17T19:42:38.627 INFO:teuthology.orchestra.run.smithi062.stdout: python3-pyperclip python3-pytest python3-repoze.lru python3-requests 2024-04-17T19:42:38.627 INFO:teuthology.orchestra.run.smithi062.stdout: python3-requests-oauthlib python3-routes python3-rsa python3-simplegeneric 2024-04-17T19:42:38.627 INFO:teuthology.orchestra.run.smithi062.stdout: python3-simplejson python3-singledispatch python3-sklearn 2024-04-17T19:42:38.628 INFO:teuthology.orchestra.run.smithi062.stdout: python3-sklearn-lib python3-tempita python3-tempora python3-threadpoolctl 2024-04-17T19:42:38.628 INFO:teuthology.orchestra.run.smithi062.stdout: python3-toml python3-urllib3 python3-waitress python3-wcwidth python3-webob 2024-04-17T19:42:38.628 INFO:teuthology.orchestra.run.smithi062.stdout: python3-websocket python3-webtest python3-werkzeug python3-zc.lockfile 2024-04-17T19:42:38.628 INFO:teuthology.orchestra.run.smithi062.stdout: qttranslations5-l10n socat unzip xmlstarlet zip 2024-04-17T19:42:38.628 INFO:teuthology.orchestra.run.smithi062.stdout:Suggested packages: 2024-04-17T19:42:38.628 INFO:teuthology.orchestra.run.smithi062.stdout: python3-influxdb readline-doc python-jinja2-doc python3-beaker 2024-04-17T19:42:38.628 INFO:teuthology.orchestra.run.smithi062.stdout: python-mako-doc python-natsort-doc python-openssl-doc python3-openssl-dbg 2024-04-17T19:42:38.628 INFO:teuthology.orchestra.run.smithi062.stdout: httpd-wsgi libapache2-mod-python libapache2-mod-scgi libjs-mochikit 2024-04-17T19:42:38.628 INFO:teuthology.orchestra.run.smithi062.stdout: python-pecan-doc python-psutil-doc subversion python-pygments-doc 2024-04-17T19:42:38.628 INFO:teuthology.orchestra.run.smithi062.stdout: python-pyinotify-doc python3-socks python-requests-doc python3-dap 2024-04-17T19:42:38.629 INFO:teuthology.orchestra.run.smithi062.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2024-04-17T19:42:38.629 INFO:teuthology.orchestra.run.smithi062.stdout: python-webtest-doc python-werkzeug-doc python3-watchdog 2024-04-17T19:42:38.629 INFO:teuthology.orchestra.run.smithi062.stdout:Recommended packages: 2024-04-17T19:42:38.629 INFO:teuthology.orchestra.run.smithi062.stdout: btrfs-tools 2024-04-17T19:42:38.645 INFO:teuthology.orchestra.run.smithi044.stdout:The following NEW packages will be installed: 2024-04-17T19:42:38.645 INFO:teuthology.orchestra.run.smithi044.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2024-04-17T19:42:38.645 INFO:teuthology.orchestra.run.smithi044.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2024-04-17T19:42:38.645 INFO:teuthology.orchestra.run.smithi044.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm 2024-04-17T19:42:38.645 INFO:teuthology.orchestra.run.smithi044.stdout: cephfs-mirror cephfs-shell cephfs-top jq libcephfs-dev libcephfs2 2024-04-17T19:42:38.645 INFO:teuthology.orchestra.run.smithi044.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liblua5.3-dev liboath0 libonig5 2024-04-17T19:42:38.645 INFO:teuthology.orchestra.run.smithi044.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 librados2 2024-04-17T19:42:38.645 INFO:teuthology.orchestra.run.smithi044.stdout: libradosstriper1 librbd1 librdkafka1 libreadline-dev librgw2 2024-04-17T19:42:38.645 INFO:teuthology.orchestra.run.smithi044.stdout: libsqlite3-mod-ceph libthrift-0.16.0 lua-any lua-sec lua-socket lua5.1 2024-04-17T19:42:38.645 INFO:teuthology.orchestra.run.smithi044.stdout: luarocks nvme-cli pkg-config python-asyncssh-doc python-babel-localedata 2024-04-17T19:42:38.645 INFO:teuthology.orchestra.run.smithi044.stdout: python-pastedeploy-tpl python3-asyncssh python3-babel python3-bcrypt 2024-04-17T19:42:38.645 INFO:teuthology.orchestra.run.smithi044.stdout: python3-cachetools python3-ceph-argparse python3-ceph-common python3-cephfs 2024-04-17T19:42:38.646 INFO:teuthology.orchestra.run.smithi044.stdout: python3-certifi python3-cheroot python3-cherrypy3 python3-cmd2 2024-04-17T19:42:38.646 INFO:teuthology.orchestra.run.smithi044.stdout: python3-colorama python3-google-auth python3-idna python3-iniconfig 2024-04-17T19:42:38.646 INFO:teuthology.orchestra.run.smithi044.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-04-17T19:42:38.646 INFO:teuthology.orchestra.run.smithi044.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-04-17T19:42:38.646 INFO:teuthology.orchestra.run.smithi044.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-04-17T19:42:38.646 INFO:teuthology.orchestra.run.smithi044.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-04-17T19:42:38.646 INFO:teuthology.orchestra.run.smithi044.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-04-17T19:42:38.646 INFO:teuthology.orchestra.run.smithi044.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-04-17T19:42:38.646 INFO:teuthology.orchestra.run.smithi044.stdout: python3-pygments python3-pyinotify python3-pyperclip python3-pytest 2024-04-17T19:42:38.646 INFO:teuthology.orchestra.run.smithi044.stdout: python3-rados python3-rbd python3-repoze.lru python3-requests 2024-04-17T19:42:38.646 INFO:teuthology.orchestra.run.smithi044.stdout: python3-requests-oauthlib python3-rgw python3-routes python3-rsa 2024-04-17T19:42:38.646 INFO:teuthology.orchestra.run.smithi044.stdout: python3-simplegeneric python3-simplejson python3-singledispatch 2024-04-17T19:42:38.646 INFO:teuthology.orchestra.run.smithi044.stdout: python3-sklearn python3-sklearn-lib python3-tempita python3-tempora 2024-04-17T19:42:38.646 INFO:teuthology.orchestra.run.smithi044.stdout: python3-threadpoolctl python3-toml python3-urllib3 python3-waitress 2024-04-17T19:42:38.647 INFO:teuthology.orchestra.run.smithi044.stdout: python3-wcwidth python3-webob python3-websocket python3-webtest 2024-04-17T19:42:38.647 INFO:teuthology.orchestra.run.smithi044.stdout: python3-werkzeug python3-zc.lockfile qttranslations5-l10n radosgw rbd-fuse 2024-04-17T19:42:38.647 INFO:teuthology.orchestra.run.smithi044.stdout: socat unzip xmlstarlet zip 2024-04-17T19:42:38.720 INFO:teuthology.orchestra.run.smithi044.stdout:0 upgraded, 124 newly installed, 0 to remove and 305 not upgraded. 2024-04-17T19:42:38.720 INFO:teuthology.orchestra.run.smithi044.stdout:Need to get 175 MB of archives. 2024-04-17T19:42:38.721 INFO:teuthology.orchestra.run.smithi044.stdout:After this operation, 887 MB of additional disk space will be used. 2024-04-17T19:42:38.721 INFO:teuthology.orchestra.run.smithi044.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyperclip all 1.8.2-2 [11.5 kB] 2024-04-17T19:42:38.739 INFO:teuthology.orchestra.run.smithi062.stdout:The following NEW packages will be installed: 2024-04-17T19:42:38.739 INFO:teuthology.orchestra.run.smithi062.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2024-04-17T19:42:38.740 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2024-04-17T19:42:38.740 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm 2024-04-17T19:42:38.740 INFO:teuthology.orchestra.run.smithi062.stdout: cephfs-mirror cephfs-shell cephfs-top jq libcephfs-dev libcephfs2 2024-04-17T19:42:38.741 INFO:teuthology.orchestra.run.smithi062.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liblua5.3-dev liboath0 libonig5 2024-04-17T19:42:38.741 INFO:teuthology.orchestra.run.smithi062.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 librados2 2024-04-17T19:42:38.741 INFO:teuthology.orchestra.run.smithi062.stdout: libradosstriper1 librbd1 librdkafka1 libreadline-dev librgw2 2024-04-17T19:42:38.741 INFO:teuthology.orchestra.run.smithi062.stdout: libsqlite3-mod-ceph libthrift-0.16.0 lua-any lua-sec lua-socket lua5.1 2024-04-17T19:42:38.742 INFO:teuthology.orchestra.run.smithi062.stdout: luarocks nvme-cli pkg-config python-asyncssh-doc python-babel-localedata 2024-04-17T19:42:38.742 INFO:teuthology.orchestra.run.smithi062.stdout: python-pastedeploy-tpl python3-asyncssh python3-babel python3-bcrypt 2024-04-17T19:42:38.742 INFO:teuthology.orchestra.run.smithi062.stdout: python3-cachetools python3-ceph-argparse python3-ceph-common python3-cephfs 2024-04-17T19:42:38.742 INFO:teuthology.orchestra.run.smithi062.stdout: python3-certifi python3-cheroot python3-cherrypy3 python3-cmd2 2024-04-17T19:42:38.742 INFO:teuthology.orchestra.run.smithi062.stdout: python3-colorama python3-google-auth python3-idna python3-iniconfig 2024-04-17T19:42:38.742 INFO:teuthology.orchestra.run.smithi062.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-04-17T19:42:38.742 INFO:teuthology.orchestra.run.smithi062.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-04-17T19:42:38.742 INFO:teuthology.orchestra.run.smithi062.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-04-17T19:42:38.742 INFO:teuthology.orchestra.run.smithi062.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-04-17T19:42:38.742 INFO:teuthology.orchestra.run.smithi062.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-04-17T19:42:38.742 INFO:teuthology.orchestra.run.smithi062.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-04-17T19:42:38.742 INFO:teuthology.orchestra.run.smithi062.stdout: python3-pygments python3-pyinotify python3-pyperclip python3-pytest 2024-04-17T19:42:38.742 INFO:teuthology.orchestra.run.smithi062.stdout: python3-rados python3-rbd python3-repoze.lru python3-requests 2024-04-17T19:42:38.742 INFO:teuthology.orchestra.run.smithi062.stdout: python3-requests-oauthlib python3-rgw python3-routes python3-rsa 2024-04-17T19:42:38.743 INFO:teuthology.orchestra.run.smithi062.stdout: python3-simplegeneric python3-simplejson python3-singledispatch 2024-04-17T19:42:38.743 INFO:teuthology.orchestra.run.smithi062.stdout: python3-sklearn python3-sklearn-lib python3-tempita python3-tempora 2024-04-17T19:42:38.743 INFO:teuthology.orchestra.run.smithi062.stdout: python3-threadpoolctl python3-toml python3-urllib3 python3-waitress 2024-04-17T19:42:38.743 INFO:teuthology.orchestra.run.smithi062.stdout: python3-wcwidth python3-webob python3-websocket python3-webtest 2024-04-17T19:42:38.743 INFO:teuthology.orchestra.run.smithi062.stdout: python3-werkzeug python3-zc.lockfile qttranslations5-l10n radosgw rbd-fuse 2024-04-17T19:42:38.743 INFO:teuthology.orchestra.run.smithi062.stdout: socat unzip xmlstarlet zip 2024-04-17T19:42:38.743 INFO:teuthology.orchestra.run.smithi044.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-wcwidth all 0.2.5+dfsg1-1 [21.9 kB] 2024-04-17T19:42:38.753 INFO:teuthology.orchestra.run.smithi044.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cmd2 all 2.3.3-1 [124 kB] 2024-04-17T19:42:38.803 INFO:teuthology.orchestra.run.smithi044.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblttng-ust1 amd64 2.13.1-1ubuntu1 [190 kB] 2024-04-17T19:42:38.808 INFO:teuthology.orchestra.run.smithi062.stdout:0 upgraded, 124 newly installed, 0 to remove and 305 not upgraded. 2024-04-17T19:42:38.808 INFO:teuthology.orchestra.run.smithi062.stdout:Need to get 175 MB of archives. 2024-04-17T19:42:38.808 INFO:teuthology.orchestra.run.smithi062.stdout:After this operation, 887 MB of additional disk space will be used. 2024-04-17T19:42:38.808 INFO:teuthology.orchestra.run.smithi062.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyperclip all 1.8.2-2 [11.5 kB] 2024-04-17T19:42:38.828 INFO:teuthology.orchestra.run.smithi062.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-wcwidth all 0.2.5+dfsg1-1 [21.9 kB] 2024-04-17T19:42:38.828 INFO:teuthology.orchestra.run.smithi044.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libdouble-conversion3 amd64 3.1.7-4 [39.0 kB] 2024-04-17T19:42:38.832 INFO:teuthology.orchestra.run.smithi044.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-16-0 amd64 10.39-3ubuntu0.1 [203 kB] 2024-04-17T19:42:38.840 INFO:teuthology.orchestra.run.smithi062.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cmd2 all 2.3.3-1 [124 kB] 2024-04-17T19:42:38.845 INFO:teuthology.orchestra.run.smithi044.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5core5a amd64 5.15.3+dfsg-2ubuntu0.2 [2,006 kB] 2024-04-17T19:42:38.887 INFO:teuthology.orchestra.run.smithi062.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblttng-ust1 amd64 2.13.1-1ubuntu1 [190 kB] 2024-04-17T19:42:38.891 INFO:teuthology.orchestra.run.smithi044.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5dbus5 amd64 5.15.3+dfsg-2ubuntu0.2 [222 kB] 2024-04-17T19:42:38.894 INFO:teuthology.orchestra.run.smithi044.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5network5 amd64 5.15.3+dfsg-2ubuntu0.2 [731 kB] 2024-04-17T19:42:38.902 INFO:teuthology.orchestra.run.smithi044.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libthrift-0.16.0 amd64 0.16.0-2 [267 kB] 2024-04-17T19:42:38.905 INFO:teuthology.orchestra.run.smithi044.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-prettytable all 2.5.0-2 [31.3 kB] 2024-04-17T19:42:38.906 INFO:teuthology.orchestra.run.smithi044.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/universe amd64 librdkafka1 amd64 1.8.0-1build1 [633 kB] 2024-04-17T19:42:38.913 INFO:teuthology.orchestra.run.smithi044.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/main amd64 libreadline-dev amd64 8.1.2-1 [166 kB] 2024-04-17T19:42:38.915 INFO:teuthology.orchestra.run.smithi044.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblua5.3-dev amd64 5.3.6-1build1 [167 kB] 2024-04-17T19:42:38.917 INFO:teuthology.orchestra.run.smithi044.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua5.1 amd64 5.1.5-8.1build4 [94.6 kB] 2024-04-17T19:42:38.918 INFO:teuthology.orchestra.run.smithi044.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-any all 27ubuntu1 [5,034 B] 2024-04-17T19:42:38.918 INFO:teuthology.orchestra.run.smithi062.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libdouble-conversion3 amd64 3.1.7-4 [39.0 kB] 2024-04-17T19:42:38.919 INFO:teuthology.orchestra.run.smithi044.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy/main amd64 zip amd64 3.0-12build2 [176 kB] 2024-04-17T19:42:38.920 INFO:teuthology.orchestra.run.smithi062.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-16-0 amd64 10.39-3ubuntu0.1 [203 kB] 2024-04-17T19:42:38.930 INFO:teuthology.orchestra.run.smithi062.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5core5a amd64 5.15.3+dfsg-2ubuntu0.2 [2,006 kB] 2024-04-17T19:42:38.940 INFO:teuthology.orchestra.run.smithi044.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 unzip amd64 6.0-26ubuntu3.2 [175 kB] 2024-04-17T19:42:38.941 INFO:teuthology.orchestra.run.smithi044.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy/universe amd64 luarocks all 3.8.0+dfsg1-1 [140 kB] 2024-04-17T19:42:38.943 INFO:teuthology.orchestra.run.smithi044.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy/main amd64 liboath0 amd64 2.6.7-3build1 [41.1 kB] 2024-04-17T19:42:38.944 INFO:teuthology.orchestra.run.smithi044.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.functools all 3.4.0-2 [9,030 B] 2024-04-17T19:42:38.944 INFO:teuthology.orchestra.run.smithi044.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-cheroot all 8.5.2+ds1-1ubuntu3.1 [71.1 kB] 2024-04-17T19:42:38.945 INFO:teuthology.orchestra.run.smithi044.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.classes all 3.2.1-3 [6,452 B] 2024-04-17T19:42:38.945 INFO:teuthology.orchestra.run.smithi044.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.text all 3.6.0-2 [8,716 B] 2024-04-17T19:42:38.946 INFO:teuthology.orchestra.run.smithi044.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.collections all 3.4.0-2 [11.4 kB] 2024-04-17T19:42:38.946 INFO:teuthology.orchestra.run.smithi044.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempora all 4.1.2-1 [14.8 kB] 2024-04-17T19:42:38.953 INFO:teuthology.orchestra.run.smithi044.stdout:Get:27 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240417.021458-debug/f3a98d3f110319c567ec86bf70955c141495ccf6/ubuntu/jammy/flavors/default jammy/main amd64 librados2 amd64 19.0.0-3146-gf3a98d3f-1jammy [3,523 kB] 2024-04-17T19:42:38.964 INFO:teuthology.orchestra.run.smithi044.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-portend all 3.0.0-1 [7,240 B] 2024-04-17T19:42:38.968 INFO:teuthology.orchestra.run.smithi044.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-zc.lockfile all 2.0-1 [8,980 B] 2024-04-17T19:42:38.968 INFO:teuthology.orchestra.run.smithi044.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cherrypy3 all 18.6.1-4 [208 kB] 2024-04-17T19:42:38.971 INFO:teuthology.orchestra.run.smithi044.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-natsort all 8.0.2-1 [35.3 kB] 2024-04-17T19:42:38.971 INFO:teuthology.orchestra.run.smithi044.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-logutils all 0.3.3-8 [17.6 kB] 2024-04-17T19:42:38.972 INFO:teuthology.orchestra.run.smithi044.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-markupsafe amd64 2.0.1-2build1 [12.7 kB] 2024-04-17T19:42:38.972 INFO:teuthology.orchestra.run.smithi044.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-mako all 1.1.3+ds1-2ubuntu0.1 [60.5 kB] 2024-04-17T19:42:38.973 INFO:teuthology.orchestra.run.smithi044.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2024-04-17T19:42:38.974 INFO:teuthology.orchestra.run.smithi044.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-singledispatch all 3.4.0.3-3 [7,320 B] 2024-04-17T19:42:38.984 INFO:teuthology.orchestra.run.smithi044.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webob all 1:1.8.6-1.1 [85.2 kB] 2024-04-17T19:42:38.995 INFO:teuthology.orchestra.run.smithi044.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-waitress all 1.4.4-1.1ubuntu1 [47.3 kB] 2024-04-17T19:42:38.995 INFO:teuthology.orchestra.run.smithi044.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempita all 0.5.2-6ubuntu1 [15.1 kB] 2024-04-17T19:42:38.996 INFO:teuthology.orchestra.run.smithi044.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-paste all 3.5.0+dfsg1-1 [456 kB] 2024-04-17T19:42:39.001 INFO:teuthology.orchestra.run.smithi062.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5dbus5 amd64 5.15.3+dfsg-2ubuntu0.2 [222 kB] 2024-04-17T19:42:39.002 INFO:teuthology.orchestra.run.smithi044.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-pastedeploy-tpl all 2.1.1-1 [4,892 B] 2024-04-17T19:42:39.002 INFO:teuthology.orchestra.run.smithi044.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastedeploy all 2.1.1-1 [26.6 kB] 2024-04-17T19:42:39.003 INFO:teuthology.orchestra.run.smithi044.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webtest all 2.0.35-1 [28.5 kB] 2024-04-17T19:42:39.003 INFO:teuthology.orchestra.run.smithi044.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pecan all 1.3.3-4ubuntu2 [87.3 kB] 2024-04-17T19:42:39.004 INFO:teuthology.orchestra.run.smithi044.stdout:Get:45 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-certifi all 2020.6.20-1 [150 kB] 2024-04-17T19:42:39.008 INFO:teuthology.orchestra.run.smithi062.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5network5 amd64 5.15.3+dfsg-2ubuntu0.2 [731 kB] 2024-04-17T19:42:39.015 INFO:teuthology.orchestra.run.smithi044.stdout:Get:46 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-idna all 3.3-1 [49.3 kB] 2024-04-17T19:42:39.024 INFO:teuthology.orchestra.run.smithi062.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libthrift-0.16.0 amd64 0.16.0-2 [267 kB] 2024-04-17T19:42:39.029 INFO:teuthology.orchestra.run.smithi062.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-prettytable all 2.5.0-2 [31.3 kB] 2024-04-17T19:42:39.030 INFO:teuthology.orchestra.run.smithi062.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/universe amd64 librdkafka1 amd64 1.8.0-1build1 [633 kB] 2024-04-17T19:42:39.036 INFO:teuthology.orchestra.run.smithi044.stdout:Get:47 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-urllib3 all 1.26.5-1~exp1ubuntu0.1 [98.2 kB] 2024-04-17T19:42:39.038 INFO:teuthology.orchestra.run.smithi044.stdout:Get:48 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-requests all 2.25.1+dfsg-2ubuntu0.1 [48.8 kB] 2024-04-17T19:42:39.038 INFO:teuthology.orchestra.run.smithi044.stdout:Get:49 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-werkzeug all 2.0.2+dfsg1-1ubuntu0.22.04.1 [181 kB] 2024-04-17T19:42:39.041 INFO:teuthology.orchestra.run.smithi044.stdout:Get:50 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-bcrypt amd64 3.2.0-1build1 [32.7 kB] 2024-04-17T19:42:39.041 INFO:teuthology.orchestra.run.smithi062.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/main amd64 libreadline-dev amd64 8.1.2-1 [166 kB] 2024-04-17T19:42:39.041 INFO:teuthology.orchestra.run.smithi044.stdout:Get:51 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-openssl all 21.0.0-1 [45.2 kB] 2024-04-17T19:42:39.042 INFO:teuthology.orchestra.run.smithi044.stdout:Get:52 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-asyncssh all 2.5.0-1 [185 kB] 2024-04-17T19:42:39.044 INFO:teuthology.orchestra.run.smithi044.stdout:Get:53 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-babel-localedata all 2.8.0+dfsg.1-7 [4,982 kB] 2024-04-17T19:42:39.044 INFO:teuthology.orchestra.run.smithi062.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblua5.3-dev amd64 5.3.6-1build1 [167 kB] 2024-04-17T19:42:39.046 INFO:teuthology.orchestra.run.smithi062.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua5.1 amd64 5.1.5-8.1build4 [94.6 kB] 2024-04-17T19:42:39.048 INFO:teuthology.orchestra.run.smithi062.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-any all 27ubuntu1 [5,034 B] 2024-04-17T19:42:39.048 INFO:teuthology.orchestra.run.smithi062.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy/main amd64 zip amd64 3.0-12build2 [176 kB] 2024-04-17T19:42:39.079 INFO:teuthology.orchestra.run.smithi062.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 unzip amd64 6.0-26ubuntu3.2 [175 kB] 2024-04-17T19:42:39.081 INFO:teuthology.orchestra.run.smithi062.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy/universe amd64 luarocks all 3.8.0+dfsg1-1 [140 kB] 2024-04-17T19:42:39.083 INFO:teuthology.orchestra.run.smithi062.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy/main amd64 liboath0 amd64 2.6.7-3build1 [41.1 kB] 2024-04-17T19:42:39.105 INFO:teuthology.orchestra.run.smithi044.stdout:Get:54 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-babel all 2.8.0+dfsg.1-7 [85.1 kB] 2024-04-17T19:42:39.106 INFO:teuthology.orchestra.run.smithi044.stdout:Get:55 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-jinja2 all 3.0.3-1ubuntu0.1 [108 kB] 2024-04-17T19:42:39.108 INFO:teuthology.orchestra.run.smithi044.stdout:Get:56 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2024-04-17T19:42:39.108 INFO:teuthology.orchestra.run.smithi044.stdout:Get:57 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-routes all 2.5.1-1ubuntu1 [89.0 kB] 2024-04-17T19:42:39.109 INFO:teuthology.orchestra.run.smithi044.stdout:Get:58 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn-lib amd64 0.23.2-5ubuntu6 [2,058 kB] 2024-04-17T19:42:39.121 INFO:teuthology.orchestra.run.smithi062.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.functools all 3.4.0-2 [9,030 B] 2024-04-17T19:42:39.121 INFO:teuthology.orchestra.run.smithi062.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-cheroot all 8.5.2+ds1-1ubuntu3.1 [71.1 kB] 2024-04-17T19:42:39.123 INFO:teuthology.orchestra.run.smithi062.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.classes all 3.2.1-3 [6,452 B] 2024-04-17T19:42:39.124 INFO:teuthology.orchestra.run.smithi062.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.text all 3.6.0-2 [8,716 B] 2024-04-17T19:42:39.124 INFO:teuthology.orchestra.run.smithi062.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.collections all 3.4.0-2 [11.4 kB] 2024-04-17T19:42:39.125 INFO:teuthology.orchestra.run.smithi062.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempora all 4.1.2-1 [14.8 kB] 2024-04-17T19:42:39.126 INFO:teuthology.orchestra.run.smithi062.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-portend all 3.0.0-1 [7,240 B] 2024-04-17T19:42:39.135 INFO:teuthology.orchestra.run.smithi044.stdout:Get:59 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-joblib all 0.17.0-4ubuntu1 [204 kB] 2024-04-17T19:42:39.138 INFO:teuthology.orchestra.run.smithi044.stdout:Get:60 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-threadpoolctl all 3.1.0-1 [21.3 kB] 2024-04-17T19:42:39.138 INFO:teuthology.orchestra.run.smithi044.stdout:Get:61 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn all 0.23.2-5ubuntu6 [1,829 kB] 2024-04-17T19:42:39.158 INFO:teuthology.orchestra.run.smithi062.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-zc.lockfile all 2.0-1 [8,980 B] 2024-04-17T19:42:39.159 INFO:teuthology.orchestra.run.smithi062.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cherrypy3 all 18.6.1-4 [208 kB] 2024-04-17T19:42:39.164 INFO:teuthology.orchestra.run.smithi062.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-natsort all 8.0.2-1 [35.3 kB] 2024-04-17T19:42:39.165 INFO:teuthology.orchestra.run.smithi044.stdout:Get:62 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cachetools all 5.0.0-1 [9,722 B] 2024-04-17T19:42:39.165 INFO:teuthology.orchestra.run.smithi044.stdout:Get:63 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1 all 0.4.8-1 [50.9 kB] 2024-04-17T19:42:39.170 INFO:teuthology.orchestra.run.smithi062.stdout:Get:31 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240417.021458-debug/f3a98d3f110319c567ec86bf70955c141495ccf6/ubuntu/jammy/flavors/default jammy/main amd64 librados2 amd64 19.0.0-3146-gf3a98d3f-1jammy [3,523 kB] 2024-04-17T19:42:39.170 INFO:teuthology.orchestra.run.smithi044.stdout:Get:64 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1-modules all 0.2.1-1 [33.0 kB] 2024-04-17T19:42:39.171 INFO:teuthology.orchestra.run.smithi044.stdout:Get:65 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-rsa all 4.8-1 [28.4 kB] 2024-04-17T19:42:39.171 INFO:teuthology.orchestra.run.smithi044.stdout:Get:66 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-google-auth all 1.5.1-3 [35.7 kB] 2024-04-17T19:42:39.172 INFO:teuthology.orchestra.run.smithi044.stdout:Get:67 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-requests-oauthlib all 1.3.0+ds-0.1 [18.7 kB] 2024-04-17T19:42:39.172 INFO:teuthology.orchestra.run.smithi044.stdout:Get:68 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-websocket all 1.2.3-1 [34.7 kB] 2024-04-17T19:42:39.173 INFO:teuthology.orchestra.run.smithi044.stdout:Get:69 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-kubernetes all 12.0.1-1ubuntu1 [353 kB] 2024-04-17T19:42:39.177 INFO:teuthology.orchestra.run.smithi044.stdout:Get:70 http://archive.ubuntu.com/ubuntu jammy/main amd64 libonig5 amd64 6.9.7.1-2build1 [172 kB] 2024-04-17T19:42:39.180 INFO:teuthology.orchestra.run.smithi062.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-logutils all 0.3.3-8 [17.6 kB] 2024-04-17T19:42:39.181 INFO:teuthology.orchestra.run.smithi062.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-markupsafe amd64 2.0.1-2build1 [12.7 kB] 2024-04-17T19:42:39.182 INFO:teuthology.orchestra.run.smithi062.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-mako all 1.1.3+ds1-2ubuntu0.1 [60.5 kB] 2024-04-17T19:42:39.184 INFO:teuthology.orchestra.run.smithi062.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2024-04-17T19:42:39.185 INFO:teuthology.orchestra.run.smithi062.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-singledispatch all 3.4.0.3-3 [7,320 B] 2024-04-17T19:42:39.185 INFO:teuthology.orchestra.run.smithi062.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webob all 1:1.8.6-1.1 [85.2 kB] 2024-04-17T19:42:39.188 INFO:teuthology.orchestra.run.smithi062.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-waitress all 1.4.4-1.1ubuntu1 [47.3 kB] 2024-04-17T19:42:39.191 INFO:teuthology.orchestra.run.smithi044.stdout:Get:71 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjq1 amd64 1.6-2.1ubuntu3 [133 kB] 2024-04-17T19:42:39.192 INFO:teuthology.orchestra.run.smithi044.stdout:Get:72 http://archive.ubuntu.com/ubuntu jammy/main amd64 jq amd64 1.6-2.1ubuntu3 [52.5 kB] 2024-04-17T19:42:39.193 INFO:teuthology.orchestra.run.smithi044.stdout:Get:73 http://archive.ubuntu.com/ubuntu jammy/main amd64 socat amd64 1.7.4.1-3ubuntu4 [349 kB] 2024-04-17T19:42:39.202 INFO:teuthology.orchestra.run.smithi062.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempita all 0.5.2-6ubuntu1 [15.1 kB] 2024-04-17T19:42:39.203 INFO:teuthology.orchestra.run.smithi062.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-paste all 3.5.0+dfsg1-1 [456 kB] 2024-04-17T19:42:39.213 INFO:teuthology.orchestra.run.smithi044.stdout:Get:74 http://archive.ubuntu.com/ubuntu jammy/universe amd64 xmlstarlet amd64 1.6.1-2.1 [265 kB] 2024-04-17T19:42:39.215 INFO:teuthology.orchestra.run.smithi062.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-pastedeploy-tpl all 2.1.1-1 [4,892 B] 2024-04-17T19:42:39.216 INFO:teuthology.orchestra.run.smithi044.stdout:Get:75 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-colorama all 0.4.4-1 [24.5 kB] 2024-04-17T19:42:39.217 INFO:teuthology.orchestra.run.smithi044.stdout:Get:76 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-socket amd64 3.0~rc1+git+ac3201d-6 [78.9 kB] 2024-04-17T19:42:39.218 INFO:teuthology.orchestra.run.smithi044.stdout:Get:77 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-sec amd64 1.0.2-1 [37.6 kB] 2024-04-17T19:42:39.218 INFO:teuthology.orchestra.run.smithi044.stdout:Get:78 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 nvme-cli amd64 1.16-3ubuntu0.1 [474 kB] 2024-04-17T19:42:39.224 INFO:teuthology.orchestra.run.smithi044.stdout:Get:79 http://archive.ubuntu.com/ubuntu jammy/main amd64 pkg-config amd64 0.29.2-1ubuntu3 [48.2 kB] 2024-04-17T19:42:39.225 INFO:teuthology.orchestra.run.smithi044.stdout:Get:80 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python-asyncssh-doc all 2.5.0-1 [318 kB] 2024-04-17T19:42:39.232 INFO:teuthology.orchestra.run.smithi062.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastedeploy all 2.1.1-1 [26.6 kB] 2024-04-17T19:42:39.233 INFO:teuthology.orchestra.run.smithi062.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webtest all 2.0.35-1 [28.5 kB] 2024-04-17T19:42:39.234 INFO:teuthology.orchestra.run.smithi062.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pecan all 1.3.3-4ubuntu2 [87.3 kB] 2024-04-17T19:42:39.237 INFO:teuthology.orchestra.run.smithi062.stdout:Get:45 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-certifi all 2020.6.20-1 [150 kB] 2024-04-17T19:42:39.240 INFO:teuthology.orchestra.run.smithi062.stdout:Get:46 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-idna all 3.3-1 [49.3 kB] 2024-04-17T19:42:39.242 INFO:teuthology.orchestra.run.smithi062.stdout:Get:47 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-urllib3 all 1.26.5-1~exp1ubuntu0.1 [98.2 kB] 2024-04-17T19:42:39.244 INFO:teuthology.orchestra.run.smithi044.stdout:Get:81 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-iniconfig all 1.1.1-2 [6,024 B] 2024-04-17T19:42:39.244 INFO:teuthology.orchestra.run.smithi044.stdout:Get:82 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2024-04-17T19:42:39.244 INFO:teuthology.orchestra.run.smithi062.stdout:Get:48 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-requests all 2.25.1+dfsg-2ubuntu0.1 [48.8 kB] 2024-04-17T19:42:39.245 INFO:teuthology.orchestra.run.smithi044.stdout:Get:83 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pluggy all 0.13.0-7.1 [19.0 kB] 2024-04-17T19:42:39.253 INFO:teuthology.orchestra.run.smithi062.stdout:Get:49 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-werkzeug all 2.0.2+dfsg1-1ubuntu0.22.04.1 [181 kB] 2024-04-17T19:42:39.258 INFO:teuthology.orchestra.run.smithi062.stdout:Get:50 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-bcrypt amd64 3.2.0-1build1 [32.7 kB] 2024-04-17T19:42:39.259 INFO:teuthology.orchestra.run.smithi062.stdout:Get:51 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-openssl all 21.0.0-1 [45.2 kB] 2024-04-17T19:42:39.264 INFO:teuthology.orchestra.run.smithi044.stdout:Get:84 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-psutil amd64 5.9.0-1build1 [158 kB] 2024-04-17T19:42:39.266 INFO:teuthology.orchestra.run.smithi044.stdout:Get:85 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-py all 1.10.0-1 [71.9 kB] 2024-04-17T19:42:39.267 INFO:teuthology.orchestra.run.smithi044.stdout:Get:86 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pygments all 2.11.2+dfsg-2 [750 kB] 2024-04-17T19:42:39.276 INFO:teuthology.orchestra.run.smithi044.stdout:Get:87 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyinotify all 0.9.6-1.3 [24.8 kB] 2024-04-17T19:42:39.276 INFO:teuthology.orchestra.run.smithi044.stdout:Get:88 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-toml all 0.10.2-1 [16.5 kB] 2024-04-17T19:42:39.277 INFO:teuthology.orchestra.run.smithi044.stdout:Get:89 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pytest all 6.2.5-1ubuntu2 [214 kB] 2024-04-17T19:42:39.279 INFO:teuthology.orchestra.run.smithi044.stdout:Get:90 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplejson amd64 3.17.6-1build1 [54.7 kB] 2024-04-17T19:42:39.282 INFO:teuthology.orchestra.run.smithi062.stdout:Get:52 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-asyncssh all 2.5.0-1 [185 kB] 2024-04-17T19:42:39.287 INFO:teuthology.orchestra.run.smithi062.stdout:Get:53 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-babel-localedata all 2.8.0+dfsg.1-7 [4,982 kB] 2024-04-17T19:42:39.315 INFO:teuthology.orchestra.run.smithi044.stdout:Get:91 http://archive.ubuntu.com/ubuntu jammy/universe amd64 qttranslations5-l10n all 5.15.3-1 [1,983 kB] 2024-04-17T19:42:39.376 INFO:teuthology.orchestra.run.smithi062.stdout:Get:54 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-babel all 2.8.0+dfsg.1-7 [85.1 kB] 2024-04-17T19:42:39.378 INFO:teuthology.orchestra.run.smithi062.stdout:Get:55 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-jinja2 all 3.0.3-1ubuntu0.1 [108 kB] 2024-04-17T19:42:39.380 INFO:teuthology.orchestra.run.smithi062.stdout:Get:56 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2024-04-17T19:42:39.412 INFO:teuthology.orchestra.run.smithi062.stdout:Get:57 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-routes all 2.5.1-1ubuntu1 [89.0 kB] 2024-04-17T19:42:39.414 INFO:teuthology.orchestra.run.smithi062.stdout:Get:58 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn-lib amd64 0.23.2-5ubuntu6 [2,058 kB] 2024-04-17T19:42:39.447 INFO:teuthology.orchestra.run.smithi062.stdout:Get:59 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-joblib all 0.17.0-4ubuntu1 [204 kB] 2024-04-17T19:42:39.450 INFO:teuthology.orchestra.run.smithi062.stdout:Get:60 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-threadpoolctl all 3.1.0-1 [21.3 kB] 2024-04-17T19:42:39.450 INFO:teuthology.orchestra.run.smithi062.stdout:Get:61 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn all 0.23.2-5ubuntu6 [1,829 kB] 2024-04-17T19:42:39.473 INFO:teuthology.orchestra.run.smithi062.stdout:Get:62 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cachetools all 5.0.0-1 [9,722 B] 2024-04-17T19:42:39.473 INFO:teuthology.orchestra.run.smithi062.stdout:Get:63 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1 all 0.4.8-1 [50.9 kB] 2024-04-17T19:42:39.474 INFO:teuthology.orchestra.run.smithi062.stdout:Get:64 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1-modules all 0.2.1-1 [33.0 kB] 2024-04-17T19:42:39.475 INFO:teuthology.orchestra.run.smithi062.stdout:Get:65 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-rsa all 4.8-1 [28.4 kB] 2024-04-17T19:42:39.475 INFO:teuthology.orchestra.run.smithi062.stdout:Get:66 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-google-auth all 1.5.1-3 [35.7 kB] 2024-04-17T19:42:39.476 INFO:teuthology.orchestra.run.smithi062.stdout:Get:67 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-requests-oauthlib all 1.3.0+ds-0.1 [18.7 kB] 2024-04-17T19:42:39.476 INFO:teuthology.orchestra.run.smithi062.stdout:Get:68 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-websocket all 1.2.3-1 [34.7 kB] 2024-04-17T19:42:39.492 INFO:teuthology.orchestra.run.smithi062.stdout:Get:69 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-kubernetes all 12.0.1-1ubuntu1 [353 kB] 2024-04-17T19:42:39.498 INFO:teuthology.orchestra.run.smithi062.stdout:Get:70 http://archive.ubuntu.com/ubuntu jammy/main amd64 libonig5 amd64 6.9.7.1-2build1 [172 kB] 2024-04-17T19:42:39.516 INFO:teuthology.orchestra.run.smithi062.stdout:Get:71 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjq1 amd64 1.6-2.1ubuntu3 [133 kB] 2024-04-17T19:42:39.518 INFO:teuthology.orchestra.run.smithi062.stdout:Get:72 http://archive.ubuntu.com/ubuntu jammy/main amd64 jq amd64 1.6-2.1ubuntu3 [52.5 kB] 2024-04-17T19:42:39.519 INFO:teuthology.orchestra.run.smithi062.stdout:Get:73 http://archive.ubuntu.com/ubuntu jammy/main amd64 socat amd64 1.7.4.1-3ubuntu4 [349 kB] 2024-04-17T19:42:39.523 INFO:teuthology.orchestra.run.smithi062.stdout:Get:74 http://archive.ubuntu.com/ubuntu jammy/universe amd64 xmlstarlet amd64 1.6.1-2.1 [265 kB] 2024-04-17T19:42:39.526 INFO:teuthology.orchestra.run.smithi062.stdout:Get:75 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-colorama all 0.4.4-1 [24.5 kB] 2024-04-17T19:42:39.527 INFO:teuthology.orchestra.run.smithi062.stdout:Get:76 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-socket amd64 3.0~rc1+git+ac3201d-6 [78.9 kB] 2024-04-17T19:42:39.528 INFO:teuthology.orchestra.run.smithi062.stdout:Get:77 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-sec amd64 1.0.2-1 [37.6 kB] 2024-04-17T19:42:39.529 INFO:teuthology.orchestra.run.smithi062.stdout:Get:78 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 nvme-cli amd64 1.16-3ubuntu0.1 [474 kB] 2024-04-17T19:42:39.547 INFO:teuthology.orchestra.run.smithi062.stdout:Get:79 http://archive.ubuntu.com/ubuntu jammy/main amd64 pkg-config amd64 0.29.2-1ubuntu3 [48.2 kB] 2024-04-17T19:42:39.548 INFO:teuthology.orchestra.run.smithi062.stdout:Get:80 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python-asyncssh-doc all 2.5.0-1 [318 kB] 2024-04-17T19:42:39.569 INFO:teuthology.orchestra.run.smithi062.stdout:Get:81 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-iniconfig all 1.1.1-2 [6,024 B] 2024-04-17T19:42:39.570 INFO:teuthology.orchestra.run.smithi062.stdout:Get:82 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2024-04-17T19:42:39.571 INFO:teuthology.orchestra.run.smithi062.stdout:Get:83 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pluggy all 0.13.0-7.1 [19.0 kB] 2024-04-17T19:42:39.571 INFO:teuthology.orchestra.run.smithi062.stdout:Get:84 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-psutil amd64 5.9.0-1build1 [158 kB] 2024-04-17T19:42:39.573 INFO:teuthology.orchestra.run.smithi062.stdout:Get:85 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-py all 1.10.0-1 [71.9 kB] 2024-04-17T19:42:39.574 INFO:teuthology.orchestra.run.smithi062.stdout:Get:86 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pygments all 2.11.2+dfsg-2 [750 kB] 2024-04-17T19:42:39.583 INFO:teuthology.orchestra.run.smithi062.stdout:Get:87 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyinotify all 0.9.6-1.3 [24.8 kB] 2024-04-17T19:42:39.583 INFO:teuthology.orchestra.run.smithi062.stdout:Get:88 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-toml all 0.10.2-1 [16.5 kB] 2024-04-17T19:42:39.601 INFO:teuthology.orchestra.run.smithi062.stdout:Get:89 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pytest all 6.2.5-1ubuntu2 [214 kB] 2024-04-17T19:42:39.604 INFO:teuthology.orchestra.run.smithi062.stdout:Get:90 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplejson amd64 3.17.6-1build1 [54.7 kB] 2024-04-17T19:42:39.628 INFO:teuthology.orchestra.run.smithi062.stdout:Get:91 http://archive.ubuntu.com/ubuntu jammy/universe amd64 qttranslations5-l10n all 5.15.3-1 [1,983 kB] 2024-04-17T19:42:39.633 INFO:teuthology.orchestra.run.smithi044.stdout:Get:92 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240417.021458-debug/f3a98d3f110319c567ec86bf70955c141495ccf6/ubuntu/jammy/flavors/default jammy/main amd64 librbd1 amd64 19.0.0-3146-gf3a98d3f-1jammy [3,286 kB] 2024-04-17T19:42:39.922 INFO:teuthology.orchestra.run.smithi044.stdout:Get:93 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240417.021458-debug/f3a98d3f110319c567ec86bf70955c141495ccf6/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2 amd64 19.0.0-3146-gf3a98d3f-1jammy [726 kB] 2024-04-17T19:42:39.989 INFO:teuthology.orchestra.run.smithi044.stdout:Get:94 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240417.021458-debug/f3a98d3f110319c567ec86bf70955c141495ccf6/ubuntu/jammy/flavors/default jammy/main amd64 python3-rados amd64 19.0.0-3146-gf3a98d3f-1jammy [357 kB] 2024-04-17T19:42:40.043 INFO:teuthology.orchestra.run.smithi044.stdout:Get:95 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240417.021458-debug/f3a98d3f110319c567ec86bf70955c141495ccf6/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-argparse all 19.0.0-3146-gf3a98d3f-1jammy [32.8 kB] 2024-04-17T19:42:40.045 INFO:teuthology.orchestra.run.smithi044.stdout:Get:96 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240417.021458-debug/f3a98d3f110319c567ec86bf70955c141495ccf6/ubuntu/jammy/flavors/default jammy/main amd64 python3-cephfs amd64 19.0.0-3146-gf3a98d3f-1jammy [180 kB] 2024-04-17T19:42:40.051 INFO:teuthology.orchestra.run.smithi044.stdout:Get:97 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240417.021458-debug/f3a98d3f110319c567ec86bf70955c141495ccf6/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-common all 19.0.0-3146-gf3a98d3f-1jammy [66.9 kB] 2024-04-17T19:42:40.054 INFO:teuthology.orchestra.run.smithi044.stdout:Get:98 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240417.021458-debug/f3a98d3f110319c567ec86bf70955c141495ccf6/ubuntu/jammy/flavors/default jammy/main amd64 python3-rbd amd64 19.0.0-3146-gf3a98d3f-1jammy [330 kB] 2024-04-17T19:42:40.064 INFO:teuthology.orchestra.run.smithi044.stdout:Get:99 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240417.021458-debug/f3a98d3f110319c567ec86bf70955c141495ccf6/ubuntu/jammy/flavors/default jammy/main amd64 librgw2 amd64 19.0.0-3146-gf3a98d3f-1jammy [7,186 kB] 2024-04-17T19:42:40.591 INFO:teuthology.orchestra.run.smithi044.stdout:Get:100 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240417.021458-debug/f3a98d3f110319c567ec86bf70955c141495ccf6/ubuntu/jammy/flavors/default jammy/main amd64 python3-rgw amd64 19.0.0-3146-gf3a98d3f-1jammy [112 kB] 2024-04-17T19:42:40.593 INFO:teuthology.orchestra.run.smithi044.stdout:Get:101 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240417.021458-debug/f3a98d3f110319c567ec86bf70955c141495ccf6/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1 amd64 19.0.0-3146-gf3a98d3f-1jammy [471 kB] 2024-04-17T19:42:40.638 INFO:teuthology.orchestra.run.smithi044.stdout:Get:102 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240417.021458-debug/f3a98d3f110319c567ec86bf70955c141495ccf6/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common amd64 19.0.0-3146-gf3a98d3f-1jammy [25.6 MB] 2024-04-17T19:42:42.247 INFO:teuthology.orchestra.run.smithi044.stdout:Get:103 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240417.021458-debug/f3a98d3f110319c567ec86bf70955c141495ccf6/ubuntu/jammy/flavors/default jammy/main amd64 ceph-base amd64 19.0.0-3146-gf3a98d3f-1jammy [4,916 kB] 2024-04-17T19:42:42.460 INFO:teuthology.orchestra.run.smithi062.stdout:Get:92 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240417.021458-debug/f3a98d3f110319c567ec86bf70955c141495ccf6/ubuntu/jammy/flavors/default jammy/main amd64 librbd1 amd64 19.0.0-3146-gf3a98d3f-1jammy [3,286 kB] 2024-04-17T19:42:42.583 INFO:teuthology.orchestra.run.smithi044.stdout:Get:104 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240417.021458-debug/f3a98d3f110319c567ec86bf70955c141495ccf6/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-modules-core all 19.0.0-3146-gf3a98d3f-1jammy [244 kB] 2024-04-17T19:42:42.589 INFO:teuthology.orchestra.run.smithi044.stdout:Get:105 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240417.021458-debug/f3a98d3f110319c567ec86bf70955c141495ccf6/ubuntu/jammy/flavors/default jammy/main amd64 libsqlite3-mod-ceph amd64 19.0.0-3146-gf3a98d3f-1jammy [125 kB] 2024-04-17T19:42:42.594 INFO:teuthology.orchestra.run.smithi044.stdout:Get:106 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240417.021458-debug/f3a98d3f110319c567ec86bf70955c141495ccf6/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr amd64 19.0.0-3146-gf3a98d3f-1jammy [1,519 kB] 2024-04-17T19:42:42.683 INFO:teuthology.orchestra.run.smithi044.stdout:Get:107 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240417.021458-debug/f3a98d3f110319c567ec86bf70955c141495ccf6/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon amd64 19.0.0-3146-gf3a98d3f-1jammy [6,148 kB] 2024-04-17T19:42:42.977 INFO:teuthology.orchestra.run.smithi044.stdout:Get:108 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240417.021458-debug/f3a98d3f110319c567ec86bf70955c141495ccf6/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd amd64 19.0.0-3146-gf3a98d3f-1jammy [22.5 MB] 2024-04-17T19:42:43.823 INFO:teuthology.orchestra.run.smithi044.stdout:Get:109 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240417.021458-debug/f3a98d3f110319c567ec86bf70955c141495ccf6/ubuntu/jammy/flavors/default jammy/main amd64 ceph amd64 19.0.0-3146-gf3a98d3f-1jammy [14.0 kB] 2024-04-17T19:42:43.824 INFO:teuthology.orchestra.run.smithi044.stdout:Get:110 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240417.021458-debug/f3a98d3f110319c567ec86bf70955c141495ccf6/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse amd64 19.0.0-3146-gf3a98d3f-1jammy [856 kB] 2024-04-17T19:42:43.848 INFO:teuthology.orchestra.run.smithi044.stdout:Get:111 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240417.021458-debug/f3a98d3f110319c567ec86bf70955c141495ccf6/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds amd64 19.0.0-3146-gf3a98d3f-1jammy [2,369 kB] 2024-04-17T19:42:43.936 INFO:teuthology.orchestra.run.smithi044.stdout:Get:112 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240417.021458-debug/f3a98d3f110319c567ec86bf70955c141495ccf6/ubuntu/jammy/flavors/default jammy/main amd64 cephadm amd64 19.0.0-3146-gf3a98d3f-1jammy [791 kB] 2024-04-17T19:42:43.966 INFO:teuthology.orchestra.run.smithi044.stdout:Get:113 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240417.021458-debug/f3a98d3f110319c567ec86bf70955c141495ccf6/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-cephadm all 19.0.0-3146-gf3a98d3f-1jammy [148 kB] 2024-04-17T19:42:43.971 INFO:teuthology.orchestra.run.smithi044.stdout:Get:114 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240417.021458-debug/f3a98d3f110319c567ec86bf70955c141495ccf6/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dashboard all 19.0.0-3146-gf3a98d3f-1jammy [2,297 kB] 2024-04-17T19:42:43.995 INFO:teuthology.orchestra.run.smithi062.stdout:Get:93 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240417.021458-debug/f3a98d3f110319c567ec86bf70955c141495ccf6/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2 amd64 19.0.0-3146-gf3a98d3f-1jammy [726 kB] 2024-04-17T19:42:44.058 INFO:teuthology.orchestra.run.smithi044.stdout:Get:115 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240417.021458-debug/f3a98d3f110319c567ec86bf70955c141495ccf6/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-diskprediction-local all 19.0.0-3146-gf3a98d3f-1jammy [8,625 kB] 2024-04-17T19:42:44.315 INFO:teuthology.orchestra.run.smithi062.stdout:Get:94 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240417.021458-debug/f3a98d3f110319c567ec86bf70955c141495ccf6/ubuntu/jammy/flavors/default jammy/main amd64 python3-rados amd64 19.0.0-3146-gf3a98d3f-1jammy [357 kB] 2024-04-17T19:42:44.384 INFO:teuthology.orchestra.run.smithi044.stdout:Get:116 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240417.021458-debug/f3a98d3f110319c567ec86bf70955c141495ccf6/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-k8sevents all 19.0.0-3146-gf3a98d3f-1jammy [14.2 kB] 2024-04-17T19:42:44.385 INFO:teuthology.orchestra.run.smithi044.stdout:Get:117 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240417.021458-debug/f3a98d3f110319c567ec86bf70955c141495ccf6/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test amd64 19.0.0-3146-gf3a98d3f-1jammy [44.9 MB] 2024-04-17T19:42:44.483 INFO:teuthology.orchestra.run.smithi062.stdout:Get:95 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240417.021458-debug/f3a98d3f110319c567ec86bf70955c141495ccf6/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-argparse all 19.0.0-3146-gf3a98d3f-1jammy [32.8 kB] 2024-04-17T19:42:44.494 INFO:teuthology.orchestra.run.smithi062.stdout:Get:96 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240417.021458-debug/f3a98d3f110319c567ec86bf70955c141495ccf6/ubuntu/jammy/flavors/default jammy/main amd64 python3-cephfs amd64 19.0.0-3146-gf3a98d3f-1jammy [180 kB] 2024-04-17T19:42:44.576 INFO:teuthology.orchestra.run.smithi062.stdout:Get:97 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240417.021458-debug/f3a98d3f110319c567ec86bf70955c141495ccf6/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-common all 19.0.0-3146-gf3a98d3f-1jammy [66.9 kB] 2024-04-17T19:42:44.594 INFO:teuthology.orchestra.run.smithi062.stdout:Get:98 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240417.021458-debug/f3a98d3f110319c567ec86bf70955c141495ccf6/ubuntu/jammy/flavors/default jammy/main amd64 python3-rbd amd64 19.0.0-3146-gf3a98d3f-1jammy [330 kB] 2024-04-17T19:42:44.759 INFO:teuthology.orchestra.run.smithi062.stdout:Get:99 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240417.021458-debug/f3a98d3f110319c567ec86bf70955c141495ccf6/ubuntu/jammy/flavors/default jammy/main amd64 librgw2 amd64 19.0.0-3146-gf3a98d3f-1jammy [7,186 kB] 2024-04-17T19:42:46.083 INFO:teuthology.orchestra.run.smithi044.stdout:Get:118 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240417.021458-debug/f3a98d3f110319c567ec86bf70955c141495ccf6/ubuntu/jammy/flavors/default jammy/main amd64 ceph-volume all 19.0.0-3146-gf3a98d3f-1jammy [124 kB] 2024-04-17T19:42:46.084 INFO:teuthology.orchestra.run.smithi044.stdout:Get:119 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240417.021458-debug/f3a98d3f110319c567ec86bf70955c141495ccf6/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-mirror amd64 19.0.0-3146-gf3a98d3f-1jammy [236 kB] 2024-04-17T19:42:46.087 INFO:teuthology.orchestra.run.smithi044.stdout:Get:120 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240417.021458-debug/f3a98d3f110319c567ec86bf70955c141495ccf6/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-shell all 19.0.0-3146-gf3a98d3f-1jammy [33.9 kB] 2024-04-17T19:42:46.087 INFO:teuthology.orchestra.run.smithi044.stdout:Get:121 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240417.021458-debug/f3a98d3f110319c567ec86bf70955c141495ccf6/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-top all 19.0.0-3146-gf3a98d3f-1jammy [23.4 kB] 2024-04-17T19:42:46.088 INFO:teuthology.orchestra.run.smithi044.stdout:Get:122 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240417.021458-debug/f3a98d3f110319c567ec86bf70955c141495ccf6/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-dev amd64 19.0.0-3146-gf3a98d3f-1jammy [38.9 kB] 2024-04-17T19:42:46.089 INFO:teuthology.orchestra.run.smithi044.stdout:Get:123 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240417.021458-debug/f3a98d3f110319c567ec86bf70955c141495ccf6/ubuntu/jammy/flavors/default jammy/main amd64 radosgw amd64 19.0.0-3146-gf3a98d3f-1jammy [14.1 MB] 2024-04-17T19:42:46.623 INFO:teuthology.orchestra.run.smithi044.stdout:Get:124 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240417.021458-debug/f3a98d3f110319c567ec86bf70955c141495ccf6/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse amd64 19.0.0-3146-gf3a98d3f-1jammy [92.6 kB] 2024-04-17T19:42:47.293 INFO:teuthology.orchestra.run.smithi044.stdout:Fetched 175 MB in 8s (21.9 MB/s) 2024-04-17T19:42:47.294 INFO:teuthology.orchestra.run.smithi062.stdout:Get:100 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240417.021458-debug/f3a98d3f110319c567ec86bf70955c141495ccf6/ubuntu/jammy/flavors/default jammy/main amd64 python3-rgw amd64 19.0.0-3146-gf3a98d3f-1jammy [112 kB] 2024-04-17T19:42:47.321 INFO:teuthology.orchestra.run.smithi062.stdout:Get:101 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240417.021458-debug/f3a98d3f110319c567ec86bf70955c141495ccf6/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1 amd64 19.0.0-3146-gf3a98d3f-1jammy [471 kB] 2024-04-17T19:42:47.421 INFO:teuthology.orchestra.run.smithi062.stdout:Get:102 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240417.021458-debug/f3a98d3f110319c567ec86bf70955c141495ccf6/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common amd64 19.0.0-3146-gf3a98d3f-1jammy [25.6 MB] 2024-04-17T19:42:47.439 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package python3-pyperclip. 2024-04-17T19:42:47.508 INFO:teuthology.orchestra.run.smithi044.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 132922 files and directories currently installed.) 2024-04-17T19:42:47.511 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../000-python3-pyperclip_1.8.2-2_all.deb ... 2024-04-17T19:42:47.571 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking python3-pyperclip (1.8.2-2) ... 2024-04-17T19:42:47.874 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package python3-wcwidth. 2024-04-17T19:42:47.888 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../001-python3-wcwidth_0.2.5+dfsg1-1_all.deb ... 2024-04-17T19:42:47.932 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking python3-wcwidth (0.2.5+dfsg1-1) ... 2024-04-17T19:42:48.202 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package python3-cmd2. 2024-04-17T19:42:48.216 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../002-python3-cmd2_2.3.3-1_all.deb ... 2024-04-17T19:42:48.251 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking python3-cmd2 (2.3.3-1) ... 2024-04-17T19:42:48.554 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package liblttng-ust1:amd64. 2024-04-17T19:42:48.569 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../003-liblttng-ust1_2.13.1-1ubuntu1_amd64.deb ... 2024-04-17T19:42:48.655 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-04-17T19:42:49.008 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2024-04-17T19:42:49.024 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../004-libdouble-conversion3_3.1.7-4_amd64.deb ... 2024-04-17T19:42:49.067 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking libdouble-conversion3:amd64 (3.1.7-4) ... 2024-04-17T19:42:49.403 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2024-04-17T19:42:49.419 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../005-libpcre2-16-0_10.39-3ubuntu0.1_amd64.deb ... 2024-04-17T19:42:49.461 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-04-17T19:42:49.815 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package libqt5core5a:amd64. 2024-04-17T19:42:49.829 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../006-libqt5core5a_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-04-17T19:42:49.873 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-17T19:42:50.301 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2024-04-17T19:42:50.317 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../007-libqt5dbus5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-04-17T19:42:50.359 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-17T19:42:50.688 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package libqt5network5:amd64. 2024-04-17T19:42:50.703 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../008-libqt5network5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-04-17T19:42:50.746 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-17T19:42:51.024 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package libthrift-0.16.0:amd64. 2024-04-17T19:42:51.039 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../009-libthrift-0.16.0_0.16.0-2_amd64.deb ... 2024-04-17T19:42:51.074 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-04-17T19:42:51.394 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package librados2. 2024-04-17T19:42:51.409 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../010-librados2_19.0.0-3146-gf3a98d3f-1jammy_amd64.deb ... 2024-04-17T19:42:51.451 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking librados2 (19.0.0-3146-gf3a98d3f-1jammy) ... 2024-04-17T19:42:51.888 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package librbd1. 2024-04-17T19:42:51.903 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../011-librbd1_19.0.0-3146-gf3a98d3f-1jammy_amd64.deb ... 2024-04-17T19:42:51.946 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking librbd1 (19.0.0-3146-gf3a98d3f-1jammy) ... 2024-04-17T19:42:52.332 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package libcephfs2. 2024-04-17T19:42:52.347 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../012-libcephfs2_19.0.0-3146-gf3a98d3f-1jammy_amd64.deb ... 2024-04-17T19:42:52.382 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking libcephfs2 (19.0.0-3146-gf3a98d3f-1jammy) ... 2024-04-17T19:42:52.626 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package python3-rados. 2024-04-17T19:42:52.641 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../013-python3-rados_19.0.0-3146-gf3a98d3f-1jammy_amd64.deb ... 2024-04-17T19:42:52.676 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking python3-rados (19.0.0-3146-gf3a98d3f-1jammy) ... 2024-04-17T19:42:52.987 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package python3-ceph-argparse. 2024-04-17T19:42:53.002 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../014-python3-ceph-argparse_19.0.0-3146-gf3a98d3f-1jammy_all.deb ... 2024-04-17T19:42:53.045 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking python3-ceph-argparse (19.0.0-3146-gf3a98d3f-1jammy) ... 2024-04-17T19:42:53.298 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package python3-cephfs. 2024-04-17T19:42:53.313 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../015-python3-cephfs_19.0.0-3146-gf3a98d3f-1jammy_amd64.deb ... 2024-04-17T19:42:53.356 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking python3-cephfs (19.0.0-3146-gf3a98d3f-1jammy) ... 2024-04-17T19:42:53.469 INFO:teuthology.orchestra.run.smithi062.stdout:Get:103 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240417.021458-debug/f3a98d3f110319c567ec86bf70955c141495ccf6/ubuntu/jammy/flavors/default jammy/main amd64 ceph-base amd64 19.0.0-3146-gf3a98d3f-1jammy [4,916 kB] 2024-04-17T19:42:53.651 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package python3-ceph-common. 2024-04-17T19:42:53.666 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../016-python3-ceph-common_19.0.0-3146-gf3a98d3f-1jammy_all.deb ... 2024-04-17T19:42:53.701 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking python3-ceph-common (19.0.0-3146-gf3a98d3f-1jammy) ... 2024-04-17T19:42:53.995 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package python3-prettytable. 2024-04-17T19:42:54.011 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../017-python3-prettytable_2.5.0-2_all.deb ... 2024-04-17T19:42:54.045 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking python3-prettytable (2.5.0-2) ... 2024-04-17T19:42:54.273 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package python3-rbd. 2024-04-17T19:42:54.288 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../018-python3-rbd_19.0.0-3146-gf3a98d3f-1jammy_amd64.deb ... 2024-04-17T19:42:54.331 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking python3-rbd (19.0.0-3146-gf3a98d3f-1jammy) ... 2024-04-17T19:42:54.676 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package librdkafka1:amd64. 2024-04-17T19:42:54.691 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../019-librdkafka1_1.8.0-1build1_amd64.deb ... 2024-04-17T19:42:54.722 INFO:teuthology.orchestra.run.smithi062.stdout:Get:104 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240417.021458-debug/f3a98d3f110319c567ec86bf70955c141495ccf6/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-modules-core all 19.0.0-3146-gf3a98d3f-1jammy [244 kB] 2024-04-17T19:42:54.734 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking librdkafka1:amd64 (1.8.0-1build1) ... 2024-04-17T19:42:54.761 INFO:teuthology.orchestra.run.smithi062.stdout:Get:105 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240417.021458-debug/f3a98d3f110319c567ec86bf70955c141495ccf6/ubuntu/jammy/flavors/default jammy/main amd64 libsqlite3-mod-ceph amd64 19.0.0-3146-gf3a98d3f-1jammy [125 kB] 2024-04-17T19:42:54.794 INFO:teuthology.orchestra.run.smithi062.stdout:Get:106 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240417.021458-debug/f3a98d3f110319c567ec86bf70955c141495ccf6/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr amd64 19.0.0-3146-gf3a98d3f-1jammy [1,519 kB] 2024-04-17T19:42:54.995 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package libreadline-dev:amd64. 2024-04-17T19:42:55.010 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../020-libreadline-dev_8.1.2-1_amd64.deb ... 2024-04-17T19:42:55.078 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking libreadline-dev:amd64 (8.1.2-1) ... 2024-04-17T19:42:55.082 INFO:teuthology.orchestra.run.smithi062.stdout:Get:107 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240417.021458-debug/f3a98d3f110319c567ec86bf70955c141495ccf6/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon amd64 19.0.0-3146-gf3a98d3f-1jammy [6,148 kB] 2024-04-17T19:42:55.581 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package liblua5.3-dev:amd64. 2024-04-17T19:42:55.596 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../021-liblua5.3-dev_5.3.6-1build1_amd64.deb ... 2024-04-17T19:42:55.631 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-04-17T19:42:55.951 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package lua5.1. 2024-04-17T19:42:55.967 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../022-lua5.1_5.1.5-8.1build4_amd64.deb ... 2024-04-17T19:42:56.009 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking lua5.1 (5.1.5-8.1build4) ... 2024-04-17T19:42:56.189 INFO:teuthology.orchestra.run.smithi062.stdout:Get:108 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240417.021458-debug/f3a98d3f110319c567ec86bf70955c141495ccf6/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd amd64 19.0.0-3146-gf3a98d3f-1jammy [22.5 MB] 2024-04-17T19:42:56.338 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package lua-any. 2024-04-17T19:42:56.353 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../023-lua-any_27ubuntu1_all.deb ... 2024-04-17T19:42:56.395 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking lua-any (27ubuntu1) ... 2024-04-17T19:42:56.590 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package zip. 2024-04-17T19:42:56.605 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../024-zip_3.0-12build2_amd64.deb ... 2024-04-17T19:42:56.640 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking zip (3.0-12build2) ... 2024-04-17T19:42:56.902 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package unzip. 2024-04-17T19:42:56.917 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../025-unzip_6.0-26ubuntu3.2_amd64.deb ... 2024-04-17T19:42:56.959 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking unzip (6.0-26ubuntu3.2) ... 2024-04-17T19:42:57.330 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package luarocks. 2024-04-17T19:42:57.346 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../026-luarocks_3.8.0+dfsg1-1_all.deb ... 2024-04-17T19:42:57.388 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking luarocks (3.8.0+dfsg1-1) ... 2024-04-17T19:42:57.813 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package librgw2. 2024-04-17T19:42:57.828 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../027-librgw2_19.0.0-3146-gf3a98d3f-1jammy_amd64.deb ... 2024-04-17T19:42:57.871 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking librgw2 (19.0.0-3146-gf3a98d3f-1jammy) ... 2024-04-17T19:42:58.374 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package python3-rgw. 2024-04-17T19:42:58.388 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../028-python3-rgw_19.0.0-3146-gf3a98d3f-1jammy_amd64.deb ... 2024-04-17T19:42:58.423 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking python3-rgw (19.0.0-3146-gf3a98d3f-1jammy) ... 2024-04-17T19:42:58.726 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package liboath0:amd64. 2024-04-17T19:42:58.742 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../029-liboath0_2.6.7-3build1_amd64.deb ... 2024-04-17T19:42:58.810 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking liboath0:amd64 (2.6.7-3build1) ... 2024-04-17T19:42:59.113 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package libradosstriper1. 2024-04-17T19:42:59.128 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../030-libradosstriper1_19.0.0-3146-gf3a98d3f-1jammy_amd64.deb ... 2024-04-17T19:42:59.179 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking libradosstriper1 (19.0.0-3146-gf3a98d3f-1jammy) ... 2024-04-17T19:42:59.549 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package ceph-common. 2024-04-17T19:42:59.565 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../031-ceph-common_19.0.0-3146-gf3a98d3f-1jammy_amd64.deb ... 2024-04-17T19:42:59.599 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking ceph-common (19.0.0-3146-gf3a98d3f-1jammy) ... 2024-04-17T19:43:00.780 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package ceph-base. 2024-04-17T19:43:00.790 INFO:teuthology.orchestra.run.smithi062.stdout:Get:109 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240417.021458-debug/f3a98d3f110319c567ec86bf70955c141495ccf6/ubuntu/jammy/flavors/default jammy/main amd64 ceph amd64 19.0.0-3146-gf3a98d3f-1jammy [14.0 kB] 2024-04-17T19:43:00.790 INFO:teuthology.orchestra.run.smithi062.stdout:Get:110 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240417.021458-debug/f3a98d3f110319c567ec86bf70955c141495ccf6/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse amd64 19.0.0-3146-gf3a98d3f-1jammy [856 kB] 2024-04-17T19:43:00.795 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../032-ceph-base_19.0.0-3146-gf3a98d3f-1jammy_amd64.deb ... 2024-04-17T19:43:00.847 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking ceph-base (19.0.0-3146-gf3a98d3f-1jammy) ... 2024-04-17T19:43:00.945 INFO:teuthology.orchestra.run.smithi062.stdout:Get:111 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240417.021458-debug/f3a98d3f110319c567ec86bf70955c141495ccf6/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds amd64 19.0.0-3146-gf3a98d3f-1jammy [2,369 kB] 2024-04-17T19:43:01.392 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package python3-jaraco.functools. 2024-04-17T19:43:01.407 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../033-python3-jaraco.functools_3.4.0-2_all.deb ... 2024-04-17T19:43:01.450 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking python3-jaraco.functools (3.4.0-2) ... 2024-04-17T19:43:01.675 INFO:teuthology.orchestra.run.smithi062.stdout:Get:112 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240417.021458-debug/f3a98d3f110319c567ec86bf70955c141495ccf6/ubuntu/jammy/flavors/default jammy/main amd64 cephadm amd64 19.0.0-3146-gf3a98d3f-1jammy [791 kB] 2024-04-17T19:43:01.703 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package python3-cheroot. 2024-04-17T19:43:01.719 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../034-python3-cheroot_8.5.2+ds1-1ubuntu3.1_all.deb ... 2024-04-17T19:43:01.753 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-04-17T19:43:01.979 INFO:teuthology.orchestra.run.smithi062.stdout:Get:113 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240417.021458-debug/f3a98d3f110319c567ec86bf70955c141495ccf6/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-cephadm all 19.0.0-3146-gf3a98d3f-1jammy [148 kB] 2024-04-17T19:43:02.025 INFO:teuthology.orchestra.run.smithi062.stdout:Get:114 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240417.021458-debug/f3a98d3f110319c567ec86bf70955c141495ccf6/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dashboard all 19.0.0-3146-gf3a98d3f-1jammy [2,297 kB] 2024-04-17T19:43:02.056 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package python3-jaraco.classes. 2024-04-17T19:43:02.072 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../035-python3-jaraco.classes_3.2.1-3_all.deb ... 2024-04-17T19:43:02.114 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking python3-jaraco.classes (3.2.1-3) ... 2024-04-17T19:43:02.401 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package python3-jaraco.text. 2024-04-17T19:43:02.416 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../036-python3-jaraco.text_3.6.0-2_all.deb ... 2024-04-17T19:43:02.459 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking python3-jaraco.text (3.6.0-2) ... 2024-04-17T19:43:02.619 INFO:teuthology.orchestra.run.smithi062.stdout:Get:115 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240417.021458-debug/f3a98d3f110319c567ec86bf70955c141495ccf6/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-diskprediction-local all 19.0.0-3146-gf3a98d3f-1jammy [8,625 kB] 2024-04-17T19:43:02.779 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package python3-jaraco.collections. 2024-04-17T19:43:02.794 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../037-python3-jaraco.collections_3.4.0-2_all.deb ... 2024-04-17T19:43:02.837 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking python3-jaraco.collections (3.4.0-2) ... 2024-04-17T19:43:03.098 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package python3-tempora. 2024-04-17T19:43:03.113 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../038-python3-tempora_4.1.2-1_all.deb ... 2024-04-17T19:43:03.148 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking python3-tempora (4.1.2-1) ... 2024-04-17T19:43:03.451 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package python3-portend. 2024-04-17T19:43:03.466 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../039-python3-portend_3.0.0-1_all.deb ... 2024-04-17T19:43:03.509 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking python3-portend (3.0.0-1) ... 2024-04-17T19:43:03.854 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package python3-zc.lockfile. 2024-04-17T19:43:03.869 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../040-python3-zc.lockfile_2.0-1_all.deb ... 2024-04-17T19:43:03.912 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking python3-zc.lockfile (2.0-1) ... 2024-04-17T19:43:04.190 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package python3-cherrypy3. 2024-04-17T19:43:04.205 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../041-python3-cherrypy3_18.6.1-4_all.deb ... 2024-04-17T19:43:04.240 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking python3-cherrypy3 (18.6.1-4) ... 2024-04-17T19:43:04.258 INFO:teuthology.orchestra.run.smithi062.stdout:Get:116 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240417.021458-debug/f3a98d3f110319c567ec86bf70955c141495ccf6/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-k8sevents all 19.0.0-3146-gf3a98d3f-1jammy [14.2 kB] 2024-04-17T19:43:04.259 INFO:teuthology.orchestra.run.smithi062.stdout:Get:117 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240417.021458-debug/f3a98d3f110319c567ec86bf70955c141495ccf6/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test amd64 19.0.0-3146-gf3a98d3f-1jammy [44.9 MB] 2024-04-17T19:43:04.552 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package python3-natsort. 2024-04-17T19:43:04.567 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../042-python3-natsort_8.0.2-1_all.deb ... 2024-04-17T19:43:04.610 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking python3-natsort (8.0.2-1) ... 2024-04-17T19:43:04.889 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package python3-logutils. 2024-04-17T19:43:04.904 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../043-python3-logutils_0.3.3-8_all.deb ... 2024-04-17T19:43:04.947 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking python3-logutils (0.3.3-8) ... 2024-04-17T19:43:05.241 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package python3-markupsafe. 2024-04-17T19:43:05.257 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../044-python3-markupsafe_2.0.1-2build1_amd64.deb ... 2024-04-17T19:43:05.299 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking python3-markupsafe (2.0.1-2build1) ... 2024-04-17T19:43:05.777 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package python3-mako. 2024-04-17T19:43:05.793 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../045-python3-mako_1.1.3+ds1-2ubuntu0.1_all.deb ... 2024-04-17T19:43:05.836 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-04-17T19:43:06.164 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package python3-simplegeneric. 2024-04-17T19:43:06.179 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../046-python3-simplegeneric_0.8.1-3_all.deb ... 2024-04-17T19:43:06.222 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2024-04-17T19:43:06.508 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package python3-singledispatch. 2024-04-17T19:43:06.524 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../047-python3-singledispatch_3.4.0.3-3_all.deb ... 2024-04-17T19:43:06.558 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking python3-singledispatch (3.4.0.3-3) ... 2024-04-17T19:43:06.828 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package python3-webob. 2024-04-17T19:43:06.843 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../048-python3-webob_1%3a1.8.6-1.1_all.deb ... 2024-04-17T19:43:06.886 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking python3-webob (1:1.8.6-1.1) ... 2024-04-17T19:43:07.214 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package python3-waitress. 2024-04-17T19:43:07.229 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../049-python3-waitress_1.4.4-1.1ubuntu1_all.deb ... 2024-04-17T19:43:07.275 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking python3-waitress (1.4.4-1.1ubuntu1) ... 2024-04-17T19:43:07.592 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package python3-tempita. 2024-04-17T19:43:07.607 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../050-python3-tempita_0.5.2-6ubuntu1_all.deb ... 2024-04-17T19:43:07.650 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking python3-tempita (0.5.2-6ubuntu1) ... 2024-04-17T19:43:07.970 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package python3-paste. 2024-04-17T19:43:07.986 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../051-python3-paste_3.5.0+dfsg1-1_all.deb ... 2024-04-17T19:43:08.028 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking python3-paste (3.5.0+dfsg1-1) ... 2024-04-17T19:43:08.323 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2024-04-17T19:43:08.338 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../052-python-pastedeploy-tpl_2.1.1-1_all.deb ... 2024-04-17T19:43:08.381 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking python-pastedeploy-tpl (2.1.1-1) ... 2024-04-17T19:43:08.642 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package python3-pastedeploy. 2024-04-17T19:43:08.657 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../053-python3-pastedeploy_2.1.1-1_all.deb ... 2024-04-17T19:43:08.692 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking python3-pastedeploy (2.1.1-1) ... 2024-04-17T19:43:09.029 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package python3-webtest. 2024-04-17T19:43:09.044 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../054-python3-webtest_2.0.35-1_all.deb ... 2024-04-17T19:43:09.087 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking python3-webtest (2.0.35-1) ... 2024-04-17T19:43:09.398 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package python3-pecan. 2024-04-17T19:43:09.414 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../055-python3-pecan_1.3.3-4ubuntu2_all.deb ... 2024-04-17T19:43:09.457 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking python3-pecan (1.3.3-4ubuntu2) ... 2024-04-17T19:43:09.822 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package python3-certifi. 2024-04-17T19:43:09.837 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../056-python3-certifi_2020.6.20-1_all.deb ... 2024-04-17T19:43:09.872 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking python3-certifi (2020.6.20-1) ... 2024-04-17T19:43:10.166 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package python3-idna. 2024-04-17T19:43:10.182 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../057-python3-idna_3.3-1_all.deb ... 2024-04-17T19:43:10.224 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking python3-idna (3.3-1) ... 2024-04-17T19:43:10.527 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package python3-urllib3. 2024-04-17T19:43:10.543 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../058-python3-urllib3_1.26.5-1~exp1ubuntu0.1_all.deb ... 2024-04-17T19:43:10.586 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-04-17T19:43:10.889 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package python3-requests. 2024-04-17T19:43:10.904 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../059-python3-requests_2.25.1+dfsg-2ubuntu0.1_all.deb ... 2024-04-17T19:43:10.947 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-04-17T19:43:11.258 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package python3-werkzeug. 2024-04-17T19:43:11.274 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../060-python3-werkzeug_2.0.2+dfsg1-1ubuntu0.22.04.1_all.deb ... 2024-04-17T19:43:11.333 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2024-04-17T19:43:11.480 INFO:teuthology.orchestra.run.smithi062.stdout:Get:118 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240417.021458-debug/f3a98d3f110319c567ec86bf70955c141495ccf6/ubuntu/jammy/flavors/default jammy/main amd64 ceph-volume all 19.0.0-3146-gf3a98d3f-1jammy [124 kB] 2024-04-17T19:43:11.483 INFO:teuthology.orchestra.run.smithi062.stdout:Get:119 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240417.021458-debug/f3a98d3f110319c567ec86bf70955c141495ccf6/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-mirror amd64 19.0.0-3146-gf3a98d3f-1jammy [236 kB] 2024-04-17T19:43:11.488 INFO:teuthology.orchestra.run.smithi062.stdout:Get:120 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240417.021458-debug/f3a98d3f110319c567ec86bf70955c141495ccf6/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-shell all 19.0.0-3146-gf3a98d3f-1jammy [33.9 kB] 2024-04-17T19:43:11.489 INFO:teuthology.orchestra.run.smithi062.stdout:Get:121 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240417.021458-debug/f3a98d3f110319c567ec86bf70955c141495ccf6/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-top all 19.0.0-3146-gf3a98d3f-1jammy [23.4 kB] 2024-04-17T19:43:11.489 INFO:teuthology.orchestra.run.smithi062.stdout:Get:122 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240417.021458-debug/f3a98d3f110319c567ec86bf70955c141495ccf6/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-dev amd64 19.0.0-3146-gf3a98d3f-1jammy [38.9 kB] 2024-04-17T19:43:11.490 INFO:teuthology.orchestra.run.smithi062.stdout:Get:123 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240417.021458-debug/f3a98d3f110319c567ec86bf70955c141495ccf6/ubuntu/jammy/flavors/default jammy/main amd64 radosgw amd64 19.0.0-3146-gf3a98d3f-1jammy [14.1 MB] 2024-04-17T19:43:12.312 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2024-04-17T19:43:12.329 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../061-ceph-mgr-modules-core_19.0.0-3146-gf3a98d3f-1jammy_all.deb ... 2024-04-17T19:43:12.370 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking ceph-mgr-modules-core (19.0.0-3146-gf3a98d3f-1jammy) ... 2024-04-17T19:43:12.792 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2024-04-17T19:43:12.807 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../062-libsqlite3-mod-ceph_19.0.0-3146-gf3a98d3f-1jammy_amd64.deb ... 2024-04-17T19:43:12.849 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking libsqlite3-mod-ceph (19.0.0-3146-gf3a98d3f-1jammy) ... 2024-04-17T19:43:13.103 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package python3-bcrypt. 2024-04-17T19:43:13.118 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../063-python3-bcrypt_3.2.0-1build1_amd64.deb ... 2024-04-17T19:43:13.152 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking python3-bcrypt (3.2.0-1build1) ... 2024-04-17T19:43:13.343 INFO:teuthology.orchestra.run.smithi062.stdout:Get:124 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240417.021458-debug/f3a98d3f110319c567ec86bf70955c141495ccf6/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse amd64 19.0.0-3146-gf3a98d3f-1jammy [92.6 kB] 2024-04-17T19:43:13.456 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package python3-openssl. 2024-04-17T19:43:13.471 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../064-python3-openssl_21.0.0-1_all.deb ... 2024-04-17T19:43:13.522 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking python3-openssl (21.0.0-1) ... 2024-04-17T19:43:13.867 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package ceph-mgr. 2024-04-17T19:43:13.882 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../065-ceph-mgr_19.0.0-3146-gf3a98d3f-1jammy_amd64.deb ... 2024-04-17T19:43:13.925 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking ceph-mgr (19.0.0-3146-gf3a98d3f-1jammy) ... 2024-04-17T19:43:13.993 INFO:teuthology.orchestra.run.smithi062.stdout:Fetched 175 MB in 35s (5,051 kB/s) 2024-04-17T19:43:14.127 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python3-pyperclip. 2024-04-17T19:43:14.213 INFO:teuthology.orchestra.run.smithi062.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 130504 files and directories currently installed.) 2024-04-17T19:43:14.217 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../000-python3-pyperclip_1.8.2-2_all.deb ... 2024-04-17T19:43:14.259 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python3-pyperclip (1.8.2-2) ... 2024-04-17T19:43:14.287 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package ceph-mon. 2024-04-17T19:43:14.302 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../066-ceph-mon_19.0.0-3146-gf3a98d3f-1jammy_amd64.deb ... 2024-04-17T19:43:14.336 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking ceph-mon (19.0.0-3146-gf3a98d3f-1jammy) ... 2024-04-17T19:43:14.553 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python3-wcwidth. 2024-04-17T19:43:14.574 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../001-python3-wcwidth_0.2.5+dfsg1-1_all.deb ... 2024-04-17T19:43:14.820 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python3-wcwidth (0.2.5+dfsg1-1) ... 2024-04-17T19:43:14.882 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package ceph-osd. 2024-04-17T19:43:14.897 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../067-ceph-osd_19.0.0-3146-gf3a98d3f-1jammy_amd64.deb ... 2024-04-17T19:43:14.940 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking ceph-osd (19.0.0-3146-gf3a98d3f-1jammy) ... 2024-04-17T19:43:15.298 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python3-cmd2. 2024-04-17T19:43:15.318 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../002-python3-cmd2_2.3.3-1_all.deb ... 2024-04-17T19:43:15.356 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python3-cmd2 (2.3.3-1) ... 2024-04-17T19:43:15.750 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package liblttng-ust1:amd64. 2024-04-17T19:43:15.751 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package ceph. 2024-04-17T19:43:15.767 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../068-ceph_19.0.0-3146-gf3a98d3f-1jammy_amd64.deb ... 2024-04-17T19:43:15.771 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../003-liblttng-ust1_2.13.1-1ubuntu1_amd64.deb ... 2024-04-17T19:43:15.810 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking ceph (19.0.0-3146-gf3a98d3f-1jammy) ... 2024-04-17T19:43:15.876 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-04-17T19:43:16.104 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package ceph-fuse. 2024-04-17T19:43:16.119 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../069-ceph-fuse_19.0.0-3146-gf3a98d3f-1jammy_amd64.deb ... 2024-04-17T19:43:16.154 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking ceph-fuse (19.0.0-3146-gf3a98d3f-1jammy) ... 2024-04-17T19:43:16.229 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2024-04-17T19:43:16.250 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../004-libdouble-conversion3_3.1.7-4_amd64.deb ... 2024-04-17T19:43:16.279 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking libdouble-conversion3:amd64 (3.1.7-4) ... 2024-04-17T19:43:16.524 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package ceph-mds. 2024-04-17T19:43:16.539 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../070-ceph-mds_19.0.0-3146-gf3a98d3f-1jammy_amd64.deb ... 2024-04-17T19:43:16.582 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking ceph-mds (19.0.0-3146-gf3a98d3f-1jammy) ... 2024-04-17T19:43:16.632 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2024-04-17T19:43:16.652 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../005-libpcre2-16-0_10.39-3ubuntu0.1_amd64.deb ... 2024-04-17T19:43:16.690 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-04-17T19:43:16.960 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package cephadm. 2024-04-17T19:43:16.975 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../071-cephadm_19.0.0-3146-gf3a98d3f-1jammy_amd64.deb ... 2024-04-17T19:43:17.018 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking cephadm (19.0.0-3146-gf3a98d3f-1jammy) ... 2024-04-17T19:43:17.177 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package libqt5core5a:amd64. 2024-04-17T19:43:17.198 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../006-libqt5core5a_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-04-17T19:43:17.268 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-17T19:43:17.321 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package python3-asyncssh. 2024-04-17T19:43:17.336 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../072-python3-asyncssh_2.5.0-1_all.deb ... 2024-04-17T19:43:17.379 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking python3-asyncssh (2.5.0-1) ... 2024-04-17T19:43:17.671 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2024-04-17T19:43:17.692 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../007-libqt5dbus5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-04-17T19:43:17.721 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-17T19:43:17.757 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package python-babel-localedata. 2024-04-17T19:43:17.773 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../073-python-babel-localedata_2.8.0+dfsg.1-7_all.deb ... 2024-04-17T19:43:17.815 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-04-17T19:43:18.100 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package libqt5network5:amd64. 2024-04-17T19:43:18.120 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../008-libqt5network5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-04-17T19:43:18.157 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-17T19:43:18.561 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package libthrift-0.16.0:amd64. 2024-04-17T19:43:18.581 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../009-libthrift-0.16.0_0.16.0-2_amd64.deb ... 2024-04-17T19:43:18.619 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-04-17T19:43:18.736 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package python3-babel. 2024-04-17T19:43:18.751 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../074-python3-babel_2.8.0+dfsg.1-7_all.deb ... 2024-04-17T19:43:18.786 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking python3-babel (2.8.0+dfsg.1-7) ... 2024-04-17T19:43:18.947 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package librados2. 2024-04-17T19:43:18.967 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../010-librados2_19.0.0-3146-gf3a98d3f-1jammy_amd64.deb ... 2024-04-17T19:43:19.030 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking librados2 (19.0.0-3146-gf3a98d3f-1jammy) ... 2024-04-17T19:43:19.073 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package python3-jinja2. 2024-04-17T19:43:19.087 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../075-python3-jinja2_3.0.3-1ubuntu0.1_all.deb ... 2024-04-17T19:43:19.123 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking python3-jinja2 (3.0.3-1ubuntu0.1) ... 2024-04-17T19:43:19.418 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2024-04-17T19:43:19.433 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../076-ceph-mgr-cephadm_19.0.0-3146-gf3a98d3f-1jammy_all.deb ... 2024-04-17T19:43:19.467 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking ceph-mgr-cephadm (19.0.0-3146-gf3a98d3f-1jammy) ... 2024-04-17T19:43:19.533 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package librbd1. 2024-04-17T19:43:19.554 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../011-librbd1_19.0.0-3146-gf3a98d3f-1jammy_amd64.deb ... 2024-04-17T19:43:19.591 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking librbd1 (19.0.0-3146-gf3a98d3f-1jammy) ... 2024-04-17T19:43:19.771 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package python3-repoze.lru. 2024-04-17T19:43:19.786 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../077-python3-repoze.lru_0.7-2_all.deb ... 2024-04-17T19:43:19.820 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2024-04-17T19:43:20.111 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package libcephfs2. 2024-04-17T19:43:20.131 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../012-libcephfs2_19.0.0-3146-gf3a98d3f-1jammy_amd64.deb ... 2024-04-17T19:43:20.140 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package python3-routes. 2024-04-17T19:43:20.156 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../078-python3-routes_2.5.1-1ubuntu1_all.deb ... 2024-04-17T19:43:20.168 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking libcephfs2 (19.0.0-3146-gf3a98d3f-1jammy) ... 2024-04-17T19:43:20.198 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking python3-routes (2.5.1-1ubuntu1) ... 2024-04-17T19:43:20.468 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2024-04-17T19:43:20.484 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../079-ceph-mgr-dashboard_19.0.0-3146-gf3a98d3f-1jammy_all.deb ... 2024-04-17T19:43:20.518 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking ceph-mgr-dashboard (19.0.0-3146-gf3a98d3f-1jammy) ... 2024-04-17T19:43:20.538 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python3-rados. 2024-04-17T19:43:20.558 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../013-python3-rados_19.0.0-3146-gf3a98d3f-1jammy_amd64.deb ... 2024-04-17T19:43:20.596 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python3-rados (19.0.0-3146-gf3a98d3f-1jammy) ... 2024-04-17T19:43:20.932 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python3-ceph-argparse. 2024-04-17T19:43:20.953 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../014-python3-ceph-argparse_19.0.0-3146-gf3a98d3f-1jammy_all.deb ... 2024-04-17T19:43:20.982 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python3-ceph-argparse (19.0.0-3146-gf3a98d3f-1jammy) ... 2024-04-17T19:43:21.243 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python3-cephfs. 2024-04-17T19:43:21.255 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../015-python3-cephfs_19.0.0-3146-gf3a98d3f-1jammy_amd64.deb ... 2024-04-17T19:43:21.293 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python3-cephfs (19.0.0-3146-gf3a98d3f-1jammy) ... 2024-04-17T19:43:21.637 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python3-ceph-common. 2024-04-17T19:43:21.658 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../016-python3-ceph-common_19.0.0-3146-gf3a98d3f-1jammy_all.deb ... 2024-04-17T19:43:21.695 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python3-ceph-common (19.0.0-3146-gf3a98d3f-1jammy) ... 2024-04-17T19:43:21.982 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package python3-sklearn-lib:amd64. 2024-04-17T19:43:21.989 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../080-python3-sklearn-lib_0.23.2-5ubuntu6_amd64.deb ... 2024-04-17T19:43:22.023 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-04-17T19:43:22.031 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python3-prettytable. 2024-04-17T19:43:22.043 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../017-python3-prettytable_2.5.0-2_all.deb ... 2024-04-17T19:43:22.081 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python3-prettytable (2.5.0-2) ... 2024-04-17T19:43:22.334 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python3-rbd. 2024-04-17T19:43:22.346 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../018-python3-rbd_19.0.0-3146-gf3a98d3f-1jammy_amd64.deb ... 2024-04-17T19:43:22.383 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python3-rbd (19.0.0-3146-gf3a98d3f-1jammy) ... 2024-04-17T19:43:22.494 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package python3-joblib. 2024-04-17T19:43:22.504 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../081-python3-joblib_0.17.0-4ubuntu1_all.deb ... 2024-04-17T19:43:22.543 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking python3-joblib (0.17.0-4ubuntu1) ... 2024-04-17T19:43:22.770 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package librdkafka1:amd64. 2024-04-17T19:43:22.791 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../019-librdkafka1_1.8.0-1build1_amd64.deb ... 2024-04-17T19:43:22.828 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking librdkafka1:amd64 (1.8.0-1build1) ... 2024-04-17T19:43:22.888 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package python3-threadpoolctl. 2024-04-17T19:43:22.900 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../082-python3-threadpoolctl_3.1.0-1_all.deb ... 2024-04-17T19:43:23.016 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking python3-threadpoolctl (3.1.0-1) ... 2024-04-17T19:43:23.155 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package libreadline-dev:amd64. 2024-04-17T19:43:23.168 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../020-libreadline-dev_8.1.2-1_amd64.deb ... 2024-04-17T19:43:23.205 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking libreadline-dev:amd64 (8.1.2-1) ... 2024-04-17T19:43:23.318 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package python3-sklearn. 2024-04-17T19:43:23.329 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../083-python3-sklearn_0.23.2-5ubuntu6_all.deb ... 2024-04-17T19:43:23.368 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking python3-sklearn (0.23.2-5ubuntu6) ... 2024-04-17T19:43:23.533 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package liblua5.3-dev:amd64. 2024-04-17T19:43:23.554 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../021-liblua5.3-dev_5.3.6-1build1_amd64.deb ... 2024-04-17T19:43:23.616 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-04-17T19:43:23.978 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package lua5.1. 2024-04-17T19:43:23.999 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../022-lua5.1_5.1.5-8.1build4_amd64.deb ... 2024-04-17T19:43:24.036 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking lua5.1 (5.1.5-8.1build4) ... 2024-04-17T19:43:24.044 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2024-04-17T19:43:24.056 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../084-ceph-mgr-diskprediction-local_19.0.0-3146-gf3a98d3f-1jammy_all.deb ... 2024-04-17T19:43:24.094 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking ceph-mgr-diskprediction-local (19.0.0-3146-gf3a98d3f-1jammy) ... 2024-04-17T19:43:24.397 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package lua-any. 2024-04-17T19:43:24.409 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../023-lua-any_27ubuntu1_all.deb ... 2024-04-17T19:43:24.447 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking lua-any (27ubuntu1) ... 2024-04-17T19:43:24.725 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package zip. 2024-04-17T19:43:24.745 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../024-zip_3.0-12build2_amd64.deb ... 2024-04-17T19:43:24.783 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking zip (3.0-12build2) ... 2024-04-17T19:43:25.023 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package python3-cachetools. 2024-04-17T19:43:25.034 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../085-python3-cachetools_5.0.0-1_all.deb ... 2024-04-17T19:43:25.072 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking python3-cachetools (5.0.0-1) ... 2024-04-17T19:43:25.111 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package unzip. 2024-04-17T19:43:25.124 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../025-unzip_6.0-26ubuntu3.2_amd64.deb ... 2024-04-17T19:43:25.161 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking unzip (6.0-26ubuntu3.2) ... 2024-04-17T19:43:25.392 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package python3-pyasn1. 2024-04-17T19:43:25.403 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../086-python3-pyasn1_0.4.8-1_all.deb ... 2024-04-17T19:43:25.442 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking python3-pyasn1 (0.4.8-1) ... 2024-04-17T19:43:25.573 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package luarocks. 2024-04-17T19:43:25.594 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../026-luarocks_3.8.0+dfsg1-1_all.deb ... 2024-04-17T19:43:25.631 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking luarocks (3.8.0+dfsg1-1) ... 2024-04-17T19:43:25.779 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package python3-pyasn1-modules. 2024-04-17T19:43:25.790 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../087-python3-pyasn1-modules_0.2.1-1_all.deb ... 2024-04-17T19:43:25.828 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking python3-pyasn1-modules (0.2.1-1) ... 2024-04-17T19:43:26.056 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package librgw2. 2024-04-17T19:43:26.077 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../027-librgw2_19.0.0-3146-gf3a98d3f-1jammy_amd64.deb ... 2024-04-17T19:43:26.122 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking librgw2 (19.0.0-3146-gf3a98d3f-1jammy) ... 2024-04-17T19:43:26.148 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package python3-rsa. 2024-04-17T19:43:26.160 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../088-python3-rsa_4.8-1_all.deb ... 2024-04-17T19:43:26.198 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking python3-rsa (4.8-1) ... 2024-04-17T19:43:26.536 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package python3-google-auth. 2024-04-17T19:43:26.547 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../089-python3-google-auth_1.5.1-3_all.deb ... 2024-04-17T19:43:26.594 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking python3-google-auth (1.5.1-3) ... 2024-04-17T19:43:26.800 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python3-rgw. 2024-04-17T19:43:26.812 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../028-python3-rgw_19.0.0-3146-gf3a98d3f-1jammy_amd64.deb ... 2024-04-17T19:43:26.874 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python3-rgw (19.0.0-3146-gf3a98d3f-1jammy) ... 2024-04-17T19:43:26.897 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package python3-requests-oauthlib. 2024-04-17T19:43:26.909 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../090-python3-requests-oauthlib_1.3.0+ds-0.1_all.deb ... 2024-04-17T19:43:26.947 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-04-17T19:43:27.211 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package liboath0:amd64. 2024-04-17T19:43:27.231 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../029-liboath0_2.6.7-3build1_amd64.deb ... 2024-04-17T19:43:27.259 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package python3-websocket. 2024-04-17T19:43:27.269 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking liboath0:amd64 (2.6.7-3build1) ... 2024-04-17T19:43:27.270 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../091-python3-websocket_1.2.3-1_all.deb ... 2024-04-17T19:43:27.308 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking python3-websocket (1.2.3-1) ... 2024-04-17T19:43:27.589 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package libradosstriper1. 2024-04-17T19:43:27.609 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../030-libradosstriper1_19.0.0-3146-gf3a98d3f-1jammy_amd64.deb ... 2024-04-17T19:43:27.628 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package python3-kubernetes. 2024-04-17T19:43:27.640 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../092-python3-kubernetes_12.0.1-1ubuntu1_all.deb ... 2024-04-17T19:43:27.646 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking libradosstriper1 (19.0.0-3146-gf3a98d3f-1jammy) ... 2024-04-17T19:43:27.678 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking python3-kubernetes (12.0.1-1ubuntu1) ... 2024-04-17T19:43:28.117 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package ceph-common. 2024-04-17T19:43:28.137 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../031-ceph-common_19.0.0-3146-gf3a98d3f-1jammy_amd64.deb ... 2024-04-17T19:43:28.174 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking ceph-common (19.0.0-3146-gf3a98d3f-1jammy) ... 2024-04-17T19:43:28.359 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2024-04-17T19:43:28.369 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../093-ceph-mgr-k8sevents_19.0.0-3146-gf3a98d3f-1jammy_all.deb ... 2024-04-17T19:43:28.409 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking ceph-mgr-k8sevents (19.0.0-3146-gf3a98d3f-1jammy) ... 2024-04-17T19:43:28.670 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package libonig5:amd64. 2024-04-17T19:43:28.680 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../094-libonig5_6.9.7.1-2build1_amd64.deb ... 2024-04-17T19:43:28.720 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking libonig5:amd64 (6.9.7.1-2build1) ... 2024-04-17T19:43:29.082 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package libjq1:amd64. 2024-04-17T19:43:29.095 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../095-libjq1_1.6-2.1ubuntu3_amd64.deb ... 2024-04-17T19:43:29.139 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-04-17T19:43:29.392 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package jq. 2024-04-17T19:43:29.404 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../096-jq_1.6-2.1ubuntu3_amd64.deb ... 2024-04-17T19:43:29.442 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking jq (1.6-2.1ubuntu3) ... 2024-04-17T19:43:29.670 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package socat. 2024-04-17T19:43:29.682 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../097-socat_1.7.4.1-3ubuntu4_amd64.deb ... 2024-04-17T19:43:29.711 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking socat (1.7.4.1-3ubuntu4) ... 2024-04-17T19:43:29.796 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package ceph-base. 2024-04-17T19:43:29.817 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../032-ceph-base_19.0.0-3146-gf3a98d3f-1jammy_amd64.deb ... 2024-04-17T19:43:29.864 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking ceph-base (19.0.0-3146-gf3a98d3f-1jammy) ... 2024-04-17T19:43:29.998 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package xmlstarlet. 2024-04-17T19:43:30.010 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../098-xmlstarlet_1.6.1-2.1_amd64.deb ... 2024-04-17T19:43:30.048 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking xmlstarlet (1.6.1-2.1) ... 2024-04-17T19:43:30.411 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package ceph-test. 2024-04-17T19:43:30.422 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../099-ceph-test_19.0.0-3146-gf3a98d3f-1jammy_amd64.deb ... 2024-04-17T19:43:30.460 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking ceph-test (19.0.0-3146-gf3a98d3f-1jammy) ... 2024-04-17T19:43:30.701 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python3-jaraco.functools. 2024-04-17T19:43:30.721 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../033-python3-jaraco.functools_3.4.0-2_all.deb ... 2024-04-17T19:43:30.792 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python3-jaraco.functools (3.4.0-2) ... 2024-04-17T19:43:31.045 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python3-cheroot. 2024-04-17T19:43:31.066 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../034-python3-cheroot_8.5.2+ds1-1ubuntu3.1_all.deb ... 2024-04-17T19:43:31.145 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-04-17T19:43:31.498 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python3-jaraco.classes. 2024-04-17T19:43:31.519 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../035-python3-jaraco.classes_3.2.1-3_all.deb ... 2024-04-17T19:43:31.556 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python3-jaraco.classes (3.2.1-3) ... 2024-04-17T19:43:31.850 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python3-jaraco.text. 2024-04-17T19:43:31.871 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../036-python3-jaraco.text_3.6.0-2_all.deb ... 2024-04-17T19:43:31.900 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python3-jaraco.text (3.6.0-2) ... 2024-04-17T19:43:32.370 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python3-jaraco.collections. 2024-04-17T19:43:32.391 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../037-python3-jaraco.collections_3.4.0-2_all.deb ... 2024-04-17T19:43:32.428 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python3-jaraco.collections (3.4.0-2) ... 2024-04-17T19:43:32.756 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package ceph-volume. 2024-04-17T19:43:32.764 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python3-tempora. 2024-04-17T19:43:32.766 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../100-ceph-volume_19.0.0-3146-gf3a98d3f-1jammy_all.deb ... 2024-04-17T19:43:32.785 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../038-python3-tempora_4.1.2-1_all.deb ... 2024-04-17T19:43:32.822 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python3-tempora (4.1.2-1) ... 2024-04-17T19:43:32.823 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking ceph-volume (19.0.0-3146-gf3a98d3f-1jammy) ... 2024-04-17T19:43:33.167 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python3-portend. 2024-04-17T19:43:33.187 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../039-python3-portend_3.0.0-1_all.deb ... 2024-04-17T19:43:33.202 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package cephfs-mirror. 2024-04-17T19:43:33.212 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../101-cephfs-mirror_19.0.0-3146-gf3a98d3f-1jammy_amd64.deb ... 2024-04-17T19:43:33.250 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python3-portend (3.0.0-1) ... 2024-04-17T19:43:33.252 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking cephfs-mirror (19.0.0-3146-gf3a98d3f-1jammy) ... 2024-04-17T19:43:33.536 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python3-zc.lockfile. 2024-04-17T19:43:33.557 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../040-python3-zc.lockfile_2.0-1_all.deb ... 2024-04-17T19:43:33.563 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package python3-colorama. 2024-04-17T19:43:33.576 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../102-python3-colorama_0.4.4-1_all.deb ... 2024-04-17T19:43:33.611 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python3-zc.lockfile (2.0-1) ... 2024-04-17T19:43:33.613 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking python3-colorama (0.4.4-1) ... 2024-04-17T19:43:33.849 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package cephfs-shell. 2024-04-17T19:43:33.860 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../103-cephfs-shell_19.0.0-3146-gf3a98d3f-1jammy_all.deb ... 2024-04-17T19:43:33.891 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking cephfs-shell (19.0.0-3146-gf3a98d3f-1jammy) ... 2024-04-17T19:43:33.947 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python3-cherrypy3. 2024-04-17T19:43:33.968 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../041-python3-cherrypy3_18.6.1-4_all.deb ... 2024-04-17T19:43:34.005 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python3-cherrypy3 (18.6.1-4) ... 2024-04-17T19:43:34.135 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package cephfs-top. 2024-04-17T19:43:34.145 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../104-cephfs-top_19.0.0-3146-gf3a98d3f-1jammy_all.deb ... 2024-04-17T19:43:34.185 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking cephfs-top (19.0.0-3146-gf3a98d3f-1jammy) ... 2024-04-17T19:43:34.343 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python3-natsort. 2024-04-17T19:43:34.363 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../042-python3-natsort_8.0.2-1_all.deb ... 2024-04-17T19:43:34.392 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python3-natsort (8.0.2-1) ... 2024-04-17T19:43:34.429 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package libcephfs-dev. 2024-04-17T19:43:34.440 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../105-libcephfs-dev_19.0.0-3146-gf3a98d3f-1jammy_amd64.deb ... 2024-04-17T19:43:34.479 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking libcephfs-dev (19.0.0-3146-gf3a98d3f-1jammy) ... 2024-04-17T19:43:34.687 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python3-logutils. 2024-04-17T19:43:34.708 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../043-python3-logutils_0.3.3-8_all.deb ... 2024-04-17T19:43:34.736 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python3-logutils (0.3.3-8) ... 2024-04-17T19:43:34.766 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package lua-socket:amd64. 2024-04-17T19:43:34.776 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../106-lua-socket_3.0~rc1+git+ac3201d-6_amd64.deb ... 2024-04-17T19:43:34.815 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-04-17T19:43:35.081 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python3-markupsafe. 2024-04-17T19:43:35.102 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../044-python3-markupsafe_2.0.1-2build1_amd64.deb ... 2024-04-17T19:43:35.139 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python3-markupsafe (2.0.1-2build1) ... 2024-04-17T19:43:35.153 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package lua-sec:amd64. 2024-04-17T19:43:35.163 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../107-lua-sec_1.0.2-1_amd64.deb ... 2024-04-17T19:43:35.203 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking lua-sec:amd64 (1.0.2-1) ... 2024-04-17T19:43:35.475 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python3-mako. 2024-04-17T19:43:35.497 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../045-python3-mako_1.1.3+ds1-2ubuntu0.1_all.deb ... 2024-04-17T19:43:35.533 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-04-17T19:43:35.549 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package nvme-cli. 2024-04-17T19:43:35.559 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../108-nvme-cli_1.16-3ubuntu0.1_amd64.deb ... 2024-04-17T19:43:35.598 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking nvme-cli (1.16-3ubuntu0.1) ... 2024-04-17T19:43:35.879 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python3-simplegeneric. 2024-04-17T19:43:35.900 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../046-python3-simplegeneric_0.8.1-3_all.deb ... 2024-04-17T19:43:35.937 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2024-04-17T19:43:35.937 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package pkg-config. 2024-04-17T19:43:35.947 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../109-pkg-config_0.29.2-1ubuntu3_amd64.deb ... 2024-04-17T19:43:35.979 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking pkg-config (0.29.2-1ubuntu3) ... 2024-04-17T19:43:36.198 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package python-asyncssh-doc. 2024-04-17T19:43:36.208 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../110-python-asyncssh-doc_2.5.0-1_all.deb ... 2024-04-17T19:43:36.214 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python3-singledispatch. 2024-04-17T19:43:36.236 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../047-python3-singledispatch_3.4.0.3-3_all.deb ... 2024-04-17T19:43:36.248 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking python-asyncssh-doc (2.5.0-1) ... 2024-04-17T19:43:36.264 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python3-singledispatch (3.4.0.3-3) ... 2024-04-17T19:43:36.592 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python3-webob. 2024-04-17T19:43:36.613 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../048-python3-webob_1%3a1.8.6-1.1_all.deb ... 2024-04-17T19:43:36.650 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python3-webob (1:1.8.6-1.1) ... 2024-04-17T19:43:36.693 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package python3-iniconfig. 2024-04-17T19:43:36.704 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../111-python3-iniconfig_1.1.1-2_all.deb ... 2024-04-17T19:43:36.742 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking python3-iniconfig (1.1.1-2) ... 2024-04-17T19:43:37.045 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python3-waitress. 2024-04-17T19:43:37.066 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../049-python3-waitress_1.4.4-1.1ubuntu1_all.deb ... 2024-04-17T19:43:37.079 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package python3-pastescript. 2024-04-17T19:43:37.090 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../112-python3-pastescript_2.0.2-4_all.deb ... 2024-04-17T19:43:37.128 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2024-04-17T19:43:37.139 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python3-waitress (1.4.4-1.1ubuntu1) ... 2024-04-17T19:43:37.432 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package python3-pluggy. 2024-04-17T19:43:37.443 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../113-python3-pluggy_0.13.0-7.1_all.deb ... 2024-04-17T19:43:37.481 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python3-tempita. 2024-04-17T19:43:37.482 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking python3-pluggy (0.13.0-7.1) ... 2024-04-17T19:43:37.502 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../050-python3-tempita_0.5.2-6ubuntu1_all.deb ... 2024-04-17T19:43:37.539 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python3-tempita (0.5.2-6ubuntu1) ... 2024-04-17T19:43:37.727 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package python3-psutil. 2024-04-17T19:43:37.738 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../114-python3-psutil_5.9.0-1build1_amd64.deb ... 2024-04-17T19:43:37.801 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking python3-psutil (5.9.0-1build1) ... 2024-04-17T19:43:37.858 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python3-paste. 2024-04-17T19:43:37.880 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../051-python3-paste_3.5.0+dfsg1-1_all.deb ... 2024-04-17T19:43:37.916 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python3-paste (3.5.0+dfsg1-1) ... 2024-04-17T19:43:38.121 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package python3-py. 2024-04-17T19:43:38.132 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../115-python3-py_1.10.0-1_all.deb ... 2024-04-17T19:43:38.163 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking python3-py (1.10.0-1) ... 2024-04-17T19:43:38.245 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2024-04-17T19:43:38.258 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../052-python-pastedeploy-tpl_2.1.1-1_all.deb ... 2024-04-17T19:43:38.294 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python-pastedeploy-tpl (2.1.1-1) ... 2024-04-17T19:43:38.441 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package python3-pygments. 2024-04-17T19:43:38.452 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../116-python3-pygments_2.11.2+dfsg-2_all.deb ... 2024-04-17T19:43:38.483 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking python3-pygments (2.11.2+dfsg-2) ... 2024-04-17T19:43:38.614 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python3-pastedeploy. 2024-04-17T19:43:38.635 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../053-python3-pastedeploy_2.1.1-1_all.deb ... 2024-04-17T19:43:38.672 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python3-pastedeploy (2.1.1-1) ... 2024-04-17T19:43:38.954 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package python3-pyinotify. 2024-04-17T19:43:38.964 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../117-python3-pyinotify_0.9.6-1.3_all.deb ... 2024-04-17T19:43:39.003 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking python3-pyinotify (0.9.6-1.3) ... 2024-04-17T19:43:39.033 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python3-webtest. 2024-04-17T19:43:39.055 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../054-python3-webtest_2.0.35-1_all.deb ... 2024-04-17T19:43:39.091 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python3-webtest (2.0.35-1) ... 2024-04-17T19:43:39.331 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package python3-toml. 2024-04-17T19:43:39.342 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../118-python3-toml_0.10.2-1_all.deb ... 2024-04-17T19:43:39.381 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking python3-toml (0.10.2-1) ... 2024-04-17T19:43:39.445 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python3-pecan. 2024-04-17T19:43:39.466 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../055-python3-pecan_1.3.3-4ubuntu2_all.deb ... 2024-04-17T19:43:39.503 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python3-pecan (1.3.3-4ubuntu2) ... 2024-04-17T19:43:39.643 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package python3-pytest. 2024-04-17T19:43:39.653 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../119-python3-pytest_6.2.5-1ubuntu2_all.deb ... 2024-04-17T19:43:39.684 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking python3-pytest (6.2.5-1ubuntu2) ... 2024-04-17T19:43:39.932 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python3-certifi. 2024-04-17T19:43:39.954 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../056-python3-certifi_2020.6.20-1_all.deb ... 2024-04-17T19:43:39.990 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python3-certifi (2020.6.20-1) ... 2024-04-17T19:43:40.021 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package python3-simplejson. 2024-04-17T19:43:40.032 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../120-python3-simplejson_3.17.6-1build1_amd64.deb ... 2024-04-17T19:43:40.071 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking python3-simplejson (3.17.6-1build1) ... 2024-04-17T19:43:40.390 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package qttranslations5-l10n. 2024-04-17T19:43:40.401 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../121-qttranslations5-l10n_5.15.3-1_all.deb ... 2024-04-17T19:43:40.402 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python3-idna. 2024-04-17T19:43:40.415 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../057-python3-idna_3.3-1_all.deb ... 2024-04-17T19:43:40.440 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking qttranslations5-l10n (5.15.3-1) ... 2024-04-17T19:43:40.445 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python3-idna (3.3-1) ... 2024-04-17T19:43:40.779 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python3-urllib3. 2024-04-17T19:43:40.800 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../058-python3-urllib3_1.26.5-1~exp1ubuntu0.1_all.deb ... 2024-04-17T19:43:40.837 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-04-17T19:43:41.144 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package radosgw. 2024-04-17T19:43:41.154 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../122-radosgw_19.0.0-3146-gf3a98d3f-1jammy_amd64.deb ... 2024-04-17T19:43:41.194 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking radosgw (19.0.0-3146-gf3a98d3f-1jammy) ... 2024-04-17T19:43:41.199 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python3-requests. 2024-04-17T19:43:41.220 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../059-python3-requests_2.25.1+dfsg-2ubuntu0.1_all.deb ... 2024-04-17T19:43:41.257 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-04-17T19:43:41.593 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python3-werkzeug. 2024-04-17T19:43:41.614 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../060-python3-werkzeug_2.0.2+dfsg1-1ubuntu0.22.04.1_all.deb ... 2024-04-17T19:43:41.685 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2024-04-17T19:43:41.939 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package rbd-fuse. 2024-04-17T19:43:41.949 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../123-rbd-fuse_19.0.0-3146-gf3a98d3f-1jammy_amd64.deb ... 2024-04-17T19:43:41.980 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2024-04-17T19:43:41.988 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking rbd-fuse (19.0.0-3146-gf3a98d3f-1jammy) ... 2024-04-17T19:43:41.993 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../061-ceph-mgr-modules-core_19.0.0-3146-gf3a98d3f-1jammy_all.deb ... 2024-04-17T19:43:42.063 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking ceph-mgr-modules-core (19.0.0-3146-gf3a98d3f-1jammy) ... 2024-04-17T19:43:42.306 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up python3-iniconfig (1.1.1-2) ... 2024-04-17T19:43:42.476 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2024-04-17T19:43:42.497 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../062-libsqlite3-mod-ceph_19.0.0-3146-gf3a98d3f-1jammy_amd64.deb ... 2024-04-17T19:43:42.542 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking libsqlite3-mod-ceph (19.0.0-3146-gf3a98d3f-1jammy) ... 2024-04-17T19:43:42.586 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up libdouble-conversion3:amd64 (3.1.7-4) ... 2024-04-17T19:43:42.687 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up nvme-cli (1.16-3ubuntu0.1) ... 2024-04-17T19:43:42.854 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python3-bcrypt. 2024-04-17T19:43:42.866 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../063-python3-bcrypt_3.2.0-1build1_amd64.deb ... 2024-04-17T19:43:42.903 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python3-bcrypt (3.2.0-1build1) ... 2024-04-17T19:43:42.953 INFO:teuthology.orchestra.run.smithi044.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service -> /lib/systemd/system/nvmefc-boot-connections.service. 2024-04-17T19:43:43.223 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python3-openssl. 2024-04-17T19:43:43.244 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../064-python3-openssl_21.0.0-1_all.deb ... 2024-04-17T19:43:43.281 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python3-openssl (21.0.0-1) ... 2024-04-17T19:43:43.360 INFO:teuthology.orchestra.run.smithi044.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmf-autoconnect.service -> /lib/systemd/system/nvmf-autoconnect.service. 2024-04-17T19:43:43.651 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package ceph-mgr. 2024-04-17T19:43:43.672 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../065-ceph-mgr_19.0.0-3146-gf3a98d3f-1jammy_amd64.deb ... 2024-04-17T19:43:43.709 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking ceph-mgr (19.0.0-3146-gf3a98d3f-1jammy) ... 2024-04-17T19:43:43.958 INFO:teuthology.orchestra.run.smithi044.stdout:nvmf-connect.target is a disabled or a static unit, not starting it. 2024-04-17T19:43:43.993 INFO:teuthology.orchestra.run.smithi044.stdout:Could not execute systemctl: at /usr/bin/deb-systemd-invoke line 142. 2024-04-17T19:43:44.080 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up cephadm (19.0.0-3146-gf3a98d3f-1jammy) ... 2024-04-17T19:43:44.162 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package ceph-mon. 2024-04-17T19:43:44.184 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../066-ceph-mon_19.0.0-3146-gf3a98d3f-1jammy_amd64.deb ... 2024-04-17T19:43:44.228 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking ceph-mon (19.0.0-3146-gf3a98d3f-1jammy) ... 2024-04-17T19:43:44.657 INFO:teuthology.orchestra.run.smithi044.stdout:Adding system user cephadm....done 2024-04-17T19:43:44.777 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up python3-waitress (1.4.4-1.1ubuntu1) ... 2024-04-17T19:43:44.882 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package ceph-osd. 2024-04-17T19:43:44.903 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../067-ceph-osd_19.0.0-3146-gf3a98d3f-1jammy_amd64.deb ... 2024-04-17T19:43:44.948 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking ceph-osd (19.0.0-3146-gf3a98d3f-1jammy) ... 2024-04-17T19:43:45.063 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up python3-jaraco.classes (3.2.1-3) ... 2024-04-17T19:43:45.347 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up python-asyncssh-doc (2.5.0-1) ... 2024-04-17T19:43:45.473 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up python3-jaraco.functools (3.4.0-2) ... 2024-04-17T19:43:45.816 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up python3-repoze.lru (0.7-2) ... 2024-04-17T19:43:46.075 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up liboath0:amd64 (2.6.7-3build1) ... 2024-04-17T19:43:46.201 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up python3-py (1.10.0-1) ... 2024-04-17T19:43:46.302 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package ceph. 2024-04-17T19:43:46.314 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../068-ceph_19.0.0-3146-gf3a98d3f-1jammy_amd64.deb ... 2024-04-17T19:43:46.351 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking ceph (19.0.0-3146-gf3a98d3f-1jammy) ... 2024-04-17T19:43:46.520 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up python3-joblib (0.17.0-4ubuntu1) ... 2024-04-17T19:43:46.704 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package ceph-fuse. 2024-04-17T19:43:46.726 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../069-ceph-fuse_19.0.0-3146-gf3a98d3f-1jammy_amd64.deb ... 2024-04-17T19:43:46.787 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking ceph-fuse (19.0.0-3146-gf3a98d3f-1jammy) ... 2024-04-17T19:43:46.913 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up python3-cachetools (5.0.0-1) ... 2024-04-17T19:43:47.166 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package ceph-mds. 2024-04-17T19:43:47.172 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up python3-colorama (0.4.4-1) ... 2024-04-17T19:43:47.187 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../070-ceph-mds_19.0.0-3146-gf3a98d3f-1jammy_amd64.deb ... 2024-04-17T19:43:47.232 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking ceph-mds (19.0.0-3146-gf3a98d3f-1jammy) ... 2024-04-17T19:43:47.449 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up python3-openssl (21.0.0-1) ... 2024-04-17T19:43:47.685 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package cephadm. 2024-04-17T19:43:47.706 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../071-cephadm_19.0.0-3146-gf3a98d3f-1jammy_amd64.deb ... 2024-04-17T19:43:47.733 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up unzip (6.0-26ubuntu3.2) ... 2024-04-17T19:43:47.751 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking cephadm (19.0.0-3146-gf3a98d3f-1jammy) ... 2024-04-17T19:43:48.010 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up python3-bcrypt (3.2.0-1build1) ... 2024-04-17T19:43:48.096 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python3-asyncssh. 2024-04-17T19:43:48.117 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../072-python3-asyncssh_2.5.0-1_all.deb ... 2024-04-17T19:43:48.195 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python3-asyncssh (2.5.0-1) ... 2024-04-17T19:43:48.378 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up python3-pyinotify (0.9.6-1.3) ... 2024-04-17T19:43:48.557 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python-babel-localedata. 2024-04-17T19:43:48.578 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../073-python-babel-localedata_2.8.0+dfsg.1-7_all.deb ... 2024-04-17T19:43:48.623 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-04-17T19:43:48.645 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up python3-threadpoolctl (3.1.0-1) ... 2024-04-17T19:43:48.897 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up python3-ceph-argparse (19.0.0-3146-gf3a98d3f-1jammy) ... 2024-04-17T19:43:49.173 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-04-17T19:43:49.301 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-04-17T19:43:49.427 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up python3-pyperclip (1.8.2-2) ... 2024-04-17T19:43:49.695 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up libreadline-dev:amd64 (8.1.2-1) ... 2024-04-17T19:43:49.753 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python3-babel. 2024-04-17T19:43:49.775 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../074-python3-babel_2.8.0+dfsg.1-7_all.deb ... 2024-04-17T19:43:49.820 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python3-babel (2.8.0+dfsg.1-7) ... 2024-04-17T19:43:49.821 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up python3-markupsafe (2.0.1-2build1) ... 2024-04-17T19:43:50.089 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up lua5.1 (5.1.5-8.1build4) ... 2024-04-17T19:43:50.173 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python3-jinja2. 2024-04-17T19:43:50.194 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../075-python3-jinja2_3.0.3-1ubuntu0.1_all.deb ... 2024-04-17T19:43:50.231 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python3-jinja2 (3.0.3-1ubuntu0.1) ... 2024-04-17T19:43:50.475 INFO:teuthology.orchestra.run.smithi044.stdout:update-alternatives: using /usr/bin/lua5.1 to provide /usr/bin/lua (lua-interpreter) in auto mode 2024-04-17T19:43:50.528 INFO:teuthology.orchestra.run.smithi044.stdout:update-alternatives: using /usr/bin/luac5.1 to provide /usr/bin/luac (lua-compiler) in auto mode 2024-04-17T19:43:50.600 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-04-17T19:43:50.601 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2024-04-17T19:43:50.622 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../076-ceph-mgr-cephadm_19.0.0-3146-gf3a98d3f-1jammy_all.deb ... 2024-04-17T19:43:50.650 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking ceph-mgr-cephadm (19.0.0-3146-gf3a98d3f-1jammy) ... 2024-04-17T19:43:50.726 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up python3-psutil (5.9.0-1build1) ... 2024-04-17T19:43:51.029 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python3-repoze.lru. 2024-04-17T19:43:51.050 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../077-python3-repoze.lru_0.7-2_all.deb ... 2024-04-17T19:43:51.111 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-04-17T19:43:51.112 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2024-04-17T19:43:51.237 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up python3-natsort (8.0.2-1) ... 2024-04-17T19:43:51.448 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python3-routes. 2024-04-17T19:43:51.469 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../078-python3-routes_2.5.1-1ubuntu1_all.deb ... 2024-04-17T19:43:51.506 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python3-routes (2.5.1-1ubuntu1) ... 2024-04-17T19:43:51.513 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up python3-routes (2.5.1-1ubuntu1) ... 2024-04-17T19:43:51.823 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up python3-simplejson (3.17.6-1build1) ... 2024-04-17T19:43:51.885 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2024-04-17T19:43:51.906 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../079-ceph-mgr-dashboard_19.0.0-3146-gf3a98d3f-1jammy_all.deb ... 2024-04-17T19:43:51.942 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking ceph-mgr-dashboard (19.0.0-3146-gf3a98d3f-1jammy) ... 2024-04-17T19:43:52.141 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up zip (3.0-12build2) ... 2024-04-17T19:43:52.242 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up python3-pygments (2.11.2+dfsg-2) ... 2024-04-17T19:43:52.961 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up python3-tempita (0.5.2-6ubuntu1) ... 2024-04-17T19:43:53.221 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up python-pastedeploy-tpl (2.1.1-1) ... 2024-04-17T19:43:53.281 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python3-sklearn-lib:amd64. 2024-04-17T19:43:53.303 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../080-python3-sklearn-lib_0.23.2-5ubuntu6_amd64.deb ... 2024-04-17T19:43:53.346 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up qttranslations5-l10n (5.15.3-1) ... 2024-04-17T19:43:53.347 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-04-17T19:43:53.472 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up python3-wcwidth (0.2.5+dfsg1-1) ... 2024-04-17T19:43:53.798 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up python3-asyncssh (2.5.0-1) ... 2024-04-17T19:43:53.893 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python3-joblib. 2024-04-17T19:43:53.914 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../081-python3-joblib_0.17.0-4ubuntu1_all.deb ... 2024-04-17T19:43:53.951 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python3-joblib (0.17.0-4ubuntu1) ... 2024-04-17T19:43:54.208 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up python3-certifi (2020.6.20-1) ... 2024-04-17T19:43:54.323 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python3-threadpoolctl. 2024-04-17T19:43:54.344 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../082-python3-threadpoolctl_3.1.0-1_all.deb ... 2024-04-17T19:43:54.468 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up python3-paste (3.5.0+dfsg1-1) ... 2024-04-17T19:43:54.508 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python3-threadpoolctl (3.1.0-1) ... 2024-04-17T19:43:54.852 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python3-sklearn. 2024-04-17T19:43:54.862 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-04-17T19:43:54.874 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../083-python3-sklearn_0.23.2-5ubuntu6_all.deb ... 2024-04-17T19:43:54.910 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python3-sklearn (0.23.2-5ubuntu6) ... 2024-04-17T19:43:55.154 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up python3-cmd2 (2.3.3-1) ... 2024-04-17T19:43:55.480 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2024-04-17T19:43:55.669 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2024-04-17T19:43:55.691 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../084-ceph-mgr-diskprediction-local_19.0.0-3146-gf3a98d3f-1jammy_all.deb ... 2024-04-17T19:43:55.735 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking ceph-mgr-diskprediction-local (19.0.0-3146-gf3a98d3f-1jammy) ... 2024-04-17T19:43:55.848 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up python3-jaraco.text (3.6.0-2) ... 2024-04-17T19:43:56.108 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up socat (1.7.4.1-3ubuntu4) ... 2024-04-17T19:43:56.234 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up python3-ceph-common (19.0.0-3146-gf3a98d3f-1jammy) ... 2024-04-17T19:43:56.577 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up python3-idna (3.3-1) ... 2024-04-17T19:43:56.755 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python3-cachetools. 2024-04-17T19:43:56.777 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../085-python3-cachetools_5.0.0-1_all.deb ... 2024-04-17T19:43:56.821 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python3-cachetools (5.0.0-1) ... 2024-04-17T19:43:56.903 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up python3-sklearn (0.23.2-5ubuntu6) ... 2024-04-17T19:43:57.091 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python3-pyasn1. 2024-04-17T19:43:57.112 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../086-python3-pyasn1_0.4.8-1_all.deb ... 2024-04-17T19:43:57.141 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python3-pyasn1 (0.4.8-1) ... 2024-04-17T19:43:57.478 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python3-pyasn1-modules. 2024-04-17T19:43:57.499 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../087-python3-pyasn1-modules_0.2.1-1_all.deb ... 2024-04-17T19:43:57.544 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python3-pyasn1-modules (0.2.1-1) ... 2024-04-17T19:43:57.897 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python3-rsa. 2024-04-17T19:43:57.919 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../088-python3-rsa_4.8-1_all.deb ... 2024-04-17T19:43:57.963 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python3-rsa (4.8-1) ... 2024-04-17T19:43:58.176 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up pkg-config (0.29.2-1ubuntu3) ... 2024-04-17T19:43:58.317 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python3-google-auth. 2024-04-17T19:43:58.339 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../089-python3-google-auth_1.5.1-3_all.deb ... 2024-04-17T19:43:58.408 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python3-google-auth (1.5.1-3) ... 2024-04-17T19:43:58.420 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-17T19:43:58.554 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up python3-toml (0.10.2-1) ... 2024-04-17T19:43:58.762 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python3-requests-oauthlib. 2024-04-17T19:43:58.783 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../090-python3-requests-oauthlib_1.3.0+ds-0.1_all.deb ... 2024-04-17T19:43:58.828 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-04-17T19:43:58.830 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up librdkafka1:amd64 (1.8.0-1build1) ... 2024-04-17T19:43:58.956 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up xmlstarlet (1.6.1-2.1) ... 2024-04-17T19:43:59.107 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-04-17T19:43:59.131 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python3-websocket. 2024-04-17T19:43:59.153 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../091-python3-websocket_1.2.3-1_all.deb ... 2024-04-17T19:43:59.189 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python3-websocket (1.2.3-1) ... 2024-04-17T19:43:59.425 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up python3-pluggy (0.13.0-7.1) ... 2024-04-17T19:43:59.543 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python3-kubernetes. 2024-04-17T19:43:59.564 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../092-python3-kubernetes_12.0.1-1ubuntu1_all.deb ... 2024-04-17T19:43:59.609 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python3-kubernetes (12.0.1-1ubuntu1) ... 2024-04-17T19:43:59.702 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up python3-zc.lockfile (2.0-1) ... 2024-04-17T19:43:59.945 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-17T19:44:00.071 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up python3-pyasn1 (0.4.8-1) ... 2024-04-17T19:44:00.356 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2024-04-17T19:44:00.370 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../093-ceph-mgr-k8sevents_19.0.0-3146-gf3a98d3f-1jammy_all.deb ... 2024-04-17T19:44:00.389 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up python3-singledispatch (3.4.0.3-3) ... 2024-04-17T19:44:00.414 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking ceph-mgr-k8sevents (19.0.0-3146-gf3a98d3f-1jammy) ... 2024-04-17T19:44:00.657 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up python3-logutils (0.3.3-8) ... 2024-04-17T19:44:00.709 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package libonig5:amd64. 2024-04-17T19:44:00.730 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../094-libonig5_6.9.7.1-2build1_amd64.deb ... 2024-04-17T19:44:00.766 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking libonig5:amd64 (6.9.7.1-2build1) ... 2024-04-17T19:44:00.933 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up python3-tempora (4.1.2-1) ... 2024-04-17T19:44:01.111 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package libjq1:amd64. 2024-04-17T19:44:01.133 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../095-libjq1_1.6-2.1ubuntu3_amd64.deb ... 2024-04-17T19:44:01.178 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-04-17T19:44:01.209 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2024-04-17T19:44:01.485 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up python3-prettytable (2.5.0-2) ... 2024-04-17T19:44:01.771 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package jq. 2024-04-17T19:44:01.793 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../096-jq_1.6-2.1ubuntu3_amd64.deb ... 2024-04-17T19:44:01.795 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-04-17T19:44:01.839 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking jq (1.6-2.1ubuntu3) ... 2024-04-17T19:44:01.896 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up python3-websocket (1.2.3-1) ... 2024-04-17T19:44:02.108 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package socat. 2024-04-17T19:44:02.130 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../097-socat_1.7.4.1-3ubuntu4_amd64.deb ... 2024-04-17T19:44:02.172 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up libonig5:amd64 (6.9.7.1-2build1) ... 2024-04-17T19:44:02.174 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking socat (1.7.4.1-3ubuntu4) ... 2024-04-17T19:44:02.298 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-04-17T19:44:02.511 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package xmlstarlet. 2024-04-17T19:44:02.533 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../098-xmlstarlet_1.6.1-2.1_amd64.deb ... 2024-04-17T19:44:02.577 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking xmlstarlet (1.6.1-2.1) ... 2024-04-17T19:44:02.749 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up python3-webob (1:1.8.6-1.1) ... 2024-04-17T19:44:02.981 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package ceph-test. 2024-04-17T19:44:02.995 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../099-ceph-test_19.0.0-3146-gf3a98d3f-1jammy_amd64.deb ... 2024-04-17T19:44:03.039 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking ceph-test (19.0.0-3146-gf3a98d3f-1jammy) ... 2024-04-17T19:44:03.100 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up python3-jaraco.collections (3.4.0-2) ... 2024-04-17T19:44:03.368 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-04-17T19:44:03.469 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up lua-sec:amd64 (1.0.2-1) ... 2024-04-17T19:44:03.570 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up python3-babel (2.8.0+dfsg.1-7) ... 2024-04-17T19:44:03.642 INFO:teuthology.orchestra.run.smithi044.stdout:update-alternatives: using /usr/bin/pybabel-python3 to provide /usr/bin/pybabel (pybabel) in auto mode 2024-04-17T19:44:03.897 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-04-17T19:44:04.023 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up python3-pytest (6.2.5-1ubuntu2) ... 2024-04-17T19:44:04.458 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up python3-pastedeploy (2.1.1-1) ... 2024-04-17T19:44:04.726 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up lua-any (27ubuntu1) ... 2024-04-17T19:44:04.836 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up python3-portend (3.0.0-1) ... 2024-04-17T19:44:05.078 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-17T19:44:05.180 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up python3-jinja2 (3.0.3-1ubuntu0.1) ... 2024-04-17T19:44:05.506 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up python3-pyasn1-modules (0.2.1-1) ... 2024-04-17T19:44:05.510 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package ceph-volume. 2024-04-17T19:44:05.533 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../100-ceph-volume_19.0.0-3146-gf3a98d3f-1jammy_all.deb ... 2024-04-17T19:44:05.600 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking ceph-volume (19.0.0-3146-gf3a98d3f-1jammy) ... 2024-04-17T19:44:05.824 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-04-17T19:44:06.031 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package cephfs-mirror. 2024-04-17T19:44:06.054 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../101-cephfs-mirror_19.0.0-3146-gf3a98d3f-1jammy_amd64.deb ... 2024-04-17T19:44:06.098 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking cephfs-mirror (19.0.0-3146-gf3a98d3f-1jammy) ... 2024-04-17T19:44:06.125 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up jq (1.6-2.1ubuntu3) ... 2024-04-17T19:44:06.319 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up python3-rsa (4.8-1) ... 2024-04-17T19:44:06.459 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python3-colorama. 2024-04-17T19:44:06.481 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../102-python3-colorama_0.4.4-1_all.deb ... 2024-04-17T19:44:06.525 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python3-colorama (0.4.4-1) ... 2024-04-17T19:44:06.596 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up python3-webtest (2.0.35-1) ... 2024-04-17T19:44:06.828 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package cephfs-shell. 2024-04-17T19:44:06.850 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../103-cephfs-shell_19.0.0-3146-gf3a98d3f-1jammy_all.deb ... 2024-04-17T19:44:06.855 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-04-17T19:44:06.886 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking cephfs-shell (19.0.0-3146-gf3a98d3f-1jammy) ... 2024-04-17T19:44:07.132 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up python3-cherrypy3 (18.6.1-4) ... 2024-04-17T19:44:07.180 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package cephfs-top. 2024-04-17T19:44:07.193 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../104-cephfs-top_19.0.0-3146-gf3a98d3f-1jammy_all.deb ... 2024-04-17T19:44:07.230 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking cephfs-top (19.0.0-3146-gf3a98d3f-1jammy) ... 2024-04-17T19:44:07.516 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package libcephfs-dev. 2024-04-17T19:44:07.525 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up python3-pastescript (2.0.2-4) ... 2024-04-17T19:44:07.538 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../105-libcephfs-dev_19.0.0-3146-gf3a98d3f-1jammy_amd64.deb ... 2024-04-17T19:44:07.582 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking libcephfs-dev (19.0.0-3146-gf3a98d3f-1jammy) ... 2024-04-17T19:44:07.835 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up python3-pecan (1.3.3-4ubuntu2) ... 2024-04-17T19:44:07.919 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package lua-socket:amd64. 2024-04-17T19:44:07.940 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../106-lua-socket_3.0~rc1+git+ac3201d-6_amd64.deb ... 2024-04-17T19:44:07.985 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-04-17T19:44:08.196 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-04-17T19:44:08.339 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up librados2 (19.0.0-3146-gf3a98d3f-1jammy) ... 2024-04-17T19:44:08.373 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package lua-sec:amd64. 2024-04-17T19:44:08.395 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../107-lua-sec_1.0.2-1_amd64.deb ... 2024-04-17T19:44:08.464 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking lua-sec:amd64 (1.0.2-1) ... 2024-04-17T19:44:08.465 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up libsqlite3-mod-ceph (19.0.0-3146-gf3a98d3f-1jammy) ... 2024-04-17T19:44:08.591 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up luarocks (3.8.0+dfsg1-1) ... 2024-04-17T19:44:08.844 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package nvme-cli. 2024-04-17T19:44:08.865 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../108-nvme-cli_1.16-3ubuntu0.1_amd64.deb ... 2024-04-17T19:44:08.901 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking nvme-cli (1.16-3ubuntu0.1) ... 2024-04-17T19:44:08.919 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up libcephfs2 (19.0.0-3146-gf3a98d3f-1jammy) ... 2024-04-17T19:44:09.079 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up libradosstriper1 (19.0.0-3146-gf3a98d3f-1jammy) ... 2024-04-17T19:44:09.204 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up python3-google-auth (1.5.1-3) ... 2024-04-17T19:44:09.315 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package pkg-config. 2024-04-17T19:44:09.337 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../109-pkg-config_0.29.2-1ubuntu3_amd64.deb ... 2024-04-17T19:44:09.381 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking pkg-config (0.29.2-1ubuntu3) ... 2024-04-17T19:44:09.506 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up librbd1 (19.0.0-3146-gf3a98d3f-1jammy) ... 2024-04-17T19:44:09.632 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up ceph-mgr-modules-core (19.0.0-3146-gf3a98d3f-1jammy) ... 2024-04-17T19:44:09.676 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python-asyncssh-doc. 2024-04-17T19:44:09.689 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../110-python-asyncssh-doc_2.5.0-1_all.deb ... 2024-04-17T19:44:09.725 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python-asyncssh-doc (2.5.0-1) ... 2024-04-17T19:44:09.758 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up ceph-fuse (19.0.0-3146-gf3a98d3f-1jammy) ... 2024-04-17T19:44:09.978 INFO:teuthology.orchestra.run.smithi044.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-04-17T19:44:09.978 INFO:teuthology.orchestra.run.smithi044.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-04-17T19:44:10.221 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python3-iniconfig. 2024-04-17T19:44:10.243 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../111-python3-iniconfig_1.1.1-2_all.deb ... 2024-04-17T19:44:10.320 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python3-iniconfig (1.1.1-2) ... 2024-04-17T19:44:10.602 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up libcephfs-dev (19.0.0-3146-gf3a98d3f-1jammy) ... 2024-04-17T19:44:10.657 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python3-pastescript. 2024-04-17T19:44:10.679 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../112-python3-pastescript_2.0.2-4_all.deb ... 2024-04-17T19:44:10.703 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up python3-rados (19.0.0-3146-gf3a98d3f-1jammy) ... 2024-04-17T19:44:10.723 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2024-04-17T19:44:10.804 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up librgw2 (19.0.0-3146-gf3a98d3f-1jammy) ... 2024-04-17T19:44:10.905 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up cephfs-top (19.0.0-3146-gf3a98d3f-1jammy) ... 2024-04-17T19:44:11.031 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up python3-kubernetes (12.0.1-1ubuntu1) ... 2024-04-17T19:44:11.076 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python3-pluggy. 2024-04-17T19:44:11.098 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../113-python3-pluggy_0.13.0-7.1_all.deb ... 2024-04-17T19:44:11.143 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python3-pluggy (0.13.0-7.1) ... 2024-04-17T19:44:11.487 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python3-psutil. 2024-04-17T19:44:11.509 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../114-python3-psutil_5.9.0-1build1_amd64.deb ... 2024-04-17T19:44:11.553 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python3-psutil (5.9.0-1build1) ... 2024-04-17T19:44:11.932 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python3-py. 2024-04-17T19:44:11.954 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../115-python3-py_1.10.0-1_all.deb ... 2024-04-17T19:44:11.998 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python3-py (1.10.0-1) ... 2024-04-17T19:44:12.368 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up python3-rbd (19.0.0-3146-gf3a98d3f-1jammy) ... 2024-04-17T19:44:12.393 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python3-pygments. 2024-04-17T19:44:12.416 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../116-python3-pygments_2.11.2+dfsg-2_all.deb ... 2024-04-17T19:44:12.460 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python3-pygments (2.11.2+dfsg-2) ... 2024-04-17T19:44:12.478 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up rbd-fuse (19.0.0-3146-gf3a98d3f-1jammy) ... 2024-04-17T19:44:12.579 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up python3-rgw (19.0.0-3146-gf3a98d3f-1jammy) ... 2024-04-17T19:44:12.680 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up python3-cephfs (19.0.0-3146-gf3a98d3f-1jammy) ... 2024-04-17T19:44:12.823 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up cephfs-shell (19.0.0-3146-gf3a98d3f-1jammy) ... 2024-04-17T19:44:12.949 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up ceph-common (19.0.0-3146-gf3a98d3f-1jammy) ... 2024-04-17T19:44:12.964 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python3-pyinotify. 2024-04-17T19:44:12.986 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../117-python3-pyinotify_0.9.6-1.3_all.deb ... 2024-04-17T19:44:13.030 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python3-pyinotify (0.9.6-1.3) ... 2024-04-17T19:44:13.366 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python3-toml. 2024-04-17T19:44:13.388 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../118-python3-toml_0.10.2-1_all.deb ... 2024-04-17T19:44:13.458 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python3-toml (0.10.2-1) ... 2024-04-17T19:44:13.511 INFO:teuthology.orchestra.run.smithi044.stdout:Adding group ceph....done 2024-04-17T19:44:13.736 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python3-pytest. 2024-04-17T19:44:13.757 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../119-python3-pytest_6.2.5-1ubuntu2_all.deb ... 2024-04-17T19:44:13.827 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python3-pytest (6.2.5-1ubuntu2) ... 2024-04-17T19:44:13.895 INFO:teuthology.orchestra.run.smithi044.stdout:Adding system user ceph....done 2024-04-17T19:44:14.090 INFO:teuthology.orchestra.run.smithi044.stdout:Setting system user ceph properties....done 2024-04-17T19:44:14.106 INFO:teuthology.orchestra.run.smithi044.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2024-04-17T19:44:14.197 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python3-simplejson. 2024-04-17T19:44:14.219 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../120-python3-simplejson_3.17.6-1build1_amd64.deb ... 2024-04-17T19:44:14.259 INFO:teuthology.orchestra.run.smithi044.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2024-04-17T19:44:14.263 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python3-simplejson (3.17.6-1build1) ... 2024-04-17T19:44:14.558 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package qttranslations5-l10n. 2024-04-17T19:44:14.580 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../121-qttranslations5-l10n_5.15.3-1_all.deb ... 2024-04-17T19:44:14.616 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking qttranslations5-l10n (5.15.3-1) ... 2024-04-17T19:44:14.679 INFO:teuthology.orchestra.run.smithi044.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2024-04-17T19:44:15.453 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package radosgw. 2024-04-17T19:44:15.475 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../122-radosgw_19.0.0-3146-gf3a98d3f-1jammy_amd64.deb ... 2024-04-17T19:44:15.484 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up cephfs-mirror (19.0.0-3146-gf3a98d3f-1jammy) ... 2024-04-17T19:44:15.519 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking radosgw (19.0.0-3146-gf3a98d3f-1jammy) ... 2024-04-17T19:44:15.694 INFO:teuthology.orchestra.run.smithi044.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2024-04-17T19:44:15.694 INFO:teuthology.orchestra.run.smithi044.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2024-04-17T19:44:16.328 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up ceph-test (19.0.0-3146-gf3a98d3f-1jammy) ... 2024-04-17T19:44:16.454 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up radosgw (19.0.0-3146-gf3a98d3f-1jammy) ... 2024-04-17T19:44:16.590 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package rbd-fuse. 2024-04-17T19:44:16.612 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../123-rbd-fuse_19.0.0-3146-gf3a98d3f-1jammy_amd64.deb ... 2024-04-17T19:44:16.656 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking rbd-fuse (19.0.0-3146-gf3a98d3f-1jammy) ... 2024-04-17T19:44:16.990 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python3-iniconfig (1.1.1-2) ... 2024-04-17T19:44:17.025 INFO:teuthology.orchestra.run.smithi044.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-04-17T19:44:17.025 INFO:teuthology.orchestra.run.smithi044.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-04-17T19:44:17.664 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up ceph-base (19.0.0-3146-gf3a98d3f-1jammy) ... 2024-04-17T19:44:17.669 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up libdouble-conversion3:amd64 (3.1.7-4) ... 2024-04-17T19:44:17.787 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up nvme-cli (1.16-3ubuntu0.1) ... 2024-04-17T19:44:18.052 INFO:teuthology.orchestra.run.smithi044.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2024-04-17T19:44:18.093 INFO:teuthology.orchestra.run.smithi062.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service -> /lib/systemd/system/nvmefc-boot-connections.service. 2024-04-17T19:44:18.477 INFO:teuthology.orchestra.run.smithi062.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmf-autoconnect.service -> /lib/systemd/system/nvmf-autoconnect.service. 2024-04-17T19:44:18.930 INFO:teuthology.orchestra.run.smithi062.stdout:nvmf-connect.target is a disabled or a static unit, not starting it. 2024-04-17T19:44:19.048 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up cephadm (19.0.0-3146-gf3a98d3f-1jammy) ... 2024-04-17T19:44:19.153 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up ceph-mds (19.0.0-3146-gf3a98d3f-1jammy) ... 2024-04-17T19:44:19.382 INFO:teuthology.orchestra.run.smithi044.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-04-17T19:44:19.383 INFO:teuthology.orchestra.run.smithi044.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-04-17T19:44:19.767 INFO:teuthology.orchestra.run.smithi062.stdout:Adding system user cephadm....done 2024-04-17T19:44:19.928 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python3-waitress (1.4.4-1.1ubuntu1) ... 2024-04-17T19:44:20.047 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up ceph-mgr (19.0.0-3146-gf3a98d3f-1jammy) ... 2024-04-17T19:44:20.204 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python3-jaraco.classes (3.2.1-3) ... 2024-04-17T19:44:20.266 INFO:teuthology.orchestra.run.smithi044.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-04-17T19:44:20.266 INFO:teuthology.orchestra.run.smithi044.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-04-17T19:44:20.597 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python-asyncssh-doc (2.5.0-1) ... 2024-04-17T19:44:20.723 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python3-jaraco.functools (3.4.0-2) ... 2024-04-17T19:44:20.923 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up ceph-osd (19.0.0-3146-gf3a98d3f-1jammy) ... 2024-04-17T19:44:21.007 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python3-repoze.lru (0.7-2) ... 2024-04-17T19:44:21.249 INFO:teuthology.orchestra.run.smithi044.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-04-17T19:44:21.250 INFO:teuthology.orchestra.run.smithi044.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-04-17T19:44:21.267 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up liboath0:amd64 (2.6.7-3build1) ... 2024-04-17T19:44:21.393 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python3-py (1.10.0-1) ... 2024-04-17T19:44:21.753 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python3-joblib (0.17.0-4ubuntu1) ... 2024-04-17T19:44:21.908 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up ceph-mgr-k8sevents (19.0.0-3146-gf3a98d3f-1jammy) ... 2024-04-17T19:44:22.034 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up ceph-mgr-diskprediction-local (19.0.0-3146-gf3a98d3f-1jammy) ... 2024-04-17T19:44:22.138 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python3-cachetools (5.0.0-1) ... 2024-04-17T19:44:22.185 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up ceph-mon (19.0.0-3146-gf3a98d3f-1jammy) ... 2024-04-17T19:44:22.402 INFO:teuthology.orchestra.run.smithi044.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-04-17T19:44:22.402 INFO:teuthology.orchestra.run.smithi044.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-04-17T19:44:22.431 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python3-colorama (0.4.4-1) ... 2024-04-17T19:44:22.691 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python3-openssl (21.0.0-1) ... 2024-04-17T19:44:22.984 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up unzip (6.0-26ubuntu3.2) ... 2024-04-17T19:44:23.028 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up ceph-mgr-cephadm (19.0.0-3146-gf3a98d3f-1jammy) ... 2024-04-17T19:44:23.162 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up ceph (19.0.0-3146-gf3a98d3f-1jammy) ... 2024-04-17T19:44:23.288 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up ceph-mgr-dashboard (19.0.0-3146-gf3a98d3f-1jammy) ... 2024-04-17T19:44:23.353 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python3-bcrypt (3.2.0-1build1) ... 2024-04-17T19:44:23.431 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up ceph-volume (19.0.0-3146-gf3a98d3f-1jammy) ... 2024-04-17T19:44:23.603 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python3-pyinotify (0.9.6-1.3) ... 2024-04-17T19:44:23.809 INFO:teuthology.orchestra.run.smithi044.stdout:Processing triggers for mailcap (3.70+nmu1ubuntu1) ... 2024-04-17T19:44:23.896 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python3-threadpoolctl (3.1.0-1) ... 2024-04-17T19:44:23.910 INFO:teuthology.orchestra.run.smithi044.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-04-17T19:44:24.062 INFO:teuthology.orchestra.run.smithi044.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-04-17T19:44:24.164 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python3-ceph-argparse (19.0.0-3146-gf3a98d3f-1jammy) ... 2024-04-17T19:44:24.431 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-04-17T19:44:24.557 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-04-17T19:44:24.683 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python3-pyperclip (1.8.2-2) ... 2024-04-17T19:44:24.976 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up libreadline-dev:amd64 (8.1.2-1) ... 2024-04-17T19:44:25.127 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python3-markupsafe (2.0.1-2build1) ... 2024-04-17T19:44:25.322 INFO:teuthology.orchestra.run.smithi044.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-04-17T19:44:25.386 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up lua5.1 (5.1.5-8.1build4) ... 2024-04-17T19:44:25.785 INFO:teuthology.orchestra.run.smithi062.stdout:update-alternatives: using /usr/bin/lua5.1 to provide /usr/bin/lua (lua-interpreter) in auto mode 2024-04-17T19:44:25.843 INFO:teuthology.orchestra.run.smithi062.stdout:update-alternatives: using /usr/bin/luac5.1 to provide /usr/bin/luac (lua-compiler) in auto mode 2024-04-17T19:44:25.915 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-04-17T19:44:26.033 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python3-psutil (5.9.0-1build1) ... 2024-04-17T19:44:26.067 INFO:teuthology.orchestra.run.smithi044.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-04-17T19:44:26.071 DEBUG:teuthology.orchestra.run.smithi044:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install bison flex libelf-dev libssl-dev network-manager iproute2 util-linux dump indent libaio-dev libtool-bin uuid-dev xfslibs-dev postgresql postgresql-client postgresql-common postgresql-contrib 2024-04-17T19:44:26.147 INFO:teuthology.orchestra.run.smithi044.stdout:Reading package lists... 2024-04-17T19:44:26.323 INFO:teuthology.orchestra.run.smithi044.stdout:Building dependency tree... 2024-04-17T19:44:26.324 INFO:teuthology.orchestra.run.smithi044.stdout:Reading state information... 2024-04-17T19:44:26.384 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-04-17T19:44:26.499 INFO:teuthology.orchestra.run.smithi044.stdout:iproute2 is already the newest version (5.15.0-1ubuntu2). 2024-04-17T19:44:26.499 INFO:teuthology.orchestra.run.smithi044.stdout:libtool-bin is already the newest version (2.4.6-15build2). 2024-04-17T19:44:26.499 INFO:teuthology.orchestra.run.smithi044.stdout:xfslibs-dev is already the newest version (5.13.0-1ubuntu2). 2024-04-17T19:44:26.499 INFO:teuthology.orchestra.run.smithi044.stdout:The following packages were automatically installed and are no longer required: 2024-04-17T19:44:26.500 INFO:teuthology.orchestra.run.smithi044.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-04-17T19:44:26.500 INFO:teuthology.orchestra.run.smithi044.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-04-17T19:44:26.500 INFO:teuthology.orchestra.run.smithi044.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-04-17T19:44:26.500 INFO:teuthology.orchestra.run.smithi044.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-04-17T19:44:26.501 INFO:teuthology.orchestra.run.smithi044.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-04-17T19:44:26.501 INFO:teuthology.orchestra.run.smithi044.stdout:Use 'sudo apt autoremove' to remove them. 2024-04-17T19:44:26.501 INFO:teuthology.orchestra.run.smithi044.stdout:The following additional packages will be installed: 2024-04-17T19:44:26.501 INFO:teuthology.orchestra.run.smithi044.stdout: libbluetooth3 libfl-dev libfl2 libjson-perl libllvm14 liblzo2-2 2024-04-17T19:44:26.501 INFO:teuthology.orchestra.run.smithi044.stdout: libmbim-glib4 libmbim-proxy libmm-glib0 libndp0 libnm0 libpq5 libqmi-glib5 2024-04-17T19:44:26.501 INFO:teuthology.orchestra.run.smithi044.stdout: libqmi-proxy libssl3 libteamdctl0 libuuid1 modemmanager network-manager-pptp 2024-04-17T19:44:26.501 INFO:teuthology.orchestra.run.smithi044.stdout: postgresql-14 postgresql-client-14 postgresql-client-common ppp pptp-linux 2024-04-17T19:44:26.502 INFO:teuthology.orchestra.run.smithi044.stdout: tcl tcl8.6 usb-modeswitch usb-modeswitch-data wpasupplicant 2024-04-17T19:44:26.502 INFO:teuthology.orchestra.run.smithi044.stdout:Suggested packages: 2024-04-17T19:44:26.502 INFO:teuthology.orchestra.run.smithi044.stdout: bison-doc flex-doc indent-doc libssl-doc avahi-autoipd libteam-utils 2024-04-17T19:44:26.502 INFO:teuthology.orchestra.run.smithi044.stdout: postgresql-doc postgresql-doc-14 tcl-tclreadline comgt wvdial 2024-04-17T19:44:26.502 INFO:teuthology.orchestra.run.smithi044.stdout: util-linux-locales wpagui libengine-pkcs11-openssl 2024-04-17T19:44:26.526 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python3-natsort (8.0.2-1) ... 2024-04-17T19:44:26.559 INFO:teuthology.orchestra.run.smithi044.stdout:The following NEW packages will be installed: 2024-04-17T19:44:26.560 INFO:teuthology.orchestra.run.smithi044.stdout: bison dump flex indent libaio-dev libbluetooth3 libelf-dev libfl-dev libfl2 2024-04-17T19:44:26.560 INFO:teuthology.orchestra.run.smithi044.stdout: libjson-perl libllvm14 liblzo2-2 libmbim-glib4 libmbim-proxy libmm-glib0 2024-04-17T19:44:26.560 INFO:teuthology.orchestra.run.smithi044.stdout: libndp0 libnm0 libpq5 libqmi-glib5 libqmi-proxy libssl-dev libteamdctl0 2024-04-17T19:44:26.560 INFO:teuthology.orchestra.run.smithi044.stdout: modemmanager network-manager network-manager-pptp postgresql postgresql-14 2024-04-17T19:44:26.560 INFO:teuthology.orchestra.run.smithi044.stdout: postgresql-client postgresql-client-14 postgresql-client-common 2024-04-17T19:44:26.560 INFO:teuthology.orchestra.run.smithi044.stdout: postgresql-common postgresql-contrib ppp pptp-linux tcl tcl8.6 2024-04-17T19:44:26.560 INFO:teuthology.orchestra.run.smithi044.stdout: usb-modeswitch usb-modeswitch-data wpasupplicant 2024-04-17T19:44:26.561 INFO:teuthology.orchestra.run.smithi044.stdout:The following packages will be upgraded: 2024-04-17T19:44:26.562 INFO:teuthology.orchestra.run.smithi044.stdout: libssl3 libuuid1 util-linux uuid-dev 2024-04-17T19:44:26.647 INFO:teuthology.orchestra.run.smithi044.stdout:4 upgraded, 39 newly installed, 0 to remove and 301 not upgraded. 2024-04-17T19:44:26.647 INFO:teuthology.orchestra.run.smithi044.stdout:Need to get 55.7 MB of archives. 2024-04-17T19:44:26.647 INFO:teuthology.orchestra.run.smithi044.stdout:After this operation, 202 MB of additional disk space will be used. 2024-04-17T19:44:26.647 INFO:teuthology.orchestra.run.smithi044.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 util-linux amd64 2.37.2-4ubuntu3.4 [1,063 kB] 2024-04-17T19:44:26.794 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python3-routes (2.5.1-1ubuntu1) ... 2024-04-17T19:44:26.891 INFO:teuthology.orchestra.run.smithi044.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy/main amd64 flex amd64 2.6.4-8build2 [307 kB] 2024-04-17T19:44:26.899 INFO:teuthology.orchestra.run.smithi044.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl3 amd64 3.0.2-0ubuntu1.15 [1,905 kB] 2024-04-17T19:44:26.960 INFO:teuthology.orchestra.run.smithi044.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 uuid-dev amd64 2.37.2-4ubuntu3.4 [33.1 kB] 2024-04-17T19:44:26.960 INFO:teuthology.orchestra.run.smithi044.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libuuid1 amd64 2.37.2-4ubuntu3.4 [23.8 kB] 2024-04-17T19:44:26.961 INFO:teuthology.orchestra.run.smithi044.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy/main amd64 bison amd64 2:3.8.2+dfsg-1build1 [748 kB] 2024-04-17T19:44:26.982 INFO:teuthology.orchestra.run.smithi044.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblzo2-2 amd64 2.10-2build3 [53.7 kB] 2024-04-17T19:44:26.983 INFO:teuthology.orchestra.run.smithi044.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy/universe amd64 dump amd64 0.4b47-3 [133 kB] 2024-04-17T19:44:26.985 INFO:teuthology.orchestra.run.smithi044.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 indent amd64 2.2.12-1ubuntu0.22.04.1 [90.8 kB] 2024-04-17T19:44:26.986 INFO:teuthology.orchestra.run.smithi044.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy/main amd64 libaio-dev amd64 0.3.112-13build1 [21.2 kB] 2024-04-17T19:44:26.987 INFO:teuthology.orchestra.run.smithi044.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libbluetooth3 amd64 5.64-0ubuntu1.1 [87.0 kB] 2024-04-17T19:44:26.988 INFO:teuthology.orchestra.run.smithi044.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/main amd64 libelf-dev amd64 0.186-1build1 [64.4 kB] 2024-04-17T19:44:27.008 INFO:teuthology.orchestra.run.smithi044.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl2 amd64 2.6.4-8build2 [10.7 kB] 2024-04-17T19:44:27.009 INFO:teuthology.orchestra.run.smithi044.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl-dev amd64 2.6.4-8build2 [6,236 B] 2024-04-17T19:44:27.009 INFO:teuthology.orchestra.run.smithi044.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjson-perl all 4.04000-1 [81.8 kB] 2024-04-17T19:44:27.043 INFO:teuthology.orchestra.run.smithi044.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libllvm14 amd64 1:14.0.0-1ubuntu1.1 [24.0 MB] 2024-04-17T19:44:27.103 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python3-simplejson (3.17.6-1build1) ... 2024-04-17T19:44:27.463 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up zip (3.0-12build2) ... 2024-04-17T19:44:27.471 INFO:teuthology.orchestra.run.smithi044.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-glib4 amd64 1.28.0-1~ubuntu20.04.1 [191 kB] 2024-04-17T19:44:27.473 INFO:teuthology.orchestra.run.smithi044.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-proxy amd64 1.28.0-1~ubuntu20.04.1 [6,130 B] 2024-04-17T19:44:27.473 INFO:teuthology.orchestra.run.smithi044.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmm-glib0 amd64 1.20.0-1~ubuntu22.04.3 [263 kB] 2024-04-17T19:44:27.476 INFO:teuthology.orchestra.run.smithi044.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy/main amd64 libndp0 amd64 1.8-0ubuntu3 [12.3 kB] 2024-04-17T19:44:27.476 INFO:teuthology.orchestra.run.smithi044.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libnm0 amd64 1.36.6-0ubuntu2 [456 kB] 2024-04-17T19:44:27.481 INFO:teuthology.orchestra.run.smithi044.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpq5 amd64 14.11-0ubuntu0.22.04.1 [144 kB] 2024-04-17T19:44:27.483 INFO:teuthology.orchestra.run.smithi044.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-glib5 amd64 1.32.0-1ubuntu0.22.04.1 [772 kB] 2024-04-17T19:44:27.490 INFO:teuthology.orchestra.run.smithi044.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-proxy amd64 1.32.0-1ubuntu0.22.04.1 [6,072 B] 2024-04-17T19:44:27.491 INFO:teuthology.orchestra.run.smithi044.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl-dev amd64 3.0.2-0ubuntu1.15 [2,376 kB] 2024-04-17T19:44:27.523 INFO:teuthology.orchestra.run.smithi044.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 libteamdctl0 amd64 1.31-1build2 [12.6 kB] 2024-04-17T19:44:27.529 INFO:teuthology.orchestra.run.smithi044.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 modemmanager amd64 1.20.0-1~ubuntu22.04.3 [1,094 kB] 2024-04-17T19:44:27.544 INFO:teuthology.orchestra.run.smithi044.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 network-manager amd64 1.36.6-0ubuntu2 [2,203 kB] 2024-04-17T19:44:27.578 INFO:teuthology.orchestra.run.smithi044.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 ppp amd64 2.4.9-1+1ubuntu3 [363 kB] 2024-04-17T19:44:27.582 INFO:teuthology.orchestra.run.smithi044.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/main amd64 pptp-linux amd64 1.10.0-1build3 [42.5 kB] 2024-04-17T19:44:27.582 INFO:teuthology.orchestra.run.smithi044.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 network-manager-pptp amd64 1.2.10-1 [30.9 kB] 2024-04-17T19:44:27.583 INFO:teuthology.orchestra.run.smithi044.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client-common all 238 [29.6 kB] 2024-04-17T19:44:27.584 INFO:teuthology.orchestra.run.smithi044.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-client-14 amd64 14.11-0ubuntu0.22.04.1 [1,222 kB] 2024-04-17T19:44:27.598 INFO:teuthology.orchestra.run.smithi044.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-common all 238 [169 kB] 2024-04-17T19:44:27.608 INFO:teuthology.orchestra.run.smithi044.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-14 amd64 14.11-0ubuntu0.22.04.1 [16.2 MB] 2024-04-17T19:44:27.631 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python3-pygments (2.11.2+dfsg-2) ... 2024-04-17T19:44:27.848 INFO:teuthology.orchestra.run.smithi044.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql all 14+238 [3,288 B] 2024-04-17T19:44:27.848 INFO:teuthology.orchestra.run.smithi044.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client all 14+238 [3,292 B] 2024-04-17T19:44:27.848 INFO:teuthology.orchestra.run.smithi044.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-contrib all 14+238 [3,292 B] 2024-04-17T19:44:27.849 INFO:teuthology.orchestra.run.smithi044.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl8.6 amd64 8.6.12+dfsg-1build1 [15.0 kB] 2024-04-17T19:44:27.849 INFO:teuthology.orchestra.run.smithi044.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl amd64 8.6.11+1build2 [4,678 B] 2024-04-17T19:44:27.849 INFO:teuthology.orchestra.run.smithi044.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 wpasupplicant amd64 2:2.10-6ubuntu2 [1,481 kB] 2024-04-17T19:44:27.867 INFO:teuthology.orchestra.run.smithi044.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch-data all 20191128-4 [33.2 kB] 2024-04-17T19:44:27.868 INFO:teuthology.orchestra.run.smithi044.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch amd64 2.6.1-3ubuntu2 [46.0 kB] 2024-04-17T19:44:28.262 INFO:teuthology.orchestra.run.smithi044.stdout:Preconfiguring packages ... 2024-04-17T19:44:28.341 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python3-tempita (0.5.2-6ubuntu1) ... 2024-04-17T19:44:28.413 INFO:teuthology.orchestra.run.smithi044.stdout:Fetched 55.7 MB in 1s (43.0 MB/s) 2024-04-17T19:44:28.626 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python-pastedeploy-tpl (2.1.1-1) ... 2024-04-17T19:44:28.703 INFO:teuthology.orchestra.run.smithi044.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 140922 files and directories currently installed.) 2024-04-17T19:44:28.707 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../util-linux_2.37.2-4ubuntu3.4_amd64.deb ... 2024-04-17T19:44:28.751 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up qttranslations5-l10n (5.15.3-1) ... 2024-04-17T19:44:28.845 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking util-linux (2.37.2-4ubuntu3.4) over (2.37.2-4ubuntu3) ... 2024-04-17T19:44:28.877 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python3-wcwidth (0.2.5+dfsg1-1) ... 2024-04-17T19:44:29.212 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python3-asyncssh (2.5.0-1) ... 2024-04-17T19:44:29.515 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up util-linux (2.37.2-4ubuntu3.4) ... 2024-04-17T19:44:29.638 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python3-certifi (2020.6.20-1) ... 2024-04-17T19:44:29.940 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python3-paste (3.5.0+dfsg1-1) ... 2024-04-17T19:44:30.391 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-04-17T19:44:30.636 INFO:teuthology.orchestra.run.smithi044.stdout:fstrim.service is a disabled or a static unit not running, not starting it. 2024-04-17T19:44:30.667 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python3-cmd2 (2.3.3-1) ... 2024-04-17T19:44:30.910 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package flex. 2024-04-17T19:44:30.981 INFO:teuthology.orchestra.run.smithi044.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 140922 files and directories currently installed.) 2024-04-17T19:44:30.985 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../flex_2.6.4-8build2_amd64.deb ... 2024-04-17T19:44:31.001 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2024-04-17T19:44:31.025 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking flex (2.6.4-8build2) ... 2024-04-17T19:44:31.378 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python3-jaraco.text (3.6.0-2) ... 2024-04-17T19:44:31.662 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../libssl3_3.0.2-0ubuntu1.15_amd64.deb ... 2024-04-17T19:44:31.679 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up socat (1.7.4.1-3ubuntu4) ... 2024-04-17T19:44:31.839 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking libssl3:amd64 (3.0.2-0ubuntu1.15) over (3.0.2-0ubuntu1.7) ... 2024-04-17T19:44:31.847 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python3-ceph-common (19.0.0-3146-gf3a98d3f-1jammy) ... 2024-04-17T19:44:32.173 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python3-idna (3.3-1) ... 2024-04-17T19:44:32.224 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up libssl3:amd64 (3.0.2-0ubuntu1.15) ... 2024-04-17T19:44:32.516 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python3-sklearn (0.23.2-5ubuntu6) ... 2024-04-17T19:44:32.766 INFO:teuthology.orchestra.run.smithi044.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 140995 files and directories currently installed.) 2024-04-17T19:44:32.770 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../uuid-dev_2.37.2-4ubuntu3.4_amd64.deb ... 2024-04-17T19:44:32.922 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking uuid-dev:amd64 (2.37.2-4ubuntu3.4) over (2.37.2-4ubuntu3) ... 2024-04-17T19:44:33.294 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../libuuid1_2.37.2-4ubuntu3.4_amd64.deb ... 2024-04-17T19:44:33.429 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking libuuid1:amd64 (2.37.2-4ubuntu3.4) over (2.37.2-4ubuntu3) ... 2024-04-17T19:44:33.705 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up pkg-config (0.29.2-1ubuntu3) ... 2024-04-17T19:44:33.746 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up libuuid1:amd64 (2.37.2-4ubuntu3.4) ... 2024-04-17T19:44:33.965 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-17T19:44:34.083 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python3-toml (0.10.2-1) ... 2024-04-17T19:44:34.133 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package bison. 2024-04-17T19:44:34.213 INFO:teuthology.orchestra.run.smithi044.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 140995 files and directories currently installed.) 2024-04-17T19:44:34.217 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../00-bison_2%3a3.8.2+dfsg-1build1_amd64.deb ... 2024-04-17T19:44:34.266 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking bison (2:3.8.2+dfsg-1build1) ... 2024-04-17T19:44:34.334 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up librdkafka1:amd64 (1.8.0-1build1) ... 2024-04-17T19:44:34.451 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up xmlstarlet (1.6.1-2.1) ... 2024-04-17T19:44:34.611 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-04-17T19:44:34.650 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package liblzo2-2:amd64. 2024-04-17T19:44:34.665 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../01-liblzo2-2_2.10-2build3_amd64.deb ... 2024-04-17T19:44:34.708 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking liblzo2-2:amd64 (2.10-2build3) ... 2024-04-17T19:44:34.912 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python3-pluggy (0.13.0-7.1) ... 2024-04-17T19:44:34.987 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package dump. 2024-04-17T19:44:35.003 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../02-dump_0.4b47-3_amd64.deb ... 2024-04-17T19:44:35.044 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking dump (0.4b47-3) ... 2024-04-17T19:44:35.196 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python3-zc.lockfile (2.0-1) ... 2024-04-17T19:44:35.323 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package indent. 2024-04-17T19:44:35.340 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../03-indent_2.2.12-1ubuntu0.22.04.1_amd64.deb ... 2024-04-17T19:44:35.390 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking indent (2.2.12-1ubuntu0.22.04.1) ... 2024-04-17T19:44:35.481 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-17T19:44:35.599 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python3-pyasn1 (0.4.8-1) ... 2024-04-17T19:44:35.651 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package libaio-dev:amd64. 2024-04-17T19:44:35.667 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../04-libaio-dev_0.3.112-13build1_amd64.deb ... 2024-04-17T19:44:35.709 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking libaio-dev:amd64 (0.3.112-13build1) ... 2024-04-17T19:44:35.917 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python3-singledispatch (3.4.0.3-3) ... 2024-04-17T19:44:35.980 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package libbluetooth3:amd64. 2024-04-17T19:44:35.997 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../05-libbluetooth3_5.64-0ubuntu1.1_amd64.deb ... 2024-04-17T19:44:36.039 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking libbluetooth3:amd64 (5.64-0ubuntu1.1) ... 2024-04-17T19:44:36.218 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python3-logutils (0.3.3-8) ... 2024-04-17T19:44:36.300 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package libelf-dev:amd64. 2024-04-17T19:44:36.316 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../06-libelf-dev_0.186-1build1_amd64.deb ... 2024-04-17T19:44:36.358 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking libelf-dev:amd64 (0.186-1build1) ... 2024-04-17T19:44:36.486 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python3-tempora (4.1.2-1) ... 2024-04-17T19:44:36.695 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package libfl2:amd64. 2024-04-17T19:44:36.711 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../07-libfl2_2.6.4-8build2_amd64.deb ... 2024-04-17T19:44:36.745 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking libfl2:amd64 (2.6.4-8build2) ... 2024-04-17T19:44:36.762 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2024-04-17T19:44:36.981 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package libfl-dev:amd64. 2024-04-17T19:44:36.997 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../08-libfl-dev_2.6.4-8build2_amd64.deb ... 2024-04-17T19:44:37.013 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python3-prettytable (2.5.0-2) ... 2024-04-17T19:44:37.039 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking libfl-dev:amd64 (2.6.4-8build2) ... 2024-04-17T19:44:37.292 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package libjson-perl. 2024-04-17T19:44:37.308 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../09-libjson-perl_4.04000-1_all.deb ... 2024-04-17T19:44:37.314 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-04-17T19:44:37.350 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking libjson-perl (4.04000-1) ... 2024-04-17T19:44:37.465 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python3-websocket (1.2.3-1) ... 2024-04-17T19:44:37.654 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package libllvm14:amd64. 2024-04-17T19:44:37.671 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../10-libllvm14_1%3a14.0.0-1ubuntu1.1_amd64.deb ... 2024-04-17T19:44:37.712 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking libllvm14:amd64 (1:14.0.0-1ubuntu1.1) ... 2024-04-17T19:44:37.733 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up libonig5:amd64 (6.9.7.1-2build1) ... 2024-04-17T19:44:37.859 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-04-17T19:44:38.160 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python3-webob (1:1.8.6-1.1) ... 2024-04-17T19:44:38.511 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python3-jaraco.collections (3.4.0-2) ... 2024-04-17T19:44:38.787 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-04-17T19:44:38.963 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up lua-sec:amd64 (1.0.2-1) ... 2024-04-17T19:44:39.049 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package libmbim-glib4:amd64. 2024-04-17T19:44:39.065 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../11-libmbim-glib4_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2024-04-17T19:44:39.106 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python3-babel (2.8.0+dfsg.1-7) ... 2024-04-17T19:44:39.132 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2024-04-17T19:44:39.220 INFO:teuthology.orchestra.run.smithi062.stdout:update-alternatives: using /usr/bin/pybabel-python3 to provide /usr/bin/pybabel (pybabel) in auto mode 2024-04-17T19:44:39.360 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package libmbim-proxy. 2024-04-17T19:44:39.376 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../12-libmbim-proxy_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2024-04-17T19:44:39.409 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2024-04-17T19:44:39.441 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-04-17T19:44:39.576 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python3-pytest (6.2.5-1ubuntu2) ... 2024-04-17T19:44:39.721 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package libmm-glib0:amd64. 2024-04-17T19:44:39.737 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../13-libmm-glib0_1.20.0-1~ubuntu22.04.3_amd64.deb ... 2024-04-17T19:44:39.779 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.3) ... 2024-04-17T19:44:39.977 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python3-pastedeploy (2.1.1-1) ... 2024-04-17T19:44:40.115 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package libndp0:amd64. 2024-04-17T19:44:40.132 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../14-libndp0_1.8-0ubuntu3_amd64.deb ... 2024-04-17T19:44:40.173 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking libndp0:amd64 (1.8-0ubuntu3) ... 2024-04-17T19:44:40.261 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up lua-any (27ubuntu1) ... 2024-04-17T19:44:40.387 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python3-portend (3.0.0-1) ... 2024-04-17T19:44:40.460 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package libnm0:amd64. 2024-04-17T19:44:40.477 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../15-libnm0_1.36.6-0ubuntu2_amd64.deb ... 2024-04-17T19:44:40.510 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking libnm0:amd64 (1.36.6-0ubuntu2) ... 2024-04-17T19:44:40.663 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-17T19:44:40.789 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python3-jinja2 (3.0.3-1ubuntu0.1) ... 2024-04-17T19:44:40.857 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package libpq5:amd64. 2024-04-17T19:44:40.873 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../16-libpq5_14.11-0ubuntu0.22.04.1_amd64.deb ... 2024-04-17T19:44:40.915 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking libpq5:amd64 (14.11-0ubuntu0.22.04.1) ... 2024-04-17T19:44:41.124 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python3-pyasn1-modules (0.2.1-1) ... 2024-04-17T19:44:41.226 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package libqmi-glib5:amd64. 2024-04-17T19:44:41.243 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../17-libqmi-glib5_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2024-04-17T19:44:41.284 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2024-04-17T19:44:41.425 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-04-17T19:44:41.562 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package libqmi-proxy. 2024-04-17T19:44:41.579 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../18-libqmi-proxy_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2024-04-17T19:44:41.637 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2024-04-17T19:44:41.693 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up jq (1.6-2.1ubuntu3) ... 2024-04-17T19:44:41.890 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package libssl-dev:amd64. 2024-04-17T19:44:41.896 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python3-rsa (4.8-1) ... 2024-04-17T19:44:41.906 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../19-libssl-dev_3.0.2-0ubuntu1.15_amd64.deb ... 2024-04-17T19:44:41.948 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking libssl-dev:amd64 (3.0.2-0ubuntu1.15) ... 2024-04-17T19:44:42.205 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python3-webtest (2.0.35-1) ... 2024-04-17T19:44:42.443 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package libteamdctl0:amd64. 2024-04-17T19:44:42.459 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../20-libteamdctl0_1.31-1build2_amd64.deb ... 2024-04-17T19:44:42.490 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-04-17T19:44:42.493 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking libteamdctl0:amd64 (1.31-1build2) ... 2024-04-17T19:44:42.749 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python3-cherrypy3 (18.6.1-4) ... 2024-04-17T19:44:42.840 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package modemmanager. 2024-04-17T19:44:42.857 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../21-modemmanager_1.20.0-1~ubuntu22.04.3_amd64.deb ... 2024-04-17T19:44:42.913 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking modemmanager (1.20.0-1~ubuntu22.04.3) ... 2024-04-17T19:44:43.126 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python3-pastescript (2.0.2-4) ... 2024-04-17T19:44:43.428 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python3-pecan (1.3.3-4ubuntu2) ... 2024-04-17T19:44:43.519 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package network-manager. 2024-04-17T19:44:43.536 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../22-network-manager_1.36.6-0ubuntu2_amd64.deb ... 2024-04-17T19:44:43.585 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking network-manager (1.36.6-0ubuntu2) ... 2024-04-17T19:44:43.796 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-04-17T19:44:43.916 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up librados2 (19.0.0-3146-gf3a98d3f-1jammy) ... 2024-04-17T19:44:44.017 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up libsqlite3-mod-ceph (19.0.0-3146-gf3a98d3f-1jammy) ... 2024-04-17T19:44:44.177 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up luarocks (3.8.0+dfsg1-1) ... 2024-04-17T19:44:44.193 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package ppp. 2024-04-17T19:44:44.210 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../23-ppp_2.4.9-1+1ubuntu3_amd64.deb ... 2024-04-17T19:44:44.538 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up libcephfs2 (19.0.0-3146-gf3a98d3f-1jammy) ... 2024-04-17T19:44:44.564 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking ppp (2.4.9-1+1ubuntu3) ... 2024-04-17T19:44:44.664 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up libradosstriper1 (19.0.0-3146-gf3a98d3f-1jammy) ... 2024-04-17T19:44:44.823 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python3-google-auth (1.5.1-3) ... 2024-04-17T19:44:44.864 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package pptp-linux. 2024-04-17T19:44:44.880 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../24-pptp-linux_1.10.0-1build3_amd64.deb ... 2024-04-17T19:44:44.914 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking pptp-linux (1.10.0-1build3) ... 2024-04-17T19:44:45.117 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up librbd1 (19.0.0-3146-gf3a98d3f-1jammy) ... 2024-04-17T19:44:45.151 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package network-manager-pptp. 2024-04-17T19:44:45.166 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../25-network-manager-pptp_1.2.10-1_amd64.deb ... 2024-04-17T19:44:45.209 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking network-manager-pptp (1.2.10-1) ... 2024-04-17T19:44:45.251 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up ceph-mgr-modules-core (19.0.0-3146-gf3a98d3f-1jammy) ... 2024-04-17T19:44:45.377 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up ceph-fuse (19.0.0-3146-gf3a98d3f-1jammy) ... 2024-04-17T19:44:45.545 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package postgresql-client-common. 2024-04-17T19:44:45.561 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../26-postgresql-client-common_238_all.deb ... 2024-04-17T19:44:45.603 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking postgresql-client-common (238) ... 2024-04-17T19:44:45.614 INFO:teuthology.orchestra.run.smithi062.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-04-17T19:44:45.615 INFO:teuthology.orchestra.run.smithi062.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-04-17T19:44:45.907 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package postgresql-client-14. 2024-04-17T19:44:45.923 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../27-postgresql-client-14_14.11-0ubuntu0.22.04.1_amd64.deb ... 2024-04-17T19:44:45.965 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking postgresql-client-14 (14.11-0ubuntu0.22.04.1) ... 2024-04-17T19:44:46.171 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up libcephfs-dev (19.0.0-3146-gf3a98d3f-1jammy) ... 2024-04-17T19:44:46.347 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python3-rados (19.0.0-3146-gf3a98d3f-1jammy) ... 2024-04-17T19:44:46.498 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up librgw2 (19.0.0-3146-gf3a98d3f-1jammy) ... 2024-04-17T19:44:46.553 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package postgresql-common. 2024-04-17T19:44:46.570 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../28-postgresql-common_238_all.deb ... 2024-04-17T19:44:46.647 INFO:teuthology.orchestra.run.smithi044.stdout:Adding 'diversion of /usr/bin/pg_config to /usr/bin/pg_config.libpq-dev by postgresql-common' 2024-04-17T19:44:46.657 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up cephfs-top (19.0.0-3146-gf3a98d3f-1jammy) ... 2024-04-17T19:44:46.677 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking postgresql-common (238) ... 2024-04-17T19:44:46.792 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python3-kubernetes (12.0.1-1ubuntu1) ... 2024-04-17T19:44:47.127 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package postgresql-14. 2024-04-17T19:44:47.143 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../29-postgresql-14_14.11-0ubuntu0.22.04.1_amd64.deb ... 2024-04-17T19:44:47.188 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking postgresql-14 (14.11-0ubuntu0.22.04.1) ... 2024-04-17T19:44:48.037 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python3-rbd (19.0.0-3146-gf3a98d3f-1jammy) ... 2024-04-17T19:44:48.188 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up rbd-fuse (19.0.0-3146-gf3a98d3f-1jammy) ... 2024-04-17T19:44:48.365 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python3-rgw (19.0.0-3146-gf3a98d3f-1jammy) ... 2024-04-17T19:44:48.405 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package postgresql. 2024-04-17T19:44:48.421 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../30-postgresql_14+238_all.deb ... 2024-04-17T19:44:48.465 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking postgresql (14+238) ... 2024-04-17T19:44:48.507 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python3-cephfs (19.0.0-3146-gf3a98d3f-1jammy) ... 2024-04-17T19:44:48.633 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up cephfs-shell (19.0.0-3146-gf3a98d3f-1jammy) ... 2024-04-17T19:44:48.691 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package postgresql-client. 2024-04-17T19:44:48.706 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../31-postgresql-client_14+238_all.deb ... 2024-04-17T19:44:48.749 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking postgresql-client (14+238) ... 2024-04-17T19:44:48.809 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up ceph-common (19.0.0-3146-gf3a98d3f-1jammy) ... 2024-04-17T19:44:48.993 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package postgresql-contrib. 2024-04-17T19:44:49.009 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../32-postgresql-contrib_14+238_all.deb ... 2024-04-17T19:44:49.051 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking postgresql-contrib (14+238) ... 2024-04-17T19:44:49.412 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package tcl8.6. 2024-04-17T19:44:49.428 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../33-tcl8.6_8.6.12+dfsg-1build1_amd64.deb ... 2024-04-17T19:44:49.470 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking tcl8.6 (8.6.12+dfsg-1build1) ... 2024-04-17T19:44:49.511 INFO:teuthology.orchestra.run.smithi062.stdout:Adding group ceph....done 2024-04-17T19:44:49.904 INFO:teuthology.orchestra.run.smithi062.stdout:Adding system user ceph....done 2024-04-17T19:44:50.088 INFO:teuthology.orchestra.run.smithi062.stdout:Setting system user ceph properties....done 2024-04-17T19:44:50.104 INFO:teuthology.orchestra.run.smithi062.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2024-04-17T19:44:50.190 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package tcl. 2024-04-17T19:44:50.206 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../34-tcl_8.6.11+1build2_amd64.deb ... 2024-04-17T19:44:50.248 INFO:teuthology.orchestra.run.smithi062.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2024-04-17T19:44:50.252 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking tcl (8.6.11+1build2) ... 2024-04-17T19:44:50.613 INFO:teuthology.orchestra.run.smithi062.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2024-04-17T19:44:50.626 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package wpasupplicant. 2024-04-17T19:44:50.642 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../35-wpasupplicant_2%3a2.10-6ubuntu2_amd64.deb ... 2024-04-17T19:44:50.684 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking wpasupplicant (2:2.10-6ubuntu2) ... 2024-04-17T19:44:51.030 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package usb-modeswitch-data. 2024-04-17T19:44:51.046 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../36-usb-modeswitch-data_20191128-4_all.deb ... 2024-04-17T19:44:51.088 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking usb-modeswitch-data (20191128-4) ... 2024-04-17T19:44:51.162 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up cephfs-mirror (19.0.0-3146-gf3a98d3f-1jammy) ... 2024-04-17T19:44:51.383 INFO:teuthology.orchestra.run.smithi062.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2024-04-17T19:44:51.384 INFO:teuthology.orchestra.run.smithi062.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2024-04-17T19:44:51.449 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package usb-modeswitch. 2024-04-17T19:44:51.466 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../37-usb-modeswitch_2.6.1-3ubuntu2_amd64.deb ... 2024-04-17T19:44:51.508 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking usb-modeswitch (2.6.1-3ubuntu2) ... 2024-04-17T19:44:51.819 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up postgresql-client-common (238) ... 2024-04-17T19:44:51.913 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up ceph-test (19.0.0-3146-gf3a98d3f-1jammy) ... 2024-04-17T19:44:52.030 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up flex (2.6.4-8build2) ... 2024-04-17T19:44:52.039 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up radosgw (19.0.0-3146-gf3a98d3f-1jammy) ... 2024-04-17T19:44:52.157 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up tcl8.6 (8.6.12+dfsg-1build1) ... 2024-04-17T19:44:52.282 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up libpq5:amd64 (14.11-0ubuntu0.22.04.1) ... 2024-04-17T19:44:52.417 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up liblzo2-2:amd64 (2.10-2build3) ... 2024-04-17T19:44:52.534 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up libaio-dev:amd64 (0.3.112-13build1) ... 2024-04-17T19:44:52.537 INFO:teuthology.orchestra.run.smithi062.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-04-17T19:44:52.537 INFO:teuthology.orchestra.run.smithi062.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-04-17T19:44:52.644 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up postgresql-client-14 (14.11-0ubuntu0.22.04.1) ... 2024-04-17T19:44:53.033 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up ceph-base (19.0.0-3146-gf3a98d3f-1jammy) ... 2024-04-17T19:44:53.604 INFO:teuthology.orchestra.run.smithi062.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2024-04-17T19:44:53.609 INFO:teuthology.orchestra.run.smithi044.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/psql.1.gz to provide /usr/share/man/man1/psql.1.gz (psql.1.gz) in auto mode 2024-04-17T19:44:53.716 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up wpasupplicant (2:2.10-6ubuntu2) ... 2024-04-17T19:44:54.103 INFO:teuthology.orchestra.run.smithi044.stdout:Created symlink /etc/systemd/system/dbus-fi.w1.wpa_supplicant1.service -> /lib/systemd/system/wpa_supplicant.service. 2024-04-17T19:44:54.103 INFO:teuthology.orchestra.run.smithi044.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/wpa_supplicant.service -> /lib/systemd/system/wpa_supplicant.service. 2024-04-17T19:44:54.190 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up ceph-mds (19.0.0-3146-gf3a98d3f-1jammy) ... 2024-04-17T19:44:54.463 INFO:teuthology.orchestra.run.smithi062.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-04-17T19:44:54.464 INFO:teuthology.orchestra.run.smithi062.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-04-17T19:44:54.810 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up uuid-dev:amd64 (2.37.2-4ubuntu3.4) ... 2024-04-17T19:44:54.936 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up libteamdctl0:amd64 (1.31-1build2) ... 2024-04-17T19:44:55.038 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up ceph-mgr (19.0.0-3146-gf3a98d3f-1jammy) ... 2024-04-17T19:44:55.063 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up libssl-dev:amd64 (3.0.2-0ubuntu1.15) ... 2024-04-17T19:44:55.189 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up usb-modeswitch-data (20191128-4) ... 2024-04-17T19:44:55.286 INFO:teuthology.orchestra.run.smithi062.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-04-17T19:44:55.286 INFO:teuthology.orchestra.run.smithi062.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-04-17T19:44:55.323 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up libelf-dev:amd64 (0.186-1build1) ... 2024-04-17T19:44:55.466 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up libfl2:amd64 (2.6.4-8build2) ... 2024-04-17T19:44:55.592 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up libnm0:amd64 (1.36.6-0ubuntu2) ... 2024-04-17T19:44:55.718 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up ppp (2.4.9-1+1ubuntu3) ... 2024-04-17T19:44:55.831 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up ceph-osd (19.0.0-3146-gf3a98d3f-1jammy) ... 2024-04-17T19:44:56.147 INFO:teuthology.orchestra.run.smithi062.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-04-17T19:44:56.147 INFO:teuthology.orchestra.run.smithi062.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-04-17T19:44:56.456 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up libllvm14:amd64 (1:14.0.0-1ubuntu1.1) ... 2024-04-17T19:44:56.618 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up dump (0.4b47-3) ... 2024-04-17T19:44:56.666 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up ceph-mgr-k8sevents (19.0.0-3146-gf3a98d3f-1jammy) ... 2024-04-17T19:44:56.719 INFO:teuthology.orchestra.run.smithi044.stdout:update-alternatives: using /usr/sbin/rmt-dump to provide /usr/sbin/rmt (rmt) in auto mode 2024-04-17T19:44:56.784 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.3) ... 2024-04-17T19:44:56.826 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up ceph-mgr-diskprediction-local (19.0.0-3146-gf3a98d3f-1jammy) ... 2024-04-17T19:44:56.910 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up libbluetooth3:amd64 (5.64-0ubuntu1.1) ... 2024-04-17T19:44:56.977 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up ceph-mon (19.0.0-3146-gf3a98d3f-1jammy) ... 2024-04-17T19:44:57.036 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up tcl (8.6.11+1build2) ... 2024-04-17T19:44:57.137 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up libjson-perl (4.04000-1) ... 2024-04-17T19:44:57.210 INFO:teuthology.orchestra.run.smithi062.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-04-17T19:44:57.211 INFO:teuthology.orchestra.run.smithi062.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-04-17T19:44:57.263 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up bison (2:3.8.2+dfsg-1build1) ... 2024-04-17T19:44:57.361 INFO:teuthology.orchestra.run.smithi044.stdout:update-alternatives: using /usr/bin/bison.yacc to provide /usr/bin/yacc (yacc) in auto mode 2024-04-17T19:44:57.440 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up indent (2.2.12-1ubuntu0.22.04.1) ... 2024-04-17T19:44:57.566 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up usb-modeswitch (2.6.1-3ubuntu2) ... 2024-04-17T19:44:57.728 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up ceph-mgr-cephadm (19.0.0-3146-gf3a98d3f-1jammy) ... 2024-04-17T19:44:57.741 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up libndp0:amd64 (1.8-0ubuntu3) ... 2024-04-17T19:44:57.893 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2024-04-17T19:44:57.904 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up ceph (19.0.0-3146-gf3a98d3f-1jammy) ... 2024-04-17T19:44:58.018 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up pptp-linux (1.10.0-1build3) ... 2024-04-17T19:44:58.030 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up ceph-mgr-dashboard (19.0.0-3146-gf3a98d3f-1jammy) ... 2024-04-17T19:44:58.187 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up postgresql-client (14+238) ... 2024-04-17T19:44:58.213 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up ceph-volume (19.0.0-3146-gf3a98d3f-1jammy) ... 2024-04-17T19:44:58.304 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up network-manager (1.36.6-0ubuntu2) ... 2024-04-17T19:44:58.677 INFO:teuthology.orchestra.run.smithi062.stdout:Processing triggers for mailcap (3.70+nmu1ubuntu1) ... 2024-04-17T19:44:58.811 INFO:teuthology.orchestra.run.smithi062.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-04-17T19:44:58.874 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-04-17T19:44:58.875 INFO:teuthology.orchestra.run.smithi044.stdout:The following network interfaces were found in /etc/network/interfaces 2024-04-17T19:44:58.875 INFO:teuthology.orchestra.run.smithi044.stdout:which means they are currently configured by ifupdown: 2024-04-17T19:44:58.875 INFO:teuthology.orchestra.run.smithi044.stdout:- ens1f0 2024-04-17T19:44:58.875 INFO:teuthology.orchestra.run.smithi044.stdout:If you want to manage those interfaces with NetworkManager instead 2024-04-17T19:44:58.875 INFO:teuthology.orchestra.run.smithi044.stdout:remove their configuration from /etc/network/interfaces. 2024-04-17T19:44:58.875 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-04-17T19:44:59.014 INFO:teuthology.orchestra.run.smithi062.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-04-17T19:44:59.014 INFO:teuthology.orchestra.run.smithi044.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.nm-dispatcher.service -> /lib/systemd/system/NetworkManager-dispatcher.service. 2024-04-17T19:44:59.430 INFO:teuthology.orchestra.run.smithi044.stdout:Created symlink /etc/systemd/system/network-online.target.wants/NetworkManager-wait-online.service -> /lib/systemd/system/NetworkManager-wait-online.service. 2024-04-17T19:44:59.870 INFO:teuthology.orchestra.run.smithi044.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/NetworkManager.service -> /lib/systemd/system/NetworkManager.service. 2024-04-17T19:45:00.240 INFO:teuthology.orchestra.run.smithi062.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-04-17T19:45:00.699 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2024-04-17T19:45:00.850 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up libfl-dev:amd64 (2.6.4-8build2) ... 2024-04-17T19:45:00.959 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up network-manager-pptp (1.2.10-1) ... 2024-04-17T19:45:00.965 INFO:teuthology.orchestra.run.smithi062.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-04-17T19:45:00.969 DEBUG:teuthology.orchestra.run.smithi062:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install bison flex libelf-dev libssl-dev network-manager iproute2 util-linux dump indent libaio-dev libtool-bin uuid-dev xfslibs-dev postgresql postgresql-client postgresql-common postgresql-contrib 2024-04-17T19:45:01.029 INFO:teuthology.orchestra.run.smithi062.stdout:Reading package lists... 2024-04-17T19:45:01.085 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up postgresql-common (238) ... 2024-04-17T19:45:01.233 INFO:teuthology.orchestra.run.smithi062.stdout:Building dependency tree... 2024-04-17T19:45:01.234 INFO:teuthology.orchestra.run.smithi062.stdout:Reading state information... 2024-04-17T19:45:01.432 INFO:teuthology.orchestra.run.smithi062.stdout:iproute2 is already the newest version (5.15.0-1ubuntu2). 2024-04-17T19:45:01.432 INFO:teuthology.orchestra.run.smithi062.stdout:libtool-bin is already the newest version (2.4.6-15build2). 2024-04-17T19:45:01.432 INFO:teuthology.orchestra.run.smithi062.stdout:xfslibs-dev is already the newest version (5.13.0-1ubuntu2). 2024-04-17T19:45:01.432 INFO:teuthology.orchestra.run.smithi062.stdout:The following packages were automatically installed and are no longer required: 2024-04-17T19:45:01.433 INFO:teuthology.orchestra.run.smithi062.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-04-17T19:45:01.433 INFO:teuthology.orchestra.run.smithi062.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-04-17T19:45:01.433 INFO:teuthology.orchestra.run.smithi062.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-04-17T19:45:01.433 INFO:teuthology.orchestra.run.smithi062.stdout: python2 python2-dev python2-minimal python2.7 python2.7-dev 2024-04-17T19:45:01.434 INFO:teuthology.orchestra.run.smithi062.stdout: python2.7-minimal 2024-04-17T19:45:01.434 INFO:teuthology.orchestra.run.smithi062.stdout:Use 'sudo apt autoremove' to remove them. 2024-04-17T19:45:01.435 INFO:teuthology.orchestra.run.smithi062.stdout:The following additional packages will be installed: 2024-04-17T19:45:01.435 INFO:teuthology.orchestra.run.smithi062.stdout: libbluetooth3 libfl-dev libfl2 libjson-perl libllvm14 liblzo2-2 2024-04-17T19:45:01.435 INFO:teuthology.orchestra.run.smithi062.stdout: libmbim-glib4 libmbim-proxy libmm-glib0 libndp0 libnm0 libpq5 libqmi-glib5 2024-04-17T19:45:01.435 INFO:teuthology.orchestra.run.smithi062.stdout: libqmi-proxy libssl3 libteamdctl0 libuuid1 modemmanager network-manager-pptp 2024-04-17T19:45:01.436 INFO:teuthology.orchestra.run.smithi062.stdout: postgresql-14 postgresql-client-14 postgresql-client-common ppp pptp-linux 2024-04-17T19:45:01.436 INFO:teuthology.orchestra.run.smithi062.stdout: tcl tcl8.6 usb-modeswitch usb-modeswitch-data wpasupplicant 2024-04-17T19:45:01.436 INFO:teuthology.orchestra.run.smithi062.stdout:Suggested packages: 2024-04-17T19:45:01.436 INFO:teuthology.orchestra.run.smithi062.stdout: bison-doc flex-doc indent-doc libssl-doc avahi-autoipd libteam-utils 2024-04-17T19:45:01.436 INFO:teuthology.orchestra.run.smithi062.stdout: postgresql-doc postgresql-doc-14 tcl-tclreadline comgt wvdial 2024-04-17T19:45:01.436 INFO:teuthology.orchestra.run.smithi062.stdout: util-linux-locales wpagui libengine-pkcs11-openssl 2024-04-17T19:45:01.481 INFO:teuthology.orchestra.run.smithi062.stdout:The following NEW packages will be installed: 2024-04-17T19:45:01.482 INFO:teuthology.orchestra.run.smithi062.stdout: bison dump flex indent libaio-dev libbluetooth3 libelf-dev libfl-dev libfl2 2024-04-17T19:45:01.482 INFO:teuthology.orchestra.run.smithi062.stdout: libjson-perl libllvm14 liblzo2-2 libmbim-glib4 libmbim-proxy libmm-glib0 2024-04-17T19:45:01.483 INFO:teuthology.orchestra.run.smithi062.stdout: libndp0 libnm0 libpq5 libqmi-glib5 libqmi-proxy libssl-dev libteamdctl0 2024-04-17T19:45:01.483 INFO:teuthology.orchestra.run.smithi062.stdout: modemmanager network-manager network-manager-pptp postgresql postgresql-14 2024-04-17T19:45:01.483 INFO:teuthology.orchestra.run.smithi062.stdout: postgresql-client postgresql-client-14 postgresql-client-common 2024-04-17T19:45:01.483 INFO:teuthology.orchestra.run.smithi062.stdout: postgresql-common postgresql-contrib ppp pptp-linux tcl tcl8.6 2024-04-17T19:45:01.483 INFO:teuthology.orchestra.run.smithi062.stdout: usb-modeswitch usb-modeswitch-data wpasupplicant 2024-04-17T19:45:01.484 INFO:teuthology.orchestra.run.smithi062.stdout:The following packages will be upgraded: 2024-04-17T19:45:01.485 INFO:teuthology.orchestra.run.smithi062.stdout: libssl3 libuuid1 util-linux uuid-dev 2024-04-17T19:45:01.564 INFO:teuthology.orchestra.run.smithi062.stdout:4 upgraded, 39 newly installed, 0 to remove and 301 not upgraded. 2024-04-17T19:45:01.564 INFO:teuthology.orchestra.run.smithi062.stdout:Need to get 55.7 MB of archives. 2024-04-17T19:45:01.564 INFO:teuthology.orchestra.run.smithi062.stdout:After this operation, 202 MB of additional disk space will be used. 2024-04-17T19:45:01.564 INFO:teuthology.orchestra.run.smithi062.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 util-linux amd64 2.37.2-4ubuntu3.4 [1,063 kB] 2024-04-17T19:45:01.784 INFO:teuthology.orchestra.run.smithi062.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy/main amd64 flex amd64 2.6.4-8build2 [307 kB] 2024-04-17T19:45:01.827 INFO:teuthology.orchestra.run.smithi062.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl3 amd64 3.0.2-0ubuntu1.15 [1,905 kB] 2024-04-17T19:45:01.869 INFO:teuthology.orchestra.run.smithi062.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 uuid-dev amd64 2.37.2-4ubuntu3.4 [33.1 kB] 2024-04-17T19:45:01.874 INFO:teuthology.orchestra.run.smithi062.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libuuid1 amd64 2.37.2-4ubuntu3.4 [23.8 kB] 2024-04-17T19:45:01.875 INFO:teuthology.orchestra.run.smithi062.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy/main amd64 bison amd64 2:3.8.2+dfsg-1build1 [748 kB] 2024-04-17T19:45:01.890 INFO:teuthology.orchestra.run.smithi062.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblzo2-2 amd64 2.10-2build3 [53.7 kB] 2024-04-17T19:45:01.892 INFO:teuthology.orchestra.run.smithi062.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy/universe amd64 dump amd64 0.4b47-3 [133 kB] 2024-04-17T19:45:01.895 INFO:teuthology.orchestra.run.smithi062.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 indent amd64 2.2.12-1ubuntu0.22.04.1 [90.8 kB] 2024-04-17T19:45:01.897 INFO:teuthology.orchestra.run.smithi062.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy/main amd64 libaio-dev amd64 0.3.112-13build1 [21.2 kB] 2024-04-17T19:45:01.898 INFO:teuthology.orchestra.run.smithi062.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libbluetooth3 amd64 5.64-0ubuntu1.1 [87.0 kB] 2024-04-17T19:45:01.900 INFO:teuthology.orchestra.run.smithi062.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/main amd64 libelf-dev amd64 0.186-1build1 [64.4 kB] 2024-04-17T19:45:01.903 INFO:teuthology.orchestra.run.smithi062.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl2 amd64 2.6.4-8build2 [10.7 kB] 2024-04-17T19:45:01.958 INFO:teuthology.orchestra.run.smithi062.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl-dev amd64 2.6.4-8build2 [6,236 B] 2024-04-17T19:45:01.959 INFO:teuthology.orchestra.run.smithi062.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjson-perl all 4.04000-1 [81.8 kB] 2024-04-17T19:45:01.961 INFO:teuthology.orchestra.run.smithi062.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libllvm14 amd64 1:14.0.0-1ubuntu1.1 [24.0 MB] 2024-04-17T19:45:02.066 INFO:teuthology.orchestra.run.smithi044.stdout:Adding user postgres to group ssl-cert 2024-04-17T19:45:02.317 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-04-17T19:45:02.318 INFO:teuthology.orchestra.run.smithi044.stdout:Creating config file /etc/postgresql-common/createcluster.conf with new version 2024-04-17T19:45:02.548 INFO:teuthology.orchestra.run.smithi062.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-glib4 amd64 1.28.0-1~ubuntu20.04.1 [191 kB] 2024-04-17T19:45:02.552 INFO:teuthology.orchestra.run.smithi062.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-proxy amd64 1.28.0-1~ubuntu20.04.1 [6,130 B] 2024-04-17T19:45:02.553 INFO:teuthology.orchestra.run.smithi062.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmm-glib0 amd64 1.20.0-1~ubuntu22.04.3 [263 kB] 2024-04-17T19:45:02.558 INFO:teuthology.orchestra.run.smithi062.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy/main amd64 libndp0 amd64 1.8-0ubuntu3 [12.3 kB] 2024-04-17T19:45:02.558 INFO:teuthology.orchestra.run.smithi062.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libnm0 amd64 1.36.6-0ubuntu2 [456 kB] 2024-04-17T19:45:02.567 INFO:teuthology.orchestra.run.smithi062.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpq5 amd64 14.11-0ubuntu0.22.04.1 [144 kB] 2024-04-17T19:45:02.570 INFO:teuthology.orchestra.run.smithi062.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-glib5 amd64 1.32.0-1ubuntu0.22.04.1 [772 kB] 2024-04-17T19:45:02.572 INFO:teuthology.orchestra.run.smithi044.stdout:Building PostgreSQL dictionaries from installed myspell/hunspell packages... 2024-04-17T19:45:02.572 INFO:teuthology.orchestra.run.smithi044.stdout:Removing obsolete dictionary files: 2024-04-17T19:45:02.584 INFO:teuthology.orchestra.run.smithi062.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-proxy amd64 1.32.0-1ubuntu0.22.04.1 [6,072 B] 2024-04-17T19:45:02.584 INFO:teuthology.orchestra.run.smithi062.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl-dev amd64 3.0.2-0ubuntu1.15 [2,376 kB] 2024-04-17T19:45:02.620 INFO:teuthology.orchestra.run.smithi062.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 libteamdctl0 amd64 1.31-1build2 [12.6 kB] 2024-04-17T19:45:02.620 INFO:teuthology.orchestra.run.smithi062.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 modemmanager amd64 1.20.0-1~ubuntu22.04.3 [1,094 kB] 2024-04-17T19:45:02.643 INFO:teuthology.orchestra.run.smithi062.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 network-manager amd64 1.36.6-0ubuntu2 [2,203 kB] 2024-04-17T19:45:02.686 INFO:teuthology.orchestra.run.smithi062.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 ppp amd64 2.4.9-1+1ubuntu3 [363 kB] 2024-04-17T19:45:02.693 INFO:teuthology.orchestra.run.smithi062.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/main amd64 pptp-linux amd64 1.10.0-1build3 [42.5 kB] 2024-04-17T19:45:02.694 INFO:teuthology.orchestra.run.smithi062.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 network-manager-pptp amd64 1.2.10-1 [30.9 kB] 2024-04-17T19:45:02.695 INFO:teuthology.orchestra.run.smithi062.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client-common all 238 [29.6 kB] 2024-04-17T19:45:02.696 INFO:teuthology.orchestra.run.smithi062.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-client-14 amd64 14.11-0ubuntu0.22.04.1 [1,222 kB] 2024-04-17T19:45:02.777 INFO:teuthology.orchestra.run.smithi062.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-common all 238 [169 kB] 2024-04-17T19:45:02.779 INFO:teuthology.orchestra.run.smithi062.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-14 amd64 14.11-0ubuntu0.22.04.1 [16.2 MB] 2024-04-17T19:45:03.121 INFO:teuthology.orchestra.run.smithi062.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql all 14+238 [3,288 B] 2024-04-17T19:45:03.121 INFO:teuthology.orchestra.run.smithi062.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client all 14+238 [3,292 B] 2024-04-17T19:45:03.122 INFO:teuthology.orchestra.run.smithi062.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-contrib all 14+238 [3,292 B] 2024-04-17T19:45:03.122 INFO:teuthology.orchestra.run.smithi062.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl8.6 amd64 8.6.12+dfsg-1build1 [15.0 kB] 2024-04-17T19:45:03.122 INFO:teuthology.orchestra.run.smithi062.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl amd64 8.6.11+1build2 [4,678 B] 2024-04-17T19:45:03.122 INFO:teuthology.orchestra.run.smithi062.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 wpasupplicant amd64 2:2.10-6ubuntu2 [1,481 kB] 2024-04-17T19:45:03.141 INFO:teuthology.orchestra.run.smithi062.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch-data all 20191128-4 [33.2 kB] 2024-04-17T19:45:03.142 INFO:teuthology.orchestra.run.smithi062.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch amd64 2.6.1-3ubuntu2 [46.0 kB] 2024-04-17T19:45:03.325 INFO:teuthology.orchestra.run.smithi044.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/postgresql.service -> /lib/systemd/system/postgresql.service. 2024-04-17T19:45:03.564 INFO:teuthology.orchestra.run.smithi062.stdout:Preconfiguring packages ... 2024-04-17T19:45:03.857 INFO:teuthology.orchestra.run.smithi062.stdout:Fetched 55.7 MB in 2s (33.8 MB/s) 2024-04-17T19:45:03.928 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up postgresql-14 (14.11-0ubuntu0.22.04.1) ... 2024-04-17T19:45:04.174 INFO:teuthology.orchestra.run.smithi062.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 138504 files and directories currently installed.) 2024-04-17T19:45:04.179 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../util-linux_2.37.2-4ubuntu3.4_amd64.deb ... 2024-04-17T19:45:04.288 INFO:teuthology.orchestra.run.smithi044.stdout:Creating new PostgreSQL cluster 14/main ... 2024-04-17T19:45:04.315 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib/postgresql/14/bin/initdb -D /var/lib/postgresql/14/main --auth-local peer --auth-host scram-sha-256 --no-instructions 2024-04-17T19:45:04.364 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking util-linux (2.37.2-4ubuntu3.4) over (2.37.2-4ubuntu3) ... 2024-04-17T19:45:04.371 INFO:teuthology.orchestra.run.smithi044.stdout:The files belonging to this database system will be owned by user "postgres". 2024-04-17T19:45:04.372 INFO:teuthology.orchestra.run.smithi044.stdout:This user must also own the server process. 2024-04-17T19:45:04.372 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-04-17T19:45:04.372 INFO:teuthology.orchestra.run.smithi044.stdout:The database cluster will be initialized with locale "en_US". 2024-04-17T19:45:04.372 INFO:teuthology.orchestra.run.smithi044.stdout:The default database encoding has accordingly been set to "LATIN1". 2024-04-17T19:45:04.372 INFO:teuthology.orchestra.run.smithi044.stdout:The default text search configuration will be set to "english". 2024-04-17T19:45:04.373 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-04-17T19:45:04.373 INFO:teuthology.orchestra.run.smithi044.stdout:Data page checksums are disabled. 2024-04-17T19:45:04.373 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-04-17T19:45:04.373 INFO:teuthology.orchestra.run.smithi044.stdout:fixing permissions on existing directory /var/lib/postgresql/14/main ... ok 2024-04-17T19:45:04.373 INFO:teuthology.orchestra.run.smithi044.stdout:creating subdirectories ... ok 2024-04-17T19:45:04.373 INFO:teuthology.orchestra.run.smithi044.stdout:selecting dynamic shared memory implementation ... posix 2024-04-17T19:45:04.396 INFO:teuthology.orchestra.run.smithi044.stdout:selecting default max_connections ... 100 2024-04-17T19:45:04.431 INFO:teuthology.orchestra.run.smithi044.stdout:selecting default shared_buffers ... 128MB 2024-04-17T19:45:04.446 INFO:teuthology.orchestra.run.smithi044.stdout:selecting default time zone ... Etc/UTC 2024-04-17T19:45:04.447 INFO:teuthology.orchestra.run.smithi044.stdout:creating configuration files ... ok 2024-04-17T19:45:04.619 INFO:teuthology.orchestra.run.smithi044.stdout:running bootstrap script ... ok 2024-04-17T19:45:05.110 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up util-linux (2.37.2-4ubuntu3.4) ... 2024-04-17T19:45:05.252 INFO:teuthology.orchestra.run.smithi044.stdout:performing post-bootstrap initialization ... ok 2024-04-17T19:45:05.840 INFO:teuthology.orchestra.run.smithi044.stdout:syncing data to disk ... ok 2024-04-17T19:45:06.073 INFO:teuthology.orchestra.run.smithi062.stdout:fstrim.service is a disabled or a static unit not running, not starting it. 2024-04-17T19:45:06.370 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package flex. 2024-04-17T19:45:06.392 INFO:teuthology.orchestra.run.smithi044.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/postmaster.1.gz to provide /usr/share/man/man1/postmaster.1.gz (postmaster.1.gz) in auto mode 2024-04-17T19:45:06.462 INFO:teuthology.orchestra.run.smithi062.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 138504 files and directories currently installed.) 2024-04-17T19:45:06.466 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../flex_2.6.4-8build2_amd64.deb ... 2024-04-17T19:45:06.510 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking flex (2.6.4-8build2) ... 2024-04-17T19:45:07.059 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../libssl3_3.0.2-0ubuntu1.15_amd64.deb ... 2024-04-17T19:45:07.225 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking libssl3:amd64 (3.0.2-0ubuntu1.15) over (3.0.2-0ubuntu1.7) ... 2024-04-17T19:45:07.709 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up libssl3:amd64 (3.0.2-0ubuntu1.15) ... 2024-04-17T19:45:08.242 INFO:teuthology.orchestra.run.smithi062.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 138577 files and directories currently installed.) 2024-04-17T19:45:08.246 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../uuid-dev_2.37.2-4ubuntu3.4_amd64.deb ... 2024-04-17T19:45:08.357 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking uuid-dev:amd64 (2.37.2-4ubuntu3.4) over (2.37.2-4ubuntu3) ... 2024-04-17T19:45:08.994 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../libuuid1_2.37.2-4ubuntu3.4_amd64.deb ... 2024-04-17T19:45:09.485 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2024-04-17T19:45:09.548 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking libuuid1:amd64 (2.37.2-4ubuntu3.4) over (2.37.2-4ubuntu3) ... 2024-04-17T19:45:09.611 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up postgresql-contrib (14+238) ... 2024-04-17T19:45:09.737 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up postgresql (14+238) ... 2024-04-17T19:45:09.863 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2024-04-17T19:45:09.890 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up libuuid1:amd64 (2.37.2-4ubuntu3.4) ... 2024-04-17T19:45:09.998 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up modemmanager (1.20.0-1~ubuntu22.04.3) ... 2024-04-17T19:45:10.249 INFO:teuthology.orchestra.run.smithi044.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.ModemManager1.service -> /lib/systemd/system/ModemManager.service. 2024-04-17T19:45:10.249 INFO:teuthology.orchestra.run.smithi044.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ModemManager.service -> /lib/systemd/system/ModemManager.service. 2024-04-17T19:45:10.374 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package bison. 2024-04-17T19:45:10.466 INFO:teuthology.orchestra.run.smithi062.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 138577 files and directories currently installed.) 2024-04-17T19:45:10.471 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../00-bison_2%3a3.8.2+dfsg-1build1_amd64.deb ... 2024-04-17T19:45:10.518 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking bison (2:3.8.2+dfsg-1build1) ... 2024-04-17T19:45:10.961 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package liblzo2-2:amd64. 2024-04-17T19:45:10.983 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../01-liblzo2-2_2.10-2build3_amd64.deb ... 2024-04-17T19:45:11.050 INFO:teuthology.orchestra.run.smithi044.stdout:Processing triggers for mailcap (3.70+nmu1ubuntu1) ... 2024-04-17T19:45:11.052 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking liblzo2-2:amd64 (2.10-2build3) ... 2024-04-17T19:45:11.134 INFO:teuthology.orchestra.run.smithi044.stdout:Processing triggers for hicolor-icon-theme (0.17-2) ... 2024-04-17T19:45:11.422 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package dump. 2024-04-17T19:45:11.444 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../02-dump_0.4b47-3_amd64.deb ... 2024-04-17T19:45:11.461 INFO:teuthology.orchestra.run.smithi044.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-04-17T19:45:11.505 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking dump (0.4b47-3) ... 2024-04-17T19:45:11.646 INFO:teuthology.orchestra.run.smithi044.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-04-17T19:45:11.826 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package indent. 2024-04-17T19:45:11.839 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../03-indent_2.2.12-1ubuntu0.22.04.1_amd64.deb ... 2024-04-17T19:45:11.876 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking indent (2.2.12-1ubuntu0.22.04.1) ... 2024-04-17T19:45:12.179 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package libaio-dev:amd64. 2024-04-17T19:45:12.192 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../04-libaio-dev_0.3.112-13build1_amd64.deb ... 2024-04-17T19:45:12.229 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking libaio-dev:amd64 (0.3.112-13build1) ... 2024-04-17T19:45:12.583 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package libbluetooth3:amd64. 2024-04-17T19:45:12.605 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../05-libbluetooth3_5.64-0ubuntu1.1_amd64.deb ... 2024-04-17T19:45:12.641 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking libbluetooth3:amd64 (5.64-0ubuntu1.1) ... 2024-04-17T19:45:12.928 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package libelf-dev:amd64. 2024-04-17T19:45:12.950 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../06-libelf-dev_0.186-1build1_amd64.deb ... 2024-04-17T19:45:12.994 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking libelf-dev:amd64 (0.186-1build1) ... 2024-04-17T19:45:13.141 INFO:teuthology.orchestra.run.smithi044.stdout:Processing triggers for dbus (1.12.20-2ubuntu4.1) ... 2024-04-17T19:45:13.241 INFO:teuthology.orchestra.run.smithi044.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-04-17T19:45:13.373 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package libfl2:amd64. 2024-04-17T19:45:13.395 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../07-libfl2_2.6.4-8build2_amd64.deb ... 2024-04-17T19:45:13.439 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking libfl2:amd64 (2.6.4-8build2) ... 2024-04-17T19:45:13.717 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package libfl-dev:amd64. 2024-04-17T19:45:13.739 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../08-libfl-dev_2.6.4-8build2_amd64.deb ... 2024-04-17T19:45:13.784 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking libfl-dev:amd64 (2.6.4-8build2) ... 2024-04-17T19:45:13.788 INFO:teuthology.orchestra.run.smithi044.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-04-17T19:45:13.795 DEBUG:teuthology.parallel:result is None 2024-04-17T19:45:14.053 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package libjson-perl. 2024-04-17T19:45:14.075 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../09-libjson-perl_4.04000-1_all.deb ... 2024-04-17T19:45:14.120 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking libjson-perl (4.04000-1) ... 2024-04-17T19:45:14.567 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package libllvm14:amd64. 2024-04-17T19:45:14.590 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../10-libllvm14_1%3a14.0.0-1ubuntu1.1_amd64.deb ... 2024-04-17T19:45:14.633 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking libllvm14:amd64 (1:14.0.0-1ubuntu1.1) ... 2024-04-17T19:45:16.361 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package libmbim-glib4:amd64. 2024-04-17T19:45:16.383 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../11-libmbim-glib4_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2024-04-17T19:45:16.419 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2024-04-17T19:45:16.722 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package libmbim-proxy. 2024-04-17T19:45:16.744 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../12-libmbim-proxy_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2024-04-17T19:45:16.822 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2024-04-17T19:45:17.183 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package libmm-glib0:amd64. 2024-04-17T19:45:17.205 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../13-libmm-glib0_1.20.0-1~ubuntu22.04.3_amd64.deb ... 2024-04-17T19:45:17.250 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.3) ... 2024-04-17T19:45:17.611 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package libndp0:amd64. 2024-04-17T19:45:17.633 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../14-libndp0_1.8-0ubuntu3_amd64.deb ... 2024-04-17T19:45:17.669 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking libndp0:amd64 (1.8-0ubuntu3) ... 2024-04-17T19:45:18.048 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package libnm0:amd64. 2024-04-17T19:45:18.070 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../15-libnm0_1.36.6-0ubuntu2_amd64.deb ... 2024-04-17T19:45:18.114 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking libnm0:amd64 (1.36.6-0ubuntu2) ... 2024-04-17T19:45:18.501 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package libpq5:amd64. 2024-04-17T19:45:18.523 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../16-libpq5_14.11-0ubuntu0.22.04.1_amd64.deb ... 2024-04-17T19:45:18.592 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking libpq5:amd64 (14.11-0ubuntu0.22.04.1) ... 2024-04-17T19:45:18.946 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package libqmi-glib5:amd64. 2024-04-17T19:45:18.968 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../17-libqmi-glib5_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2024-04-17T19:45:19.004 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2024-04-17T19:45:19.332 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package libqmi-proxy. 2024-04-17T19:45:19.354 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../18-libqmi-proxy_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2024-04-17T19:45:19.398 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2024-04-17T19:45:19.961 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package libssl-dev:amd64. 2024-04-17T19:45:19.984 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../19-libssl-dev_3.0.2-0ubuntu1.15_amd64.deb ... 2024-04-17T19:45:20.027 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking libssl-dev:amd64 (3.0.2-0ubuntu1.15) ... 2024-04-17T19:45:20.648 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package libteamdctl0:amd64. 2024-04-17T19:45:20.671 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../20-libteamdctl0_1.31-1build2_amd64.deb ... 2024-04-17T19:45:20.714 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking libteamdctl0:amd64 (1.31-1build2) ... 2024-04-17T19:45:21.135 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package modemmanager. 2024-04-17T19:45:21.157 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../21-modemmanager_1.20.0-1~ubuntu22.04.3_amd64.deb ... 2024-04-17T19:45:21.201 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking modemmanager (1.20.0-1~ubuntu22.04.3) ... 2024-04-17T19:45:21.883 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package network-manager. 2024-04-17T19:45:21.905 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../22-network-manager_1.36.6-0ubuntu2_amd64.deb ... 2024-04-17T19:45:21.949 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking network-manager (1.36.6-0ubuntu2) ... 2024-04-17T19:45:22.616 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package ppp. 2024-04-17T19:45:22.638 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../23-ppp_2.4.9-1+1ubuntu3_amd64.deb ... 2024-04-17T19:45:22.924 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking ppp (2.4.9-1+1ubuntu3) ... 2024-04-17T19:45:23.288 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package pptp-linux. 2024-04-17T19:45:23.310 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../24-pptp-linux_1.10.0-1build3_amd64.deb ... 2024-04-17T19:45:23.354 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking pptp-linux (1.10.0-1build3) ... 2024-04-17T19:45:23.632 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package network-manager-pptp. 2024-04-17T19:45:23.646 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../25-network-manager-pptp_1.2.10-1_amd64.deb ... 2024-04-17T19:45:23.682 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking network-manager-pptp (1.2.10-1) ... 2024-04-17T19:45:23.994 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package postgresql-client-common. 2024-04-17T19:45:24.016 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../26-postgresql-client-common_238_all.deb ... 2024-04-17T19:45:24.060 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking postgresql-client-common (238) ... 2024-04-17T19:45:24.397 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package postgresql-client-14. 2024-04-17T19:45:24.420 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../27-postgresql-client-14_14.11-0ubuntu0.22.04.1_amd64.deb ... 2024-04-17T19:45:24.464 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking postgresql-client-14 (14.11-0ubuntu0.22.04.1) ... 2024-04-17T19:45:25.069 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package postgresql-common. 2024-04-17T19:45:25.092 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../28-postgresql-common_238_all.deb ... 2024-04-17T19:45:25.155 INFO:teuthology.orchestra.run.smithi062.stdout:Adding 'diversion of /usr/bin/pg_config to /usr/bin/pg_config.libpq-dev by postgresql-common' 2024-04-17T19:45:25.192 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking postgresql-common (238) ... 2024-04-17T19:45:25.685 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package postgresql-14. 2024-04-17T19:45:25.707 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../29-postgresql-14_14.11-0ubuntu0.22.04.1_amd64.deb ... 2024-04-17T19:45:25.771 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking postgresql-14 (14.11-0ubuntu0.22.04.1) ... 2024-04-17T19:45:27.205 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package postgresql. 2024-04-17T19:45:27.228 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../30-postgresql_14+238_all.deb ... 2024-04-17T19:45:27.271 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking postgresql (14+238) ... 2024-04-17T19:45:27.549 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package postgresql-client. 2024-04-17T19:45:27.571 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../31-postgresql-client_14+238_all.deb ... 2024-04-17T19:45:27.615 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking postgresql-client (14+238) ... 2024-04-17T19:45:27.884 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package postgresql-contrib. 2024-04-17T19:45:27.907 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../32-postgresql-contrib_14+238_all.deb ... 2024-04-17T19:45:27.951 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking postgresql-contrib (14+238) ... 2024-04-17T19:45:28.295 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package tcl8.6. 2024-04-17T19:45:28.318 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../33-tcl8.6_8.6.12+dfsg-1build1_amd64.deb ... 2024-04-17T19:45:28.362 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking tcl8.6 (8.6.12+dfsg-1build1) ... 2024-04-17T19:45:28.640 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package tcl. 2024-04-17T19:45:28.662 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../34-tcl_8.6.11+1build2_amd64.deb ... 2024-04-17T19:45:28.711 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking tcl (8.6.11+1build2) ... 2024-04-17T19:45:29.109 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package wpasupplicant. 2024-04-17T19:45:29.132 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../35-wpasupplicant_2%3a2.10-6ubuntu2_amd64.deb ... 2024-04-17T19:45:29.175 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking wpasupplicant (2:2.10-6ubuntu2) ... 2024-04-17T19:45:29.563 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package usb-modeswitch-data. 2024-04-17T19:45:29.577 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../36-usb-modeswitch-data_20191128-4_all.deb ... 2024-04-17T19:45:29.638 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking usb-modeswitch-data (20191128-4) ... 2024-04-17T19:45:30.017 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package usb-modeswitch. 2024-04-17T19:45:30.040 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../37-usb-modeswitch_2.6.1-3ubuntu2_amd64.deb ... 2024-04-17T19:45:30.091 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking usb-modeswitch (2.6.1-3ubuntu2) ... 2024-04-17T19:45:30.405 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up postgresql-client-common (238) ... 2024-04-17T19:45:30.666 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up flex (2.6.4-8build2) ... 2024-04-17T19:45:30.792 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up tcl8.6 (8.6.12+dfsg-1build1) ... 2024-04-17T19:45:30.918 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up libpq5:amd64 (14.11-0ubuntu0.22.04.1) ... 2024-04-17T19:45:31.086 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up liblzo2-2:amd64 (2.10-2build3) ... 2024-04-17T19:45:31.221 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up libaio-dev:amd64 (0.3.112-13build1) ... 2024-04-17T19:45:31.380 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up postgresql-client-14 (14.11-0ubuntu0.22.04.1) ... 2024-04-17T19:45:31.903 INFO:teuthology.orchestra.run.smithi062.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/psql.1.gz to provide /usr/share/man/man1/psql.1.gz (psql.1.gz) in auto mode 2024-04-17T19:45:32.002 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up wpasupplicant (2:2.10-6ubuntu2) ... 2024-04-17T19:45:32.933 INFO:teuthology.orchestra.run.smithi062.stdout:Created symlink /etc/systemd/system/dbus-fi.w1.wpa_supplicant1.service -> /lib/systemd/system/wpa_supplicant.service. 2024-04-17T19:45:32.933 INFO:teuthology.orchestra.run.smithi062.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/wpa_supplicant.service -> /lib/systemd/system/wpa_supplicant.service. 2024-04-17T19:45:33.473 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up uuid-dev:amd64 (2.37.2-4ubuntu3.4) ... 2024-04-17T19:45:33.649 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up libteamdctl0:amd64 (1.31-1build2) ... 2024-04-17T19:45:33.801 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up libssl-dev:amd64 (3.0.2-0ubuntu1.15) ... 2024-04-17T19:45:33.976 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up usb-modeswitch-data (20191128-4) ... 2024-04-17T19:45:34.127 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up libelf-dev:amd64 (0.186-1build1) ... 2024-04-17T19:45:34.303 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up libfl2:amd64 (2.6.4-8build2) ... 2024-04-17T19:45:34.454 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up libnm0:amd64 (1.36.6-0ubuntu2) ... 2024-04-17T19:45:34.613 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up ppp (2.4.9-1+1ubuntu3) ... 2024-04-17T19:45:35.444 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up libllvm14:amd64 (1:14.0.0-1ubuntu1.1) ... 2024-04-17T19:45:35.595 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up dump (0.4b47-3) ... 2024-04-17T19:45:35.739 INFO:teuthology.orchestra.run.smithi062.stdout:update-alternatives: using /usr/sbin/rmt-dump to provide /usr/sbin/rmt (rmt) in auto mode 2024-04-17T19:45:35.805 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.3) ... 2024-04-17T19:45:35.931 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up libbluetooth3:amd64 (5.64-0ubuntu1.1) ... 2024-04-17T19:45:36.099 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up tcl (8.6.11+1build2) ... 2024-04-17T19:45:36.250 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up libjson-perl (4.04000-1) ... 2024-04-17T19:45:36.426 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up bison (2:3.8.2+dfsg-1build1) ... 2024-04-17T19:45:36.532 INFO:teuthology.orchestra.run.smithi062.stdout:update-alternatives: using /usr/bin/bison.yacc to provide /usr/bin/yacc (yacc) in auto mode 2024-04-17T19:45:36.611 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up indent (2.2.12-1ubuntu0.22.04.1) ... 2024-04-17T19:45:36.787 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up usb-modeswitch (2.6.1-3ubuntu2) ... 2024-04-17T19:45:36.988 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up libndp0:amd64 (1.8-0ubuntu3) ... 2024-04-17T19:45:37.140 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2024-04-17T19:45:37.282 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up pptp-linux (1.10.0-1build3) ... 2024-04-17T19:45:37.509 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up postgresql-client (14+238) ... 2024-04-17T19:45:37.659 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up network-manager (1.36.6-0ubuntu2) ... 2024-04-17T19:45:38.243 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-04-17T19:45:38.243 INFO:teuthology.orchestra.run.smithi062.stdout:The following network interfaces were found in /etc/network/interfaces 2024-04-17T19:45:38.243 INFO:teuthology.orchestra.run.smithi062.stdout:which means they are currently configured by ifupdown: 2024-04-17T19:45:38.243 INFO:teuthology.orchestra.run.smithi062.stdout:- enp3s0f1 2024-04-17T19:45:38.243 INFO:teuthology.orchestra.run.smithi062.stdout:If you want to manage those interfaces with NetworkManager instead 2024-04-17T19:45:38.243 INFO:teuthology.orchestra.run.smithi062.stdout:remove their configuration from /etc/network/interfaces. 2024-04-17T19:45:38.243 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-04-17T19:45:38.357 INFO:teuthology.orchestra.run.smithi062.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.nm-dispatcher.service -> /lib/systemd/system/NetworkManager-dispatcher.service. 2024-04-17T19:45:38.681 INFO:teuthology.orchestra.run.smithi062.stdout:Created symlink /etc/systemd/system/network-online.target.wants/NetworkManager-wait-online.service -> /lib/systemd/system/NetworkManager-wait-online.service. 2024-04-17T19:45:39.036 INFO:teuthology.orchestra.run.smithi062.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/NetworkManager.service -> /lib/systemd/system/NetworkManager.service. 2024-04-17T19:45:39.588 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2024-04-17T19:45:39.739 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up libfl-dev:amd64 (2.6.4-8build2) ... 2024-04-17T19:45:39.899 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up network-manager-pptp (1.2.10-1) ... 2024-04-17T19:45:40.050 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up postgresql-common (238) ... 2024-04-17T19:45:41.049 INFO:teuthology.orchestra.run.smithi062.stdout:Adding user postgres to group ssl-cert 2024-04-17T19:45:41.241 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-04-17T19:45:41.241 INFO:teuthology.orchestra.run.smithi062.stdout:Creating config file /etc/postgresql-common/createcluster.conf with new version 2024-04-17T19:45:41.432 INFO:teuthology.orchestra.run.smithi062.stdout:Building PostgreSQL dictionaries from installed myspell/hunspell packages... 2024-04-17T19:45:41.432 INFO:teuthology.orchestra.run.smithi062.stdout:Removing obsolete dictionary files: 2024-04-17T19:45:42.004 INFO:teuthology.orchestra.run.smithi062.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/postgresql.service -> /lib/systemd/system/postgresql.service. 2024-04-17T19:45:42.460 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up postgresql-14 (14.11-0ubuntu0.22.04.1) ... 2024-04-17T19:45:42.826 INFO:teuthology.orchestra.run.smithi062.stdout:Creating new PostgreSQL cluster 14/main ... 2024-04-17T19:45:42.838 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/lib/postgresql/14/bin/initdb -D /var/lib/postgresql/14/main --auth-local peer --auth-host scram-sha-256 --no-instructions 2024-04-17T19:45:42.888 INFO:teuthology.orchestra.run.smithi062.stdout:The files belonging to this database system will be owned by user "postgres". 2024-04-17T19:45:42.888 INFO:teuthology.orchestra.run.smithi062.stdout:This user must also own the server process. 2024-04-17T19:45:42.888 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-04-17T19:45:42.888 INFO:teuthology.orchestra.run.smithi062.stdout:The database cluster will be initialized with locale "en_US". 2024-04-17T19:45:42.888 INFO:teuthology.orchestra.run.smithi062.stdout:The default database encoding has accordingly been set to "LATIN1". 2024-04-17T19:45:42.889 INFO:teuthology.orchestra.run.smithi062.stdout:The default text search configuration will be set to "english". 2024-04-17T19:45:42.889 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-04-17T19:45:42.889 INFO:teuthology.orchestra.run.smithi062.stdout:Data page checksums are disabled. 2024-04-17T19:45:42.889 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-04-17T19:45:42.889 INFO:teuthology.orchestra.run.smithi062.stdout:fixing permissions on existing directory /var/lib/postgresql/14/main ... ok 2024-04-17T19:45:42.889 INFO:teuthology.orchestra.run.smithi062.stdout:creating subdirectories ... ok 2024-04-17T19:45:42.889 INFO:teuthology.orchestra.run.smithi062.stdout:selecting dynamic shared memory implementation ... posix 2024-04-17T19:45:42.905 INFO:teuthology.orchestra.run.smithi062.stdout:selecting default max_connections ... 100 2024-04-17T19:45:42.925 INFO:teuthology.orchestra.run.smithi062.stdout:selecting default shared_buffers ... 128MB 2024-04-17T19:45:42.935 INFO:teuthology.orchestra.run.smithi062.stdout:selecting default time zone ... Etc/UTC 2024-04-17T19:45:42.936 INFO:teuthology.orchestra.run.smithi062.stdout:creating configuration files ... ok 2024-04-17T19:45:43.054 INFO:teuthology.orchestra.run.smithi062.stdout:running bootstrap script ... ok 2024-04-17T19:45:43.726 INFO:teuthology.orchestra.run.smithi062.stdout:performing post-bootstrap initialization ... ok 2024-04-17T19:45:44.598 INFO:teuthology.orchestra.run.smithi062.stdout:syncing data to disk ... ok 2024-04-17T19:45:45.017 INFO:teuthology.orchestra.run.smithi062.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/postmaster.1.gz to provide /usr/share/man/man1/postmaster.1.gz (postmaster.1.gz) in auto mode 2024-04-17T19:45:47.925 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2024-04-17T19:45:48.084 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up postgresql-contrib (14+238) ... 2024-04-17T19:45:48.210 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up postgresql (14+238) ... 2024-04-17T19:45:48.369 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2024-04-17T19:45:48.521 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up modemmanager (1.20.0-1~ubuntu22.04.3) ... 2024-04-17T19:45:48.796 INFO:teuthology.orchestra.run.smithi062.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.ModemManager1.service -> /lib/systemd/system/ModemManager.service. 2024-04-17T19:45:48.797 INFO:teuthology.orchestra.run.smithi062.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ModemManager.service -> /lib/systemd/system/ModemManager.service. 2024-04-17T19:45:49.440 INFO:teuthology.orchestra.run.smithi062.stdout:Processing triggers for mailcap (3.70+nmu1ubuntu1) ... 2024-04-17T19:45:49.541 INFO:teuthology.orchestra.run.smithi062.stdout:Processing triggers for hicolor-icon-theme (0.17-2) ... 2024-04-17T19:45:49.893 INFO:teuthology.orchestra.run.smithi062.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-04-17T19:45:50.070 INFO:teuthology.orchestra.run.smithi062.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-04-17T19:45:51.699 INFO:teuthology.orchestra.run.smithi062.stdout:Processing triggers for dbus (1.12.20-2ubuntu4.1) ... 2024-04-17T19:45:51.774 INFO:teuthology.orchestra.run.smithi062.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-04-17T19:45:52.294 INFO:teuthology.orchestra.run.smithi062.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-04-17T19:45:52.300 DEBUG:teuthology.parallel:result is None 2024-04-17T19:45:52.300 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=f3a98d3f110319c567ec86bf70955c141495ccf6 2024-04-17T19:45:52.441 DEBUG:teuthology.orchestra.run.smithi044:> dpkg-query -W -f '${Version}' ceph 2024-04-17T19:45:52.466 INFO:teuthology.orchestra.run.smithi044.stdout:19.0.0-3146-gf3a98d3f-1jammy 2024-04-17T19:45:52.466 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-3146-gf3a98d3f-1jammy 2024-04-17T19:45:52.467 INFO:teuthology.task.install:The correct ceph version 19.0.0-3146-gf3a98d3f-1jammy is installed. 2024-04-17T19:45:52.468 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=f3a98d3f110319c567ec86bf70955c141495ccf6 2024-04-17T19:45:52.602 DEBUG:teuthology.orchestra.run.smithi062:> dpkg-query -W -f '${Version}' ceph 2024-04-17T19:45:52.622 INFO:teuthology.orchestra.run.smithi062.stdout:19.0.0-3146-gf3a98d3f-1jammy 2024-04-17T19:45:52.623 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-3146-gf3a98d3f-1jammy 2024-04-17T19:45:52.623 INFO:teuthology.task.install:The correct ceph version 19.0.0-3146-gf3a98d3f-1jammy is installed. 2024-04-17T19:45:52.624 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-04-17T19:45:52.624 DEBUG:teuthology.orchestra.run.smithi044:> set -ex 2024-04-17T19:45:52.624 DEBUG:teuthology.orchestra.run.smithi044:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-04-17T19:45:52.647 DEBUG:teuthology.orchestra.run.smithi062:> set -ex 2024-04-17T19:45:52.647 DEBUG:teuthology.orchestra.run.smithi062:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-04-17T19:45:52.678 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-04-17T19:45:52.678 DEBUG:teuthology.orchestra.run.smithi044:> set -ex 2024-04-17T19:45:52.678 DEBUG:teuthology.orchestra.run.smithi044:> sudo dd of=/usr/bin/daemon-helper 2024-04-17T19:45:52.710 DEBUG:teuthology.orchestra.run.smithi044:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-04-17T19:45:52.777 DEBUG:teuthology.orchestra.run.smithi062:> set -ex 2024-04-17T19:45:52.777 DEBUG:teuthology.orchestra.run.smithi062:> sudo dd of=/usr/bin/daemon-helper 2024-04-17T19:45:52.791 DEBUG:teuthology.orchestra.run.smithi062:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-04-17T19:45:52.845 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-04-17T19:45:52.845 DEBUG:teuthology.orchestra.run.smithi044:> set -ex 2024-04-17T19:45:52.846 DEBUG:teuthology.orchestra.run.smithi044:> sudo dd of=/usr/bin/adjust-ulimits 2024-04-17T19:45:52.867 DEBUG:teuthology.orchestra.run.smithi044:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-04-17T19:45:52.931 DEBUG:teuthology.orchestra.run.smithi062:> set -ex 2024-04-17T19:45:52.931 DEBUG:teuthology.orchestra.run.smithi062:> sudo dd of=/usr/bin/adjust-ulimits 2024-04-17T19:45:52.944 DEBUG:teuthology.orchestra.run.smithi062:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-04-17T19:45:52.997 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-04-17T19:45:52.998 DEBUG:teuthology.orchestra.run.smithi044:> set -ex 2024-04-17T19:45:52.998 DEBUG:teuthology.orchestra.run.smithi044:> sudo dd of=/usr/bin/stdin-killer 2024-04-17T19:45:53.019 DEBUG:teuthology.orchestra.run.smithi044:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-04-17T19:45:53.082 DEBUG:teuthology.orchestra.run.smithi062:> set -ex 2024-04-17T19:45:53.082 DEBUG:teuthology.orchestra.run.smithi062:> sudo dd of=/usr/bin/stdin-killer 2024-04-17T19:45:53.096 DEBUG:teuthology.orchestra.run.smithi062:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-04-17T19:45:53.149 INFO:teuthology.run_tasks:Running task ceph... 2024-04-17T19:45:53.233 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2024-04-17T19:45:53.233 DEBUG:teuthology.orchestra.run.smithi044:> sudo chmod 777 /var/log/ceph 2024-04-17T19:45:53.237 DEBUG:teuthology.orchestra.run.smithi062:> sudo chmod 777 /var/log/ceph 2024-04-17T19:45:53.255 INFO:tasks.ceph:Disabling ceph logrotate... 2024-04-17T19:45:53.255 DEBUG:teuthology.orchestra.run.smithi044:> sudo rm -f -- /etc/logrotate.d/ceph 2024-04-17T19:45:53.300 DEBUG:teuthology.orchestra.run.smithi062:> sudo rm -f -- /etc/logrotate.d/ceph 2024-04-17T19:45:53.318 INFO:tasks.ceph:Creating extra log directories... 2024-04-17T19:45:53.318 DEBUG:teuthology.orchestra.run.smithi044:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-04-17T19:45:53.368 DEBUG:teuthology.orchestra.run.smithi062:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-04-17T19:45:53.393 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2024-04-17T19:45:53.393 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2024-04-17T19:45:53.393 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2024-04-17T19:45:53.393 DEBUG:teuthology.orchestra.run.smithi044:> set -ex 2024-04-17T19:45:53.393 DEBUG:teuthology.orchestra.run.smithi044:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-04-17T19:45:53.438 DEBUG:teuthology.orchestra.run.smithi044:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-04-17T19:45:53.531 DEBUG:teuthology.orchestra.run.smithi062:> set -ex 2024-04-17T19:45:53.531 DEBUG:teuthology.orchestra.run.smithi062:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-04-17T19:45:53.537 DEBUG:teuthology.orchestra.run.smithi062:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-04-17T19:45:53.620 INFO:tasks.ceph:Creating ceph cluster ceph... 2024-04-17T19:45:53.620 INFO:tasks.ceph:config {'conf': {'client': {'client mount timeout': 600, 'client_shutdown_timeout': 120, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds bal fragment size max': 10000, 'mds bal merge size': 5, 'mds bal split bits': 3, 'mds bal split size': 100, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds oft prefetch dirfrags': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'mds_dir_prefetch': True, 'mds_sleep_rank_change': 5000000.0, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120}, 'osd': {'bluestore block size': 96636764160, 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd blocked scrub grace period': 3600, 'osd failsafe full ratio': 0.95, 'osd max markdown count': 1000, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(POOL_', '\\(CACHE_POOL_', '\\(SMALLER_PGP_NUM\\)', '\\(OBJECT_', '\\(SLOW_OPS\\)', '\\(REQUEST_SLOW\\)', '\\(TOO_FEW_PGS\\)', 'slow request', 'timeout on replica', 'late reservation from', 'MON_DOWN', 'OSDMAP_FLAGS', 'OSD_DOWN', 'PG_DEGRADED', 'PG_AVAILABILITY', 'POOL_APP_NOT_ENABLED', 'mons down', 'mon down', 'out of quorum', 'overall HEALTH_', '\\(MON_DOWN\\)'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2024-04-17T19:45:53.620 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/pdonnell-2024-04-17_17:06:06-fs-wip-pdonnell-testing-20240417.021458-debug-distro-default-smithi/7660526', 'branch': 'wip-pdonnell-testing-20240417.021458-debug', 'description': 'fs/thrash/workloads/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a5s-mds-1c-client conf/{client mds mgr mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} msgr-failures/none objectstore-ec/bluestore-comp-ec-root overrides/{client-shutdown frag ignorelist_health ignorelist_wrongly_marked_down pg_health prefetch_dirfrags/no prefetch_dirfrags/yes prefetch_entire_dirfrags/no prefetch_entire_dirfrags/yes races session_timeout thrashosds-health} ranks/5 tasks/{1-thrash/mon 2-workunit/fs/trivial_sync}}', 'email': 'pdonnell@redhat.com', 'first_in_suite': False, 'job_id': '7660526', 'kernel': {'client': {'branch': 'testing'}, 'kdb': True, 'sha1': 'distro'}, 'ktype': 'upstream', 'last_in_suite': False, 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'machine_type': 'smithi', 'mgrmodules': {'sequential': [{'print': 'Enabling mgr modules'}]}, 'name': 'pdonnell-2024-04-17_17:06:06-fs-wip-pdonnell-testing-20240417.021458-debug-distro-default-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'openstack': [{'volumes': {'count': 4, 'size': 20}}, {'machine': {'disk': 200}}], 'os_type': 'ubuntu', 'os_version': '22.04', 'overrides': {'admin_socket': {'branch': 'wip-pdonnell-testing-20240417.021458-debug'}, 'ceph': {'cephfs': {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd'], 'max_mds': 5, 'session_timeout': 300}, 'conf': {'client': {'client mount timeout': 600, 'client_shutdown_timeout': 120, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds bal fragment size max': 10000, 'mds bal merge size': 5, 'mds bal split bits': 3, 'mds bal split size': 100, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds oft prefetch dirfrags': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'mds_dir_prefetch': True, 'mds_sleep_rank_change': 5000000.0, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120}, 'osd': {'bluestore block size': 96636764160, 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd blocked scrub grace period': 3600, 'osd failsafe full ratio': 0.95, 'osd max markdown count': 1000, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(POOL_', '\\(CACHE_POOL_', '\\(SMALLER_PGP_NUM\\)', '\\(OBJECT_', '\\(SLOW_OPS\\)', '\\(REQUEST_SLOW\\)', '\\(TOO_FEW_PGS\\)', 'slow request', 'timeout on replica', 'late reservation from', 'MON_DOWN', 'OSDMAP_FLAGS', 'OSD_DOWN', 'PG_DEGRADED', 'PG_AVAILABILITY', 'POOL_APP_NOT_ENABLED', 'mons down', 'mon down', 'out of quorum', 'overall HEALTH_', '\\(MON_DOWN\\)'], 'sha1': 'f3a98d3f110319c567ec86bf70955c141495ccf6'}, 'ceph-deploy': {'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}}}, 'check-counter': {'counters': {'mds': ['mds.exported', 'mds.imported']}}, 'install': {'ceph': {'flavor': 'default', 'sha1': 'f3a98d3f110319c567ec86bf70955c141495ccf6'}}, 'kclient': {'syntax': 'v2'}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-pdonnell-testing-20240417.021458-debug', 'sha1': 'f3a98d3f110319c567ec86bf70955c141495ccf6'}}, 'owner': 'scheduled_pdonnell@teuthology', 'priority': 80, 'repo': 'https://git.ceph.com/ceph-ci.git', 'roles': [['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'mds.e', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0'], ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'mds.f', 'osd.4', 'osd.5', 'osd.6', 'osd.7']], 'seed': 4494, 'sha1': 'f3a98d3f110319c567ec86bf70955c141495ccf6', 'sleep_before_teardown': 0, 'subset': '496/512', 'suite': 'fs', 'suite_branch': 'wip-pdonnell-testing-20240417.021458-debug', 'suite_path': '/home/teuthworker/src/git.ceph.com_ceph-c_f3a98d3f110319c567ec86bf70955c141495ccf6/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://git.ceph.com/ceph-ci.git', 'suite_sha1': 'f3a98d3f110319c567ec86bf70955c141495ccf6', 'syslog': {'ignorelist': ['WARNING*.*check_session_state', 'WARNING*.*__ceph_remove_cap']}, 'targets': {'smithi044.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBBFkJ52XrASwbXBJkhLYHXC9lUsFKGmEAu0c2ILuh+RkEqHiJJKqimKzB25NswwXGPZ9OowOod9ggq0azou+vy4=', 'smithi062.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBBdPDDmhHCrLcO4+cuZnbcbQZ04BH+g04+WSXZceFtgUShLqoqRSQZVduVFjnxHeEaOXOhi3T1ptKeKEZYh4LJ4='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'client': {'branch': 'testing'}, 'kdb': True, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': 'f3a98d3f110319c567ec86bf70955c141495ccf6'}}, {'ceph': {'create_rbd_pool': False, 'cephfs': {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd'], 'max_mds': 5, 'session_timeout': 300}, 'conf': {'client': {'client mount timeout': 600, 'client_shutdown_timeout': 120, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds bal fragment size max': 10000, 'mds bal merge size': 5, 'mds bal split bits': 3, 'mds bal split size': 100, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds oft prefetch dirfrags': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'mds_dir_prefetch': True, 'mds_sleep_rank_change': 5000000.0, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120}, 'osd': {'bluestore block size': 96636764160, 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd blocked scrub grace period': 3600, 'osd failsafe full ratio': 0.95, 'osd max markdown count': 1000, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(POOL_', '\\(CACHE_POOL_', '\\(SMALLER_PGP_NUM\\)', '\\(OBJECT_', '\\(SLOW_OPS\\)', '\\(REQUEST_SLOW\\)', '\\(TOO_FEW_PGS\\)', 'slow request', 'timeout on replica', 'late reservation from', 'MON_DOWN', 'OSDMAP_FLAGS', 'OSD_DOWN', 'PG_DEGRADED', 'PG_AVAILABILITY', 'POOL_APP_NOT_ENABLED', 'mons down', 'mon down', 'out of quorum', 'overall HEALTH_', '\\(MON_DOWN\\)'], 'sha1': 'f3a98d3f110319c567ec86bf70955c141495ccf6', 'cluster': 'ceph'}}, {'sequential': ['mgrmodules']}, {'kclient': None}, {'mon_thrash': {'check_mds_failover': True, 'revive_delay': 20, 'thrash_delay': 10}}, {'workunit': {'clients': {'all': ['fs/misc/trivial_sync.sh']}}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': ["local function is_kupstream() return yaml.ktype == 'upstream' end", "local function is_kdistro() return yaml.ktype == 'distro' end", 'local function is_fuse() return false end', 'local function syntax_version() return yaml.overrides.kclient.syntax end']}, 'teuthology_branch': 'main', 'teuthology_sha1': '6c637841c215537a4502385240412f1966e0faab', 'timestamp': '2024-04-17_17:06:06', 'tube': 'smithi', 'user': 'pdonnell', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885'} 2024-04-17T19:45:53.621 DEBUG:teuthology.orchestra.run.smithi044:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-04-17T19:45:53.624 DEBUG:teuthology.orchestra.run.smithi062:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-04-17T19:45:53.662 DEBUG:teuthology.orchestra.run.smithi044:> sudo install -d -m0777 -- /var/run/ceph 2024-04-17T19:45:53.676 DEBUG:teuthology.orchestra.run.smithi062:> sudo install -d -m0777 -- /var/run/ceph 2024-04-17T19:45:53.718 DEBUG:teuthology.orchestra.run.smithi044:> set -ex 2024-04-17T19:45:53.719 DEBUG:teuthology.orchestra.run.smithi044:> dd if=/scratch_devs of=/dev/stdout 2024-04-17T19:45:53.746 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-04-17T19:45:53.747 DEBUG:teuthology.orchestra.run.smithi044:> stat /dev/vg_nvme/lv_1 2024-04-17T19:45:53.798 INFO:teuthology.orchestra.run.smithi044.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-04-17T19:45:53.798 INFO:teuthology.orchestra.run.smithi044.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-17T19:45:53.798 INFO:teuthology.orchestra.run.smithi044.stdout:Device: 6h/6d Inode: 881 Links: 1 2024-04-17T19:45:53.799 INFO:teuthology.orchestra.run.smithi044.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-17T19:45:53.799 INFO:teuthology.orchestra.run.smithi044.stdout:Access: 2024-04-17 19:38:58.819663723 +0000 2024-04-17T19:45:53.799 INFO:teuthology.orchestra.run.smithi044.stdout:Modify: 2024-04-17 19:38:58.543666185 +0000 2024-04-17T19:45:53.799 INFO:teuthology.orchestra.run.smithi044.stdout:Change: 2024-04-17 19:38:58.543666185 +0000 2024-04-17T19:45:53.799 INFO:teuthology.orchestra.run.smithi044.stdout: Birth: 2024-04-17 19:38:58.543666185 +0000 2024-04-17T19:45:53.799 DEBUG:teuthology.orchestra.run.smithi044:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-04-17T19:45:53.861 INFO:teuthology.orchestra.run.smithi044.stderr:1+0 records in 2024-04-17T19:45:53.861 INFO:teuthology.orchestra.run.smithi044.stderr:1+0 records out 2024-04-17T19:45:53.861 INFO:teuthology.orchestra.run.smithi044.stderr:512 bytes copied, 0.000389611 s, 1.3 MB/s 2024-04-17T19:45:53.863 DEBUG:teuthology.orchestra.run.smithi044:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-04-17T19:45:53.916 DEBUG:teuthology.orchestra.run.smithi044:> stat /dev/vg_nvme/lv_2 2024-04-17T19:45:53.966 INFO:teuthology.orchestra.run.smithi044.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-04-17T19:45:53.967 INFO:teuthology.orchestra.run.smithi044.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-17T19:45:53.967 INFO:teuthology.orchestra.run.smithi044.stdout:Device: 6h/6d Inode: 899 Links: 1 2024-04-17T19:45:53.967 INFO:teuthology.orchestra.run.smithi044.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-17T19:45:53.967 INFO:teuthology.orchestra.run.smithi044.stdout:Access: 2024-04-17 19:38:59.403658514 +0000 2024-04-17T19:45:53.967 INFO:teuthology.orchestra.run.smithi044.stdout:Modify: 2024-04-17 19:38:59.127660976 +0000 2024-04-17T19:45:53.967 INFO:teuthology.orchestra.run.smithi044.stdout:Change: 2024-04-17 19:38:59.127660976 +0000 2024-04-17T19:45:53.967 INFO:teuthology.orchestra.run.smithi044.stdout: Birth: 2024-04-17 19:38:59.127660976 +0000 2024-04-17T19:45:53.967 DEBUG:teuthology.orchestra.run.smithi044:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-04-17T19:45:54.029 INFO:teuthology.orchestra.run.smithi044.stderr:1+0 records in 2024-04-17T19:45:54.029 INFO:teuthology.orchestra.run.smithi044.stderr:1+0 records out 2024-04-17T19:45:54.029 INFO:teuthology.orchestra.run.smithi044.stderr:512 bytes copied, 0.00038635 s, 1.3 MB/s 2024-04-17T19:45:54.031 DEBUG:teuthology.orchestra.run.smithi044:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-04-17T19:45:54.085 DEBUG:teuthology.orchestra.run.smithi044:> stat /dev/vg_nvme/lv_3 2024-04-17T19:45:54.134 INFO:teuthology.orchestra.run.smithi044.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-04-17T19:45:54.135 INFO:teuthology.orchestra.run.smithi044.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-17T19:45:54.135 INFO:teuthology.orchestra.run.smithi044.stdout:Device: 6h/6d Inode: 917 Links: 1 2024-04-17T19:45:54.135 INFO:teuthology.orchestra.run.smithi044.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-17T19:45:54.135 INFO:teuthology.orchestra.run.smithi044.stdout:Access: 2024-04-17 19:38:59.979653375 +0000 2024-04-17T19:45:54.135 INFO:teuthology.orchestra.run.smithi044.stdout:Modify: 2024-04-17 19:38:59.703655837 +0000 2024-04-17T19:45:54.135 INFO:teuthology.orchestra.run.smithi044.stdout:Change: 2024-04-17 19:38:59.703655837 +0000 2024-04-17T19:45:54.135 INFO:teuthology.orchestra.run.smithi044.stdout: Birth: 2024-04-17 19:38:59.703655837 +0000 2024-04-17T19:45:54.135 DEBUG:teuthology.orchestra.run.smithi044:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-04-17T19:45:54.197 INFO:teuthology.orchestra.run.smithi044.stderr:1+0 records in 2024-04-17T19:45:54.197 INFO:teuthology.orchestra.run.smithi044.stderr:1+0 records out 2024-04-17T19:45:54.197 INFO:teuthology.orchestra.run.smithi044.stderr:512 bytes copied, 0.000403685 s, 1.3 MB/s 2024-04-17T19:45:54.199 DEBUG:teuthology.orchestra.run.smithi044:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-04-17T19:45:54.252 DEBUG:teuthology.orchestra.run.smithi044:> stat /dev/vg_nvme/lv_4 2024-04-17T19:45:54.302 INFO:teuthology.orchestra.run.smithi044.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-04-17T19:45:54.302 INFO:teuthology.orchestra.run.smithi044.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-17T19:45:54.302 INFO:teuthology.orchestra.run.smithi044.stdout:Device: 6h/6d Inode: 935 Links: 1 2024-04-17T19:45:54.302 INFO:teuthology.orchestra.run.smithi044.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-17T19:45:54.303 INFO:teuthology.orchestra.run.smithi044.stdout:Access: 2024-04-17 19:39:00.599647844 +0000 2024-04-17T19:45:54.303 INFO:teuthology.orchestra.run.smithi044.stdout:Modify: 2024-04-17 19:39:00.311650413 +0000 2024-04-17T19:45:54.303 INFO:teuthology.orchestra.run.smithi044.stdout:Change: 2024-04-17 19:39:00.311650413 +0000 2024-04-17T19:45:54.303 INFO:teuthology.orchestra.run.smithi044.stdout: Birth: 2024-04-17 19:39:00.311650413 +0000 2024-04-17T19:45:54.303 DEBUG:teuthology.orchestra.run.smithi044:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-04-17T19:45:54.365 INFO:teuthology.orchestra.run.smithi044.stderr:1+0 records in 2024-04-17T19:45:54.365 INFO:teuthology.orchestra.run.smithi044.stderr:1+0 records out 2024-04-17T19:45:54.365 INFO:teuthology.orchestra.run.smithi044.stderr:512 bytes copied, 0.000384913 s, 1.3 MB/s 2024-04-17T19:45:54.367 DEBUG:teuthology.orchestra.run.smithi044:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-04-17T19:45:54.420 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-04-17T19:45:54.420 DEBUG:teuthology.orchestra.run.smithi062:> set -ex 2024-04-17T19:45:54.421 DEBUG:teuthology.orchestra.run.smithi062:> dd if=/scratch_devs of=/dev/stdout 2024-04-17T19:45:54.427 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-04-17T19:45:54.427 DEBUG:teuthology.orchestra.run.smithi062:> stat /dev/vg_nvme/lv_1 2024-04-17T19:45:54.474 INFO:teuthology.orchestra.run.smithi062.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-04-17T19:45:54.475 INFO:teuthology.orchestra.run.smithi062.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-17T19:45:54.475 INFO:teuthology.orchestra.run.smithi062.stdout:Device: 5h/5d Inode: 878 Links: 1 2024-04-17T19:45:54.475 INFO:teuthology.orchestra.run.smithi062.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-17T19:45:54.475 INFO:teuthology.orchestra.run.smithi062.stdout:Access: 2024-04-17 19:38:47.555311268 +0000 2024-04-17T19:45:54.475 INFO:teuthology.orchestra.run.smithi062.stdout:Modify: 2024-04-17 19:38:47.307313707 +0000 2024-04-17T19:45:54.475 INFO:teuthology.orchestra.run.smithi062.stdout:Change: 2024-04-17 19:38:47.307313707 +0000 2024-04-17T19:45:54.475 INFO:teuthology.orchestra.run.smithi062.stdout: Birth: - 2024-04-17T19:45:54.475 DEBUG:teuthology.orchestra.run.smithi062:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-04-17T19:45:54.529 INFO:teuthology.orchestra.run.smithi062.stderr:1+0 records in 2024-04-17T19:45:54.529 INFO:teuthology.orchestra.run.smithi062.stderr:1+0 records out 2024-04-17T19:45:54.530 INFO:teuthology.orchestra.run.smithi062.stderr:512 bytes copied, 0.000532735 s, 961 kB/s 2024-04-17T19:45:54.531 DEBUG:teuthology.orchestra.run.smithi062:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-04-17T19:45:54.581 DEBUG:teuthology.orchestra.run.smithi062:> stat /dev/vg_nvme/lv_2 2024-04-17T19:45:54.630 INFO:teuthology.orchestra.run.smithi062.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-04-17T19:45:54.630 INFO:teuthology.orchestra.run.smithi062.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-17T19:45:54.630 INFO:teuthology.orchestra.run.smithi062.stdout:Device: 5h/5d Inode: 895 Links: 1 2024-04-17T19:45:54.630 INFO:teuthology.orchestra.run.smithi062.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-17T19:45:54.630 INFO:teuthology.orchestra.run.smithi062.stdout:Access: 2024-04-17 19:38:48.043306469 +0000 2024-04-17T19:45:54.630 INFO:teuthology.orchestra.run.smithi062.stdout:Modify: 2024-04-17 19:38:47.771309144 +0000 2024-04-17T19:45:54.631 INFO:teuthology.orchestra.run.smithi062.stdout:Change: 2024-04-17 19:38:47.771309144 +0000 2024-04-17T19:45:54.631 INFO:teuthology.orchestra.run.smithi062.stdout: Birth: - 2024-04-17T19:45:54.631 DEBUG:teuthology.orchestra.run.smithi062:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-04-17T19:45:54.685 INFO:teuthology.orchestra.run.smithi062.stderr:1+0 records in 2024-04-17T19:45:54.685 INFO:teuthology.orchestra.run.smithi062.stderr:1+0 records out 2024-04-17T19:45:54.685 INFO:teuthology.orchestra.run.smithi062.stderr:512 bytes copied, 0.000476516 s, 1.1 MB/s 2024-04-17T19:45:54.687 DEBUG:teuthology.orchestra.run.smithi062:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-04-17T19:45:54.736 DEBUG:teuthology.orchestra.run.smithi062:> stat /dev/vg_nvme/lv_3 2024-04-17T19:45:54.782 INFO:teuthology.orchestra.run.smithi062.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-04-17T19:45:54.782 INFO:teuthology.orchestra.run.smithi062.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-17T19:45:54.783 INFO:teuthology.orchestra.run.smithi062.stdout:Device: 5h/5d Inode: 916 Links: 1 2024-04-17T19:45:54.783 INFO:teuthology.orchestra.run.smithi062.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-17T19:45:54.783 INFO:teuthology.orchestra.run.smithi062.stdout:Access: 2024-04-17 19:38:48.567301317 +0000 2024-04-17T19:45:54.783 INFO:teuthology.orchestra.run.smithi062.stdout:Modify: 2024-04-17 19:38:48.291304031 +0000 2024-04-17T19:45:54.783 INFO:teuthology.orchestra.run.smithi062.stdout:Change: 2024-04-17 19:38:48.291304031 +0000 2024-04-17T19:45:54.783 INFO:teuthology.orchestra.run.smithi062.stdout: Birth: - 2024-04-17T19:45:54.783 DEBUG:teuthology.orchestra.run.smithi062:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-04-17T19:45:54.837 INFO:teuthology.orchestra.run.smithi062.stderr:1+0 records in 2024-04-17T19:45:54.838 INFO:teuthology.orchestra.run.smithi062.stderr:1+0 records out 2024-04-17T19:45:54.838 INFO:teuthology.orchestra.run.smithi062.stderr:512 bytes copied, 0.000591728 s, 865 kB/s 2024-04-17T19:45:54.839 DEBUG:teuthology.orchestra.run.smithi062:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-04-17T19:45:54.888 DEBUG:teuthology.orchestra.run.smithi062:> stat /dev/vg_nvme/lv_4 2024-04-17T19:45:54.938 INFO:teuthology.orchestra.run.smithi062.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-04-17T19:45:54.939 INFO:teuthology.orchestra.run.smithi062.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-17T19:45:54.939 INFO:teuthology.orchestra.run.smithi062.stdout:Device: 5h/5d Inode: 934 Links: 1 2024-04-17T19:45:54.939 INFO:teuthology.orchestra.run.smithi062.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-17T19:45:54.939 INFO:teuthology.orchestra.run.smithi062.stdout:Access: 2024-04-17 19:38:49.119295891 +0000 2024-04-17T19:45:54.939 INFO:teuthology.orchestra.run.smithi062.stdout:Modify: 2024-04-17 19:38:48.815298879 +0000 2024-04-17T19:45:54.939 INFO:teuthology.orchestra.run.smithi062.stdout:Change: 2024-04-17 19:38:48.815298879 +0000 2024-04-17T19:45:54.939 INFO:teuthology.orchestra.run.smithi062.stdout: Birth: - 2024-04-17T19:45:54.940 DEBUG:teuthology.orchestra.run.smithi062:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-04-17T19:45:54.993 INFO:teuthology.orchestra.run.smithi062.stderr:1+0 records in 2024-04-17T19:45:54.993 INFO:teuthology.orchestra.run.smithi062.stderr:1+0 records out 2024-04-17T19:45:54.993 INFO:teuthology.orchestra.run.smithi062.stderr:512 bytes copied, 0.000438153 s, 1.2 MB/s 2024-04-17T19:45:54.994 DEBUG:teuthology.orchestra.run.smithi062:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-04-17T19:45:55.043 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-04-17T19:45:55.044 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi044.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi062.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-04-17T19:45:55.044 INFO:tasks.ceph:Generating config... 2024-04-17T19:45:55.045 INFO:tasks.ceph:[client] client mount timeout = 600 2024-04-17T19:45:55.045 INFO:tasks.ceph:[client] client_shutdown_timeout = 120 2024-04-17T19:45:55.045 INFO:tasks.ceph:[client] debug client = 20 2024-04-17T19:45:55.045 INFO:tasks.ceph:[client] debug ms = 1 2024-04-17T19:45:55.045 INFO:tasks.ceph:[client] rados mon op timeout = 900 2024-04-17T19:45:55.046 INFO:tasks.ceph:[client] rados osd op timeout = 900 2024-04-17T19:45:55.046 INFO:tasks.ceph:[global] ms die on skipped message = False 2024-04-17T19:45:55.046 INFO:tasks.ceph:[mds] debug mds = 20 2024-04-17T19:45:55.046 INFO:tasks.ceph:[mds] debug mds balancer = 20 2024-04-17T19:45:55.046 INFO:tasks.ceph:[mds] debug ms = 1 2024-04-17T19:45:55.046 INFO:tasks.ceph:[mds] mds bal fragment size max = 10000 2024-04-17T19:45:55.046 INFO:tasks.ceph:[mds] mds bal merge size = 5 2024-04-17T19:45:55.046 INFO:tasks.ceph:[mds] mds bal split bits = 3 2024-04-17T19:45:55.046 INFO:tasks.ceph:[mds] mds bal split size = 100 2024-04-17T19:45:55.046 INFO:tasks.ceph:[mds] mds debug frag = True 2024-04-17T19:45:55.047 INFO:tasks.ceph:[mds] mds debug scatterstat = True 2024-04-17T19:45:55.047 INFO:tasks.ceph:[mds] mds oft prefetch dirfrags = True 2024-04-17T19:45:55.047 INFO:tasks.ceph:[mds] mds op complaint time = 180 2024-04-17T19:45:55.047 INFO:tasks.ceph:[mds] mds verify scatter = True 2024-04-17T19:45:55.047 INFO:tasks.ceph:[mds] mds_dir_prefetch = True 2024-04-17T19:45:55.047 INFO:tasks.ceph:[mds] mds_sleep_rank_change = 5000000.0 2024-04-17T19:45:55.047 INFO:tasks.ceph:[mds] osd op complaint time = 180 2024-04-17T19:45:55.047 INFO:tasks.ceph:[mds] rados mon op timeout = 900 2024-04-17T19:45:55.047 INFO:tasks.ceph:[mds] rados osd op timeout = 900 2024-04-17T19:45:55.047 INFO:tasks.ceph:[mgr] debug client = 20 2024-04-17T19:45:55.047 INFO:tasks.ceph:[mgr] debug mgr = 20 2024-04-17T19:45:55.048 INFO:tasks.ceph:[mgr] debug ms = 1 2024-04-17T19:45:55.048 INFO:tasks.ceph:[mon] debug mon = 20 2024-04-17T19:45:55.048 INFO:tasks.ceph:[mon] debug ms = 1 2024-04-17T19:45:55.048 INFO:tasks.ceph:[mon] debug paxos = 20 2024-04-17T19:45:55.048 INFO:tasks.ceph:[mon] mon down mkfs grace = 300 2024-04-17T19:45:55.048 INFO:tasks.ceph:[mon] mon op complaint time = 120 2024-04-17T19:45:55.048 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2024-04-17T19:45:55.048 INFO:tasks.ceph:[osd] bluestore compression mode = aggressive 2024-04-17T19:45:55.048 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2024-04-17T19:45:55.048 INFO:tasks.ceph:[osd] debug bluefs = 20 2024-04-17T19:45:55.048 INFO:tasks.ceph:[osd] debug bluestore = 20 2024-04-17T19:45:55.048 INFO:tasks.ceph:[osd] debug ms = 1 2024-04-17T19:45:55.049 INFO:tasks.ceph:[osd] debug osd = 20 2024-04-17T19:45:55.049 INFO:tasks.ceph:[osd] debug rocksdb = 10 2024-04-17T19:45:55.049 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2024-04-17T19:45:55.049 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2024-04-17T19:45:55.049 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2024-04-17T19:45:55.049 INFO:tasks.ceph:[osd] osd blocked scrub grace period = 3600 2024-04-17T19:45:55.049 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2024-04-17T19:45:55.049 INFO:tasks.ceph:[osd] osd max markdown count = 1000 2024-04-17T19:45:55.049 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2024-04-17T19:45:55.049 INFO:tasks.ceph:[osd] osd op complaint time = 180 2024-04-17T19:45:55.049 INFO:tasks.ceph:Setting up mon.a... 2024-04-17T19:45:55.050 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2024-04-17T19:45:55.110 INFO:teuthology.orchestra.run.smithi044.stdout:creating /etc/ceph/ceph.keyring 2024-04-17T19:45:55.127 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2024-04-17T19:45:55.189 DEBUG:teuthology.orchestra.run.smithi044:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-04-17T19:45:55.209 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.44'), ('mon.b', '172.21.15.62'), ('mon.c', '[v2:172.21.15.62:3301,v1:172.21.15.62:6790]')] 2024-04-17T19:45:55.209 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.44,172.21.15.62,[v2:172.21.15.62:3301,v1:172.21.15.62:6790]', 'ms die on skipped message': False}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd debug trim objects': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bluestore block size': 96636764160, 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd blocked scrub grace period': 3600, 'osd failsafe full ratio': 0.95, 'osd max markdown count': 1000, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false', 'debug client': 20}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon down mkfs grace': 300, 'mon op complaint time': 120}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'client mount timeout': 600, 'client_shutdown_timeout': 120, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'mds.c': {}, 'mds.e': {}, 'mds.b': {}, 'mds.d': {}, 'mds.f': {}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds bal fragment size max': 10000, 'mds bal merge size': 5, 'mds bal split bits': 3, 'mds bal split size': 100, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds oft prefetch dirfrags': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'mds_dir_prefetch': True, 'mds_sleep_rank_change': 5000000.0, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}} 2024-04-17T19:45:55.210 DEBUG:teuthology.orchestra.run.smithi044:> set -ex 2024-04-17T19:45:55.210 DEBUG:teuthology.orchestra.run.smithi044:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2024-04-17T19:45:55.261 DEBUG:teuthology.orchestra.run.smithi044:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.44 --add b 172.21.15.62 --addv c '[v2:172.21.15.62:3301,v1:172.21.15.62:6790]' --print /home/ubuntu/cephtest/ceph.monmap 2024-04-17T19:45:55.364 INFO:teuthology.orchestra.run.smithi044.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2024-04-17T19:45:55.364 INFO:teuthology.orchestra.run.smithi044.stdout:monmaptool: generated fsid 703f77ca-79c6-4a66-b576-62c526cb1021 2024-04-17T19:45:55.364 INFO:teuthology.orchestra.run.smithi044.stdout:setting min_mon_release = quincy 2024-04-17T19:45:55.365 INFO:teuthology.orchestra.run.smithi044.stdout:epoch 0 2024-04-17T19:45:55.365 INFO:teuthology.orchestra.run.smithi044.stdout:fsid 703f77ca-79c6-4a66-b576-62c526cb1021 2024-04-17T19:45:55.365 INFO:teuthology.orchestra.run.smithi044.stdout:last_changed 2024-04-17T19:45:55.379749+0000 2024-04-17T19:45:55.365 INFO:teuthology.orchestra.run.smithi044.stdout:created 2024-04-17T19:45:55.379749+0000 2024-04-17T19:45:55.365 INFO:teuthology.orchestra.run.smithi044.stdout:min_mon_release 17 (quincy) 2024-04-17T19:45:55.365 INFO:teuthology.orchestra.run.smithi044.stdout:election_strategy: 1 2024-04-17T19:45:55.365 INFO:teuthology.orchestra.run.smithi044.stdout:0: [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] mon.a 2024-04-17T19:45:55.365 INFO:teuthology.orchestra.run.smithi044.stdout:1: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.b 2024-04-17T19:45:55.365 INFO:teuthology.orchestra.run.smithi044.stdout:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.c 2024-04-17T19:45:55.365 INFO:teuthology.orchestra.run.smithi044.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2024-04-17T19:45:55.368 DEBUG:teuthology.orchestra.run.smithi044:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2024-04-17T19:45:55.376 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 703f77ca-79c6-4a66-b576-62c526cb1021... 2024-04-17T19:45:55.377 DEBUG:teuthology.orchestra.run.smithi044:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-04-17T19:45:55.420 DEBUG:teuthology.orchestra.run.smithi062:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-04-17T19:45:55.452 INFO:teuthology.orchestra.run.smithi062.stdout:[global] 2024-04-17T19:45:55.452 INFO:teuthology.orchestra.run.smithi062.stdout: chdir = "" 2024-04-17T19:45:55.452 INFO:teuthology.orchestra.run.smithi062.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-04-17T19:45:55.452 INFO:teuthology.orchestra.run.smithi062.stdout: auth supported = cephx 2024-04-17T19:45:55.452 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-04-17T19:45:55.452 INFO:teuthology.orchestra.run.smithi062.stdout: filestore xattr use omap = true 2024-04-17T19:45:55.452 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-04-17T19:45:55.452 INFO:teuthology.orchestra.run.smithi062.stdout: mon clock drift allowed = 1.000 2024-04-17T19:45:55.452 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-04-17T19:45:55.452 INFO:teuthology.orchestra.run.smithi062.stdout: osd crush chooseleaf type = 0 2024-04-17T19:45:55.452 INFO:teuthology.orchestra.run.smithi062.stdout: auth debug = true 2024-04-17T19:45:55.452 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-04-17T19:45:55.453 INFO:teuthology.orchestra.run.smithi062.stdout: ms die on old message = true 2024-04-17T19:45:55.453 INFO:teuthology.orchestra.run.smithi062.stdout: ms die on bug = true 2024-04-17T19:45:55.453 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-04-17T19:45:55.453 INFO:teuthology.orchestra.run.smithi062.stdout: mon max pg per osd = 10000 # >= luminous 2024-04-17T19:45:55.453 INFO:teuthology.orchestra.run.smithi062.stdout: mon pg warn max object skew = 0 2024-04-17T19:45:55.453 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-04-17T19:45:55.453 INFO:teuthology.orchestra.run.smithi062.stdout: # disable pg_autoscaler by default for new pools 2024-04-17T19:45:55.453 INFO:teuthology.orchestra.run.smithi062.stdout: osd_pool_default_pg_autoscale_mode = off 2024-04-17T19:45:55.453 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-04-17T19:45:55.453 INFO:teuthology.orchestra.run.smithi062.stdout: osd pool default size = 2 2024-04-17T19:45:55.453 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-04-17T19:45:55.453 INFO:teuthology.orchestra.run.smithi062.stdout: mon osd allow primary affinity = true 2024-04-17T19:45:55.453 INFO:teuthology.orchestra.run.smithi062.stdout: mon osd allow pg remap = true 2024-04-17T19:45:55.453 INFO:teuthology.orchestra.run.smithi062.stdout: mon warn on legacy crush tunables = false 2024-04-17T19:45:55.453 INFO:teuthology.orchestra.run.smithi062.stdout: mon warn on crush straw calc version zero = false 2024-04-17T19:45:55.453 INFO:teuthology.orchestra.run.smithi062.stdout: mon warn on no sortbitwise = false 2024-04-17T19:45:55.454 INFO:teuthology.orchestra.run.smithi062.stdout: mon warn on osd down out interval zero = false 2024-04-17T19:45:55.454 INFO:teuthology.orchestra.run.smithi062.stdout: mon warn on too few osds = false 2024-04-17T19:45:55.454 INFO:teuthology.orchestra.run.smithi062.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-04-17T19:45:55.454 INFO:teuthology.orchestra.run.smithi062.stdout: mon_warn_on_pool_no_redundancy = false 2024-04-17T19:45:55.454 INFO:teuthology.orchestra.run.smithi062.stdout: mon_allow_pool_size_one = true 2024-04-17T19:45:55.454 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-04-17T19:45:55.454 INFO:teuthology.orchestra.run.smithi062.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-04-17T19:45:55.454 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-04-17T19:45:55.454 INFO:teuthology.orchestra.run.smithi062.stdout: osd default data pool replay window = 5 2024-04-17T19:45:55.454 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-04-17T19:45:55.454 INFO:teuthology.orchestra.run.smithi062.stdout: mon allow pool delete = true 2024-04-17T19:45:55.454 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-04-17T19:45:55.454 INFO:teuthology.orchestra.run.smithi062.stdout: mon cluster log file level = debug 2024-04-17T19:45:55.454 INFO:teuthology.orchestra.run.smithi062.stdout: debug asserts on shutdown = true 2024-04-17T19:45:55.454 INFO:teuthology.orchestra.run.smithi062.stdout: mon health detail to clog = false 2024-04-17T19:45:55.455 INFO:teuthology.orchestra.run.smithi062.stdout: mon host = "172.21.15.44,172.21.15.62,[v2:172.21.15.62:3301,v1:172.21.15.62:6790]" 2024-04-17T19:45:55.455 INFO:teuthology.orchestra.run.smithi062.stdout: ms die on skipped message = False 2024-04-17T19:45:55.455 INFO:teuthology.orchestra.run.smithi062.stdout: fsid = 703f77ca-79c6-4a66-b576-62c526cb1021 2024-04-17T19:45:55.455 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-04-17T19:45:55.455 INFO:teuthology.orchestra.run.smithi062.stdout:[osd] 2024-04-17T19:45:55.455 INFO:teuthology.orchestra.run.smithi062.stdout: osd journal size = 100 2024-04-17T19:45:55.455 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-04-17T19:45:55.455 INFO:teuthology.orchestra.run.smithi062.stdout: osd scrub load threshold = 5.0 2024-04-17T19:45:55.455 INFO:teuthology.orchestra.run.smithi062.stdout: osd scrub max interval = 600 2024-04-17T19:45:55.455 INFO:teuthology.orchestra.run.smithi062.stdout: osd mclock profile = high_recovery_ops 2024-04-17T19:45:55.455 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-04-17T19:45:55.455 INFO:teuthology.orchestra.run.smithi062.stdout: osd recover clone overlap = true 2024-04-17T19:45:55.455 INFO:teuthology.orchestra.run.smithi062.stdout: osd recovery max chunk = 1048576 2024-04-17T19:45:55.455 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-04-17T19:45:55.455 INFO:teuthology.orchestra.run.smithi062.stdout: osd debug shutdown = true 2024-04-17T19:45:55.456 INFO:teuthology.orchestra.run.smithi062.stdout: osd debug op order = true 2024-04-17T19:45:55.456 INFO:teuthology.orchestra.run.smithi062.stdout: osd debug verify stray on activate = true 2024-04-17T19:45:55.456 INFO:teuthology.orchestra.run.smithi062.stdout: osd debug trim objects = true 2024-04-17T19:45:55.456 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-04-17T19:45:55.456 INFO:teuthology.orchestra.run.smithi062.stdout: osd open classes on start = true 2024-04-17T19:45:55.456 INFO:teuthology.orchestra.run.smithi062.stdout: osd debug pg log writeout = true 2024-04-17T19:45:55.456 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-04-17T19:45:55.456 INFO:teuthology.orchestra.run.smithi062.stdout: osd deep scrub update digest min age = 30 2024-04-17T19:45:55.456 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-04-17T19:45:55.456 INFO:teuthology.orchestra.run.smithi062.stdout: osd map max advance = 10 2024-04-17T19:45:55.456 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-04-17T19:45:55.456 INFO:teuthology.orchestra.run.smithi062.stdout: journal zero on create = true 2024-04-17T19:45:55.456 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-04-17T19:45:55.456 INFO:teuthology.orchestra.run.smithi062.stdout: filestore ondisk finisher threads = 3 2024-04-17T19:45:55.456 INFO:teuthology.orchestra.run.smithi062.stdout: filestore apply finisher threads = 3 2024-04-17T19:45:55.456 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-04-17T19:45:55.457 INFO:teuthology.orchestra.run.smithi062.stdout: bdev debug aio = true 2024-04-17T19:45:55.457 INFO:teuthology.orchestra.run.smithi062.stdout: osd debug misdirected ops = true 2024-04-17T19:45:55.457 INFO:teuthology.orchestra.run.smithi062.stdout: bluestore block size = 96636764160 2024-04-17T19:45:55.457 INFO:teuthology.orchestra.run.smithi062.stdout: bluestore compression mode = aggressive 2024-04-17T19:45:55.457 INFO:teuthology.orchestra.run.smithi062.stdout: bluestore fsck on mount = True 2024-04-17T19:45:55.457 INFO:teuthology.orchestra.run.smithi062.stdout: debug bluefs = 20 2024-04-17T19:45:55.457 INFO:teuthology.orchestra.run.smithi062.stdout: debug bluestore = 20 2024-04-17T19:45:55.457 INFO:teuthology.orchestra.run.smithi062.stdout: debug ms = 1 2024-04-17T19:45:55.457 INFO:teuthology.orchestra.run.smithi062.stdout: debug osd = 20 2024-04-17T19:45:55.457 INFO:teuthology.orchestra.run.smithi062.stdout: debug rocksdb = 10 2024-04-17T19:45:55.457 INFO:teuthology.orchestra.run.smithi062.stdout: mon osd backfillfull_ratio = 0.85 2024-04-17T19:45:55.457 INFO:teuthology.orchestra.run.smithi062.stdout: mon osd full ratio = 0.9 2024-04-17T19:45:55.457 INFO:teuthology.orchestra.run.smithi062.stdout: mon osd nearfull ratio = 0.8 2024-04-17T19:45:55.457 INFO:teuthology.orchestra.run.smithi062.stdout: osd blocked scrub grace period = 3600 2024-04-17T19:45:55.457 INFO:teuthology.orchestra.run.smithi062.stdout: osd failsafe full ratio = 0.95 2024-04-17T19:45:55.457 INFO:teuthology.orchestra.run.smithi062.stdout: osd max markdown count = 1000 2024-04-17T19:45:55.458 INFO:teuthology.orchestra.run.smithi062.stdout: osd objectstore = bluestore 2024-04-17T19:45:55.458 INFO:teuthology.orchestra.run.smithi062.stdout: osd op complaint time = 180 2024-04-17T19:45:55.458 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-04-17T19:45:55.458 INFO:teuthology.orchestra.run.smithi062.stdout:[mgr] 2024-04-17T19:45:55.458 INFO:teuthology.orchestra.run.smithi062.stdout: debug ms = 1 2024-04-17T19:45:55.458 INFO:teuthology.orchestra.run.smithi062.stdout: debug mgr = 20 2024-04-17T19:45:55.458 INFO:teuthology.orchestra.run.smithi062.stdout: debug mon = 20 2024-04-17T19:45:55.458 INFO:teuthology.orchestra.run.smithi062.stdout: debug auth = 20 2024-04-17T19:45:55.458 INFO:teuthology.orchestra.run.smithi062.stdout: mon reweight min pgs per osd = 4 2024-04-17T19:45:55.458 INFO:teuthology.orchestra.run.smithi062.stdout: mon reweight min bytes per osd = 10 2024-04-17T19:45:55.458 INFO:teuthology.orchestra.run.smithi062.stdout: mgr/telemetry/nag = false 2024-04-17T19:45:55.458 INFO:teuthology.orchestra.run.smithi062.stdout: debug client = 20 2024-04-17T19:45:55.458 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-04-17T19:45:55.458 INFO:teuthology.orchestra.run.smithi062.stdout:[mon] 2024-04-17T19:45:55.458 INFO:teuthology.orchestra.run.smithi062.stdout: debug ms = 1 2024-04-17T19:45:55.459 INFO:teuthology.orchestra.run.smithi062.stdout: debug mon = 20 2024-04-17T19:45:55.459 INFO:teuthology.orchestra.run.smithi062.stdout: debug paxos = 20 2024-04-17T19:45:55.459 INFO:teuthology.orchestra.run.smithi062.stdout: debug auth = 20 2024-04-17T19:45:55.459 INFO:teuthology.orchestra.run.smithi062.stdout: mon data avail warn = 5 2024-04-17T19:45:55.459 INFO:teuthology.orchestra.run.smithi062.stdout: mon mgr mkfs grace = 240 2024-04-17T19:45:55.459 INFO:teuthology.orchestra.run.smithi062.stdout: mon reweight min pgs per osd = 4 2024-04-17T19:45:55.459 INFO:teuthology.orchestra.run.smithi062.stdout: mon osd reporter subtree level = osd 2024-04-17T19:45:55.459 INFO:teuthology.orchestra.run.smithi062.stdout: mon osd prime pg temp = true 2024-04-17T19:45:55.459 INFO:teuthology.orchestra.run.smithi062.stdout: mon reweight min bytes per osd = 10 2024-04-17T19:45:55.459 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-04-17T19:45:55.459 INFO:teuthology.orchestra.run.smithi062.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-04-17T19:45:55.459 INFO:teuthology.orchestra.run.smithi062.stdout: auth mon ticket ttl = 660 # 11m 2024-04-17T19:45:55.459 INFO:teuthology.orchestra.run.smithi062.stdout: auth service ticket ttl = 240 # 4m 2024-04-17T19:45:55.459 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-04-17T19:45:55.459 INFO:teuthology.orchestra.run.smithi062.stdout: # don't complain about insecure global_id in the test suite 2024-04-17T19:45:55.459 INFO:teuthology.orchestra.run.smithi062.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-04-17T19:45:55.460 INFO:teuthology.orchestra.run.smithi062.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-04-17T19:45:55.460 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-04-17T19:45:55.460 INFO:teuthology.orchestra.run.smithi062.stdout: # 1m isn't quite enough 2024-04-17T19:45:55.460 INFO:teuthology.orchestra.run.smithi062.stdout: mon_down_mkfs_grace = 2m 2024-04-17T19:45:55.460 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-04-17T19:45:55.460 INFO:teuthology.orchestra.run.smithi062.stdout: mon_warn_on_filestore_osds = false 2024-04-17T19:45:55.460 INFO:teuthology.orchestra.run.smithi062.stdout: mon down mkfs grace = 300 2024-04-17T19:45:55.460 INFO:teuthology.orchestra.run.smithi062.stdout: mon op complaint time = 120 2024-04-17T19:45:55.460 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-04-17T19:45:55.460 INFO:teuthology.orchestra.run.smithi062.stdout:[client] 2024-04-17T19:45:55.460 INFO:teuthology.orchestra.run.smithi062.stdout: rgw cache enabled = true 2024-04-17T19:45:55.460 INFO:teuthology.orchestra.run.smithi062.stdout: rgw enable ops log = true 2024-04-17T19:45:55.460 INFO:teuthology.orchestra.run.smithi062.stdout: rgw enable usage log = true 2024-04-17T19:45:55.461 INFO:teuthology.orchestra.run.smithi062.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-04-17T19:45:55.461 INFO:teuthology.orchestra.run.smithi062.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-04-17T19:45:55.461 INFO:teuthology.orchestra.run.smithi062.stdout: client mount timeout = 600 2024-04-17T19:45:55.461 INFO:teuthology.orchestra.run.smithi062.stdout: client_shutdown_timeout = 120 2024-04-17T19:45:55.461 INFO:teuthology.orchestra.run.smithi062.stdout: debug client = 20 2024-04-17T19:45:55.461 INFO:teuthology.orchestra.run.smithi062.stdout: debug ms = 1 2024-04-17T19:45:55.461 INFO:teuthology.orchestra.run.smithi062.stdout: rados mon op timeout = 900 2024-04-17T19:45:55.461 INFO:teuthology.orchestra.run.smithi062.stdout: rados osd op timeout = 900 2024-04-17T19:45:55.461 INFO:teuthology.orchestra.run.smithi062.stdout:[mon.a] 2024-04-17T19:45:55.461 INFO:teuthology.orchestra.run.smithi062.stdout:[mon.b] 2024-04-17T19:45:55.461 INFO:teuthology.orchestra.run.smithi062.stdout:[mon.c] 2024-04-17T19:45:55.461 INFO:teuthology.orchestra.run.smithi062.stdout:[mds.a] 2024-04-17T19:45:55.461 INFO:teuthology.orchestra.run.smithi062.stdout:[mds.c] 2024-04-17T19:45:55.461 INFO:teuthology.orchestra.run.smithi062.stdout:[mds.e] 2024-04-17T19:45:55.461 INFO:teuthology.orchestra.run.smithi062.stdout:[mds.b] 2024-04-17T19:45:55.461 INFO:teuthology.orchestra.run.smithi062.stdout:[mds.d] 2024-04-17T19:45:55.462 INFO:teuthology.orchestra.run.smithi062.stdout:[mds.f] 2024-04-17T19:45:55.462 INFO:teuthology.orchestra.run.smithi062.stdout:[mds] 2024-04-17T19:45:55.462 INFO:teuthology.orchestra.run.smithi062.stdout: debug mds = 20 2024-04-17T19:45:55.462 INFO:teuthology.orchestra.run.smithi062.stdout: debug mds balancer = 20 2024-04-17T19:45:55.462 INFO:teuthology.orchestra.run.smithi062.stdout: debug ms = 1 2024-04-17T19:45:55.462 INFO:teuthology.orchestra.run.smithi062.stdout: mds bal fragment size max = 10000 2024-04-17T19:45:55.462 INFO:teuthology.orchestra.run.smithi062.stdout: mds bal merge size = 5 2024-04-17T19:45:55.462 INFO:teuthology.orchestra.run.smithi062.stdout: mds bal split bits = 3 2024-04-17T19:45:55.462 INFO:teuthology.orchestra.run.smithi062.stdout: mds bal split size = 100 2024-04-17T19:45:55.462 INFO:teuthology.orchestra.run.smithi062.stdout: mds debug frag = True 2024-04-17T19:45:55.462 INFO:teuthology.orchestra.run.smithi062.stdout: mds debug scatterstat = True 2024-04-17T19:45:55.462 INFO:teuthology.orchestra.run.smithi062.stdout: mds oft prefetch dirfrags = True 2024-04-17T19:45:55.462 INFO:teuthology.orchestra.run.smithi062.stdout: mds op complaint time = 180 2024-04-17T19:45:55.462 INFO:teuthology.orchestra.run.smithi062.stdout: mds verify scatter = True 2024-04-17T19:45:55.462 INFO:teuthology.orchestra.run.smithi062.stdout: mds_dir_prefetch = True 2024-04-17T19:45:55.463 INFO:teuthology.orchestra.run.smithi062.stdout: mds_sleep_rank_change = 5000000.0 2024-04-17T19:45:55.463 INFO:teuthology.orchestra.run.smithi062.stdout: osd op complaint time = 180 2024-04-17T19:45:55.463 INFO:teuthology.orchestra.run.smithi062.stdout: rados mon op timeout = 900 2024-04-17T19:45:55.463 INFO:teuthology.orchestra.run.smithi062.stdout: rados osd op timeout = 900 2024-04-17T19:45:55.463 INFO:teuthology.orchestra.run.smithi044.stdout:[global] 2024-04-17T19:45:55.463 INFO:teuthology.orchestra.run.smithi044.stdout: chdir = "" 2024-04-17T19:45:55.463 INFO:teuthology.orchestra.run.smithi044.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-04-17T19:45:55.463 INFO:teuthology.orchestra.run.smithi044.stdout: auth supported = cephx 2024-04-17T19:45:55.463 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-04-17T19:45:55.464 INFO:teuthology.orchestra.run.smithi044.stdout: filestore xattr use omap = true 2024-04-17T19:45:55.464 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-04-17T19:45:55.464 INFO:teuthology.orchestra.run.smithi044.stdout: mon clock drift allowed = 1.000 2024-04-17T19:45:55.464 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-04-17T19:45:55.464 INFO:teuthology.orchestra.run.smithi044.stdout: osd crush chooseleaf type = 0 2024-04-17T19:45:55.464 INFO:teuthology.orchestra.run.smithi044.stdout: auth debug = true 2024-04-17T19:45:55.464 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-04-17T19:45:55.464 INFO:teuthology.orchestra.run.smithi044.stdout: ms die on old message = true 2024-04-17T19:45:55.464 INFO:teuthology.orchestra.run.smithi044.stdout: ms die on bug = true 2024-04-17T19:45:55.464 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-04-17T19:45:55.464 INFO:teuthology.orchestra.run.smithi044.stdout: mon max pg per osd = 10000 # >= luminous 2024-04-17T19:45:55.464 INFO:teuthology.orchestra.run.smithi044.stdout: mon pg warn max object skew = 0 2024-04-17T19:45:55.464 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-04-17T19:45:55.464 INFO:teuthology.orchestra.run.smithi044.stdout: # disable pg_autoscaler by default for new pools 2024-04-17T19:45:55.464 INFO:teuthology.orchestra.run.smithi044.stdout: osd_pool_default_pg_autoscale_mode = off 2024-04-17T19:45:55.465 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-04-17T19:45:55.465 INFO:teuthology.orchestra.run.smithi044.stdout: osd pool default size = 2 2024-04-17T19:45:55.465 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-04-17T19:45:55.465 INFO:teuthology.orchestra.run.smithi044.stdout: mon osd allow primary affinity = true 2024-04-17T19:45:55.465 INFO:teuthology.orchestra.run.smithi044.stdout: mon osd allow pg remap = true 2024-04-17T19:45:55.465 INFO:teuthology.orchestra.run.smithi044.stdout: mon warn on legacy crush tunables = false 2024-04-17T19:45:55.465 INFO:teuthology.orchestra.run.smithi044.stdout: mon warn on crush straw calc version zero = false 2024-04-17T19:45:55.465 INFO:teuthology.orchestra.run.smithi044.stdout: mon warn on no sortbitwise = false 2024-04-17T19:45:55.465 INFO:teuthology.orchestra.run.smithi044.stdout: mon warn on osd down out interval zero = false 2024-04-17T19:45:55.465 INFO:teuthology.orchestra.run.smithi044.stdout: mon warn on too few osds = false 2024-04-17T19:45:55.465 INFO:teuthology.orchestra.run.smithi044.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-04-17T19:45:55.465 INFO:teuthology.orchestra.run.smithi044.stdout: mon_warn_on_pool_no_redundancy = false 2024-04-17T19:45:55.465 INFO:teuthology.orchestra.run.smithi044.stdout: mon_allow_pool_size_one = true 2024-04-17T19:45:55.465 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-04-17T19:45:55.465 INFO:teuthology.orchestra.run.smithi044.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-04-17T19:45:55.465 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-04-17T19:45:55.466 INFO:teuthology.orchestra.run.smithi044.stdout: osd default data pool replay window = 5 2024-04-17T19:45:55.466 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-04-17T19:45:55.466 INFO:teuthology.orchestra.run.smithi044.stdout: mon allow pool delete = true 2024-04-17T19:45:55.466 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-04-17T19:45:55.466 INFO:teuthology.orchestra.run.smithi044.stdout: mon cluster log file level = debug 2024-04-17T19:45:55.466 INFO:teuthology.orchestra.run.smithi044.stdout: debug asserts on shutdown = true 2024-04-17T19:45:55.466 INFO:teuthology.orchestra.run.smithi044.stdout: mon health detail to clog = false 2024-04-17T19:45:55.466 INFO:teuthology.orchestra.run.smithi044.stdout: mon host = "172.21.15.44,172.21.15.62,[v2:172.21.15.62:3301,v1:172.21.15.62:6790]" 2024-04-17T19:45:55.466 INFO:teuthology.orchestra.run.smithi044.stdout: ms die on skipped message = False 2024-04-17T19:45:55.466 INFO:teuthology.orchestra.run.smithi044.stdout: fsid = 703f77ca-79c6-4a66-b576-62c526cb1021 2024-04-17T19:45:55.466 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-04-17T19:45:55.466 INFO:teuthology.orchestra.run.smithi044.stdout:[osd] 2024-04-17T19:45:55.466 INFO:teuthology.orchestra.run.smithi044.stdout: osd journal size = 100 2024-04-17T19:45:55.466 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-04-17T19:45:55.466 INFO:teuthology.orchestra.run.smithi044.stdout: osd scrub load threshold = 5.0 2024-04-17T19:45:55.467 INFO:teuthology.orchestra.run.smithi044.stdout: osd scrub max interval = 600 2024-04-17T19:45:55.467 INFO:teuthology.orchestra.run.smithi044.stdout: osd mclock profile = high_recovery_ops 2024-04-17T19:45:55.467 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-04-17T19:45:55.467 INFO:teuthology.orchestra.run.smithi044.stdout: osd recover clone overlap = true 2024-04-17T19:45:55.467 INFO:teuthology.orchestra.run.smithi044.stdout: osd recovery max chunk = 1048576 2024-04-17T19:45:55.467 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-04-17T19:45:55.467 INFO:teuthology.orchestra.run.smithi044.stdout: osd debug shutdown = true 2024-04-17T19:45:55.467 INFO:teuthology.orchestra.run.smithi044.stdout: osd debug op order = true 2024-04-17T19:45:55.467 INFO:teuthology.orchestra.run.smithi044.stdout: osd debug verify stray on activate = true 2024-04-17T19:45:55.467 INFO:teuthology.orchestra.run.smithi044.stdout: osd debug trim objects = true 2024-04-17T19:45:55.467 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-04-17T19:45:55.467 INFO:teuthology.orchestra.run.smithi044.stdout: osd open classes on start = true 2024-04-17T19:45:55.467 INFO:teuthology.orchestra.run.smithi044.stdout: osd debug pg log writeout = true 2024-04-17T19:45:55.467 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-04-17T19:45:55.467 INFO:teuthology.orchestra.run.smithi044.stdout: osd deep scrub update digest min age = 30 2024-04-17T19:45:55.467 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-04-17T19:45:55.468 INFO:teuthology.orchestra.run.smithi044.stdout: osd map max advance = 10 2024-04-17T19:45:55.468 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-04-17T19:45:55.468 INFO:teuthology.orchestra.run.smithi044.stdout: journal zero on create = true 2024-04-17T19:45:55.468 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-04-17T19:45:55.468 INFO:teuthology.orchestra.run.smithi044.stdout: filestore ondisk finisher threads = 3 2024-04-17T19:45:55.468 INFO:teuthology.orchestra.run.smithi044.stdout: filestore apply finisher threads = 3 2024-04-17T19:45:55.468 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-04-17T19:45:55.468 INFO:teuthology.orchestra.run.smithi044.stdout: bdev debug aio = true 2024-04-17T19:45:55.468 INFO:teuthology.orchestra.run.smithi044.stdout: osd debug misdirected ops = true 2024-04-17T19:45:55.468 INFO:teuthology.orchestra.run.smithi044.stdout: bluestore block size = 96636764160 2024-04-17T19:45:55.468 INFO:teuthology.orchestra.run.smithi044.stdout: bluestore compression mode = aggressive 2024-04-17T19:45:55.468 INFO:teuthology.orchestra.run.smithi044.stdout: bluestore fsck on mount = True 2024-04-17T19:45:55.468 INFO:teuthology.orchestra.run.smithi044.stdout: debug bluefs = 20 2024-04-17T19:45:55.468 INFO:teuthology.orchestra.run.smithi044.stdout: debug bluestore = 20 2024-04-17T19:45:55.468 INFO:teuthology.orchestra.run.smithi044.stdout: debug ms = 1 2024-04-17T19:45:55.468 INFO:teuthology.orchestra.run.smithi044.stdout: debug osd = 20 2024-04-17T19:45:55.469 INFO:teuthology.orchestra.run.smithi044.stdout: debug rocksdb = 10 2024-04-17T19:45:55.469 INFO:teuthology.orchestra.run.smithi044.stdout: mon osd backfillfull_ratio = 0.85 2024-04-17T19:45:55.469 INFO:teuthology.orchestra.run.smithi044.stdout: mon osd full ratio = 0.9 2024-04-17T19:45:55.469 INFO:teuthology.orchestra.run.smithi044.stdout: mon osd nearfull ratio = 0.8 2024-04-17T19:45:55.469 INFO:teuthology.orchestra.run.smithi044.stdout: osd blocked scrub grace period = 3600 2024-04-17T19:45:55.469 INFO:teuthology.orchestra.run.smithi044.stdout: osd failsafe full ratio = 0.95 2024-04-17T19:45:55.469 INFO:teuthology.orchestra.run.smithi044.stdout: osd max markdown count = 1000 2024-04-17T19:45:55.469 INFO:teuthology.orchestra.run.smithi044.stdout: osd objectstore = bluestore 2024-04-17T19:45:55.469 INFO:teuthology.orchestra.run.smithi044.stdout: osd op complaint time = 180 2024-04-17T19:45:55.469 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-04-17T19:45:55.469 INFO:teuthology.orchestra.run.smithi044.stdout:[mgr] 2024-04-17T19:45:55.469 INFO:teuthology.orchestra.run.smithi044.stdout: debug ms = 1 2024-04-17T19:45:55.469 INFO:teuthology.orchestra.run.smithi044.stdout: debug mgr = 20 2024-04-17T19:45:55.469 INFO:teuthology.orchestra.run.smithi044.stdout: debug mon = 20 2024-04-17T19:45:55.469 INFO:teuthology.orchestra.run.smithi044.stdout: debug auth = 20 2024-04-17T19:45:55.470 INFO:teuthology.orchestra.run.smithi044.stdout: mon reweight min pgs per osd = 4 2024-04-17T19:45:55.470 INFO:teuthology.orchestra.run.smithi044.stdout: mon reweight min bytes per osd = 10 2024-04-17T19:45:55.470 INFO:teuthology.orchestra.run.smithi044.stdout: mgr/telemetry/nag = false 2024-04-17T19:45:55.470 INFO:teuthology.orchestra.run.smithi044.stdout: debug client = 20 2024-04-17T19:45:55.470 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-04-17T19:45:55.470 INFO:teuthology.orchestra.run.smithi044.stdout:[mon] 2024-04-17T19:45:55.470 INFO:teuthology.orchestra.run.smithi044.stdout: debug ms = 1 2024-04-17T19:45:55.470 INFO:teuthology.orchestra.run.smithi044.stdout: debug mon = 20 2024-04-17T19:45:55.470 INFO:teuthology.orchestra.run.smithi044.stdout: debug paxos = 20 2024-04-17T19:45:55.470 INFO:teuthology.orchestra.run.smithi044.stdout: debug auth = 20 2024-04-17T19:45:55.470 INFO:teuthology.orchestra.run.smithi044.stdout: mon data avail warn = 5 2024-04-17T19:45:55.470 INFO:teuthology.orchestra.run.smithi044.stdout: mon mgr mkfs grace = 240 2024-04-17T19:45:55.470 INFO:teuthology.orchestra.run.smithi044.stdout: mon reweight min pgs per osd = 4 2024-04-17T19:45:55.470 INFO:teuthology.orchestra.run.smithi044.stdout: mon osd reporter subtree level = osd 2024-04-17T19:45:55.470 INFO:teuthology.orchestra.run.smithi044.stdout: mon osd prime pg temp = true 2024-04-17T19:45:55.470 INFO:teuthology.orchestra.run.smithi044.stdout: mon reweight min bytes per osd = 10 2024-04-17T19:45:55.471 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-04-17T19:45:55.471 INFO:teuthology.orchestra.run.smithi044.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-04-17T19:45:55.471 INFO:teuthology.orchestra.run.smithi044.stdout: auth mon ticket ttl = 660 # 11m 2024-04-17T19:45:55.471 INFO:teuthology.orchestra.run.smithi044.stdout: auth service ticket ttl = 240 # 4m 2024-04-17T19:45:55.471 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-04-17T19:45:55.471 INFO:teuthology.orchestra.run.smithi044.stdout: # don't complain about insecure global_id in the test suite 2024-04-17T19:45:55.471 INFO:teuthology.orchestra.run.smithi044.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-04-17T19:45:55.471 INFO:teuthology.orchestra.run.smithi044.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-04-17T19:45:55.471 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-04-17T19:45:55.471 INFO:teuthology.orchestra.run.smithi044.stdout: # 1m isn't quite enough 2024-04-17T19:45:55.471 INFO:teuthology.orchestra.run.smithi044.stdout: mon_down_mkfs_grace = 2m 2024-04-17T19:45:55.471 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-04-17T19:45:55.471 INFO:teuthology.orchestra.run.smithi044.stdout: mon_warn_on_filestore_osds = false 2024-04-17T19:45:55.471 INFO:teuthology.orchestra.run.smithi044.stdout: mon down mkfs grace = 300 2024-04-17T19:45:55.471 INFO:teuthology.orchestra.run.smithi044.stdout: mon op complaint time = 120 2024-04-17T19:45:55.472 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-04-17T19:45:55.472 INFO:teuthology.orchestra.run.smithi044.stdout:[client] 2024-04-17T19:45:55.472 INFO:teuthology.orchestra.run.smithi044.stdout: rgw cache enabled = true 2024-04-17T19:45:55.472 INFO:teuthology.orchestra.run.smithi044.stdout: rgw enable ops log = true 2024-04-17T19:45:55.472 INFO:teuthology.orchestra.run.smithi044.stdout: rgw enable usage log = true 2024-04-17T19:45:55.472 INFO:teuthology.orchestra.run.smithi044.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-04-17T19:45:55.472 INFO:teuthology.orchestra.run.smithi044.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-04-17T19:45:55.472 INFO:teuthology.orchestra.run.smithi044.stdout: client mount timeout = 600 2024-04-17T19:45:55.472 INFO:teuthology.orchestra.run.smithi044.stdout: client_shutdown_timeout = 120 2024-04-17T19:45:55.472 INFO:teuthology.orchestra.run.smithi044.stdout: debug client = 20 2024-04-17T19:45:55.472 INFO:teuthology.orchestra.run.smithi044.stdout: debug ms = 1 2024-04-17T19:45:55.472 INFO:teuthology.orchestra.run.smithi044.stdout: rados mon op timeout = 900 2024-04-17T19:45:55.472 INFO:teuthology.orchestra.run.smithi044.stdout: rados osd op timeout = 900 2024-04-17T19:45:55.472 INFO:teuthology.orchestra.run.smithi044.stdout:[mon.a] 2024-04-17T19:45:55.472 INFO:teuthology.orchestra.run.smithi044.stdout:[mon.b] 2024-04-17T19:45:55.472 INFO:teuthology.orchestra.run.smithi044.stdout:[mon.c] 2024-04-17T19:45:55.473 INFO:teuthology.orchestra.run.smithi044.stdout:[mds.a] 2024-04-17T19:45:55.473 INFO:teuthology.orchestra.run.smithi044.stdout:[mds.c] 2024-04-17T19:45:55.473 INFO:teuthology.orchestra.run.smithi044.stdout:[mds.e] 2024-04-17T19:45:55.473 INFO:teuthology.orchestra.run.smithi044.stdout:[mds.b] 2024-04-17T19:45:55.473 INFO:teuthology.orchestra.run.smithi044.stdout:[mds.d] 2024-04-17T19:45:55.473 INFO:teuthology.orchestra.run.smithi044.stdout:[mds.f] 2024-04-17T19:45:55.473 INFO:teuthology.orchestra.run.smithi044.stdout:[mds] 2024-04-17T19:45:55.473 INFO:teuthology.orchestra.run.smithi044.stdout: debug mds = 20 2024-04-17T19:45:55.473 INFO:teuthology.orchestra.run.smithi044.stdout: debug mds balancer = 20 2024-04-17T19:45:55.473 INFO:teuthology.orchestra.run.smithi044.stdout: debug ms = 1 2024-04-17T19:45:55.473 INFO:teuthology.orchestra.run.smithi044.stdout: mds bal fragment size max = 10000 2024-04-17T19:45:55.473 INFO:teuthology.orchestra.run.smithi044.stdout: mds bal merge size = 5 2024-04-17T19:45:55.473 INFO:teuthology.orchestra.run.smithi044.stdout: mds bal split bits = 3 2024-04-17T19:45:55.473 INFO:teuthology.orchestra.run.smithi044.stdout: mds bal split size = 100 2024-04-17T19:45:55.473 INFO:teuthology.orchestra.run.smithi044.stdout: mds debug frag = True 2024-04-17T19:45:55.473 INFO:teuthology.orchestra.run.smithi044.stdout: mds debug scatterstat = True 2024-04-17T19:45:55.473 INFO:teuthology.orchestra.run.smithi044.stdout: mds oft prefetch dirfrags = True 2024-04-17T19:45:55.474 INFO:teuthology.orchestra.run.smithi044.stdout: mds op complaint time = 180 2024-04-17T19:45:55.474 INFO:teuthology.orchestra.run.smithi044.stdout: mds verify scatter = True 2024-04-17T19:45:55.474 INFO:teuthology.orchestra.run.smithi044.stdout: mds_dir_prefetch = True 2024-04-17T19:45:55.474 INFO:teuthology.orchestra.run.smithi044.stdout: mds_sleep_rank_change = 5000000.0 2024-04-17T19:45:55.474 INFO:teuthology.orchestra.run.smithi044.stdout: osd op complaint time = 180 2024-04-17T19:45:55.474 INFO:teuthology.orchestra.run.smithi044.stdout: rados mon op timeout = 900 2024-04-17T19:45:55.474 INFO:teuthology.orchestra.run.smithi044.stdout: rados osd op timeout = 900 2024-04-17T19:45:55.475 INFO:tasks.ceph:Creating admin key on mon.a... 2024-04-17T19:45:55.475 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2024-04-17T19:45:55.588 INFO:tasks.ceph:Copying monmap to all nodes... 2024-04-17T19:45:55.588 DEBUG:teuthology.orchestra.run.smithi044:> set -ex 2024-04-17T19:45:55.588 DEBUG:teuthology.orchestra.run.smithi044:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2024-04-17T19:45:55.596 DEBUG:teuthology.orchestra.run.smithi044:> set -ex 2024-04-17T19:45:55.596 DEBUG:teuthology.orchestra.run.smithi044:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2024-04-17T19:45:55.645 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi044.front.sepia.ceph.com 2024-04-17T19:45:55.645 DEBUG:teuthology.orchestra.run.smithi044:> set -ex 2024-04-17T19:45:55.645 DEBUG:teuthology.orchestra.run.smithi044:> sudo dd of=/etc/ceph/ceph.keyring 2024-04-17T19:45:55.645 DEBUG:teuthology.orchestra.run.smithi044:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-04-17T19:45:55.717 DEBUG:teuthology.orchestra.run.smithi044:> set -ex 2024-04-17T19:45:55.717 DEBUG:teuthology.orchestra.run.smithi044:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-04-17T19:45:55.769 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi062.front.sepia.ceph.com 2024-04-17T19:45:55.769 DEBUG:teuthology.orchestra.run.smithi062:> set -ex 2024-04-17T19:45:55.769 DEBUG:teuthology.orchestra.run.smithi062:> sudo dd of=/etc/ceph/ceph.keyring 2024-04-17T19:45:55.769 DEBUG:teuthology.orchestra.run.smithi062:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-04-17T19:45:55.794 DEBUG:teuthology.orchestra.run.smithi062:> set -ex 2024-04-17T19:45:55.794 DEBUG:teuthology.orchestra.run.smithi062:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-04-17T19:45:55.842 INFO:tasks.ceph:Setting up mon nodes... 2024-04-17T19:45:55.842 INFO:tasks.ceph:Setting up mgr nodes... 2024-04-17T19:45:55.842 DEBUG:teuthology.orchestra.run.smithi044:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2024-04-17T19:45:55.907 INFO:teuthology.orchestra.run.smithi044.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2024-04-17T19:45:55.914 DEBUG:teuthology.orchestra.run.smithi062:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2024-04-17T19:45:55.990 INFO:teuthology.orchestra.run.smithi062.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2024-04-17T19:45:56.018 INFO:tasks.ceph:Setting up mds nodes... 2024-04-17T19:45:56.018 DEBUG:teuthology.orchestra.run.smithi044:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2024-04-17T19:45:56.084 INFO:teuthology.orchestra.run.smithi044.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2024-04-17T19:45:56.090 DEBUG:teuthology.orchestra.run.smithi044:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2024-04-17T19:45:56.110 DEBUG:teuthology.orchestra.run.smithi044:> sudo mkdir -p /var/lib/ceph/mds/ceph-c && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.c /var/lib/ceph/mds/ceph-c/keyring 2024-04-17T19:45:56.222 INFO:teuthology.orchestra.run.smithi044.stdout:creating /var/lib/ceph/mds/ceph-c/keyring 2024-04-17T19:45:56.227 DEBUG:teuthology.orchestra.run.smithi044:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-c 2024-04-17T19:45:56.247 DEBUG:teuthology.orchestra.run.smithi044:> sudo mkdir -p /var/lib/ceph/mds/ceph-e && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.e /var/lib/ceph/mds/ceph-e/keyring 2024-04-17T19:45:56.357 INFO:teuthology.orchestra.run.smithi044.stdout:creating /var/lib/ceph/mds/ceph-e/keyring 2024-04-17T19:45:56.362 DEBUG:teuthology.orchestra.run.smithi044:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-e 2024-04-17T19:45:56.381 DEBUG:teuthology.orchestra.run.smithi062:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2024-04-17T19:45:56.459 INFO:teuthology.orchestra.run.smithi062.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2024-04-17T19:45:56.466 DEBUG:teuthology.orchestra.run.smithi062:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2024-04-17T19:45:56.479 DEBUG:teuthology.orchestra.run.smithi062:> sudo mkdir -p /var/lib/ceph/mds/ceph-d && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.d /var/lib/ceph/mds/ceph-d/keyring 2024-04-17T19:45:56.591 INFO:teuthology.orchestra.run.smithi062.stdout:creating /var/lib/ceph/mds/ceph-d/keyring 2024-04-17T19:45:56.598 DEBUG:teuthology.orchestra.run.smithi062:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-d 2024-04-17T19:45:56.609 DEBUG:teuthology.orchestra.run.smithi062:> sudo mkdir -p /var/lib/ceph/mds/ceph-f && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.f /var/lib/ceph/mds/ceph-f/keyring 2024-04-17T19:45:56.713 INFO:teuthology.orchestra.run.smithi062.stdout:creating /var/lib/ceph/mds/ceph-f/keyring 2024-04-17T19:45:56.720 DEBUG:teuthology.orchestra.run.smithi062:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-f 2024-04-17T19:45:56.730 INFO:tasks.ceph_client:Setting up client nodes... 2024-04-17T19:45:56.731 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-04-17T19:45:56.784 INFO:teuthology.orchestra.run.smithi044.stdout:creating /etc/ceph/ceph.client.0.keyring 2024-04-17T19:45:56.802 INFO:tasks.ceph:Running mkfs on osd nodes... 2024-04-17T19:45:56.802 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi044.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi062.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-04-17T19:45:56.803 DEBUG:teuthology.orchestra.run.smithi044:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2024-04-17T19:45:56.822 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-04-17T19:45:56.822 INFO:tasks.ceph:role: osd.0 2024-04-17T19:45:56.822 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi044.front.sepia.ceph.com 2024-04-17T19:45:56.822 DEBUG:teuthology.orchestra.run.smithi044:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-04-17T19:45:56.892 INFO:teuthology.orchestra.run.smithi044.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-04-17T19:45:56.892 INFO:teuthology.orchestra.run.smithi044.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-17T19:45:56.892 INFO:teuthology.orchestra.run.smithi044.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-17T19:45:56.892 INFO:teuthology.orchestra.run.smithi044.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-04-17T19:45:56.892 INFO:teuthology.orchestra.run.smithi044.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-17T19:45:56.892 INFO:teuthology.orchestra.run.smithi044.stdout: = sunit=0 swidth=0 blks 2024-04-17T19:45:56.892 INFO:teuthology.orchestra.run.smithi044.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-17T19:45:56.892 INFO:teuthology.orchestra.run.smithi044.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-04-17T19:45:56.892 INFO:teuthology.orchestra.run.smithi044.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-17T19:45:56.893 INFO:teuthology.orchestra.run.smithi044.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-17T19:45:57.278 INFO:teuthology.orchestra.run.smithi044.stdout:Discarding blocks...Done. 2024-04-17T19:45:57.280 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi044.front.sepia.ceph.com -o noatime 2024-04-17T19:45:57.280 DEBUG:teuthology.orchestra.run.smithi044:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2024-04-17T19:45:57.373 DEBUG:teuthology.orchestra.run.smithi044:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2024-04-17T19:45:57.433 INFO:teuthology.orchestra.run.smithi044.stderr:sudo: /sbin/restorecon: command not found 2024-04-17T19:45:57.434 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-17T19:45:57.435 DEBUG:teuthology.orchestra.run.smithi044:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2024-04-17T19:45:57.501 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-04-17T19:45:57.501 INFO:tasks.ceph:role: osd.1 2024-04-17T19:45:57.501 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi044.front.sepia.ceph.com 2024-04-17T19:45:57.501 DEBUG:teuthology.orchestra.run.smithi044:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-04-17T19:45:57.572 INFO:teuthology.orchestra.run.smithi044.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-04-17T19:45:57.573 INFO:teuthology.orchestra.run.smithi044.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-17T19:45:57.573 INFO:teuthology.orchestra.run.smithi044.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-17T19:45:57.573 INFO:teuthology.orchestra.run.smithi044.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-04-17T19:45:57.573 INFO:teuthology.orchestra.run.smithi044.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-17T19:45:57.573 INFO:teuthology.orchestra.run.smithi044.stdout: = sunit=0 swidth=0 blks 2024-04-17T19:45:57.573 INFO:teuthology.orchestra.run.smithi044.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-17T19:45:57.573 INFO:teuthology.orchestra.run.smithi044.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-04-17T19:45:57.573 INFO:teuthology.orchestra.run.smithi044.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-17T19:45:57.573 INFO:teuthology.orchestra.run.smithi044.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-17T19:45:57.958 INFO:teuthology.orchestra.run.smithi044.stdout:Discarding blocks...Done. 2024-04-17T19:45:57.961 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi044.front.sepia.ceph.com -o noatime 2024-04-17T19:45:57.961 DEBUG:teuthology.orchestra.run.smithi044:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2024-04-17T19:45:58.100 DEBUG:teuthology.orchestra.run.smithi044:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2024-04-17T19:45:58.118 INFO:teuthology.orchestra.run.smithi044.stderr:sudo: /sbin/restorecon: command not found 2024-04-17T19:45:58.118 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-17T19:45:58.119 DEBUG:teuthology.orchestra.run.smithi044:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2024-04-17T19:45:58.183 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-04-17T19:45:58.183 INFO:tasks.ceph:role: osd.2 2024-04-17T19:45:58.183 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi044.front.sepia.ceph.com 2024-04-17T19:45:58.183 DEBUG:teuthology.orchestra.run.smithi044:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-04-17T19:45:58.254 INFO:teuthology.orchestra.run.smithi044.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-04-17T19:45:58.254 INFO:teuthology.orchestra.run.smithi044.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-17T19:45:58.254 INFO:teuthology.orchestra.run.smithi044.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-17T19:45:58.254 INFO:teuthology.orchestra.run.smithi044.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-04-17T19:45:58.254 INFO:teuthology.orchestra.run.smithi044.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-17T19:45:58.254 INFO:teuthology.orchestra.run.smithi044.stdout: = sunit=0 swidth=0 blks 2024-04-17T19:45:58.255 INFO:teuthology.orchestra.run.smithi044.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-17T19:45:58.255 INFO:teuthology.orchestra.run.smithi044.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-04-17T19:45:58.255 INFO:teuthology.orchestra.run.smithi044.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-17T19:45:58.255 INFO:teuthology.orchestra.run.smithi044.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-17T19:45:58.659 INFO:teuthology.orchestra.run.smithi044.stdout:Discarding blocks...Done. 2024-04-17T19:45:58.662 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi044.front.sepia.ceph.com -o noatime 2024-04-17T19:45:58.663 DEBUG:teuthology.orchestra.run.smithi044:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2024-04-17T19:45:58.792 DEBUG:teuthology.orchestra.run.smithi044:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2024-04-17T19:45:58.810 INFO:teuthology.orchestra.run.smithi044.stderr:sudo: /sbin/restorecon: command not found 2024-04-17T19:45:58.811 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-17T19:45:58.811 DEBUG:teuthology.orchestra.run.smithi044:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2024-04-17T19:45:58.879 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-04-17T19:45:58.879 INFO:tasks.ceph:role: osd.3 2024-04-17T19:45:58.879 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi044.front.sepia.ceph.com 2024-04-17T19:45:58.879 DEBUG:teuthology.orchestra.run.smithi044:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-04-17T19:45:58.951 INFO:teuthology.orchestra.run.smithi044.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-04-17T19:45:58.951 INFO:teuthology.orchestra.run.smithi044.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-17T19:45:58.951 INFO:teuthology.orchestra.run.smithi044.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-17T19:45:58.951 INFO:teuthology.orchestra.run.smithi044.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-04-17T19:45:58.951 INFO:teuthology.orchestra.run.smithi044.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-17T19:45:58.951 INFO:teuthology.orchestra.run.smithi044.stdout: = sunit=0 swidth=0 blks 2024-04-17T19:45:58.951 INFO:teuthology.orchestra.run.smithi044.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-17T19:45:58.951 INFO:teuthology.orchestra.run.smithi044.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-04-17T19:45:58.951 INFO:teuthology.orchestra.run.smithi044.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-17T19:45:58.951 INFO:teuthology.orchestra.run.smithi044.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-17T19:45:59.315 INFO:teuthology.orchestra.run.smithi044.stdout:Discarding blocks...Done. 2024-04-17T19:45:59.318 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi044.front.sepia.ceph.com -o noatime 2024-04-17T19:45:59.319 DEBUG:teuthology.orchestra.run.smithi044:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2024-04-17T19:45:59.409 DEBUG:teuthology.orchestra.run.smithi044:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2024-04-17T19:45:59.471 INFO:teuthology.orchestra.run.smithi044.stderr:sudo: /sbin/restorecon: command not found 2024-04-17T19:45:59.472 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-17T19:45:59.472 DEBUG:teuthology.orchestra.run.smithi044:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-17T19:45:59.619 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:45:59.632+0000 7ff1afdb67c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2024-04-17T19:45:59.623 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:45:59.636+0000 7ff1afdb67c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2024-04-17T19:45:59.623 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:45:59.636+0000 7ff1afdb67c0 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-04-17T19:45:59.623 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:45:59.636+0000 7ff1afdb67c0 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-04-17T19:45:59.623 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:45:59.636+0000 7ff1afdb67c0 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-04-17T19:45:59.628 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:45:59.640+0000 7ff1afdb67c0 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2024-04-17T19:46:02.684 DEBUG:teuthology.orchestra.run.smithi044:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-04-17T19:46:02.706 DEBUG:teuthology.orchestra.run.smithi044:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-17T19:46:02.818 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:02.827+0000 7f15835d37c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2024-04-17T19:46:02.819 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:02.831+0000 7f15835d37c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2024-04-17T19:46:02.819 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:02.831+0000 7f15835d37c0 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-04-17T19:46:02.819 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:02.831+0000 7f15835d37c0 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-04-17T19:46:02.819 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:02.831+0000 7f15835d37c0 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-04-17T19:46:02.820 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:02.831+0000 7f15835d37c0 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2024-04-17T19:46:05.863 DEBUG:teuthology.orchestra.run.smithi044:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-04-17T19:46:05.885 DEBUG:teuthology.orchestra.run.smithi044:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-17T19:46:06.000 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:06.011+0000 7f67235037c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2024-04-17T19:46:06.001 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:06.011+0000 7f67235037c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2024-04-17T19:46:06.001 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:06.011+0000 7f67235037c0 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-04-17T19:46:06.001 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:06.011+0000 7f67235037c0 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-04-17T19:46:06.001 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:06.011+0000 7f67235037c0 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-04-17T19:46:06.003 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:06.015+0000 7f67235037c0 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2024-04-17T19:46:09.058 DEBUG:teuthology.orchestra.run.smithi044:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-04-17T19:46:09.080 DEBUG:teuthology.orchestra.run.smithi044:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-17T19:46:09.189 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:09.199+0000 7f5940f657c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2024-04-17T19:46:09.190 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:09.203+0000 7f5940f657c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2024-04-17T19:46:09.190 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:09.203+0000 7f5940f657c0 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-04-17T19:46:09.191 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:09.203+0000 7f5940f657c0 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-04-17T19:46:09.191 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:09.203+0000 7f5940f657c0 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-04-17T19:46:09.192 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:09.203+0000 7f5940f657c0 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2024-04-17T19:46:12.223 DEBUG:teuthology.orchestra.run.smithi044:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-04-17T19:46:12.246 DEBUG:teuthology.orchestra.run.smithi062:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2024-04-17T19:46:12.262 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-04-17T19:46:12.262 INFO:tasks.ceph:role: osd.4 2024-04-17T19:46:12.263 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi062.front.sepia.ceph.com 2024-04-17T19:46:12.263 DEBUG:teuthology.orchestra.run.smithi062:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-04-17T19:46:12.329 INFO:teuthology.orchestra.run.smithi062.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-04-17T19:46:12.329 INFO:teuthology.orchestra.run.smithi062.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-17T19:46:12.329 INFO:teuthology.orchestra.run.smithi062.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-17T19:46:12.330 INFO:teuthology.orchestra.run.smithi062.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-04-17T19:46:12.330 INFO:teuthology.orchestra.run.smithi062.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-17T19:46:12.330 INFO:teuthology.orchestra.run.smithi062.stdout: = sunit=0 swidth=0 blks 2024-04-17T19:46:12.330 INFO:teuthology.orchestra.run.smithi062.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-17T19:46:12.330 INFO:teuthology.orchestra.run.smithi062.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-04-17T19:46:12.330 INFO:teuthology.orchestra.run.smithi062.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-17T19:46:12.330 INFO:teuthology.orchestra.run.smithi062.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-17T19:46:12.810 INFO:teuthology.orchestra.run.smithi062.stdout:Discarding blocks...Done. 2024-04-17T19:46:12.812 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi062.front.sepia.ceph.com -o noatime 2024-04-17T19:46:12.813 DEBUG:teuthology.orchestra.run.smithi062:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2024-04-17T19:46:12.920 DEBUG:teuthology.orchestra.run.smithi062:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2024-04-17T19:46:12.955 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-17T19:46:12.955 INFO:teuthology.orchestra.run.smithi062.stderr:sudo: /sbin/restorecon: command not found 2024-04-17T19:46:12.956 DEBUG:teuthology.orchestra.run.smithi062:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2024-04-17T19:46:13.010 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-04-17T19:46:13.010 INFO:tasks.ceph:role: osd.5 2024-04-17T19:46:13.010 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi062.front.sepia.ceph.com 2024-04-17T19:46:13.010 DEBUG:teuthology.orchestra.run.smithi062:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-04-17T19:46:13.081 INFO:teuthology.orchestra.run.smithi062.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-04-17T19:46:13.082 INFO:teuthology.orchestra.run.smithi062.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-17T19:46:13.082 INFO:teuthology.orchestra.run.smithi062.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-17T19:46:13.082 INFO:teuthology.orchestra.run.smithi062.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-04-17T19:46:13.082 INFO:teuthology.orchestra.run.smithi062.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-17T19:46:13.082 INFO:teuthology.orchestra.run.smithi062.stdout: = sunit=0 swidth=0 blks 2024-04-17T19:46:13.082 INFO:teuthology.orchestra.run.smithi062.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-17T19:46:13.082 INFO:teuthology.orchestra.run.smithi062.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-04-17T19:46:13.082 INFO:teuthology.orchestra.run.smithi062.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-17T19:46:13.082 INFO:teuthology.orchestra.run.smithi062.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-17T19:46:13.515 INFO:teuthology.orchestra.run.smithi062.stdout:Discarding blocks...Done. 2024-04-17T19:46:13.517 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi062.front.sepia.ceph.com -o noatime 2024-04-17T19:46:13.517 DEBUG:teuthology.orchestra.run.smithi062:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2024-04-17T19:46:13.580 DEBUG:teuthology.orchestra.run.smithi062:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2024-04-17T19:46:13.633 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-17T19:46:13.634 INFO:teuthology.orchestra.run.smithi062.stderr:sudo: /sbin/restorecon: command not found 2024-04-17T19:46:13.634 DEBUG:teuthology.orchestra.run.smithi062:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2024-04-17T19:46:13.687 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-04-17T19:46:13.687 INFO:tasks.ceph:role: osd.6 2024-04-17T19:46:13.687 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi062.front.sepia.ceph.com 2024-04-17T19:46:13.687 DEBUG:teuthology.orchestra.run.smithi062:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-04-17T19:46:13.751 INFO:teuthology.orchestra.run.smithi062.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-04-17T19:46:13.751 INFO:teuthology.orchestra.run.smithi062.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-17T19:46:13.751 INFO:teuthology.orchestra.run.smithi062.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-17T19:46:13.751 INFO:teuthology.orchestra.run.smithi062.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-04-17T19:46:13.751 INFO:teuthology.orchestra.run.smithi062.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-17T19:46:13.751 INFO:teuthology.orchestra.run.smithi062.stdout: = sunit=0 swidth=0 blks 2024-04-17T19:46:13.751 INFO:teuthology.orchestra.run.smithi062.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-17T19:46:13.751 INFO:teuthology.orchestra.run.smithi062.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-04-17T19:46:13.751 INFO:teuthology.orchestra.run.smithi062.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-17T19:46:13.751 INFO:teuthology.orchestra.run.smithi062.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-17T19:46:14.210 INFO:teuthology.orchestra.run.smithi062.stdout:Discarding blocks...Done. 2024-04-17T19:46:14.213 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi062.front.sepia.ceph.com -o noatime 2024-04-17T19:46:14.213 DEBUG:teuthology.orchestra.run.smithi062:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2024-04-17T19:46:14.316 DEBUG:teuthology.orchestra.run.smithi062:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2024-04-17T19:46:14.326 INFO:teuthology.orchestra.run.smithi062.stderr:sudo: /sbin/restorecon: command not found 2024-04-17T19:46:14.327 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-17T19:46:14.327 DEBUG:teuthology.orchestra.run.smithi062:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2024-04-17T19:46:14.383 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-04-17T19:46:14.383 INFO:tasks.ceph:role: osd.7 2024-04-17T19:46:14.383 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi062.front.sepia.ceph.com 2024-04-17T19:46:14.383 DEBUG:teuthology.orchestra.run.smithi062:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-04-17T19:46:14.447 INFO:teuthology.orchestra.run.smithi062.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-04-17T19:46:14.447 INFO:teuthology.orchestra.run.smithi062.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-17T19:46:14.447 INFO:teuthology.orchestra.run.smithi062.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-17T19:46:14.447 INFO:teuthology.orchestra.run.smithi062.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-04-17T19:46:14.448 INFO:teuthology.orchestra.run.smithi062.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-17T19:46:14.448 INFO:teuthology.orchestra.run.smithi062.stdout: = sunit=0 swidth=0 blks 2024-04-17T19:46:14.448 INFO:teuthology.orchestra.run.smithi062.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-17T19:46:14.448 INFO:teuthology.orchestra.run.smithi062.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-04-17T19:46:14.448 INFO:teuthology.orchestra.run.smithi062.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-17T19:46:14.448 INFO:teuthology.orchestra.run.smithi062.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-17T19:46:14.912 INFO:teuthology.orchestra.run.smithi062.stdout:Discarding blocks...Done. 2024-04-17T19:46:14.914 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi062.front.sepia.ceph.com -o noatime 2024-04-17T19:46:14.915 DEBUG:teuthology.orchestra.run.smithi062:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2024-04-17T19:46:15.041 DEBUG:teuthology.orchestra.run.smithi062:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2024-04-17T19:46:15.053 INFO:teuthology.orchestra.run.smithi062.stderr:sudo: /sbin/restorecon: command not found 2024-04-17T19:46:15.053 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-17T19:46:15.054 DEBUG:teuthology.orchestra.run.smithi062:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-17T19:46:15.196 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-17T19:46:15.208+0000 7fe6dc5477c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2024-04-17T19:46:15.199 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-17T19:46:15.212+0000 7fe6dc5477c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2024-04-17T19:46:15.199 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-17T19:46:15.212+0000 7fe6dc5477c0 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-04-17T19:46:15.199 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-17T19:46:15.212+0000 7fe6dc5477c0 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-04-17T19:46:15.200 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-17T19:46:15.212+0000 7fe6dc5477c0 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-04-17T19:46:15.204 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-17T19:46:15.216+0000 7fe6dc5477c0 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2024-04-17T19:46:18.173 DEBUG:teuthology.orchestra.run.smithi062:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-04-17T19:46:18.187 DEBUG:teuthology.orchestra.run.smithi062:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-17T19:46:18.303 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-17T19:46:18.315+0000 7efdbbc747c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2024-04-17T19:46:18.304 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-17T19:46:18.315+0000 7efdbbc747c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2024-04-17T19:46:18.305 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-17T19:46:18.315+0000 7efdbbc747c0 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-04-17T19:46:18.305 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-17T19:46:18.315+0000 7efdbbc747c0 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-04-17T19:46:18.305 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-17T19:46:18.315+0000 7efdbbc747c0 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-04-17T19:46:18.305 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-17T19:46:18.315+0000 7efdbbc747c0 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2024-04-17T19:46:21.286 DEBUG:teuthology.orchestra.run.smithi062:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-04-17T19:46:21.300 DEBUG:teuthology.orchestra.run.smithi062:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-17T19:46:21.410 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-17T19:46:21.419+0000 7fbbce8d17c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2024-04-17T19:46:21.410 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-17T19:46:21.419+0000 7fbbce8d17c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2024-04-17T19:46:21.410 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-17T19:46:21.419+0000 7fbbce8d17c0 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-04-17T19:46:21.410 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-17T19:46:21.419+0000 7fbbce8d17c0 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-04-17T19:46:21.411 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-17T19:46:21.419+0000 7fbbce8d17c0 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-04-17T19:46:21.411 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-17T19:46:21.423+0000 7fbbce8d17c0 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2024-04-17T19:46:23.621 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T19:46:23.625 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T19:46:24.390 DEBUG:teuthology.orchestra.run.smithi062:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2024-04-17T19:46:24.402 DEBUG:teuthology.orchestra.run.smithi062:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-17T19:46:24.518 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-17T19:46:24.527+0000 7f3ffd6957c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2024-04-17T19:46:24.519 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-17T19:46:24.527+0000 7f3ffd6957c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2024-04-17T19:46:24.519 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-17T19:46:24.527+0000 7f3ffd6957c0 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-04-17T19:46:24.519 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-17T19:46:24.531+0000 7f3ffd6957c0 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-04-17T19:46:24.519 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-17T19:46:24.531+0000 7f3ffd6957c0 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-04-17T19:46:24.520 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-17T19:46:24.531+0000 7f3ffd6957c0 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2024-04-17T19:46:27.500 DEBUG:teuthology.orchestra.run.smithi062:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2024-04-17T19:46:27.515 INFO:tasks.ceph:Reading keys from all nodes... 2024-04-17T19:46:27.515 DEBUG:teuthology.orchestra.run.smithi044:> set -ex 2024-04-17T19:46:27.516 DEBUG:teuthology.orchestra.run.smithi044:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2024-04-17T19:46:27.539 DEBUG:teuthology.orchestra.run.smithi044:> set -ex 2024-04-17T19:46:27.539 DEBUG:teuthology.orchestra.run.smithi044:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2024-04-17T19:46:27.607 DEBUG:teuthology.orchestra.run.smithi044:> set -ex 2024-04-17T19:46:27.607 DEBUG:teuthology.orchestra.run.smithi044:> sudo dd if=/var/lib/ceph/mds/ceph-c/keyring of=/dev/stdout 2024-04-17T19:46:27.675 DEBUG:teuthology.orchestra.run.smithi044:> set -ex 2024-04-17T19:46:27.675 DEBUG:teuthology.orchestra.run.smithi044:> sudo dd if=/var/lib/ceph/mds/ceph-e/keyring of=/dev/stdout 2024-04-17T19:46:27.743 DEBUG:teuthology.orchestra.run.smithi044:> set -ex 2024-04-17T19:46:27.744 DEBUG:teuthology.orchestra.run.smithi044:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2024-04-17T19:46:27.811 DEBUG:teuthology.orchestra.run.smithi044:> set -ex 2024-04-17T19:46:27.811 DEBUG:teuthology.orchestra.run.smithi044:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2024-04-17T19:46:27.875 DEBUG:teuthology.orchestra.run.smithi044:> set -ex 2024-04-17T19:46:27.875 DEBUG:teuthology.orchestra.run.smithi044:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2024-04-17T19:46:27.939 DEBUG:teuthology.orchestra.run.smithi044:> set -ex 2024-04-17T19:46:27.939 DEBUG:teuthology.orchestra.run.smithi044:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2024-04-17T19:46:28.007 DEBUG:teuthology.orchestra.run.smithi062:> set -ex 2024-04-17T19:46:28.007 DEBUG:teuthology.orchestra.run.smithi062:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2024-04-17T19:46:28.022 DEBUG:teuthology.orchestra.run.smithi062:> set -ex 2024-04-17T19:46:28.022 DEBUG:teuthology.orchestra.run.smithi062:> sudo dd if=/var/lib/ceph/mds/ceph-b/keyring of=/dev/stdout 2024-04-17T19:46:28.075 DEBUG:teuthology.orchestra.run.smithi062:> set -ex 2024-04-17T19:46:28.075 DEBUG:teuthology.orchestra.run.smithi062:> sudo dd if=/var/lib/ceph/mds/ceph-d/keyring of=/dev/stdout 2024-04-17T19:46:28.131 DEBUG:teuthology.orchestra.run.smithi062:> set -ex 2024-04-17T19:46:28.131 DEBUG:teuthology.orchestra.run.smithi062:> sudo dd if=/var/lib/ceph/mds/ceph-f/keyring of=/dev/stdout 2024-04-17T19:46:28.188 DEBUG:teuthology.orchestra.run.smithi062:> set -ex 2024-04-17T19:46:28.188 DEBUG:teuthology.orchestra.run.smithi062:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2024-04-17T19:46:28.243 DEBUG:teuthology.orchestra.run.smithi062:> set -ex 2024-04-17T19:46:28.244 DEBUG:teuthology.orchestra.run.smithi062:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2024-04-17T19:46:28.299 DEBUG:teuthology.orchestra.run.smithi062:> set -ex 2024-04-17T19:46:28.299 DEBUG:teuthology.orchestra.run.smithi062:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2024-04-17T19:46:28.356 DEBUG:teuthology.orchestra.run.smithi062:> set -ex 2024-04-17T19:46:28.356 DEBUG:teuthology.orchestra.run.smithi062:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2024-04-17T19:46:28.411 DEBUG:teuthology.orchestra.run.smithi044:> set -ex 2024-04-17T19:46:28.412 DEBUG:teuthology.orchestra.run.smithi044:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2024-04-17T19:46:28.420 INFO:tasks.ceph:Adding keys to all mons... 2024-04-17T19:46:28.421 DEBUG:teuthology.orchestra.run.smithi044:> sudo tee -a /etc/ceph/ceph.keyring 2024-04-17T19:46:28.469 DEBUG:teuthology.orchestra.run.smithi062:> sudo tee -a /etc/ceph/ceph.keyring 2024-04-17T19:46:28.480 INFO:teuthology.orchestra.run.smithi062.stdout:[mgr.y] 2024-04-17T19:46:28.480 INFO:teuthology.orchestra.run.smithi062.stdout: key = AQDzJiBmoTUGNxAAntnM4uI+BrceaDtGwLFeEA== 2024-04-17T19:46:28.480 INFO:teuthology.orchestra.run.smithi062.stdout:[mds.a] 2024-04-17T19:46:28.480 INFO:teuthology.orchestra.run.smithi062.stdout: key = AQD0JiBm1yn1BRAAPmsrYRRJ//GiY28OkSra3w== 2024-04-17T19:46:28.480 INFO:teuthology.orchestra.run.smithi062.stdout:[mds.c] 2024-04-17T19:46:28.480 INFO:teuthology.orchestra.run.smithi062.stdout: key = AQD0JiBmrZctDhAAtUrujSxt2LRS3UgOO/oJTg== 2024-04-17T19:46:28.481 INFO:teuthology.orchestra.run.smithi062.stdout:[mds.e] 2024-04-17T19:46:28.481 INFO:teuthology.orchestra.run.smithi062.stdout: key = AQD0JiBme741FhAA041z9XfzUkhE1wj2EcJkbQ== 2024-04-17T19:46:28.481 INFO:teuthology.orchestra.run.smithi062.stdout:[osd.0] 2024-04-17T19:46:28.481 INFO:teuthology.orchestra.run.smithi062.stdout: key = AQD3JiBm08fXJRAAq9QihVJKtfBPD1t6QVvIsA== 2024-04-17T19:46:28.481 INFO:teuthology.orchestra.run.smithi062.stdout:[osd.1] 2024-04-17T19:46:28.481 INFO:teuthology.orchestra.run.smithi062.stdout: key = AQD6JiBmQhKpMRAAfmUDhc+Wa5huq/uLI9NdPw== 2024-04-17T19:46:28.481 INFO:teuthology.orchestra.run.smithi062.stdout:[osd.2] 2024-04-17T19:46:28.481 INFO:teuthology.orchestra.run.smithi062.stdout: key = AQD+JiBmoD/wABAA0zyt/aIbD69GV6JuEmPfmQ== 2024-04-17T19:46:28.481 INFO:teuthology.orchestra.run.smithi062.stdout:[osd.3] 2024-04-17T19:46:28.481 INFO:teuthology.orchestra.run.smithi062.stdout: key = AQABJyBmx90yDBAAKtpYJ2e/dsYKqSKAXOIoaQ== 2024-04-17T19:46:28.481 INFO:teuthology.orchestra.run.smithi062.stdout:[mgr.x] 2024-04-17T19:46:28.482 INFO:teuthology.orchestra.run.smithi062.stdout: key = AQD0JiBmXydwABAAE8og9EU37tRXKbEoPpRDsA== 2024-04-17T19:46:28.482 INFO:teuthology.orchestra.run.smithi062.stdout:[mds.b] 2024-04-17T19:46:28.482 INFO:teuthology.orchestra.run.smithi062.stdout: key = AQD0JiBmScJfHBAAOojrCaOjgAl+74pT0F08jQ== 2024-04-17T19:46:28.482 INFO:teuthology.orchestra.run.smithi062.stdout:[mds.d] 2024-04-17T19:46:28.482 INFO:teuthology.orchestra.run.smithi062.stdout: key = AQD0JiBmDfQ6JBAAoJ/aFDNXFzWCcfLsd8DXaw== 2024-04-17T19:46:28.482 INFO:teuthology.orchestra.run.smithi062.stdout:[mds.f] 2024-04-17T19:46:28.482 INFO:teuthology.orchestra.run.smithi062.stdout: key = AQD0JiBm2hqGKxAAF89quFM3s3PJW3EwRHm5LA== 2024-04-17T19:46:28.482 INFO:teuthology.orchestra.run.smithi062.stdout:[osd.4] 2024-04-17T19:46:28.482 INFO:teuthology.orchestra.run.smithi062.stdout: key = AQAHJyBmYeKaDBAAztIVAUyp0vgmOWum2wiWGw== 2024-04-17T19:46:28.482 INFO:teuthology.orchestra.run.smithi062.stdout:[osd.5] 2024-04-17T19:46:28.482 INFO:teuthology.orchestra.run.smithi062.stdout: key = AQAKJyBmP0wBExAAqg8Y8y1px7gLJWsDuh+xnQ== 2024-04-17T19:46:28.482 INFO:teuthology.orchestra.run.smithi062.stdout:[osd.6] 2024-04-17T19:46:28.483 INFO:teuthology.orchestra.run.smithi062.stdout: key = AQANJyBmSTtTGRAAtPj4mxqp/HftnV8r5RCzbQ== 2024-04-17T19:46:28.483 INFO:teuthology.orchestra.run.smithi062.stdout:[osd.7] 2024-04-17T19:46:28.483 INFO:teuthology.orchestra.run.smithi062.stdout: key = AQAQJyBmd1PKHxAAA7W59qdGsbtOl7KyBQqnlw== 2024-04-17T19:46:28.483 INFO:teuthology.orchestra.run.smithi062.stdout:[client.0] 2024-04-17T19:46:28.483 INFO:teuthology.orchestra.run.smithi062.stdout: key = AQD0JiBmyJ+yLxAA7YhvHKBhBnxYOxQ60AjrQQ== 2024-04-17T19:46:28.485 INFO:teuthology.orchestra.run.smithi044.stdout:[mgr.y] 2024-04-17T19:46:28.485 INFO:teuthology.orchestra.run.smithi044.stdout: key = AQDzJiBmoTUGNxAAntnM4uI+BrceaDtGwLFeEA== 2024-04-17T19:46:28.485 INFO:teuthology.orchestra.run.smithi044.stdout:[mds.a] 2024-04-17T19:46:28.485 INFO:teuthology.orchestra.run.smithi044.stdout: key = AQD0JiBm1yn1BRAAPmsrYRRJ//GiY28OkSra3w== 2024-04-17T19:46:28.485 INFO:teuthology.orchestra.run.smithi044.stdout:[mds.c] 2024-04-17T19:46:28.485 INFO:teuthology.orchestra.run.smithi044.stdout: key = AQD0JiBmrZctDhAAtUrujSxt2LRS3UgOO/oJTg== 2024-04-17T19:46:28.485 INFO:teuthology.orchestra.run.smithi044.stdout:[mds.e] 2024-04-17T19:46:28.485 INFO:teuthology.orchestra.run.smithi044.stdout: key = AQD0JiBme741FhAA041z9XfzUkhE1wj2EcJkbQ== 2024-04-17T19:46:28.485 INFO:teuthology.orchestra.run.smithi044.stdout:[osd.0] 2024-04-17T19:46:28.486 INFO:teuthology.orchestra.run.smithi044.stdout: key = AQD3JiBm08fXJRAAq9QihVJKtfBPD1t6QVvIsA== 2024-04-17T19:46:28.486 INFO:teuthology.orchestra.run.smithi044.stdout:[osd.1] 2024-04-17T19:46:28.486 INFO:teuthology.orchestra.run.smithi044.stdout: key = AQD6JiBmQhKpMRAAfmUDhc+Wa5huq/uLI9NdPw== 2024-04-17T19:46:28.486 INFO:teuthology.orchestra.run.smithi044.stdout:[osd.2] 2024-04-17T19:46:28.486 INFO:teuthology.orchestra.run.smithi044.stdout: key = AQD+JiBmoD/wABAA0zyt/aIbD69GV6JuEmPfmQ== 2024-04-17T19:46:28.486 INFO:teuthology.orchestra.run.smithi044.stdout:[osd.3] 2024-04-17T19:46:28.486 INFO:teuthology.orchestra.run.smithi044.stdout: key = AQABJyBmx90yDBAAKtpYJ2e/dsYKqSKAXOIoaQ== 2024-04-17T19:46:28.486 INFO:teuthology.orchestra.run.smithi044.stdout:[mgr.x] 2024-04-17T19:46:28.486 INFO:teuthology.orchestra.run.smithi044.stdout: key = AQD0JiBmXydwABAAE8og9EU37tRXKbEoPpRDsA== 2024-04-17T19:46:28.486 INFO:teuthology.orchestra.run.smithi044.stdout:[mds.b] 2024-04-17T19:46:28.486 INFO:teuthology.orchestra.run.smithi044.stdout: key = AQD0JiBmScJfHBAAOojrCaOjgAl+74pT0F08jQ== 2024-04-17T19:46:28.486 INFO:teuthology.orchestra.run.smithi044.stdout:[mds.d] 2024-04-17T19:46:28.487 INFO:teuthology.orchestra.run.smithi044.stdout: key = AQD0JiBmDfQ6JBAAoJ/aFDNXFzWCcfLsd8DXaw== 2024-04-17T19:46:28.487 INFO:teuthology.orchestra.run.smithi044.stdout:[mds.f] 2024-04-17T19:46:28.487 INFO:teuthology.orchestra.run.smithi044.stdout: key = AQD0JiBm2hqGKxAAF89quFM3s3PJW3EwRHm5LA== 2024-04-17T19:46:28.487 INFO:teuthology.orchestra.run.smithi044.stdout:[osd.4] 2024-04-17T19:46:28.487 INFO:teuthology.orchestra.run.smithi044.stdout: key = AQAHJyBmYeKaDBAAztIVAUyp0vgmOWum2wiWGw== 2024-04-17T19:46:28.487 INFO:teuthology.orchestra.run.smithi044.stdout:[osd.5] 2024-04-17T19:46:28.487 INFO:teuthology.orchestra.run.smithi044.stdout: key = AQAKJyBmP0wBExAAqg8Y8y1px7gLJWsDuh+xnQ== 2024-04-17T19:46:28.487 INFO:teuthology.orchestra.run.smithi044.stdout:[osd.6] 2024-04-17T19:46:28.487 INFO:teuthology.orchestra.run.smithi044.stdout: key = AQANJyBmSTtTGRAAtPj4mxqp/HftnV8r5RCzbQ== 2024-04-17T19:46:28.487 INFO:teuthology.orchestra.run.smithi044.stdout:[osd.7] 2024-04-17T19:46:28.487 INFO:teuthology.orchestra.run.smithi044.stdout: key = AQAQJyBmd1PKHxAAA7W59qdGsbtOl7KyBQqnlw== 2024-04-17T19:46:28.487 INFO:teuthology.orchestra.run.smithi044.stdout:[client.0] 2024-04-17T19:46:28.488 INFO:teuthology.orchestra.run.smithi044.stdout: key = AQD0JiBmyJ+yLxAA7YhvHKBhBnxYOxQ60AjrQQ== 2024-04-17T19:46:28.488 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-04-17T19:46:28.536 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-04-17T19:46:28.619 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-17T19:46:28.622 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-17T19:46:28.702 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-17T19:46:28.705 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-17T19:46:28.784 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.e --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-17T19:46:28.787 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.e --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-17T19:46:28.865 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-17T19:46:28.868 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-17T19:46:28.938 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-17T19:46:28.941 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-17T19:46:29.010 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-17T19:46:29.014 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-17T19:46:29.085 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-17T19:46:29.088 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-17T19:46:29.158 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-04-17T19:46:29.161 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-04-17T19:46:29.238 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-17T19:46:29.241 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-17T19:46:29.314 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-17T19:46:29.318 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-17T19:46:29.391 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.f --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-17T19:46:29.395 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.f --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-17T19:46:29.468 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-17T19:46:29.472 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-17T19:46:29.541 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-17T19:46:29.545 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-17T19:46:29.616 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-17T19:46:29.620 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-17T19:46:29.690 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-17T19:46:29.693 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-17T19:46:29.764 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-04-17T19:46:29.768 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-04-17T19:46:29.840 INFO:tasks.ceph:Running mkfs on mon nodes... 2024-04-17T19:46:29.840 DEBUG:teuthology.orchestra.run.smithi044:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2024-04-17T19:46:29.860 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-04-17T19:46:29.986 DEBUG:teuthology.orchestra.run.smithi044:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2024-04-17T19:46:30.006 DEBUG:teuthology.orchestra.run.smithi062:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2024-04-17T19:46:30.020 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-04-17T19:46:30.149 DEBUG:teuthology.orchestra.run.smithi062:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2024-04-17T19:46:30.161 DEBUG:teuthology.orchestra.run.smithi062:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2024-04-17T19:46:30.219 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-04-17T19:46:30.352 DEBUG:teuthology.orchestra.run.smithi062:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2024-04-17T19:46:30.364 DEBUG:teuthology.orchestra.run.smithi044:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-04-17T19:46:30.367 DEBUG:teuthology.orchestra.run.smithi062:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-04-17T19:46:30.411 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2024-04-17T19:46:30.411 INFO:tasks.ceph.mon.a:Restarting daemon 2024-04-17T19:46:30.411 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2024-04-17T19:46:30.417 INFO:tasks.ceph.mon.a:Started 2024-04-17T19:46:30.417 INFO:tasks.ceph.mon.b:Restarting daemon 2024-04-17T19:46:30.417 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2024-04-17T19:46:30.456 INFO:tasks.ceph.mon.b:Started 2024-04-17T19:46:30.457 INFO:tasks.ceph.mon.c:Restarting daemon 2024-04-17T19:46:30.457 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2024-04-17T19:46:30.458 INFO:tasks.ceph.mon.c:Started 2024-04-17T19:46:30.459 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2024-04-17T19:46:30.459 INFO:tasks.ceph.mgr.y:Restarting daemon 2024-04-17T19:46:30.459 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2024-04-17T19:46:30.462 INFO:tasks.ceph.mgr.y:Started 2024-04-17T19:46:30.462 INFO:tasks.ceph.mgr.x:Restarting daemon 2024-04-17T19:46:30.462 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2024-04-17T19:46:30.465 INFO:tasks.ceph.mgr.x:Started 2024-04-17T19:46:30.465 INFO:tasks.ceph:Setting crush tunables to default 2024-04-17T19:46:30.465 DEBUG:teuthology.orchestra.run.smithi044:> sudo ceph --cluster ceph osd crush tunables default 2024-04-17T19:46:30.620 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:30.631+0000 7f6d73200640 1 Processor -- start 2024-04-17T19:46:30.620 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:30.631+0000 7f6d73200640 1 -- start start 2024-04-17T19:46:30.623 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:30.631+0000 7f6d73200640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f6d740b3b50 0x7f6d7415d650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:46:30.623 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:30.631+0000 7f6d73200640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f6d740ccbc0 0x7f6d740ccfd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:46:30.623 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:30.631+0000 7f6d73200640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6d7415a6d0 con 0x7f6d740cb560 2024-04-17T19:46:30.623 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:30.631+0000 7f6d73200640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 -- 0x7f6d74159e30 con 0x7f6d740b3b50 2024-04-17T19:46:30.623 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:30.631+0000 7f6d73200640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 -- 0x7f6d7415a110 con 0x7f6d740ccbc0 2024-04-17T19:46:30.623 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:30.635+0000 7f6d71e00640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f6d740b3b50 0x7f6d7415d650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:46:30.623 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:30.635+0000 7f6d71e00640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f6d740b3b50 0x7f6d7415d650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:60154/0 (socket says 172.21.15.44:60154) 2024-04-17T19:46:30.623 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:30.635+0000 7f6d71e00640 1 -- 172.21.15.44:0/1632602302 learned_addr learned my addr 172.21.15.44:0/1632602302 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-04-17T19:46:30.623 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:30.635+0000 7f6d72800640 1 --1- 172.21.15.44:0/1632602302 >> v1:172.21.15.44:6789/0 conn(0x7f6d740cb560 0x7f6d740701a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:56994/0 (socket says 172.21.15.44:56994) 2024-04-17T19:46:30.623 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:30.635+0000 7f6d71400640 1 --2- 172.21.15.44:0/1632602302 >> v2:172.21.15.62:3300/0 conn(0x7f6d740ccbc0 0x7f6d740ccfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:46:30.623 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:30.635+0000 7f6d71e00640 1 -- 172.21.15.44:0/1632602302 >> v2:172.21.15.44:3300/0 conn(0x7f6d740b3b50 msgr2=0x7f6d7415d650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-04-17T19:46:30.624 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:30.635+0000 7f6d71e00640 1 -- 172.21.15.44:0/1632602302 >> v2:172.21.15.44:3300/0 conn(0x7f6d740b3b50 msgr2=0x7f6d7415d650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-17T19:46:30.624 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:30.635+0000 7f6d71e00640 1 --2- 172.21.15.44:0/1632602302 >> v2:172.21.15.44:3300/0 conn(0x7f6d740b3b50 0x7f6d7415d650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-17T19:46:30.624 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:30.635+0000 7f6d71e00640 1 --2- 172.21.15.44:0/1632602302 >> v2:172.21.15.44:3300/0 conn(0x7f6d740b3b50 0x7f6d7415d650 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-17T19:46:30.624 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:30.635+0000 7f6d71400640 1 -- 172.21.15.44:0/1632602302 >> v2:172.21.15.62:3300/0 conn(0x7f6d740ccbc0 msgr2=0x7f6d740ccfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-04-17T19:46:30.624 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:30.635+0000 7f6d71400640 1 -- 172.21.15.44:0/1632602302 >> v2:172.21.15.62:3300/0 conn(0x7f6d740ccbc0 msgr2=0x7f6d740ccfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-17T19:46:30.624 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:30.635+0000 7f6d71400640 1 --2- 172.21.15.44:0/1632602302 >> v2:172.21.15.62:3300/0 conn(0x7f6d740ccbc0 0x7f6d740ccfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-17T19:46:30.624 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:30.635+0000 7f6d71400640 1 --2- 172.21.15.44:0/1632602302 >> v2:172.21.15.62:3300/0 conn(0x7f6d740ccbc0 0x7f6d740ccfd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-17T19:46:30.827 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:30.839+0000 7f6d71e00640 1 --2- 172.21.15.44:0/1632602302 >> v2:172.21.15.44:3300/0 conn(0x7f6d740b3b50 0x7f6d7415d650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:46:30.827 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:30.839+0000 7f6d71400640 1 --2- 172.21.15.44:0/1632602302 >> v2:172.21.15.62:3300/0 conn(0x7f6d740ccbc0 0x7f6d740ccfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:46:30.827 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:30.839+0000 7f6d71e00640 1 -- 172.21.15.44:0/1632602302 >> v2:172.21.15.44:3300/0 conn(0x7f6d740b3b50 msgr2=0x7f6d7415d650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-04-17T19:46:30.827 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:30.839+0000 7f6d71e00640 1 -- 172.21.15.44:0/1632602302 >> v2:172.21.15.44:3300/0 conn(0x7f6d740b3b50 msgr2=0x7f6d7415d650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-17T19:46:30.827 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:30.839+0000 7f6d71e00640 1 --2- 172.21.15.44:0/1632602302 >> v2:172.21.15.44:3300/0 conn(0x7f6d740b3b50 0x7f6d7415d650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-17T19:46:30.827 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:30.839+0000 7f6d71e00640 1 --2- 172.21.15.44:0/1632602302 >> v2:172.21.15.44:3300/0 conn(0x7f6d740b3b50 0x7f6d7415d650 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-17T19:46:30.828 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:30.839+0000 7f6d71400640 1 -- 172.21.15.44:0/1632602302 >> v2:172.21.15.62:3300/0 conn(0x7f6d740ccbc0 msgr2=0x7f6d740ccfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-04-17T19:46:30.828 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:30.839+0000 7f6d71400640 1 -- 172.21.15.44:0/1632602302 >> v2:172.21.15.62:3300/0 conn(0x7f6d740ccbc0 msgr2=0x7f6d740ccfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-17T19:46:30.828 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:30.839+0000 7f6d71400640 1 --2- 172.21.15.44:0/1632602302 >> v2:172.21.15.62:3300/0 conn(0x7f6d740ccbc0 0x7f6d740ccfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-17T19:46:30.828 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:30.839+0000 7f6d71400640 1 --2- 172.21.15.44:0/1632602302 >> v2:172.21.15.62:3300/0 conn(0x7f6d740ccbc0 0x7f6d740ccfd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-17T19:46:30.844 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:30.855+0000 7f6d70a00640 1 -- 172.21.15.44:0/1632602302 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1003285952 0 0) 0x7f6d7415a6d0 con 0x7f6d740cb560 2024-04-17T19:46:30.845 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:30.855+0000 7f6d70a00640 1 -- 172.21.15.44:0/1632602302 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6d58003530 con 0x7f6d740cb560 2024-04-17T19:46:30.847 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:30.855+0000 7f6d70a00640 1 -- 172.21.15.44:0/1632602302 <== mon.0 v1:172.21.15.44:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2014362487 0 0) 0x7f6d58003530 con 0x7f6d740cb560 2024-04-17T19:46:30.847 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:30.855+0000 7f6d70a00640 1 -- 172.21.15.44:0/1632602302 >> v2:172.21.15.62:3300/0 conn(0x7f6d740ccbc0 msgr2=0x7f6d740ccfd0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-17T19:46:30.847 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:30.855+0000 7f6d70a00640 1 --2- 172.21.15.44:0/1632602302 >> v2:172.21.15.62:3300/0 conn(0x7f6d740ccbc0 0x7f6d740ccfd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:46:30.848 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:30.855+0000 7f6d70a00640 1 -- 172.21.15.44:0/1632602302 >> v2:172.21.15.44:3300/0 conn(0x7f6d740b3b50 msgr2=0x7f6d7415d650 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-17T19:46:30.848 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:30.855+0000 7f6d70a00640 1 --2- 172.21.15.44:0/1632602302 >> v2:172.21.15.44:3300/0 conn(0x7f6d740b3b50 0x7f6d7415d650 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:46:30.848 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:30.855+0000 7f6d70a00640 1 -- 172.21.15.44:0/1632602302 --> v1:172.21.15.44:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6d7415a3f0 con 0x7f6d740cb560 2024-04-17T19:46:30.848 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:30.855+0000 7f6d70a00640 1 -- 172.21.15.44:0/1632602302 <== mon.0 v1:172.21.15.44:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1863569991 0 0) 0x7f6d6c001a20 con 0x7f6d740cb560 2024-04-17T19:46:30.848 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:30.855+0000 7f6d70a00640 1 -- 172.21.15.44:0/1632602302 >> v1:172.21.15.44:6789/0 conn(0x7f6d740cb560 legacy=0x7f6d740701a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:46:30.848 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:30.855+0000 7f6d70a00640 1 --2- 172.21.15.44:0/1632602302 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6d58003a10 0x7f6d58003e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:46:30.848 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:30.855+0000 7f6d70a00640 1 --2- 172.21.15.44:0/1632602302 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6d58004810 0x7f6d58004c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:46:30.848 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:30.855+0000 7f6d70a00640 1 --2- 172.21.15.44:0/1632602302 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f6d58005280 0x7f6d5800b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:46:30.848 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:30.855+0000 7f6d70a00640 1 -- 172.21.15.44:0/1632602302 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f6d74159e30 con 0x7f6d58004810 2024-04-17T19:46:30.848 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:30.855+0000 7f6d70a00640 1 -- 172.21.15.44:0/1632602302 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f6d7415a110 con 0x7f6d58003a10 2024-04-17T19:46:30.848 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:30.855+0000 7f6d70a00640 1 -- 172.21.15.44:0/1632602302 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7f6d5800c220 con 0x7f6d58005280 2024-04-17T19:46:30.849 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:30.859+0000 7f6d71400640 1 --2- 172.21.15.44:0/1632602302 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6d58004810 0x7f6d58004c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:46:30.849 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:30.859+0000 7f6d71e00640 1 --2- 172.21.15.44:0/1632602302 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6d58003a10 0x7f6d58003e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:46:30.849 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:30.859+0000 7f6d72800640 1 --2- 172.21.15.44:0/1632602302 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f6d58005280 0x7f6d5800b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:46:30.849 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:30.859+0000 7f6d71400640 1 -- 172.21.15.44:0/1632602302 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f6d58005280 msgr2=0x7f6d5800b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T19:46:30.849 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:30.859+0000 7f6d71400640 1 --2- 172.21.15.44:0/1632602302 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f6d58005280 0x7f6d5800b9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:46:30.849 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:30.859+0000 7f6d71400640 1 -- 172.21.15.44:0/1632602302 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6d58003a10 msgr2=0x7f6d58003e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T19:46:30.849 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:30.859+0000 7f6d71400640 1 --2- 172.21.15.44:0/1632602302 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6d58003a10 0x7f6d58003e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:46:30.849 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:30.859+0000 7f6d71400640 1 -- 172.21.15.44:0/1632602302 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6d58003530 con 0x7f6d58004810 2024-04-17T19:46:30.849 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:30.859+0000 7f6d72800640 1 -- 172.21.15.44:0/1632602302 reap_dead start 2024-04-17T19:46:30.849 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:30.859+0000 7f6d71e00640 1 --2- 172.21.15.44:0/1632602302 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6d58003a10 0x7f6d58003e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-17T19:46:30.850 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:30.859+0000 7f6d71400640 1 --2- 172.21.15.44:0/1632602302 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6d58004810 0x7f6d58004c20 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f6d7406fcf0 tx=0x7f6d6001c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=540f2bdf8fd769ed server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:46:30.850 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:30.859+0000 7f6d70a00640 1 -- 172.21.15.44:0/1632602302 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d600ae020 con 0x7f6d58004810 2024-04-17T19:46:30.850 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:30.859+0000 7f6d70a00640 1 -- 172.21.15.44:0/1632602302 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6d600a6650 con 0x7f6d58004810 2024-04-17T19:46:30.850 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:30.859+0000 7f6d70a00640 1 -- 172.21.15.44:0/1632602302 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d6000d660 con 0x7f6d58004810 2024-04-17T19:46:30.851 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:30.863+0000 7f6d73200640 1 -- 172.21.15.44:0/1632602302 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6d58004810 msgr2=0x7f6d58004c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:46:30.851 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:30.863+0000 7f6d73200640 1 --2- 172.21.15.44:0/1632602302 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6d58004810 0x7f6d58004c20 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f6d7406fcf0 tx=0x7f6d6001c960 comp rx=0 tx=0).stop 2024-04-17T19:46:30.851 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:30.863+0000 7f6d73200640 1 -- 172.21.15.44:0/1632602302 shutdown_connections 2024-04-17T19:46:30.851 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:30.863+0000 7f6d73200640 1 --2- 172.21.15.44:0/1632602302 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6d58004810 0x7f6d58004c20 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:46:30.851 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:30.863+0000 7f6d73200640 1 -- 172.21.15.44:0/1632602302 >> 172.21.15.44:0/1632602302 conn(0x7f6d74072150 msgr2=0x7f6d74072560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:46:30.852 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:30.863+0000 7f6d73200640 1 -- 172.21.15.44:0/1632602302 shutdown_connections 2024-04-17T19:46:30.852 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:30.863+0000 7f6d73200640 1 -- 172.21.15.44:0/1632602302 wait complete. 2024-04-17T19:46:30.853 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:30.863+0000 7f6d73200640 1 Processor -- start 2024-04-17T19:46:30.854 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:30.863+0000 7f6d73200640 1 -- start start 2024-04-17T19:46:30.856 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:30.867+0000 7f6d73200640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6d58004810 0x7f6d740c68b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:46:30.856 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:30.867+0000 7f6d73200640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f6d741ef810 0x7f6d741f3530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:46:30.856 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:30.867+0000 7f6d73200640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6d741e3f50 0x7f6d74070370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:46:30.857 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:30.867+0000 7f6d73200640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f6d74159b50 con 0x7f6d58004810 2024-04-17T19:46:30.857 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:30.867+0000 7f6d73200640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f6d7415d130 con 0x7f6d741e3f50 2024-04-17T19:46:30.857 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:30.867+0000 7f6d73200640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7f6d740b3f60 con 0x7f6d741ef810 2024-04-17T19:46:30.857 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:30.867+0000 7f6d71e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6d58004810 0x7f6d740c68b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:46:30.857 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:30.867+0000 7f6d71e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6d58004810 0x7f6d740c68b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:60176/0 (socket says 172.21.15.44:60176) 2024-04-17T19:46:30.857 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:30.867+0000 7f6d71e00640 1 -- 172.21.15.44:0/278798540 learned_addr learned my addr 172.21.15.44:0/278798540 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-04-17T19:46:30.857 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:30.867+0000 7f6d71400640 1 --2- 172.21.15.44:0/278798540 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f6d741ef810 0x7f6d741f3530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:46:30.857 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:30.867+0000 7f6d72800640 1 --2- 172.21.15.44:0/278798540 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6d741e3f50 0x7f6d74070370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:46:30.857 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:30.867+0000 7f6d71e00640 1 -- 172.21.15.44:0/278798540 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f6d741ef810 msgr2=0x7f6d741f3530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:46:30.857 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:30.867+0000 7f6d71e00640 1 --2- 172.21.15.44:0/278798540 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f6d741ef810 0x7f6d741f3530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:46:30.857 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:30.867+0000 7f6d71e00640 1 -- 172.21.15.44:0/278798540 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6d741e3f50 msgr2=0x7f6d74070370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:46:30.858 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:30.867+0000 7f6d71e00640 1 --2- 172.21.15.44:0/278798540 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6d741e3f50 0x7f6d74070370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:46:30.858 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:30.867+0000 7f6d71e00640 1 -- 172.21.15.44:0/278798540 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6d741f3a70 con 0x7f6d58004810 2024-04-17T19:46:30.858 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:30.867+0000 7f6d71e00640 1 --2- 172.21.15.44:0/278798540 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6d58004810 0x7f6d740c68b0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f6d64012890 tx=0x7f6d64012d50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:46:30.859 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:30.867+0000 7f6d6a000640 1 -- 172.21.15.44:0/278798540 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d6401c070 con 0x7f6d58004810 2024-04-17T19:46:30.859 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:30.867+0000 7f6d6a000640 1 -- 172.21.15.44:0/278798540 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6d64010be0 con 0x7f6d58004810 2024-04-17T19:46:30.859 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:30.867+0000 7f6d6a000640 1 -- 172.21.15.44:0/278798540 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d6400f040 con 0x7f6d58004810 2024-04-17T19:46:30.859 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:30.867+0000 7f6d73200640 1 -- 172.21.15.44:0/278798540 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6d741f0060 con 0x7f6d58004810 2024-04-17T19:46:30.859 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:30.867+0000 7f6d73200640 1 -- 172.21.15.44:0/278798540 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6d741f0620 con 0x7f6d58004810 2024-04-17T19:46:30.859 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:30.871+0000 7f6d6a000640 1 -- 172.21.15.44:0/278798540 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f6d6401f070 con 0x7f6d58004810 2024-04-17T19:46:30.859 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:30.871+0000 7f6d6a000640 1 -- 172.21.15.44:0/278798540 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f6d64015730 con 0x7f6d58004810 2024-04-17T19:46:30.860 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:30.871+0000 7f6d73200640 1 -- 172.21.15.44:0/278798540 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6d7404fea0 con 0x7f6d58004810 2024-04-17T19:46:30.876 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:30.887+0000 7f6d6a000640 1 -- 172.21.15.44:0/278798540 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7f6d64015980 con 0x7f6d58004810 2024-04-17T19:46:30.939 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:30.951+0000 7f6d73200640 1 -- 172.21.15.44:0/278798540 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) -- 0x7f6d740725f0 con 0x7f6d58004810 2024-04-17T19:46:30.944 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:30.955+0000 7f6d6a000640 1 -- 172.21.15.44:0/278798540 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) ==== 124+0+0 (secure 0 0 0) 0x7f6d64015b60 con 0x7f6d58004810 2024-04-17T19:46:30.944 INFO:teuthology.orchestra.run.smithi044.stderr:adjusted tunables profile to default 2024-04-17T19:46:30.945 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:30.955+0000 7f6d73200640 1 -- 172.21.15.44:0/278798540 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6d58004810 msgr2=0x7f6d740c68b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:46:30.945 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:30.955+0000 7f6d73200640 1 --2- 172.21.15.44:0/278798540 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6d58004810 0x7f6d740c68b0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f6d64012890 tx=0x7f6d64012d50 comp rx=0 tx=0).stop 2024-04-17T19:46:30.945 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:30.955+0000 7f6d73200640 1 -- 172.21.15.44:0/278798540 shutdown_connections 2024-04-17T19:46:30.945 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:30.955+0000 7f6d73200640 1 --2- 172.21.15.44:0/278798540 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f6d741ef810 0x7f6d741f3530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:46:30.945 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:30.955+0000 7f6d73200640 1 --2- 172.21.15.44:0/278798540 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6d741e3f50 0x7f6d74070370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:46:30.945 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:30.955+0000 7f6d73200640 1 --2- 172.21.15.44:0/278798540 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6d58004810 0x7f6d740c68b0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:46:30.945 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:30.955+0000 7f6d73200640 1 -- 172.21.15.44:0/278798540 >> 172.21.15.44:0/278798540 conn(0x7f6d74072150 msgr2=0x7f6d74157350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:46:30.946 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:30.955+0000 7f6d73200640 1 -- 172.21.15.44:0/278798540 shutdown_connections 2024-04-17T19:46:30.946 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:30.955+0000 7f6d73200640 1 -- 172.21.15.44:0/278798540 wait complete. 2024-04-17T19:46:30.965 INFO:tasks.ceph:check_enable_crimson: False 2024-04-17T19:46:30.965 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2024-04-17T19:46:30.965 DEBUG:teuthology.orchestra.run.smithi044:> set -ex 2024-04-17T19:46:30.965 DEBUG:teuthology.orchestra.run.smithi044:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2024-04-17T19:46:30.986 DEBUG:teuthology.orchestra.run.smithi044:> set -ex 2024-04-17T19:46:30.986 DEBUG:teuthology.orchestra.run.smithi044:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2024-04-17T19:46:31.050 DEBUG:teuthology.orchestra.run.smithi044:> set -ex 2024-04-17T19:46:31.050 DEBUG:teuthology.orchestra.run.smithi044:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2024-04-17T19:46:31.097 INFO:tasks.ceph.mgr.y.smithi044.stderr:2024-04-17T19:46:31.107+0000 7f9c50ed6180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-04-17T19:46:31.098 INFO:tasks.ceph.mgr.x.smithi062.stderr:2024-04-17T19:46:31.107+0000 7fd8b56cc180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-04-17T19:46:31.113 DEBUG:teuthology.orchestra.run.smithi044:> set -ex 2024-04-17T19:46:31.113 DEBUG:teuthology.orchestra.run.smithi044:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2024-04-17T19:46:31.173 DEBUG:teuthology.orchestra.run.smithi062:> set -ex 2024-04-17T19:46:31.173 DEBUG:teuthology.orchestra.run.smithi062:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2024-04-17T19:46:31.188 DEBUG:teuthology.orchestra.run.smithi062:> set -ex 2024-04-17T19:46:31.188 DEBUG:teuthology.orchestra.run.smithi062:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2024-04-17T19:46:31.244 DEBUG:teuthology.orchestra.run.smithi062:> set -ex 2024-04-17T19:46:31.244 DEBUG:teuthology.orchestra.run.smithi062:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2024-04-17T19:46:31.298 DEBUG:teuthology.orchestra.run.smithi062:> set -ex 2024-04-17T19:46:31.298 DEBUG:teuthology.orchestra.run.smithi062:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2024-04-17T19:46:31.350 DEBUG:teuthology.orchestra.run.smithi062:> sudo ceph --cluster ceph osd new 30520dc6-eea6-43d4-ab60-3ca9e92329dd 0 2024-04-17T19:46:31.541 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-17T19:46:31.551+0000 7fab18c5a640 1 Processor -- start 2024-04-17T19:46:31.541 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-17T19:46:31.551+0000 7fab18c5a640 1 -- start start 2024-04-17T19:46:31.543 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-17T19:46:31.551+0000 7fab18c5a640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fab1406fe50 0x7fab14159190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:46:31.543 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-17T19:46:31.551+0000 7fab18c5a640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fab140c35b0 0x7fab140c39c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:46:31.543 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-17T19:46:31.551+0000 7fab18c5a640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fab14070260 con 0x7fab14152b30 2024-04-17T19:46:31.543 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-17T19:46:31.551+0000 7fab18c5a640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 -- 0x7fab141596d0 con 0x7fab1406fe50 2024-04-17T19:46:31.544 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-17T19:46:31.551+0000 7fab18c5a640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 -- 0x7fab14152f40 con 0x7fab140c35b0 2024-04-17T19:46:31.544 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-17T19:46:31.551+0000 7fab12d9d640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fab140c35b0 0x7fab140c39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:46:31.544 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-17T19:46:31.551+0000 7fab12d9d640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fab140c35b0 0x7fab140c39c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:58736/0 (socket says 172.21.15.62:58736) 2024-04-17T19:46:31.544 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-17T19:46:31.551+0000 7fab12d9d640 1 -- 172.21.15.62:0/461763430 learned_addr learned my addr 172.21.15.62:0/461763430 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-04-17T19:46:31.544 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-17T19:46:31.551+0000 7fab11d9b640 1 --2- 172.21.15.62:0/461763430 >> v2:172.21.15.44:3300/0 conn(0x7fab1406fe50 0x7fab14159190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:46:31.544 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-17T19:46:31.551+0000 7fab12d9d640 1 -- 172.21.15.62:0/461763430 >> v2:172.21.15.44:3300/0 conn(0x7fab1406fe50 msgr2=0x7fab14159190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T19:46:31.544 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-17T19:46:31.551+0000 7fab12d9d640 1 --2- 172.21.15.62:0/461763430 >> v2:172.21.15.44:3300/0 conn(0x7fab1406fe50 0x7fab14159190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:46:31.544 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-17T19:46:31.551+0000 7fab12d9d640 1 -- 172.21.15.62:0/461763430 >> v1:172.21.15.44:6789/0 conn(0x7fab14152b30 legacy=0x7fab140c89a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:46:31.544 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-17T19:46:31.551+0000 7fab12d9d640 1 -- 172.21.15.62:0/461763430 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fab140c2c10 con 0x7fab140c35b0 2024-04-17T19:46:31.545 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-17T19:46:31.555+0000 7fab12d9d640 1 --2- 172.21.15.62:0/461763430 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fab140c35b0 0x7fab140c39c0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fab0c009870 tx=0x7fab0c01ed10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ccafe1812b409b6 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:46:31.546 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-17T19:46:31.555+0000 7fab1159a640 1 -- 172.21.15.62:0/461763430 <== mon.1 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab0c0b5070 con 0x7fab140c35b0 2024-04-17T19:46:31.546 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-17T19:46:31.555+0000 7fab1159a640 1 -- 172.21.15.62:0/461763430 <== mon.1 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fab0c0a8a10 con 0x7fab140c35b0 2024-04-17T19:46:31.546 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-17T19:46:31.555+0000 7fab1159a640 1 -- 172.21.15.62:0/461763430 <== mon.1 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab0c0a8de0 con 0x7fab140c35b0 2024-04-17T19:46:31.547 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-17T19:46:31.555+0000 7fab18c5a640 1 -- 172.21.15.62:0/461763430 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fab140c35b0 msgr2=0x7fab140c39c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:46:31.547 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-17T19:46:31.555+0000 7fab18c5a640 1 --2- 172.21.15.62:0/461763430 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fab140c35b0 0x7fab140c39c0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fab0c009870 tx=0x7fab0c01ed10 comp rx=0 tx=0).stop 2024-04-17T19:46:31.547 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-17T19:46:31.555+0000 7fab18c5a640 1 -- 172.21.15.62:0/461763430 shutdown_connections 2024-04-17T19:46:31.547 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-17T19:46:31.555+0000 7fab18c5a640 1 --2- 172.21.15.62:0/461763430 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fab140c35b0 0x7fab140c39c0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:46:31.547 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-17T19:46:31.555+0000 7fab18c5a640 1 --2- 172.21.15.62:0/461763430 >> v2:172.21.15.44:3300/0 conn(0x7fab1406fe50 0x7fab14159190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:46:31.547 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-17T19:46:31.555+0000 7fab18c5a640 1 -- 172.21.15.62:0/461763430 >> 172.21.15.62:0/461763430 conn(0x7fab140cdcb0 msgr2=0x7fab140ce0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:46:31.547 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-17T19:46:31.555+0000 7fab18c5a640 1 -- 172.21.15.62:0/461763430 shutdown_connections 2024-04-17T19:46:31.547 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-17T19:46:31.555+0000 7fab18c5a640 1 -- 172.21.15.62:0/461763430 wait complete. 2024-04-17T19:46:31.548 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-17T19:46:31.559+0000 7fab18c5a640 1 Processor -- start 2024-04-17T19:46:31.548 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-17T19:46:31.559+0000 7fab18c5a640 1 -- start start 2024-04-17T19:46:31.551 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-17T19:46:31.559+0000 7fab18c5a640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fab1406fe50 0x7fab141573b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:46:31.551 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-17T19:46:31.559+0000 7fab18c5a640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fab140c35b0 0x7fab141533e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:46:31.552 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-17T19:46:31.559+0000 7fab18c5a640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fab14152b30 0x7fab141f3760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:46:31.552 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-17T19:46:31.559+0000 7fab18c5a640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fab140c31d0 con 0x7fab14152b30 2024-04-17T19:46:31.552 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-17T19:46:31.559+0000 7fab18c5a640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7fab140c3f00 con 0x7fab1406fe50 2024-04-17T19:46:31.552 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-17T19:46:31.559+0000 7fab18c5a640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7fab1406f370 con 0x7fab140c35b0 2024-04-17T19:46:31.552 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-17T19:46:31.559+0000 7fab1259c640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fab1406fe50 0x7fab141573b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:46:31.552 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-17T19:46:31.559+0000 7fab11d9b640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fab140c35b0 0x7fab141533e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:46:31.552 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-17T19:46:31.559+0000 7fab1259c640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fab1406fe50 0x7fab141573b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:58752/0 (socket says 172.21.15.62:58752) 2024-04-17T19:46:31.552 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-17T19:46:31.559+0000 7fab1259c640 1 -- 172.21.15.62:0/3799761315 learned_addr learned my addr 172.21.15.62:0/3799761315 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-04-17T19:46:31.552 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-17T19:46:31.559+0000 7fab12d9d640 1 --2- 172.21.15.62:0/3799761315 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fab14152b30 0x7fab141f3760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:46:31.552 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-17T19:46:31.559+0000 7fab11d9b640 1 -- 172.21.15.62:0/3799761315 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fab1406fe50 msgr2=0x7fab141573b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:46:31.552 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-17T19:46:31.559+0000 7fab11d9b640 1 --2- 172.21.15.62:0/3799761315 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fab1406fe50 0x7fab141573b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:46:31.552 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-17T19:46:31.559+0000 7fab11d9b640 1 -- 172.21.15.62:0/3799761315 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fab14152b30 msgr2=0x7fab141f3760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:46:31.552 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-17T19:46:31.559+0000 7fab11d9b640 1 --2- 172.21.15.62:0/3799761315 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fab14152b30 0x7fab141f3760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:46:31.553 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-17T19:46:31.559+0000 7fab11d9b640 1 -- 172.21.15.62:0/3799761315 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fab141578f0 con 0x7fab140c35b0 2024-04-17T19:46:31.553 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-17T19:46:31.559+0000 7fab1259c640 1 --2- 172.21.15.62:0/3799761315 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fab1406fe50 0x7fab141573b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-17T19:46:31.553 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-17T19:46:31.559+0000 7fab11d9b640 1 --2- 172.21.15.62:0/3799761315 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fab140c35b0 0x7fab141533e0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7faafc00e870 tx=0x7faafc00ed30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:46:31.553 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-17T19:46:31.559+0000 7fab0affd640 1 -- 172.21.15.62:0/3799761315 <== mon.2 v2:172.21.15.62:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faafc017070 con 0x7fab140c35b0 2024-04-17T19:46:31.553 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-17T19:46:31.559+0000 7fab0affd640 1 -- 172.21.15.62:0/3799761315 <== mon.2 v2:172.21.15.62:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faafc00ee60 con 0x7fab140c35b0 2024-04-17T19:46:31.553 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-17T19:46:31.559+0000 7fab18c5a640 1 -- 172.21.15.62:0/3799761315 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fab141f4230 con 0x7fab140c35b0 2024-04-17T19:46:31.553 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-17T19:46:31.559+0000 7fab0affd640 1 -- 172.21.15.62:0/3799761315 <== mon.2 v2:172.21.15.62:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faafc00cb60 con 0x7fab140c35b0 2024-04-17T19:46:31.553 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-17T19:46:31.559+0000 7fab18c5a640 1 -- 172.21.15.62:0/3799761315 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fab14158ef0 con 0x7fab140c35b0 2024-04-17T19:46:31.553 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-17T19:46:31.559+0000 7fab0affd640 1 -- 172.21.15.62:0/3799761315 <== mon.2 v2:172.21.15.62:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7faafc01a070 con 0x7fab140c35b0 2024-04-17T19:46:31.553 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-17T19:46:31.559+0000 7fab0affd640 1 -- 172.21.15.62:0/3799761315 <== mon.2 v2:172.21.15.62:3301/0 5 ==== osd_map(2..2 src has 1..2) ==== 725+0+0 (secure 0 0 0) 0x7faafc0067e0 con 0x7fab140c35b0 2024-04-17T19:46:31.553 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-17T19:46:31.563+0000 7fab18c5a640 1 -- 172.21.15.62:0/3799761315 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fab1404fea0 con 0x7fab140c35b0 2024-04-17T19:46:31.554 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-17T19:46:31.563+0000 7fab0affd640 1 -- 172.21.15.62:0/3799761315 <== mon.2 v2:172.21.15.62:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7faafc00cd50 con 0x7fab140c35b0 2024-04-17T19:46:31.623 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-17T19:46:31.631+0000 7fab18c5a640 1 -- 172.21.15.62:0/3799761315 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_command({"prefix": "osd new", "uuid": "30520dc6-eea6-43d4-ab60-3ca9e92329dd", "id": 0} v 0) -- 0x7fab14151f90 con 0x7fab140c35b0 2024-04-17T19:46:31.624 INFO:tasks.ceph.mgr.y.smithi044.stderr:2024-04-17T19:46:31.635+0000 7f9c50ed6180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-04-17T19:46:31.634 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-17T19:46:31.643+0000 7fab0affd640 1 -- 172.21.15.62:0/3799761315 <== mon.2 v2:172.21.15.62:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "30520dc6-eea6-43d4-ab60-3ca9e92329dd", "id": 0}]=0 v3) ==== 112+0+2 (secure 0 0 0) 0x7faafc005a70 con 0x7fab140c35b0 2024-04-17T19:46:31.634 INFO:teuthology.orchestra.run.smithi062.stdout:0 2024-04-17T19:46:31.635 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-17T19:46:31.643+0000 7fab18c5a640 1 -- 172.21.15.62:0/3799761315 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fab140c35b0 msgr2=0x7fab141533e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:46:31.635 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-17T19:46:31.643+0000 7fab18c5a640 1 --2- 172.21.15.62:0/3799761315 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fab140c35b0 0x7fab141533e0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7faafc00e870 tx=0x7faafc00ed30 comp rx=0 tx=0).stop 2024-04-17T19:46:31.635 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-17T19:46:31.643+0000 7fab18c5a640 1 -- 172.21.15.62:0/3799761315 shutdown_connections 2024-04-17T19:46:31.635 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-17T19:46:31.643+0000 7fab18c5a640 1 --2- 172.21.15.62:0/3799761315 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fab140c35b0 0x7fab141533e0 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:46:31.636 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-17T19:46:31.643+0000 7fab18c5a640 1 --2- 172.21.15.62:0/3799761315 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fab14152b30 0x7fab141f3760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:46:31.636 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-17T19:46:31.643+0000 7fab18c5a640 1 --2- 172.21.15.62:0/3799761315 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fab1406fe50 0x7fab141573b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:46:31.636 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-17T19:46:31.643+0000 7fab18c5a640 1 -- 172.21.15.62:0/3799761315 >> 172.21.15.62:0/3799761315 conn(0x7fab140cdcb0 msgr2=0x7fab141517a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:46:31.636 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-17T19:46:31.643+0000 7fab18c5a640 1 -- 172.21.15.62:0/3799761315 shutdown_connections 2024-04-17T19:46:31.636 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-17T19:46:31.643+0000 7fab18c5a640 1 -- 172.21.15.62:0/3799761315 wait complete. 2024-04-17T19:46:31.653 DEBUG:teuthology.orchestra.run.smithi062:> sudo ceph --cluster ceph osd new 079bd511-b6ce-449b-8f11-17b311b12f7c 1 2024-04-17T19:46:31.786 INFO:tasks.ceph.mgr.x.smithi062.stderr:2024-04-17T19:46:31.795+0000 7fd8b56cc180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-04-17T19:46:31.794 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-17T19:46:31.803+0000 7f2892d91640 1 Processor -- start 2024-04-17T19:46:31.794 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-17T19:46:31.803+0000 7f2892d91640 1 -- start start 2024-04-17T19:46:31.797 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-17T19:46:31.807+0000 7f2892d91640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f288c155a50 0x7f288c071b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:46:31.797 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-17T19:46:31.807+0000 7f2892d91640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f288c0c4560 con 0x7f288c15f600 2024-04-17T19:46:31.797 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-17T19:46:31.807+0000 7f2892d91640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f288c15fe20 con 0x7f288c15fa10 2024-04-17T19:46:31.797 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-17T19:46:31.807+0000 7f2892d91640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 -- 0x7f288c155e60 con 0x7f288c155a50 2024-04-17T19:46:31.797 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-17T19:46:31.807+0000 7f289132e640 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f288c15fa10 0x7f288c1662d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:49508/0 (socket says 172.21.15.62:49508) 2024-04-17T19:46:31.797 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-17T19:46:31.807+0000 7f289132e640 1 -- 172.21.15.62:0/4171188069 learned_addr learned my addr 172.21.15.62:0/4171188069 (peer_addr_for_me v1:172.21.15.62:0/0) 2024-04-17T19:46:31.797 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-17T19:46:31.807+0000 7f2890b2d640 1 --2- 172.21.15.62:0/4171188069 >> v2:172.21.15.44:3300/0 conn(0x7f288c155a50 0x7f288c071b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:46:31.797 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-17T19:46:31.807+0000 7f288b7fe640 1 -- 172.21.15.62:0/4171188069 <== mon.1 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1244675323 0 0) 0x7f288c15fe20 con 0x7f288c15fa10 2024-04-17T19:46:31.797 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-17T19:46:31.807+0000 7f288b7fe640 1 -- 172.21.15.62:0/4171188069 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f287c003530 con 0x7f288c15fa10 2024-04-17T19:46:31.797 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-17T19:46:31.807+0000 7f2890b2d640 1 -- 172.21.15.62:0/4171188069 >> v1:172.21.15.62:6789/0 conn(0x7f288c15fa10 legacy=0x7f288c1662d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:46:31.797 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-17T19:46:31.807+0000 7f2890b2d640 1 -- 172.21.15.62:0/4171188069 >> v1:172.21.15.44:6789/0 conn(0x7f288c15f600 legacy=0x7f288c070d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:46:31.798 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-17T19:46:31.807+0000 7f288b7fe640 1 -- 172.21.15.62:0/4171188069 <== mon.1 v1:172.21.15.62:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3149527027 0 0) 0x7f287c003530 con 0x7f288c15fa10 2024-04-17T19:46:31.798 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-17T19:46:31.807+0000 7f2890b2d640 1 -- 172.21.15.62:0/4171188069 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f288c15c7a0 con 0x7f288c155a50 2024-04-17T19:46:31.799 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-17T19:46:31.807+0000 7f2890b2d640 1 --2- 172.21.15.62:0/4171188069 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f288c155a50 0x7f288c071b90 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f28800097c0 tx=0x7f288001ec90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bd27f14e9e09fd0e server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:46:31.799 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-17T19:46:31.807+0000 7f288b7fe640 1 -- 172.21.15.62:0/4171188069 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28800b5070 con 0x7f288c155a50 2024-04-17T19:46:31.799 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-17T19:46:31.807+0000 7f288b7fe640 1 -- 172.21.15.62:0/4171188069 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f28800a8990 con 0x7f288c155a50 2024-04-17T19:46:31.799 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-17T19:46:31.807+0000 7f288b7fe640 1 -- 172.21.15.62:0/4171188069 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28800a8d60 con 0x7f288c155a50 2024-04-17T19:46:31.800 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-17T19:46:31.811+0000 7f2892d91640 1 -- 172.21.15.62:0/4171188069 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f288c155a50 msgr2=0x7f288c071b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:46:31.800 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-17T19:46:31.811+0000 7f2892d91640 1 --2- 172.21.15.62:0/4171188069 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f288c155a50 0x7f288c071b90 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f28800097c0 tx=0x7f288001ec90 comp rx=0 tx=0).stop 2024-04-17T19:46:31.800 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-17T19:46:31.811+0000 7f2892d91640 1 -- 172.21.15.62:0/4171188069 shutdown_connections 2024-04-17T19:46:31.800 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-17T19:46:31.811+0000 7f2892d91640 1 --2- 172.21.15.62:0/4171188069 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f288c155a50 0x7f288c071b90 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:46:31.800 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-17T19:46:31.811+0000 7f2892d91640 1 -- 172.21.15.62:0/4171188069 >> 172.21.15.62:0/4171188069 conn(0x7f288c073c50 msgr2=0x7f288c06ce90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:46:31.800 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-17T19:46:31.811+0000 7f2892d91640 1 -- 172.21.15.62:0/4171188069 shutdown_connections 2024-04-17T19:46:31.800 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-17T19:46:31.811+0000 7f2892d91640 1 -- 172.21.15.62:0/4171188069 wait complete. 2024-04-17T19:46:31.802 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-17T19:46:31.811+0000 7f2892d91640 1 Processor -- start 2024-04-17T19:46:31.802 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-17T19:46:31.811+0000 7f2892d91640 1 -- start start 2024-04-17T19:46:31.805 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-17T19:46:31.811+0000 7f2892d91640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f288c155a50 0x7f288c159e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:46:31.805 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-17T19:46:31.811+0000 7f2892d91640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f288c15f600 0x7f288c15d5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:46:31.805 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-17T19:46:31.811+0000 7f2892d91640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f288c15fa10 0x7f288c143310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:46:31.805 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-17T19:46:31.815+0000 7f2892d91640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f288c15f0e0 con 0x7f288c15fa10 2024-04-17T19:46:31.805 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-17T19:46:31.815+0000 7f2892d91640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f288c0c4ab0 con 0x7f288c155a50 2024-04-17T19:46:31.805 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-17T19:46:31.815+0000 7f2892d91640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7f288c0c2f90 con 0x7f288c15f600 2024-04-17T19:46:31.805 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-17T19:46:31.815+0000 7f2890b2d640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f288c155a50 0x7f288c159e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:46:31.805 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-17T19:46:31.815+0000 7f288bfff640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f288c15f600 0x7f288c15d5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:46:31.806 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-17T19:46:31.815+0000 7f2890b2d640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f288c155a50 0x7f288c159e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:58762/0 (socket says 172.21.15.62:58762) 2024-04-17T19:46:31.806 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-17T19:46:31.815+0000 7f2890b2d640 1 -- 172.21.15.62:0/3844859448 learned_addr learned my addr 172.21.15.62:0/3844859448 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-04-17T19:46:31.806 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-17T19:46:31.815+0000 7f289132e640 1 --2- 172.21.15.62:0/3844859448 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f288c15fa10 0x7f288c143310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:46:31.806 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-17T19:46:31.815+0000 7f2890b2d640 1 -- 172.21.15.62:0/3844859448 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f288c15f600 msgr2=0x7f288c15d5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:46:31.806 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-17T19:46:31.815+0000 7f2890b2d640 1 --2- 172.21.15.62:0/3844859448 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f288c15f600 0x7f288c15d5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:46:31.806 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-17T19:46:31.815+0000 7f2890b2d640 1 -- 172.21.15.62:0/3844859448 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f288c15fa10 msgr2=0x7f288c143310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:46:31.806 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-17T19:46:31.815+0000 7f2890b2d640 1 --2- 172.21.15.62:0/3844859448 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f288c15fa10 0x7f288c143310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:46:31.806 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-17T19:46:31.815+0000 7f2890b2d640 1 -- 172.21.15.62:0/3844859448 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f288c15a350 con 0x7f288c155a50 2024-04-17T19:46:31.806 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-17T19:46:31.815+0000 7f288bfff640 1 --2- 172.21.15.62:0/3844859448 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f288c15f600 0x7f288c15d5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-17T19:46:31.806 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-17T19:46:31.815+0000 7f2890b2d640 1 --2- 172.21.15.62:0/3844859448 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f288c155a50 0x7f288c159e10 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f28800098b0 tx=0x7f288001ba30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:46:31.806 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-17T19:46:31.815+0000 7f28897fa640 1 -- 172.21.15.62:0/3844859448 <== mon.1 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28800bf020 con 0x7f288c155a50 2024-04-17T19:46:31.806 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-17T19:46:31.815+0000 7f28897fa640 1 -- 172.21.15.62:0/3844859448 <== mon.1 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2880004220 con 0x7f288c155a50 2024-04-17T19:46:31.807 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-17T19:46:31.815+0000 7f2892d91640 1 -- 172.21.15.62:0/3844859448 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f288c1f2e30 con 0x7f288c155a50 2024-04-17T19:46:31.807 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-17T19:46:31.815+0000 7f28897fa640 1 -- 172.21.15.62:0/3844859448 <== mon.1 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28800b5040 con 0x7f288c155a50 2024-04-17T19:46:31.807 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-17T19:46:31.815+0000 7f2892d91640 1 -- 172.21.15.62:0/3844859448 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f288c15ce90 con 0x7f288c155a50 2024-04-17T19:46:31.807 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-17T19:46:31.815+0000 7f28897fa640 1 -- 172.21.15.62:0/3844859448 <== mon.1 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f28800c2070 con 0x7f288c155a50 2024-04-17T19:46:31.807 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-17T19:46:31.815+0000 7f28897fa640 1 -- 172.21.15.62:0/3844859448 <== mon.1 v2:172.21.15.62:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 840+0+0 (secure 0 0 0) 0x7f28800b0890 con 0x7f288c155a50 2024-04-17T19:46:31.807 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-17T19:46:31.815+0000 7f2892d91640 1 -- 172.21.15.62:0/3844859448 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f288c04fea0 con 0x7f288c155a50 2024-04-17T19:46:31.808 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-17T19:46:31.819+0000 7f28897fa640 1 -- 172.21.15.62:0/3844859448 <== mon.1 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7f28800187f0 con 0x7f288c155a50 2024-04-17T19:46:31.845 INFO:tasks.ceph.mgr.y.smithi044.stderr:2024-04-17T19:46:31.855+0000 7f9c50ed6180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-04-17T19:46:31.878 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-17T19:46:31.887+0000 7f2892d91640 1 -- 172.21.15.62:0/3844859448 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd new", "uuid": "079bd511-b6ce-449b-8f11-17b311b12f7c", "id": 1} v 0) -- 0x7f288c071300 con 0x7f288c155a50 2024-04-17T19:46:31.884 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-17T19:46:31.895+0000 7f28897fa640 1 -- 172.21.15.62:0/3844859448 <== mon.1 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "079bd511-b6ce-449b-8f11-17b311b12f7c", "id": 1}]=0 v4) ==== 112+0+2 (secure 0 0 0) 0x7f28800b0a90 con 0x7f288c155a50 2024-04-17T19:46:31.884 INFO:teuthology.orchestra.run.smithi062.stdout:1 2024-04-17T19:46:31.885 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-17T19:46:31.895+0000 7f2892d91640 1 -- 172.21.15.62:0/3844859448 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f288c155a50 msgr2=0x7f288c159e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:46:31.885 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-17T19:46:31.895+0000 7f2892d91640 1 --2- 172.21.15.62:0/3844859448 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f288c155a50 0x7f288c159e10 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f28800098b0 tx=0x7f288001ba30 comp rx=0 tx=0).stop 2024-04-17T19:46:31.885 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-17T19:46:31.895+0000 7f2892d91640 1 -- 172.21.15.62:0/3844859448 shutdown_connections 2024-04-17T19:46:31.885 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-17T19:46:31.895+0000 7f2892d91640 1 --2- 172.21.15.62:0/3844859448 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f288c15f600 0x7f288c15d5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:46:31.885 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-17T19:46:31.895+0000 7f2892d91640 1 --2- 172.21.15.62:0/3844859448 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f288c15fa10 0x7f288c143310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:46:31.886 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-17T19:46:31.895+0000 7f2892d91640 1 --2- 172.21.15.62:0/3844859448 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f288c155a50 0x7f288c159e10 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:46:31.886 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-17T19:46:31.895+0000 7f2892d91640 1 -- 172.21.15.62:0/3844859448 >> 172.21.15.62:0/3844859448 conn(0x7f288c073c50 msgr2=0x7f288c070b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:46:31.886 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-17T19:46:31.895+0000 7f2892d91640 1 -- 172.21.15.62:0/3844859448 shutdown_connections 2024-04-17T19:46:31.886 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-17T19:46:31.895+0000 7f2892d91640 1 -- 172.21.15.62:0/3844859448 wait complete. 2024-04-17T19:46:31.902 DEBUG:teuthology.orchestra.run.smithi062:> sudo ceph --cluster ceph osd new 34f0b9ab-b1d2-4ee9-841c-f15afbb6bec5 2 2024-04-17T19:46:31.992 INFO:tasks.ceph.mgr.x.smithi062.stderr:2024-04-17T19:46:32.003+0000 7fd8b56cc180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-04-17T19:46:32.048 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-17T19:46:32.059+0000 7f0559df5640 1 Processor -- start 2024-04-17T19:46:32.048 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-17T19:46:32.059+0000 7f0559df5640 1 -- start start 2024-04-17T19:46:32.050 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-17T19:46:32.059+0000 7f0559df5640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f05540c8e00 0x7f05540c9210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:46:32.050 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-17T19:46:32.059+0000 7f0559df5640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f055415d310 0x7f055415d720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:46:32.050 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-17T19:46:32.059+0000 7f0559df5640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0554071750 con 0x7f0554070dc0 2024-04-17T19:46:32.051 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-17T19:46:32.059+0000 7f0559df5640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 -- 0x7f055406c810 con 0x7f055415d310 2024-04-17T19:46:32.051 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-17T19:46:32.059+0000 7f0559df5640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7f05540719f0 con 0x7f05540c8e00 2024-04-17T19:46:32.051 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-17T19:46:32.059+0000 7f0552ffd640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f05540c8e00 0x7f05540c9210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:46:32.051 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-17T19:46:32.059+0000 7f0553fff640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f055415d310 0x7f055415d720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:46:32.051 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-17T19:46:32.059+0000 7f05537fe640 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f0554070dc0 0x7f055406bf10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:49522/0 (socket says 172.21.15.62:49522) 2024-04-17T19:46:32.051 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-17T19:46:32.059+0000 7f05537fe640 1 -- 172.21.15.62:0/4051767864 learned_addr learned my addr 172.21.15.62:0/4051767864 (peer_addr_for_me v1:172.21.15.62:0/0) 2024-04-17T19:46:32.051 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-17T19:46:32.059+0000 7f0552ffd640 1 --2- 172.21.15.62:0/4051767864 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f05540c8e00 0x7f05540c9210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3301/0 says I am v2:172.21.15.62:36366/0 (socket says 172.21.15.62:36366) 2024-04-17T19:46:32.051 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-17T19:46:32.059+0000 7f0552ffd640 1 -- 172.21.15.62:0/4051767864 >> v2:172.21.15.62:3300/0 conn(0x7f055415d310 msgr2=0x7f055415d720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T19:46:32.051 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-17T19:46:32.059+0000 7f0552ffd640 1 --2- 172.21.15.62:0/4051767864 >> v2:172.21.15.62:3300/0 conn(0x7f055415d310 0x7f055415d720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:46:32.051 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-17T19:46:32.059+0000 7f0552ffd640 1 -- 172.21.15.62:0/4051767864 >> v1:172.21.15.62:6789/0 conn(0x7f0554070dc0 legacy=0x7f055406bf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:46:32.051 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-17T19:46:32.059+0000 7f05527fc640 1 -- 172.21.15.62:0/4051767864 <== mon.1 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 911231065 0 0) 0x7f0554071750 con 0x7f0554070dc0 2024-04-17T19:46:32.051 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-17T19:46:32.059+0000 7f0552ffd640 1 -- 172.21.15.62:0/4051767864 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0554071cd0 con 0x7f05540c8e00 2024-04-17T19:46:32.052 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-17T19:46:32.059+0000 7f0553fff640 1 --2- 172.21.15.62:0/4051767864 >> v2:172.21.15.62:3300/0 conn(0x7f055415d310 0x7f055415d720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-17T19:46:32.052 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-17T19:46:32.063+0000 7f0552ffd640 1 --2- 172.21.15.62:0/4051767864 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f05540c8e00 0x7f05540c9210 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f053c0097c0 tx=0x7f053c01ec90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a131203fbbb68363 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:46:32.052 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-17T19:46:32.063+0000 7f05527fc640 1 -- 172.21.15.62:0/4051767864 <== mon.2 v2:172.21.15.62:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f053c0b5070 con 0x7f05540c8e00 2024-04-17T19:46:32.053 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-17T19:46:32.063+0000 7f05527fc640 1 -- 172.21.15.62:0/4051767864 <== mon.2 v2:172.21.15.62:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f053c0a8990 con 0x7f05540c8e00 2024-04-17T19:46:32.053 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-17T19:46:32.063+0000 7f05527fc640 1 -- 172.21.15.62:0/4051767864 <== mon.2 v2:172.21.15.62:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f053c0a8d60 con 0x7f05540c8e00 2024-04-17T19:46:32.054 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-17T19:46:32.063+0000 7f0559df5640 1 -- 172.21.15.62:0/4051767864 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f05540c8e00 msgr2=0x7f05540c9210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:46:32.054 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-17T19:46:32.063+0000 7f0559df5640 1 --2- 172.21.15.62:0/4051767864 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f05540c8e00 0x7f05540c9210 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f053c0097c0 tx=0x7f053c01ec90 comp rx=0 tx=0).stop 2024-04-17T19:46:32.054 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-17T19:46:32.063+0000 7f0559df5640 1 -- 172.21.15.62:0/4051767864 shutdown_connections 2024-04-17T19:46:32.054 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-17T19:46:32.063+0000 7f0559df5640 1 --2- 172.21.15.62:0/4051767864 >> v2:172.21.15.62:3300/0 conn(0x7f055415d310 0x7f055415d720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:46:32.054 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-17T19:46:32.063+0000 7f0559df5640 1 --2- 172.21.15.62:0/4051767864 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f05540c8e00 0x7f05540c9210 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:46:32.054 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-17T19:46:32.063+0000 7f0559df5640 1 -- 172.21.15.62:0/4051767864 >> 172.21.15.62:0/4051767864 conn(0x7f0554073c50 msgr2=0x7f055406ce90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:46:32.054 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-17T19:46:32.063+0000 7f0559df5640 1 -- 172.21.15.62:0/4051767864 shutdown_connections 2024-04-17T19:46:32.054 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-17T19:46:32.063+0000 7f0559df5640 1 -- 172.21.15.62:0/4051767864 wait complete. 2024-04-17T19:46:32.055 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-17T19:46:32.063+0000 7f0559df5640 1 Processor -- start 2024-04-17T19:46:32.055 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-17T19:46:32.063+0000 7f0559df5640 1 -- start start 2024-04-17T19:46:32.058 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-17T19:46:32.067+0000 7f0559df5640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0554070dc0 0x7f05541e4a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:46:32.058 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-17T19:46:32.067+0000 7f0559df5640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f05540c8e00 0x7f055414d520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:46:32.058 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-17T19:46:32.067+0000 7f0559df5640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f055415d310 0x7f05541464e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:46:32.058 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-17T19:46:32.067+0000 7f0559df5640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f05540711d0 con 0x7f0554070dc0 2024-04-17T19:46:32.059 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-17T19:46:32.067+0000 7f0559df5640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f0554071fb0 con 0x7f055415d310 2024-04-17T19:46:32.059 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-17T19:46:32.067+0000 7f0559df5640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7f0554071350 con 0x7f05540c8e00 2024-04-17T19:46:32.059 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-17T19:46:32.067+0000 7f0552ffd640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f05540c8e00 0x7f055414d520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:46:32.059 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-17T19:46:32.067+0000 7f0552ffd640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f05540c8e00 0x7f055414d520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3301/0 says I am v2:172.21.15.62:36380/0 (socket says 172.21.15.62:36380) 2024-04-17T19:46:32.059 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-17T19:46:32.067+0000 7f0553fff640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f055415d310 0x7f05541464e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:46:32.059 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-17T19:46:32.067+0000 7f0552ffd640 1 -- 172.21.15.62:0/627836166 learned_addr learned my addr 172.21.15.62:0/627836166 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-04-17T19:46:32.059 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-17T19:46:32.067+0000 7f05537fe640 1 --2- 172.21.15.62:0/627836166 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0554070dc0 0x7f05541e4a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:46:32.059 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-17T19:46:32.067+0000 7f0552ffd640 1 -- 172.21.15.62:0/627836166 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f055415d310 msgr2=0x7f05541464e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:46:32.059 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-17T19:46:32.067+0000 7f0552ffd640 1 --2- 172.21.15.62:0/627836166 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f055415d310 0x7f05541464e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:46:32.059 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-17T19:46:32.067+0000 7f0552ffd640 1 -- 172.21.15.62:0/627836166 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0554070dc0 msgr2=0x7f05541e4a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:46:32.059 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-17T19:46:32.067+0000 7f0552ffd640 1 --2- 172.21.15.62:0/627836166 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0554070dc0 0x7f05541e4a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:46:32.059 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-17T19:46:32.067+0000 7f0552ffd640 1 -- 172.21.15.62:0/627836166 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f055414da60 con 0x7f05540c8e00 2024-04-17T19:46:32.059 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-17T19:46:32.067+0000 7f0553fff640 1 --2- 172.21.15.62:0/627836166 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f055415d310 0x7f05541464e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-17T19:46:32.060 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-17T19:46:32.067+0000 7f0552ffd640 1 --2- 172.21.15.62:0/627836166 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f05540c8e00 0x7f055414d520 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f053c0b3040 tx=0x7f053c01ba30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:46:32.060 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-17T19:46:32.067+0000 7f054bfff640 1 -- 172.21.15.62:0/627836166 <== mon.2 v2:172.21.15.62:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f053c0c0070 con 0x7f05540c8e00 2024-04-17T19:46:32.060 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-17T19:46:32.067+0000 7f054bfff640 1 -- 172.21.15.62:0/627836166 <== mon.2 v2:172.21.15.62:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f053c004230 con 0x7f05540c8e00 2024-04-17T19:46:32.060 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-17T19:46:32.067+0000 7f054bfff640 1 -- 172.21.15.62:0/627836166 <== mon.2 v2:172.21.15.62:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f053c0b5040 con 0x7f05540c8e00 2024-04-17T19:46:32.060 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-17T19:46:32.067+0000 7f0559df5640 1 -- 172.21.15.62:0/627836166 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f055414cc10 con 0x7f05540c8e00 2024-04-17T19:46:32.060 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-17T19:46:32.067+0000 7f0559df5640 1 -- 172.21.15.62:0/627836166 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f05541e5810 con 0x7f05540c8e00 2024-04-17T19:46:32.060 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-17T19:46:32.067+0000 7f054bfff640 1 -- 172.21.15.62:0/627836166 <== mon.2 v2:172.21.15.62:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f053c0a8810 con 0x7f05540c8e00 2024-04-17T19:46:32.060 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-17T19:46:32.067+0000 7f054bfff640 1 -- 172.21.15.62:0/627836166 <== mon.2 v2:172.21.15.62:3301/0 5 ==== osd_map(4..4 src has 1..4) ==== 955+0+0 (secure 0 0 0) 0x7f053c0b0a40 con 0x7f05540c8e00 2024-04-17T19:46:32.060 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-17T19:46:32.067+0000 7f0559df5640 1 -- 172.21.15.62:0/627836166 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f055404fea0 con 0x7f05540c8e00 2024-04-17T19:46:32.061 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-17T19:46:32.071+0000 7f054bfff640 1 -- 172.21.15.62:0/627836166 <== mon.2 v2:172.21.15.62:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7f053c0c9020 con 0x7f05540c8e00 2024-04-17T19:46:32.128 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-17T19:46:32.139+0000 7f0559df5640 1 -- 172.21.15.62:0/627836166 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_command({"prefix": "osd new", "uuid": "34f0b9ab-b1d2-4ee9-841c-f15afbb6bec5", "id": 2} v 0) -- 0x7f05540ce900 con 0x7f05540c8e00 2024-04-17T19:46:32.134 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-17T19:46:32.143+0000 7f054bfff640 1 -- 172.21.15.62:0/627836166 <== mon.2 v2:172.21.15.62:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "34f0b9ab-b1d2-4ee9-841c-f15afbb6bec5", "id": 2}]=0 v5) ==== 112+0+2 (secure 0 0 0) 0x7f053c0187f0 con 0x7f05540c8e00 2024-04-17T19:46:32.134 INFO:teuthology.orchestra.run.smithi062.stdout:2 2024-04-17T19:46:32.135 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-17T19:46:32.143+0000 7f0559df5640 1 -- 172.21.15.62:0/627836166 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f05540c8e00 msgr2=0x7f055414d520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:46:32.136 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-17T19:46:32.143+0000 7f0559df5640 1 --2- 172.21.15.62:0/627836166 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f05540c8e00 0x7f055414d520 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f053c0b3040 tx=0x7f053c01ba30 comp rx=0 tx=0).stop 2024-04-17T19:46:32.136 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-17T19:46:32.143+0000 7f0559df5640 1 -- 172.21.15.62:0/627836166 shutdown_connections 2024-04-17T19:46:32.136 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-17T19:46:32.143+0000 7f0559df5640 1 --2- 172.21.15.62:0/627836166 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f05540c8e00 0x7f055414d520 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:46:32.136 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-17T19:46:32.143+0000 7f0559df5640 1 --2- 172.21.15.62:0/627836166 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f055415d310 0x7f05541464e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:46:32.136 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-17T19:46:32.143+0000 7f0559df5640 1 --2- 172.21.15.62:0/627836166 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0554070dc0 0x7f05541e4a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:46:32.136 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-17T19:46:32.143+0000 7f0559df5640 1 -- 172.21.15.62:0/627836166 >> 172.21.15.62:0/627836166 conn(0x7f0554073c50 msgr2=0x7f0554148940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:46:32.136 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-17T19:46:32.147+0000 7f0559df5640 1 -- 172.21.15.62:0/627836166 shutdown_connections 2024-04-17T19:46:32.136 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-17T19:46:32.147+0000 7f0559df5640 1 -- 172.21.15.62:0/627836166 wait complete. 2024-04-17T19:46:32.152 DEBUG:teuthology.orchestra.run.smithi062:> sudo ceph --cluster ceph osd new 4740032d-fe34-4b1b-bb85-f430896fc3c0 3 2024-04-17T19:46:32.300 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-17T19:46:32.311+0000 7f34b6012640 1 Processor -- start 2024-04-17T19:46:32.300 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-17T19:46:32.311+0000 7f34b6012640 1 -- start start 2024-04-17T19:46:32.302 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-17T19:46:32.311+0000 7f34b6012640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f34b01500e0 0x7f34b0159920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:46:32.303 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-17T19:46:32.311+0000 7f34b6012640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f34b0159e60 0x7f34b0164080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:46:32.303 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-17T19:46:32.311+0000 7f34b6012640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f34b0068290 con 0x7f34b006bd80 2024-04-17T19:46:32.303 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-17T19:46:32.311+0000 7f34b6012640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 -- 0x7f34b006c980 con 0x7f34b0159e60 2024-04-17T19:46:32.303 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-17T19:46:32.311+0000 7f34b6012640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7f34b006cc40 con 0x7f34b01500e0 2024-04-17T19:46:32.303 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-17T19:46:32.311+0000 7f34affff640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f34b0159e60 0x7f34b0164080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:46:32.303 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-17T19:46:32.311+0000 7f34affff640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f34b0159e60 0x7f34b0164080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:58776/0 (socket says 172.21.15.62:58776) 2024-04-17T19:46:32.303 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-17T19:46:32.311+0000 7f34affff640 1 -- 172.21.15.62:0/3357334994 learned_addr learned my addr 172.21.15.62:0/3357334994 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-04-17T19:46:32.303 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-17T19:46:32.311+0000 7f34a7fff640 1 --2- 172.21.15.62:0/3357334994 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f34b01500e0 0x7f34b0159920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:46:32.303 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-17T19:46:32.311+0000 7f34affff640 1 -- 172.21.15.62:0/3357334994 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f34b01500e0 msgr2=0x7f34b0159920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T19:46:32.303 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-17T19:46:32.311+0000 7f34affff640 1 --2- 172.21.15.62:0/3357334994 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f34b01500e0 0x7f34b0159920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:46:32.303 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-17T19:46:32.311+0000 7f34affff640 1 -- 172.21.15.62:0/3357334994 >> v1:172.21.15.44:6789/0 conn(0x7f34b006bd80 legacy=0x7f34b00c6bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:46:32.303 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-17T19:46:32.311+0000 7f34affff640 1 -- 172.21.15.62:0/3357334994 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f34b006cf20 con 0x7f34b0159e60 2024-04-17T19:46:32.304 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-17T19:46:32.315+0000 7f34affff640 1 --2- 172.21.15.62:0/3357334994 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f34b0159e60 0x7f34b0164080 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f34a8009e50 tx=0x7f34a801f210 comp rx=0 tx=0).ready entity=mon.1 client_cookie=98531b9c0f2936e2 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:46:32.304 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-17T19:46:32.315+0000 7f34aeffd640 1 -- 172.21.15.62:0/3357334994 <== mon.1 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34a80b4070 con 0x7f34b0159e60 2024-04-17T19:46:32.304 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-17T19:46:32.315+0000 7f34aeffd640 1 -- 172.21.15.62:0/3357334994 <== mon.1 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f34a80af400 con 0x7f34b0159e60 2024-04-17T19:46:32.305 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-17T19:46:32.315+0000 7f34aeffd640 1 -- 172.21.15.62:0/3357334994 <== mon.1 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34a80af7d0 con 0x7f34b0159e60 2024-04-17T19:46:32.305 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-17T19:46:32.315+0000 7f34b6012640 1 -- 172.21.15.62:0/3357334994 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f34b0159e60 msgr2=0x7f34b0164080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:46:32.305 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-17T19:46:32.315+0000 7f34b6012640 1 --2- 172.21.15.62:0/3357334994 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f34b0159e60 0x7f34b0164080 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f34a8009e50 tx=0x7f34a801f210 comp rx=0 tx=0).stop 2024-04-17T19:46:32.306 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-17T19:46:32.315+0000 7f34b6012640 1 -- 172.21.15.62:0/3357334994 shutdown_connections 2024-04-17T19:46:32.306 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-17T19:46:32.315+0000 7f34b6012640 1 --2- 172.21.15.62:0/3357334994 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f34b0159e60 0x7f34b0164080 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:46:32.306 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-17T19:46:32.315+0000 7f34b6012640 1 --2- 172.21.15.62:0/3357334994 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f34b01500e0 0x7f34b0159920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:46:32.306 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-17T19:46:32.315+0000 7f34b6012640 1 -- 172.21.15.62:0/3357334994 >> 172.21.15.62:0/3357334994 conn(0x7f34b00ca170 msgr2=0x7f34b00ca580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:46:32.306 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-17T19:46:32.315+0000 7f34b6012640 1 -- 172.21.15.62:0/3357334994 shutdown_connections 2024-04-17T19:46:32.306 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-17T19:46:32.315+0000 7f34b6012640 1 -- 172.21.15.62:0/3357334994 wait complete. 2024-04-17T19:46:32.307 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-17T19:46:32.315+0000 7f34b6012640 1 Processor -- start 2024-04-17T19:46:32.307 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-17T19:46:32.315+0000 7f34b6012640 1 -- start start 2024-04-17T19:46:32.310 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-17T19:46:32.319+0000 7f34b6012640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f34b006bd80 0x7f34b00c54f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:46:32.310 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-17T19:46:32.319+0000 7f34b6012640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f34b01500e0 0x7f34b0156870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:46:32.310 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-17T19:46:32.319+0000 7f34b6012640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f34b0159e60 0x7f34b014ab10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:46:32.311 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-17T19:46:32.319+0000 7f34b6012640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f34b006c190 con 0x7f34b0159e60 2024-04-17T19:46:32.311 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-17T19:46:32.319+0000 7f34b6012640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f34b006d4e0 con 0x7f34b006bd80 2024-04-17T19:46:32.311 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-17T19:46:32.319+0000 7f34b6012640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7f34b015a270 con 0x7f34b01500e0 2024-04-17T19:46:32.311 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-17T19:46:32.319+0000 7f34a7fff640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f34b01500e0 0x7f34b0156870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:46:32.311 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-17T19:46:32.319+0000 7f34af7fe640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f34b006bd80 0x7f34b00c54f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:46:32.311 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-17T19:46:32.319+0000 7f34a7fff640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f34b01500e0 0x7f34b0156870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3301/0 says I am v2:172.21.15.62:36396/0 (socket says 172.21.15.62:36396) 2024-04-17T19:46:32.311 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-17T19:46:32.319+0000 7f34af7fe640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f34b006bd80 0x7f34b00c54f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:58782/0 (socket says 172.21.15.62:58782) 2024-04-17T19:46:32.311 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-17T19:46:32.319+0000 7f34a7fff640 1 -- 172.21.15.62:0/1698157232 learned_addr learned my addr 172.21.15.62:0/1698157232 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-04-17T19:46:32.311 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-17T19:46:32.319+0000 7f34affff640 1 --2- 172.21.15.62:0/1698157232 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f34b0159e60 0x7f34b014ab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:46:32.311 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-17T19:46:32.319+0000 7f34af7fe640 1 -- 172.21.15.62:0/1698157232 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f34b01500e0 msgr2=0x7f34b0156870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:46:32.311 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-17T19:46:32.319+0000 7f34af7fe640 1 --2- 172.21.15.62:0/1698157232 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f34b01500e0 0x7f34b0156870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:46:32.311 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-17T19:46:32.319+0000 7f34af7fe640 1 -- 172.21.15.62:0/1698157232 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f34b0159e60 msgr2=0x7f34b014ab10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:46:32.311 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-17T19:46:32.319+0000 7f34af7fe640 1 --2- 172.21.15.62:0/1698157232 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f34b0159e60 0x7f34b014ab10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:46:32.312 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-17T19:46:32.319+0000 7f34af7fe640 1 -- 172.21.15.62:0/1698157232 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f34b00c5280 con 0x7f34b006bd80 2024-04-17T19:46:32.312 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-17T19:46:32.319+0000 7f34affff640 1 --2- 172.21.15.62:0/1698157232 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f34b0159e60 0x7f34b014ab10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-17T19:46:32.312 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-17T19:46:32.319+0000 7f34af7fe640 1 --2- 172.21.15.62:0/1698157232 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f34b006bd80 0x7f34b00c54f0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f34a0000f70 tx=0x7f34a000c820 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:46:32.312 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-17T19:46:32.319+0000 7f34acff9640 1 -- 172.21.15.62:0/1698157232 <== mon.1 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34a0017070 con 0x7f34b006bd80 2024-04-17T19:46:32.312 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-17T19:46:32.319+0000 7f34acff9640 1 -- 172.21.15.62:0/1698157232 <== mon.1 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f34a00052d0 con 0x7f34b006bd80 2024-04-17T19:46:32.312 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-17T19:46:32.319+0000 7f34b6012640 1 -- 172.21.15.62:0/1698157232 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f34b01f51c0 con 0x7f34b006bd80 2024-04-17T19:46:32.312 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-17T19:46:32.319+0000 7f34acff9640 1 -- 172.21.15.62:0/1698157232 <== mon.1 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34a0003840 con 0x7f34b006bd80 2024-04-17T19:46:32.312 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-17T19:46:32.319+0000 7f34b6012640 1 -- 172.21.15.62:0/1698157232 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f34b01f5780 con 0x7f34b006bd80 2024-04-17T19:46:32.312 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-17T19:46:32.319+0000 7f34acff9640 1 -- 172.21.15.62:0/1698157232 <== mon.1 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f34a001a070 con 0x7f34b006bd80 2024-04-17T19:46:32.312 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-17T19:46:32.319+0000 7f34acff9640 1 -- 172.21.15.62:0/1698157232 <== mon.1 v2:172.21.15.62:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1070+0+0 (secure 0 0 0) 0x7f34a0011c20 con 0x7f34b006bd80 2024-04-17T19:46:32.312 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-17T19:46:32.319+0000 7f34b6012640 1 -- 172.21.15.62:0/1698157232 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f34b004fea0 con 0x7f34b006bd80 2024-04-17T19:46:32.313 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-17T19:46:32.323+0000 7f34acff9640 1 -- 172.21.15.62:0/1698157232 <== mon.1 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7f34a0021070 con 0x7f34b006bd80 2024-04-17T19:46:32.381 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-17T19:46:32.391+0000 7f34b6012640 1 -- 172.21.15.62:0/1698157232 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd new", "uuid": "4740032d-fe34-4b1b-bb85-f430896fc3c0", "id": 3} v 0) -- 0x7f34b015d800 con 0x7f34b006bd80 2024-04-17T19:46:32.387 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-17T19:46:32.395+0000 7f34acff9640 1 -- 172.21.15.62:0/1698157232 <== mon.1 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "4740032d-fe34-4b1b-bb85-f430896fc3c0", "id": 3}]=0 v6) ==== 112+0+2 (secure 0 0 0) 0x7f34a0011630 con 0x7f34b006bd80 2024-04-17T19:46:32.387 INFO:teuthology.orchestra.run.smithi062.stdout:3 2024-04-17T19:46:32.388 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-17T19:46:32.399+0000 7f34b6012640 1 -- 172.21.15.62:0/1698157232 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f34b006bd80 msgr2=0x7f34b00c54f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:46:32.388 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-17T19:46:32.399+0000 7f34b6012640 1 --2- 172.21.15.62:0/1698157232 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f34b006bd80 0x7f34b00c54f0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f34a0000f70 tx=0x7f34a000c820 comp rx=0 tx=0).stop 2024-04-17T19:46:32.388 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-17T19:46:32.399+0000 7f34b6012640 1 -- 172.21.15.62:0/1698157232 shutdown_connections 2024-04-17T19:46:32.389 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-17T19:46:32.399+0000 7f34b6012640 1 --2- 172.21.15.62:0/1698157232 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f34b01500e0 0x7f34b0156870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:46:32.389 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-17T19:46:32.399+0000 7f34b6012640 1 --2- 172.21.15.62:0/1698157232 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f34b0159e60 0x7f34b014ab10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:46:32.389 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-17T19:46:32.399+0000 7f34b6012640 1 --2- 172.21.15.62:0/1698157232 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f34b006bd80 0x7f34b00c54f0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:46:32.389 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-17T19:46:32.399+0000 7f34b6012640 1 -- 172.21.15.62:0/1698157232 >> 172.21.15.62:0/1698157232 conn(0x7f34b00ca170 msgr2=0x7f34b00cccf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:46:32.389 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-17T19:46:32.399+0000 7f34b6012640 1 -- 172.21.15.62:0/1698157232 shutdown_connections 2024-04-17T19:46:32.389 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-17T19:46:32.399+0000 7f34b6012640 1 -- 172.21.15.62:0/1698157232 wait complete. 2024-04-17T19:46:32.406 DEBUG:teuthology.orchestra.run.smithi062:> sudo ceph --cluster ceph osd new 7dbedb00-302d-4d52-810c-e18839254da1 4 2024-04-17T19:46:32.493 INFO:tasks.ceph.mgr.y.smithi044.stderr:2024-04-17T19:46:32.502+0000 7f9c50ed6180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-04-17T19:46:32.558 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-17T19:46:32.567+0000 7f904c04e640 1 Processor -- start 2024-04-17T19:46:32.558 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-17T19:46:32.567+0000 7f904c04e640 1 -- start start 2024-04-17T19:46:32.559 INFO:tasks.ceph.mgr.y.smithi044.stderr:2024-04-17T19:46:32.570+0000 7f9c50ed6180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-04-17T19:46:32.561 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-17T19:46:32.571+0000 7f904c04e640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f904415d8e0 0x7f904406f410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:46:32.561 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-17T19:46:32.571+0000 7f904c04e640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f904406f950 0x7f9044159de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:46:32.561 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-17T19:46:32.571+0000 7f904c04e640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f90440c9de0 con 0x7f904415a320 2024-04-17T19:46:32.561 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-17T19:46:32.571+0000 7f904c04e640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 -- 0x7f90440c9bb0 con 0x7f904406f950 2024-04-17T19:46:32.561 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-17T19:46:32.571+0000 7f904c04e640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 -- 0x7f904406bd80 con 0x7f904415d8e0 2024-04-17T19:46:32.561 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-17T19:46:32.571+0000 7f9049dea640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f904415d8e0 0x7f904406f410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:46:32.562 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-17T19:46:32.571+0000 7f904a5eb640 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f904415a320 0x7f90440c8830 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:49536/0 (socket says 172.21.15.62:49536) 2024-04-17T19:46:32.562 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-17T19:46:32.571+0000 7f904a5eb640 1 -- 172.21.15.62:0/3491136510 learned_addr learned my addr 172.21.15.62:0/3491136510 (peer_addr_for_me v1:172.21.15.62:0/0) 2024-04-17T19:46:32.562 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-17T19:46:32.571+0000 7f90495e9640 1 --2- 172.21.15.62:0/3491136510 >> v2:172.21.15.44:3300/0 conn(0x7f904406f950 0x7f9044159de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:46:32.562 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-17T19:46:32.571+0000 7f9048de8640 1 -- 172.21.15.62:0/3491136510 <== mon.1 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2341887225 0 0) 0x7f90440c9de0 con 0x7f904415a320 2024-04-17T19:46:32.562 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-17T19:46:32.571+0000 7f9048de8640 1 -- 172.21.15.62:0/3491136510 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9030003530 con 0x7f904415a320 2024-04-17T19:46:32.562 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-17T19:46:32.571+0000 7f9049dea640 1 -- 172.21.15.62:0/3491136510 >> v2:172.21.15.44:3300/0 conn(0x7f904406f950 msgr2=0x7f9044159de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T19:46:32.562 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-17T19:46:32.571+0000 7f9049dea640 1 --2- 172.21.15.62:0/3491136510 >> v2:172.21.15.44:3300/0 conn(0x7f904406f950 0x7f9044159de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:46:32.562 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-17T19:46:32.571+0000 7f9049dea640 1 -- 172.21.15.62:0/3491136510 >> v1:172.21.15.62:6789/0 conn(0x7f904415a320 legacy=0x7f90440c8830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:46:32.562 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-17T19:46:32.571+0000 7f9049dea640 1 -- 172.21.15.62:0/3491136510 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f90440ca0c0 con 0x7f904415d8e0 2024-04-17T19:46:32.563 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-17T19:46:32.571+0000 7f90495e9640 1 --2- 172.21.15.62:0/3491136510 >> v2:172.21.15.44:3300/0 conn(0x7f904406f950 0x7f9044159de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-17T19:46:32.564 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-17T19:46:32.571+0000 7f9049dea640 1 --2- 172.21.15.62:0/3491136510 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f904415d8e0 0x7f904406f410 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f9044070330 tx=0x7f903c01f110 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b624821dd525beb2 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:46:32.564 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-17T19:46:32.571+0000 7f9048de8640 1 -- 172.21.15.62:0/3491136510 <== mon.1 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f903c0b4070 con 0x7f904415d8e0 2024-04-17T19:46:32.564 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-17T19:46:32.571+0000 7f9048de8640 1 -- 172.21.15.62:0/3491136510 <== mon.1 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f903c0af600 con 0x7f904415d8e0 2024-04-17T19:46:32.565 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-17T19:46:32.571+0000 7f9048de8640 1 -- 172.21.15.62:0/3491136510 <== mon.1 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f903c0af9d0 con 0x7f904415d8e0 2024-04-17T19:46:32.565 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-17T19:46:32.571+0000 7f904c04e640 1 -- 172.21.15.62:0/3491136510 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f904415d8e0 msgr2=0x7f904406f410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:46:32.565 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-17T19:46:32.571+0000 7f904c04e640 1 --2- 172.21.15.62:0/3491136510 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f904415d8e0 0x7f904406f410 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f9044070330 tx=0x7f903c01f110 comp rx=0 tx=0).stop 2024-04-17T19:46:32.565 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-17T19:46:32.571+0000 7f904c04e640 1 -- 172.21.15.62:0/3491136510 shutdown_connections 2024-04-17T19:46:32.565 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-17T19:46:32.571+0000 7f904c04e640 1 --2- 172.21.15.62:0/3491136510 >> v2:172.21.15.44:3300/0 conn(0x7f904406f950 0x7f9044159de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:46:32.565 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-17T19:46:32.571+0000 7f904c04e640 1 --2- 172.21.15.62:0/3491136510 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f904415d8e0 0x7f904406f410 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:46:32.565 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-17T19:46:32.575+0000 7f904c04e640 1 -- 172.21.15.62:0/3491136510 >> 172.21.15.62:0/3491136510 conn(0x7f90440ca930 msgr2=0x7f90440cad40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:46:32.565 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-17T19:46:32.575+0000 7f904c04e640 1 -- 172.21.15.62:0/3491136510 shutdown_connections 2024-04-17T19:46:32.565 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-17T19:46:32.575+0000 7f904c04e640 1 -- 172.21.15.62:0/3491136510 wait complete. 2024-04-17T19:46:32.566 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-17T19:46:32.575+0000 7f904c04e640 1 Processor -- start 2024-04-17T19:46:32.566 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-17T19:46:32.575+0000 7f904c04e640 1 -- start start 2024-04-17T19:46:32.569 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-17T19:46:32.575+0000 7f904c04e640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f904406f950 0x7f9044149520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:46:32.569 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-17T19:46:32.575+0000 7f904c04e640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f904415a320 0x7f9044149a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:46:32.569 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-17T19:46:32.575+0000 7f904c04e640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f904415d8e0 0x7f904415b770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:46:32.569 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-17T19:46:32.575+0000 7f904c04e640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f904415a730 con 0x7f904415d8e0 2024-04-17T19:46:32.569 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-17T19:46:32.575+0000 7f904c04e640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f904406c2b0 con 0x7f904415a320 2024-04-17T19:46:32.569 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-17T19:46:32.575+0000 7f904c04e640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7f90440ca6a0 con 0x7f904406f950 2024-04-17T19:46:32.570 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-17T19:46:32.575+0000 7f90495e9640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f904415a320 0x7f9044149a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:46:32.570 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-17T19:46:32.575+0000 7f9049dea640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f904406f950 0x7f9044149520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:46:32.570 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-17T19:46:32.575+0000 7f90495e9640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f904415a320 0x7f9044149a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:58812/0 (socket says 172.21.15.62:58812) 2024-04-17T19:46:32.570 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-17T19:46:32.575+0000 7f90495e9640 1 -- 172.21.15.62:0/3098759965 learned_addr learned my addr 172.21.15.62:0/3098759965 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-04-17T19:46:32.570 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-17T19:46:32.575+0000 7f904a5eb640 1 --2- 172.21.15.62:0/3098759965 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f904415d8e0 0x7f904415b770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:46:32.570 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-17T19:46:32.575+0000 7f90495e9640 1 -- 172.21.15.62:0/3098759965 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f904406f950 msgr2=0x7f9044149520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:46:32.570 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-17T19:46:32.575+0000 7f90495e9640 1 --2- 172.21.15.62:0/3098759965 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f904406f950 0x7f9044149520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:46:32.570 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-17T19:46:32.575+0000 7f90495e9640 1 -- 172.21.15.62:0/3098759965 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f904415d8e0 msgr2=0x7f904415b770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:46:32.570 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-17T19:46:32.575+0000 7f90495e9640 1 --2- 172.21.15.62:0/3098759965 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f904415d8e0 0x7f904415b770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:46:32.571 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-17T19:46:32.575+0000 7f90495e9640 1 -- 172.21.15.62:0/3098759965 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f90440c3600 con 0x7f904415a320 2024-04-17T19:46:32.571 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-17T19:46:32.575+0000 7f90495e9640 1 --2- 172.21.15.62:0/3098759965 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f904415a320 0x7f9044149a60 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f903800d800 tx=0x7f903800dcc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:46:32.571 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-17T19:46:32.579+0000 7f90367fc640 1 -- 172.21.15.62:0/3098759965 <== mon.1 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9038018020 con 0x7f904415a320 2024-04-17T19:46:32.571 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-17T19:46:32.579+0000 7f90367fc640 1 -- 172.21.15.62:0/3098759965 <== mon.1 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f90380096c0 con 0x7f904415a320 2024-04-17T19:46:32.571 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-17T19:46:32.579+0000 7f904c04e640 1 -- 172.21.15.62:0/3098759965 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f90440c38e0 con 0x7f904415a320 2024-04-17T19:46:32.571 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-17T19:46:32.579+0000 7f90367fc640 1 -- 172.21.15.62:0/3098759965 <== mon.1 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9038009ab0 con 0x7f904415a320 2024-04-17T19:46:32.571 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-17T19:46:32.579+0000 7f904c04e640 1 -- 172.21.15.62:0/3098759965 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f90440c3ea0 con 0x7f904415a320 2024-04-17T19:46:32.571 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-17T19:46:32.579+0000 7f90367fc640 1 -- 172.21.15.62:0/3098759965 <== mon.1 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f903801b020 con 0x7f904415a320 2024-04-17T19:46:32.571 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-17T19:46:32.579+0000 7f90367fc640 1 -- 172.21.15.62:0/3098759965 <== mon.1 v2:172.21.15.62:3300/0 5 ==== osd_map(6..6 src has 1..6) ==== 1185+0+0 (secure 0 0 0) 0x7f903801daa0 con 0x7f904415a320 2024-04-17T19:46:32.571 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-17T19:46:32.579+0000 7f904c04e640 1 -- 172.21.15.62:0/3098759965 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f90440c3350 con 0x7f904415a320 2024-04-17T19:46:32.572 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-17T19:46:32.579+0000 7f90367fc640 1 -- 172.21.15.62:0/3098759965 <== mon.1 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7f9038022020 con 0x7f904415a320 2024-04-17T19:46:32.586 INFO:tasks.ceph.mgr.x.smithi062.stderr:2024-04-17T19:46:32.595+0000 7fd8b56cc180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-04-17T19:46:32.623 INFO:tasks.ceph.mgr.y.smithi044.stderr:2024-04-17T19:46:32.634+0000 7f9c50ed6180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-04-17T19:46:32.639 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-17T19:46:32.651+0000 7f904c04e640 1 -- 172.21.15.62:0/3098759965 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd new", "uuid": "7dbedb00-302d-4d52-810c-e18839254da1", "id": 4} v 0) -- 0x7f904404fea0 con 0x7f904415a320 2024-04-17T19:46:32.646 INFO:tasks.ceph.mgr.x.smithi062.stderr:2024-04-17T19:46:32.655+0000 7fd8b56cc180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-04-17T19:46:32.646 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-17T19:46:32.655+0000 7f90367fc640 1 -- 172.21.15.62:0/3098759965 <== mon.1 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "7dbedb00-302d-4d52-810c-e18839254da1", "id": 4}]=0 v7) ==== 112+0+2 (secure 0 0 0) 0x7f903801d720 con 0x7f904415a320 2024-04-17T19:46:32.647 INFO:teuthology.orchestra.run.smithi062.stdout:4 2024-04-17T19:46:32.648 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-17T19:46:32.659+0000 7f904c04e640 1 -- 172.21.15.62:0/3098759965 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f904415a320 msgr2=0x7f9044149a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:46:32.648 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-17T19:46:32.659+0000 7f904c04e640 1 --2- 172.21.15.62:0/3098759965 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f904415a320 0x7f9044149a60 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f903800d800 tx=0x7f903800dcc0 comp rx=0 tx=0).stop 2024-04-17T19:46:32.648 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-17T19:46:32.659+0000 7f904c04e640 1 -- 172.21.15.62:0/3098759965 shutdown_connections 2024-04-17T19:46:32.649 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-17T19:46:32.659+0000 7f904c04e640 1 --2- 172.21.15.62:0/3098759965 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f904415d8e0 0x7f904415b770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:46:32.649 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-17T19:46:32.659+0000 7f904c04e640 1 --2- 172.21.15.62:0/3098759965 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f904415a320 0x7f9044149a60 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:46:32.649 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-17T19:46:32.659+0000 7f904c04e640 1 --2- 172.21.15.62:0/3098759965 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f904406f950 0x7f9044149520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:46:32.649 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-17T19:46:32.659+0000 7f904c04e640 1 -- 172.21.15.62:0/3098759965 >> 172.21.15.62:0/3098759965 conn(0x7f90440ca930 msgr2=0x7f9044152ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:46:32.649 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-17T19:46:32.659+0000 7f904c04e640 1 -- 172.21.15.62:0/3098759965 shutdown_connections 2024-04-17T19:46:32.649 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-17T19:46:32.659+0000 7f904c04e640 1 -- 172.21.15.62:0/3098759965 wait complete. 2024-04-17T19:46:32.665 DEBUG:teuthology.orchestra.run.smithi062:> sudo ceph --cluster ceph osd new 38c1e8d9-393d-4f33-a97a-3295cf5c5b07 5 2024-04-17T19:46:32.703 INFO:tasks.ceph.mgr.x.smithi062.stderr:2024-04-17T19:46:32.711+0000 7fd8b56cc180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-04-17T19:46:32.716 INFO:tasks.ceph.mgr.y.smithi044.stderr:2024-04-17T19:46:32.726+0000 7f9c50ed6180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-04-17T19:46:32.780 INFO:tasks.ceph.mgr.y.smithi044.stderr:2024-04-17T19:46:32.790+0000 7f9c50ed6180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-04-17T19:46:32.787 INFO:tasks.ceph.mgr.x.smithi062.stderr:2024-04-17T19:46:32.795+0000 7fd8b56cc180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-04-17T19:46:32.807 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-17T19:46:32.815+0000 7f873811d640 1 Processor -- start 2024-04-17T19:46:32.807 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-17T19:46:32.815+0000 7f873811d640 1 -- start start 2024-04-17T19:46:32.809 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-17T19:46:32.819+0000 7f873811d640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f87300c2ee0 0x7f87300c85f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:46:32.810 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-17T19:46:32.819+0000 7f873811d640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f8730159250 0x7f8730162fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:46:32.810 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-17T19:46:32.819+0000 7f873811d640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8730159660 con 0x7f8730158e40 2024-04-17T19:46:32.810 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-17T19:46:32.819+0000 7f873811d640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 -- 0x7f87300c32f0 con 0x7f8730159250 2024-04-17T19:46:32.810 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-17T19:46:32.819+0000 7f873811d640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7f87300c3540 con 0x7f87300c2ee0 2024-04-17T19:46:32.810 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-17T19:46:32.819+0000 7f8735eb9640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f87300c2ee0 0x7f87300c85f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:46:32.810 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-17T19:46:32.819+0000 7f8735eb9640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f87300c2ee0 0x7f87300c85f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3301/0 says I am v2:172.21.15.62:36422/0 (socket says 172.21.15.62:36422) 2024-04-17T19:46:32.810 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-17T19:46:32.819+0000 7f8735eb9640 1 -- 172.21.15.62:0/1105950576 learned_addr learned my addr 172.21.15.62:0/1105950576 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-04-17T19:46:32.810 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-17T19:46:32.819+0000 7f87366ba640 1 --2- 172.21.15.62:0/1105950576 >> v2:172.21.15.44:3300/0 conn(0x7f8730159250 0x7f8730162fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:46:32.810 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-17T19:46:32.819+0000 7f8735eb9640 1 -- 172.21.15.62:0/1105950576 >> v2:172.21.15.44:3300/0 conn(0x7f8730159250 msgr2=0x7f8730162fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T19:46:32.810 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-17T19:46:32.819+0000 7f8735eb9640 1 --2- 172.21.15.62:0/1105950576 >> v2:172.21.15.44:3300/0 conn(0x7f8730159250 0x7f8730162fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:46:32.810 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-17T19:46:32.819+0000 7f8735eb9640 1 -- 172.21.15.62:0/1105950576 >> v1:172.21.15.44:6789/0 conn(0x7f8730158e40 legacy=0x7f87300ca610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:46:32.811 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-17T19:46:32.819+0000 7f8735eb9640 1 -- 172.21.15.62:0/1105950576 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f87300c9900 con 0x7f87300c2ee0 2024-04-17T19:46:32.811 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-17T19:46:32.819+0000 7f8735eb9640 1 --2- 172.21.15.62:0/1105950576 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f87300c2ee0 0x7f87300c85f0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f872c009870 tx=0x7f872c01ed70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a1f2b816045f2bab server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:46:32.811 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-17T19:46:32.823+0000 7f8734eb7640 1 -- 172.21.15.62:0/1105950576 <== mon.2 v2:172.21.15.62:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f872c0b5070 con 0x7f87300c2ee0 2024-04-17T19:46:32.812 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-17T19:46:32.823+0000 7f8734eb7640 1 -- 172.21.15.62:0/1105950576 <== mon.2 v2:172.21.15.62:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f872c0a8a70 con 0x7f87300c2ee0 2024-04-17T19:46:32.812 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-17T19:46:32.823+0000 7f8734eb7640 1 -- 172.21.15.62:0/1105950576 <== mon.2 v2:172.21.15.62:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f872c0a8e40 con 0x7f87300c2ee0 2024-04-17T19:46:32.812 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-17T19:46:32.823+0000 7f873811d640 1 -- 172.21.15.62:0/1105950576 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f87300c2ee0 msgr2=0x7f87300c85f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:46:32.813 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-17T19:46:32.823+0000 7f873811d640 1 --2- 172.21.15.62:0/1105950576 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f87300c2ee0 0x7f87300c85f0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f872c009870 tx=0x7f872c01ed70 comp rx=0 tx=0).stop 2024-04-17T19:46:32.813 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-17T19:46:32.823+0000 7f873811d640 1 -- 172.21.15.62:0/1105950576 shutdown_connections 2024-04-17T19:46:32.813 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-17T19:46:32.823+0000 7f873811d640 1 --2- 172.21.15.62:0/1105950576 >> v2:172.21.15.44:3300/0 conn(0x7f8730159250 0x7f8730162fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:46:32.813 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-17T19:46:32.823+0000 7f873811d640 1 --2- 172.21.15.62:0/1105950576 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f87300c2ee0 0x7f87300c85f0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:46:32.813 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-17T19:46:32.823+0000 7f873811d640 1 -- 172.21.15.62:0/1105950576 >> 172.21.15.62:0/1105950576 conn(0x7f8730073c50 msgr2=0x7f873006ce90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:46:32.813 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-17T19:46:32.823+0000 7f873811d640 1 -- 172.21.15.62:0/1105950576 shutdown_connections 2024-04-17T19:46:32.813 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-17T19:46:32.823+0000 7f873811d640 1 -- 172.21.15.62:0/1105950576 wait complete. 2024-04-17T19:46:32.814 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-17T19:46:32.823+0000 7f873811d640 1 Processor -- start 2024-04-17T19:46:32.814 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-17T19:46:32.823+0000 7f873811d640 1 -- start start 2024-04-17T19:46:32.817 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-17T19:46:32.823+0000 7f873811d640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f87300c2ee0 0x7f87301531a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:46:32.817 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-17T19:46:32.823+0000 7f873811d640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f8730158e40 0x7f87301f0a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:46:32.817 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-17T19:46:32.823+0000 7f873811d640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8730159250 0x7f87301e4d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:46:32.817 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-17T19:46:32.823+0000 7f873811d640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f87300ca1a0 con 0x7f87300c2ee0 2024-04-17T19:46:32.817 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-17T19:46:32.823+0000 7f873811d640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f87300c9ec0 con 0x7f8730159250 2024-04-17T19:46:32.818 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-17T19:46:32.823+0000 7f873811d640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7f8730158920 con 0x7f8730158e40 2024-04-17T19:46:32.818 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-17T19:46:32.827+0000 7f87366ba640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8730159250 0x7f87301e4d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:46:32.818 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-17T19:46:32.827+0000 7f87356b8640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f8730158e40 0x7f87301f0a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:46:32.818 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-17T19:46:32.827+0000 7f87366ba640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8730159250 0x7f87301e4d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:58816/0 (socket says 172.21.15.62:58816) 2024-04-17T19:46:32.818 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-17T19:46:32.827+0000 7f87366ba640 1 -- 172.21.15.62:0/3338601058 learned_addr learned my addr 172.21.15.62:0/3338601058 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-04-17T19:46:32.818 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-17T19:46:32.827+0000 7f8735eb9640 1 --2- 172.21.15.62:0/3338601058 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f87300c2ee0 0x7f87301531a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:46:32.818 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-17T19:46:32.827+0000 7f87366ba640 1 -- 172.21.15.62:0/3338601058 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f8730158e40 msgr2=0x7f87301f0a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:46:32.818 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-17T19:46:32.827+0000 7f87366ba640 1 --2- 172.21.15.62:0/3338601058 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f8730158e40 0x7f87301f0a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:46:32.818 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-17T19:46:32.827+0000 7f87366ba640 1 -- 172.21.15.62:0/3338601058 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f87300c2ee0 msgr2=0x7f87301531a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:46:32.818 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-17T19:46:32.827+0000 7f87366ba640 1 --2- 172.21.15.62:0/3338601058 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f87300c2ee0 0x7f87301531a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:46:32.818 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-17T19:46:32.827+0000 7f87366ba640 1 -- 172.21.15.62:0/3338601058 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f87301eff60 con 0x7f8730159250 2024-04-17T19:46:32.819 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-17T19:46:32.827+0000 7f87366ba640 1 --2- 172.21.15.62:0/3338601058 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8730159250 0x7f87301e4d70 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f872800efc0 tx=0x7f872800c490 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:46:32.819 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-17T19:46:32.827+0000 7f87267fc640 1 -- 172.21.15.62:0/3338601058 <== mon.1 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8728018020 con 0x7f8730159250 2024-04-17T19:46:32.819 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-17T19:46:32.827+0000 7f87267fc640 1 -- 172.21.15.62:0/3338601058 <== mon.1 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8728014480 con 0x7f8730159250 2024-04-17T19:46:32.819 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-17T19:46:32.827+0000 7f873811d640 1 -- 172.21.15.62:0/3338601058 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8730150e30 con 0x7f8730159250 2024-04-17T19:46:32.819 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-17T19:46:32.827+0000 7f87267fc640 1 -- 172.21.15.62:0/3338601058 <== mon.1 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8728014870 con 0x7f8730159250 2024-04-17T19:46:32.819 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-17T19:46:32.827+0000 7f873811d640 1 -- 172.21.15.62:0/3338601058 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f87301f3560 con 0x7f8730159250 2024-04-17T19:46:32.819 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-17T19:46:32.827+0000 7f87267fc640 1 -- 172.21.15.62:0/3338601058 <== mon.1 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f872801b020 con 0x7f8730159250 2024-04-17T19:46:32.819 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-17T19:46:32.827+0000 7f87267fc640 1 -- 172.21.15.62:0/3338601058 <== mon.1 v2:172.21.15.62:3300/0 5 ==== osd_map(7..7 src has 1..7) ==== 1300+0+0 (secure 0 0 0) 0x7f8728013960 con 0x7f8730159250 2024-04-17T19:46:32.819 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-17T19:46:32.827+0000 7f873811d640 1 -- 172.21.15.62:0/3338601058 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f873004fea0 con 0x7f8730159250 2024-04-17T19:46:32.821 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-17T19:46:32.831+0000 7f87267fc640 1 -- 172.21.15.62:0/3338601058 <== mon.1 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7f8728022070 con 0x7f8730159250 2024-04-17T19:46:32.845 INFO:tasks.ceph.mgr.x.smithi062.stderr:2024-04-17T19:46:32.855+0000 7fd8b56cc180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-04-17T19:46:32.874 INFO:tasks.ceph.mgr.y.smithi044.stderr:2024-04-17T19:46:32.882+0000 7f9c50ed6180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-04-17T19:46:32.891 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-17T19:46:32.899+0000 7f873811d640 1 -- 172.21.15.62:0/3338601058 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd new", "uuid": "38c1e8d9-393d-4f33-a97a-3295cf5c5b07", "id": 5} v 0) -- 0x7f87300c8dd0 con 0x7f8730159250 2024-04-17T19:46:32.898 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-17T19:46:32.907+0000 7f87267fc640 1 -- 172.21.15.62:0/3338601058 <== mon.1 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "38c1e8d9-393d-4f33-a97a-3295cf5c5b07", "id": 5}]=0 v8) ==== 112+0+2 (secure 0 0 0) 0x7f8728010040 con 0x7f8730159250 2024-04-17T19:46:32.899 INFO:teuthology.orchestra.run.smithi062.stdout:5 2024-04-17T19:46:32.900 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-17T19:46:32.911+0000 7f873811d640 1 -- 172.21.15.62:0/3338601058 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8730159250 msgr2=0x7f87301e4d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:46:32.900 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-17T19:46:32.911+0000 7f873811d640 1 --2- 172.21.15.62:0/3338601058 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8730159250 0x7f87301e4d70 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f872800efc0 tx=0x7f872800c490 comp rx=0 tx=0).stop 2024-04-17T19:46:32.901 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-17T19:46:32.911+0000 7f873811d640 1 -- 172.21.15.62:0/3338601058 shutdown_connections 2024-04-17T19:46:32.901 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-17T19:46:32.911+0000 7f873811d640 1 --2- 172.21.15.62:0/3338601058 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f8730158e40 0x7f87301f0a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:46:32.901 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-17T19:46:32.911+0000 7f873811d640 1 --2- 172.21.15.62:0/3338601058 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8730159250 0x7f87301e4d70 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:46:32.901 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-17T19:46:32.911+0000 7f873811d640 1 --2- 172.21.15.62:0/3338601058 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f87300c2ee0 0x7f87301531a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:46:32.901 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-17T19:46:32.911+0000 7f873811d640 1 -- 172.21.15.62:0/3338601058 >> 172.21.15.62:0/3338601058 conn(0x7f8730073c50 msgr2=0x7f8730157510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:46:32.901 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-17T19:46:32.911+0000 7f873811d640 1 -- 172.21.15.62:0/3338601058 shutdown_connections 2024-04-17T19:46:32.902 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-17T19:46:32.911+0000 7f873811d640 1 -- 172.21.15.62:0/3338601058 wait complete. 2024-04-17T19:46:32.917 DEBUG:teuthology.orchestra.run.smithi062:> sudo ceph --cluster ceph osd new f6ff81c6-f14d-4477-88e3-9116cc5a2992 6 2024-04-17T19:46:32.928 INFO:tasks.ceph.mgr.x.smithi062.stderr:2024-04-17T19:46:32.939+0000 7fd8b56cc180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-04-17T19:46:32.941 INFO:tasks.ceph.mgr.y.smithi044.stderr:2024-04-17T19:46:32.950+0000 7f9c50ed6180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-04-17T19:46:32.984 INFO:tasks.ceph.mgr.x.smithi062.stderr:2024-04-17T19:46:32.995+0000 7fd8b56cc180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-04-17T19:46:33.071 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-17T19:46:33.079+0000 7fb99c162640 1 Processor -- start 2024-04-17T19:46:33.071 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-17T19:46:33.079+0000 7fb99c162640 1 -- start start 2024-04-17T19:46:33.074 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-17T19:46:33.083+0000 7fb99c162640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fb99406bd80 0x7fb9941500e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:46:33.074 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-17T19:46:33.083+0000 7fb99c162640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fb99415a030 0x7fb9940c6fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:46:33.075 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-17T19:46:33.083+0000 7fb99c162640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb994068290 con 0x7fb9940c6bb0 2024-04-17T19:46:33.075 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-17T19:46:33.083+0000 7fb99c162640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 -- 0x7fb99406c980 con 0x7fb99406bd80 2024-04-17T19:46:33.075 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-17T19:46:33.083+0000 7fb99c162640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7fb99406cc40 con 0x7fb99415a030 2024-04-17T19:46:33.075 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-17T19:46:33.083+0000 7fb9996fd640 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7fb9940c6bb0 0x7fb994159920 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:49538/0 (socket says 172.21.15.62:49538) 2024-04-17T19:46:33.075 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-17T19:46:33.083+0000 7fb99a6ff640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fb99415a030 0x7fb9940c6fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:46:33.075 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-17T19:46:33.083+0000 7fb9996fd640 1 -- 172.21.15.62:0/4158166475 learned_addr learned my addr 172.21.15.62:0/4158166475 (peer_addr_for_me v1:172.21.15.62:0/0) 2024-04-17T19:46:33.075 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-17T19:46:33.083+0000 7fb999efe640 1 --2- 172.21.15.62:0/4158166475 >> v2:172.21.15.44:3300/0 conn(0x7fb99406bd80 0x7fb9941500e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:46:33.075 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-17T19:46:33.083+0000 7fb998efc640 1 -- 172.21.15.62:0/4158166475 <== mon.1 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3732887234 0 0) 0x7fb994068290 con 0x7fb9940c6bb0 2024-04-17T19:46:33.076 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-17T19:46:33.083+0000 7fb998efc640 1 -- 172.21.15.62:0/4158166475 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb980003530 con 0x7fb9940c6bb0 2024-04-17T19:46:33.076 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-17T19:46:33.083+0000 7fb99a6ff640 1 -- 172.21.15.62:0/4158166475 >> v2:172.21.15.44:3300/0 conn(0x7fb99406bd80 msgr2=0x7fb9941500e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T19:46:33.076 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-17T19:46:33.083+0000 7fb99a6ff640 1 --2- 172.21.15.62:0/4158166475 >> v2:172.21.15.44:3300/0 conn(0x7fb99406bd80 0x7fb9941500e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:46:33.076 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-17T19:46:33.083+0000 7fb99a6ff640 1 -- 172.21.15.62:0/4158166475 >> v1:172.21.15.62:6789/0 conn(0x7fb9940c6bb0 legacy=0x7fb994159920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:46:33.076 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-17T19:46:33.083+0000 7fb99a6ff640 1 -- 172.21.15.62:0/4158166475 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb99406cf20 con 0x7fb99415a030 2024-04-17T19:46:33.078 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-17T19:46:33.087+0000 7fb99a6ff640 1 --2- 172.21.15.62:0/4158166475 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fb99415a030 0x7fb9940c6fc0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fb9900097c0 tx=0x7fb99001ec90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6aa71347d32adecf server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:46:33.078 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-17T19:46:33.087+0000 7fb998efc640 1 -- 172.21.15.62:0/4158166475 <== mon.2 v2:172.21.15.62:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9900b5070 con 0x7fb99415a030 2024-04-17T19:46:33.078 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-17T19:46:33.087+0000 7fb998efc640 1 -- 172.21.15.62:0/4158166475 <== mon.2 v2:172.21.15.62:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb9900a8990 con 0x7fb99415a030 2024-04-17T19:46:33.078 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-17T19:46:33.087+0000 7fb998efc640 1 -- 172.21.15.62:0/4158166475 <== mon.2 v2:172.21.15.62:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9900a8d60 con 0x7fb99415a030 2024-04-17T19:46:33.078 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-17T19:46:33.087+0000 7fb99c162640 1 -- 172.21.15.62:0/4158166475 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fb99415a030 msgr2=0x7fb9940c6fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:46:33.078 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-17T19:46:33.087+0000 7fb99c162640 1 --2- 172.21.15.62:0/4158166475 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fb99415a030 0x7fb9940c6fc0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fb9900097c0 tx=0x7fb99001ec90 comp rx=0 tx=0).stop 2024-04-17T19:46:33.078 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-17T19:46:33.087+0000 7fb99c162640 1 -- 172.21.15.62:0/4158166475 shutdown_connections 2024-04-17T19:46:33.079 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-17T19:46:33.087+0000 7fb99c162640 1 --2- 172.21.15.62:0/4158166475 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fb99415a030 0x7fb9940c6fc0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:46:33.079 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-17T19:46:33.087+0000 7fb99c162640 1 --2- 172.21.15.62:0/4158166475 >> v2:172.21.15.44:3300/0 conn(0x7fb99406bd80 0x7fb9941500e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:46:33.079 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-17T19:46:33.087+0000 7fb99c162640 1 -- 172.21.15.62:0/4158166475 >> 172.21.15.62:0/4158166475 conn(0x7fb9940ca170 msgr2=0x7fb9940ca580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:46:33.079 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-17T19:46:33.087+0000 7fb99c162640 1 -- 172.21.15.62:0/4158166475 shutdown_connections 2024-04-17T19:46:33.079 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-17T19:46:33.087+0000 7fb99c162640 1 -- 172.21.15.62:0/4158166475 wait complete. 2024-04-17T19:46:33.083 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-17T19:46:33.087+0000 7fb99c162640 1 Processor -- start 2024-04-17T19:46:33.083 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-17T19:46:33.087+0000 7fb99c162640 1 -- start start 2024-04-17T19:46:33.083 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-17T19:46:33.091+0000 7fb99c162640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb99406bd80 0x7fb994140710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:46:33.083 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-17T19:46:33.091+0000 7fb99c162640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb9940c6bb0 0x7fb9941566f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:46:33.083 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-17T19:46:33.091+0000 7fb99c162640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fb99415a030 0x7fb99413efb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:46:33.083 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-17T19:46:33.091+0000 7fb99c162640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fb99406c190 con 0x7fb99406bd80 2024-04-17T19:46:33.083 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-17T19:46:33.091+0000 7fb99c162640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7fb99406d4e0 con 0x7fb9940c6bb0 2024-04-17T19:46:33.083 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-17T19:46:33.091+0000 7fb99c162640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7fb994067e70 con 0x7fb99415a030 2024-04-17T19:46:33.084 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-17T19:46:33.091+0000 7fb99a6ff640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fb99415a030 0x7fb99413efb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:46:33.084 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-17T19:46:33.091+0000 7fb99a6ff640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fb99415a030 0x7fb99413efb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3301/0 says I am v2:172.21.15.62:36442/0 (socket says 172.21.15.62:36442) 2024-04-17T19:46:33.084 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-17T19:46:33.091+0000 7fb99a6ff640 1 -- 172.21.15.62:0/4280526384 learned_addr learned my addr 172.21.15.62:0/4280526384 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-04-17T19:46:33.084 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-17T19:46:33.091+0000 7fb9996fd640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb9940c6bb0 0x7fb9941566f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:46:33.084 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-17T19:46:33.091+0000 7fb999efe640 1 --2- 172.21.15.62:0/4280526384 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb99406bd80 0x7fb994140710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:46:33.084 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-17T19:46:33.091+0000 7fb99a6ff640 1 -- 172.21.15.62:0/4280526384 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb9940c6bb0 msgr2=0x7fb9941566f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:46:33.084 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-17T19:46:33.091+0000 7fb99a6ff640 1 --2- 172.21.15.62:0/4280526384 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb9940c6bb0 0x7fb9941566f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:46:33.084 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-17T19:46:33.091+0000 7fb99a6ff640 1 -- 172.21.15.62:0/4280526384 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb99406bd80 msgr2=0x7fb994140710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:46:33.085 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-17T19:46:33.091+0000 7fb99a6ff640 1 --2- 172.21.15.62:0/4280526384 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb99406bd80 0x7fb994140710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:46:33.085 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-17T19:46:33.091+0000 7fb99a6ff640 1 -- 172.21.15.62:0/4280526384 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb9941533c0 con 0x7fb99415a030 2024-04-17T19:46:33.085 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-17T19:46:33.091+0000 7fb99a6ff640 1 --2- 172.21.15.62:0/4280526384 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fb99415a030 0x7fb99413efb0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fb99001c8c0 tx=0x7fb99001ba30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:46:33.085 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-17T19:46:33.091+0000 7fb98a7fc640 1 -- 172.21.15.62:0/4280526384 <== mon.2 v2:172.21.15.62:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9900bf070 con 0x7fb99415a030 2024-04-17T19:46:33.085 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-17T19:46:33.091+0000 7fb98a7fc640 1 -- 172.21.15.62:0/4280526384 <== mon.2 v2:172.21.15.62:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb9900b0640 con 0x7fb99415a030 2024-04-17T19:46:33.085 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-17T19:46:33.091+0000 7fb98a7fc640 1 -- 172.21.15.62:0/4280526384 <== mon.2 v2:172.21.15.62:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9900b5040 con 0x7fb99415a030 2024-04-17T19:46:33.085 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-17T19:46:33.091+0000 7fb99c162640 1 -- 172.21.15.62:0/4280526384 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb994153680 con 0x7fb99415a030 2024-04-17T19:46:33.085 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-17T19:46:33.091+0000 7fb99c162640 1 -- 172.21.15.62:0/4280526384 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fb9941f3820 con 0x7fb99415a030 2024-04-17T19:46:33.085 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-17T19:46:33.091+0000 7fb98a7fc640 1 -- 172.21.15.62:0/4280526384 <== mon.2 v2:172.21.15.62:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fb9900b0a10 con 0x7fb99415a030 2024-04-17T19:46:33.086 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-17T19:46:33.091+0000 7fb98a7fc640 1 -- 172.21.15.62:0/4280526384 <== mon.2 v2:172.21.15.62:3301/0 5 ==== osd_map(8..8 src has 1..8) ==== 1415+0+0 (secure 0 0 0) 0x7fb9900b99e0 con 0x7fb99415a030 2024-04-17T19:46:33.086 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-17T19:46:33.091+0000 7fb99c162640 1 -- 172.21.15.62:0/4280526384 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb99415b400 con 0x7fb99415a030 2024-04-17T19:46:33.086 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-17T19:46:33.095+0000 7fb98a7fc640 1 -- 172.21.15.62:0/4280526384 <== mon.2 v2:172.21.15.62:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7fb99415b400 con 0x7fb99415a030 2024-04-17T19:46:33.116 INFO:tasks.ceph.mgr.y.smithi044.stderr:2024-04-17T19:46:33.126+0000 7f9c50ed6180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-04-17T19:46:33.145 INFO:tasks.ceph.mgr.x.smithi062.stderr:2024-04-17T19:46:33.155+0000 7fd8b56cc180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-04-17T19:46:33.152 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-17T19:46:33.163+0000 7fb99c162640 1 -- 172.21.15.62:0/4280526384 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_command({"prefix": "osd new", "uuid": "f6ff81c6-f14d-4477-88e3-9116cc5a2992", "id": 6} v 0) -- 0x7fb99404fea0 con 0x7fb99415a030 2024-04-17T19:46:33.157 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-17T19:46:33.167+0000 7fb98a7fc640 1 -- 172.21.15.62:0/4280526384 <== mon.2 v2:172.21.15.62:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "f6ff81c6-f14d-4477-88e3-9116cc5a2992", "id": 6}]=0 v9) ==== 112+0+2 (secure 0 0 0) 0x7fb9900c8020 con 0x7fb99415a030 2024-04-17T19:46:33.157 INFO:teuthology.orchestra.run.smithi062.stdout:6 2024-04-17T19:46:33.159 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-17T19:46:33.167+0000 7fb99c162640 1 -- 172.21.15.62:0/4280526384 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fb99415a030 msgr2=0x7fb99413efb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:46:33.159 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-17T19:46:33.167+0000 7fb99c162640 1 --2- 172.21.15.62:0/4280526384 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fb99415a030 0x7fb99413efb0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fb99001c8c0 tx=0x7fb99001ba30 comp rx=0 tx=0).stop 2024-04-17T19:46:33.159 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-17T19:46:33.167+0000 7fb99c162640 1 -- 172.21.15.62:0/4280526384 shutdown_connections 2024-04-17T19:46:33.159 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-17T19:46:33.167+0000 7fb99c162640 1 --2- 172.21.15.62:0/4280526384 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fb99415a030 0x7fb99413efb0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:46:33.159 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-17T19:46:33.167+0000 7fb99c162640 1 --2- 172.21.15.62:0/4280526384 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb9940c6bb0 0x7fb9941566f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:46:33.159 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-17T19:46:33.167+0000 7fb99c162640 1 --2- 172.21.15.62:0/4280526384 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb99406bd80 0x7fb994140710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:46:33.159 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-17T19:46:33.167+0000 7fb99c162640 1 -- 172.21.15.62:0/4280526384 >> 172.21.15.62:0/4280526384 conn(0x7fb9940ca170 msgr2=0x7fb9940700a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:46:33.159 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-17T19:46:33.167+0000 7fb99c162640 1 -- 172.21.15.62:0/4280526384 shutdown_connections 2024-04-17T19:46:33.159 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-17T19:46:33.167+0000 7fb99c162640 1 -- 172.21.15.62:0/4280526384 wait complete. 2024-04-17T19:46:33.176 DEBUG:teuthology.orchestra.run.smithi062:> sudo ceph --cluster ceph osd new ce395bc3-bcb5-4b94-a523-5bb9df491eca 7 2024-04-17T19:46:33.190 INFO:tasks.ceph.mgr.y.smithi044.stderr:2024-04-17T19:46:33.202+0000 7f9c50ed6180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-04-17T19:46:33.212 INFO:tasks.ceph.mgr.x.smithi062.stderr:2024-04-17T19:46:33.223+0000 7fd8b56cc180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-04-17T19:46:33.312 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-17T19:46:33.323+0000 7f015f1a3640 1 Processor -- start 2024-04-17T19:46:33.312 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-17T19:46:33.323+0000 7f015f1a3640 1 -- start start 2024-04-17T19:46:33.315 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-17T19:46:33.323+0000 7f015f1a3640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f015815d8e0 0x7f015806f410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:46:33.315 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-17T19:46:33.323+0000 7f015f1a3640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f015806f950 0x7f0158159de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:46:33.315 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-17T19:46:33.323+0000 7f015f1a3640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f01580c9de0 con 0x7f015815a320 2024-04-17T19:46:33.315 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-17T19:46:33.323+0000 7f015f1a3640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 -- 0x7f01580c9bb0 con 0x7f015806f950 2024-04-17T19:46:33.315 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-17T19:46:33.323+0000 7f015f1a3640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7f015806bd80 con 0x7f015815d8e0 2024-04-17T19:46:33.315 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-17T19:46:33.323+0000 7f015cf3f640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f015815d8e0 0x7f015806f410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:46:33.315 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-17T19:46:33.323+0000 7f015cf3f640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f015815d8e0 0x7f015806f410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3301/0 says I am v2:172.21.15.62:36450/0 (socket says 172.21.15.62:36450) 2024-04-17T19:46:33.315 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-17T19:46:33.323+0000 7f015cf3f640 1 -- 172.21.15.62:0/87627484 learned_addr learned my addr 172.21.15.62:0/87627484 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-04-17T19:46:33.315 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-17T19:46:33.323+0000 7f0157fff640 1 --2- 172.21.15.62:0/87627484 >> v2:172.21.15.44:3300/0 conn(0x7f015806f950 0x7f0158159de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:46:33.315 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-17T19:46:33.323+0000 7f015cf3f640 1 -- 172.21.15.62:0/87627484 >> v2:172.21.15.44:3300/0 conn(0x7f015806f950 msgr2=0x7f0158159de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T19:46:33.315 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-17T19:46:33.323+0000 7f015cf3f640 1 --2- 172.21.15.62:0/87627484 >> v2:172.21.15.44:3300/0 conn(0x7f015806f950 0x7f0158159de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:46:33.316 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-17T19:46:33.323+0000 7f015cf3f640 1 -- 172.21.15.62:0/87627484 >> v1:172.21.15.44:6789/0 conn(0x7f015815a320 legacy=0x7f01580c8830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:46:33.316 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-17T19:46:33.323+0000 7f015cf3f640 1 -- 172.21.15.62:0/87627484 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f01580ca0c0 con 0x7f015815d8e0 2024-04-17T19:46:33.317 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-17T19:46:33.327+0000 7f015cf3f640 1 --2- 172.21.15.62:0/87627484 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f015815d8e0 0x7f015806f410 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f0144009870 tx=0x7f014401ed50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=47b52897ee24d417 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:46:33.317 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-17T19:46:33.327+0000 7f01577fe640 1 -- 172.21.15.62:0/87627484 <== mon.2 v2:172.21.15.62:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01440b5070 con 0x7f015815d8e0 2024-04-17T19:46:33.317 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-17T19:46:33.327+0000 7f01577fe640 1 -- 172.21.15.62:0/87627484 <== mon.2 v2:172.21.15.62:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f01440a8a50 con 0x7f015815d8e0 2024-04-17T19:46:33.317 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-17T19:46:33.327+0000 7f01577fe640 1 -- 172.21.15.62:0/87627484 <== mon.2 v2:172.21.15.62:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01440a8e20 con 0x7f015815d8e0 2024-04-17T19:46:33.318 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-17T19:46:33.327+0000 7f015f1a3640 1 -- 172.21.15.62:0/87627484 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f015815d8e0 msgr2=0x7f015806f410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:46:33.318 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-17T19:46:33.327+0000 7f015f1a3640 1 --2- 172.21.15.62:0/87627484 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f015815d8e0 0x7f015806f410 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f0144009870 tx=0x7f014401ed50 comp rx=0 tx=0).stop 2024-04-17T19:46:33.318 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-17T19:46:33.327+0000 7f015f1a3640 1 -- 172.21.15.62:0/87627484 shutdown_connections 2024-04-17T19:46:33.318 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-17T19:46:33.327+0000 7f015f1a3640 1 --2- 172.21.15.62:0/87627484 >> v2:172.21.15.44:3300/0 conn(0x7f015806f950 0x7f0158159de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:46:33.318 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-17T19:46:33.327+0000 7f015f1a3640 1 --2- 172.21.15.62:0/87627484 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f015815d8e0 0x7f015806f410 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:46:33.318 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-17T19:46:33.327+0000 7f015f1a3640 1 -- 172.21.15.62:0/87627484 >> 172.21.15.62:0/87627484 conn(0x7f01580ca930 msgr2=0x7f01580cad40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:46:33.318 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-17T19:46:33.327+0000 7f015f1a3640 1 -- 172.21.15.62:0/87627484 shutdown_connections 2024-04-17T19:46:33.318 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-17T19:46:33.327+0000 7f015f1a3640 1 -- 172.21.15.62:0/87627484 wait complete. 2024-04-17T19:46:33.319 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-17T19:46:33.331+0000 7f015f1a3640 1 Processor -- start 2024-04-17T19:46:33.320 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-17T19:46:33.331+0000 7f015f1a3640 1 -- start start 2024-04-17T19:46:33.323 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-17T19:46:33.331+0000 7f015f1a3640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f015806f950 0x7f01581f03e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:46:33.323 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-17T19:46:33.331+0000 7f015f1a3640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f015815a320 0x7f01581527d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:46:33.323 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-17T19:46:33.331+0000 7f015f1a3640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f015815d8e0 0x7f01581f3540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:46:33.323 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-17T19:46:33.331+0000 7f015f1a3640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f015815a730 con 0x7f015815d8e0 2024-04-17T19:46:33.323 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-17T19:46:33.331+0000 7f015f1a3640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f015806c2b0 con 0x7f015806f950 2024-04-17T19:46:33.323 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-17T19:46:33.331+0000 7f015f1a3640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7f01580ca6a0 con 0x7f015815a320 2024-04-17T19:46:33.323 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-17T19:46:33.331+0000 7f0157fff640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f015815a320 0x7f01581527d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:46:33.323 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-17T19:46:33.331+0000 7f015cf3f640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f015806f950 0x7f01581f03e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:46:33.324 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-17T19:46:33.331+0000 7f0157fff640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f015815a320 0x7f01581527d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3301/0 says I am v2:172.21.15.62:36458/0 (socket says 172.21.15.62:36458) 2024-04-17T19:46:33.324 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-17T19:46:33.331+0000 7f0157fff640 1 -- 172.21.15.62:0/660515307 learned_addr learned my addr 172.21.15.62:0/660515307 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-04-17T19:46:33.324 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-17T19:46:33.331+0000 7f015d740640 1 --2- 172.21.15.62:0/660515307 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f015815d8e0 0x7f01581f3540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:46:33.324 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-17T19:46:33.331+0000 7f0157fff640 1 -- 172.21.15.62:0/660515307 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f015806f950 msgr2=0x7f01581f03e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:46:33.324 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-17T19:46:33.331+0000 7f0157fff640 1 --2- 172.21.15.62:0/660515307 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f015806f950 0x7f01581f03e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:46:33.324 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-17T19:46:33.331+0000 7f0157fff640 1 -- 172.21.15.62:0/660515307 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f015815d8e0 msgr2=0x7f01581f3540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:46:33.324 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-17T19:46:33.331+0000 7f0157fff640 1 --2- 172.21.15.62:0/660515307 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f015815d8e0 0x7f01581f3540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:46:33.324 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-17T19:46:33.331+0000 7f0157fff640 1 -- 172.21.15.62:0/660515307 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f01581f0920 con 0x7f015815a320 2024-04-17T19:46:33.324 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-17T19:46:33.331+0000 7f015cf3f640 1 --2- 172.21.15.62:0/660515307 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f015806f950 0x7f01581f03e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-17T19:46:33.324 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-17T19:46:33.331+0000 7f0157fff640 1 --2- 172.21.15.62:0/660515307 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f015815a320 0x7f01581527d0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f014c00d620 tx=0x7f014c00dae0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:46:33.324 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-17T19:46:33.331+0000 7f01557fa640 1 -- 172.21.15.62:0/660515307 <== mon.2 v2:172.21.15.62:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f014c00b620 con 0x7f015815a320 2024-04-17T19:46:33.324 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-17T19:46:33.331+0000 7f01557fa640 1 -- 172.21.15.62:0/660515307 <== mon.2 v2:172.21.15.62:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f014c019070 con 0x7f015815a320 2024-04-17T19:46:33.325 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-17T19:46:33.331+0000 7f015f1a3640 1 -- 172.21.15.62:0/660515307 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f01580cd6e0 con 0x7f015815a320 2024-04-17T19:46:33.325 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-17T19:46:33.331+0000 7f01557fa640 1 -- 172.21.15.62:0/660515307 <== mon.2 v2:172.21.15.62:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f014c00ba20 con 0x7f015815a320 2024-04-17T19:46:33.325 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-17T19:46:33.331+0000 7f015f1a3640 1 -- 172.21.15.62:0/660515307 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f01580cd980 con 0x7f015815a320 2024-04-17T19:46:33.325 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-17T19:46:33.331+0000 7f01557fa640 1 -- 172.21.15.62:0/660515307 <== mon.2 v2:172.21.15.62:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f014c00bbc0 con 0x7f015815a320 2024-04-17T19:46:33.325 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-17T19:46:33.331+0000 7f01557fa640 1 -- 172.21.15.62:0/660515307 <== mon.2 v2:172.21.15.62:3301/0 5 ==== osd_map(9..9 src has 1..9) ==== 1530+0+0 (secure 0 0 0) 0x7f014c014b30 con 0x7f015815a320 2024-04-17T19:46:33.325 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-17T19:46:33.331+0000 7f015f1a3640 1 -- 172.21.15.62:0/660515307 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f015804fea0 con 0x7f015815a320 2024-04-17T19:46:33.325 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-17T19:46:33.335+0000 7f01557fa640 1 -- 172.21.15.62:0/660515307 <== mon.2 v2:172.21.15.62:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7f014c014d30 con 0x7f015815a320 2024-04-17T19:46:33.391 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-17T19:46:33.399+0000 7f015f1a3640 1 -- 172.21.15.62:0/660515307 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_command({"prefix": "osd new", "uuid": "ce395bc3-bcb5-4b94-a523-5bb9df491eca", "id": 7} v 0) -- 0x7f01580ca480 con 0x7f015815a320 2024-04-17T19:46:33.399 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-17T19:46:33.407+0000 7f01557fa640 1 -- 172.21.15.62:0/660515307 <== mon.2 v2:172.21.15.62:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "ce395bc3-bcb5-4b94-a523-5bb9df491eca", "id": 7}]=0 v10) ==== 112+0+2 (secure 0 0 0) 0x7f014c0144d0 con 0x7f015815a320 2024-04-17T19:46:33.399 INFO:teuthology.orchestra.run.smithi062.stdout:7 2024-04-17T19:46:33.401 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-17T19:46:33.411+0000 7f015f1a3640 1 -- 172.21.15.62:0/660515307 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f015815a320 msgr2=0x7f01581527d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:46:33.401 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-17T19:46:33.411+0000 7f015f1a3640 1 --2- 172.21.15.62:0/660515307 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f015815a320 0x7f01581527d0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f014c00d620 tx=0x7f014c00dae0 comp rx=0 tx=0).stop 2024-04-17T19:46:33.401 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-17T19:46:33.411+0000 7f015f1a3640 1 -- 172.21.15.62:0/660515307 shutdown_connections 2024-04-17T19:46:33.401 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-17T19:46:33.411+0000 7f015f1a3640 1 --2- 172.21.15.62:0/660515307 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f015815a320 0x7f01581527d0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:46:33.401 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-17T19:46:33.411+0000 7f015f1a3640 1 --2- 172.21.15.62:0/660515307 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f015815d8e0 0x7f01581f3540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:46:33.401 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-17T19:46:33.411+0000 7f015f1a3640 1 --2- 172.21.15.62:0/660515307 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f015806f950 0x7f01581f03e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:46:33.401 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-17T19:46:33.411+0000 7f015f1a3640 1 -- 172.21.15.62:0/660515307 >> 172.21.15.62:0/660515307 conn(0x7f01580ca930 msgr2=0x7f0158149d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:46:33.401 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-17T19:46:33.411+0000 7f015f1a3640 1 -- 172.21.15.62:0/660515307 shutdown_connections 2024-04-17T19:46:33.401 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-17T19:46:33.411+0000 7f015f1a3640 1 -- 172.21.15.62:0/660515307 wait complete. 2024-04-17T19:46:33.418 INFO:tasks.ceph.osd.0:Restarting daemon 2024-04-17T19:46:33.418 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2024-04-17T19:46:33.422 INFO:tasks.ceph.osd.0:Started 2024-04-17T19:46:33.422 INFO:tasks.ceph.osd.1:Restarting daemon 2024-04-17T19:46:33.422 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2024-04-17T19:46:33.425 INFO:tasks.ceph.osd.1:Started 2024-04-17T19:46:33.425 INFO:tasks.ceph.osd.2:Restarting daemon 2024-04-17T19:46:33.426 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2024-04-17T19:46:33.428 INFO:tasks.ceph.osd.2:Started 2024-04-17T19:46:33.429 INFO:tasks.ceph.osd.3:Restarting daemon 2024-04-17T19:46:33.429 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2024-04-17T19:46:33.432 INFO:tasks.ceph.osd.3:Started 2024-04-17T19:46:33.432 INFO:tasks.ceph.osd.4:Restarting daemon 2024-04-17T19:46:33.432 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2024-04-17T19:46:33.464 INFO:tasks.ceph.osd.4:Started 2024-04-17T19:46:33.465 INFO:tasks.ceph.osd.5:Restarting daemon 2024-04-17T19:46:33.465 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2024-04-17T19:46:33.467 INFO:tasks.ceph.osd.5:Started 2024-04-17T19:46:33.467 INFO:tasks.ceph.osd.6:Restarting daemon 2024-04-17T19:46:33.467 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2024-04-17T19:46:33.469 INFO:tasks.ceph.osd.6:Started 2024-04-17T19:46:33.469 INFO:tasks.ceph.osd.7:Restarting daemon 2024-04-17T19:46:33.469 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2024-04-17T19:46:33.471 INFO:tasks.ceph.osd.7:Started 2024-04-17T19:46:33.472 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-17T19:46:33.695 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:33.706+0000 7f9832600640 1 Processor -- start 2024-04-17T19:46:33.695 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:33.706+0000 7f9832600640 1 -- start start 2024-04-17T19:46:33.697 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:33.706+0000 7f9832600640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f982c06d330 0x7f982c15d400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:46:33.698 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:33.706+0000 7f9832600640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f982c160430 0x7f982c0c9900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:46:33.698 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:33.706+0000 7f9832600640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f982c0cbef0 con 0x7f982c0c94f0 2024-04-17T19:46:33.698 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:33.706+0000 7f9832600640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 -- 0x7f982c06e000 con 0x7f982c06d330 2024-04-17T19:46:33.698 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:33.706+0000 7f9832600640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 -- 0x7f982c0cb930 con 0x7f982c160430 2024-04-17T19:46:33.698 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:33.706+0000 7f9831200640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f982c06d330 0x7f982c15d400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:46:33.698 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:33.706+0000 7f9823e00640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f982c0c94f0 0x7f982c15fd20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:57046/0 (socket says 172.21.15.44:57046) 2024-04-17T19:46:33.698 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:33.706+0000 7f9823e00640 1 -- 172.21.15.44:0/1784042303 learned_addr learned my addr 172.21.15.44:0/1784042303 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-04-17T19:46:33.698 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:33.706+0000 7f9831c00640 1 --2- 172.21.15.44:0/1784042303 >> v2:172.21.15.62:3300/0 conn(0x7f982c160430 0x7f982c0c9900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:46:33.698 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:33.706+0000 7f9831200640 1 -- 172.21.15.44:0/1784042303 >> v2:172.21.15.62:3300/0 conn(0x7f982c160430 msgr2=0x7f982c0c9900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T19:46:33.698 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:33.706+0000 7f9831200640 1 --2- 172.21.15.44:0/1784042303 >> v2:172.21.15.62:3300/0 conn(0x7f982c160430 0x7f982c0c9900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:46:33.698 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:33.706+0000 7f9831200640 1 -- 172.21.15.44:0/1784042303 >> v1:172.21.15.44:6789/0 conn(0x7f982c0c94f0 legacy=0x7f982c15fd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:46:33.698 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:33.706+0000 7f9831200640 1 -- 172.21.15.44:0/1784042303 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f982c0cbc10 con 0x7f982c06d330 2024-04-17T19:46:33.698 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:33.706+0000 7f982be00640 1 -- 172.21.15.44:0/1784042303 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2569331566 0 0) 0x7f982c0cbef0 con 0x7f982c0c94f0 2024-04-17T19:46:33.701 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:33.710+0000 7f9831200640 1 --2- 172.21.15.44:0/1784042303 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f982c06d330 0x7f982c15d400 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f982c0c5560 tx=0x7f981c01ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fda14c115a90c7db server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:46:33.701 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:33.710+0000 7f982be00640 1 -- 172.21.15.44:0/1784042303 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f981c0b5070 con 0x7f982c06d330 2024-04-17T19:46:33.701 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:33.710+0000 7f982be00640 1 -- 172.21.15.44:0/1784042303 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f981c0a8970 con 0x7f982c06d330 2024-04-17T19:46:33.701 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:33.710+0000 7f982be00640 1 -- 172.21.15.44:0/1784042303 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f981c0a8d40 con 0x7f982c06d330 2024-04-17T19:46:33.702 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:33.710+0000 7f9832600640 1 -- 172.21.15.44:0/1784042303 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f982c06d330 msgr2=0x7f982c15d400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:46:33.702 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:33.710+0000 7f9832600640 1 --2- 172.21.15.44:0/1784042303 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f982c06d330 0x7f982c15d400 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f982c0c5560 tx=0x7f981c01ec70 comp rx=0 tx=0).stop 2024-04-17T19:46:33.702 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:33.710+0000 7f9832600640 1 -- 172.21.15.44:0/1784042303 shutdown_connections 2024-04-17T19:46:33.702 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:33.710+0000 7f9832600640 1 --2- 172.21.15.44:0/1784042303 >> v2:172.21.15.62:3300/0 conn(0x7f982c160430 0x7f982c0c9900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:46:33.702 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:33.710+0000 7f9832600640 1 --2- 172.21.15.44:0/1784042303 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f982c06d330 0x7f982c15d400 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:46:33.702 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:33.710+0000 7f9832600640 1 -- 172.21.15.44:0/1784042303 >> 172.21.15.44:0/1784042303 conn(0x7f982c072150 msgr2=0x7f982c072560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:46:33.702 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:33.710+0000 7f9832600640 1 -- 172.21.15.44:0/1784042303 shutdown_connections 2024-04-17T19:46:33.702 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:33.710+0000 7f9832600640 1 -- 172.21.15.44:0/1784042303 wait complete. 2024-04-17T19:46:33.704 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:33.714+0000 7f9832600640 1 Processor -- start 2024-04-17T19:46:33.704 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:33.714+0000 7f9832600640 1 -- start start 2024-04-17T19:46:33.707 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:33.714+0000 7f9832600640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f982c06d330 0x7f982c1fa130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:46:33.708 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:33.714+0000 7f9832600640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f982c0c94f0 0x7f982c153a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:46:33.708 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:33.714+0000 7f9832600640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f982c160430 0x7f982c14e1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:46:33.708 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:33.714+0000 7f9832600640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f982c0cae00 con 0x7f982c160430 2024-04-17T19:46:33.708 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:33.714+0000 7f9832600640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f982c06dc90 con 0x7f982c06d330 2024-04-17T19:46:33.708 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:33.714+0000 7f9832600640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7f982c0cb4f0 con 0x7f982c0c94f0 2024-04-17T19:46:33.708 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:33.714+0000 7f9831200640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f982c06d330 0x7f982c1fa130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:46:33.708 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:33.714+0000 7f9823e00640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f982c0c94f0 0x7f982c153a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:46:33.708 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:33.714+0000 7f9831c00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f982c160430 0x7f982c14e1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:46:33.708 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:33.714+0000 7f9831200640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f982c06d330 0x7f982c1fa130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.44:52292/0 (socket says 172.21.15.44:52292) 2024-04-17T19:46:33.708 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:33.714+0000 7f9831200640 1 -- 172.21.15.44:0/2586097691 learned_addr learned my addr 172.21.15.44:0/2586097691 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-04-17T19:46:33.708 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:33.718+0000 7f9831200640 1 -- 172.21.15.44:0/2586097691 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f982c0c94f0 msgr2=0x7f982c153a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:46:33.708 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:33.718+0000 7f9831200640 1 --2- 172.21.15.44:0/2586097691 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f982c0c94f0 0x7f982c153a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:46:33.708 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:33.718+0000 7f9831200640 1 -- 172.21.15.44:0/2586097691 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f982c160430 msgr2=0x7f982c14e1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:46:33.708 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:33.718+0000 7f9831200640 1 --2- 172.21.15.44:0/2586097691 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f982c160430 0x7f982c14e1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:46:33.709 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:33.718+0000 7f9831200640 1 -- 172.21.15.44:0/2586097691 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f982c15ea70 con 0x7f982c06d330 2024-04-17T19:46:33.709 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:33.718+0000 7f9823e00640 1 --2- 172.21.15.44:0/2586097691 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f982c0c94f0 0x7f982c153a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-17T19:46:33.709 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:33.718+0000 7f9831c00640 1 --2- 172.21.15.44:0/2586097691 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f982c160430 0x7f982c14e1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-17T19:46:33.709 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:33.718+0000 7f9831200640 1 --2- 172.21.15.44:0/2586097691 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f982c06d330 0x7f982c1fa130 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f981c01b880 tx=0x7f981c01ba10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:46:33.709 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:33.718+0000 7f9829600640 1 -- 172.21.15.44:0/2586097691 <== mon.1 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f981c0c0070 con 0x7f982c06d330 2024-04-17T19:46:33.709 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:33.718+0000 7f9829600640 1 -- 172.21.15.44:0/2586097691 <== mon.1 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f981c004230 con 0x7f982c06d330 2024-04-17T19:46:33.709 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:33.718+0000 7f9829600640 1 -- 172.21.15.44:0/2586097691 <== mon.1 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f981c0b5040 con 0x7f982c06d330 2024-04-17T19:46:33.709 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:33.718+0000 7f9832600640 1 -- 172.21.15.44:0/2586097691 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f982c15aa90 con 0x7f982c06d330 2024-04-17T19:46:33.709 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:33.718+0000 7f9832600640 1 -- 172.21.15.44:0/2586097691 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f982c1f9930 con 0x7f982c06d330 2024-04-17T19:46:33.709 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:33.718+0000 7f9829600640 1 -- 172.21.15.44:0/2586097691 <== mon.1 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f981c003620 con 0x7f982c06d330 2024-04-17T19:46:33.709 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:33.718+0000 7f9829600640 1 -- 172.21.15.44:0/2586097691 <== mon.1 v2:172.21.15.62:3300/0 5 ==== osd_map(10..10 src has 1..10) ==== 1645+0+0 (secure 0 0 0) 0x7f981c0a88b0 con 0x7f982c06d330 2024-04-17T19:46:33.709 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:33.718+0000 7f9832600640 1 -- 172.21.15.44:0/2586097691 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f982c04fea0 con 0x7f982c06d330 2024-04-17T19:46:33.711 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:33.722+0000 7f9829600640 1 -- 172.21.15.44:0/2586097691 <== mon.1 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7f981c0dbe50 con 0x7f982c06d330 2024-04-17T19:46:33.769 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:33.778+0000 7f9832600640 1 -- 172.21.15.44:0/2586097691 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f982c0c9fc0 con 0x7f982c06d330 2024-04-17T19:46:33.770 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:33.782+0000 7f9829600640 1 -- 172.21.15.44:0/2586097691 <== mon.1 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) ==== 74+0+7058 (secure 0 0 0) 0x7f981c0ca020 con 0x7f982c06d330 2024-04-17T19:46:33.770 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-04-17T19:46:33.771 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":10,"fsid":"703f77ca-79c6-4a66-b576-62c526cb1021","created":"2024-04-17T19:46:30.831994+0000","modified":"2024-04-17T19:46:33.407430+0000","last_up_change":"0.000000","last_in_change":"2024-04-17T19:46:33.407430+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"30520dc6-eea6-43d4-ab60-3ca9e92329dd","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"079bd511-b6ce-449b-8f11-17b311b12f7c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"34f0b9ab-b1d2-4ee9-841c-f15afbb6bec5","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"4740032d-fe34-4b1b-bb85-f430896fc3c0","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"7dbedb00-302d-4d52-810c-e18839254da1","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"38c1e8d9-393d-4f33-a97a-3295cf5c5b07","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"f6ff81c6-f14d-4477-88e3-9116cc5a2992","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"ce395bc3-bcb5-4b94-a523-5bb9df491eca","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-17T19:46:33.771 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:33.782+0000 7f9832600640 1 -- 172.21.15.44:0/2586097691 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f982c06d330 msgr2=0x7f982c1fa130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:46:33.772 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:33.782+0000 7f9832600640 1 --2- 172.21.15.44:0/2586097691 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f982c06d330 0x7f982c1fa130 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f981c01b880 tx=0x7f981c01ba10 comp rx=0 tx=0).stop 2024-04-17T19:46:33.772 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:33.782+0000 7f9832600640 1 -- 172.21.15.44:0/2586097691 shutdown_connections 2024-04-17T19:46:33.772 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:33.782+0000 7f9832600640 1 --2- 172.21.15.44:0/2586097691 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f982c0c94f0 0x7f982c153a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:46:33.772 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:33.782+0000 7f9832600640 1 --2- 172.21.15.44:0/2586097691 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f982c160430 0x7f982c14e1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:46:33.772 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:33.782+0000 7f9832600640 1 --2- 172.21.15.44:0/2586097691 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f982c06d330 0x7f982c1fa130 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:46:33.772 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:33.782+0000 7f9832600640 1 -- 172.21.15.44:0/2586097691 >> 172.21.15.44:0/2586097691 conn(0x7f982c072150 msgr2=0x7f982c070ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:46:33.772 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:33.782+0000 7f9832600640 1 -- 172.21.15.44:0/2586097691 shutdown_connections 2024-04-17T19:46:33.772 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:33.782+0000 7f9832600640 1 -- 172.21.15.44:0/2586097691 wait complete. 2024-04-17T19:46:33.790 INFO:tasks.ceph.ceph_manager.ceph:[] 2024-04-17T19:46:33.790 INFO:tasks.ceph:Waiting for OSDs to come up 2024-04-17T19:46:33.877 INFO:tasks.ceph.mgr.x.smithi062.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2024-04-17T19:46:33.877 INFO:tasks.ceph.mgr.x.smithi062.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2024-04-17T19:46:33.877 INFO:tasks.ceph.mgr.x.smithi062.stderr: from numpy import show_config as show_numpy_config 2024-04-17T19:46:33.879 INFO:tasks.ceph.mgr.y.smithi044.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2024-04-17T19:46:33.879 INFO:tasks.ceph.mgr.y.smithi044.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2024-04-17T19:46:33.879 INFO:tasks.ceph.mgr.y.smithi044.stderr: from numpy import show_config as show_numpy_config 2024-04-17T19:46:33.901 INFO:tasks.ceph.osd.4.smithi062.stderr:2024-04-17T19:46:33.911+0000 7f00ad35f7c0 -1 Falling back to public interface 2024-04-17T19:46:33.908 INFO:tasks.ceph.osd.5.smithi062.stderr:2024-04-17T19:46:33.919+0000 7f4a318497c0 -1 Falling back to public interface 2024-04-17T19:46:33.922 INFO:tasks.ceph.mgr.y.smithi044.stderr:2024-04-17T19:46:33.930+0000 7f9c50ed6180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-04-17T19:46:33.922 INFO:tasks.ceph.mgr.x.smithi062.stderr:2024-04-17T19:46:33.931+0000 7fd8b56cc180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-04-17T19:46:34.072 INFO:tasks.ceph.mgr.x.smithi062.stderr:2024-04-17T19:46:34.083+0000 7fd8b56cc180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-04-17T19:46:34.078 INFO:tasks.ceph.mgr.y.smithi044.stderr:2024-04-17T19:46:34.086+0000 7f9c50ed6180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-04-17T19:46:34.135 INFO:tasks.ceph.osd.0.smithi044.stderr:2024-04-17T19:46:34.146+0000 7f62efba47c0 -1 Falling back to public interface 2024-04-17T19:46:34.139 INFO:tasks.ceph.osd.3.smithi044.stderr:2024-04-17T19:46:34.150+0000 7f8c3ca2b7c0 -1 Falling back to public interface 2024-04-17T19:46:34.148 INFO:tasks.ceph.osd.1.smithi044.stderr:2024-04-17T19:46:34.158+0000 7f93347207c0 -1 Falling back to public interface 2024-04-17T19:46:34.148 INFO:tasks.ceph.osd.2.smithi044.stderr:2024-04-17T19:46:34.158+0000 7f888ce2b7c0 -1 Falling back to public interface 2024-04-17T19:46:34.153 INFO:tasks.ceph.osd.7.smithi062.stderr:2024-04-17T19:46:34.163+0000 7fb8619c47c0 -1 Falling back to public interface 2024-04-17T19:46:34.166 INFO:tasks.ceph.osd.6.smithi062.stderr:2024-04-17T19:46:34.175+0000 7fcb8abac7c0 -1 Falling back to public interface 2024-04-17T19:46:34.242 INFO:tasks.ceph.mgr.x.smithi062.stderr:2024-04-17T19:46:34.251+0000 7fd8b56cc180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-04-17T19:46:34.265 INFO:tasks.ceph.mgr.y.smithi044.stderr:2024-04-17T19:46:34.274+0000 7f9c50ed6180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-04-17T19:46:34.311 INFO:tasks.ceph.mgr.x.smithi062.stderr:2024-04-17T19:46:34.319+0000 7fd8b56cc180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-04-17T19:46:34.341 INFO:tasks.ceph.mgr.y.smithi044.stderr:2024-04-17T19:46:34.350+0000 7f9c50ed6180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-04-17T19:46:34.459 INFO:tasks.ceph.mgr.x.smithi062.stderr:2024-04-17T19:46:34.471+0000 7fd8b56cc180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-04-17T19:46:34.499 INFO:tasks.ceph.mgr.y.smithi044.stderr:2024-04-17T19:46:34.510+0000 7f9c50ed6180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-04-17T19:46:34.596 DEBUG:teuthology.orchestra.run.smithi044:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-04-17T19:46:34.737 INFO:teuthology.misc.health.smithi044.stderr:2024-04-17T19:46:34.746+0000 7f9ebea00640 1 Processor -- start 2024-04-17T19:46:34.737 INFO:teuthology.misc.health.smithi044.stderr:2024-04-17T19:46:34.746+0000 7f9ebea00640 1 -- start start 2024-04-17T19:46:34.739 INFO:teuthology.misc.health.smithi044.stderr:2024-04-17T19:46:34.750+0000 7f9ebea00640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f9eb80c8a50 0x7f9eb8072550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:46:34.739 INFO:teuthology.misc.health.smithi044.stderr:2024-04-17T19:46:34.750+0000 7f9ebea00640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f9eb80c75e0 0x7f9eb80c79f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:46:34.739 INFO:teuthology.misc.health.smithi044.stderr:2024-04-17T19:46:34.750+0000 7f9ebea00640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f9eb8072ef0 0x7f9eb8073300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:46:34.740 INFO:teuthology.misc.health.smithi044.stderr:2024-04-17T19:46:34.750+0000 7f9ebea00640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 -- 0x7f9eb815c880 con 0x7f9eb80c75e0 2024-04-17T19:46:34.740 INFO:teuthology.misc.health.smithi044.stderr:2024-04-17T19:46:34.750+0000 7f9ebea00640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 -- 0x7f9eb80c7f30 con 0x7f9eb80c8a50 2024-04-17T19:46:34.740 INFO:teuthology.misc.health.smithi044.stderr:2024-04-17T19:46:34.750+0000 7f9ebea00640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7f9eb8073840 con 0x7f9eb8072ef0 2024-04-17T19:46:34.740 INFO:teuthology.misc.health.smithi044.stderr:2024-04-17T19:46:34.750+0000 7f9eafe00640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f9eb80c75e0 0x7f9eb80c79f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:46:34.740 INFO:teuthology.misc.health.smithi044.stderr:2024-04-17T19:46:34.750+0000 7f9eafe00640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f9eb80c75e0 0x7f9eb80c79f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:60254/0 (socket says 172.21.15.44:60254) 2024-04-17T19:46:34.740 INFO:teuthology.misc.health.smithi044.stderr:2024-04-17T19:46:34.750+0000 7f9ebca00640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f9eb8072ef0 0x7f9eb8073300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:46:34.740 INFO:teuthology.misc.health.smithi044.stderr:2024-04-17T19:46:34.750+0000 7f9eafe00640 1 -- 172.21.15.44:0/1727488491 learned_addr learned my addr 172.21.15.44:0/1727488491 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-04-17T19:46:34.740 INFO:teuthology.misc.health.smithi044.stderr:2024-04-17T19:46:34.750+0000 7f9eb7e00640 1 --2- 172.21.15.44:0/1727488491 >> v2:172.21.15.62:3300/0 conn(0x7f9eb80c8a50 0x7f9eb8072550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:46:34.740 INFO:teuthology.misc.health.smithi044.stderr:2024-04-17T19:46:34.750+0000 7f9eafe00640 1 -- 172.21.15.44:0/1727488491 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f9eb8072ef0 msgr2=0x7f9eb8073300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T19:46:34.740 INFO:teuthology.misc.health.smithi044.stderr:2024-04-17T19:46:34.750+0000 7f9eafe00640 1 --2- 172.21.15.44:0/1727488491 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f9eb8072ef0 0x7f9eb8073300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:46:34.740 INFO:teuthology.misc.health.smithi044.stderr:2024-04-17T19:46:34.750+0000 7f9eafe00640 1 -- 172.21.15.44:0/1727488491 >> v2:172.21.15.62:3300/0 conn(0x7f9eb80c8a50 msgr2=0x7f9eb8072550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T19:46:34.740 INFO:teuthology.misc.health.smithi044.stderr:2024-04-17T19:46:34.750+0000 7f9eafe00640 1 --2- 172.21.15.44:0/1727488491 >> v2:172.21.15.62:3300/0 conn(0x7f9eb80c8a50 0x7f9eb8072550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:46:34.740 INFO:teuthology.misc.health.smithi044.stderr:2024-04-17T19:46:34.750+0000 7f9eafe00640 1 -- 172.21.15.44:0/1727488491 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9eb80c22f0 con 0x7f9eb80c75e0 2024-04-17T19:46:34.743 INFO:teuthology.misc.health.smithi044.stderr:2024-04-17T19:46:34.754+0000 7f9eafe00640 1 --2- 172.21.15.44:0/1727488491 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9eb80c75e0 0x7f9eb80c79f0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f9eb80739c0 tx=0x7f9ea001c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7272b0d745a7226f server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:46:34.743 INFO:teuthology.misc.health.smithi044.stderr:2024-04-17T19:46:34.754+0000 7f9eb7400640 1 -- 172.21.15.44:0/1727488491 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ea00b1070 con 0x7f9eb80c75e0 2024-04-17T19:46:34.743 INFO:teuthology.misc.health.smithi044.stderr:2024-04-17T19:46:34.754+0000 7f9eb7400640 1 -- 172.21.15.44:0/1727488491 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9ea00ac630 con 0x7f9eb80c75e0 2024-04-17T19:46:34.743 INFO:teuthology.misc.health.smithi044.stderr:2024-04-17T19:46:34.754+0000 7f9eb7400640 1 -- 172.21.15.44:0/1727488491 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ea00a8050 con 0x7f9eb80c75e0 2024-04-17T19:46:34.744 INFO:teuthology.misc.health.smithi044.stderr:2024-04-17T19:46:34.754+0000 7f9ebea00640 1 -- 172.21.15.44:0/1727488491 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9eb80c75e0 msgr2=0x7f9eb80c79f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:46:34.744 INFO:teuthology.misc.health.smithi044.stderr:2024-04-17T19:46:34.754+0000 7f9ebea00640 1 --2- 172.21.15.44:0/1727488491 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9eb80c75e0 0x7f9eb80c79f0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f9eb80739c0 tx=0x7f9ea001c520 comp rx=0 tx=0).stop 2024-04-17T19:46:34.744 INFO:teuthology.misc.health.smithi044.stderr:2024-04-17T19:46:34.754+0000 7f9ebea00640 1 -- 172.21.15.44:0/1727488491 shutdown_connections 2024-04-17T19:46:34.744 INFO:teuthology.misc.health.smithi044.stderr:2024-04-17T19:46:34.754+0000 7f9ebea00640 1 --2- 172.21.15.44:0/1727488491 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9eb80c75e0 0x7f9eb80c79f0 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:46:34.744 INFO:teuthology.misc.health.smithi044.stderr:2024-04-17T19:46:34.754+0000 7f9ebea00640 1 --2- 172.21.15.44:0/1727488491 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f9eb8072ef0 0x7f9eb8073300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:46:34.744 INFO:teuthology.misc.health.smithi044.stderr:2024-04-17T19:46:34.754+0000 7f9ebea00640 1 --2- 172.21.15.44:0/1727488491 >> v2:172.21.15.62:3300/0 conn(0x7f9eb80c8a50 0x7f9eb8072550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:46:34.744 INFO:teuthology.misc.health.smithi044.stderr:2024-04-17T19:46:34.754+0000 7f9ebea00640 1 -- 172.21.15.44:0/1727488491 >> 172.21.15.44:0/1727488491 conn(0x7f9eb806c380 msgr2=0x7f9eb80ccbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:46:34.744 INFO:teuthology.misc.health.smithi044.stderr:2024-04-17T19:46:34.754+0000 7f9ebea00640 1 -- 172.21.15.44:0/1727488491 shutdown_connections 2024-04-17T19:46:34.744 INFO:teuthology.misc.health.smithi044.stderr:2024-04-17T19:46:34.754+0000 7f9ebea00640 1 -- 172.21.15.44:0/1727488491 wait complete. 2024-04-17T19:46:34.745 INFO:teuthology.misc.health.smithi044.stderr:2024-04-17T19:46:34.754+0000 7f9ebea00640 1 Processor -- start 2024-04-17T19:46:34.745 INFO:teuthology.misc.health.smithi044.stderr:2024-04-17T19:46:34.754+0000 7f9ebea00640 1 -- start start 2024-04-17T19:46:34.749 INFO:teuthology.misc.health.smithi044.stderr:2024-04-17T19:46:34.758+0000 7f9ebea00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9eb8072ef0 0x7f9eb81f5410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:46:34.749 INFO:teuthology.misc.health.smithi044.stderr:2024-04-17T19:46:34.758+0000 7f9ebea00640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f9eb80c75e0 0x7f9eb8149930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:46:34.749 INFO:teuthology.misc.health.smithi044.stderr:2024-04-17T19:46:34.758+0000 7f9ebea00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9eb80c8a50 0x7f9eb814b770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:46:34.749 INFO:teuthology.misc.health.smithi044.stderr:2024-04-17T19:46:34.758+0000 7f9ebea00640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f9eb815c230 con 0x7f9eb8072ef0 2024-04-17T19:46:34.749 INFO:teuthology.misc.health.smithi044.stderr:2024-04-17T19:46:34.758+0000 7f9ebea00640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f9eb815bf50 con 0x7f9eb80c8a50 2024-04-17T19:46:34.749 INFO:teuthology.misc.health.smithi044.stderr:2024-04-17T19:46:34.758+0000 7f9ebea00640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7f9eb815c510 con 0x7f9eb80c75e0 2024-04-17T19:46:34.749 INFO:teuthology.misc.health.smithi044.stderr:2024-04-17T19:46:34.758+0000 7f9eb7e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9eb8072ef0 0x7f9eb81f5410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:46:34.749 INFO:teuthology.misc.health.smithi044.stderr:2024-04-17T19:46:34.758+0000 7f9eb7e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9eb8072ef0 0x7f9eb81f5410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:60256/0 (socket says 172.21.15.44:60256) 2024-04-17T19:46:34.749 INFO:teuthology.misc.health.smithi044.stderr:2024-04-17T19:46:34.758+0000 7f9eb7e00640 1 -- 172.21.15.44:0/2784502087 learned_addr learned my addr 172.21.15.44:0/2784502087 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-04-17T19:46:34.749 INFO:teuthology.misc.health.smithi044.stderr:2024-04-17T19:46:34.758+0000 7f9ebca00640 1 --2- 172.21.15.44:0/2784502087 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9eb80c8a50 0x7f9eb814b770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:46:34.750 INFO:teuthology.misc.health.smithi044.stderr:2024-04-17T19:46:34.758+0000 7f9eafe00640 1 --2- 172.21.15.44:0/2784502087 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f9eb80c75e0 0x7f9eb8149930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:46:34.750 INFO:teuthology.misc.health.smithi044.stderr:2024-04-17T19:46:34.758+0000 7f9eb7e00640 1 -- 172.21.15.44:0/2784502087 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f9eb80c75e0 msgr2=0x7f9eb8149930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:46:34.750 INFO:teuthology.misc.health.smithi044.stderr:2024-04-17T19:46:34.758+0000 7f9eb7e00640 1 --2- 172.21.15.44:0/2784502087 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f9eb80c75e0 0x7f9eb8149930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:46:34.750 INFO:teuthology.misc.health.smithi044.stderr:2024-04-17T19:46:34.758+0000 7f9eb7e00640 1 -- 172.21.15.44:0/2784502087 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9eb80c8a50 msgr2=0x7f9eb814b770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:46:34.750 INFO:teuthology.misc.health.smithi044.stderr:2024-04-17T19:46:34.758+0000 7f9eb7e00640 1 --2- 172.21.15.44:0/2784502087 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9eb80c8a50 0x7f9eb814b770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:46:34.750 INFO:teuthology.misc.health.smithi044.stderr:2024-04-17T19:46:34.758+0000 7f9eb7e00640 1 -- 172.21.15.44:0/2784502087 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9eb81469a0 con 0x7f9eb8072ef0 2024-04-17T19:46:34.750 INFO:teuthology.misc.health.smithi044.stderr:2024-04-17T19:46:34.758+0000 7f9eafe00640 1 --2- 172.21.15.44:0/2784502087 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f9eb80c75e0 0x7f9eb8149930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-17T19:46:34.750 INFO:teuthology.misc.health.smithi044.stderr:2024-04-17T19:46:34.758+0000 7f9eb7e00640 1 --2- 172.21.15.44:0/2784502087 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9eb8072ef0 0x7f9eb81f5410 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f9ea800e870 tx=0x7f9ea800ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:46:34.750 INFO:teuthology.misc.health.smithi044.stderr:2024-04-17T19:46:34.758+0000 7f9eb4c00640 1 -- 172.21.15.44:0/2784502087 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ea8017070 con 0x7f9eb8072ef0 2024-04-17T19:46:34.750 INFO:teuthology.misc.health.smithi044.stderr:2024-04-17T19:46:34.758+0000 7f9eb4c00640 1 -- 172.21.15.44:0/2784502087 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9ea800ee60 con 0x7f9eb8072ef0 2024-04-17T19:46:34.750 INFO:teuthology.misc.health.smithi044.stderr:2024-04-17T19:46:34.758+0000 7f9eb4c00640 1 -- 172.21.15.44:0/2784502087 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ea800cae0 con 0x7f9eb8072ef0 2024-04-17T19:46:34.750 INFO:teuthology.misc.health.smithi044.stderr:2024-04-17T19:46:34.758+0000 7f9ebea00640 1 -- 172.21.15.44:0/2784502087 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9eb81f5950 con 0x7f9eb8072ef0 2024-04-17T19:46:34.750 INFO:teuthology.misc.health.smithi044.stderr:2024-04-17T19:46:34.758+0000 7f9ebea00640 1 -- 172.21.15.44:0/2784502087 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9eb81f8be0 con 0x7f9eb8072ef0 2024-04-17T19:46:34.750 INFO:teuthology.misc.health.smithi044.stderr:2024-04-17T19:46:34.758+0000 7f9eb4c00640 1 -- 172.21.15.44:0/2784502087 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f9ea801a070 con 0x7f9eb8072ef0 2024-04-17T19:46:34.751 INFO:teuthology.misc.health.smithi044.stderr:2024-04-17T19:46:34.758+0000 7f9eb4c00640 1 -- 172.21.15.44:0/2784502087 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(10..10 src has 1..10) ==== 1645+0+0 (secure 0 0 0) 0x7f9ea800cc80 con 0x7f9eb8072ef0 2024-04-17T19:46:34.751 INFO:teuthology.misc.health.smithi044.stderr:2024-04-17T19:46:34.758+0000 7f9ebea00640 1 -- 172.21.15.44:0/2784502087 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9eb804fea0 con 0x7f9eb8072ef0 2024-04-17T19:46:34.752 INFO:teuthology.misc.health.smithi044.stderr:2024-04-17T19:46:34.762+0000 7f9eb4c00640 1 -- 172.21.15.44:0/2784502087 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7f9ea8013470 con 0x7f9eb8072ef0 2024-04-17T19:46:34.812 INFO:teuthology.misc.health.smithi044.stderr:2024-04-17T19:46:34.822+0000 7f9ebea00640 1 -- 172.21.15.44:0/2784502087 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f9eb815a850 con 0x7f9eb8072ef0 2024-04-17T19:46:34.813 INFO:teuthology.misc.health.smithi044.stderr:2024-04-17T19:46:34.822+0000 7f9eb4c00640 1 -- 172.21.15.44:0/2784502087 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) ==== 74+0+7058 (secure 0 0 0) 0x7f9ea8013650 con 0x7f9eb8072ef0 2024-04-17T19:46:34.813 INFO:teuthology.misc.health.smithi044.stdout: 2024-04-17T19:46:34.813 INFO:teuthology.misc.health.smithi044.stdout:{"epoch":10,"fsid":"703f77ca-79c6-4a66-b576-62c526cb1021","created":"2024-04-17T19:46:30.831994+0000","modified":"2024-04-17T19:46:33.407430+0000","last_up_change":"0.000000","last_in_change":"2024-04-17T19:46:33.407430+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"30520dc6-eea6-43d4-ab60-3ca9e92329dd","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"079bd511-b6ce-449b-8f11-17b311b12f7c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"34f0b9ab-b1d2-4ee9-841c-f15afbb6bec5","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"4740032d-fe34-4b1b-bb85-f430896fc3c0","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"7dbedb00-302d-4d52-810c-e18839254da1","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"38c1e8d9-393d-4f33-a97a-3295cf5c5b07","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"f6ff81c6-f14d-4477-88e3-9116cc5a2992","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"ce395bc3-bcb5-4b94-a523-5bb9df491eca","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-17T19:46:34.814 INFO:teuthology.misc.health.smithi044.stderr:2024-04-17T19:46:34.822+0000 7f9ebea00640 1 -- 172.21.15.44:0/2784502087 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9eb8072ef0 msgr2=0x7f9eb81f5410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:46:34.814 INFO:teuthology.misc.health.smithi044.stderr:2024-04-17T19:46:34.822+0000 7f9ebea00640 1 --2- 172.21.15.44:0/2784502087 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9eb8072ef0 0x7f9eb81f5410 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f9ea800e870 tx=0x7f9ea800ec70 comp rx=0 tx=0).stop 2024-04-17T19:46:34.814 INFO:teuthology.misc.health.smithi044.stderr:2024-04-17T19:46:34.822+0000 7f9ebea00640 1 -- 172.21.15.44:0/2784502087 shutdown_connections 2024-04-17T19:46:34.814 INFO:teuthology.misc.health.smithi044.stderr:2024-04-17T19:46:34.822+0000 7f9ebea00640 1 --2- 172.21.15.44:0/2784502087 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f9eb80c75e0 0x7f9eb8149930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:46:34.815 INFO:teuthology.misc.health.smithi044.stderr:2024-04-17T19:46:34.822+0000 7f9ebea00640 1 --2- 172.21.15.44:0/2784502087 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9eb80c8a50 0x7f9eb814b770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:46:34.815 INFO:teuthology.misc.health.smithi044.stderr:2024-04-17T19:46:34.822+0000 7f9ebea00640 1 --2- 172.21.15.44:0/2784502087 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9eb8072ef0 0x7f9eb81f5410 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:46:34.815 INFO:teuthology.misc.health.smithi044.stderr:2024-04-17T19:46:34.822+0000 7f9ebea00640 1 -- 172.21.15.44:0/2784502087 >> 172.21.15.44:0/2784502087 conn(0x7f9eb806c380 msgr2=0x7f9eb814cf70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:46:34.815 INFO:teuthology.misc.health.smithi044.stderr:2024-04-17T19:46:34.822+0000 7f9ebea00640 1 -- 172.21.15.44:0/2784502087 shutdown_connections 2024-04-17T19:46:34.815 INFO:teuthology.misc.health.smithi044.stderr:2024-04-17T19:46:34.822+0000 7f9ebea00640 1 -- 172.21.15.44:0/2784502087 wait complete. 2024-04-17T19:46:34.831 DEBUG:teuthology.misc:0 of 8 OSDs are up 2024-04-17T19:46:35.111 INFO:tasks.ceph.mgr.x.smithi062.stderr:2024-04-17T19:46:35.119+0000 7fd8b56cc180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-04-17T19:46:35.190 INFO:tasks.ceph.mgr.x.smithi062.stderr:2024-04-17T19:46:35.199+0000 7fd8b56cc180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-04-17T19:46:35.215 INFO:tasks.ceph.mgr.y.smithi044.stderr:2024-04-17T19:46:35.226+0000 7f9c50ed6180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-04-17T19:46:35.308 INFO:tasks.ceph.mgr.y.smithi044.stderr:2024-04-17T19:46:35.318+0000 7f9c50ed6180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-04-17T19:46:35.379 INFO:tasks.ceph.mgr.x.smithi062.stderr:2024-04-17T19:46:35.391+0000 7fd8b56cc180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-04-17T19:46:35.457 INFO:tasks.ceph.mgr.x.smithi062.stderr:2024-04-17T19:46:35.467+0000 7fd8b56cc180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-04-17T19:46:35.520 INFO:tasks.ceph.mgr.y.smithi044.stderr:2024-04-17T19:46:35.530+0000 7f9c50ed6180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-04-17T19:46:35.610 INFO:tasks.ceph.mgr.y.smithi044.stderr:2024-04-17T19:46:35.618+0000 7f9c50ed6180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-04-17T19:46:35.761 INFO:tasks.ceph.mgr.x.smithi062.stderr:2024-04-17T19:46:35.771+0000 7fd8b56cc180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-04-17T19:46:35.826 INFO:tasks.ceph.mgr.x.smithi062.stderr:2024-04-17T19:46:35.835+0000 7fd8b56cc180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-04-17T19:46:35.963 INFO:tasks.ceph.mgr.y.smithi044.stderr:2024-04-17T19:46:35.974+0000 7f9c50ed6180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-04-17T19:46:36.038 INFO:tasks.ceph.mgr.y.smithi044.stderr:2024-04-17T19:46:36.046+0000 7f9c50ed6180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-04-17T19:46:36.927 INFO:tasks.ceph.mgr.x.smithi062.stderr:2024-04-17T19:46:36.935+0000 7fd85c981640 -1 mgr.server handle_report got status from non-daemon mon.b 2024-04-17T19:46:36.927 INFO:tasks.ceph.mgr.x.smithi062.stderr:2024-04-17T19:46:36.935+0000 7fd85c981640 -1 mgr.server handle_report got status from non-daemon mon.c 2024-04-17T19:46:37.756 INFO:tasks.ceph.osd.5.smithi062.stderr:2024-04-17T19:46:37.766+0000 7f4a318497c0 -1 osd.5 0 log_to_monitors true 2024-04-17T19:46:37.848 INFO:tasks.ceph.osd.4.smithi062.stderr:2024-04-17T19:46:37.858+0000 7f00ad35f7c0 -1 osd.4 0 log_to_monitors true 2024-04-17T19:46:37.984 INFO:tasks.ceph.osd.7.smithi062.stderr:2024-04-17T19:46:37.994+0000 7fb8619c47c0 -1 osd.7 0 log_to_monitors true 2024-04-17T19:46:37.992 INFO:tasks.ceph.osd.6.smithi062.stderr:2024-04-17T19:46:38.002+0000 7fcb8abac7c0 -1 osd.6 0 log_to_monitors true 2024-04-17T19:46:38.124 INFO:tasks.ceph.osd.1.smithi044.stderr:2024-04-17T19:46:38.134+0000 7f93347207c0 -1 osd.1 0 log_to_monitors true 2024-04-17T19:46:38.143 INFO:tasks.ceph.osd.2.smithi044.stderr:2024-04-17T19:46:38.154+0000 7f888ce2b7c0 -1 osd.2 0 log_to_monitors true 2024-04-17T19:46:38.298 INFO:tasks.ceph.osd.0.smithi044.stderr:2024-04-17T19:46:38.310+0000 7f62efba47c0 -1 osd.0 0 log_to_monitors true 2024-04-17T19:46:38.342 INFO:tasks.ceph.osd.3.smithi044.stderr:2024-04-17T19:46:38.350+0000 7f8c3ca2b7c0 -1 osd.3 0 log_to_monitors true 2024-04-17T19:46:39.839 INFO:tasks.ceph.osd.4.smithi062.stderr:2024-04-17T19:46:39.846+0000 7f00a9306640 -1 osd.4 0 waiting for initial osdmap 2024-04-17T19:46:39.860 INFO:tasks.ceph.osd.4.smithi062.stderr:2024-04-17T19:46:39.870+0000 7f00a1107640 -1 osd.4 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-17T19:46:39.867 INFO:tasks.ceph.osd.5.smithi062.stderr:2024-04-17T19:46:39.874+0000 7f4a2d7f0640 -1 osd.5 0 waiting for initial osdmap 2024-04-17T19:46:39.900 INFO:tasks.ceph.osd.5.smithi062.stderr:2024-04-17T19:46:39.910+0000 7f4a255f1640 -1 osd.5 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-17T19:46:40.921 INFO:tasks.ceph.osd.7.smithi062.stderr:2024-04-17T19:46:40.930+0000 7fb85e17f640 -1 osd.7 0 waiting for initial osdmap 2024-04-17T19:46:40.922 INFO:tasks.ceph.osd.6.smithi062.stderr:2024-04-17T19:46:40.930+0000 7fcb86b53640 -1 osd.6 0 waiting for initial osdmap 2024-04-17T19:46:40.949 INFO:tasks.ceph.osd.6.smithi062.stderr:2024-04-17T19:46:40.958+0000 7fcb7e954640 -1 osd.6 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-17T19:46:40.949 INFO:tasks.ceph.osd.7.smithi062.stderr:2024-04-17T19:46:40.958+0000 7fb85576c640 -1 osd.7 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-17T19:46:41.451 INFO:tasks.ceph.osd.0.smithi044.stderr:2024-04-17T19:46:41.462+0000 7f62eaa00640 -1 osd.0 0 waiting for initial osdmap 2024-04-17T19:46:41.472 INFO:tasks.ceph.osd.2.smithi044.stderr:2024-04-17T19:46:41.482+0000 7f8887200640 -1 osd.2 0 waiting for initial osdmap 2024-04-17T19:46:41.481 INFO:tasks.ceph.osd.1.smithi044.stderr:2024-04-17T19:46:41.490+0000 7f932f600640 -1 osd.1 0 waiting for initial osdmap 2024-04-17T19:46:41.483 INFO:tasks.ceph.osd.0.smithi044.stderr:2024-04-17T19:46:41.494+0000 7f62e0a00640 -1 osd.0 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-17T19:46:41.503 INFO:tasks.ceph.osd.2.smithi044.stderr:2024-04-17T19:46:41.514+0000 7f887d200640 -1 osd.2 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-17T19:46:41.524 INFO:tasks.ceph.osd.1.smithi044.stderr:2024-04-17T19:46:41.534+0000 7f9325600640 -1 osd.1 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-17T19:46:41.558 INFO:tasks.ceph.osd.3.smithi044.stderr:2024-04-17T19:46:41.566+0000 7f8c36e00640 -1 osd.3 0 waiting for initial osdmap 2024-04-17T19:46:41.584 INFO:tasks.ceph.osd.3.smithi044.stderr:2024-04-17T19:46:41.594+0000 7f8c2ce00640 -1 osd.3 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-17T19:46:41.636 DEBUG:teuthology.orchestra.run.smithi044:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-04-17T19:46:41.777 INFO:teuthology.misc.health.smithi044.stderr:2024-04-17T19:46:41.786+0000 7f0698e00640 1 Processor -- start 2024-04-17T19:46:41.777 INFO:teuthology.misc.health.smithi044.stderr:2024-04-17T19:46:41.786+0000 7f0698e00640 1 -- start start 2024-04-17T19:46:41.779 INFO:teuthology.misc.health.smithi044.stderr:2024-04-17T19:46:41.790+0000 7f0698e00640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f0694151eb0 0x7f06940c22a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:46:41.779 INFO:teuthology.misc.health.smithi044.stderr:2024-04-17T19:46:41.790+0000 7f0698e00640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f0694158ac0 0x7f0694162800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:46:41.780 INFO:teuthology.misc.health.smithi044.stderr:2024-04-17T19:46:41.790+0000 7f0698e00640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f06940725f0 con 0x7f06941586b0 2024-04-17T19:46:41.780 INFO:teuthology.misc.health.smithi044.stderr:2024-04-17T19:46:41.790+0000 7f0698e00640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 -- 0x7f0694158220 con 0x7f0694151eb0 2024-04-17T19:46:41.780 INFO:teuthology.misc.health.smithi044.stderr:2024-04-17T19:46:41.790+0000 7f0698e00640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 -- 0x7f0694072890 con 0x7f0694158ac0 2024-04-17T19:46:41.780 INFO:teuthology.misc.health.smithi044.stderr:2024-04-17T19:46:41.790+0000 7f0691e00640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f0694151eb0 0x7f06940c22a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:46:41.780 INFO:teuthology.misc.health.smithi044.stderr:2024-04-17T19:46:41.790+0000 7f0691e00640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f0694151eb0 0x7f06940c22a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:47884/0 (socket says 172.21.15.44:47884) 2024-04-17T19:46:41.780 INFO:teuthology.misc.health.smithi044.stderr:2024-04-17T19:46:41.790+0000 7f0691e00640 1 -- 172.21.15.44:0/1490855865 learned_addr learned my addr 172.21.15.44:0/1490855865 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-04-17T19:46:41.780 INFO:teuthology.misc.health.smithi044.stderr:2024-04-17T19:46:41.790+0000 7f0692800640 1 --2- 172.21.15.44:0/1490855865 >> v2:172.21.15.62:3300/0 conn(0x7f0694158ac0 0x7f0694162800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:46:41.780 INFO:teuthology.misc.health.smithi044.stderr:2024-04-17T19:46:41.790+0000 7f0691e00640 1 -- 172.21.15.44:0/1490855865 >> v2:172.21.15.62:3300/0 conn(0x7f0694158ac0 msgr2=0x7f0694162800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T19:46:41.780 INFO:teuthology.misc.health.smithi044.stderr:2024-04-17T19:46:41.790+0000 7f0691e00640 1 --2- 172.21.15.44:0/1490855865 >> v2:172.21.15.62:3300/0 conn(0x7f0694158ac0 0x7f0694162800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:46:41.780 INFO:teuthology.misc.health.smithi044.stderr:2024-04-17T19:46:41.790+0000 7f0691e00640 1 -- 172.21.15.44:0/1490855865 >> v1:172.21.15.62:6789/0 conn(0x7f06941586b0 legacy=0x7f069406fcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:46:41.780 INFO:teuthology.misc.health.smithi044.stderr:2024-04-17T19:46:41.790+0000 7f0691e00640 1 -- 172.21.15.44:0/1490855865 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0694072b70 con 0x7f0694151eb0 2024-04-17T19:46:41.783 INFO:teuthology.misc.health.smithi044.stderr:2024-04-17T19:46:41.794+0000 7f0691e00640 1 --2- 172.21.15.44:0/1490855865 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0694151eb0 0x7f06940c22a0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f06940727c0 tx=0x7f068401c4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=47f30dc82c50a436 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:46:41.783 INFO:teuthology.misc.health.smithi044.stderr:2024-04-17T19:46:41.794+0000 7f0691400640 1 -- 172.21.15.44:0/1490855865 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06840aa610 con 0x7f0694151eb0 2024-04-17T19:46:41.783 INFO:teuthology.misc.health.smithi044.stderr:2024-04-17T19:46:41.794+0000 7f0691400640 1 -- 172.21.15.44:0/1490855865 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f06840af070 con 0x7f0694151eb0 2024-04-17T19:46:41.783 INFO:teuthology.misc.health.smithi044.stderr:2024-04-17T19:46:41.794+0000 7f0691400640 1 -- 172.21.15.44:0/1490855865 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06840aa9d0 con 0x7f0694151eb0 2024-04-17T19:46:41.784 INFO:teuthology.misc.health.smithi044.stderr:2024-04-17T19:46:41.794+0000 7f0698e00640 1 -- 172.21.15.44:0/1490855865 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0694151eb0 msgr2=0x7f06940c22a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:46:41.784 INFO:teuthology.misc.health.smithi044.stderr:2024-04-17T19:46:41.794+0000 7f0698e00640 1 --2- 172.21.15.44:0/1490855865 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0694151eb0 0x7f06940c22a0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f06940727c0 tx=0x7f068401c4f0 comp rx=0 tx=0).stop 2024-04-17T19:46:41.784 INFO:teuthology.misc.health.smithi044.stderr:2024-04-17T19:46:41.794+0000 7f0698e00640 1 -- 172.21.15.44:0/1490855865 shutdown_connections 2024-04-17T19:46:41.784 INFO:teuthology.misc.health.smithi044.stderr:2024-04-17T19:46:41.794+0000 7f0698e00640 1 --2- 172.21.15.44:0/1490855865 >> v2:172.21.15.62:3300/0 conn(0x7f0694158ac0 0x7f0694162800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:46:41.784 INFO:teuthology.misc.health.smithi044.stderr:2024-04-17T19:46:41.794+0000 7f0698e00640 1 --2- 172.21.15.44:0/1490855865 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0694151eb0 0x7f06940c22a0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:46:41.784 INFO:teuthology.misc.health.smithi044.stderr:2024-04-17T19:46:41.794+0000 7f0698e00640 1 -- 172.21.15.44:0/1490855865 >> 172.21.15.44:0/1490855865 conn(0x7f069406c380 msgr2=0x7f06940ccbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:46:41.784 INFO:teuthology.misc.health.smithi044.stderr:2024-04-17T19:46:41.794+0000 7f0698e00640 1 -- 172.21.15.44:0/1490855865 shutdown_connections 2024-04-17T19:46:41.784 INFO:teuthology.misc.health.smithi044.stderr:2024-04-17T19:46:41.794+0000 7f0698e00640 1 -- 172.21.15.44:0/1490855865 wait complete. 2024-04-17T19:46:41.786 INFO:teuthology.misc.health.smithi044.stderr:2024-04-17T19:46:41.794+0000 7f0698e00640 1 Processor -- start 2024-04-17T19:46:41.786 INFO:teuthology.misc.health.smithi044.stderr:2024-04-17T19:46:41.794+0000 7f0698e00640 1 -- start start 2024-04-17T19:46:41.788 INFO:teuthology.misc.health.smithi044.stderr:2024-04-17T19:46:41.798+0000 7f0698e00640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f0694151eb0 0x7f069414da50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:46:41.788 INFO:teuthology.misc.health.smithi044.stderr:2024-04-17T19:46:41.798+0000 7f0698e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f06941586b0 0x7f06941f82c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:46:41.789 INFO:teuthology.misc.health.smithi044.stderr:2024-04-17T19:46:41.798+0000 7f0698e00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0694158ac0 0x7f0694140350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:46:41.789 INFO:teuthology.misc.health.smithi044.stderr:2024-04-17T19:46:41.798+0000 7f0698e00640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f0694074070 con 0x7f06941586b0 2024-04-17T19:46:41.789 INFO:teuthology.misc.health.smithi044.stderr:2024-04-17T19:46:41.798+0000 7f0698e00640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f06940c75e0 con 0x7f0694158ac0 2024-04-17T19:46:41.789 INFO:teuthology.misc.health.smithi044.stderr:2024-04-17T19:46:41.798+0000 7f0698e00640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7f06940c27e0 con 0x7f0694151eb0 2024-04-17T19:46:41.789 INFO:teuthology.misc.health.smithi044.stderr:2024-04-17T19:46:41.798+0000 7f068be00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f06941586b0 0x7f06941f82c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:46:41.789 INFO:teuthology.misc.health.smithi044.stderr:2024-04-17T19:46:41.798+0000 7f068be00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f06941586b0 0x7f06941f82c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:47886/0 (socket says 172.21.15.44:47886) 2024-04-17T19:46:41.789 INFO:teuthology.misc.health.smithi044.stderr:2024-04-17T19:46:41.798+0000 7f068be00640 1 -- 172.21.15.44:0/2239852658 learned_addr learned my addr 172.21.15.44:0/2239852658 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-04-17T19:46:41.789 INFO:teuthology.misc.health.smithi044.stderr:2024-04-17T19:46:41.798+0000 7f0691e00640 1 --2- 172.21.15.44:0/2239852658 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f0694151eb0 0x7f069414da50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:46:41.789 INFO:teuthology.misc.health.smithi044.stderr:2024-04-17T19:46:41.798+0000 7f0692800640 1 --2- 172.21.15.44:0/2239852658 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0694158ac0 0x7f0694140350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:46:41.789 INFO:teuthology.misc.health.smithi044.stderr:2024-04-17T19:46:41.798+0000 7f068be00640 1 -- 172.21.15.44:0/2239852658 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f0694151eb0 msgr2=0x7f069414da50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:46:41.789 INFO:teuthology.misc.health.smithi044.stderr:2024-04-17T19:46:41.798+0000 7f068be00640 1 --2- 172.21.15.44:0/2239852658 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f0694151eb0 0x7f069414da50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:46:41.789 INFO:teuthology.misc.health.smithi044.stderr:2024-04-17T19:46:41.798+0000 7f068be00640 1 -- 172.21.15.44:0/2239852658 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0694158ac0 msgr2=0x7f0694140350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:46:41.789 INFO:teuthology.misc.health.smithi044.stderr:2024-04-17T19:46:41.798+0000 7f068be00640 1 --2- 172.21.15.44:0/2239852658 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0694158ac0 0x7f0694140350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:46:41.790 INFO:teuthology.misc.health.smithi044.stderr:2024-04-17T19:46:41.798+0000 7f068be00640 1 -- 172.21.15.44:0/2239852658 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0694142560 con 0x7f06941586b0 2024-04-17T19:46:41.790 INFO:teuthology.misc.health.smithi044.stderr:2024-04-17T19:46:41.798+0000 7f068be00640 1 --2- 172.21.15.44:0/2239852658 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f06941586b0 0x7f06941f82c0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f067c00c3f0 tx=0x7f067c00c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:46:41.790 INFO:teuthology.misc.health.smithi044.stderr:2024-04-17T19:46:41.798+0000 7f068a000640 1 -- 172.21.15.44:0/2239852658 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f067c017070 con 0x7f06941586b0 2024-04-17T19:46:41.790 INFO:teuthology.misc.health.smithi044.stderr:2024-04-17T19:46:41.798+0000 7f068a000640 1 -- 172.21.15.44:0/2239852658 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f067c0052d0 con 0x7f06941586b0 2024-04-17T19:46:41.790 INFO:teuthology.misc.health.smithi044.stderr:2024-04-17T19:46:41.798+0000 7f068a000640 1 -- 172.21.15.44:0/2239852658 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f067c003840 con 0x7f06941586b0 2024-04-17T19:46:41.790 INFO:teuthology.misc.health.smithi044.stderr:2024-04-17T19:46:41.798+0000 7f0698e00640 1 -- 172.21.15.44:0/2239852658 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0694142840 con 0x7f06941586b0 2024-04-17T19:46:41.790 INFO:teuthology.misc.health.smithi044.stderr:2024-04-17T19:46:41.798+0000 7f0698e00640 1 -- 172.21.15.44:0/2239852658 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0694144190 con 0x7f06941586b0 2024-04-17T19:46:41.790 INFO:teuthology.misc.health.smithi044.stderr:2024-04-17T19:46:41.798+0000 7f0698e00640 1 -- 172.21.15.44:0/2239852658 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f069404fea0 con 0x7f06941586b0 2024-04-17T19:46:41.791 INFO:teuthology.misc.health.smithi044.stderr:2024-04-17T19:46:41.802+0000 7f068a000640 1 -- 172.21.15.44:0/2239852658 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 4) ==== 87931+0+0 (secure 0 0 0) 0x7f067c01a070 con 0x7f06941586b0 2024-04-17T19:46:41.791 INFO:teuthology.misc.health.smithi044.stderr:2024-04-17T19:46:41.802+0000 7f068a000640 1 --2- 172.21.15.44:0/2239852658 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f0670068320 0x7f067006a830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:46:41.791 INFO:teuthology.misc.health.smithi044.stderr:2024-04-17T19:46:41.802+0000 7f068a000640 1 -- 172.21.15.44:0/2239852658 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(14..14 src has 1..14) ==== 2791+0+0 (secure 0 0 0) 0x7f067c085130 con 0x7f06941586b0 2024-04-17T19:46:41.792 INFO:teuthology.misc.health.smithi044.stderr:2024-04-17T19:46:41.802+0000 7f0691e00640 1 --2- 172.21.15.44:0/2239852658 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f0670068320 0x7f067006a830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:46:41.793 INFO:teuthology.misc.health.smithi044.stderr:2024-04-17T19:46:41.802+0000 7f0691e00640 1 --2- 172.21.15.44:0/2239852658 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f0670068320 0x7f067006a830 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f06840ae000 tx=0x7f06840a7000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:46:41.797 INFO:teuthology.misc.health.smithi044.stderr:2024-04-17T19:46:41.806+0000 7f068a000640 1 -- 172.21.15.44:0/2239852658 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f067c005480 con 0x7f06941586b0 2024-04-17T19:46:41.970 INFO:teuthology.misc.health.smithi044.stderr:2024-04-17T19:46:41.978+0000 7f0698e00640 1 -- 172.21.15.44:0/2239852658 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f06940cb120 con 0x7f06941586b0 2024-04-17T19:46:41.971 INFO:teuthology.misc.health.smithi044.stderr:2024-04-17T19:46:41.982+0000 7f068a000640 1 -- 172.21.15.44:0/2239852658 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v14) ==== 74+0+8075 (secure 0 0 0) 0x7f067c0562a0 con 0x7f06941586b0 2024-04-17T19:46:41.971 INFO:teuthology.misc.health.smithi044.stdout: 2024-04-17T19:46:41.972 INFO:teuthology.misc.health.smithi044.stdout:{"epoch":14,"fsid":"703f77ca-79c6-4a66-b576-62c526cb1021","created":"2024-04-17T19:46:30.831994+0000","modified":"2024-04-17T19:46:40.982679+0000","last_up_change":"2024-04-17T19:46:39.943776+0000","last_in_change":"2024-04-17T19:46:33.407430+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"30520dc6-eea6-43d4-ab60-3ca9e92329dd","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"079bd511-b6ce-449b-8f11-17b311b12f7c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"34f0b9ab-b1d2-4ee9-841c-f15afbb6bec5","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"4740032d-fe34-4b1b-bb85-f430896fc3c0","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"7dbedb00-302d-4d52-810c-e18839254da1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6800","nonce":2293251376},{"type":"v1","addr":"172.21.15.62:6801","nonce":2293251376}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6802","nonce":2293251376},{"type":"v1","addr":"172.21.15.62:6803","nonce":2293251376}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6806","nonce":2293251376},{"type":"v1","addr":"172.21.15.62:6807","nonce":2293251376}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6804","nonce":2293251376},{"type":"v1","addr":"172.21.15.62:6805","nonce":2293251376}]},"public_addr":"172.21.15.62:6801/2293251376","cluster_addr":"172.21.15.62:6803/2293251376","heartbeat_back_addr":"172.21.15.62:6807/2293251376","heartbeat_front_addr":"172.21.15.62:6805/2293251376","state":["exists","up"]},{"osd":5,"uuid":"38c1e8d9-393d-4f33-a97a-3295cf5c5b07","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6808","nonce":1551020300},{"type":"v1","addr":"172.21.15.62:6809","nonce":1551020300}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6810","nonce":1551020300},{"type":"v1","addr":"172.21.15.62:6811","nonce":1551020300}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6814","nonce":1551020300},{"type":"v1","addr":"172.21.15.62:6815","nonce":1551020300}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6812","nonce":1551020300},{"type":"v1","addr":"172.21.15.62:6813","nonce":1551020300}]},"public_addr":"172.21.15.62:6809/1551020300","cluster_addr":"172.21.15.62:6811/1551020300","heartbeat_back_addr":"172.21.15.62:6815/1551020300","heartbeat_front_addr":"172.21.15.62:6813/1551020300","state":["exists","up"]},{"osd":6,"uuid":"f6ff81c6-f14d-4477-88e3-9116cc5a2992","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"ce395bc3-bcb5-4b94-a523-5bb9df491eca","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T19:46:38.870508+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T19:46:38.790900+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-17T19:46:41.974 INFO:teuthology.misc.health.smithi044.stderr:2024-04-17T19:46:41.982+0000 7f0698e00640 1 -- 172.21.15.44:0/2239852658 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f0670068320 msgr2=0x7f067006a830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:46:41.974 INFO:teuthology.misc.health.smithi044.stderr:2024-04-17T19:46:41.982+0000 7f0698e00640 1 --2- 172.21.15.44:0/2239852658 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f0670068320 0x7f067006a830 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f06840ae000 tx=0x7f06840a7000 comp rx=0 tx=0).stop 2024-04-17T19:46:41.974 INFO:teuthology.misc.health.smithi044.stderr:2024-04-17T19:46:41.982+0000 7f0698e00640 1 -- 172.21.15.44:0/2239852658 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f06941586b0 msgr2=0x7f06941f82c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:46:41.974 INFO:teuthology.misc.health.smithi044.stderr:2024-04-17T19:46:41.982+0000 7f0698e00640 1 --2- 172.21.15.44:0/2239852658 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f06941586b0 0x7f06941f82c0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f067c00c3f0 tx=0x7f067c00c8b0 comp rx=0 tx=0).stop 2024-04-17T19:46:41.974 INFO:teuthology.misc.health.smithi044.stderr:2024-04-17T19:46:41.982+0000 7f0698e00640 1 -- 172.21.15.44:0/2239852658 shutdown_connections 2024-04-17T19:46:41.974 INFO:teuthology.misc.health.smithi044.stderr:2024-04-17T19:46:41.982+0000 7f0698e00640 1 --2- 172.21.15.44:0/2239852658 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f0670068320 0x7f067006a830 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:46:41.974 INFO:teuthology.misc.health.smithi044.stderr:2024-04-17T19:46:41.982+0000 7f0698e00640 1 --2- 172.21.15.44:0/2239852658 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0694158ac0 0x7f0694140350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:46:41.974 INFO:teuthology.misc.health.smithi044.stderr:2024-04-17T19:46:41.982+0000 7f0698e00640 1 --2- 172.21.15.44:0/2239852658 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f06941586b0 0x7f06941f82c0 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:46:41.974 INFO:teuthology.misc.health.smithi044.stderr:2024-04-17T19:46:41.982+0000 7f0698e00640 1 --2- 172.21.15.44:0/2239852658 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f0694151eb0 0x7f069414da50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:46:41.974 INFO:teuthology.misc.health.smithi044.stderr:2024-04-17T19:46:41.982+0000 7f0698e00640 1 -- 172.21.15.44:0/2239852658 >> 172.21.15.44:0/2239852658 conn(0x7f069406c380 msgr2=0x7f06940ca010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:46:41.974 INFO:teuthology.misc.health.smithi044.stderr:2024-04-17T19:46:41.982+0000 7f0698e00640 1 -- 172.21.15.44:0/2239852658 shutdown_connections 2024-04-17T19:46:41.975 INFO:teuthology.misc.health.smithi044.stderr:2024-04-17T19:46:41.982+0000 7f0698e00640 1 -- 172.21.15.44:0/2239852658 wait complete. 2024-04-17T19:46:42.001 DEBUG:teuthology.misc:2 of 8 OSDs are up 2024-04-17T19:46:48.807 DEBUG:teuthology.orchestra.run.smithi044:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-04-17T19:46:48.961 INFO:teuthology.misc.health.smithi044.stderr:2024-04-17T19:46:48.970+0000 7f28d7600640 1 Processor -- start 2024-04-17T19:46:48.962 INFO:teuthology.misc.health.smithi044.stderr:2024-04-17T19:46:48.970+0000 7f28d7600640 1 -- start start 2024-04-17T19:46:48.964 INFO:teuthology.misc.health.smithi044.stderr:2024-04-17T19:46:48.974+0000 7f28d7600640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f28d0159490 0x7f28d00725e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:46:48.964 INFO:teuthology.misc.health.smithi044.stderr:2024-04-17T19:46:48.974+0000 7f28d7600640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f28d00c26f0 con 0x7f28d00c6010 2024-04-17T19:46:48.964 INFO:teuthology.misc.health.smithi044.stderr:2024-04-17T19:46:48.974+0000 7f28d7600640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f28d00c2450 con 0x7f28d0072b20 2024-04-17T19:46:48.964 INFO:teuthology.misc.health.smithi044.stderr:2024-04-17T19:46:48.974+0000 7f28d7600640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 -- 0x7f28d0073c60 con 0x7f28d0159490 2024-04-17T19:46:48.964 INFO:teuthology.misc.health.smithi044.stderr:2024-04-17T19:46:48.974+0000 7f28d4c00640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f28d00c6010 0x7f28d0158d80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:52746/0 (socket says 172.21.15.44:52746) 2024-04-17T19:46:48.964 INFO:teuthology.misc.health.smithi044.stderr:2024-04-17T19:46:48.974+0000 7f28d4c00640 1 -- 172.21.15.44:0/3463958321 learned_addr learned my addr 172.21.15.44:0/3463958321 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-04-17T19:46:48.964 INFO:teuthology.misc.health.smithi044.stderr:2024-04-17T19:46:48.974+0000 7f28cfe00640 1 --2- 172.21.15.44:0/3463958321 >> v2:172.21.15.62:3300/0 conn(0x7f28d0159490 0x7f28d00725e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:46:48.965 INFO:teuthology.misc.health.smithi044.stderr:2024-04-17T19:46:48.974+0000 7f28cf400640 1 -- 172.21.15.44:0/3463958321 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1358767430 0 0) 0x7f28d00c26f0 con 0x7f28d00c6010 2024-04-17T19:46:48.965 INFO:teuthology.misc.health.smithi044.stderr:2024-04-17T19:46:48.974+0000 7f28cf400640 1 -- 172.21.15.44:0/3463958321 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f28b8003530 con 0x7f28d00c6010 2024-04-17T19:46:48.965 INFO:teuthology.misc.health.smithi044.stderr:2024-04-17T19:46:48.974+0000 7f28cfe00640 1 -- 172.21.15.44:0/3463958321 >> v1:172.21.15.62:6789/0 conn(0x7f28d0072b20 legacy=0x7f28d0072f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:46:48.965 INFO:teuthology.misc.health.smithi044.stderr:2024-04-17T19:46:48.974+0000 7f28cfe00640 1 -- 172.21.15.44:0/3463958321 >> v1:172.21.15.44:6789/0 conn(0x7f28d00c6010 legacy=0x7f28d0158d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:46:48.965 INFO:teuthology.misc.health.smithi044.stderr:2024-04-17T19:46:48.974+0000 7f28cf400640 1 -- 172.21.15.44:0/3463958321 <== mon.0 v1:172.21.15.44:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2067687798 0 0) 0x7f28b8003530 con 0x7f28d00c6010 2024-04-17T19:46:48.965 INFO:teuthology.misc.health.smithi044.stderr:2024-04-17T19:46:48.974+0000 7f28cfe00640 1 -- 172.21.15.44:0/3463958321 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f28d00c3760 con 0x7f28d0159490 2024-04-17T19:46:48.967 INFO:teuthology.misc.health.smithi044.stderr:2024-04-17T19:46:48.978+0000 7f28cfe00640 1 --2- 172.21.15.44:0/3463958321 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f28d0159490 0x7f28d00725e0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f28bc0097c0 tx=0x7f28bc01c330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f200c3fc5889bab server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:46:48.968 INFO:teuthology.misc.health.smithi044.stderr:2024-04-17T19:46:48.978+0000 7f28cf400640 1 -- 172.21.15.44:0/3463958321 <== mon.1 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28bc0b0070 con 0x7f28d0159490 2024-04-17T19:46:48.968 INFO:teuthology.misc.health.smithi044.stderr:2024-04-17T19:46:48.978+0000 7f28cf400640 1 -- 172.21.15.44:0/3463958321 <== mon.1 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f28bc0ab400 con 0x7f28d0159490 2024-04-17T19:46:48.968 INFO:teuthology.misc.health.smithi044.stderr:2024-04-17T19:46:48.978+0000 7f28cf400640 1 -- 172.21.15.44:0/3463958321 <== mon.1 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28c40016a0 con 0x7f28d0159490 2024-04-17T19:46:48.969 INFO:teuthology.misc.health.smithi044.stderr:2024-04-17T19:46:48.978+0000 7f28d7600640 1 -- 172.21.15.44:0/3463958321 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f28d0159490 msgr2=0x7f28d00725e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:46:48.969 INFO:teuthology.misc.health.smithi044.stderr:2024-04-17T19:46:48.978+0000 7f28d7600640 1 --2- 172.21.15.44:0/3463958321 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f28d0159490 0x7f28d00725e0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f28bc0097c0 tx=0x7f28bc01c330 comp rx=0 tx=0).stop 2024-04-17T19:46:48.969 INFO:teuthology.misc.health.smithi044.stderr:2024-04-17T19:46:48.978+0000 7f28d7600640 1 -- 172.21.15.44:0/3463958321 shutdown_connections 2024-04-17T19:46:48.969 INFO:teuthology.misc.health.smithi044.stderr:2024-04-17T19:46:48.978+0000 7f28d7600640 1 --2- 172.21.15.44:0/3463958321 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f28d0159490 0x7f28d00725e0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:46:48.969 INFO:teuthology.misc.health.smithi044.stderr:2024-04-17T19:46:48.978+0000 7f28d7600640 1 -- 172.21.15.44:0/3463958321 >> 172.21.15.44:0/3463958321 conn(0x7f28d006c380 msgr2=0x7f28d00ccbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:46:48.969 INFO:teuthology.misc.health.smithi044.stderr:2024-04-17T19:46:48.978+0000 7f28d7600640 1 -- 172.21.15.44:0/3463958321 shutdown_connections 2024-04-17T19:46:48.969 INFO:teuthology.misc.health.smithi044.stderr:2024-04-17T19:46:48.978+0000 7f28d7600640 1 -- 172.21.15.44:0/3463958321 wait complete. 2024-04-17T19:46:48.971 INFO:teuthology.misc.health.smithi044.stderr:2024-04-17T19:46:48.982+0000 7f28d7600640 1 Processor -- start 2024-04-17T19:46:48.971 INFO:teuthology.misc.health.smithi044.stderr:2024-04-17T19:46:48.982+0000 7f28d7600640 1 -- start start 2024-04-17T19:46:48.973 INFO:teuthology.misc.health.smithi044.stderr:2024-04-17T19:46:48.982+0000 7f28d7600640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f28d0072b20 0x7f28d01480a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:46:48.973 INFO:teuthology.misc.health.smithi044.stderr:2024-04-17T19:46:48.982+0000 7f28d7600640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f28d00c6010 0x7f28d014ffb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:46:48.973 INFO:teuthology.misc.health.smithi044.stderr:2024-04-17T19:46:48.982+0000 7f28d7600640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f28d0159490 0x7f28d0146a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:46:48.974 INFO:teuthology.misc.health.smithi044.stderr:2024-04-17T19:46:48.982+0000 7f28d7600640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f28d0073640 con 0x7f28d0072b20 2024-04-17T19:46:48.974 INFO:teuthology.misc.health.smithi044.stderr:2024-04-17T19:46:48.982+0000 7f28d7600640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f28d00c3500 con 0x7f28d0159490 2024-04-17T19:46:48.974 INFO:teuthology.misc.health.smithi044.stderr:2024-04-17T19:46:48.982+0000 7f28d7600640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7f28d00737c0 con 0x7f28d00c6010 2024-04-17T19:46:48.974 INFO:teuthology.misc.health.smithi044.stderr:2024-04-17T19:46:48.982+0000 7f28d4c00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f28d0072b20 0x7f28d01480a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:46:48.974 INFO:teuthology.misc.health.smithi044.stderr:2024-04-17T19:46:48.982+0000 7f28d4c00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f28d0072b20 0x7f28d01480a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:33872/0 (socket says 172.21.15.44:33872) 2024-04-17T19:46:48.974 INFO:teuthology.misc.health.smithi044.stderr:2024-04-17T19:46:48.982+0000 7f28d4c00640 1 -- 172.21.15.44:0/1975972894 learned_addr learned my addr 172.21.15.44:0/1975972894 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-04-17T19:46:48.974 INFO:teuthology.misc.health.smithi044.stderr:2024-04-17T19:46:48.982+0000 7f28cfe00640 1 --2- 172.21.15.44:0/1975972894 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f28d00c6010 0x7f28d014ffb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:46:48.974 INFO:teuthology.misc.health.smithi044.stderr:2024-04-17T19:46:48.982+0000 7f28d5600640 1 --2- 172.21.15.44:0/1975972894 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f28d0159490 0x7f28d0146a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:46:48.974 INFO:teuthology.misc.health.smithi044.stderr:2024-04-17T19:46:48.982+0000 7f28d4c00640 1 -- 172.21.15.44:0/1975972894 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f28d00c6010 msgr2=0x7f28d014ffb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:46:48.974 INFO:teuthology.misc.health.smithi044.stderr:2024-04-17T19:46:48.982+0000 7f28d4c00640 1 --2- 172.21.15.44:0/1975972894 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f28d00c6010 0x7f28d014ffb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:46:48.974 INFO:teuthology.misc.health.smithi044.stderr:2024-04-17T19:46:48.982+0000 7f28d4c00640 1 -- 172.21.15.44:0/1975972894 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f28d0159490 msgr2=0x7f28d0146a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:46:48.974 INFO:teuthology.misc.health.smithi044.stderr:2024-04-17T19:46:48.982+0000 7f28d4c00640 1 --2- 172.21.15.44:0/1975972894 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f28d0159490 0x7f28d0146a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:46:48.974 INFO:teuthology.misc.health.smithi044.stderr:2024-04-17T19:46:48.982+0000 7f28d4c00640 1 -- 172.21.15.44:0/1975972894 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f28d01f3750 con 0x7f28d0072b20 2024-04-17T19:46:48.975 INFO:teuthology.misc.health.smithi044.stderr:2024-04-17T19:46:48.982+0000 7f28d4c00640 1 --2- 172.21.15.44:0/1975972894 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f28d0072b20 0x7f28d01480a0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f28c4001210 tx=0x7f28c400cb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:46:48.975 INFO:teuthology.misc.health.smithi044.stderr:2024-04-17T19:46:48.982+0000 7f28ccc00640 1 -- 172.21.15.44:0/1975972894 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28c4018070 con 0x7f28d0072b20 2024-04-17T19:46:48.975 INFO:teuthology.misc.health.smithi044.stderr:2024-04-17T19:46:48.982+0000 7f28ccc00640 1 -- 172.21.15.44:0/1975972894 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f28c40072d0 con 0x7f28d0072b20 2024-04-17T19:46:48.976 INFO:teuthology.misc.health.smithi044.stderr:2024-04-17T19:46:48.982+0000 7f28ccc00640 1 -- 172.21.15.44:0/1975972894 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28c40047f0 con 0x7f28d0072b20 2024-04-17T19:46:48.976 INFO:teuthology.misc.health.smithi044.stderr:2024-04-17T19:46:48.982+0000 7f28d7600640 1 -- 172.21.15.44:0/1975972894 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f28d01485e0 con 0x7f28d0072b20 2024-04-17T19:46:48.976 INFO:teuthology.misc.health.smithi044.stderr:2024-04-17T19:46:48.986+0000 7f28d7600640 1 -- 172.21.15.44:0/1975972894 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f28d01f39c0 con 0x7f28d0072b20 2024-04-17T19:46:48.976 INFO:teuthology.misc.health.smithi044.stderr:2024-04-17T19:46:48.986+0000 7f28d7600640 1 -- 172.21.15.44:0/1975972894 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f28d004fea0 con 0x7f28d0072b20 2024-04-17T19:46:48.976 INFO:teuthology.misc.health.smithi044.stderr:2024-04-17T19:46:48.986+0000 7f28ccc00640 1 -- 172.21.15.44:0/1975972894 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f28c4004990 con 0x7f28d0072b20 2024-04-17T19:46:48.977 INFO:teuthology.misc.health.smithi044.stderr:2024-04-17T19:46:48.986+0000 7f28ccc00640 1 --2- 172.21.15.44:0/1975972894 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f28b0068380 0x7f28b006a890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:46:48.977 INFO:teuthology.misc.health.smithi044.stderr:2024-04-17T19:46:48.986+0000 7f28ccc00640 1 -- 172.21.15.44:0/1975972894 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 4857+0+0 (secure 0 0 0) 0x7f28c4085a90 con 0x7f28d0072b20 2024-04-17T19:46:48.977 INFO:teuthology.misc.health.smithi044.stderr:2024-04-17T19:46:48.986+0000 7f28cfe00640 1 --2- 172.21.15.44:0/1975972894 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f28b0068380 0x7f28b006a890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:46:48.978 INFO:teuthology.misc.health.smithi044.stderr:2024-04-17T19:46:48.990+0000 7f28cfe00640 1 --2- 172.21.15.44:0/1975972894 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f28b0068380 0x7f28b006a890 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f28bc0ad000 tx=0x7f28bc0a6000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:46:48.982 INFO:teuthology.misc.health.smithi044.stderr:2024-04-17T19:46:48.990+0000 7f28ccc00640 1 -- 172.21.15.44:0/1975972894 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f28c4055cb0 con 0x7f28d0072b20 2024-04-17T19:46:49.148 INFO:teuthology.misc.health.smithi044.stderr:2024-04-17T19:46:49.158+0000 7f28d7600640 1 -- 172.21.15.44:0/1975972894 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f28d00c5300 con 0x7f28d0072b20 2024-04-17T19:46:49.149 INFO:teuthology.misc.health.smithi044.stderr:2024-04-17T19:46:49.158+0000 7f28ccc00640 1 -- 172.21.15.44:0/1975972894 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v17) ==== 74+0+12848 (secure 0 0 0) 0x7f28c4059fb0 con 0x7f28d0072b20 2024-04-17T19:46:49.150 INFO:teuthology.misc.health.smithi044.stdout: 2024-04-17T19:46:49.150 INFO:teuthology.misc.health.smithi044.stdout:{"epoch":17,"fsid":"703f77ca-79c6-4a66-b576-62c526cb1021","created":"2024-04-17T19:46:30.831994+0000","modified":"2024-04-17T19:46:43.993068+0000","last_up_change":"2024-04-17T19:46:41.988197+0000","last_in_change":"2024-04-17T19:46:33.407430+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-17T19:46:41.940380+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"30520dc6-eea6-43d4-ab60-3ca9e92329dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6800","nonce":1018735925},{"type":"v1","addr":"172.21.15.44:6801","nonce":1018735925}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6802","nonce":1018735925},{"type":"v1","addr":"172.21.15.44:6803","nonce":1018735925}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6806","nonce":1018735925},{"type":"v1","addr":"172.21.15.44:6807","nonce":1018735925}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6804","nonce":1018735925},{"type":"v1","addr":"172.21.15.44:6805","nonce":1018735925}]},"public_addr":"172.21.15.44:6801/1018735925","cluster_addr":"172.21.15.44:6803/1018735925","heartbeat_back_addr":"172.21.15.44:6807/1018735925","heartbeat_front_addr":"172.21.15.44:6805/1018735925","state":["exists","up"]},{"osd":1,"uuid":"079bd511-b6ce-449b-8f11-17b311b12f7c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6817","nonce":1452577434},{"type":"v1","addr":"172.21.15.44:6820","nonce":1452577434}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6823","nonce":1452577434},{"type":"v1","addr":"172.21.15.44:6825","nonce":1452577434}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6830","nonce":1452577434},{"type":"v1","addr":"172.21.15.44:6831","nonce":1452577434}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6828","nonce":1452577434},{"type":"v1","addr":"172.21.15.44:6829","nonce":1452577434}]},"public_addr":"172.21.15.44:6820/1452577434","cluster_addr":"172.21.15.44:6825/1452577434","heartbeat_back_addr":"172.21.15.44:6831/1452577434","heartbeat_front_addr":"172.21.15.44:6829/1452577434","state":["exists","up"]},{"osd":2,"uuid":"34f0b9ab-b1d2-4ee9-841c-f15afbb6bec5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6816","nonce":1160071918},{"type":"v1","addr":"172.21.15.44:6818","nonce":1160071918}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6819","nonce":1160071918},{"type":"v1","addr":"172.21.15.44:6821","nonce":1160071918}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6826","nonce":1160071918},{"type":"v1","addr":"172.21.15.44:6827","nonce":1160071918}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6822","nonce":1160071918},{"type":"v1","addr":"172.21.15.44:6824","nonce":1160071918}]},"public_addr":"172.21.15.44:6818/1160071918","cluster_addr":"172.21.15.44:6821/1160071918","heartbeat_back_addr":"172.21.15.44:6827/1160071918","heartbeat_front_addr":"172.21.15.44:6824/1160071918","state":["exists","up"]},{"osd":3,"uuid":"4740032d-fe34-4b1b-bb85-f430896fc3c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6808","nonce":4236454921},{"type":"v1","addr":"172.21.15.44:6809","nonce":4236454921}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6810","nonce":4236454921},{"type":"v1","addr":"172.21.15.44:6811","nonce":4236454921}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6814","nonce":4236454921},{"type":"v1","addr":"172.21.15.44:6815","nonce":4236454921}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6812","nonce":4236454921},{"type":"v1","addr":"172.21.15.44:6813","nonce":4236454921}]},"public_addr":"172.21.15.44:6809/4236454921","cluster_addr":"172.21.15.44:6811/4236454921","heartbeat_back_addr":"172.21.15.44:6815/4236454921","heartbeat_front_addr":"172.21.15.44:6813/4236454921","state":["exists","up"]},{"osd":4,"uuid":"7dbedb00-302d-4d52-810c-e18839254da1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6800","nonce":2293251376},{"type":"v1","addr":"172.21.15.62:6801","nonce":2293251376}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6802","nonce":2293251376},{"type":"v1","addr":"172.21.15.62:6803","nonce":2293251376}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6806","nonce":2293251376},{"type":"v1","addr":"172.21.15.62:6807","nonce":2293251376}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6804","nonce":2293251376},{"type":"v1","addr":"172.21.15.62:6805","nonce":2293251376}]},"public_addr":"172.21.15.62:6801/2293251376","cluster_addr":"172.21.15.62:6803/2293251376","heartbeat_back_addr":"172.21.15.62:6807/2293251376","heartbeat_front_addr":"172.21.15.62:6805/2293251376","state":["exists","up"]},{"osd":5,"uuid":"38c1e8d9-393d-4f33-a97a-3295cf5c5b07","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6808","nonce":1551020300},{"type":"v1","addr":"172.21.15.62:6809","nonce":1551020300}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6810","nonce":1551020300},{"type":"v1","addr":"172.21.15.62:6811","nonce":1551020300}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6814","nonce":1551020300},{"type":"v1","addr":"172.21.15.62:6815","nonce":1551020300}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6812","nonce":1551020300},{"type":"v1","addr":"172.21.15.62:6813","nonce":1551020300}]},"public_addr":"172.21.15.62:6809/1551020300","cluster_addr":"172.21.15.62:6811/1551020300","heartbeat_back_addr":"172.21.15.62:6815/1551020300","heartbeat_front_addr":"172.21.15.62:6813/1551020300","state":["exists","up"]},{"osd":6,"uuid":"f6ff81c6-f14d-4477-88e3-9116cc5a2992","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6824","nonce":2602310256},{"type":"v1","addr":"172.21.15.62:6825","nonce":2602310256}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6826","nonce":2602310256},{"type":"v1","addr":"172.21.15.62:6827","nonce":2602310256}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6830","nonce":2602310256},{"type":"v1","addr":"172.21.15.62:6831","nonce":2602310256}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6828","nonce":2602310256},{"type":"v1","addr":"172.21.15.62:6829","nonce":2602310256}]},"public_addr":"172.21.15.62:6825/2602310256","cluster_addr":"172.21.15.62:6827/2602310256","heartbeat_back_addr":"172.21.15.62:6831/2602310256","heartbeat_front_addr":"172.21.15.62:6829/2602310256","state":["exists","up"]},{"osd":7,"uuid":"ce395bc3-bcb5-4b94-a523-5bb9df491eca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6816","nonce":2912738359},{"type":"v1","addr":"172.21.15.62:6817","nonce":2912738359}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6818","nonce":2912738359},{"type":"v1","addr":"172.21.15.62:6819","nonce":2912738359}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6822","nonce":2912738359},{"type":"v1","addr":"172.21.15.62:6823","nonce":2912738359}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6820","nonce":2912738359},{"type":"v1","addr":"172.21.15.62:6821","nonce":2912738359}]},"public_addr":"172.21.15.62:6817/2912738359","cluster_addr":"172.21.15.62:6819/2912738359","heartbeat_back_addr":"172.21.15.62:6823/2912738359","heartbeat_front_addr":"172.21.15.62:6821/2912738359","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T19:46:39.302883+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T19:46:39.177705+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T19:46:39.188894+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T19:46:39.313009+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T19:46:38.870508+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T19:46:38.790900+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T19:46:38.979163+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T19:46:38.992348+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-17T19:46:49.152 INFO:teuthology.misc.health.smithi044.stderr:2024-04-17T19:46:49.162+0000 7f28d7600640 1 -- 172.21.15.44:0/1975972894 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f28b0068380 msgr2=0x7f28b006a890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:46:49.152 INFO:teuthology.misc.health.smithi044.stderr:2024-04-17T19:46:49.162+0000 7f28d7600640 1 --2- 172.21.15.44:0/1975972894 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f28b0068380 0x7f28b006a890 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f28bc0ad000 tx=0x7f28bc0a6000 comp rx=0 tx=0).stop 2024-04-17T19:46:49.153 INFO:teuthology.misc.health.smithi044.stderr:2024-04-17T19:46:49.162+0000 7f28d7600640 1 -- 172.21.15.44:0/1975972894 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f28d0072b20 msgr2=0x7f28d01480a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:46:49.153 INFO:teuthology.misc.health.smithi044.stderr:2024-04-17T19:46:49.162+0000 7f28d7600640 1 --2- 172.21.15.44:0/1975972894 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f28d0072b20 0x7f28d01480a0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f28c4001210 tx=0x7f28c400cb90 comp rx=0 tx=0).stop 2024-04-17T19:46:49.153 INFO:teuthology.misc.health.smithi044.stderr:2024-04-17T19:46:49.162+0000 7f28d7600640 1 -- 172.21.15.44:0/1975972894 shutdown_connections 2024-04-17T19:46:49.153 INFO:teuthology.misc.health.smithi044.stderr:2024-04-17T19:46:49.162+0000 7f28d7600640 1 --2- 172.21.15.44:0/1975972894 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f28b0068380 0x7f28b006a890 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:46:49.153 INFO:teuthology.misc.health.smithi044.stderr:2024-04-17T19:46:49.162+0000 7f28d7600640 1 --2- 172.21.15.44:0/1975972894 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f28d00c6010 0x7f28d014ffb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:46:49.153 INFO:teuthology.misc.health.smithi044.stderr:2024-04-17T19:46:49.162+0000 7f28d7600640 1 --2- 172.21.15.44:0/1975972894 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f28d0159490 0x7f28d0146a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:46:49.153 INFO:teuthology.misc.health.smithi044.stderr:2024-04-17T19:46:49.162+0000 7f28d7600640 1 --2- 172.21.15.44:0/1975972894 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f28d0072b20 0x7f28d01480a0 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:46:49.153 INFO:teuthology.misc.health.smithi044.stderr:2024-04-17T19:46:49.162+0000 7f28d7600640 1 -- 172.21.15.44:0/1975972894 >> 172.21.15.44:0/1975972894 conn(0x7f28d006c380 msgr2=0x7f28d0158c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:46:49.153 INFO:teuthology.misc.health.smithi044.stderr:2024-04-17T19:46:49.162+0000 7f28d7600640 1 -- 172.21.15.44:0/1975972894 shutdown_connections 2024-04-17T19:46:49.153 INFO:teuthology.misc.health.smithi044.stderr:2024-04-17T19:46:49.162+0000 7f28d7600640 1 -- 172.21.15.44:0/1975972894 wait complete. 2024-04-17T19:46:49.170 DEBUG:teuthology.misc:8 of 8 OSDs are up 2024-04-17T19:46:49.170 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2024-04-17T19:46:49.170 INFO:tasks.ceph.mds.a:Restarting daemon 2024-04-17T19:46:49.170 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-04-17T19:46:49.174 INFO:tasks.ceph.mds.a:Started 2024-04-17T19:46:49.174 INFO:tasks.ceph.mds.c:Restarting daemon 2024-04-17T19:46:49.174 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-04-17T19:46:49.176 INFO:tasks.ceph.mds.c:Started 2024-04-17T19:46:49.177 INFO:tasks.ceph.mds.e:Restarting daemon 2024-04-17T19:46:49.177 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i e 2024-04-17T19:46:49.179 INFO:tasks.ceph.mds.e:Started 2024-04-17T19:46:49.179 INFO:tasks.ceph.mds.b:Restarting daemon 2024-04-17T19:46:49.180 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-04-17T19:46:49.182 INFO:tasks.ceph.mds.b:Started 2024-04-17T19:46:49.182 INFO:tasks.ceph.mds.d:Restarting daemon 2024-04-17T19:46:49.182 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-04-17T19:46:49.185 INFO:tasks.ceph.mds.d:Started 2024-04-17T19:46:49.185 INFO:tasks.ceph.mds.f:Restarting daemon 2024-04-17T19:46:49.185 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i f 2024-04-17T19:46:49.187 INFO:tasks.ceph.mds.f:Started 2024-04-17T19:46:49.187 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2024-04-17T19:46:49.188 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-17T19:46:49.291 INFO:tasks.ceph.mds.a.smithi044.stdout:starting mds.a at 2024-04-17T19:46:49.291 INFO:tasks.ceph.mds.c.smithi044.stdout:starting mds.c at 2024-04-17T19:46:49.292 INFO:tasks.ceph.mds.e.smithi044.stdout:starting mds.e at 2024-04-17T19:46:49.352 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:49.362+0000 7feecda00640 1 Processor -- start 2024-04-17T19:46:49.352 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:49.362+0000 7feecda00640 1 -- start start 2024-04-17T19:46:49.353 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:49.362+0000 7feecda00640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7feec80c4b20 0x7feec806ce90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:46:49.353 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:49.362+0000 7feecda00640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7feec815b9c0 0x7feec80725c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:46:49.353 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:49.362+0000 7feecda00640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7feec80ca3d0 con 0x7feec815bdd0 2024-04-17T19:46:49.353 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:49.362+0000 7feecda00640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 -- 0x7feec80cb5e0 con 0x7feec815b9c0 2024-04-17T19:46:49.354 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:49.362+0000 7feecda00640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7feec80cbe80 con 0x7feec80c4b20 2024-04-17T19:46:49.354 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:49.362+0000 7feec6a00640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7feec80c4b20 0x7feec806ce90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:46:49.354 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:49.362+0000 7feec6a00640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7feec80c4b20 0x7feec806ce90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3301/0 says I am v2:172.21.15.44:35888/0 (socket says 172.21.15.44:35888) 2024-04-17T19:46:49.355 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:49.362+0000 7feec6a00640 1 -- 172.21.15.44:0/2163768100 learned_addr learned my addr 172.21.15.44:0/2163768100 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-04-17T19:46:49.355 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:49.362+0000 7feebfe00640 1 --2- 172.21.15.44:0/2163768100 >> v2:172.21.15.62:3300/0 conn(0x7feec815b9c0 0x7feec80725c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:46:49.355 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:49.366+0000 7feec6a00640 1 -- 172.21.15.44:0/2163768100 >> v2:172.21.15.62:3300/0 conn(0x7feec815b9c0 msgr2=0x7feec80725c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T19:46:49.355 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:49.366+0000 7feec6a00640 1 --2- 172.21.15.44:0/2163768100 >> v2:172.21.15.62:3300/0 conn(0x7feec815b9c0 0x7feec80725c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:46:49.355 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:49.366+0000 7feec6a00640 1 -- 172.21.15.44:0/2163768100 >> v1:172.21.15.62:6789/0 conn(0x7feec815bdd0 legacy=0x7feec815efb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:46:49.355 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:49.366+0000 7feec6a00640 1 -- 172.21.15.44:0/2163768100 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feec80ca6b0 con 0x7feec80c4b20 2024-04-17T19:46:49.357 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:49.366+0000 7feec6a00640 1 --2- 172.21.15.44:0/2163768100 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7feec80c4b20 0x7feec806ce90 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7feeb8009870 tx=0x7feeb801c530 comp rx=0 tx=0).ready entity=mon.2 client_cookie=99f29945a49189b1 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:46:49.357 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:49.366+0000 7feec6000640 1 -- 172.21.15.44:0/2163768100 <== mon.2 v2:172.21.15.62:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feeb80ab640 con 0x7feec80c4b20 2024-04-17T19:46:49.358 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:49.366+0000 7feec6000640 1 -- 172.21.15.44:0/2163768100 <== mon.2 v2:172.21.15.62:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feeb80b0070 con 0x7feec80c4b20 2024-04-17T19:46:49.358 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:49.366+0000 7feec6000640 1 -- 172.21.15.44:0/2163768100 <== mon.2 v2:172.21.15.62:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feeb80aba00 con 0x7feec80c4b20 2024-04-17T19:46:49.358 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:49.370+0000 7feecda00640 1 -- 172.21.15.44:0/2163768100 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7feec80c4b20 msgr2=0x7feec806ce90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:46:49.358 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:49.370+0000 7feecda00640 1 --2- 172.21.15.44:0/2163768100 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7feec80c4b20 0x7feec806ce90 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7feeb8009870 tx=0x7feeb801c530 comp rx=0 tx=0).stop 2024-04-17T19:46:49.359 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:49.370+0000 7feecda00640 1 -- 172.21.15.44:0/2163768100 shutdown_connections 2024-04-17T19:46:49.359 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:49.370+0000 7feecda00640 1 --2- 172.21.15.44:0/2163768100 >> v2:172.21.15.62:3300/0 conn(0x7feec815b9c0 0x7feec80725c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:46:49.359 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:49.370+0000 7feecda00640 1 --2- 172.21.15.44:0/2163768100 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7feec80c4b20 0x7feec806ce90 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:46:49.359 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:49.370+0000 7feecda00640 1 -- 172.21.15.44:0/2163768100 >> 172.21.15.44:0/2163768100 conn(0x7feec8067eb0 msgr2=0x7feec80682c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:46:49.359 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:49.370+0000 7feecda00640 1 -- 172.21.15.44:0/2163768100 shutdown_connections 2024-04-17T19:46:49.359 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:49.370+0000 7feecda00640 1 -- 172.21.15.44:0/2163768100 wait complete. 2024-04-17T19:46:49.361 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:49.370+0000 7feecda00640 1 Processor -- start 2024-04-17T19:46:49.361 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:49.370+0000 7feecda00640 1 -- start start 2024-04-17T19:46:49.363 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:49.374+0000 7feecda00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7feec80c4b20 0x7feec8149990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:46:49.363 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:49.374+0000 7feecda00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7feec815b9c0 0x7feec81482f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:46:49.363 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:49.374+0000 7feecda00640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7feec815bdd0 0x7feec8148830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:46:49.363 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:49.374+0000 7feecda00640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7feec80cac50 con 0x7feec80c4b20 2024-04-17T19:46:49.363 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:49.374+0000 7feecda00640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7feec80caad0 con 0x7feec815b9c0 2024-04-17T19:46:49.363 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:49.374+0000 7feecda00640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7feec80cc310 con 0x7feec815bdd0 2024-04-17T19:46:49.364 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:49.374+0000 7feec6a00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7feec80c4b20 0x7feec8149990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:46:49.364 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:49.374+0000 7feec6a00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7feec80c4b20 0x7feec8149990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:33918/0 (socket says 172.21.15.44:33918) 2024-04-17T19:46:49.364 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:49.374+0000 7feec6a00640 1 -- 172.21.15.44:0/143017306 learned_addr learned my addr 172.21.15.44:0/143017306 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-04-17T19:46:49.364 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:49.374+0000 7feec7400640 1 --2- 172.21.15.44:0/143017306 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7feec815bdd0 0x7feec8148830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:46:49.364 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:49.374+0000 7feebfe00640 1 --2- 172.21.15.44:0/143017306 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7feec815b9c0 0x7feec81482f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:46:49.364 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:49.374+0000 7feec6a00640 1 -- 172.21.15.44:0/143017306 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7feec815bdd0 msgr2=0x7feec8148830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:46:49.364 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:49.374+0000 7feec6a00640 1 --2- 172.21.15.44:0/143017306 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7feec815bdd0 0x7feec8148830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:46:49.364 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:49.374+0000 7feec6a00640 1 -- 172.21.15.44:0/143017306 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7feec815b9c0 msgr2=0x7feec81482f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:46:49.364 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:49.374+0000 7feec6a00640 1 --2- 172.21.15.44:0/143017306 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7feec815b9c0 0x7feec81482f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:46:49.364 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:49.374+0000 7feec6a00640 1 -- 172.21.15.44:0/143017306 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feec81f7300 con 0x7feec80c4b20 2024-04-17T19:46:49.364 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:49.374+0000 7feec6a00640 1 --2- 172.21.15.44:0/143017306 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7feec80c4b20 0x7feec8149990 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7feeb801abe0 tx=0x7feeb801ad70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:46:49.366 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:49.374+0000 7feebea00640 1 -- 172.21.15.44:0/143017306 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feeb80abe60 con 0x7feec80c4b20 2024-04-17T19:46:49.366 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:49.374+0000 7feecda00640 1 -- 172.21.15.44:0/143017306 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feec81f75a0 con 0x7feec80c4b20 2024-04-17T19:46:49.366 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:49.374+0000 7feebea00640 1 -- 172.21.15.44:0/143017306 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feeb80be3f0 con 0x7feec80c4b20 2024-04-17T19:46:49.366 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:49.374+0000 7feebea00640 1 -- 172.21.15.44:0/143017306 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feeb80be7e0 con 0x7feec80c4b20 2024-04-17T19:46:49.366 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:49.374+0000 7feecda00640 1 -- 172.21.15.44:0/143017306 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feec81f7b60 con 0x7feec80c4b20 2024-04-17T19:46:49.366 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:49.374+0000 7feecda00640 1 -- 172.21.15.44:0/143017306 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7feec804ff10 con 0x7feec80c4b20 2024-04-17T19:46:49.366 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:49.374+0000 7feebea00640 1 -- 172.21.15.44:0/143017306 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7feeb80b43f0 con 0x7feec80c4b20 2024-04-17T19:46:49.367 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:49.378+0000 7feebea00640 1 --2- 172.21.15.44:0/143017306 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7feea40683b0 0x7feea406a8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:46:49.367 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:49.378+0000 7feebea00640 1 -- 172.21.15.44:0/143017306 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 4857+0+0 (secure 0 0 0) 0x7feeb8120700 con 0x7feec80c4b20 2024-04-17T19:46:49.367 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:49.378+0000 7feebfe00640 1 --2- 172.21.15.44:0/143017306 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7feea40683b0 0x7feea406a8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:46:49.367 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:49.378+0000 7feebfe00640 1 --2- 172.21.15.44:0/143017306 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7feea40683b0 0x7feea406a8c0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7feec806d350 tx=0x7feeb0008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:46:49.370 INFO:tasks.ceph.mds.d.smithi062.stdout:starting mds.d at 2024-04-17T19:46:49.371 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:49.382+0000 7feebea00640 1 -- 172.21.15.44:0/143017306 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7feec81f7300 con 0x7feec80c4b20 2024-04-17T19:46:49.385 INFO:tasks.ceph.mds.f.smithi062.stdout:starting mds.f at 2024-04-17T19:46:49.391 INFO:tasks.ceph.mds.b.smithi062.stdout:starting mds.b at 2024-04-17T19:46:49.539 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:49.550+0000 7feecda00640 1 -- 172.21.15.44:0/143017306 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7feec80c4740 con 0x7feec80c4b20 2024-04-17T19:46:49.540 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:49.550+0000 7feebea00640 1 -- 172.21.15.44:0/143017306 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v17) ==== 74+0+12848 (secure 0 0 0) 0x7feeb8016150 con 0x7feec80c4b20 2024-04-17T19:46:49.540 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-04-17T19:46:49.540 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":17,"fsid":"703f77ca-79c6-4a66-b576-62c526cb1021","created":"2024-04-17T19:46:30.831994+0000","modified":"2024-04-17T19:46:43.993068+0000","last_up_change":"2024-04-17T19:46:41.988197+0000","last_in_change":"2024-04-17T19:46:33.407430+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-17T19:46:41.940380+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"30520dc6-eea6-43d4-ab60-3ca9e92329dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6800","nonce":1018735925},{"type":"v1","addr":"172.21.15.44:6801","nonce":1018735925}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6802","nonce":1018735925},{"type":"v1","addr":"172.21.15.44:6803","nonce":1018735925}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6806","nonce":1018735925},{"type":"v1","addr":"172.21.15.44:6807","nonce":1018735925}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6804","nonce":1018735925},{"type":"v1","addr":"172.21.15.44:6805","nonce":1018735925}]},"public_addr":"172.21.15.44:6801/1018735925","cluster_addr":"172.21.15.44:6803/1018735925","heartbeat_back_addr":"172.21.15.44:6807/1018735925","heartbeat_front_addr":"172.21.15.44:6805/1018735925","state":["exists","up"]},{"osd":1,"uuid":"079bd511-b6ce-449b-8f11-17b311b12f7c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6817","nonce":1452577434},{"type":"v1","addr":"172.21.15.44:6820","nonce":1452577434}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6823","nonce":1452577434},{"type":"v1","addr":"172.21.15.44:6825","nonce":1452577434}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6830","nonce":1452577434},{"type":"v1","addr":"172.21.15.44:6831","nonce":1452577434}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6828","nonce":1452577434},{"type":"v1","addr":"172.21.15.44:6829","nonce":1452577434}]},"public_addr":"172.21.15.44:6820/1452577434","cluster_addr":"172.21.15.44:6825/1452577434","heartbeat_back_addr":"172.21.15.44:6831/1452577434","heartbeat_front_addr":"172.21.15.44:6829/1452577434","state":["exists","up"]},{"osd":2,"uuid":"34f0b9ab-b1d2-4ee9-841c-f15afbb6bec5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6816","nonce":1160071918},{"type":"v1","addr":"172.21.15.44:6818","nonce":1160071918}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6819","nonce":1160071918},{"type":"v1","addr":"172.21.15.44:6821","nonce":1160071918}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6826","nonce":1160071918},{"type":"v1","addr":"172.21.15.44:6827","nonce":1160071918}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6822","nonce":1160071918},{"type":"v1","addr":"172.21.15.44:6824","nonce":1160071918}]},"public_addr":"172.21.15.44:6818/1160071918","cluster_addr":"172.21.15.44:6821/1160071918","heartbeat_back_addr":"172.21.15.44:6827/1160071918","heartbeat_front_addr":"172.21.15.44:6824/1160071918","state":["exists","up"]},{"osd":3,"uuid":"4740032d-fe34-4b1b-bb85-f430896fc3c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6808","nonce":4236454921},{"type":"v1","addr":"172.21.15.44:6809","nonce":4236454921}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6810","nonce":4236454921},{"type":"v1","addr":"172.21.15.44:6811","nonce":4236454921}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6814","nonce":4236454921},{"type":"v1","addr":"172.21.15.44:6815","nonce":4236454921}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6812","nonce":4236454921},{"type":"v1","addr":"172.21.15.44:6813","nonce":4236454921}]},"public_addr":"172.21.15.44:6809/4236454921","cluster_addr":"172.21.15.44:6811/4236454921","heartbeat_back_addr":"172.21.15.44:6815/4236454921","heartbeat_front_addr":"172.21.15.44:6813/4236454921","state":["exists","up"]},{"osd":4,"uuid":"7dbedb00-302d-4d52-810c-e18839254da1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6800","nonce":2293251376},{"type":"v1","addr":"172.21.15.62:6801","nonce":2293251376}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6802","nonce":2293251376},{"type":"v1","addr":"172.21.15.62:6803","nonce":2293251376}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6806","nonce":2293251376},{"type":"v1","addr":"172.21.15.62:6807","nonce":2293251376}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6804","nonce":2293251376},{"type":"v1","addr":"172.21.15.62:6805","nonce":2293251376}]},"public_addr":"172.21.15.62:6801/2293251376","cluster_addr":"172.21.15.62:6803/2293251376","heartbeat_back_addr":"172.21.15.62:6807/2293251376","heartbeat_front_addr":"172.21.15.62:6805/2293251376","state":["exists","up"]},{"osd":5,"uuid":"38c1e8d9-393d-4f33-a97a-3295cf5c5b07","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6808","nonce":1551020300},{"type":"v1","addr":"172.21.15.62:6809","nonce":1551020300}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6810","nonce":1551020300},{"type":"v1","addr":"172.21.15.62:6811","nonce":1551020300}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6814","nonce":1551020300},{"type":"v1","addr":"172.21.15.62:6815","nonce":1551020300}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6812","nonce":1551020300},{"type":"v1","addr":"172.21.15.62:6813","nonce":1551020300}]},"public_addr":"172.21.15.62:6809/1551020300","cluster_addr":"172.21.15.62:6811/1551020300","heartbeat_back_addr":"172.21.15.62:6815/1551020300","heartbeat_front_addr":"172.21.15.62:6813/1551020300","state":["exists","up"]},{"osd":6,"uuid":"f6ff81c6-f14d-4477-88e3-9116cc5a2992","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6824","nonce":2602310256},{"type":"v1","addr":"172.21.15.62:6825","nonce":2602310256}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6826","nonce":2602310256},{"type":"v1","addr":"172.21.15.62:6827","nonce":2602310256}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6830","nonce":2602310256},{"type":"v1","addr":"172.21.15.62:6831","nonce":2602310256}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6828","nonce":2602310256},{"type":"v1","addr":"172.21.15.62:6829","nonce":2602310256}]},"public_addr":"172.21.15.62:6825/2602310256","cluster_addr":"172.21.15.62:6827/2602310256","heartbeat_back_addr":"172.21.15.62:6831/2602310256","heartbeat_front_addr":"172.21.15.62:6829/2602310256","state":["exists","up"]},{"osd":7,"uuid":"ce395bc3-bcb5-4b94-a523-5bb9df491eca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6816","nonce":2912738359},{"type":"v1","addr":"172.21.15.62:6817","nonce":2912738359}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6818","nonce":2912738359},{"type":"v1","addr":"172.21.15.62:6819","nonce":2912738359}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6822","nonce":2912738359},{"type":"v1","addr":"172.21.15.62:6823","nonce":2912738359}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6820","nonce":2912738359},{"type":"v1","addr":"172.21.15.62:6821","nonce":2912738359}]},"public_addr":"172.21.15.62:6817/2912738359","cluster_addr":"172.21.15.62:6819/2912738359","heartbeat_back_addr":"172.21.15.62:6823/2912738359","heartbeat_front_addr":"172.21.15.62:6821/2912738359","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T19:46:39.302883+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T19:46:39.177705+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T19:46:39.188894+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T19:46:39.313009+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T19:46:38.870508+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T19:46:38.790900+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T19:46:38.979163+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T19:46:38.992348+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-17T19:46:49.542 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:49.550+0000 7feecda00640 1 -- 172.21.15.44:0/143017306 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7feea40683b0 msgr2=0x7feea406a8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:46:49.542 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:49.550+0000 7feecda00640 1 --2- 172.21.15.44:0/143017306 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7feea40683b0 0x7feea406a8c0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7feec806d350 tx=0x7feeb0008040 comp rx=0 tx=0).stop 2024-04-17T19:46:49.542 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:49.550+0000 7feecda00640 1 -- 172.21.15.44:0/143017306 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7feec80c4b20 msgr2=0x7feec8149990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:46:49.542 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:49.550+0000 7feecda00640 1 --2- 172.21.15.44:0/143017306 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7feec80c4b20 0x7feec8149990 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7feeb801abe0 tx=0x7feeb801ad70 comp rx=0 tx=0).stop 2024-04-17T19:46:49.543 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:49.550+0000 7feecda00640 1 -- 172.21.15.44:0/143017306 shutdown_connections 2024-04-17T19:46:49.543 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:49.550+0000 7feecda00640 1 --2- 172.21.15.44:0/143017306 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7feea40683b0 0x7feea406a8c0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:46:49.543 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:49.550+0000 7feecda00640 1 --2- 172.21.15.44:0/143017306 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7feec815bdd0 0x7feec8148830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:46:49.543 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:49.550+0000 7feecda00640 1 --2- 172.21.15.44:0/143017306 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7feec815b9c0 0x7feec81482f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:46:49.543 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:49.550+0000 7feecda00640 1 --2- 172.21.15.44:0/143017306 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7feec80c4b20 0x7feec8149990 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:46:49.543 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:49.550+0000 7feecda00640 1 -- 172.21.15.44:0/143017306 >> 172.21.15.44:0/143017306 conn(0x7feec8067eb0 msgr2=0x7feec80682c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:46:49.543 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:49.550+0000 7feecda00640 1 -- 172.21.15.44:0/143017306 shutdown_connections 2024-04-17T19:46:49.543 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:49.550+0000 7feecda00640 1 -- 172.21.15.44:0/143017306 wait complete. 2024-04-17T19:46:49.561 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-17T19:46:41.940380+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-17T19:46:49.562 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-17T19:46:49.716 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:49.726+0000 7f8c8ba00640 1 Processor -- start 2024-04-17T19:46:49.716 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:49.726+0000 7f8c8ba00640 1 -- start start 2024-04-17T19:46:49.718 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:49.726+0000 7f8c8ba00640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f8c840c8660 0x7f8c840c8a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:46:49.718 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:49.726+0000 7f8c8ba00640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8c840c7680 con 0x7f8c84153b10 2024-04-17T19:46:49.718 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:49.726+0000 7f8c8ba00640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8c840c6b00 con 0x7f8c8415d3d0 2024-04-17T19:46:49.718 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:49.726+0000 7f8c8ba00640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 -- 0x7f8c84153f20 con 0x7f8c840c8660 2024-04-17T19:46:49.718 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:49.726+0000 7f8c89000640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f8c84153b10 0x7f8c840c7cc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:52796/0 (socket says 172.21.15.44:52796) 2024-04-17T19:46:49.718 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:49.726+0000 7f8c89000640 1 -- 172.21.15.44:0/91754791 learned_addr learned my addr 172.21.15.44:0/91754791 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-04-17T19:46:49.720 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:49.730+0000 7f8c7be00640 1 --2- 172.21.15.44:0/91754791 >> v2:172.21.15.62:3300/0 conn(0x7f8c840c8660 0x7f8c840c8a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:46:49.720 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:49.730+0000 7f8c83e00640 1 -- 172.21.15.44:0/91754791 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 482617609 0 0) 0x7f8c840c7680 con 0x7f8c84153b10 2024-04-17T19:46:49.721 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:49.730+0000 7f8c83e00640 1 -- 172.21.15.44:0/91754791 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8c68003530 con 0x7f8c84153b10 2024-04-17T19:46:49.721 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:49.730+0000 7f8c83e00640 1 -- 172.21.15.44:0/91754791 <== mon.0 v1:172.21.15.44:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1879826883 0 0) 0x7f8c68003530 con 0x7f8c84153b10 2024-04-17T19:46:49.721 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:49.730+0000 7f8c83e00640 1 -- 172.21.15.44:0/91754791 >> v2:172.21.15.62:3300/0 conn(0x7f8c840c8660 msgr2=0x7f8c840c8a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T19:46:49.721 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:49.730+0000 7f8c83e00640 1 --2- 172.21.15.44:0/91754791 >> v2:172.21.15.62:3300/0 conn(0x7f8c840c8660 0x7f8c840c8a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:46:49.721 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:49.730+0000 7f8c83e00640 1 -- 172.21.15.44:0/91754791 >> v1:172.21.15.62:6789/0 conn(0x7f8c8415d3d0 legacy=0x7f8c8415d7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:46:49.721 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:49.730+0000 7f8c83e00640 1 -- 172.21.15.44:0/91754791 --> v1:172.21.15.44:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8c840c6de0 con 0x7f8c84153b10 2024-04-17T19:46:49.721 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:49.730+0000 7f8c83e00640 1 -- 172.21.15.44:0/91754791 <== mon.0 v1:172.21.15.44:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1863569991 0 0) 0x7f8c74001680 con 0x7f8c84153b10 2024-04-17T19:46:49.721 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:49.730+0000 7f8c83e00640 1 -- 172.21.15.44:0/91754791 >> v1:172.21.15.44:6789/0 conn(0x7f8c84153b10 legacy=0x7f8c840c7cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:46:49.721 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:49.730+0000 7f8c83e00640 1 --2- 172.21.15.44:0/91754791 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f8c680039c0 0x7f8c68003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:46:49.721 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:49.730+0000 7f8c83e00640 1 --2- 172.21.15.44:0/91754791 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8c68004810 0x7f8c68004c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:46:49.721 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:49.730+0000 7f8c83e00640 1 --2- 172.21.15.44:0/91754791 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8c680051d0 0x7f8c6800b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:46:49.721 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:49.730+0000 7f8c83e00640 1 -- 172.21.15.44:0/91754791 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f8c84153f20 con 0x7f8c680051d0 2024-04-17T19:46:49.721 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:49.730+0000 7f8c83e00640 1 -- 172.21.15.44:0/91754791 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f8c6800c170 con 0x7f8c68004810 2024-04-17T19:46:49.721 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:49.730+0000 7f8c83e00640 1 -- 172.21.15.44:0/91754791 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7f8c6800c370 con 0x7f8c680039c0 2024-04-17T19:46:49.722 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:49.730+0000 7f8c89a00640 1 --2- 172.21.15.44:0/91754791 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8c680051d0 0x7f8c6800b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:46:49.722 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:49.730+0000 7f8c7be00640 1 --2- 172.21.15.44:0/91754791 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8c68004810 0x7f8c68004c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:46:49.722 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:49.730+0000 7f8c89000640 1 --2- 172.21.15.44:0/91754791 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f8c680039c0 0x7f8c68003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:46:49.722 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:49.730+0000 7f8c89a00640 1 -- 172.21.15.44:0/91754791 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f8c680039c0 msgr2=0x7f8c68003e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T19:46:49.722 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:49.730+0000 7f8c89a00640 1 --2- 172.21.15.44:0/91754791 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f8c680039c0 0x7f8c68003e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:46:49.722 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:49.730+0000 7f8c89a00640 1 -- 172.21.15.44:0/91754791 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8c68004810 msgr2=0x7f8c68004c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T19:46:49.722 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:49.730+0000 7f8c89a00640 1 --2- 172.21.15.44:0/91754791 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8c68004810 0x7f8c68004c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:46:49.722 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:49.730+0000 7f8c89a00640 1 -- 172.21.15.44:0/91754791 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8c68003530 con 0x7f8c680051d0 2024-04-17T19:46:49.722 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:49.730+0000 7f8c89000640 1 --2- 172.21.15.44:0/91754791 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f8c680039c0 0x7f8c68003e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-17T19:46:49.723 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:49.734+0000 7f8c89a00640 1 -- 172.21.15.44:0/91754791 reap_dead start 2024-04-17T19:46:49.723 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:49.734+0000 7f8c89a00640 1 --2- 172.21.15.44:0/91754791 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8c680051d0 0x7f8c6800b9d0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f8c7c001e40 tx=0x7f8c7c01c6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e32c2acdc4af430f server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:46:49.723 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:49.734+0000 7f8c83e00640 1 -- 172.21.15.44:0/91754791 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c7c001a90 con 0x7f8c680051d0 2024-04-17T19:46:49.723 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:49.734+0000 7f8c83e00640 1 -- 172.21.15.44:0/91754791 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8c7c003b80 con 0x7f8c680051d0 2024-04-17T19:46:49.723 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:49.734+0000 7f8c83e00640 1 -- 172.21.15.44:0/91754791 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c7c0050d0 con 0x7f8c680051d0 2024-04-17T19:46:49.724 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:49.734+0000 7f8c8ba00640 1 -- 172.21.15.44:0/91754791 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8c680051d0 msgr2=0x7f8c6800b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:46:49.724 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:49.734+0000 7f8c8ba00640 1 --2- 172.21.15.44:0/91754791 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8c680051d0 0x7f8c6800b9d0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f8c7c001e40 tx=0x7f8c7c01c6a0 comp rx=0 tx=0).stop 2024-04-17T19:46:49.724 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:49.734+0000 7f8c8ba00640 1 -- 172.21.15.44:0/91754791 shutdown_connections 2024-04-17T19:46:49.724 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:49.734+0000 7f8c8ba00640 1 --2- 172.21.15.44:0/91754791 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8c680051d0 0x7f8c6800b9d0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:46:49.724 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:49.734+0000 7f8c8ba00640 1 -- 172.21.15.44:0/91754791 >> 172.21.15.44:0/91754791 conn(0x7f8c840c9dc0 msgr2=0x7f8c840ca1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:46:49.724 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:49.734+0000 7f8c8ba00640 1 -- 172.21.15.44:0/91754791 shutdown_connections 2024-04-17T19:46:49.724 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:49.734+0000 7f8c8ba00640 1 -- 172.21.15.44:0/91754791 wait complete. 2024-04-17T19:46:49.726 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:49.734+0000 7f8c8ba00640 1 Processor -- start 2024-04-17T19:46:49.726 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:49.734+0000 7f8c8ba00640 1 -- start start 2024-04-17T19:46:49.729 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:49.738+0000 7f8c8ba00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8c680051d0 0x7f8c840c4650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:46:49.729 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:49.738+0000 7f8c8ba00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8c840cbfb0 0x7f8c84159a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:46:49.729 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:49.738+0000 7f8c8ba00640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f8c84159fa0 0x7f8c841f0ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:46:49.729 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:49.738+0000 7f8c8ba00640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f8c840c73a0 con 0x7f8c680051d0 2024-04-17T19:46:49.729 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:49.738+0000 7f8c8ba00640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f8c8415cf40 con 0x7f8c840cbfb0 2024-04-17T19:46:49.729 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:49.738+0000 7f8c8ba00640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7f8c840681c0 con 0x7f8c84159fa0 2024-04-17T19:46:49.729 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:49.738+0000 7f8c89000640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8c680051d0 0x7f8c840c4650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:46:49.729 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:49.738+0000 7f8c89000640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8c680051d0 0x7f8c840c4650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:33938/0 (socket says 172.21.15.44:33938) 2024-04-17T19:46:49.729 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:49.738+0000 7f8c89000640 1 -- 172.21.15.44:0/3947114525 learned_addr learned my addr 172.21.15.44:0/3947114525 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-04-17T19:46:49.729 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:49.738+0000 7f8c7be00640 1 --2- 172.21.15.44:0/3947114525 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8c840cbfb0 0x7f8c84159a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:46:49.729 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:49.738+0000 7f8c89a00640 1 --2- 172.21.15.44:0/3947114525 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f8c84159fa0 0x7f8c841f0ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:46:49.729 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:49.738+0000 7f8c89000640 1 -- 172.21.15.44:0/3947114525 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f8c84159fa0 msgr2=0x7f8c841f0ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:46:49.730 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:49.738+0000 7f8c89000640 1 --2- 172.21.15.44:0/3947114525 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f8c84159fa0 0x7f8c841f0ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:46:49.730 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:49.738+0000 7f8c89000640 1 -- 172.21.15.44:0/3947114525 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8c840cbfb0 msgr2=0x7f8c84159a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:46:49.730 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:49.738+0000 7f8c89000640 1 --2- 172.21.15.44:0/3947114525 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8c840cbfb0 0x7f8c84159a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:46:49.730 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:49.738+0000 7f8c89000640 1 -- 172.21.15.44:0/3947114525 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8c840c3a50 con 0x7f8c680051d0 2024-04-17T19:46:49.730 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:49.738+0000 7f8c89a00640 1 --2- 172.21.15.44:0/3947114525 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f8c84159fa0 0x7f8c841f0ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-17T19:46:49.730 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:49.738+0000 7f8c89000640 1 --2- 172.21.15.44:0/3947114525 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8c680051d0 0x7f8c840c4650 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f8c7400e7b0 tx=0x7f8c7400ebb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:46:49.730 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:49.738+0000 7f8c81600640 1 -- 172.21.15.44:0/3947114525 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c7400c660 con 0x7f8c680051d0 2024-04-17T19:46:49.730 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:49.738+0000 7f8c81600640 1 -- 172.21.15.44:0/3947114525 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8c74018070 con 0x7f8c680051d0 2024-04-17T19:46:49.730 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:49.738+0000 7f8c81600640 1 -- 172.21.15.44:0/3947114525 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c7400ca40 con 0x7f8c680051d0 2024-04-17T19:46:49.730 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:49.738+0000 7f8c8ba00640 1 -- 172.21.15.44:0/3947114525 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8c840cb1f0 con 0x7f8c680051d0 2024-04-17T19:46:49.730 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:49.738+0000 7f8c8ba00640 1 -- 172.21.15.44:0/3947114525 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8c840cb7b0 con 0x7f8c680051d0 2024-04-17T19:46:49.731 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:49.738+0000 7f8c8ba00640 1 -- 172.21.15.44:0/3947114525 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8c8404ff10 con 0x7f8c680051d0 2024-04-17T19:46:49.731 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:49.742+0000 7f8c81600640 1 -- 172.21.15.44:0/3947114525 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f8c7400cbe0 con 0x7f8c680051d0 2024-04-17T19:46:49.732 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:49.742+0000 7f8c81600640 1 --2- 172.21.15.44:0/3947114525 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f8c60068380 0x7f8c6006a890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:46:49.732 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:49.742+0000 7f8c81600640 1 -- 172.21.15.44:0/3947114525 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 4857+0+0 (secure 0 0 0) 0x7f8c74086410 con 0x7f8c680051d0 2024-04-17T19:46:49.732 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:49.742+0000 7f8c7be00640 1 --2- 172.21.15.44:0/3947114525 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f8c60068380 0x7f8c6006a890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:46:49.733 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:49.742+0000 7f8c7be00640 1 --2- 172.21.15.44:0/3947114525 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f8c60068380 0x7f8c6006a890 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f8c8414eb80 tx=0x7f8c6c009190 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:46:49.736 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:49.746+0000 7f8c81600640 1 -- 172.21.15.44:0/3947114525 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f8c740566d0 con 0x7f8c680051d0 2024-04-17T19:46:49.899 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:49.910+0000 7f8c8ba00640 1 -- 172.21.15.44:0/3947114525 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f8c841571d0 con 0x7f8c680051d0 2024-04-17T19:46:49.900 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:49.910+0000 7f8c81600640 1 -- 172.21.15.44:0/3947114525 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v17) ==== 93+0+10 (secure 0 0 0) 0x7f8c7405a9d0 con 0x7f8c680051d0 2024-04-17T19:46:49.900 INFO:teuthology.orchestra.run.smithi044.stdout:pg_num: 1 2024-04-17T19:46:49.902 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:49.910+0000 7f8c8ba00640 1 -- 172.21.15.44:0/3947114525 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f8c60068380 msgr2=0x7f8c6006a890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:46:49.902 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:49.910+0000 7f8c8ba00640 1 --2- 172.21.15.44:0/3947114525 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f8c60068380 0x7f8c6006a890 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f8c8414eb80 tx=0x7f8c6c009190 comp rx=0 tx=0).stop 2024-04-17T19:46:49.902 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:49.910+0000 7f8c8ba00640 1 -- 172.21.15.44:0/3947114525 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8c680051d0 msgr2=0x7f8c840c4650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:46:49.902 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:49.910+0000 7f8c8ba00640 1 --2- 172.21.15.44:0/3947114525 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8c680051d0 0x7f8c840c4650 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f8c7400e7b0 tx=0x7f8c7400ebb0 comp rx=0 tx=0).stop 2024-04-17T19:46:49.902 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:49.910+0000 7f8c8ba00640 1 -- 172.21.15.44:0/3947114525 shutdown_connections 2024-04-17T19:46:49.903 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:49.910+0000 7f8c8ba00640 1 --2- 172.21.15.44:0/3947114525 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f8c60068380 0x7f8c6006a890 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:46:49.903 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:49.910+0000 7f8c8ba00640 1 --2- 172.21.15.44:0/3947114525 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f8c84159fa0 0x7f8c841f0ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:46:49.903 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:49.910+0000 7f8c8ba00640 1 --2- 172.21.15.44:0/3947114525 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8c840cbfb0 0x7f8c84159a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:46:49.903 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:49.910+0000 7f8c8ba00640 1 --2- 172.21.15.44:0/3947114525 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8c680051d0 0x7f8c840c4650 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:46:49.903 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:49.910+0000 7f8c8ba00640 1 -- 172.21.15.44:0/3947114525 >> 172.21.15.44:0/3947114525 conn(0x7f8c840c9dc0 msgr2=0x7f8c84070890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:46:49.903 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:49.914+0000 7f8c8ba00640 1 -- 172.21.15.44:0/3947114525 shutdown_connections 2024-04-17T19:46:49.903 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:49.914+0000 7f8c8ba00640 1 -- 172.21.15.44:0/3947114525 wait complete. 2024-04-17T19:46:49.921 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-17T19:46:50.073 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:50.082+0000 7f8676200640 1 Processor -- start 2024-04-17T19:46:50.073 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:50.082+0000 7f8676200640 1 -- start start 2024-04-17T19:46:50.075 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:50.086+0000 7f8676200640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f8670158eb0 0x7f86701592c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:46:50.075 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:50.086+0000 7f8676200640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8670152e70 con 0x7f86700c47c0 2024-04-17T19:46:50.075 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:50.086+0000 7f8676200640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f86700c52c0 con 0x7f8670152a60 2024-04-17T19:46:50.075 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:50.086+0000 7f8676200640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 -- 0x7f86700c8840 con 0x7f8670158eb0 2024-04-17T19:46:50.075 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:50.086+0000 7f8666a00640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f8670158eb0 0x7f86701592c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:46:50.075 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:50.086+0000 7f866fe00640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f86700c47c0 0x7f8670163100 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:52812/0 (socket says 172.21.15.44:52812) 2024-04-17T19:46:50.075 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:50.086+0000 7f866fe00640 1 -- 172.21.15.44:0/219191036 learned_addr learned my addr 172.21.15.44:0/219191036 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-04-17T19:46:50.076 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:50.086+0000 7f8666a00640 1 -- 172.21.15.44:0/219191036 >> v1:172.21.15.62:6789/0 conn(0x7f8670152a60 legacy=0x7f86700c6920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:46:50.076 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:50.086+0000 7f8666a00640 1 -- 172.21.15.44:0/219191036 >> v1:172.21.15.44:6789/0 conn(0x7f86700c47c0 legacy=0x7f8670163100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:46:50.076 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:50.086+0000 7f8666a00640 1 -- 172.21.15.44:0/219191036 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f86700c8b20 con 0x7f8670158eb0 2024-04-17T19:46:50.076 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:50.086+0000 7f866ea00640 1 -- 172.21.15.44:0/219191036 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4293091102 0 0) 0x7f8670152e70 con 0x7f86700c47c0 2024-04-17T19:46:50.078 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:50.090+0000 7f8666a00640 1 --2- 172.21.15.44:0/219191036 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8670158eb0 0x7f86701592c0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f86580097c0 tx=0x7f865801c4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=86039b2d15753704 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:46:50.079 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:50.090+0000 7f866ea00640 1 -- 172.21.15.44:0/219191036 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86580b0070 con 0x7f8670158eb0 2024-04-17T19:46:50.079 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:50.090+0000 7f866ea00640 1 -- 172.21.15.44:0/219191036 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f86580ab600 con 0x7f8670158eb0 2024-04-17T19:46:50.079 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:50.090+0000 7f866ea00640 1 -- 172.21.15.44:0/219191036 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86580ab9d0 con 0x7f8670158eb0 2024-04-17T19:46:50.080 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:50.090+0000 7f8676200640 1 -- 172.21.15.44:0/219191036 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8670158eb0 msgr2=0x7f86701592c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:46:50.080 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:50.090+0000 7f8676200640 1 --2- 172.21.15.44:0/219191036 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8670158eb0 0x7f86701592c0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f86580097c0 tx=0x7f865801c4a0 comp rx=0 tx=0).stop 2024-04-17T19:46:50.080 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:50.090+0000 7f8676200640 1 -- 172.21.15.44:0/219191036 shutdown_connections 2024-04-17T19:46:50.080 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:50.090+0000 7f8676200640 1 --2- 172.21.15.44:0/219191036 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8670158eb0 0x7f86701592c0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:46:50.080 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:50.090+0000 7f8676200640 1 -- 172.21.15.44:0/219191036 >> 172.21.15.44:0/219191036 conn(0x7f867006c380 msgr2=0x7f8670070080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:46:50.080 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:50.090+0000 7f8676200640 1 -- 172.21.15.44:0/219191036 shutdown_connections 2024-04-17T19:46:50.080 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:50.090+0000 7f8676200640 1 -- 172.21.15.44:0/219191036 wait complete. 2024-04-17T19:46:50.082 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:50.090+0000 7f8676200640 1 Processor -- start 2024-04-17T19:46:50.082 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:50.090+0000 7f8676200640 1 -- start start 2024-04-17T19:46:50.085 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:50.094+0000 7f8676200640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f86700c47c0 0x7f86701499d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:46:50.085 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:50.094+0000 7f8676200640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8670152a60 0x7f8670147560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:46:50.085 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:50.094+0000 7f8676200640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f8670158eb0 0x7f86700ca920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:46:50.085 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:50.094+0000 7f8676200640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f8670167450 con 0x7f8670152a60 2024-04-17T19:46:50.085 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:50.094+0000 7f8676200640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f86700c4fe0 con 0x7f86700c47c0 2024-04-17T19:46:50.085 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:50.094+0000 7f8676200640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7f86701675d0 con 0x7f8670158eb0 2024-04-17T19:46:50.085 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:50.094+0000 7f8666a00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8670152a60 0x7f8670147560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:46:50.085 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:50.094+0000 7f8666a00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8670152a60 0x7f8670147560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:33964/0 (socket says 172.21.15.44:33964) 2024-04-17T19:46:50.085 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:50.094+0000 7f8666a00640 1 -- 172.21.15.44:0/1815506724 learned_addr learned my addr 172.21.15.44:0/1815506724 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-04-17T19:46:50.085 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:50.094+0000 7f866f400640 1 --2- 172.21.15.44:0/1815506724 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f86700c47c0 0x7f86701499d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:46:50.086 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:50.094+0000 7f866fe00640 1 --2- 172.21.15.44:0/1815506724 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f8670158eb0 0x7f86700ca920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:46:50.086 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:50.094+0000 7f8666a00640 1 -- 172.21.15.44:0/1815506724 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f8670158eb0 msgr2=0x7f86700ca920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:46:50.086 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:50.094+0000 7f8666a00640 1 --2- 172.21.15.44:0/1815506724 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f8670158eb0 0x7f86700ca920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:46:50.086 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:50.094+0000 7f8666a00640 1 -- 172.21.15.44:0/1815506724 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f86700c47c0 msgr2=0x7f86701499d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:46:50.086 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:50.094+0000 7f8666a00640 1 --2- 172.21.15.44:0/1815506724 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f86700c47c0 0x7f86701499d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:46:50.086 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:50.094+0000 7f8666a00640 1 -- 172.21.15.44:0/1815506724 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8670146de0 con 0x7f8670152a60 2024-04-17T19:46:50.086 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:50.094+0000 7f866f400640 1 --2- 172.21.15.44:0/1815506724 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f86700c47c0 0x7f86701499d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-17T19:46:50.086 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:50.094+0000 7f8666a00640 1 --2- 172.21.15.44:0/1815506724 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8670152a60 0x7f8670147560 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f86580ae040 tx=0x7f865801ace0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:46:50.086 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:50.094+0000 7f8667e00640 1 -- 172.21.15.44:0/1815506724 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86580bc070 con 0x7f8670152a60 2024-04-17T19:46:50.086 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:50.094+0000 7f8667e00640 1 -- 172.21.15.44:0/1815506724 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f86580b1040 con 0x7f8670152a60 2024-04-17T19:46:50.086 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:50.094+0000 7f8667e00640 1 -- 172.21.15.44:0/1815506724 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86580b0050 con 0x7f8670152a60 2024-04-17T19:46:50.086 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:50.094+0000 7f8676200640 1 -- 172.21.15.44:0/1815506724 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8670147080 con 0x7f8670152a60 2024-04-17T19:46:50.086 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:50.094+0000 7f8676200640 1 -- 172.21.15.44:0/1815506724 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f86701550a0 con 0x7f8670152a60 2024-04-17T19:46:50.087 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:50.094+0000 7f8676200640 1 -- 172.21.15.44:0/1815506724 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f867004ff10 con 0x7f8670152a60 2024-04-17T19:46:50.087 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:50.098+0000 7f8667e00640 1 -- 172.21.15.44:0/1815506724 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f8658004270 con 0x7f8670152a60 2024-04-17T19:46:50.088 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:50.098+0000 7f8667e00640 1 --2- 172.21.15.44:0/1815506724 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f864c0683b0 0x7f864c06a8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:46:50.088 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:50.098+0000 7f8667e00640 1 -- 172.21.15.44:0/1815506724 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 4857+0+0 (secure 0 0 0) 0x7f86581201f0 con 0x7f8670152a60 2024-04-17T19:46:50.088 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:50.098+0000 7f866f400640 1 --2- 172.21.15.44:0/1815506724 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f864c0683b0 0x7f864c06a8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:46:50.089 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:50.098+0000 7f866f400640 1 --2- 172.21.15.44:0/1815506724 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f864c0683b0 0x7f864c06a8c0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f8660000f70 tx=0x7f8660009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:46:50.092 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:50.102+0000 7f8667e00640 1 -- 172.21.15.44:0/1815506724 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f8658016090 con 0x7f8670152a60 2024-04-17T19:46:50.295 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:50.306+0000 7f8676200640 1 -- 172.21.15.44:0/1815506724 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f86700c7ea0 con 0x7f8670152a60 2024-04-17T19:46:50.296 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:50.306+0000 7f8667e00640 1 -- 172.21.15.44:0/1815506724 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 2 v2) ==== 93+0+1392 (secure 0 0 0) 0x7f86580f0af0 con 0x7f8670152a60 2024-04-17T19:46:50.296 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-04-17T19:46:50.296 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":2,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4263,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.44:6835/1724891996","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6832","nonce":1724891996},{"type":"v1","addr":"172.21.15.44:6835","nonce":1724891996}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[]} 2024-04-17T19:46:50.296 INFO:teuthology.orchestra.run.smithi044.stderr:dumped fsmap epoch 2 2024-04-17T19:46:50.298 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:50.306+0000 7f8676200640 1 -- 172.21.15.44:0/1815506724 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f864c0683b0 msgr2=0x7f864c06a8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:46:50.298 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:50.306+0000 7f8676200640 1 --2- 172.21.15.44:0/1815506724 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f864c0683b0 0x7f864c06a8c0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f8660000f70 tx=0x7f8660009040 comp rx=0 tx=0).stop 2024-04-17T19:46:50.299 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:50.306+0000 7f8676200640 1 -- 172.21.15.44:0/1815506724 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8670152a60 msgr2=0x7f8670147560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:46:50.299 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:50.306+0000 7f8676200640 1 --2- 172.21.15.44:0/1815506724 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8670152a60 0x7f8670147560 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f86580ae040 tx=0x7f865801ace0 comp rx=0 tx=0).stop 2024-04-17T19:46:50.299 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:50.306+0000 7f8676200640 1 -- 172.21.15.44:0/1815506724 shutdown_connections 2024-04-17T19:46:50.299 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:50.306+0000 7f8676200640 1 --2- 172.21.15.44:0/1815506724 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f864c0683b0 0x7f864c06a8c0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:46:50.299 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:50.306+0000 7f8676200640 1 --2- 172.21.15.44:0/1815506724 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f8670158eb0 0x7f86700ca920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:46:50.299 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:50.306+0000 7f8676200640 1 --2- 172.21.15.44:0/1815506724 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8670152a60 0x7f8670147560 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:46:50.299 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:50.306+0000 7f8676200640 1 --2- 172.21.15.44:0/1815506724 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f86700c47c0 0x7f86701499d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:46:50.299 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:50.306+0000 7f8676200640 1 -- 172.21.15.44:0/1815506724 >> 172.21.15.44:0/1815506724 conn(0x7f867006c380 msgr2=0x7f86700734d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:46:50.299 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:50.306+0000 7f8676200640 1 -- 172.21.15.44:0/1815506724 shutdown_connections 2024-04-17T19:46:50.299 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:50.310+0000 7f8676200640 1 -- 172.21.15.44:0/1815506724 wait complete. 2024-04-17T19:46:52.321 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-17T19:46:52.486 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:52.498+0000 7f59f8400640 1 Processor -- start 2024-04-17T19:46:52.486 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:52.498+0000 7f59f8400640 1 -- start start 2024-04-17T19:46:52.488 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:52.498+0000 7f59f8400640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f59f006bf90 0x7f59f006fba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:46:52.488 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:52.498+0000 7f59f8400640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f59f006c3a0 0x7f59f00ca740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:46:52.488 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:52.498+0000 7f59f8400640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f59f015be90 con 0x7f59f00cac80 2024-04-17T19:46:52.489 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:52.498+0000 7f59f8400640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 -- 0x7f59f015c150 con 0x7f59f006c3a0 2024-04-17T19:46:52.489 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:52.498+0000 7f59f8400640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 -- 0x7f59f015c430 con 0x7f59f006bf90 2024-04-17T19:46:52.489 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:52.498+0000 7f59f5000640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f59f006c3a0 0x7f59f00ca740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:46:52.489 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:52.498+0000 7f59f6400640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f59f00cac80 0x7f59f015f0a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:52814/0 (socket says 172.21.15.44:52814) 2024-04-17T19:46:52.489 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:52.498+0000 7f59f6400640 1 -- 172.21.15.44:0/3133875453 learned_addr learned my addr 172.21.15.44:0/3133875453 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-04-17T19:46:52.489 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:52.498+0000 7f59f5a00640 1 --2- 172.21.15.44:0/3133875453 >> v2:172.21.15.62:3300/0 conn(0x7f59f006bf90 0x7f59f006fba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:46:52.489 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:52.498+0000 7f59f5000640 1 -- 172.21.15.44:0/3133875453 >> v2:172.21.15.62:3300/0 conn(0x7f59f006bf90 msgr2=0x7f59f006fba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T19:46:52.489 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:52.498+0000 7f59f5000640 1 --2- 172.21.15.44:0/3133875453 >> v2:172.21.15.62:3300/0 conn(0x7f59f006bf90 0x7f59f006fba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:46:52.490 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:52.498+0000 7f59f5000640 1 -- 172.21.15.44:0/3133875453 >> v1:172.21.15.44:6789/0 conn(0x7f59f00cac80 legacy=0x7f59f015f0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:46:52.490 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:52.498+0000 7f59f5000640 1 -- 172.21.15.44:0/3133875453 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f59f015c710 con 0x7f59f006c3a0 2024-04-17T19:46:52.490 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:52.498+0000 7f59efe00640 1 -- 172.21.15.44:0/3133875453 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2979717190 0 0) 0x7f59f015be90 con 0x7f59f00cac80 2024-04-17T19:46:52.492 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:52.502+0000 7f59f5000640 1 --2- 172.21.15.44:0/3133875453 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f59f006c3a0 0x7f59f00ca740 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f59f0072860 tx=0x7f59dc01ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6469137b4b5941cb server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:46:52.492 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:52.502+0000 7f59efe00640 1 -- 172.21.15.44:0/3133875453 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59dc0b5070 con 0x7f59f006c3a0 2024-04-17T19:46:52.492 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:52.502+0000 7f59efe00640 1 -- 172.21.15.44:0/3133875453 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f59dc0a8970 con 0x7f59f006c3a0 2024-04-17T19:46:52.492 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:52.502+0000 7f59efe00640 1 -- 172.21.15.44:0/3133875453 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59dc0a8d40 con 0x7f59f006c3a0 2024-04-17T19:46:52.493 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:52.502+0000 7f59f8400640 1 -- 172.21.15.44:0/3133875453 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f59f006c3a0 msgr2=0x7f59f00ca740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:46:52.493 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:52.502+0000 7f59f8400640 1 --2- 172.21.15.44:0/3133875453 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f59f006c3a0 0x7f59f00ca740 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f59f0072860 tx=0x7f59dc01ec70 comp rx=0 tx=0).stop 2024-04-17T19:46:52.493 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:52.502+0000 7f59f8400640 1 -- 172.21.15.44:0/3133875453 shutdown_connections 2024-04-17T19:46:52.493 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:52.502+0000 7f59f8400640 1 --2- 172.21.15.44:0/3133875453 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f59f006c3a0 0x7f59f00ca740 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:46:52.493 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:52.502+0000 7f59f8400640 1 --2- 172.21.15.44:0/3133875453 >> v2:172.21.15.62:3300/0 conn(0x7f59f006bf90 0x7f59f006fba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:46:52.493 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:52.502+0000 7f59f8400640 1 -- 172.21.15.44:0/3133875453 >> 172.21.15.44:0/3133875453 conn(0x7f59f0073650 msgr2=0x7f59f0073a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:46:52.493 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:52.502+0000 7f59f8400640 1 -- 172.21.15.44:0/3133875453 shutdown_connections 2024-04-17T19:46:52.493 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:52.502+0000 7f59f8400640 1 -- 172.21.15.44:0/3133875453 wait complete. 2024-04-17T19:46:52.495 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:52.506+0000 7f59f8400640 1 Processor -- start 2024-04-17T19:46:52.495 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:52.506+0000 7f59f8400640 1 -- start start 2024-04-17T19:46:52.497 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:52.506+0000 7f59f8400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f59f006bf90 0x7f59f00c6610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:46:52.497 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:52.506+0000 7f59f8400640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f59f006c3a0 0x7f59f014bb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:46:52.498 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:52.506+0000 7f59f8400640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f59f00cac80 0x7f59f01f5530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:46:52.498 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:52.506+0000 7f59f8400640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f59f006f680 con 0x7f59f006bf90 2024-04-17T19:46:52.498 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:52.506+0000 7f59f8400640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f59f006f3a0 con 0x7f59f006c3a0 2024-04-17T19:46:52.498 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:52.506+0000 7f59f8400640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7f59f015bb80 con 0x7f59f00cac80 2024-04-17T19:46:52.498 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:52.506+0000 7f59f5a00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f59f006bf90 0x7f59f00c6610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:46:52.498 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:52.506+0000 7f59f5a00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f59f006bf90 0x7f59f00c6610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:33982/0 (socket says 172.21.15.44:33982) 2024-04-17T19:46:52.498 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:52.506+0000 7f59f5a00640 1 -- 172.21.15.44:0/105421868 learned_addr learned my addr 172.21.15.44:0/105421868 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-04-17T19:46:52.498 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:52.506+0000 7f59f5000640 1 --2- 172.21.15.44:0/105421868 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f59f006c3a0 0x7f59f014bb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:46:52.498 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:52.506+0000 7f59f6400640 1 --2- 172.21.15.44:0/105421868 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f59f00cac80 0x7f59f01f5530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:46:52.498 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:52.506+0000 7f59f5a00640 1 -- 172.21.15.44:0/105421868 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f59f00cac80 msgr2=0x7f59f01f5530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:46:52.498 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:52.506+0000 7f59f5a00640 1 --2- 172.21.15.44:0/105421868 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f59f00cac80 0x7f59f01f5530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:46:52.498 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:52.506+0000 7f59f5a00640 1 -- 172.21.15.44:0/105421868 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f59f006c3a0 msgr2=0x7f59f014bb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:46:52.499 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:52.506+0000 7f59f5a00640 1 --2- 172.21.15.44:0/105421868 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f59f006c3a0 0x7f59f014bb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:46:52.499 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:52.506+0000 7f59f5a00640 1 -- 172.21.15.44:0/105421868 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f59f00c6b50 con 0x7f59f006bf90 2024-04-17T19:46:52.499 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:52.506+0000 7f59f5000640 1 --2- 172.21.15.44:0/105421868 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f59f006c3a0 0x7f59f014bb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-17T19:46:52.499 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:52.506+0000 7f59f5a00640 1 --2- 172.21.15.44:0/105421868 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f59f006bf90 0x7f59f00c6610 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f59e400e8a0 tx=0x7f59e400eca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:46:52.500 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:52.506+0000 7f59ed600640 1 -- 172.21.15.44:0/105421868 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59e4017070 con 0x7f59f006bf90 2024-04-17T19:46:52.500 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:52.506+0000 7f59ed600640 1 -- 172.21.15.44:0/105421868 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f59e400c940 con 0x7f59f006bf90 2024-04-17T19:46:52.500 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:52.506+0000 7f59ed600640 1 -- 172.21.15.44:0/105421868 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59e400ccf0 con 0x7f59f006bf90 2024-04-17T19:46:52.500 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:52.506+0000 7f59f8400640 1 -- 172.21.15.44:0/105421868 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f59f00c80a0 con 0x7f59f006bf90 2024-04-17T19:46:52.500 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:52.510+0000 7f59f8400640 1 -- 172.21.15.44:0/105421868 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f59f0150000 con 0x7f59f006bf90 2024-04-17T19:46:52.500 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:52.510+0000 7f59f8400640 1 -- 172.21.15.44:0/105421868 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f59f004ff10 con 0x7f59f006bf90 2024-04-17T19:46:52.500 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:52.510+0000 7f59ed600640 1 -- 172.21.15.44:0/105421868 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f59e401a070 con 0x7f59f006bf90 2024-04-17T19:46:52.501 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:52.510+0000 7f59ed600640 1 --2- 172.21.15.44:0/105421868 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f59d0068380 0x7f59d006a890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:46:52.501 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:52.510+0000 7f59ed600640 1 -- 172.21.15.44:0/105421868 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 4857+0+0 (secure 0 0 0) 0x7f59e40868e0 con 0x7f59f006bf90 2024-04-17T19:46:52.501 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:52.510+0000 7f59f5000640 1 --2- 172.21.15.44:0/105421868 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f59d0068380 0x7f59d006a890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:46:52.502 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:52.514+0000 7f59f5000640 1 --2- 172.21.15.44:0/105421868 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f59d0068380 0x7f59d006a890 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f59dc0b2000 tx=0x7f59dc0aa070 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:46:52.506 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:52.518+0000 7f59ed600640 1 -- 172.21.15.44:0/105421868 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f59e40571f0 con 0x7f59f006bf90 2024-04-17T19:46:52.708 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:52.718+0000 7f59f8400640 1 -- 172.21.15.44:0/105421868 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f59f00c9810 con 0x7f59f006bf90 2024-04-17T19:46:52.709 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:52.718+0000 7f59ed600640 1 -- 172.21.15.44:0/105421868 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) ==== 93+0+5512 (secure 0 0 0) 0x7f59e4056af0 con 0x7f59f006bf90 2024-04-17T19:46:52.709 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-04-17T19:46:52.709 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4263,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.44:6835/1724891996","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6832","nonce":1724891996},{"type":"v1","addr":"172.21.15.44:6835","nonce":1724891996}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4266,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.44:6836/2201911513","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6833","nonce":2201911513},{"type":"v1","addr":"172.21.15.44:6836","nonce":2201911513}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4268,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.62:6837/3085335335","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6836","nonce":3085335335},{"type":"v1","addr":"172.21.15.62:6837","nonce":3085335335}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4269,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.44:6837/4073536070","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6834","nonce":4073536070},{"type":"v1","addr":"172.21.15.44:6837","nonce":4073536070}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4294,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.62:6835/2585862759","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6834","nonce":2585862759},{"type":"v1","addr":"172.21.15.62:6835","nonce":2585862759}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4306,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.62:6839/1537667111","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6838","nonce":1537667111},{"type":"v1","addr":"172.21.15.62:6839","nonce":1537667111}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[]} 2024-04-17T19:46:52.709 INFO:teuthology.orchestra.run.smithi044.stderr:dumped fsmap epoch 3 2024-04-17T19:46:52.711 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:52.722+0000 7f59f8400640 1 -- 172.21.15.44:0/105421868 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f59d0068380 msgr2=0x7f59d006a890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:46:52.711 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:52.722+0000 7f59f8400640 1 --2- 172.21.15.44:0/105421868 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f59d0068380 0x7f59d006a890 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f59dc0b2000 tx=0x7f59dc0aa070 comp rx=0 tx=0).stop 2024-04-17T19:46:52.711 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:52.722+0000 7f59f8400640 1 -- 172.21.15.44:0/105421868 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f59f006bf90 msgr2=0x7f59f00c6610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:46:52.711 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:52.722+0000 7f59f8400640 1 --2- 172.21.15.44:0/105421868 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f59f006bf90 0x7f59f00c6610 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f59e400e8a0 tx=0x7f59e400eca0 comp rx=0 tx=0).stop 2024-04-17T19:46:52.712 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:52.722+0000 7f59f8400640 1 -- 172.21.15.44:0/105421868 shutdown_connections 2024-04-17T19:46:52.712 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:52.722+0000 7f59f8400640 1 --2- 172.21.15.44:0/105421868 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f59d0068380 0x7f59d006a890 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:46:52.712 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:52.722+0000 7f59f8400640 1 --2- 172.21.15.44:0/105421868 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f59f00cac80 0x7f59f01f5530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:46:52.712 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:52.722+0000 7f59f8400640 1 --2- 172.21.15.44:0/105421868 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f59f006c3a0 0x7f59f014bb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:46:52.712 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:52.722+0000 7f59f8400640 1 --2- 172.21.15.44:0/105421868 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f59f006bf90 0x7f59f00c6610 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:46:52.712 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:52.722+0000 7f59f8400640 1 -- 172.21.15.44:0/105421868 >> 172.21.15.44:0/105421868 conn(0x7f59f0073650 msgr2=0x7f59f0073a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:46:52.712 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:52.722+0000 7f59f8400640 1 -- 172.21.15.44:0/105421868 shutdown_connections 2024-04-17T19:46:52.712 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:52.722+0000 7f59f8400640 1 -- 172.21.15.44:0/105421868 wait complete. 2024-04-17T19:46:52.731 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-17T19:46:52.882 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:52.894+0000 7fc3cb200640 1 Processor -- start 2024-04-17T19:46:52.883 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:52.894+0000 7fc3cb200640 1 -- start start 2024-04-17T19:46:52.884 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:52.894+0000 7fc3cb200640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fc3c4073f80 0x7fc3c4159c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:46:52.884 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:52.894+0000 7fc3cb200640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fc3c415a1b0 0x7fc3c4164060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:46:52.884 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:52.894+0000 7fc3cb200640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc3c40c8e10 con 0x7fc3c4073b70 2024-04-17T19:46:52.885 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:52.894+0000 7fc3cb200640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 -- 0x7fc3c415d860 con 0x7fc3c4073f80 2024-04-17T19:46:52.885 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:52.894+0000 7fc3cb200640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7fc3c415db40 con 0x7fc3c415a1b0 2024-04-17T19:46:52.885 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:52.894+0000 7fc3c9400640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fc3c4073f80 0x7fc3c4159c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:46:52.885 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:52.894+0000 7fc3c9e00640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7fc3c4073b70 0x7fc3c4153520 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:52824/0 (socket says 172.21.15.44:52824) 2024-04-17T19:46:52.885 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:52.894+0000 7fc3c9e00640 1 -- 172.21.15.44:0/3710958328 learned_addr learned my addr 172.21.15.44:0/3710958328 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-04-17T19:46:52.885 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:52.894+0000 7fc3ca800640 1 --2- 172.21.15.44:0/3710958328 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fc3c415a1b0 0x7fc3c4164060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:46:52.886 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:52.894+0000 7fc3c9400640 1 -- 172.21.15.44:0/3710958328 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fc3c415a1b0 msgr2=0x7fc3c4164060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T19:46:52.886 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:52.894+0000 7fc3c9400640 1 --2- 172.21.15.44:0/3710958328 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fc3c415a1b0 0x7fc3c4164060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:46:52.886 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:52.894+0000 7fc3c9400640 1 -- 172.21.15.44:0/3710958328 >> v1:172.21.15.44:6789/0 conn(0x7fc3c4073b70 legacy=0x7fc3c4153520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:46:52.886 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:52.894+0000 7fc3c9400640 1 -- 172.21.15.44:0/3710958328 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc3c40b3e40 con 0x7fc3c4073f80 2024-04-17T19:46:52.888 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:52.898+0000 7fc3c9400640 1 --2- 172.21.15.44:0/3710958328 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc3c4073f80 0x7fc3c4159c70 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fc3b40097c0 tx=0x7fc3b401ec90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6f01deea8b9e2965 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:46:52.888 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:52.898+0000 7fc3c8a00640 1 -- 172.21.15.44:0/3710958328 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3b40b5070 con 0x7fc3c4073f80 2024-04-17T19:46:52.888 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:52.898+0000 7fc3c8a00640 1 -- 172.21.15.44:0/3710958328 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc3b40a8990 con 0x7fc3c4073f80 2024-04-17T19:46:52.888 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:52.898+0000 7fc3c8a00640 1 -- 172.21.15.44:0/3710958328 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3b40a8d60 con 0x7fc3c4073f80 2024-04-17T19:46:52.889 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:52.898+0000 7fc3cb200640 1 -- 172.21.15.44:0/3710958328 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc3c4073f80 msgr2=0x7fc3c4159c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:46:52.889 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:52.898+0000 7fc3cb200640 1 --2- 172.21.15.44:0/3710958328 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc3c4073f80 0x7fc3c4159c70 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fc3b40097c0 tx=0x7fc3b401ec90 comp rx=0 tx=0).stop 2024-04-17T19:46:52.889 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:52.898+0000 7fc3cb200640 1 -- 172.21.15.44:0/3710958328 shutdown_connections 2024-04-17T19:46:52.889 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:52.898+0000 7fc3cb200640 1 --2- 172.21.15.44:0/3710958328 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fc3c415a1b0 0x7fc3c4164060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:46:52.889 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:52.898+0000 7fc3cb200640 1 --2- 172.21.15.44:0/3710958328 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc3c4073f80 0x7fc3c4159c70 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:46:52.889 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:52.898+0000 7fc3cb200640 1 -- 172.21.15.44:0/3710958328 >> 172.21.15.44:0/3710958328 conn(0x7fc3c4071080 msgr2=0x7fc3c4071490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:46:52.889 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:52.898+0000 7fc3cb200640 1 -- 172.21.15.44:0/3710958328 shutdown_connections 2024-04-17T19:46:52.890 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:52.898+0000 7fc3cb200640 1 -- 172.21.15.44:0/3710958328 wait complete. 2024-04-17T19:46:52.891 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:52.902+0000 7fc3cb200640 1 Processor -- start 2024-04-17T19:46:52.891 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:52.902+0000 7fc3cb200640 1 -- start start 2024-04-17T19:46:52.893 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:52.902+0000 7fc3cb200640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc3c4073b70 0x7fc3c41f2360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:46:52.893 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:52.902+0000 7fc3cb200640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc3c4073f80 0x7fc3c414e5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:46:52.893 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:52.902+0000 7fc3cb200640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fc3c415a1b0 0x7fc3c40cc6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:46:52.893 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:52.902+0000 7fc3cb200640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fc3c40c9210 con 0x7fc3c4073b70 2024-04-17T19:46:52.894 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:52.902+0000 7fc3cb200640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7fc3c41596e0 con 0x7fc3c4073f80 2024-04-17T19:46:52.894 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:52.902+0000 7fc3cb200640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7fc3c40c9390 con 0x7fc3c415a1b0 2024-04-17T19:46:52.894 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:52.902+0000 7fc3c9e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc3c4073b70 0x7fc3c41f2360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:46:52.894 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:52.902+0000 7fc3c9e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc3c4073b70 0x7fc3c41f2360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:33996/0 (socket says 172.21.15.44:33996) 2024-04-17T19:46:52.894 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:52.902+0000 7fc3c9e00640 1 -- 172.21.15.44:0/2272811881 learned_addr learned my addr 172.21.15.44:0/2272811881 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-04-17T19:46:52.894 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:52.902+0000 7fc3ca800640 1 --2- 172.21.15.44:0/2272811881 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fc3c415a1b0 0x7fc3c40cc6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:46:52.894 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:52.902+0000 7fc3c9400640 1 --2- 172.21.15.44:0/2272811881 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc3c4073f80 0x7fc3c414e5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:46:52.894 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:52.902+0000 7fc3c9e00640 1 -- 172.21.15.44:0/2272811881 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fc3c415a1b0 msgr2=0x7fc3c40cc6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:46:52.894 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:52.902+0000 7fc3c9e00640 1 --2- 172.21.15.44:0/2272811881 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fc3c415a1b0 0x7fc3c40cc6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:46:52.894 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:52.902+0000 7fc3c9e00640 1 -- 172.21.15.44:0/2272811881 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc3c4073f80 msgr2=0x7fc3c414e5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:46:52.894 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:52.902+0000 7fc3c9e00640 1 --2- 172.21.15.44:0/2272811881 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc3c4073f80 0x7fc3c414e5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:46:52.894 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:52.902+0000 7fc3c9e00640 1 -- 172.21.15.44:0/2272811881 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc3c41f28a0 con 0x7fc3c4073b70 2024-04-17T19:46:52.895 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:52.902+0000 7fc3c9e00640 1 --2- 172.21.15.44:0/2272811881 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc3c4073b70 0x7fc3c41f2360 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fc3b800c370 tx=0x7fc3b800c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:46:52.895 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:52.902+0000 7fc3be000640 1 -- 172.21.15.44:0/2272811881 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3b8017070 con 0x7fc3c4073b70 2024-04-17T19:46:52.895 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:52.902+0000 7fc3be000640 1 -- 172.21.15.44:0/2272811881 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc3b8005cf0 con 0x7fc3c4073b70 2024-04-17T19:46:52.895 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:52.902+0000 7fc3cb200640 1 -- 172.21.15.44:0/2272811881 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc3c41f6030 con 0x7fc3c4073b70 2024-04-17T19:46:52.896 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:52.902+0000 7fc3be000640 1 -- 172.21.15.44:0/2272811881 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3b80072f0 con 0x7fc3c4073b70 2024-04-17T19:46:52.896 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:52.902+0000 7fc3cb200640 1 -- 172.21.15.44:0/2272811881 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc3c40c47a0 con 0x7fc3c4073b70 2024-04-17T19:46:52.896 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:52.906+0000 7fc3cb200640 1 -- 172.21.15.44:0/2272811881 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc3c404fea0 con 0x7fc3c4073b70 2024-04-17T19:46:52.896 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:52.906+0000 7fc3be000640 1 -- 172.21.15.44:0/2272811881 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fc3b801a070 con 0x7fc3c4073b70 2024-04-17T19:46:52.897 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:52.906+0000 7fc3be000640 1 --2- 172.21.15.44:0/2272811881 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7fc3a80683b0 0x7fc3a806a8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:46:52.897 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:52.906+0000 7fc3be000640 1 -- 172.21.15.44:0/2272811881 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 4857+0+0 (secure 0 0 0) 0x7fc3b80859d0 con 0x7fc3c4073b70 2024-04-17T19:46:52.897 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:52.906+0000 7fc3c9400640 1 --2- 172.21.15.44:0/2272811881 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7fc3a80683b0 0x7fc3a806a8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:46:52.898 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:52.910+0000 7fc3c9400640 1 --2- 172.21.15.44:0/2272811881 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7fc3a80683b0 0x7fc3a806a8c0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fc3b40b2000 tx=0x7fc3b4008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:46:52.901 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:52.910+0000 7fc3be000640 1 -- 172.21.15.44:0/2272811881 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fc3b80562d0 con 0x7fc3c4073b70 2024-04-17T19:46:53.067 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:53.078+0000 7fc3cb200640 1 -- 172.21.15.44:0/2272811881 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fc3c40c5ef0 con 0x7fc3c4073b70 2024-04-17T19:46:53.068 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:53.078+0000 7fc3be000640 1 -- 172.21.15.44:0/2272811881 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v17) ==== 74+0+12848 (secure 0 0 0) 0x7fc3b8055bd0 con 0x7fc3c4073b70 2024-04-17T19:46:53.068 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-04-17T19:46:53.068 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":17,"fsid":"703f77ca-79c6-4a66-b576-62c526cb1021","created":"2024-04-17T19:46:30.831994+0000","modified":"2024-04-17T19:46:43.993068+0000","last_up_change":"2024-04-17T19:46:41.988197+0000","last_in_change":"2024-04-17T19:46:33.407430+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-17T19:46:41.940380+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"30520dc6-eea6-43d4-ab60-3ca9e92329dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6800","nonce":1018735925},{"type":"v1","addr":"172.21.15.44:6801","nonce":1018735925}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6802","nonce":1018735925},{"type":"v1","addr":"172.21.15.44:6803","nonce":1018735925}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6806","nonce":1018735925},{"type":"v1","addr":"172.21.15.44:6807","nonce":1018735925}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6804","nonce":1018735925},{"type":"v1","addr":"172.21.15.44:6805","nonce":1018735925}]},"public_addr":"172.21.15.44:6801/1018735925","cluster_addr":"172.21.15.44:6803/1018735925","heartbeat_back_addr":"172.21.15.44:6807/1018735925","heartbeat_front_addr":"172.21.15.44:6805/1018735925","state":["exists","up"]},{"osd":1,"uuid":"079bd511-b6ce-449b-8f11-17b311b12f7c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6817","nonce":1452577434},{"type":"v1","addr":"172.21.15.44:6820","nonce":1452577434}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6823","nonce":1452577434},{"type":"v1","addr":"172.21.15.44:6825","nonce":1452577434}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6830","nonce":1452577434},{"type":"v1","addr":"172.21.15.44:6831","nonce":1452577434}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6828","nonce":1452577434},{"type":"v1","addr":"172.21.15.44:6829","nonce":1452577434}]},"public_addr":"172.21.15.44:6820/1452577434","cluster_addr":"172.21.15.44:6825/1452577434","heartbeat_back_addr":"172.21.15.44:6831/1452577434","heartbeat_front_addr":"172.21.15.44:6829/1452577434","state":["exists","up"]},{"osd":2,"uuid":"34f0b9ab-b1d2-4ee9-841c-f15afbb6bec5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6816","nonce":1160071918},{"type":"v1","addr":"172.21.15.44:6818","nonce":1160071918}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6819","nonce":1160071918},{"type":"v1","addr":"172.21.15.44:6821","nonce":1160071918}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6826","nonce":1160071918},{"type":"v1","addr":"172.21.15.44:6827","nonce":1160071918}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6822","nonce":1160071918},{"type":"v1","addr":"172.21.15.44:6824","nonce":1160071918}]},"public_addr":"172.21.15.44:6818/1160071918","cluster_addr":"172.21.15.44:6821/1160071918","heartbeat_back_addr":"172.21.15.44:6827/1160071918","heartbeat_front_addr":"172.21.15.44:6824/1160071918","state":["exists","up"]},{"osd":3,"uuid":"4740032d-fe34-4b1b-bb85-f430896fc3c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6808","nonce":4236454921},{"type":"v1","addr":"172.21.15.44:6809","nonce":4236454921}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6810","nonce":4236454921},{"type":"v1","addr":"172.21.15.44:6811","nonce":4236454921}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6814","nonce":4236454921},{"type":"v1","addr":"172.21.15.44:6815","nonce":4236454921}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6812","nonce":4236454921},{"type":"v1","addr":"172.21.15.44:6813","nonce":4236454921}]},"public_addr":"172.21.15.44:6809/4236454921","cluster_addr":"172.21.15.44:6811/4236454921","heartbeat_back_addr":"172.21.15.44:6815/4236454921","heartbeat_front_addr":"172.21.15.44:6813/4236454921","state":["exists","up"]},{"osd":4,"uuid":"7dbedb00-302d-4d52-810c-e18839254da1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6800","nonce":2293251376},{"type":"v1","addr":"172.21.15.62:6801","nonce":2293251376}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6802","nonce":2293251376},{"type":"v1","addr":"172.21.15.62:6803","nonce":2293251376}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6806","nonce":2293251376},{"type":"v1","addr":"172.21.15.62:6807","nonce":2293251376}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6804","nonce":2293251376},{"type":"v1","addr":"172.21.15.62:6805","nonce":2293251376}]},"public_addr":"172.21.15.62:6801/2293251376","cluster_addr":"172.21.15.62:6803/2293251376","heartbeat_back_addr":"172.21.15.62:6807/2293251376","heartbeat_front_addr":"172.21.15.62:6805/2293251376","state":["exists","up"]},{"osd":5,"uuid":"38c1e8d9-393d-4f33-a97a-3295cf5c5b07","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6808","nonce":1551020300},{"type":"v1","addr":"172.21.15.62:6809","nonce":1551020300}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6810","nonce":1551020300},{"type":"v1","addr":"172.21.15.62:6811","nonce":1551020300}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6814","nonce":1551020300},{"type":"v1","addr":"172.21.15.62:6815","nonce":1551020300}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6812","nonce":1551020300},{"type":"v1","addr":"172.21.15.62:6813","nonce":1551020300}]},"public_addr":"172.21.15.62:6809/1551020300","cluster_addr":"172.21.15.62:6811/1551020300","heartbeat_back_addr":"172.21.15.62:6815/1551020300","heartbeat_front_addr":"172.21.15.62:6813/1551020300","state":["exists","up"]},{"osd":6,"uuid":"f6ff81c6-f14d-4477-88e3-9116cc5a2992","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6824","nonce":2602310256},{"type":"v1","addr":"172.21.15.62:6825","nonce":2602310256}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6826","nonce":2602310256},{"type":"v1","addr":"172.21.15.62:6827","nonce":2602310256}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6830","nonce":2602310256},{"type":"v1","addr":"172.21.15.62:6831","nonce":2602310256}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6828","nonce":2602310256},{"type":"v1","addr":"172.21.15.62:6829","nonce":2602310256}]},"public_addr":"172.21.15.62:6825/2602310256","cluster_addr":"172.21.15.62:6827/2602310256","heartbeat_back_addr":"172.21.15.62:6831/2602310256","heartbeat_front_addr":"172.21.15.62:6829/2602310256","state":["exists","up"]},{"osd":7,"uuid":"ce395bc3-bcb5-4b94-a523-5bb9df491eca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6816","nonce":2912738359},{"type":"v1","addr":"172.21.15.62:6817","nonce":2912738359}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6818","nonce":2912738359},{"type":"v1","addr":"172.21.15.62:6819","nonce":2912738359}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6822","nonce":2912738359},{"type":"v1","addr":"172.21.15.62:6823","nonce":2912738359}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6820","nonce":2912738359},{"type":"v1","addr":"172.21.15.62:6821","nonce":2912738359}]},"public_addr":"172.21.15.62:6817/2912738359","cluster_addr":"172.21.15.62:6819/2912738359","heartbeat_back_addr":"172.21.15.62:6823/2912738359","heartbeat_front_addr":"172.21.15.62:6821/2912738359","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T19:46:39.302883+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T19:46:39.177705+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T19:46:39.188894+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T19:46:39.313009+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T19:46:38.870508+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T19:46:38.790900+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T19:46:38.979163+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T19:46:38.992348+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-17T19:46:53.070 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:53.078+0000 7fc3cb200640 1 -- 172.21.15.44:0/2272811881 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7fc3a80683b0 msgr2=0x7fc3a806a8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:46:53.071 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:53.078+0000 7fc3cb200640 1 --2- 172.21.15.44:0/2272811881 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7fc3a80683b0 0x7fc3a806a8c0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fc3b40b2000 tx=0x7fc3b4008040 comp rx=0 tx=0).stop 2024-04-17T19:46:53.071 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:53.082+0000 7fc3cb200640 1 -- 172.21.15.44:0/2272811881 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc3c4073b70 msgr2=0x7fc3c41f2360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:46:53.071 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:53.082+0000 7fc3cb200640 1 --2- 172.21.15.44:0/2272811881 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc3c4073b70 0x7fc3c41f2360 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fc3b800c370 tx=0x7fc3b800c830 comp rx=0 tx=0).stop 2024-04-17T19:46:53.071 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:53.082+0000 7fc3cb200640 1 -- 172.21.15.44:0/2272811881 shutdown_connections 2024-04-17T19:46:53.071 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:53.082+0000 7fc3cb200640 1 --2- 172.21.15.44:0/2272811881 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7fc3a80683b0 0x7fc3a806a8c0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:46:53.071 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:53.082+0000 7fc3cb200640 1 --2- 172.21.15.44:0/2272811881 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fc3c415a1b0 0x7fc3c40cc6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:46:53.071 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:53.082+0000 7fc3cb200640 1 --2- 172.21.15.44:0/2272811881 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc3c4073f80 0x7fc3c414e5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:46:53.071 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:53.082+0000 7fc3cb200640 1 --2- 172.21.15.44:0/2272811881 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc3c4073b70 0x7fc3c41f2360 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:46:53.071 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:53.082+0000 7fc3cb200640 1 -- 172.21.15.44:0/2272811881 >> 172.21.15.44:0/2272811881 conn(0x7fc3c4071080 msgr2=0x7fc3c4150ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:46:53.071 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:53.082+0000 7fc3cb200640 1 -- 172.21.15.44:0/2272811881 shutdown_connections 2024-04-17T19:46:53.071 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:53.082+0000 7fc3cb200640 1 -- 172.21.15.44:0/2272811881 wait complete. 2024-04-17T19:46:53.090 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-17T19:46:41.940380+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-17T19:46:53.090 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-17T19:46:53.245 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:53.254+0000 7f63fbe00640 1 Processor -- start 2024-04-17T19:46:53.246 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:53.254+0000 7f63fbe00640 1 -- start start 2024-04-17T19:46:53.247 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:53.258+0000 7f63fbe00640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f63fc06f5d0 0x7f63fc155e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:46:53.247 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:53.258+0000 7f63fbe00640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f63fc06bd80 0x7f63fc06c190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:46:53.248 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:53.258+0000 7f63fbe00640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f63fc0c5000 con 0x7f63fc0c8370 2024-04-17T19:46:53.248 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:53.258+0000 7f63fbe00640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 -- 0x7f63fc0c6610 con 0x7f63fc06f5d0 2024-04-17T19:46:53.248 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:53.258+0000 7f63fbe00640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 -- 0x7f63fc06ee20 con 0x7f63fc06bd80 2024-04-17T19:46:53.248 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:53.258+0000 7f63faa00640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f63fc06f5d0 0x7f63fc155e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:46:53.248 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:53.258+0000 7f63f3e00640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f63fc0c8370 0x7f63fc15f010 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:52828/0 (socket says 172.21.15.44:52828) 2024-04-17T19:46:53.248 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:53.258+0000 7f63f3e00640 1 -- 172.21.15.44:0/4114736881 learned_addr learned my addr 172.21.15.44:0/4114736881 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-04-17T19:46:53.248 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:53.258+0000 7f63fb400640 1 --2- 172.21.15.44:0/4114736881 >> v2:172.21.15.62:3300/0 conn(0x7f63fc06bd80 0x7f63fc06c190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:46:53.248 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:53.258+0000 7f63fa000640 1 -- 172.21.15.44:0/4114736881 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 182194865 0 0) 0x7f63e4001120 con 0x7f63fc0c8370 2024-04-17T19:46:53.249 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:53.258+0000 7f63faa00640 1 -- 172.21.15.44:0/4114736881 >> v2:172.21.15.62:3300/0 conn(0x7f63fc06bd80 msgr2=0x7f63fc06c190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T19:46:53.249 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:53.258+0000 7f63faa00640 1 --2- 172.21.15.44:0/4114736881 >> v2:172.21.15.62:3300/0 conn(0x7f63fc06bd80 0x7f63fc06c190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:46:53.249 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:53.258+0000 7f63faa00640 1 -- 172.21.15.44:0/4114736881 >> v1:172.21.15.44:6789/0 conn(0x7f63fc0c8370 legacy=0x7f63fc15f010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:46:53.249 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:53.258+0000 7f63faa00640 1 -- 172.21.15.44:0/4114736881 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f63fc0c8a00 con 0x7f63fc06f5d0 2024-04-17T19:46:53.251 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:53.262+0000 7f63faa00640 1 --2- 172.21.15.44:0/4114736881 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f63fc06f5d0 0x7f63fc155e50 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f63fc0cd960 tx=0x7f63ec01c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cc52fd410798d9dd server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:46:53.251 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:53.262+0000 7f63fa000640 1 -- 172.21.15.44:0/4114736881 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63ec0b0070 con 0x7f63fc06f5d0 2024-04-17T19:46:53.251 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:53.262+0000 7f63fa000640 1 -- 172.21.15.44:0/4114736881 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f63ec0ab600 con 0x7f63fc06f5d0 2024-04-17T19:46:53.251 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:53.262+0000 7f63fa000640 1 -- 172.21.15.44:0/4114736881 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63ec0ab9d0 con 0x7f63fc06f5d0 2024-04-17T19:46:53.252 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:53.262+0000 7f63fbe00640 1 -- 172.21.15.44:0/4114736881 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f63fc06f5d0 msgr2=0x7f63fc155e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:46:53.252 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:53.262+0000 7f63fbe00640 1 --2- 172.21.15.44:0/4114736881 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f63fc06f5d0 0x7f63fc155e50 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f63fc0cd960 tx=0x7f63ec01c480 comp rx=0 tx=0).stop 2024-04-17T19:46:53.252 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:53.262+0000 7f63fbe00640 1 -- 172.21.15.44:0/4114736881 shutdown_connections 2024-04-17T19:46:53.252 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:53.262+0000 7f63fbe00640 1 --2- 172.21.15.44:0/4114736881 >> v2:172.21.15.62:3300/0 conn(0x7f63fc06bd80 0x7f63fc06c190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:46:53.252 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:53.262+0000 7f63fbe00640 1 --2- 172.21.15.44:0/4114736881 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f63fc06f5d0 0x7f63fc155e50 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:46:53.252 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:53.262+0000 7f63fbe00640 1 -- 172.21.15.44:0/4114736881 >> 172.21.15.44:0/4114736881 conn(0x7f63fc0cd9d0 msgr2=0x7f63fc0cdde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:46:53.252 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:53.262+0000 7f63fbe00640 1 -- 172.21.15.44:0/4114736881 shutdown_connections 2024-04-17T19:46:53.252 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:53.262+0000 7f63fbe00640 1 -- 172.21.15.44:0/4114736881 wait complete. 2024-04-17T19:46:53.254 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:53.266+0000 7f63fbe00640 1 Processor -- start 2024-04-17T19:46:53.254 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:53.266+0000 7f63fbe00640 1 -- start start 2024-04-17T19:46:53.257 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:53.266+0000 7f63fbe00640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f63fc06bd80 0x7f63fc1457a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:46:53.257 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:53.266+0000 7f63fbe00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f63fc06f5d0 0x7f63fc1f5a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:46:53.257 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:53.266+0000 7f63fbe00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f63fc0c8370 0x7f63fc14b600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:46:53.257 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:53.266+0000 7f63fbe00640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f63fc168ce0 con 0x7f63fc06f5d0 2024-04-17T19:46:53.257 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:53.266+0000 7f63fbe00640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f63fc168b60 con 0x7f63fc0c8370 2024-04-17T19:46:53.257 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:53.266+0000 7f63fbe00640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7f63fc168e60 con 0x7f63fc06bd80 2024-04-17T19:46:53.257 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:53.266+0000 7f63f3e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f63fc06f5d0 0x7f63fc1f5a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:46:53.258 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:53.266+0000 7f63f3e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f63fc06f5d0 0x7f63fc1f5a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:34028/0 (socket says 172.21.15.44:34028) 2024-04-17T19:46:53.258 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:53.266+0000 7f63f3e00640 1 -- 172.21.15.44:0/1489000331 learned_addr learned my addr 172.21.15.44:0/1489000331 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-04-17T19:46:53.258 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:53.266+0000 7f63faa00640 1 --2- 172.21.15.44:0/1489000331 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f63fc06bd80 0x7f63fc1457a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:46:53.258 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:53.266+0000 7f63fb400640 1 --2- 172.21.15.44:0/1489000331 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f63fc0c8370 0x7f63fc14b600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:46:53.258 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:53.266+0000 7f63f3e00640 1 -- 172.21.15.44:0/1489000331 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f63fc06bd80 msgr2=0x7f63fc1457a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:46:53.258 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:53.266+0000 7f63f3e00640 1 --2- 172.21.15.44:0/1489000331 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f63fc06bd80 0x7f63fc1457a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:46:53.258 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:53.266+0000 7f63f3e00640 1 -- 172.21.15.44:0/1489000331 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f63fc0c8370 msgr2=0x7f63fc14b600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:46:53.258 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:53.266+0000 7f63f3e00640 1 --2- 172.21.15.44:0/1489000331 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f63fc0c8370 0x7f63fc14b600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:46:53.258 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:53.266+0000 7f63f3e00640 1 -- 172.21.15.44:0/1489000331 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f63fc14fb30 con 0x7f63fc06f5d0 2024-04-17T19:46:53.258 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:53.266+0000 7f63faa00640 1 --2- 172.21.15.44:0/1489000331 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f63fc06bd80 0x7f63fc1457a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-17T19:46:53.258 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:53.266+0000 7f63f3e00640 1 --2- 172.21.15.44:0/1489000331 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f63fc06f5d0 0x7f63fc1f5a60 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f63e400c480 tx=0x7f63e400c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:46:53.258 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:53.266+0000 7f63f2a00640 1 -- 172.21.15.44:0/1489000331 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63e4018070 con 0x7f63fc06f5d0 2024-04-17T19:46:53.258 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:53.266+0000 7f63f2a00640 1 -- 172.21.15.44:0/1489000331 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f63e4007500 con 0x7f63fc06f5d0 2024-04-17T19:46:53.259 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:53.266+0000 7f63fbe00640 1 -- 172.21.15.44:0/1489000331 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f63fc14fe10 con 0x7f63fc06f5d0 2024-04-17T19:46:53.259 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:53.266+0000 7f63f2a00640 1 -- 172.21.15.44:0/1489000331 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63e4004a30 con 0x7f63fc06f5d0 2024-04-17T19:46:53.259 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:53.266+0000 7f63fbe00640 1 -- 172.21.15.44:0/1489000331 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f63fc14ae00 con 0x7f63fc06f5d0 2024-04-17T19:46:53.259 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:53.266+0000 7f63fbe00640 1 -- 172.21.15.44:0/1489000331 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f63fc04fea0 con 0x7f63fc06f5d0 2024-04-17T19:46:53.259 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:53.270+0000 7f63f2a00640 1 -- 172.21.15.44:0/1489000331 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f63e401b070 con 0x7f63fc06f5d0 2024-04-17T19:46:53.260 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:53.270+0000 7f63f2a00640 1 --2- 172.21.15.44:0/1489000331 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f63d80683b0 0x7f63d806a8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:46:53.260 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:53.270+0000 7f63f2a00640 1 -- 172.21.15.44:0/1489000331 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 4857+0+0 (secure 0 0 0) 0x7f63e4085a10 con 0x7f63fc06f5d0 2024-04-17T19:46:53.260 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:53.270+0000 7f63faa00640 1 --2- 172.21.15.44:0/1489000331 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f63d80683b0 0x7f63d806a8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:46:53.261 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:53.270+0000 7f63faa00640 1 --2- 172.21.15.44:0/1489000331 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f63d80683b0 0x7f63d806a8c0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f63ec0ad000 tx=0x7f63ec0a6000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:46:53.264 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:53.274+0000 7f63f2a00640 1 -- 172.21.15.44:0/1489000331 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f63fc0c5000 con 0x7f63fc06f5d0 2024-04-17T19:46:53.431 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:53.442+0000 7f63fbe00640 1 -- 172.21.15.44:0/1489000331 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f63fc06f3b0 con 0x7f63fc06f5d0 2024-04-17T19:46:53.432 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:53.442+0000 7f63f2a00640 1 -- 172.21.15.44:0/1489000331 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v17) ==== 93+0+10 (secure 0 0 0) 0x7f63e4056280 con 0x7f63fc06f5d0 2024-04-17T19:46:53.432 INFO:teuthology.orchestra.run.smithi044.stdout:pg_num: 1 2024-04-17T19:46:53.434 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:53.442+0000 7f63fbe00640 1 -- 172.21.15.44:0/1489000331 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f63d80683b0 msgr2=0x7f63d806a8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:46:53.434 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:53.442+0000 7f63fbe00640 1 --2- 172.21.15.44:0/1489000331 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f63d80683b0 0x7f63d806a8c0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f63ec0ad000 tx=0x7f63ec0a6000 comp rx=0 tx=0).stop 2024-04-17T19:46:53.434 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:53.442+0000 7f63fbe00640 1 -- 172.21.15.44:0/1489000331 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f63fc06f5d0 msgr2=0x7f63fc1f5a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:46:53.434 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:53.442+0000 7f63fbe00640 1 --2- 172.21.15.44:0/1489000331 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f63fc06f5d0 0x7f63fc1f5a60 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f63e400c480 tx=0x7f63e400c940 comp rx=0 tx=0).stop 2024-04-17T19:46:53.434 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:53.442+0000 7f63fbe00640 1 -- 172.21.15.44:0/1489000331 shutdown_connections 2024-04-17T19:46:53.435 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:53.442+0000 7f63fbe00640 1 --2- 172.21.15.44:0/1489000331 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f63d80683b0 0x7f63d806a8c0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:46:53.435 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:53.442+0000 7f63fbe00640 1 --2- 172.21.15.44:0/1489000331 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f63fc0c8370 0x7f63fc14b600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:46:53.435 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:53.442+0000 7f63fbe00640 1 --2- 172.21.15.44:0/1489000331 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f63fc06f5d0 0x7f63fc1f5a60 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:46:53.435 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:53.442+0000 7f63fbe00640 1 --2- 172.21.15.44:0/1489000331 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f63fc06bd80 0x7f63fc1457a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:46:53.435 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:53.442+0000 7f63fbe00640 1 -- 172.21.15.44:0/1489000331 >> 172.21.15.44:0/1489000331 conn(0x7f63fc0cd9d0 msgr2=0x7f63fc1554b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:46:53.435 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:53.446+0000 7f63fbe00640 1 -- 172.21.15.44:0/1489000331 shutdown_connections 2024-04-17T19:46:53.435 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:53.446+0000 7f63fbe00640 1 -- 172.21.15.44:0/1489000331 wait complete. 2024-04-17T19:46:53.454 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-04-17T19:46:53.605 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:53.614+0000 7f2eaf200640 1 Processor -- start 2024-04-17T19:46:53.605 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:53.614+0000 7f2eaf200640 1 -- start start 2024-04-17T19:46:53.607 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:53.618+0000 7f2eaf200640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f2ea80c66d0 0x7f2ea81536a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:46:53.608 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:53.618+0000 7f2eaf200640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f2ea8153be0 0x7f2ea8073820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:46:53.608 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:53.618+0000 7f2eaf200640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2ea8153ff0 con 0x7f2ea8073d60 2024-04-17T19:46:53.608 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:53.618+0000 7f2eaf200640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 -- 0x7f2ea8159ad0 con 0x7f2ea80c66d0 2024-04-17T19:46:53.608 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:53.618+0000 7f2eaf200640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7f2ea8159db0 con 0x7f2ea8153be0 2024-04-17T19:46:53.608 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:53.618+0000 7f2ea7e00640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f2ea80c66d0 0x7f2ea81536a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:46:53.608 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:53.618+0000 7f2ea7e00640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f2ea80c66d0 0x7f2ea81536a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:34036/0 (socket says 172.21.15.44:34036) 2024-04-17T19:46:53.608 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:53.618+0000 7f2ea7e00640 1 -- 172.21.15.44:0/3742455031 learned_addr learned my addr 172.21.15.44:0/3742455031 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-04-17T19:46:53.608 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:53.618+0000 7f2e9fe00640 1 --2- 172.21.15.44:0/3742455031 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f2ea8153be0 0x7f2ea8073820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:46:53.608 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:53.618+0000 7f2ea7e00640 1 -- 172.21.15.44:0/3742455031 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f2ea8153be0 msgr2=0x7f2ea8073820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T19:46:53.608 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:53.618+0000 7f2ea7e00640 1 --2- 172.21.15.44:0/3742455031 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f2ea8153be0 0x7f2ea8073820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:46:53.608 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:53.618+0000 7f2ea7e00640 1 -- 172.21.15.44:0/3742455031 >> v1:172.21.15.44:6789/0 conn(0x7f2ea8073d60 legacy=0x7f2ea80725b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:46:53.608 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:53.618+0000 7f2ea7e00640 1 -- 172.21.15.44:0/3742455031 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2ea815a090 con 0x7f2ea80c66d0 2024-04-17T19:46:53.611 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:53.622+0000 7f2ea7e00640 1 --2- 172.21.15.44:0/3742455031 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2ea80c66d0 0x7f2ea81536a0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f2e98009870 tx=0x7f2e9801c560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aade5205a83f428c server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:46:53.611 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:53.622+0000 7f2ea7400640 1 -- 172.21.15.44:0/3742455031 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e980b2070 con 0x7f2ea80c66d0 2024-04-17T19:46:53.611 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:53.622+0000 7f2ea7400640 1 -- 172.21.15.44:0/3742455031 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2e980a9070 con 0x7f2ea80c66d0 2024-04-17T19:46:53.611 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:53.622+0000 7f2ea7400640 1 -- 172.21.15.44:0/3742455031 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e980ad880 con 0x7f2ea80c66d0 2024-04-17T19:46:53.612 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:53.622+0000 7f2eaf200640 1 -- 172.21.15.44:0/3742455031 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2ea80c66d0 msgr2=0x7f2ea81536a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:46:53.612 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:53.622+0000 7f2eaf200640 1 --2- 172.21.15.44:0/3742455031 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2ea80c66d0 0x7f2ea81536a0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f2e98009870 tx=0x7f2e9801c560 comp rx=0 tx=0).stop 2024-04-17T19:46:53.612 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:53.622+0000 7f2eaf200640 1 -- 172.21.15.44:0/3742455031 shutdown_connections 2024-04-17T19:46:53.612 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:53.622+0000 7f2eaf200640 1 --2- 172.21.15.44:0/3742455031 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f2ea8153be0 0x7f2ea8073820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:46:53.612 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:53.622+0000 7f2eaf200640 1 --2- 172.21.15.44:0/3742455031 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2ea80c66d0 0x7f2ea81536a0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:46:53.612 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:53.622+0000 7f2eaf200640 1 -- 172.21.15.44:0/3742455031 >> 172.21.15.44:0/3742455031 conn(0x7f2ea806c380 msgr2=0x7f2ea8070080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:46:53.612 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:53.622+0000 7f2eaf200640 1 -- 172.21.15.44:0/3742455031 shutdown_connections 2024-04-17T19:46:53.612 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:53.622+0000 7f2eaf200640 1 -- 172.21.15.44:0/3742455031 wait complete. 2024-04-17T19:46:53.614 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:53.622+0000 7f2eaf200640 1 Processor -- start 2024-04-17T19:46:53.614 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:53.622+0000 7f2eaf200640 1 -- start start 2024-04-17T19:46:53.616 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:53.626+0000 7f2eaf200640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f2ea8073d60 0x7f2ea8154ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:46:53.616 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:53.626+0000 7f2eaf200640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2ea80c66d0 0x7f2ea8150260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:46:53.617 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:53.626+0000 7f2eaf200640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2ea8153be0 0x7f2ea81f85f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:46:53.617 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:53.626+0000 7f2eaf200640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f2ea80c8890 con 0x7f2ea8153be0 2024-04-17T19:46:53.617 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:53.626+0000 7f2eaf200640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f2ea80c8710 con 0x7f2ea80c66d0 2024-04-17T19:46:53.617 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:53.626+0000 7f2eaf200640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7f2ea8166a80 con 0x7f2ea8073d60 2024-04-17T19:46:53.617 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:53.626+0000 7f2ead200640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2ea8153be0 0x7f2ea81f85f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:46:53.617 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:53.626+0000 7f2ead200640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2ea8153be0 0x7f2ea81f85f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:34052/0 (socket says 172.21.15.44:34052) 2024-04-17T19:46:53.617 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:53.626+0000 7f2ead200640 1 -- 172.21.15.44:0/2458234227 learned_addr learned my addr 172.21.15.44:0/2458234227 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-04-17T19:46:53.617 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:53.626+0000 7f2e9fe00640 1 --2- 172.21.15.44:0/2458234227 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2ea80c66d0 0x7f2ea8150260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:46:53.617 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:53.626+0000 7f2ea7e00640 1 --2- 172.21.15.44:0/2458234227 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f2ea8073d60 0x7f2ea8154ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:46:53.617 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:53.626+0000 7f2ead200640 1 -- 172.21.15.44:0/2458234227 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f2ea8073d60 msgr2=0x7f2ea8154ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:46:53.617 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:53.626+0000 7f2ead200640 1 --2- 172.21.15.44:0/2458234227 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f2ea8073d60 0x7f2ea8154ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:46:53.617 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:53.626+0000 7f2ead200640 1 -- 172.21.15.44:0/2458234227 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2ea80c66d0 msgr2=0x7f2ea8150260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:46:53.617 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:53.626+0000 7f2ead200640 1 --2- 172.21.15.44:0/2458234227 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2ea80c66d0 0x7f2ea8150260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:46:53.618 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:53.626+0000 7f2ead200640 1 -- 172.21.15.44:0/2458234227 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2ea8155020 con 0x7f2ea8153be0 2024-04-17T19:46:53.618 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:53.626+0000 7f2ead200640 1 --2- 172.21.15.44:0/2458234227 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2ea8153be0 0x7f2ea81f85f0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f2ea000c760 tx=0x7f2ea000cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:46:53.618 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:53.626+0000 7f2ea4c00640 1 -- 172.21.15.44:0/2458234227 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ea0003b80 con 0x7f2ea8153be0 2024-04-17T19:46:53.618 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:53.626+0000 7f2ea4c00640 1 -- 172.21.15.44:0/2458234227 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2ea0003d20 con 0x7f2ea8153be0 2024-04-17T19:46:53.618 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:53.626+0000 7f2ea4c00640 1 -- 172.21.15.44:0/2458234227 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ea000aa90 con 0x7f2ea8153be0 2024-04-17T19:46:53.618 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:53.626+0000 7f2eaf200640 1 -- 172.21.15.44:0/2458234227 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2ea81f92b0 con 0x7f2ea8153be0 2024-04-17T19:46:53.618 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:53.626+0000 7f2eaf200640 1 -- 172.21.15.44:0/2458234227 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2ea80c45b0 con 0x7f2ea8153be0 2024-04-17T19:46:53.618 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:53.626+0000 7f2eaf200640 1 -- 172.21.15.44:0/2458234227 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2ea804ff10 con 0x7f2ea8153be0 2024-04-17T19:46:53.619 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:53.630+0000 7f2ea4c00640 1 -- 172.21.15.44:0/2458234227 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f2ea000ac30 con 0x7f2ea8153be0 2024-04-17T19:46:53.620 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:53.630+0000 7f2ea4c00640 1 --2- 172.21.15.44:0/2458234227 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f2e84068380 0x7f2e8406a890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:46:53.620 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:53.630+0000 7f2ea4c00640 1 -- 172.21.15.44:0/2458234227 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 4857+0+0 (secure 0 0 0) 0x7f2ea0086400 con 0x7f2ea8153be0 2024-04-17T19:46:53.620 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:53.630+0000 7f2ea7e00640 1 --2- 172.21.15.44:0/2458234227 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f2e84068380 0x7f2e8406a890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:46:53.621 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:53.630+0000 7f2ea7e00640 1 --2- 172.21.15.44:0/2458234227 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f2e84068380 0x7f2e8406a890 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f2e980af000 tx=0x7f2e980a7000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:46:53.624 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:53.634+0000 7f2ea4c00640 1 -- 172.21.15.44:0/2458234227 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f2ea0056620 con 0x7f2ea8153be0 2024-04-17T19:46:53.700 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T19:46:53.703 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T19:46:53.792 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:53.802+0000 7f2eaf200640 1 -- 172.21.15.44:0/2458234227 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7f2ea8070910 con 0x7f2ea8153be0 2024-04-17T19:46:53.793 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:53.802+0000 7f2ea4c00640 1 -- 172.21.15.44:0/2458234227 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v17) ==== 84+0+65 (secure 0 0 0) 0x7f2ea005a920 con 0x7f2ea8153be0 2024-04-17T19:46:53.793 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-04-17T19:46:53.793 INFO:teuthology.orchestra.run.smithi044.stdout:[ 2024-04-17T19:46:53.793 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T19:46:53.793 INFO:teuthology.orchestra.run.smithi044.stdout: "poolnum": 1, 2024-04-17T19:46:53.793 INFO:teuthology.orchestra.run.smithi044.stdout: "poolname": ".mgr" 2024-04-17T19:46:53.794 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T19:46:53.794 INFO:teuthology.orchestra.run.smithi044.stdout:] 2024-04-17T19:46:53.795 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:53.806+0000 7f2eaf200640 1 -- 172.21.15.44:0/2458234227 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f2e84068380 msgr2=0x7f2e8406a890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:46:53.796 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:53.806+0000 7f2eaf200640 1 --2- 172.21.15.44:0/2458234227 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f2e84068380 0x7f2e8406a890 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f2e980af000 tx=0x7f2e980a7000 comp rx=0 tx=0).stop 2024-04-17T19:46:53.796 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:53.806+0000 7f2eaf200640 1 -- 172.21.15.44:0/2458234227 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2ea8153be0 msgr2=0x7f2ea81f85f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:46:53.796 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:53.806+0000 7f2eaf200640 1 --2- 172.21.15.44:0/2458234227 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2ea8153be0 0x7f2ea81f85f0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f2ea000c760 tx=0x7f2ea000cc20 comp rx=0 tx=0).stop 2024-04-17T19:46:53.796 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:53.806+0000 7f2eaf200640 1 -- 172.21.15.44:0/2458234227 shutdown_connections 2024-04-17T19:46:53.796 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:53.806+0000 7f2eaf200640 1 --2- 172.21.15.44:0/2458234227 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f2e84068380 0x7f2e8406a890 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:46:53.796 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:53.806+0000 7f2eaf200640 1 --2- 172.21.15.44:0/2458234227 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2ea8153be0 0x7f2ea81f85f0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:46:53.796 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:53.806+0000 7f2eaf200640 1 --2- 172.21.15.44:0/2458234227 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2ea80c66d0 0x7f2ea8150260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:46:53.796 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:53.806+0000 7f2eaf200640 1 --2- 172.21.15.44:0/2458234227 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f2ea8073d60 0x7f2ea8154ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:46:53.796 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:53.806+0000 7f2eaf200640 1 -- 172.21.15.44:0/2458234227 >> 172.21.15.44:0/2458234227 conn(0x7f2ea806c380 msgr2=0x7f2ea8152f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:46:53.796 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:53.806+0000 7f2eaf200640 1 -- 172.21.15.44:0/2458234227 shutdown_connections 2024-04-17T19:46:53.796 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:53.806+0000 7f2eaf200640 1 -- 172.21.15.44:0/2458234227 wait complete. 2024-04-17T19:46:53.814 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-04-17T19:46:53.815 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-04-17T19:46:54.014 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:54.022+0000 7f6acd000640 1 Processor -- start 2024-04-17T19:46:54.014 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:54.022+0000 7f6acd000640 1 -- start start 2024-04-17T19:46:54.016 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:54.026+0000 7f6acd000640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f6ac8155f30 0x7f6ac80c48a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:46:54.016 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:54.026+0000 7f6acd000640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f6ac80c66c0 0x7f6ac80c6ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:46:54.016 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:54.026+0000 7f6acd000640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6ac80c9c40 con 0x7f6ac80c86c0 2024-04-17T19:46:54.016 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:54.026+0000 7f6acd000640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 -- 0x7f6ac806d750 con 0x7f6ac80c66c0 2024-04-17T19:46:54.016 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:54.026+0000 7f6acd000640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7f6ac80c83c0 con 0x7f6ac8155f30 2024-04-17T19:46:54.017 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:54.026+0000 7f6abd400640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f6ac80c66c0 0x7f6ac80c6ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:46:54.017 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:54.026+0000 7f6abd400640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f6ac80c66c0 0x7f6ac80c6ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:34054/0 (socket says 172.21.15.44:34054) 2024-04-17T19:46:54.017 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:54.026+0000 7f6abd400640 1 -- 172.21.15.44:0/4279055630 learned_addr learned my addr 172.21.15.44:0/4279055630 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-04-17T19:46:54.017 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:54.026+0000 7f6ac5e00640 1 --2- 172.21.15.44:0/4279055630 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f6ac8155f30 0x7f6ac80c48a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:46:54.017 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:54.026+0000 7f6abd400640 1 -- 172.21.15.44:0/4279055630 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f6ac8155f30 msgr2=0x7f6ac80c48a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T19:46:54.017 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:54.026+0000 7f6abd400640 1 --2- 172.21.15.44:0/4279055630 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f6ac8155f30 0x7f6ac80c48a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:46:54.017 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:54.026+0000 7f6abd400640 1 -- 172.21.15.44:0/4279055630 >> v1:172.21.15.62:6789/0 conn(0x7f6ac80c86c0 legacy=0x7f6ac815bb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:46:54.017 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:54.026+0000 7f6abd400640 1 -- 172.21.15.44:0/4279055630 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6ac80c9350 con 0x7f6ac80c66c0 2024-04-17T19:46:54.019 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:54.030+0000 7f6abd400640 1 --2- 172.21.15.44:0/4279055630 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6ac80c66c0 0x7f6ac80c6ad0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f6ac80c9520 tx=0x7f6ab001c540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ae2883a7931784c0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:46:54.020 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:54.030+0000 7f6ac5400640 1 -- 172.21.15.44:0/4279055630 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ab00ab650 con 0x7f6ac80c66c0 2024-04-17T19:46:54.020 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:54.030+0000 7f6ac5400640 1 -- 172.21.15.44:0/4279055630 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6ab00b0070 con 0x7f6ac80c66c0 2024-04-17T19:46:54.020 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:54.030+0000 7f6ac5400640 1 -- 172.21.15.44:0/4279055630 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ab00aba10 con 0x7f6ac80c66c0 2024-04-17T19:46:54.022 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:54.030+0000 7f6acd000640 1 -- 172.21.15.44:0/4279055630 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6ac80c66c0 msgr2=0x7f6ac80c6ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:46:54.022 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:54.030+0000 7f6acd000640 1 --2- 172.21.15.44:0/4279055630 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6ac80c66c0 0x7f6ac80c6ad0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f6ac80c9520 tx=0x7f6ab001c540 comp rx=0 tx=0).stop 2024-04-17T19:46:54.022 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:54.030+0000 7f6acd000640 1 -- 172.21.15.44:0/4279055630 shutdown_connections 2024-04-17T19:46:54.022 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:54.030+0000 7f6acd000640 1 --2- 172.21.15.44:0/4279055630 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6ac80c66c0 0x7f6ac80c6ad0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:46:54.023 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:54.030+0000 7f6acd000640 1 --2- 172.21.15.44:0/4279055630 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f6ac8155f30 0x7f6ac80c48a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:46:54.023 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:54.030+0000 7f6acd000640 1 -- 172.21.15.44:0/4279055630 >> 172.21.15.44:0/4279055630 conn(0x7f6ac80708e0 msgr2=0x7f6ac8070cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:46:54.023 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:54.030+0000 7f6acd000640 1 -- 172.21.15.44:0/4279055630 shutdown_connections 2024-04-17T19:46:54.023 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:54.030+0000 7f6acd000640 1 -- 172.21.15.44:0/4279055630 wait complete. 2024-04-17T19:46:54.027 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:54.034+0000 7f6acd000640 1 Processor -- start 2024-04-17T19:46:54.027 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:54.034+0000 7f6acd000640 1 -- start start 2024-04-17T19:46:54.027 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:54.034+0000 7f6acd000640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6ac80c66c0 0x7f6ac814b590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:46:54.027 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:54.034+0000 7f6acd000640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6ac80c86c0 0x7f6ac8158af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:46:54.028 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:54.034+0000 7f6acd000640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f6ac8155f30 0x7f6ac815a9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:46:54.028 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:54.034+0000 7f6acd000640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f6ac80c8ee0 con 0x7f6ac80c86c0 2024-04-17T19:46:54.028 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:54.034+0000 7f6acd000640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f6ac80c7da0 con 0x7f6ac80c66c0 2024-04-17T19:46:54.028 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:54.034+0000 7f6acd000640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7f6ac80c4de0 con 0x7f6ac8155f30 2024-04-17T19:46:54.028 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:54.034+0000 7f6abd400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6ac80c86c0 0x7f6ac8158af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:46:54.028 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:54.034+0000 7f6abd400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6ac80c86c0 0x7f6ac8158af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:34062/0 (socket says 172.21.15.44:34062) 2024-04-17T19:46:54.028 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:54.034+0000 7f6abd400640 1 -- 172.21.15.44:0/3148106736 learned_addr learned my addr 172.21.15.44:0/3148106736 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-04-17T19:46:54.028 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:54.034+0000 7f6ac5e00640 1 --2- 172.21.15.44:0/3148106736 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6ac80c66c0 0x7f6ac814b590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:46:54.029 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:54.034+0000 7f6ac6800640 1 --2- 172.21.15.44:0/3148106736 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f6ac8155f30 0x7f6ac815a9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:46:54.029 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:54.034+0000 7f6abd400640 1 -- 172.21.15.44:0/3148106736 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f6ac8155f30 msgr2=0x7f6ac815a9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:46:54.029 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:54.034+0000 7f6abd400640 1 --2- 172.21.15.44:0/3148106736 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f6ac8155f30 0x7f6ac815a9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:46:54.029 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:54.034+0000 7f6abd400640 1 -- 172.21.15.44:0/3148106736 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6ac80c66c0 msgr2=0x7f6ac814b590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:46:54.029 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:54.034+0000 7f6abd400640 1 --2- 172.21.15.44:0/3148106736 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6ac80c66c0 0x7f6ac814b590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:46:54.029 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:54.034+0000 7f6abd400640 1 -- 172.21.15.44:0/3148106736 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6ac81f6790 con 0x7f6ac80c86c0 2024-04-17T19:46:54.029 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:54.034+0000 7f6ac5e00640 1 --2- 172.21.15.44:0/3148106736 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6ac80c66c0 0x7f6ac814b590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-17T19:46:54.030 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:54.034+0000 7f6ac6800640 1 --2- 172.21.15.44:0/3148106736 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f6ac8155f30 0x7f6ac815a9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-17T19:46:54.030 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:54.034+0000 7f6abd400640 1 --2- 172.21.15.44:0/3148106736 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6ac80c86c0 0x7f6ac8158af0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f6ab00ad040 tx=0x7f6ab001ad80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:46:54.030 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:54.034+0000 7f6abea00640 1 -- 172.21.15.44:0/3148106736 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ab00be5f0 con 0x7f6ac80c86c0 2024-04-17T19:46:54.030 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:54.034+0000 7f6abea00640 1 -- 172.21.15.44:0/3148106736 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6ab00be7b0 con 0x7f6ac80c86c0 2024-04-17T19:46:54.030 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:54.034+0000 7f6abea00640 1 -- 172.21.15.44:0/3148106736 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ab00beba0 con 0x7f6ac80c86c0 2024-04-17T19:46:54.030 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:54.034+0000 7f6acd000640 1 -- 172.21.15.44:0/3148106736 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6ac814bad0 con 0x7f6ac80c86c0 2024-04-17T19:46:54.030 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:54.034+0000 7f6acd000640 1 -- 172.21.15.44:0/3148106736 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6ac81518d0 con 0x7f6ac80c86c0 2024-04-17T19:46:54.030 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:54.038+0000 7f6acd000640 1 -- 172.21.15.44:0/3148106736 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6ac8075f10 con 0x7f6ac80c86c0 2024-04-17T19:46:54.032 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:54.038+0000 7f6abea00640 1 -- 172.21.15.44:0/3148106736 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f6ab00b43f0 con 0x7f6ac80c86c0 2024-04-17T19:46:54.032 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:54.038+0000 7f6abea00640 1 --2- 172.21.15.44:0/3148106736 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f6aa4068380 0x7f6aa406a890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:46:54.032 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:54.038+0000 7f6abea00640 1 -- 172.21.15.44:0/3148106736 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 4857+0+0 (secure 0 0 0) 0x7f6ab0120790 con 0x7f6ac80c86c0 2024-04-17T19:46:54.032 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:54.038+0000 7f6ac5e00640 1 --2- 172.21.15.44:0/3148106736 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f6aa4068380 0x7f6aa406a890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:46:54.032 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:54.038+0000 7f6ac5e00640 1 --2- 172.21.15.44:0/3148106736 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f6aa4068380 0x7f6aa406a890 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f6ab8009b10 tx=0x7f6ab8008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:46:54.032 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:54.042+0000 7f6abea00640 1 -- 172.21.15.44:0/3148106736 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f6ab0016130 con 0x7f6ac80c86c0 2024-04-17T19:46:54.198 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:54.206+0000 7f6acd000640 1 -- 172.21.15.44:0/3148106736 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7f6ac81f6520 con 0x7f6ac80c86c0 2024-04-17T19:46:54.633 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:54.642+0000 7f6abea00640 1 -- 172.21.15.44:0/3148106736 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v18) ==== 138+0+0 (secure 0 0 0) 0x7f6ab00f0b70 con 0x7f6ac80c86c0 2024-04-17T19:46:54.633 INFO:teuthology.orchestra.run.smithi044.stderr:pool 'cephfs_metadata' created 2024-04-17T19:46:54.636 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:54.646+0000 7f6acd000640 1 -- 172.21.15.44:0/3148106736 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f6aa4068380 msgr2=0x7f6aa406a890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:46:54.636 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:54.646+0000 7f6acd000640 1 --2- 172.21.15.44:0/3148106736 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f6aa4068380 0x7f6aa406a890 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f6ab8009b10 tx=0x7f6ab8008040 comp rx=0 tx=0).stop 2024-04-17T19:46:54.636 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:54.646+0000 7f6acd000640 1 -- 172.21.15.44:0/3148106736 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6ac80c86c0 msgr2=0x7f6ac8158af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:46:54.637 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:54.646+0000 7f6acd000640 1 --2- 172.21.15.44:0/3148106736 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6ac80c86c0 0x7f6ac8158af0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f6ab00ad040 tx=0x7f6ab001ad80 comp rx=0 tx=0).stop 2024-04-17T19:46:54.637 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:54.646+0000 7f6acd000640 1 -- 172.21.15.44:0/3148106736 shutdown_connections 2024-04-17T19:46:54.637 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:54.646+0000 7f6acd000640 1 --2- 172.21.15.44:0/3148106736 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f6aa4068380 0x7f6aa406a890 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:46:54.637 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:54.646+0000 7f6acd000640 1 --2- 172.21.15.44:0/3148106736 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f6ac8155f30 0x7f6ac815a9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:46:54.637 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:54.646+0000 7f6acd000640 1 --2- 172.21.15.44:0/3148106736 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6ac80c86c0 0x7f6ac8158af0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:46:54.637 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:54.646+0000 7f6acd000640 1 --2- 172.21.15.44:0/3148106736 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6ac80c66c0 0x7f6ac814b590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:46:54.637 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:54.646+0000 7f6acd000640 1 -- 172.21.15.44:0/3148106736 >> 172.21.15.44:0/3148106736 conn(0x7f6ac80708e0 msgr2=0x7f6ac80ccc70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:46:54.637 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:54.646+0000 7f6acd000640 1 -- 172.21.15.44:0/3148106736 shutdown_connections 2024-04-17T19:46:54.637 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:54.646+0000 7f6acd000640 1 -- 172.21.15.44:0/3148106736 wait complete. 2024-04-17T19:46:54.664 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.05 2024-04-17T19:46:54.823 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:54.834+0000 7f0ab2000640 1 Processor -- start 2024-04-17T19:46:54.823 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:54.834+0000 7f0ab2000640 1 -- start start 2024-04-17T19:46:54.825 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:54.834+0000 7f0ab2000640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f0aac1538b0 0x7f0aac072590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:46:54.826 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:54.834+0000 7f0ab2000640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f0aac0c60e0 0x7f0aac0c64f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:46:54.826 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:54.834+0000 7f0ab2000640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0aac0736b0 con 0x7f0aac15d0b0 2024-04-17T19:46:54.826 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:54.834+0000 7f0ab2000640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 -- 0x7f0aac073990 con 0x7f0aac1538b0 2024-04-17T19:46:54.826 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:54.834+0000 7f0ab2000640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7f0aac073c70 con 0x7f0aac0c60e0 2024-04-17T19:46:54.826 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:54.834+0000 7f0aab400640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f0aac1538b0 0x7f0aac072590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:46:54.826 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:54.834+0000 7f0aab400640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f0aac1538b0 0x7f0aac072590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:34070/0 (socket says 172.21.15.44:34070) 2024-04-17T19:46:54.826 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:54.834+0000 7f0aab400640 1 -- 172.21.15.44:0/3220931163 learned_addr learned my addr 172.21.15.44:0/3220931163 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-04-17T19:46:54.826 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:54.834+0000 7f0aa3e00640 1 --2- 172.21.15.44:0/3220931163 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f0aac0c60e0 0x7f0aac0c64f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:46:54.826 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:54.834+0000 7f0aab400640 1 -- 172.21.15.44:0/3220931163 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f0aac0c60e0 msgr2=0x7f0aac0c64f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T19:46:54.826 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:54.834+0000 7f0aab400640 1 --2- 172.21.15.44:0/3220931163 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f0aac0c60e0 0x7f0aac0c64f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:46:54.826 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:54.834+0000 7f0aab400640 1 -- 172.21.15.44:0/3220931163 >> v1:172.21.15.62:6789/0 conn(0x7f0aac15d0b0 legacy=0x7f0aac15d4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:46:54.826 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:54.834+0000 7f0aab400640 1 -- 172.21.15.44:0/3220931163 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0aac073f50 con 0x7f0aac1538b0 2024-04-17T19:46:54.829 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:54.838+0000 7f0aab400640 1 --2- 172.21.15.44:0/3220931163 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0aac1538b0 0x7f0aac072590 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f0a9c009870 tx=0x7f0a9c01ed50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=188dc08fa2878d4 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:46:54.829 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:54.838+0000 7f0aaaa00640 1 -- 172.21.15.44:0/3220931163 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a9c0b5070 con 0x7f0aac1538b0 2024-04-17T19:46:54.829 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:54.838+0000 7f0aaaa00640 1 -- 172.21.15.44:0/3220931163 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0a9c0a8a50 con 0x7f0aac1538b0 2024-04-17T19:46:54.829 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:54.838+0000 7f0aaaa00640 1 -- 172.21.15.44:0/3220931163 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a9c0a8e20 con 0x7f0aac1538b0 2024-04-17T19:46:54.830 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:54.838+0000 7f0ab2000640 1 -- 172.21.15.44:0/3220931163 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0aac1538b0 msgr2=0x7f0aac072590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:46:54.830 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:54.838+0000 7f0ab2000640 1 --2- 172.21.15.44:0/3220931163 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0aac1538b0 0x7f0aac072590 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f0a9c009870 tx=0x7f0a9c01ed50 comp rx=0 tx=0).stop 2024-04-17T19:46:54.830 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:54.838+0000 7f0ab2000640 1 -- 172.21.15.44:0/3220931163 shutdown_connections 2024-04-17T19:46:54.830 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:54.838+0000 7f0ab2000640 1 --2- 172.21.15.44:0/3220931163 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f0aac0c60e0 0x7f0aac0c64f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:46:54.830 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:54.838+0000 7f0ab2000640 1 --2- 172.21.15.44:0/3220931163 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0aac1538b0 0x7f0aac072590 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:46:54.830 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:54.838+0000 7f0ab2000640 1 -- 172.21.15.44:0/3220931163 >> 172.21.15.44:0/3220931163 conn(0x7f0aac0c9ad0 msgr2=0x7f0aac0cc9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:46:54.830 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:54.838+0000 7f0ab2000640 1 -- 172.21.15.44:0/3220931163 shutdown_connections 2024-04-17T19:46:54.830 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:54.838+0000 7f0ab2000640 1 -- 172.21.15.44:0/3220931163 wait complete. 2024-04-17T19:46:54.832 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:54.842+0000 7f0ab2000640 1 Processor -- start 2024-04-17T19:46:54.832 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:54.842+0000 7f0ab2000640 1 -- start start 2024-04-17T19:46:54.835 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:54.842+0000 7f0ab2000640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0aac0c60e0 0x7f0aac1586c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:46:54.835 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:54.842+0000 7f0ab2000640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0aac1538b0 0x7f0aac1492e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:46:54.835 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:54.842+0000 7f0ab2000640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f0aac15d0b0 0x7f0aac155a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:46:54.835 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:54.842+0000 7f0ab2000640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f0aac0c9130 con 0x7f0aac1538b0 2024-04-17T19:46:54.835 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:54.842+0000 7f0ab2000640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f0aac153cc0 con 0x7f0aac0c60e0 2024-04-17T19:46:54.835 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:54.842+0000 7f0ab2000640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7f0aac072ad0 con 0x7f0aac15d0b0 2024-04-17T19:46:54.835 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:54.842+0000 7f0aa3e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0aac1538b0 0x7f0aac1492e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:46:54.835 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:54.842+0000 7f0aa3e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0aac1538b0 0x7f0aac1492e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:34084/0 (socket says 172.21.15.44:34084) 2024-04-17T19:46:54.835 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:54.842+0000 7f0aa3e00640 1 -- 172.21.15.44:0/352652895 learned_addr learned my addr 172.21.15.44:0/352652895 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-04-17T19:46:54.835 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:54.842+0000 7f0aab400640 1 --2- 172.21.15.44:0/352652895 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0aac0c60e0 0x7f0aac1586c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:46:54.836 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:54.842+0000 7f0aabe00640 1 --2- 172.21.15.44:0/352652895 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f0aac15d0b0 0x7f0aac155a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:46:54.836 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:54.842+0000 7f0aa3e00640 1 -- 172.21.15.44:0/352652895 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f0aac15d0b0 msgr2=0x7f0aac155a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:46:54.836 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:54.842+0000 7f0aa3e00640 1 --2- 172.21.15.44:0/352652895 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f0aac15d0b0 0x7f0aac155a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:46:54.836 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:54.842+0000 7f0aa3e00640 1 -- 172.21.15.44:0/352652895 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0aac0c60e0 msgr2=0x7f0aac1586c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:46:54.836 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:54.842+0000 7f0aa3e00640 1 --2- 172.21.15.44:0/352652895 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0aac0c60e0 0x7f0aac1586c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:46:54.836 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:54.842+0000 7f0aa3e00640 1 -- 172.21.15.44:0/352652895 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0aac159b30 con 0x7f0aac1538b0 2024-04-17T19:46:54.836 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:54.846+0000 7f0aa3e00640 1 --2- 172.21.15.44:0/352652895 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0aac1538b0 0x7f0aac1492e0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f0a9400d7d0 tx=0x7f0a9400dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:46:54.836 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:54.846+0000 7f0aa3400640 1 -- 172.21.15.44:0/352652895 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a9400b6c0 con 0x7f0aac1538b0 2024-04-17T19:46:54.836 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:54.846+0000 7f0aa3400640 1 -- 172.21.15.44:0/352652895 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0a94019070 con 0x7f0aac1538b0 2024-04-17T19:46:54.836 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:54.846+0000 7f0aa3400640 1 -- 172.21.15.44:0/352652895 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a9400ba80 con 0x7f0aac1538b0 2024-04-17T19:46:54.836 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:54.846+0000 7f0ab2000640 1 -- 172.21.15.44:0/352652895 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0aac14c160 con 0x7f0aac1538b0 2024-04-17T19:46:54.836 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:54.846+0000 7f0ab2000640 1 -- 172.21.15.44:0/352652895 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0aac157ec0 con 0x7f0aac1538b0 2024-04-17T19:46:54.837 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:54.846+0000 7f0ab2000640 1 -- 172.21.15.44:0/352652895 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0aac04ff10 con 0x7f0aac1538b0 2024-04-17T19:46:54.837 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:54.846+0000 7f0aa3400640 1 -- 172.21.15.44:0/352652895 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f0a9400bc20 con 0x7f0aac1538b0 2024-04-17T19:46:54.837 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:54.846+0000 7f0aa3400640 1 --2- 172.21.15.44:0/352652895 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f0a88068380 0x7f0a8806a890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:46:54.838 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:54.846+0000 7f0aa3400640 1 -- 172.21.15.44:0/352652895 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 5227+0+0 (secure 0 0 0) 0x7f0a94086c30 con 0x7f0aac1538b0 2024-04-17T19:46:54.838 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:54.850+0000 7f0aab400640 1 --2- 172.21.15.44:0/352652895 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f0a88068380 0x7f0a8806a890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:46:54.839 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:54.850+0000 7f0aab400640 1 --2- 172.21.15.44:0/352652895 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f0a88068380 0x7f0a8806a890 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f0a9c0b2000 tx=0x7f0a9c009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:46:54.842 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:54.854+0000 7f0aa3400640 1 -- 172.21.15.44:0/352652895 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f0a94057330 con 0x7f0aac1538b0 2024-04-17T19:46:55.007 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:55.018+0000 7f0ab2000640 1 -- 172.21.15.44:0/352652895 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05} v 0) -- 0x7f0aac072eb0 con 0x7f0aac1538b0 2024-04-17T19:46:55.643 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:55.654+0000 7f0aa3400640 1 -- 172.21.15.44:0/352652895 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]=0 pool 'cephfs_data' created v19) ==== 171+0+0 (secure 0 0 0) 0x7f0a94056c30 con 0x7f0aac1538b0 2024-04-17T19:46:55.643 INFO:teuthology.orchestra.run.smithi044.stderr:pool 'cephfs_data' created 2024-04-17T19:46:55.646 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:55.654+0000 7f0ab2000640 1 -- 172.21.15.44:0/352652895 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f0a88068380 msgr2=0x7f0a8806a890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:46:55.646 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:55.654+0000 7f0ab2000640 1 --2- 172.21.15.44:0/352652895 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f0a88068380 0x7f0a8806a890 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f0a9c0b2000 tx=0x7f0a9c009040 comp rx=0 tx=0).stop 2024-04-17T19:46:55.646 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:55.654+0000 7f0ab2000640 1 -- 172.21.15.44:0/352652895 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0aac1538b0 msgr2=0x7f0aac1492e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:46:55.646 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:55.654+0000 7f0ab2000640 1 --2- 172.21.15.44:0/352652895 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0aac1538b0 0x7f0aac1492e0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f0a9400d7d0 tx=0x7f0a9400dc90 comp rx=0 tx=0).stop 2024-04-17T19:46:55.646 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:55.654+0000 7f0ab2000640 1 -- 172.21.15.44:0/352652895 shutdown_connections 2024-04-17T19:46:55.646 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:55.654+0000 7f0ab2000640 1 --2- 172.21.15.44:0/352652895 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f0a88068380 0x7f0a8806a890 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:46:55.646 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:55.654+0000 7f0ab2000640 1 --2- 172.21.15.44:0/352652895 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f0aac15d0b0 0x7f0aac155a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:46:55.646 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:55.654+0000 7f0ab2000640 1 --2- 172.21.15.44:0/352652895 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0aac1538b0 0x7f0aac1492e0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:46:55.646 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:55.654+0000 7f0ab2000640 1 --2- 172.21.15.44:0/352652895 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0aac0c60e0 0x7f0aac1586c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:46:55.647 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:55.654+0000 7f0ab2000640 1 -- 172.21.15.44:0/352652895 >> 172.21.15.44:0/352652895 conn(0x7f0aac0c9ad0 msgr2=0x7f0aac0cc8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:46:55.647 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:55.654+0000 7f0ab2000640 1 -- 172.21.15.44:0/352652895 shutdown_connections 2024-04-17T19:46:55.647 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:55.654+0000 7f0ab2000640 1 -- 172.21.15.44:0/352652895 wait complete. 2024-04-17T19:46:55.688 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-04-17T19:46:55.845 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:55.854+0000 7f0e98e00640 1 Processor -- start 2024-04-17T19:46:55.845 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:55.854+0000 7f0e98e00640 1 -- start start 2024-04-17T19:46:55.847 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:55.858+0000 7f0e98e00640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f0e94072700 0x7f0e94153a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:46:55.847 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:55.858+0000 7f0e98e00640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f0e940c60e0 0x7f0e940c64f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:46:55.847 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:55.858+0000 7f0e98e00640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0e94072d60 con 0x7f0e94159de0 2024-04-17T19:46:55.847 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:55.858+0000 7f0e98e00640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 -- 0x7f0e94072b10 con 0x7f0e940c60e0 2024-04-17T19:46:55.848 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:55.858+0000 7f0e98e00640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7f0e94073810 con 0x7f0e94072700 2024-04-17T19:46:55.848 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:55.858+0000 7f0e92800640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f0e94159de0 0x7f0e9415a1f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:34388/0 (socket says 172.21.15.44:34388) 2024-04-17T19:46:55.848 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:55.858+0000 7f0e92800640 1 -- 172.21.15.44:0/2797430340 learned_addr learned my addr 172.21.15.44:0/2797430340 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-04-17T19:46:55.848 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:55.858+0000 7f0e8be00640 1 --2- 172.21.15.44:0/2797430340 >> v2:172.21.15.62:3300/0 conn(0x7f0e940c60e0 0x7f0e940c64f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:46:55.848 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:55.858+0000 7f0e91e00640 1 --2- 172.21.15.44:0/2797430340 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f0e94072700 0x7f0e94153a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:46:55.850 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:55.858+0000 7f0e91400640 1 -- 172.21.15.44:0/2797430340 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3135461802 0 0) 0x7f0e94072d60 con 0x7f0e94159de0 2024-04-17T19:46:55.850 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:55.858+0000 7f0e91400640 1 -- 172.21.15.44:0/2797430340 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0e78003530 con 0x7f0e94159de0 2024-04-17T19:46:55.850 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:55.858+0000 7f0e91400640 1 -- 172.21.15.44:0/2797430340 <== mon.0 v1:172.21.15.44:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1624669846 0 0) 0x7f0e78003530 con 0x7f0e94159de0 2024-04-17T19:46:55.850 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:55.858+0000 7f0e91400640 1 -- 172.21.15.44:0/2797430340 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f0e94072700 msgr2=0x7f0e94153a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T19:46:55.850 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:55.858+0000 7f0e91400640 1 --2- 172.21.15.44:0/2797430340 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f0e94072700 0x7f0e94153a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:46:55.850 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:55.858+0000 7f0e91400640 1 -- 172.21.15.44:0/2797430340 >> v2:172.21.15.62:3300/0 conn(0x7f0e940c60e0 msgr2=0x7f0e940c64f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T19:46:55.850 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:55.858+0000 7f0e91400640 1 --2- 172.21.15.44:0/2797430340 >> v2:172.21.15.62:3300/0 conn(0x7f0e940c60e0 0x7f0e940c64f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:46:55.850 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:55.858+0000 7f0e91400640 1 -- 172.21.15.44:0/2797430340 --> v1:172.21.15.44:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0e94073af0 con 0x7f0e94159de0 2024-04-17T19:46:55.850 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:55.858+0000 7f0e91400640 1 -- 172.21.15.44:0/2797430340 <== mon.0 v1:172.21.15.44:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1863569991 0 0) 0x7f0e8c001a20 con 0x7f0e94159de0 2024-04-17T19:46:55.850 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:55.858+0000 7f0e91400640 1 -- 172.21.15.44:0/2797430340 >> v1:172.21.15.44:6789/0 conn(0x7f0e94159de0 legacy=0x7f0e9415a1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:46:55.850 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:55.858+0000 7f0e91400640 1 --2- 172.21.15.44:0/2797430340 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0e780039c0 0x7f0e78003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:46:55.850 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:55.858+0000 7f0e91400640 1 --2- 172.21.15.44:0/2797430340 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0e78004810 0x7f0e78004c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:46:55.851 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:55.858+0000 7f0e91400640 1 --2- 172.21.15.44:0/2797430340 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f0e94072700 0x7f0e78005160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:46:55.851 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:55.858+0000 7f0e91400640 1 -- 172.21.15.44:0/2797430340 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f0e94072b10 con 0x7f0e78004810 2024-04-17T19:46:55.851 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:55.858+0000 7f0e91400640 1 -- 172.21.15.44:0/2797430340 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f0e94073810 con 0x7f0e780039c0 2024-04-17T19:46:55.851 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:55.858+0000 7f0e91400640 1 -- 172.21.15.44:0/2797430340 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7f0e7800ba50 con 0x7f0e94072700 2024-04-17T19:46:55.851 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:55.858+0000 7f0e8be00640 1 --2- 172.21.15.44:0/2797430340 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0e78004810 0x7f0e78004c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:46:55.851 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:55.858+0000 7f0e91e00640 1 --2- 172.21.15.44:0/2797430340 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0e780039c0 0x7f0e78003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:46:55.851 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:55.858+0000 7f0e92800640 1 --2- 172.21.15.44:0/2797430340 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f0e94072700 0x7f0e78005160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:46:55.851 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:55.858+0000 7f0e8be00640 1 -- 172.21.15.44:0/2797430340 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f0e94072700 msgr2=0x7f0e78005160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T19:46:55.851 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:55.858+0000 7f0e8be00640 1 --2- 172.21.15.44:0/2797430340 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f0e94072700 0x7f0e78005160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:46:55.851 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:55.858+0000 7f0e8be00640 1 -- 172.21.15.44:0/2797430340 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0e780039c0 msgr2=0x7f0e78003e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T19:46:55.851 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:55.858+0000 7f0e8be00640 1 --2- 172.21.15.44:0/2797430340 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0e780039c0 0x7f0e78003e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:46:55.851 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:55.858+0000 7f0e8be00640 1 -- 172.21.15.44:0/2797430340 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0e78003530 con 0x7f0e78004810 2024-04-17T19:46:55.851 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:55.858+0000 7f0e92800640 1 --2- 172.21.15.44:0/2797430340 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f0e94072700 0x7f0e78005160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-17T19:46:55.852 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:55.862+0000 7f0e8be00640 1 --2- 172.21.15.44:0/2797430340 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0e78004810 0x7f0e78004c20 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f0e7c009ae0 tx=0x7f0e7c01cab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=22f050a092ba1708 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:46:55.852 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:55.862+0000 7f0e91400640 1 -- 172.21.15.44:0/2797430340 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e7c0b2070 con 0x7f0e78004810 2024-04-17T19:46:55.852 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:55.862+0000 7f0e91400640 1 -- 172.21.15.44:0/2797430340 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0e7c0a56a0 con 0x7f0e78004810 2024-04-17T19:46:55.852 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:55.862+0000 7f0e91400640 1 -- 172.21.15.44:0/2797430340 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e7c0096b0 con 0x7f0e78004810 2024-04-17T19:46:55.853 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:55.862+0000 7f0e98e00640 1 -- 172.21.15.44:0/2797430340 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0e78004810 msgr2=0x7f0e78004c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:46:55.853 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:55.862+0000 7f0e98e00640 1 --2- 172.21.15.44:0/2797430340 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0e78004810 0x7f0e78004c20 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f0e7c009ae0 tx=0x7f0e7c01cab0 comp rx=0 tx=0).stop 2024-04-17T19:46:55.853 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:55.862+0000 7f0e92800640 1 -- 172.21.15.44:0/2797430340 reap_dead start 2024-04-17T19:46:55.853 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:55.862+0000 7f0e98e00640 1 -- 172.21.15.44:0/2797430340 shutdown_connections 2024-04-17T19:46:55.853 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:55.862+0000 7f0e98e00640 1 -- 172.21.15.44:0/2797430340 >> 172.21.15.44:0/2797430340 conn(0x7f0e9406c380 msgr2=0x7f0e94070080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:46:55.853 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:55.862+0000 7f0e98e00640 1 -- 172.21.15.44:0/2797430340 shutdown_connections 2024-04-17T19:46:55.854 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:55.862+0000 7f0e98e00640 1 -- 172.21.15.44:0/2797430340 wait complete. 2024-04-17T19:46:55.855 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:55.866+0000 7f0e98e00640 1 Processor -- start 2024-04-17T19:46:55.855 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:55.866+0000 7f0e98e00640 1 -- start start 2024-04-17T19:46:55.858 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:55.866+0000 7f0e98e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0e78004810 0x7f0e940c4e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:46:55.858 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:55.866+0000 7f0e98e00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0e9414e750 0x7f0e941e5010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:46:55.858 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:55.866+0000 7f0e98e00640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f0e940cc2d0 0x7f0e941489b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:46:55.858 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:55.866+0000 7f0e98e00640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f0e94074390 con 0x7f0e78004810 2024-04-17T19:46:55.858 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:55.866+0000 7f0e98e00640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f0e940740b0 con 0x7f0e9414e750 2024-04-17T19:46:55.858 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:55.866+0000 7f0e98e00640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7f0e941598c0 con 0x7f0e940cc2d0 2024-04-17T19:46:55.859 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:55.866+0000 7f0e91e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0e78004810 0x7f0e940c4e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:46:55.859 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:55.866+0000 7f0e91e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0e78004810 0x7f0e940c4e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:47414/0 (socket says 172.21.15.44:47414) 2024-04-17T19:46:55.859 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:55.866+0000 7f0e91e00640 1 -- 172.21.15.44:0/3855563883 learned_addr learned my addr 172.21.15.44:0/3855563883 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-04-17T19:46:55.859 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:55.866+0000 7f0e92800640 1 --2- 172.21.15.44:0/3855563883 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f0e940cc2d0 0x7f0e941489b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:46:55.859 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:55.866+0000 7f0e8be00640 1 --2- 172.21.15.44:0/3855563883 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0e9414e750 0x7f0e941e5010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:46:55.859 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:55.866+0000 7f0e91e00640 1 -- 172.21.15.44:0/3855563883 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f0e940cc2d0 msgr2=0x7f0e941489b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:46:55.859 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:55.866+0000 7f0e91e00640 1 --2- 172.21.15.44:0/3855563883 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f0e940cc2d0 0x7f0e941489b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:46:55.859 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:55.866+0000 7f0e91e00640 1 -- 172.21.15.44:0/3855563883 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0e9414e750 msgr2=0x7f0e941e5010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:46:55.859 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:55.866+0000 7f0e91e00640 1 --2- 172.21.15.44:0/3855563883 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0e9414e750 0x7f0e941e5010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:46:55.859 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:55.866+0000 7f0e91e00640 1 -- 172.21.15.44:0/3855563883 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0e941f6600 con 0x7f0e78004810 2024-04-17T19:46:55.859 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:55.866+0000 7f0e91e00640 1 --2- 172.21.15.44:0/3855563883 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0e78004810 0x7f0e940c4e80 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f0e84011a00 tx=0x7f0e84011ec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:46:55.859 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:55.866+0000 7f0e8a000640 1 -- 172.21.15.44:0/3855563883 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e8400fb50 con 0x7f0e78004810 2024-04-17T19:46:55.859 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:55.870+0000 7f0e8a000640 1 -- 172.21.15.44:0/3855563883 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0e8400fcf0 con 0x7f0e78004810 2024-04-17T19:46:55.859 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:55.870+0000 7f0e98e00640 1 -- 172.21.15.44:0/3855563883 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0e940c8f60 con 0x7f0e78004810 2024-04-17T19:46:55.859 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:55.870+0000 7f0e8a000640 1 -- 172.21.15.44:0/3855563883 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e8400fea0 con 0x7f0e78004810 2024-04-17T19:46:55.860 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:55.870+0000 7f0e98e00640 1 -- 172.21.15.44:0/3855563883 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0e941f5b20 con 0x7f0e78004810 2024-04-17T19:46:55.860 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:55.870+0000 7f0e98e00640 1 -- 172.21.15.44:0/3855563883 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0e9404ff10 con 0x7f0e78004810 2024-04-17T19:46:55.861 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:55.870+0000 7f0e8a000640 1 -- 172.21.15.44:0/3855563883 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f0e84012040 con 0x7f0e78004810 2024-04-17T19:46:55.862 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:55.874+0000 7f0e8a000640 1 --2- 172.21.15.44:0/3855563883 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f0e70068380 0x7f0e7006a890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:46:55.862 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:55.874+0000 7f0e8a000640 1 -- 172.21.15.44:0/3855563883 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(19..19 src has 1..19) ==== 5609+0+0 (secure 0 0 0) 0x7f0e84087590 con 0x7f0e78004810 2024-04-17T19:46:55.863 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:55.874+0000 7f0e8be00640 1 --2- 172.21.15.44:0/3855563883 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f0e70068380 0x7f0e7006a890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:46:55.863 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:55.874+0000 7f0e8be00640 1 --2- 172.21.15.44:0/3855563883 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f0e70068380 0x7f0e7006a890 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f0e7c009ae0 tx=0x7f0e7c0046d0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:46:55.866 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:55.878+0000 7f0e8a000640 1 -- 172.21.15.44:0/3855563883 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f0e8402b080 con 0x7f0e78004810 2024-04-17T19:46:56.068 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:56.078+0000 7f0e98e00640 1 -- 172.21.15.44:0/3855563883 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7f0e94156ef0 con 0x7f0e78004810 2024-04-17T19:46:56.645 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:56.654+0000 7f0e8a000640 1 -- 172.21.15.44:0/3855563883 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v4) ==== 172+0+0 (secure 0 0 0) 0x7f0e84019030 con 0x7f0e78004810 2024-04-17T19:46:56.645 INFO:teuthology.orchestra.run.smithi044.stderr:new fs with metadata pool 2 and data pool 3 2024-04-17T19:46:56.649 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:56.658+0000 7f0e98e00640 1 -- 172.21.15.44:0/3855563883 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f0e70068380 msgr2=0x7f0e7006a890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:46:56.649 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:56.658+0000 7f0e98e00640 1 --2- 172.21.15.44:0/3855563883 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f0e70068380 0x7f0e7006a890 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f0e7c009ae0 tx=0x7f0e7c0046d0 comp rx=0 tx=0).stop 2024-04-17T19:46:56.649 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:56.658+0000 7f0e98e00640 1 -- 172.21.15.44:0/3855563883 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0e78004810 msgr2=0x7f0e940c4e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:46:56.649 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:56.658+0000 7f0e98e00640 1 --2- 172.21.15.44:0/3855563883 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0e78004810 0x7f0e940c4e80 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f0e84011a00 tx=0x7f0e84011ec0 comp rx=0 tx=0).stop 2024-04-17T19:46:56.649 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:56.658+0000 7f0e98e00640 1 -- 172.21.15.44:0/3855563883 shutdown_connections 2024-04-17T19:46:56.649 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:56.658+0000 7f0e98e00640 1 --2- 172.21.15.44:0/3855563883 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f0e70068380 0x7f0e7006a890 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:46:56.650 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:56.658+0000 7f0e98e00640 1 --2- 172.21.15.44:0/3855563883 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f0e940cc2d0 0x7f0e941489b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:46:56.650 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:56.658+0000 7f0e98e00640 1 --2- 172.21.15.44:0/3855563883 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0e9414e750 0x7f0e941e5010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:46:56.650 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:56.658+0000 7f0e98e00640 1 --2- 172.21.15.44:0/3855563883 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0e78004810 0x7f0e940c4e80 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:46:56.650 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:56.658+0000 7f0e98e00640 1 -- 172.21.15.44:0/3855563883 >> 172.21.15.44:0/3855563883 conn(0x7f0e9406c380 msgr2=0x7f0e94158270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:46:56.650 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:56.658+0000 7f0e98e00640 1 -- 172.21.15.44:0/3855563883 shutdown_connections 2024-04-17T19:46:56.650 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:56.662+0000 7f0e98e00640 1 -- 172.21.15.44:0/3855563883 wait complete. 2024-04-17T19:46:56.698 DEBUG:tasks.cephfs.filesystem:EC profile is ['m=2', 'k=2', 'crush-failure-domain=osd'] 2024-04-17T19:46:56.698 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd erasure-code-profile set cephfs_data_ec m=2 k=2 crush-failure-domain=osd 2024-04-17T19:46:56.857 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:56.866+0000 7f6ca7400640 1 Processor -- start 2024-04-17T19:46:56.857 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:56.866+0000 7f6ca7400640 1 -- start start 2024-04-17T19:46:56.860 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:56.870+0000 7f6ca7400640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f6ca00c83d0 0x7f6ca00c4870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:46:56.860 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:56.870+0000 7f6ca7400640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f6ca00c4db0 0x7f6ca0162f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:46:56.860 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:56.870+0000 7f6ca7400640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6ca00c6c20 con 0x7f6ca00c7fc0 2024-04-17T19:46:56.860 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:56.870+0000 7f6ca7400640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 -- 0x7f6ca0152d20 con 0x7f6ca00c83d0 2024-04-17T19:46:56.860 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:56.870+0000 7f6ca7400640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 -- 0x7f6ca00c6ee0 con 0x7f6ca00c4db0 2024-04-17T19:46:56.860 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:56.870+0000 7f6c9fe00640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f6ca00c83d0 0x7f6ca00c4870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:46:56.860 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:56.870+0000 7f6c9fe00640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f6ca00c83d0 0x7f6ca00c4870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:47426/0 (socket says 172.21.15.44:47426) 2024-04-17T19:46:56.860 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:56.870+0000 7f6c9fe00640 1 -- 172.21.15.44:0/1085669731 learned_addr learned my addr 172.21.15.44:0/1085669731 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-04-17T19:46:56.860 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:56.870+0000 7f6ca5400640 1 --2- 172.21.15.44:0/1085669731 >> v2:172.21.15.62:3300/0 conn(0x7f6ca00c4db0 0x7f6ca0162f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:46:56.860 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:56.870+0000 7f6c9fe00640 1 -- 172.21.15.44:0/1085669731 >> v2:172.21.15.62:3300/0 conn(0x7f6ca00c4db0 msgr2=0x7f6ca0162f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T19:46:56.861 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:56.870+0000 7f6c9fe00640 1 --2- 172.21.15.44:0/1085669731 >> v2:172.21.15.62:3300/0 conn(0x7f6ca00c4db0 0x7f6ca0162f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:46:56.861 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:56.870+0000 7f6c9fe00640 1 -- 172.21.15.44:0/1085669731 >> v1:172.21.15.62:6789/0 conn(0x7f6ca00c7fc0 legacy=0x7f6ca0152610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:46:56.861 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:56.870+0000 7f6c9fe00640 1 -- 172.21.15.44:0/1085669731 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6ca00c4000 con 0x7f6ca00c83d0 2024-04-17T19:46:56.861 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:56.870+0000 7f6ca5400640 1 --2- 172.21.15.44:0/1085669731 >> v2:172.21.15.62:3300/0 conn(0x7f6ca00c4db0 0x7f6ca0162f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-17T19:46:56.863 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:56.874+0000 7f6c9fe00640 1 --2- 172.21.15.44:0/1085669731 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6ca00c83d0 0x7f6ca00c4870 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f6ca0156110 tx=0x7f6c8c01c400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e47bfb20fd5c370b server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:46:56.863 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:56.874+0000 7f6c9f400640 1 -- 172.21.15.44:0/1085669731 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c8c0b0070 con 0x7f6ca00c83d0 2024-04-17T19:46:56.863 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:56.874+0000 7f6c9f400640 1 -- 172.21.15.44:0/1085669731 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6c8c0ab600 con 0x7f6ca00c83d0 2024-04-17T19:46:56.863 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:56.874+0000 7f6c9f400640 1 -- 172.21.15.44:0/1085669731 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c8c0ab9d0 con 0x7f6ca00c83d0 2024-04-17T19:46:56.864 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:56.874+0000 7f6ca7400640 1 -- 172.21.15.44:0/1085669731 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6ca00c83d0 msgr2=0x7f6ca00c4870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:46:56.864 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:56.874+0000 7f6ca7400640 1 --2- 172.21.15.44:0/1085669731 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6ca00c83d0 0x7f6ca00c4870 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f6ca0156110 tx=0x7f6c8c01c400 comp rx=0 tx=0).stop 2024-04-17T19:46:56.864 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:56.874+0000 7f6ca7400640 1 -- 172.21.15.44:0/1085669731 shutdown_connections 2024-04-17T19:46:56.864 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:56.874+0000 7f6ca7400640 1 --2- 172.21.15.44:0/1085669731 >> v2:172.21.15.62:3300/0 conn(0x7f6ca00c4db0 0x7f6ca0162f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:46:56.864 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:56.874+0000 7f6ca7400640 1 --2- 172.21.15.44:0/1085669731 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6ca00c83d0 0x7f6ca00c4870 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:46:56.864 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:56.874+0000 7f6ca7400640 1 -- 172.21.15.44:0/1085669731 >> 172.21.15.44:0/1085669731 conn(0x7f6ca00c9ad0 msgr2=0x7f6ca00cc9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:46:56.864 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:56.874+0000 7f6ca7400640 1 -- 172.21.15.44:0/1085669731 shutdown_connections 2024-04-17T19:46:56.864 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:56.874+0000 7f6ca7400640 1 -- 172.21.15.44:0/1085669731 wait complete. 2024-04-17T19:46:56.866 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:56.878+0000 7f6ca7400640 1 Processor -- start 2024-04-17T19:46:56.866 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:56.878+0000 7f6ca7400640 1 -- start start 2024-04-17T19:46:56.868 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:56.878+0000 7f6ca7400640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6ca00c4db0 0x7f6ca0159b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:46:56.868 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:56.878+0000 7f6ca7400640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f6ca00c7fc0 0x7f6ca014b210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:46:56.868 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:56.878+0000 7f6ca7400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6ca00c83d0 0x7f6ca0144480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:46:56.869 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:56.878+0000 7f6ca7400640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f6ca00c6870 con 0x7f6ca00c83d0 2024-04-17T19:46:56.869 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:56.878+0000 7f6ca7400640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f6ca00c7a20 con 0x7f6ca00c4db0 2024-04-17T19:46:56.869 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:56.878+0000 7f6ca7400640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7f6ca01f33b0 con 0x7f6ca00c7fc0 2024-04-17T19:46:56.869 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:56.878+0000 7f6ca5400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6ca00c83d0 0x7f6ca0144480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:46:56.869 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:56.878+0000 7f6ca5400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6ca00c83d0 0x7f6ca0144480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:47438/0 (socket says 172.21.15.44:47438) 2024-04-17T19:46:56.869 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:56.878+0000 7f6ca5400640 1 -- 172.21.15.44:0/2912026741 learned_addr learned my addr 172.21.15.44:0/2912026741 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-04-17T19:46:56.869 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:56.878+0000 7f6ca4a00640 1 --2- 172.21.15.44:0/2912026741 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6ca00c4db0 0x7f6ca0159b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:46:56.869 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:56.878+0000 7f6c9fe00640 1 --2- 172.21.15.44:0/2912026741 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f6ca00c7fc0 0x7f6ca014b210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:46:56.869 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:56.878+0000 7f6ca5400640 1 -- 172.21.15.44:0/2912026741 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f6ca00c7fc0 msgr2=0x7f6ca014b210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:46:56.869 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:56.878+0000 7f6ca5400640 1 --2- 172.21.15.44:0/2912026741 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f6ca00c7fc0 0x7f6ca014b210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:46:56.869 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:56.878+0000 7f6ca5400640 1 -- 172.21.15.44:0/2912026741 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6ca00c4db0 msgr2=0x7f6ca0159b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:46:56.869 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:56.878+0000 7f6ca5400640 1 --2- 172.21.15.44:0/2912026741 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6ca00c4db0 0x7f6ca0159b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:46:56.869 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:56.878+0000 7f6ca5400640 1 -- 172.21.15.44:0/2912026741 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6ca015a4a0 con 0x7f6ca00c83d0 2024-04-17T19:46:56.869 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:56.878+0000 7f6ca4a00640 1 --2- 172.21.15.44:0/2912026741 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6ca00c4db0 0x7f6ca0159b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-17T19:46:56.869 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:56.878+0000 7f6ca5400640 1 --2- 172.21.15.44:0/2912026741 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6ca00c83d0 0x7f6ca0144480 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f6c98007ea0 tx=0x7f6c98007f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:46:56.870 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:56.878+0000 7f6c9cc00640 1 -- 172.21.15.44:0/2912026741 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c9801a070 con 0x7f6ca00c83d0 2024-04-17T19:46:56.870 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:56.878+0000 7f6c9cc00640 1 -- 172.21.15.44:0/2912026741 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6c980039a0 con 0x7f6ca00c83d0 2024-04-17T19:46:56.870 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:56.878+0000 7f6c9cc00640 1 -- 172.21.15.44:0/2912026741 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c98003db0 con 0x7f6ca00c83d0 2024-04-17T19:46:56.870 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:56.878+0000 7f6ca7400640 1 -- 172.21.15.44:0/2912026741 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6ca01f6460 con 0x7f6ca00c83d0 2024-04-17T19:46:56.871 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:56.878+0000 7f6ca7400640 1 -- 172.21.15.44:0/2912026741 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6ca01f30f0 con 0x7f6ca00c83d0 2024-04-17T19:46:56.871 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:56.882+0000 7f6ca7400640 1 -- 172.21.15.44:0/2912026741 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6ca0075f10 con 0x7f6ca00c83d0 2024-04-17T19:46:56.871 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:56.882+0000 7f6c9cc00640 1 -- 172.21.15.44:0/2912026741 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f6c9801d070 con 0x7f6ca00c83d0 2024-04-17T19:46:56.872 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:56.882+0000 7f6c9cc00640 1 --2- 172.21.15.44:0/2912026741 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f6c800683b0 0x7f6c8006a8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:46:56.872 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:56.882+0000 7f6c9cc00640 1 -- 172.21.15.44:0/2912026741 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f6c98086c30 con 0x7f6ca00c83d0 2024-04-17T19:46:56.872 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:56.882+0000 7f6ca4a00640 1 --2- 172.21.15.44:0/2912026741 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f6c800683b0 0x7f6c8006a8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:46:56.873 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:56.882+0000 7f6ca4a00640 1 --2- 172.21.15.44:0/2912026741 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f6c800683b0 0x7f6c8006a8c0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f6c94001670 tx=0x7f6c94009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:46:56.876 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:56.886+0000 7f6c9cc00640 1 -- 172.21.15.44:0/2912026741 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f6c98010070 con 0x7f6ca00c83d0 2024-04-17T19:46:57.049 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:57.058+0000 7f6ca7400640 1 -- 172.21.15.44:0/2912026741 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]} v 0) -- 0x7f6ca00c37c0 con 0x7f6ca00c83d0 2024-04-17T19:46:57.647 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:57.658+0000 7f6c9cc00640 1 -- 172.21.15.44:0/2912026741 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]=0 v21) ==== 157+0+0 (secure 0 0 0) 0x7f6c980571f0 con 0x7f6ca00c83d0 2024-04-17T19:46:57.651 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:57.658+0000 7f6ca7400640 1 -- 172.21.15.44:0/2912026741 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f6c800683b0 msgr2=0x7f6c8006a8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:46:57.651 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:57.658+0000 7f6ca7400640 1 --2- 172.21.15.44:0/2912026741 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f6c800683b0 0x7f6c8006a8c0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f6c94001670 tx=0x7f6c94009040 comp rx=0 tx=0).stop 2024-04-17T19:46:57.651 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:57.662+0000 7f6ca7400640 1 -- 172.21.15.44:0/2912026741 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6ca00c83d0 msgr2=0x7f6ca0144480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:46:57.651 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:57.662+0000 7f6ca7400640 1 --2- 172.21.15.44:0/2912026741 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6ca00c83d0 0x7f6ca0144480 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f6c98007ea0 tx=0x7f6c98007f90 comp rx=0 tx=0).stop 2024-04-17T19:46:57.651 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:57.662+0000 7f6ca7400640 1 -- 172.21.15.44:0/2912026741 shutdown_connections 2024-04-17T19:46:57.651 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:57.662+0000 7f6ca7400640 1 --2- 172.21.15.44:0/2912026741 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f6c800683b0 0x7f6c8006a8c0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:46:57.651 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:57.662+0000 7f6ca7400640 1 --2- 172.21.15.44:0/2912026741 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f6ca00c7fc0 0x7f6ca014b210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:46:57.651 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:57.662+0000 7f6ca7400640 1 --2- 172.21.15.44:0/2912026741 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6ca00c83d0 0x7f6ca0144480 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:46:57.651 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:57.662+0000 7f6ca7400640 1 --2- 172.21.15.44:0/2912026741 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6ca00c4db0 0x7f6ca0159b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:46:57.651 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:57.662+0000 7f6ca7400640 1 -- 172.21.15.44:0/2912026741 >> 172.21.15.44:0/2912026741 conn(0x7f6ca00c9ad0 msgr2=0x7f6ca00cc380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:46:57.651 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:57.662+0000 7f6ca7400640 1 -- 172.21.15.44:0/2912026741 shutdown_connections 2024-04-17T19:46:57.651 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:57.662+0000 7f6ca7400640 1 -- 172.21.15.44:0/2912026741 wait complete. 2024-04-17T19:46:57.675 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data_ec erasure cephfs_data_ec --pg_num_min 64 --target_size_ratio 0.9 2024-04-17T19:46:57.842 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:57.850+0000 7f3faf000640 1 Processor -- start 2024-04-17T19:46:57.842 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:57.854+0000 7f3faf000640 1 -- start start 2024-04-17T19:46:57.844 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:57.854+0000 7f3faf000640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f3fa80c3810 0x7f3fa80c3c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:46:57.844 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:57.854+0000 7f3faf000640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3fa80c8bc0 con 0x7f3fa8160ff0 2024-04-17T19:46:57.844 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:57.854+0000 7f3faf000640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3fa80c2f80 con 0x7f3fa80c76c0 2024-04-17T19:46:57.844 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:57.854+0000 7f3faf000640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 -- 0x7f3fa80c89a0 con 0x7f3fa80c3810 2024-04-17T19:46:57.844 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:57.854+0000 7f3f9f400640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f3fa80c3810 0x7f3fa80c3c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:46:57.844 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:57.854+0000 7f3f9f400640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f3fa80c3810 0x7f3fa80c3c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:47442/0 (socket says 172.21.15.44:47442) 2024-04-17T19:46:57.845 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:57.854+0000 7f3fad000640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f3fa8160ff0 0x7f3fa8163410 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:34394/0 (socket says 172.21.15.44:34394) 2024-04-17T19:46:57.845 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:57.854+0000 7f3f9f400640 1 -- 172.21.15.44:0/2367949658 learned_addr learned my addr 172.21.15.44:0/2367949658 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-04-17T19:46:57.845 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:57.854+0000 7f3f9f400640 1 -- 172.21.15.44:0/2367949658 >> v1:172.21.15.62:6789/0 conn(0x7f3fa80c76c0 legacy=0x7f3fa815bcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:46:57.845 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:57.854+0000 7f3f9f400640 1 -- 172.21.15.44:0/2367949658 >> v1:172.21.15.44:6789/0 conn(0x7f3fa8160ff0 legacy=0x7f3fa8163410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:46:57.845 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:57.854+0000 7f3f9f400640 1 -- 172.21.15.44:0/2367949658 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3fa80c3260 con 0x7f3fa80c3810 2024-04-17T19:46:57.845 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:57.854+0000 7f3fa7400640 1 -- 172.21.15.44:0/2367949658 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3352455303 0 0) 0x7f3fa80c8bc0 con 0x7f3fa8160ff0 2024-04-17T19:46:57.847 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:57.858+0000 7f3f9f400640 1 --2- 172.21.15.44:0/2367949658 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3fa80c3810 0x7f3fa80c3c20 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f3f90009870 tx=0x7f3f9001ed50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=acaf64702b1b16b2 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:46:57.848 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:57.858+0000 7f3fa7400640 1 -- 172.21.15.44:0/2367949658 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f900b5070 con 0x7f3fa80c3810 2024-04-17T19:46:57.848 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:57.858+0000 7f3fa7400640 1 -- 172.21.15.44:0/2367949658 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3f900a8a50 con 0x7f3fa80c3810 2024-04-17T19:46:57.848 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:57.858+0000 7f3fa7400640 1 -- 172.21.15.44:0/2367949658 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f900a8e20 con 0x7f3fa80c3810 2024-04-17T19:46:57.848 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:57.858+0000 7f3faf000640 1 -- 172.21.15.44:0/2367949658 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3fa80c3810 msgr2=0x7f3fa80c3c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:46:57.849 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:57.858+0000 7f3faf000640 1 --2- 172.21.15.44:0/2367949658 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3fa80c3810 0x7f3fa80c3c20 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f3f90009870 tx=0x7f3f9001ed50 comp rx=0 tx=0).stop 2024-04-17T19:46:57.849 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:57.858+0000 7f3faf000640 1 -- 172.21.15.44:0/2367949658 shutdown_connections 2024-04-17T19:46:57.849 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:57.858+0000 7f3faf000640 1 --2- 172.21.15.44:0/2367949658 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3fa80c3810 0x7f3fa80c3c20 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:46:57.849 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:57.858+0000 7f3faf000640 1 -- 172.21.15.44:0/2367949658 >> 172.21.15.44:0/2367949658 conn(0x7f3fa80713f0 msgr2=0x7f3fa8071800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:46:57.849 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:57.858+0000 7f3faf000640 1 -- 172.21.15.44:0/2367949658 shutdown_connections 2024-04-17T19:46:57.849 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:57.858+0000 7f3faf000640 1 -- 172.21.15.44:0/2367949658 wait complete. 2024-04-17T19:46:57.851 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:57.862+0000 7f3faf000640 1 Processor -- start 2024-04-17T19:46:57.851 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:57.862+0000 7f3faf000640 1 -- start start 2024-04-17T19:46:57.854 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:57.862+0000 7f3faf000640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3fa80c3810 0x7f3fa8153f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:46:57.854 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:57.862+0000 7f3faf000640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3fa80c76c0 0x7f3fa814cae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:46:57.854 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:57.862+0000 7f3faf000640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f3fa8160ff0 0x7f3fa814d020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:46:57.854 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:57.862+0000 7f3faf000640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f3fa80c4160 con 0x7f3fa80c76c0 2024-04-17T19:46:57.854 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:57.862+0000 7f3faf000640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f3fa815c3e0 con 0x7f3fa80c3810 2024-04-17T19:46:57.854 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:57.862+0000 7f3faf000640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7f3fa80c9a50 con 0x7f3fa8160ff0 2024-04-17T19:46:57.854 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:57.862+0000 7f3f9f400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3fa80c76c0 0x7f3fa814cae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:46:57.854 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:57.862+0000 7f3f9f400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3fa80c76c0 0x7f3fa814cae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:47452/0 (socket says 172.21.15.44:47452) 2024-04-17T19:46:57.854 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:57.862+0000 7f3f9f400640 1 -- 172.21.15.44:0/3787083336 learned_addr learned my addr 172.21.15.44:0/3787083336 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-04-17T19:46:57.854 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:57.862+0000 7f3fa7e00640 1 --2- 172.21.15.44:0/3787083336 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3fa80c3810 0x7f3fa8153f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:46:57.854 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:57.862+0000 7f3fad000640 1 --2- 172.21.15.44:0/3787083336 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f3fa8160ff0 0x7f3fa814d020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:46:57.854 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:57.862+0000 7f3f9f400640 1 -- 172.21.15.44:0/3787083336 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f3fa8160ff0 msgr2=0x7f3fa814d020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:46:57.855 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:57.862+0000 7f3f9f400640 1 --2- 172.21.15.44:0/3787083336 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f3fa8160ff0 0x7f3fa814d020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:46:57.855 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:57.862+0000 7f3f9f400640 1 -- 172.21.15.44:0/3787083336 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3fa80c3810 msgr2=0x7f3fa8153f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:46:57.855 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:57.862+0000 7f3f9f400640 1 --2- 172.21.15.44:0/3787083336 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3fa80c3810 0x7f3fa8153f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:46:57.855 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:57.862+0000 7f3f9f400640 1 -- 172.21.15.44:0/3787083336 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3fa814ef80 con 0x7f3fa80c76c0 2024-04-17T19:46:57.855 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:57.862+0000 7f3f9f400640 1 --2- 172.21.15.44:0/3787083336 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3fa80c76c0 0x7f3fa814cae0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f3f900b3040 tx=0x7f3f9001baf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:46:57.855 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:57.862+0000 7f3fa4c00640 1 -- 172.21.15.44:0/3787083336 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f900b5040 con 0x7f3fa80c76c0 2024-04-17T19:46:57.855 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:57.862+0000 7f3fa4c00640 1 -- 172.21.15.44:0/3787083336 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3f900b0ba0 con 0x7f3fa80c76c0 2024-04-17T19:46:57.855 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:57.862+0000 7f3fa4c00640 1 -- 172.21.15.44:0/3787083336 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f90004030 con 0x7f3fa80c76c0 2024-04-17T19:46:57.855 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:57.862+0000 7f3faf000640 1 -- 172.21.15.44:0/3787083336 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3fa80ce9c0 con 0x7f3fa80c76c0 2024-04-17T19:46:57.855 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:57.862+0000 7f3faf000640 1 -- 172.21.15.44:0/3787083336 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3fa81443e0 con 0x7f3fa80c76c0 2024-04-17T19:46:57.856 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:57.866+0000 7f3faf000640 1 -- 172.21.15.44:0/3787083336 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3fa804ff10 con 0x7f3fa80c76c0 2024-04-17T19:46:57.856 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:57.866+0000 7f3fa4c00640 1 -- 172.21.15.44:0/3787083336 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f3f900041d0 con 0x7f3fa80c76c0 2024-04-17T19:46:57.856 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:57.866+0000 7f3fa4c00640 1 --2- 172.21.15.44:0/3787083336 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f3f840683b0 0x7f3f8406a8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:46:57.857 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:57.866+0000 7f3fa4c00640 1 -- 172.21.15.44:0/3787083336 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 6007+0+0 (secure 0 0 0) 0x7f3f90124620 con 0x7f3fa80c76c0 2024-04-17T19:46:57.857 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:57.866+0000 7f3fa7e00640 1 --2- 172.21.15.44:0/3787083336 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f3f840683b0 0x7f3f8406a8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:46:57.858 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:57.866+0000 7f3fa7e00640 1 --2- 172.21.15.44:0/3787083336 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f3f840683b0 0x7f3f8406a8c0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f3f98000f70 tx=0x7f3f98009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:46:57.861 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:57.870+0000 7f3fa4c00640 1 -- 172.21.15.44:0/3787083336 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f3fa80ce9c0 con 0x7f3fa80c76c0 2024-04-17T19:46:58.028 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:58.038+0000 7f3faf000640 1 -- 172.21.15.44:0/3787083336 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7f3fa8070b00 con 0x7f3fa80c76c0 2024-04-17T19:46:59.686 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:59.698+0000 7f3fa4c00640 1 -- 172.21.15.44:0/3787083336 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data_ec' created v23) ==== 228+0+0 (secure 0 0 0) 0x7f3f900bd020 con 0x7f3fa80c76c0 2024-04-17T19:46:59.687 INFO:teuthology.orchestra.run.smithi044.stderr:pool 'cephfs_data_ec' created 2024-04-17T19:46:59.690 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:59.698+0000 7f3faf000640 1 -- 172.21.15.44:0/3787083336 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f3f840683b0 msgr2=0x7f3f8406a8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:46:59.690 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:59.698+0000 7f3faf000640 1 --2- 172.21.15.44:0/3787083336 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f3f840683b0 0x7f3f8406a8c0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f3f98000f70 tx=0x7f3f98009040 comp rx=0 tx=0).stop 2024-04-17T19:46:59.690 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:59.698+0000 7f3faf000640 1 -- 172.21.15.44:0/3787083336 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3fa80c76c0 msgr2=0x7f3fa814cae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:46:59.690 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:59.698+0000 7f3faf000640 1 --2- 172.21.15.44:0/3787083336 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3fa80c76c0 0x7f3fa814cae0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f3f900b3040 tx=0x7f3f9001baf0 comp rx=0 tx=0).stop 2024-04-17T19:46:59.691 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:59.702+0000 7f3faf000640 1 -- 172.21.15.44:0/3787083336 shutdown_connections 2024-04-17T19:46:59.691 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:59.702+0000 7f3faf000640 1 --2- 172.21.15.44:0/3787083336 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f3f840683b0 0x7f3f8406a8c0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:46:59.691 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:59.702+0000 7f3faf000640 1 --2- 172.21.15.44:0/3787083336 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f3fa8160ff0 0x7f3fa814d020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:46:59.691 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:59.702+0000 7f3faf000640 1 --2- 172.21.15.44:0/3787083336 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3fa80c76c0 0x7f3fa814cae0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:46:59.691 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:59.702+0000 7f3faf000640 1 --2- 172.21.15.44:0/3787083336 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3fa80c3810 0x7f3fa8153f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:46:59.691 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:59.702+0000 7f3faf000640 1 -- 172.21.15.44:0/3787083336 >> 172.21.15.44:0/3787083336 conn(0x7f3fa80713f0 msgr2=0x7f3fa81467e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:46:59.691 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:59.702+0000 7f3faf000640 1 -- 172.21.15.44:0/3787083336 shutdown_connections 2024-04-17T19:46:59.691 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:59.702+0000 7f3faf000640 1 -- 172.21.15.44:0/3787083336 wait complete. 2024-04-17T19:46:59.724 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool set cephfs_data_ec allow_ec_overwrites true 2024-04-17T19:46:59.883 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:59.894+0000 7f11cd000640 1 Processor -- start 2024-04-17T19:46:59.883 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:59.894+0000 7f11cd000640 1 -- start start 2024-04-17T19:46:59.885 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:59.894+0000 7f11cd000640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f11c8152450 0x7f11c80c5090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:46:59.885 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:59.894+0000 7f11cd000640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f11c80c55d0 0x7f11c80c59e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:46:59.885 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:59.894+0000 7f11cd000640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f11c806cfc0 con 0x7f11c8070e70 2024-04-17T19:46:59.885 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:59.894+0000 7f11cd000640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 -- 0x7f11c815c870 con 0x7f11c8152450 2024-04-17T19:46:59.885 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:59.894+0000 7f11cd000640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 -- 0x7f11c815c3e0 con 0x7f11c80c55d0 2024-04-17T19:46:59.885 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:59.894+0000 7f11c5e00640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f11c8070e70 0x7f11c80c9550 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:34406/0 (socket says 172.21.15.44:34406) 2024-04-17T19:46:59.885 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:59.894+0000 7f11c5e00640 1 -- 172.21.15.44:0/3861371767 learned_addr learned my addr 172.21.15.44:0/3861371767 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-04-17T19:46:59.886 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:59.894+0000 7f11bd400640 1 --2- 172.21.15.44:0/3861371767 >> v2:172.21.15.44:3300/0 conn(0x7f11c8152450 0x7f11c80c5090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:46:59.886 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:59.894+0000 7f11c6800640 1 --2- 172.21.15.44:0/3861371767 >> v2:172.21.15.62:3300/0 conn(0x7f11c80c55d0 0x7f11c80c59e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:46:59.886 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:59.894+0000 7f11c5400640 1 -- 172.21.15.44:0/3861371767 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2123386244 0 0) 0x7f11c806cfc0 con 0x7f11c8070e70 2024-04-17T19:46:59.886 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:59.894+0000 7f11c5400640 1 -- 172.21.15.44:0/3861371767 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f11ac003530 con 0x7f11c8070e70 2024-04-17T19:46:59.886 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:59.894+0000 7f11bd400640 1 -- 172.21.15.44:0/3861371767 >> v2:172.21.15.62:3300/0 conn(0x7f11c80c55d0 msgr2=0x7f11c80c59e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T19:46:59.886 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:59.894+0000 7f11bd400640 1 --2- 172.21.15.44:0/3861371767 >> v2:172.21.15.62:3300/0 conn(0x7f11c80c55d0 0x7f11c80c59e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:46:59.887 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:59.894+0000 7f11bd400640 1 -- 172.21.15.44:0/3861371767 >> v1:172.21.15.44:6789/0 conn(0x7f11c8070e70 legacy=0x7f11c80c9550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:46:59.887 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:59.894+0000 7f11bd400640 1 -- 172.21.15.44:0/3861371767 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f11c815bab0 con 0x7f11c8152450 2024-04-17T19:46:59.887 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:59.894+0000 7f11c6800640 1 --2- 172.21.15.44:0/3861371767 >> v2:172.21.15.62:3300/0 conn(0x7f11c80c55d0 0x7f11c80c59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-17T19:46:59.888 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:59.898+0000 7f11bd400640 1 --2- 172.21.15.44:0/3861371767 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f11c8152450 0x7f11c80c5090 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f11c80ca930 tx=0x7f11b001c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fd9ec6cd8fa4b7d6 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:46:59.889 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:59.898+0000 7f11c5400640 1 -- 172.21.15.44:0/3861371767 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11b00b0070 con 0x7f11c8152450 2024-04-17T19:46:59.889 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:59.898+0000 7f11c5400640 1 -- 172.21.15.44:0/3861371767 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f11b00ab600 con 0x7f11c8152450 2024-04-17T19:46:59.889 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:59.898+0000 7f11c5400640 1 -- 172.21.15.44:0/3861371767 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11b00ab9b0 con 0x7f11c8152450 2024-04-17T19:46:59.890 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:59.898+0000 7f11cd000640 1 -- 172.21.15.44:0/3861371767 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f11c8152450 msgr2=0x7f11c80c5090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:46:59.890 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:59.898+0000 7f11cd000640 1 --2- 172.21.15.44:0/3861371767 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f11c8152450 0x7f11c80c5090 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f11c80ca930 tx=0x7f11b001c480 comp rx=0 tx=0).stop 2024-04-17T19:46:59.890 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:59.898+0000 7f11cd000640 1 -- 172.21.15.44:0/3861371767 shutdown_connections 2024-04-17T19:46:59.890 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:59.898+0000 7f11cd000640 1 --2- 172.21.15.44:0/3861371767 >> v2:172.21.15.62:3300/0 conn(0x7f11c80c55d0 0x7f11c80c59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:46:59.890 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:59.898+0000 7f11cd000640 1 --2- 172.21.15.44:0/3861371767 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f11c8152450 0x7f11c80c5090 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:46:59.890 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:59.898+0000 7f11cd000640 1 -- 172.21.15.44:0/3861371767 >> 172.21.15.44:0/3861371767 conn(0x7f11c80cebd0 msgr2=0x7f11c80cefe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:46:59.890 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:59.898+0000 7f11cd000640 1 -- 172.21.15.44:0/3861371767 shutdown_connections 2024-04-17T19:46:59.890 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:59.898+0000 7f11cd000640 1 -- 172.21.15.44:0/3861371767 wait complete. 2024-04-17T19:46:59.891 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:59.902+0000 7f11cd000640 1 Processor -- start 2024-04-17T19:46:59.892 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:59.902+0000 7f11cd000640 1 -- start start 2024-04-17T19:46:59.894 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:59.902+0000 7f11cd000640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f11c8070e70 0x7f11c815cb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:46:59.894 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:59.902+0000 7f11cd000640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f11c80c55d0 0x7f11c80c6ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:46:59.894 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:59.902+0000 7f11cd000640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f11c8152450 0x7f11c81f8580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:46:59.894 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:59.902+0000 7f11cd000640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f11c8168ab0 con 0x7f11c8070e70 2024-04-17T19:46:59.894 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:59.902+0000 7f11cd000640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f11c806d2a0 con 0x7f11c8152450 2024-04-17T19:46:59.894 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:59.902+0000 7f11cd000640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7f11c8168c30 con 0x7f11c80c55d0 2024-04-17T19:46:59.894 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:59.902+0000 7f11c5e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f11c8070e70 0x7f11c815cb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:46:59.894 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:59.902+0000 7f11c5e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f11c8070e70 0x7f11c815cb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:47474/0 (socket says 172.21.15.44:47474) 2024-04-17T19:46:59.894 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:59.902+0000 7f11c5e00640 1 -- 172.21.15.44:0/2306391416 learned_addr learned my addr 172.21.15.44:0/2306391416 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-04-17T19:46:59.894 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:59.902+0000 7f11c6800640 1 --2- 172.21.15.44:0/2306391416 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f11c8152450 0x7f11c81f8580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:46:59.894 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:59.902+0000 7f11bd400640 1 --2- 172.21.15.44:0/2306391416 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f11c80c55d0 0x7f11c80c6ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:46:59.895 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:59.906+0000 7f11c5e00640 1 -- 172.21.15.44:0/2306391416 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f11c80c55d0 msgr2=0x7f11c80c6ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:46:59.895 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:59.906+0000 7f11c5e00640 1 --2- 172.21.15.44:0/2306391416 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f11c80c55d0 0x7f11c80c6ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:46:59.896 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:59.906+0000 7f11c5e00640 1 -- 172.21.15.44:0/2306391416 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f11c8152450 msgr2=0x7f11c81f8580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:46:59.896 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:59.906+0000 7f11c5e00640 1 --2- 172.21.15.44:0/2306391416 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f11c8152450 0x7f11c81f8580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:46:59.896 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:59.906+0000 7f11c5e00640 1 -- 172.21.15.44:0/2306391416 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f11c80c7010 con 0x7f11c8070e70 2024-04-17T19:46:59.896 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:59.906+0000 7f11c5e00640 1 --2- 172.21.15.44:0/2306391416 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f11c8070e70 0x7f11c815cb60 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f11b800c3f0 tx=0x7f11b800c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:46:59.896 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:59.906+0000 7f11bea00640 1 -- 172.21.15.44:0/2306391416 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11b8017070 con 0x7f11c8070e70 2024-04-17T19:46:59.896 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:59.906+0000 7f11bea00640 1 -- 172.21.15.44:0/2306391416 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f11b8005cf0 con 0x7f11c8070e70 2024-04-17T19:46:59.896 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:59.906+0000 7f11bea00640 1 -- 172.21.15.44:0/2306391416 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11b80072f0 con 0x7f11c8070e70 2024-04-17T19:46:59.896 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:59.906+0000 7f11cd000640 1 -- 172.21.15.44:0/2306391416 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f11c80ca640 con 0x7f11c8070e70 2024-04-17T19:46:59.896 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:59.906+0000 7f11cd000640 1 -- 172.21.15.44:0/2306391416 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f11c80c8400 con 0x7f11c8070e70 2024-04-17T19:46:59.896 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:59.906+0000 7f11cd000640 1 -- 172.21.15.44:0/2306391416 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f11c804ff80 con 0x7f11c8070e70 2024-04-17T19:46:59.897 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:59.906+0000 7f11bea00640 1 -- 172.21.15.44:0/2306391416 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f11b801a070 con 0x7f11c8070e70 2024-04-17T19:46:59.898 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:59.910+0000 7f11bea00640 1 --2- 172.21.15.44:0/2306391416 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f11a4068380 0x7f11a406a890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:46:59.898 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:59.910+0000 7f11bea00640 1 -- 172.21.15.44:0/2306391416 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 6500+0+0 (secure 0 0 0) 0x7f11b80864a0 con 0x7f11c8070e70 2024-04-17T19:46:59.899 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:59.910+0000 7f11bd400640 1 --2- 172.21.15.44:0/2306391416 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f11a4068380 0x7f11a406a890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:46:59.899 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:59.910+0000 7f11bd400640 1 --2- 172.21.15.44:0/2306391416 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f11a4068380 0x7f11a406a890 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f11b00ad000 tx=0x7f11b00a6000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:46:59.902 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:46:59.910+0000 7f11bea00640 1 -- 172.21.15.44:0/2306391416 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f11b8021020 con 0x7f11c8070e70 2024-04-17T19:47:00.067 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:00.078+0000 7f11cd000640 1 -- 172.21.15.44:0/2306391416 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"} v 0) -- 0x7f11c80cad40 con 0x7f11c8070e70 2024-04-17T19:47:00.695 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:00.706+0000 7f11bea00640 1 -- 172.21.15.44:0/2306391416 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]=0 set pool 4 allow_ec_overwrites to true v24) ==== 169+0+0 (secure 0 0 0) 0x7f11b8056160 con 0x7f11c8070e70 2024-04-17T19:47:00.695 INFO:teuthology.orchestra.run.smithi044.stderr:set pool 4 allow_ec_overwrites to true 2024-04-17T19:47:00.697 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:00.706+0000 7f11cd000640 1 -- 172.21.15.44:0/2306391416 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f11a4068380 msgr2=0x7f11a406a890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:00.698 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:00.706+0000 7f11cd000640 1 --2- 172.21.15.44:0/2306391416 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f11a4068380 0x7f11a406a890 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f11b00ad000 tx=0x7f11b00a6000 comp rx=0 tx=0).stop 2024-04-17T19:47:00.698 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:00.706+0000 7f11cd000640 1 -- 172.21.15.44:0/2306391416 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f11c8070e70 msgr2=0x7f11c815cb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:00.698 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:00.706+0000 7f11cd000640 1 --2- 172.21.15.44:0/2306391416 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f11c8070e70 0x7f11c815cb60 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f11b800c3f0 tx=0x7f11b800c8b0 comp rx=0 tx=0).stop 2024-04-17T19:47:00.698 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:00.706+0000 7f11cd000640 1 -- 172.21.15.44:0/2306391416 shutdown_connections 2024-04-17T19:47:00.698 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:00.706+0000 7f11cd000640 1 --2- 172.21.15.44:0/2306391416 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f11a4068380 0x7f11a406a890 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:00.698 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:00.706+0000 7f11cd000640 1 --2- 172.21.15.44:0/2306391416 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f11c80c55d0 0x7f11c80c6ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:00.698 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:00.706+0000 7f11cd000640 1 --2- 172.21.15.44:0/2306391416 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f11c8152450 0x7f11c81f8580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:00.698 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:00.706+0000 7f11cd000640 1 --2- 172.21.15.44:0/2306391416 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f11c8070e70 0x7f11c815cb60 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:00.698 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:00.706+0000 7f11cd000640 1 -- 172.21.15.44:0/2306391416 >> 172.21.15.44:0/2306391416 conn(0x7f11c80cebd0 msgr2=0x7f11c80cdec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:47:00.698 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:00.706+0000 7f11cd000640 1 -- 172.21.15.44:0/2306391416 shutdown_connections 2024-04-17T19:47:00.698 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:00.706+0000 7f11cd000640 1 -- 172.21.15.44:0/2306391416 wait complete. 2024-04-17T19:47:00.744 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs add_data_pool cephfs cephfs_data_ec 2024-04-17T19:47:00.907 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:00.918+0000 7f1b51800640 1 Processor -- start 2024-04-17T19:47:00.907 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:00.918+0000 7f1b51800640 1 -- start start 2024-04-17T19:47:00.909 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:00.918+0000 7f1b51800640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f1b4c1596e0 0x7f1b4c15d390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:00.909 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:00.918+0000 7f1b51800640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f1b4c15d8d0 0x7f1b4c0ccdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:00.910 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:00.918+0000 7f1b51800640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1b4c159b90 con 0x7f1b4c153870 2024-04-17T19:47:00.910 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:00.918+0000 7f1b51800640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 -- 0x7f1b4c15cf00 con 0x7f1b4c1596e0 2024-04-17T19:47:00.910 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:00.918+0000 7f1b51800640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 -- 0x7f1b4c159e70 con 0x7f1b4c15d8d0 2024-04-17T19:47:00.910 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:00.918+0000 7f1b4aa00640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f1b4c1596e0 0x7f1b4c15d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:00.910 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:00.918+0000 7f1b4aa00640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f1b4c1596e0 0x7f1b4c15d390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:47486/0 (socket says 172.21.15.44:47486) 2024-04-17T19:47:00.910 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:00.918+0000 7f1b4aa00640 1 -- 172.21.15.44:0/1623152042 learned_addr learned my addr 172.21.15.44:0/1623152042 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-04-17T19:47:00.910 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:00.918+0000 7f1b42000640 1 --2- 172.21.15.44:0/1623152042 >> v2:172.21.15.62:3300/0 conn(0x7f1b4c15d8d0 0x7f1b4c0ccdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:00.911 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:00.918+0000 7f1b4aa00640 1 -- 172.21.15.44:0/1623152042 >> v2:172.21.15.62:3300/0 conn(0x7f1b4c15d8d0 msgr2=0x7f1b4c0ccdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T19:47:00.911 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:00.918+0000 7f1b4aa00640 1 --2- 172.21.15.44:0/1623152042 >> v2:172.21.15.62:3300/0 conn(0x7f1b4c15d8d0 0x7f1b4c0ccdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:00.911 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:00.918+0000 7f1b4aa00640 1 -- 172.21.15.44:0/1623152042 >> v1:172.21.15.62:6789/0 conn(0x7f1b4c153870 legacy=0x7f1b4c06ffc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T19:47:00.911 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:00.918+0000 7f1b4aa00640 1 -- 172.21.15.44:0/1623152042 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1b4c15a150 con 0x7f1b4c1596e0 2024-04-17T19:47:00.912 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:00.922+0000 7f1b4aa00640 1 --2- 172.21.15.44:0/1623152042 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1b4c1596e0 0x7f1b4c15d390 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f1b4c06cdd0 tx=0x7f1b3c01ecd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fef10a4b89f5b59d server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:47:00.913 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:00.922+0000 7f1b4a000640 1 -- 172.21.15.44:0/1623152042 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b3c0b5070 con 0x7f1b4c1596e0 2024-04-17T19:47:00.913 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:00.922+0000 7f1b4a000640 1 -- 172.21.15.44:0/1623152042 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1b3c0a89d0 con 0x7f1b4c1596e0 2024-04-17T19:47:00.913 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:00.922+0000 7f1b4a000640 1 -- 172.21.15.44:0/1623152042 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b3c0a8da0 con 0x7f1b4c1596e0 2024-04-17T19:47:00.914 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:00.922+0000 7f1b51800640 1 -- 172.21.15.44:0/1623152042 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1b4c1596e0 msgr2=0x7f1b4c15d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:00.914 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:00.922+0000 7f1b51800640 1 --2- 172.21.15.44:0/1623152042 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1b4c1596e0 0x7f1b4c15d390 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f1b4c06cdd0 tx=0x7f1b3c01ecd0 comp rx=0 tx=0).stop 2024-04-17T19:47:00.914 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:00.922+0000 7f1b51800640 1 -- 172.21.15.44:0/1623152042 shutdown_connections 2024-04-17T19:47:00.914 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:00.922+0000 7f1b51800640 1 --2- 172.21.15.44:0/1623152042 >> v2:172.21.15.62:3300/0 conn(0x7f1b4c15d8d0 0x7f1b4c0ccdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:00.914 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:00.922+0000 7f1b51800640 1 --2- 172.21.15.44:0/1623152042 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1b4c1596e0 0x7f1b4c15d390 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:00.914 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:00.922+0000 7f1b51800640 1 -- 172.21.15.44:0/1623152042 >> 172.21.15.44:0/1623152042 conn(0x7f1b4c06c180 msgr2=0x7f1b4c06c5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:47:00.914 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:00.922+0000 7f1b51800640 1 -- 172.21.15.44:0/1623152042 shutdown_connections 2024-04-17T19:47:00.914 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:00.922+0000 7f1b51800640 1 -- 172.21.15.44:0/1623152042 wait complete. 2024-04-17T19:47:00.916 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:00.926+0000 7f1b51800640 1 Processor -- start 2024-04-17T19:47:00.916 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:00.926+0000 7f1b51800640 1 -- start start 2024-04-17T19:47:00.918 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:00.926+0000 7f1b51800640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f1b4c153870 0x7f1b4c13f700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:00.918 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:00.926+0000 7f1b51800640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1b4c1596e0 0x7f1b4c158900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:00.918 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:00.926+0000 7f1b51800640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1b4c15d8d0 0x7f1b4c158e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:00.918 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:00.926+0000 7f1b51800640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f1b4c072540 con 0x7f1b4c1596e0 2024-04-17T19:47:00.918 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:00.926+0000 7f1b51800640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f1b4c0c8660 con 0x7f1b4c15d8d0 2024-04-17T19:47:00.919 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:00.926+0000 7f1b51800640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7f1b4c0c91a0 con 0x7f1b4c153870 2024-04-17T19:47:00.919 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:00.926+0000 7f1b42000640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1b4c1596e0 0x7f1b4c158900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:00.919 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:00.926+0000 7f1b42000640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1b4c1596e0 0x7f1b4c158900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:47492/0 (socket says 172.21.15.44:47492) 2024-04-17T19:47:00.919 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:00.926+0000 7f1b42000640 1 -- 172.21.15.44:0/2385602827 learned_addr learned my addr 172.21.15.44:0/2385602827 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-04-17T19:47:00.919 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:00.926+0000 7f1b4aa00640 1 --2- 172.21.15.44:0/2385602827 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f1b4c153870 0x7f1b4c13f700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:00.919 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:00.926+0000 7f1b4b400640 1 --2- 172.21.15.44:0/2385602827 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1b4c15d8d0 0x7f1b4c158e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:00.919 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:00.930+0000 7f1b42000640 1 -- 172.21.15.44:0/2385602827 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f1b4c153870 msgr2=0x7f1b4c13f700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:00.919 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:00.930+0000 7f1b42000640 1 --2- 172.21.15.44:0/2385602827 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f1b4c153870 0x7f1b4c13f700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:00.919 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:00.930+0000 7f1b42000640 1 -- 172.21.15.44:0/2385602827 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1b4c15d8d0 msgr2=0x7f1b4c158e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:00.919 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:00.930+0000 7f1b42000640 1 --2- 172.21.15.44:0/2385602827 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1b4c15d8d0 0x7f1b4c158e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:00.919 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:00.930+0000 7f1b42000640 1 -- 172.21.15.44:0/2385602827 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1b4c151560 con 0x7f1b4c1596e0 2024-04-17T19:47:00.919 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:00.930+0000 7f1b42000640 1 --2- 172.21.15.44:0/2385602827 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1b4c1596e0 0x7f1b4c158900 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f1b3400d7d0 tx=0x7f1b3400dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:47:00.920 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:00.930+0000 7f1b43400640 1 -- 172.21.15.44:0/2385602827 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b3400b660 con 0x7f1b4c1596e0 2024-04-17T19:47:00.920 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:00.930+0000 7f1b43400640 1 -- 172.21.15.44:0/2385602827 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1b34019070 con 0x7f1b4c1596e0 2024-04-17T19:47:00.920 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:00.930+0000 7f1b51800640 1 -- 172.21.15.44:0/2385602827 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1b4c13fc40 con 0x7f1b4c1596e0 2024-04-17T19:47:00.920 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:00.930+0000 7f1b43400640 1 -- 172.21.15.44:0/2385602827 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b3400ba20 con 0x7f1b4c1596e0 2024-04-17T19:47:00.920 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:00.930+0000 7f1b51800640 1 -- 172.21.15.44:0/2385602827 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1b4c1517d0 con 0x7f1b4c1596e0 2024-04-17T19:47:00.920 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:00.930+0000 7f1b51800640 1 -- 172.21.15.44:0/2385602827 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1b4c04fea0 con 0x7f1b4c1596e0 2024-04-17T19:47:00.921 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:00.930+0000 7f1b43400640 1 -- 172.21.15.44:0/2385602827 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f1b3400bbc0 con 0x7f1b4c1596e0 2024-04-17T19:47:00.921 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:00.930+0000 7f1b43400640 1 --2- 172.21.15.44:0/2385602827 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f1b280683b0 0x7f1b2806a8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:00.922 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:00.930+0000 7f1b43400640 1 -- 172.21.15.44:0/2385602827 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6500+0+0 (secure 0 0 0) 0x7f1b34087170 con 0x7f1b4c1596e0 2024-04-17T19:47:00.922 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:00.934+0000 7f1b4aa00640 1 --2- 172.21.15.44:0/2385602827 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f1b280683b0 0x7f1b2806a8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:00.923 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:00.934+0000 7f1b4aa00640 1 --2- 172.21.15.44:0/2385602827 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f1b280683b0 0x7f1b2806a8c0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f1b3c0b2000 tx=0x7f1b3c008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:47:00.927 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:00.938+0000 7f1b43400640 1 -- 172.21.15.44:0/2385602827 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f1b340572e0 con 0x7f1b4c1596e0 2024-04-17T19:47:01.125 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:01.134+0000 7f1b51800640 1 -- 172.21.15.44:0/2385602827 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"} v 0) -- 0x7f1b4c0c7820 con 0x7f1b4c1596e0 2024-04-17T19:47:01.708 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:01.718+0000 7f1b43400640 1 -- 172.21.15.44:0/2385602827 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]=0 added data pool 4 to fsmap v5) ==== 137+0+0 (secure 0 0 0) 0x7f1b34056be0 con 0x7f1b4c1596e0 2024-04-17T19:47:01.708 INFO:teuthology.orchestra.run.smithi044.stderr:added data pool 4 to fsmap 2024-04-17T19:47:01.711 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:01.722+0000 7f1b51800640 1 -- 172.21.15.44:0/2385602827 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f1b280683b0 msgr2=0x7f1b2806a8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:01.711 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:01.722+0000 7f1b51800640 1 --2- 172.21.15.44:0/2385602827 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f1b280683b0 0x7f1b2806a8c0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f1b3c0b2000 tx=0x7f1b3c008040 comp rx=0 tx=0).stop 2024-04-17T19:47:01.711 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:01.722+0000 7f1b51800640 1 -- 172.21.15.44:0/2385602827 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1b4c1596e0 msgr2=0x7f1b4c158900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:01.711 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:01.722+0000 7f1b51800640 1 --2- 172.21.15.44:0/2385602827 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1b4c1596e0 0x7f1b4c158900 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f1b3400d7d0 tx=0x7f1b3400dc90 comp rx=0 tx=0).stop 2024-04-17T19:47:01.711 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:01.722+0000 7f1b51800640 1 -- 172.21.15.44:0/2385602827 shutdown_connections 2024-04-17T19:47:01.711 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:01.722+0000 7f1b51800640 1 --2- 172.21.15.44:0/2385602827 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f1b280683b0 0x7f1b2806a8c0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:01.711 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:01.722+0000 7f1b51800640 1 --2- 172.21.15.44:0/2385602827 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1b4c15d8d0 0x7f1b4c158e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:01.711 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:01.722+0000 7f1b51800640 1 --2- 172.21.15.44:0/2385602827 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1b4c1596e0 0x7f1b4c158900 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:01.711 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:01.722+0000 7f1b51800640 1 --2- 172.21.15.44:0/2385602827 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f1b4c153870 0x7f1b4c13f700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:01.711 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:01.722+0000 7f1b51800640 1 -- 172.21.15.44:0/2385602827 >> 172.21.15.44:0/2385602827 conn(0x7f1b4c06c180 msgr2=0x7f1b4c0c7a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:47:01.712 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:01.722+0000 7f1b51800640 1 -- 172.21.15.44:0/2385602827 shutdown_connections 2024-04-17T19:47:01.712 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:01.722+0000 7f1b51800640 1 -- 172.21.15.44:0/2385602827 wait complete. 2024-04-17T19:47:01.732 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-17T19:47:01.886 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:01.894+0000 7f1db7e00640 1 Processor -- start 2024-04-17T19:47:01.886 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:01.894+0000 7f1db7e00640 1 -- start start 2024-04-17T19:47:01.888 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:01.898+0000 7f1db7e00640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f1db80c9b60 0x7f1db815c370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:01.888 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:01.898+0000 7f1db7e00640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f1db8070750 0x7f1db8070b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:01.888 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:01.898+0000 7f1db7e00640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f1db80caf60 0x7f1db80cb370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:01.888 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:01.898+0000 7f1db7e00640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 -- 0x7f1db815f5b0 con 0x7f1db8070750 2024-04-17T19:47:01.888 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:01.898+0000 7f1db7e00640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 -- 0x7f1db815f890 con 0x7f1db80c9b60 2024-04-17T19:47:01.888 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:01.898+0000 7f1db7e00640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7f1db815fb70 con 0x7f1db80caf60 2024-04-17T19:47:01.888 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:01.898+0000 7f1dae000640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f1db8070750 0x7f1db8070b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:01.888 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:01.898+0000 7f1dae000640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f1db8070750 0x7f1db8070b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:47504/0 (socket says 172.21.15.44:47504) 2024-04-17T19:47:01.888 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:01.898+0000 7f1dae000640 1 -- 172.21.15.44:0/1171974283 learned_addr learned my addr 172.21.15.44:0/1171974283 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-04-17T19:47:01.888 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:01.898+0000 7f1db7400640 1 --2- 172.21.15.44:0/1171974283 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f1db80caf60 0x7f1db80cb370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:01.889 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:01.898+0000 7f1db6a00640 1 --2- 172.21.15.44:0/1171974283 >> v2:172.21.15.62:3300/0 conn(0x7f1db80c9b60 0x7f1db815c370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:01.889 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:01.898+0000 7f1dae000640 1 -- 172.21.15.44:0/1171974283 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f1db80caf60 msgr2=0x7f1db80cb370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T19:47:01.889 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:01.898+0000 7f1dae000640 1 --2- 172.21.15.44:0/1171974283 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f1db80caf60 0x7f1db80cb370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:01.889 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:01.898+0000 7f1dae000640 1 -- 172.21.15.44:0/1171974283 >> v2:172.21.15.62:3300/0 conn(0x7f1db80c9b60 msgr2=0x7f1db815c370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T19:47:01.889 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:01.898+0000 7f1dae000640 1 --2- 172.21.15.44:0/1171974283 >> v2:172.21.15.62:3300/0 conn(0x7f1db80c9b60 0x7f1db815c370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:01.889 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:01.898+0000 7f1dae000640 1 -- 172.21.15.44:0/1171974283 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1db815fe50 con 0x7f1db8070750 2024-04-17T19:47:01.891 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:01.902+0000 7f1dae000640 1 --2- 172.21.15.44:0/1171974283 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1db8070750 0x7f1db8070b60 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f1db80ced90 tx=0x7f1da001ed10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=630bf7b0413656b7 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:47:01.891 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:01.902+0000 7f1db6000640 1 -- 172.21.15.44:0/1171974283 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1da00b5070 con 0x7f1db8070750 2024-04-17T19:47:01.891 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:01.902+0000 7f1db6000640 1 -- 172.21.15.44:0/1171974283 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1da00a89d0 con 0x7f1db8070750 2024-04-17T19:47:01.891 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:01.902+0000 7f1db6000640 1 -- 172.21.15.44:0/1171974283 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1da00a8da0 con 0x7f1db8070750 2024-04-17T19:47:01.892 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:01.902+0000 7f1db7e00640 1 -- 172.21.15.44:0/1171974283 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1db8070750 msgr2=0x7f1db8070b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:01.892 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:01.902+0000 7f1db7e00640 1 --2- 172.21.15.44:0/1171974283 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1db8070750 0x7f1db8070b60 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f1db80ced90 tx=0x7f1da001ed10 comp rx=0 tx=0).stop 2024-04-17T19:47:01.892 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:01.902+0000 7f1db7e00640 1 -- 172.21.15.44:0/1171974283 shutdown_connections 2024-04-17T19:47:01.892 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:01.902+0000 7f1db7e00640 1 --2- 172.21.15.44:0/1171974283 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1db8070750 0x7f1db8070b60 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:01.892 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:01.902+0000 7f1db7e00640 1 --2- 172.21.15.44:0/1171974283 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f1db80caf60 0x7f1db80cb370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:01.892 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:01.902+0000 7f1db7e00640 1 --2- 172.21.15.44:0/1171974283 >> v2:172.21.15.62:3300/0 conn(0x7f1db80c9b60 0x7f1db815c370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:01.892 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:01.902+0000 7f1db7e00640 1 -- 172.21.15.44:0/1171974283 >> 172.21.15.44:0/1171974283 conn(0x7f1db80680e0 msgr2=0x7f1db80684f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:47:01.893 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:01.902+0000 7f1db7e00640 1 -- 172.21.15.44:0/1171974283 shutdown_connections 2024-04-17T19:47:01.893 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:01.902+0000 7f1db7e00640 1 -- 172.21.15.44:0/1171974283 wait complete. 2024-04-17T19:47:01.894 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:01.906+0000 7f1db7e00640 1 Processor -- start 2024-04-17T19:47:01.894 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:01.906+0000 7f1db7e00640 1 -- start start 2024-04-17T19:47:01.897 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:01.906+0000 7f1db7e00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1db8070750 0x7f1db80cb880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:01.897 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:01.906+0000 7f1db7e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1db80c9b60 0x7f1db80cbdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:01.897 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:01.906+0000 7f1db7e00640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f1db80caf60 0x7f1db80aea60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:01.897 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:01.906+0000 7f1db7e00640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f1db80ca390 con 0x7f1db80c9b60 2024-04-17T19:47:01.898 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:01.906+0000 7f1db7e00640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f1db815bb00 con 0x7f1db8070750 2024-04-17T19:47:01.898 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:01.906+0000 7f1db7e00640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7f1db806ee90 con 0x7f1db80caf60 2024-04-17T19:47:01.898 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:01.906+0000 7f1dae000640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1db80c9b60 0x7f1db80cbdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:01.898 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:01.906+0000 7f1dae000640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1db80c9b60 0x7f1db80cbdc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:47510/0 (socket says 172.21.15.44:47510) 2024-04-17T19:47:01.898 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:01.906+0000 7f1dae000640 1 -- 172.21.15.44:0/331689225 learned_addr learned my addr 172.21.15.44:0/331689225 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-04-17T19:47:01.898 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:01.906+0000 7f1db6a00640 1 --2- 172.21.15.44:0/331689225 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1db8070750 0x7f1db80cb880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:01.898 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:01.906+0000 7f1db7400640 1 --2- 172.21.15.44:0/331689225 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f1db80caf60 0x7f1db80aea60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:01.898 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:01.906+0000 7f1dae000640 1 -- 172.21.15.44:0/331689225 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f1db80caf60 msgr2=0x7f1db80aea60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:01.898 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:01.906+0000 7f1dae000640 1 --2- 172.21.15.44:0/331689225 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f1db80caf60 0x7f1db80aea60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:01.898 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:01.906+0000 7f1dae000640 1 -- 172.21.15.44:0/331689225 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1db8070750 msgr2=0x7f1db80cb880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:01.898 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:01.906+0000 7f1dae000640 1 --2- 172.21.15.44:0/331689225 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1db8070750 0x7f1db80cb880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:01.898 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:01.906+0000 7f1dae000640 1 -- 172.21.15.44:0/331689225 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1db8157090 con 0x7f1db80c9b60 2024-04-17T19:47:01.898 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:01.906+0000 7f1dae000640 1 --2- 172.21.15.44:0/331689225 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1db80c9b60 0x7f1db80cbdc0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f1da00b3040 tx=0x7f1da001bab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:47:01.899 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:01.906+0000 7f1dafe00640 1 -- 172.21.15.44:0/331689225 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1da00b5070 con 0x7f1db80c9b60 2024-04-17T19:47:01.899 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:01.906+0000 7f1dafe00640 1 -- 172.21.15.44:0/331689225 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1da00b0a50 con 0x7f1db80c9b60 2024-04-17T19:47:01.899 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:01.906+0000 7f1db7e00640 1 -- 172.21.15.44:0/331689225 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1db8156a70 con 0x7f1db80c9b60 2024-04-17T19:47:01.899 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:01.906+0000 7f1dafe00640 1 -- 172.21.15.44:0/331689225 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1da00b0e20 con 0x7f1db80c9b60 2024-04-17T19:47:01.899 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:01.906+0000 7f1db7e00640 1 -- 172.21.15.44:0/331689225 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1db81f5440 con 0x7f1db80c9b60 2024-04-17T19:47:01.899 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:01.910+0000 7f1db7e00640 1 -- 172.21.15.44:0/331689225 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1db804fea0 con 0x7f1db80c9b60 2024-04-17T19:47:01.899 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:01.910+0000 7f1dafe00640 1 -- 172.21.15.44:0/331689225 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f1da00c2060 con 0x7f1db80c9b60 2024-04-17T19:47:01.900 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:01.910+0000 7f1dafe00640 1 --2- 172.21.15.44:0/331689225 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f1d94068380 0x7f1d9406a890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:01.900 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:01.910+0000 7f1dafe00640 1 -- 172.21.15.44:0/331689225 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f1da0123ed0 con 0x7f1db80c9b60 2024-04-17T19:47:01.901 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:01.910+0000 7f1db6a00640 1 --2- 172.21.15.44:0/331689225 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f1d94068380 0x7f1d9406a890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:01.901 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:01.910+0000 7f1db6a00640 1 --2- 172.21.15.44:0/331689225 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f1d94068380 0x7f1d9406a890 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f1da800b970 tx=0x7f1da8008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:47:01.904 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:01.914+0000 7f1dafe00640 1 -- 172.21.15.44:0/331689225 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f1da0018870 con 0x7f1db80c9b60 2024-04-17T19:47:02.102 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:02.114+0000 7f1db7e00640 1 -- 172.21.15.44:0/331689225 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f1db806d3c0 con 0x7f1db80c9b60 2024-04-17T19:47:02.103 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:02.114+0000 7f1dafe00640 1 -- 172.21.15.44:0/331689225 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) ==== 93+0+6825 (secure 0 0 0) 0x7f1da00c2350 con 0x7f1db80c9b60 2024-04-17T19:47:02.103 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-04-17T19:47:02.103 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4263,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.44:6835/1724891996","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6832","nonce":1724891996},{"type":"v1","addr":"172.21.15.44:6835","nonce":1724891996}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4266,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.44:6836/2201911513","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6833","nonce":2201911513},{"type":"v1","addr":"172.21.15.44:6836","nonce":2201911513}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4268,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.62:6837/3085335335","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6836","nonce":3085335335},{"type":"v1","addr":"172.21.15.62:6837","nonce":3085335335}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4269,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.44:6837/4073536070","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6834","nonce":4073536070},{"type":"v1","addr":"172.21.15.44:6837","nonce":4073536070}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4294,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.62:6835/2585862759","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6834","nonce":2585862759},{"type":"v1","addr":"172.21.15.62:6835","nonce":2585862759}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":5,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-17T19:46:56.083202+0000","modified":"2024-04-17T19:47:01.710184+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4306},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4306":{"gid":4306,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":5,"addr":"172.21.15.62:6839/1537667111","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6838","nonce":1537667111},{"type":"v1","addr":"172.21.15.62:6839","nonce":1537667111}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":4306,"qdb_cluster":[4306]},"id":1}]} 2024-04-17T19:47:02.103 INFO:teuthology.orchestra.run.smithi044.stderr:dumped fsmap epoch 6 2024-04-17T19:47:02.105 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:02.114+0000 7f1db7e00640 1 -- 172.21.15.44:0/331689225 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f1d94068380 msgr2=0x7f1d9406a890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:02.105 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:02.114+0000 7f1db7e00640 1 --2- 172.21.15.44:0/331689225 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f1d94068380 0x7f1d9406a890 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f1da800b970 tx=0x7f1da8008040 comp rx=0 tx=0).stop 2024-04-17T19:47:02.105 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:02.114+0000 7f1db7e00640 1 -- 172.21.15.44:0/331689225 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1db80c9b60 msgr2=0x7f1db80cbdc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:02.105 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:02.114+0000 7f1db7e00640 1 --2- 172.21.15.44:0/331689225 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1db80c9b60 0x7f1db80cbdc0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f1da00b3040 tx=0x7f1da001bab0 comp rx=0 tx=0).stop 2024-04-17T19:47:02.105 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:02.114+0000 7f1db7e00640 1 -- 172.21.15.44:0/331689225 shutdown_connections 2024-04-17T19:47:02.106 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:02.114+0000 7f1db7e00640 1 --2- 172.21.15.44:0/331689225 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f1d94068380 0x7f1d9406a890 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:02.106 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:02.114+0000 7f1db7e00640 1 --2- 172.21.15.44:0/331689225 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f1db80caf60 0x7f1db80aea60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:02.106 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:02.114+0000 7f1db7e00640 1 --2- 172.21.15.44:0/331689225 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1db80c9b60 0x7f1db80cbdc0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:02.106 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:02.114+0000 7f1db7e00640 1 --2- 172.21.15.44:0/331689225 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1db8070750 0x7f1db80cb880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:02.106 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:02.114+0000 7f1db7e00640 1 -- 172.21.15.44:0/331689225 >> 172.21.15.44:0/331689225 conn(0x7f1db80680e0 msgr2=0x7f1db8159970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:47:02.106 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:02.114+0000 7f1db7e00640 1 -- 172.21.15.44:0/331689225 shutdown_connections 2024-04-17T19:47:02.106 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:02.114+0000 7f1db7e00640 1 -- 172.21.15.44:0/331689225 wait complete. 2024-04-17T19:47:02.125 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-17T19:47:02.276 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:02.286+0000 7fb854c00640 1 Processor -- start 2024-04-17T19:47:02.276 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:02.286+0000 7fb854c00640 1 -- start start 2024-04-17T19:47:02.279 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:02.290+0000 7fb854c00640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fb8500c3ed0 0x7fb85015fb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:02.279 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:02.290+0000 7fb854c00640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fb850155de0 0x7fb8500c5800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:02.279 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:02.290+0000 7fb854c00640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fb8500c5d40 0x7fb850072760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:02.279 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:02.290+0000 7fb854c00640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 -- 0x7fb8500c6d80 con 0x7fb8500c5d40 2024-04-17T19:47:02.279 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:02.290+0000 7fb854c00640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 -- 0x7fb8500c6770 con 0x7fb8500c3ed0 2024-04-17T19:47:02.279 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:02.290+0000 7fb854c00640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7fb8500737e0 con 0x7fb850155de0 2024-04-17T19:47:02.279 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:02.290+0000 7fb84e800640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fb8500c5d40 0x7fb850072760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:02.279 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:02.290+0000 7fb84e800640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fb8500c5d40 0x7fb850072760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:47516/0 (socket says 172.21.15.44:47516) 2024-04-17T19:47:02.279 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:02.290+0000 7fb84e800640 1 -- 172.21.15.44:0/1254986861 learned_addr learned my addr 172.21.15.44:0/1254986861 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-04-17T19:47:02.279 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:02.290+0000 7fb847e00640 1 --2- 172.21.15.44:0/1254986861 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fb850155de0 0x7fb8500c5800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:02.280 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:02.290+0000 7fb84de00640 1 --2- 172.21.15.44:0/1254986861 >> v2:172.21.15.62:3300/0 conn(0x7fb8500c3ed0 0x7fb85015fb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:02.280 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:02.290+0000 7fb84e800640 1 -- 172.21.15.44:0/1254986861 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fb850155de0 msgr2=0x7fb8500c5800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T19:47:02.280 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:02.290+0000 7fb84e800640 1 --2- 172.21.15.44:0/1254986861 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fb850155de0 0x7fb8500c5800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:02.280 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:02.290+0000 7fb84e800640 1 -- 172.21.15.44:0/1254986861 >> v2:172.21.15.62:3300/0 conn(0x7fb8500c3ed0 msgr2=0x7fb85015fb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T19:47:02.280 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:02.290+0000 7fb84e800640 1 --2- 172.21.15.44:0/1254986861 >> v2:172.21.15.62:3300/0 conn(0x7fb8500c3ed0 0x7fb85015fb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:02.280 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:02.290+0000 7fb84e800640 1 -- 172.21.15.44:0/1254986861 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb850073a90 con 0x7fb8500c5d40 2024-04-17T19:47:02.281 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:02.290+0000 7fb84e800640 1 --2- 172.21.15.44:0/1254986861 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb8500c5d40 0x7fb850072760 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fb850072060 tx=0x7fb84801c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=333a431d1f2ff53a server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:47:02.282 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:02.294+0000 7fb84d400640 1 -- 172.21.15.44:0/1254986861 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8480a5670 con 0x7fb8500c5d40 2024-04-17T19:47:02.282 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:02.294+0000 7fb84d400640 1 -- 172.21.15.44:0/1254986861 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb8480a5810 con 0x7fb8500c5d40 2024-04-17T19:47:02.282 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:02.294+0000 7fb84d400640 1 -- 172.21.15.44:0/1254986861 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8480a5be0 con 0x7fb8500c5d40 2024-04-17T19:47:02.283 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:02.294+0000 7fb854c00640 1 -- 172.21.15.44:0/1254986861 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb8500c5d40 msgr2=0x7fb850072760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:02.283 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:02.294+0000 7fb854c00640 1 --2- 172.21.15.44:0/1254986861 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb8500c5d40 0x7fb850072760 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fb850072060 tx=0x7fb84801c9f0 comp rx=0 tx=0).stop 2024-04-17T19:47:02.283 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:02.294+0000 7fb854c00640 1 -- 172.21.15.44:0/1254986861 shutdown_connections 2024-04-17T19:47:02.283 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:02.294+0000 7fb854c00640 1 --2- 172.21.15.44:0/1254986861 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb8500c5d40 0x7fb850072760 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:02.283 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:02.294+0000 7fb854c00640 1 --2- 172.21.15.44:0/1254986861 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fb850155de0 0x7fb8500c5800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:02.283 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:02.294+0000 7fb854c00640 1 --2- 172.21.15.44:0/1254986861 >> v2:172.21.15.62:3300/0 conn(0x7fb8500c3ed0 0x7fb85015fb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:02.283 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:02.294+0000 7fb854c00640 1 -- 172.21.15.44:0/1254986861 >> 172.21.15.44:0/1254986861 conn(0x7fb85006c380 msgr2=0x7fb850070080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:47:02.284 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:02.294+0000 7fb854c00640 1 -- 172.21.15.44:0/1254986861 shutdown_connections 2024-04-17T19:47:02.284 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:02.294+0000 7fb854c00640 1 -- 172.21.15.44:0/1254986861 wait complete. 2024-04-17T19:47:02.285 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:02.294+0000 7fb854c00640 1 Processor -- start 2024-04-17T19:47:02.285 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:02.294+0000 7fb854c00640 1 -- start start 2024-04-17T19:47:02.287 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:02.298+0000 7fb854c00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb8500c3ed0 0x7fb8501538a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:02.287 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:02.298+0000 7fb854c00640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fb8500c5d40 0x7fb85013f390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:02.287 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:02.298+0000 7fb854c00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb850155de0 0x7fb850143300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:02.287 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:02.298+0000 7fb854c00640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fb85015c360 con 0x7fb850155de0 2024-04-17T19:47:02.287 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:02.298+0000 7fb854c00640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7fb8501561f0 con 0x7fb8500c3ed0 2024-04-17T19:47:02.287 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:02.298+0000 7fb854c00640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7fb85015c4e0 con 0x7fb8500c5d40 2024-04-17T19:47:02.287 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:02.298+0000 7fb84e800640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb850155de0 0x7fb850143300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:02.287 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:02.298+0000 7fb84e800640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb850155de0 0x7fb850143300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:47528/0 (socket says 172.21.15.44:47528) 2024-04-17T19:47:02.287 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:02.298+0000 7fb84e800640 1 -- 172.21.15.44:0/4081046065 learned_addr learned my addr 172.21.15.44:0/4081046065 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-04-17T19:47:02.287 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:02.298+0000 7fb847e00640 1 --2- 172.21.15.44:0/4081046065 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fb8500c5d40 0x7fb85013f390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:02.287 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:02.298+0000 7fb84de00640 1 --2- 172.21.15.44:0/4081046065 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb8500c3ed0 0x7fb8501538a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:02.288 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:02.298+0000 7fb84e800640 1 -- 172.21.15.44:0/4081046065 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fb8500c5d40 msgr2=0x7fb85013f390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:02.288 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:02.298+0000 7fb84e800640 1 --2- 172.21.15.44:0/4081046065 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fb8500c5d40 0x7fb85013f390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:02.289 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:02.298+0000 7fb84e800640 1 -- 172.21.15.44:0/4081046065 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb8500c3ed0 msgr2=0x7fb8501538a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:02.289 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:02.298+0000 7fb84e800640 1 --2- 172.21.15.44:0/4081046065 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb8500c3ed0 0x7fb8501538a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:02.289 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:02.298+0000 7fb84e800640 1 -- 172.21.15.44:0/4081046065 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb850153de0 con 0x7fb850155de0 2024-04-17T19:47:02.289 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:02.298+0000 7fb84de00640 1 --2- 172.21.15.44:0/4081046065 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb8500c3ed0 0x7fb8501538a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-17T19:47:02.289 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:02.298+0000 7fb84e800640 1 --2- 172.21.15.44:0/4081046065 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb850155de0 0x7fb850143300 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fb84801c820 tx=0x7fb85015cb60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:47:02.289 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:02.298+0000 7fb846000640 1 -- 172.21.15.44:0/4081046065 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8480bd020 con 0x7fb850155de0 2024-04-17T19:47:02.289 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:02.298+0000 7fb846000640 1 -- 172.21.15.44:0/4081046065 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb8480b8690 con 0x7fb850155de0 2024-04-17T19:47:02.289 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:02.298+0000 7fb846000640 1 -- 172.21.15.44:0/4081046065 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8480b8a80 con 0x7fb850155de0 2024-04-17T19:47:02.289 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:02.298+0000 7fb854c00640 1 -- 172.21.15.44:0/4081046065 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb85013f8d0 con 0x7fb850155de0 2024-04-17T19:47:02.289 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:02.298+0000 7fb854c00640 1 -- 172.21.15.44:0/4081046065 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb850147630 con 0x7fb850155de0 2024-04-17T19:47:02.289 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:02.298+0000 7fb854c00640 1 -- 172.21.15.44:0/4081046065 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb85004ff10 con 0x7fb850155de0 2024-04-17T19:47:02.290 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:02.302+0000 7fb846000640 1 -- 172.21.15.44:0/4081046065 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fb8480c0070 con 0x7fb850155de0 2024-04-17T19:47:02.291 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:02.302+0000 7fb846000640 1 --2- 172.21.15.44:0/4081046065 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7fb82c068380 0x7fb82c06a890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:02.291 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:02.302+0000 7fb846000640 1 -- 172.21.15.44:0/4081046065 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fb848121350 con 0x7fb850155de0 2024-04-17T19:47:02.291 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:02.302+0000 7fb84de00640 1 --2- 172.21.15.44:0/4081046065 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7fb82c068380 0x7fb82c06a890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:02.292 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:02.302+0000 7fb84de00640 1 --2- 172.21.15.44:0/4081046065 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7fb82c068380 0x7fb82c06a890 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fb8500cdb70 tx=0x7fb840008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:47:02.295 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:02.306+0000 7fb846000640 1 -- 172.21.15.44:0/4081046065 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fb8480165e0 con 0x7fb850155de0 2024-04-17T19:47:02.462 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:02.474+0000 7fb854c00640 1 -- 172.21.15.44:0/4081046065 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fb850143e90 con 0x7fb850155de0 2024-04-17T19:47:02.464 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:02.474+0000 7fb846000640 1 -- 172.21.15.44:0/4081046065 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) ==== 74+0+18482 (secure 0 0 0) 0x7fb8480f1530 con 0x7fb850155de0 2024-04-17T19:47:02.464 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-04-17T19:47:02.464 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":25,"fsid":"703f77ca-79c6-4a66-b576-62c526cb1021","created":"2024-04-17T19:46:30.831994+0000","modified":"2024-04-17T19:47:01.141287+0000","last_up_change":"2024-04-17T19:46:41.988197+0000","last_in_change":"2024-04-17T19:46:33.407430+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-17T19:46:41.940380+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-17T19:46:54.222150+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-17T19:46:55.031694+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-17T19:46:58.707529+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"30520dc6-eea6-43d4-ab60-3ca9e92329dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6800","nonce":1018735925},{"type":"v1","addr":"172.21.15.44:6801","nonce":1018735925}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6802","nonce":1018735925},{"type":"v1","addr":"172.21.15.44:6803","nonce":1018735925}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6806","nonce":1018735925},{"type":"v1","addr":"172.21.15.44:6807","nonce":1018735925}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6804","nonce":1018735925},{"type":"v1","addr":"172.21.15.44:6805","nonce":1018735925}]},"public_addr":"172.21.15.44:6801/1018735925","cluster_addr":"172.21.15.44:6803/1018735925","heartbeat_back_addr":"172.21.15.44:6807/1018735925","heartbeat_front_addr":"172.21.15.44:6805/1018735925","state":["exists","up"]},{"osd":1,"uuid":"079bd511-b6ce-449b-8f11-17b311b12f7c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6817","nonce":1452577434},{"type":"v1","addr":"172.21.15.44:6820","nonce":1452577434}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6823","nonce":1452577434},{"type":"v1","addr":"172.21.15.44:6825","nonce":1452577434}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6830","nonce":1452577434},{"type":"v1","addr":"172.21.15.44:6831","nonce":1452577434}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6828","nonce":1452577434},{"type":"v1","addr":"172.21.15.44:6829","nonce":1452577434}]},"public_addr":"172.21.15.44:6820/1452577434","cluster_addr":"172.21.15.44:6825/1452577434","heartbeat_back_addr":"172.21.15.44:6831/1452577434","heartbeat_front_addr":"172.21.15.44:6829/1452577434","state":["exists","up"]},{"osd":2,"uuid":"34f0b9ab-b1d2-4ee9-841c-f15afbb6bec5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6816","nonce":1160071918},{"type":"v1","addr":"172.21.15.44:6818","nonce":1160071918}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6819","nonce":1160071918},{"type":"v1","addr":"172.21.15.44:6821","nonce":1160071918}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6826","nonce":1160071918},{"type":"v1","addr":"172.21.15.44:6827","nonce":1160071918}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6822","nonce":1160071918},{"type":"v1","addr":"172.21.15.44:6824","nonce":1160071918}]},"public_addr":"172.21.15.44:6818/1160071918","cluster_addr":"172.21.15.44:6821/1160071918","heartbeat_back_addr":"172.21.15.44:6827/1160071918","heartbeat_front_addr":"172.21.15.44:6824/1160071918","state":["exists","up"]},{"osd":3,"uuid":"4740032d-fe34-4b1b-bb85-f430896fc3c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6808","nonce":4236454921},{"type":"v1","addr":"172.21.15.44:6809","nonce":4236454921}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6810","nonce":4236454921},{"type":"v1","addr":"172.21.15.44:6811","nonce":4236454921}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6814","nonce":4236454921},{"type":"v1","addr":"172.21.15.44:6815","nonce":4236454921}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6812","nonce":4236454921},{"type":"v1","addr":"172.21.15.44:6813","nonce":4236454921}]},"public_addr":"172.21.15.44:6809/4236454921","cluster_addr":"172.21.15.44:6811/4236454921","heartbeat_back_addr":"172.21.15.44:6815/4236454921","heartbeat_front_addr":"172.21.15.44:6813/4236454921","state":["exists","up"]},{"osd":4,"uuid":"7dbedb00-302d-4d52-810c-e18839254da1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6800","nonce":2293251376},{"type":"v1","addr":"172.21.15.62:6801","nonce":2293251376}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6802","nonce":2293251376},{"type":"v1","addr":"172.21.15.62:6803","nonce":2293251376}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6806","nonce":2293251376},{"type":"v1","addr":"172.21.15.62:6807","nonce":2293251376}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6804","nonce":2293251376},{"type":"v1","addr":"172.21.15.62:6805","nonce":2293251376}]},"public_addr":"172.21.15.62:6801/2293251376","cluster_addr":"172.21.15.62:6803/2293251376","heartbeat_back_addr":"172.21.15.62:6807/2293251376","heartbeat_front_addr":"172.21.15.62:6805/2293251376","state":["exists","up"]},{"osd":5,"uuid":"38c1e8d9-393d-4f33-a97a-3295cf5c5b07","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6808","nonce":1551020300},{"type":"v1","addr":"172.21.15.62:6809","nonce":1551020300}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6810","nonce":1551020300},{"type":"v1","addr":"172.21.15.62:6811","nonce":1551020300}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6814","nonce":1551020300},{"type":"v1","addr":"172.21.15.62:6815","nonce":1551020300}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6812","nonce":1551020300},{"type":"v1","addr":"172.21.15.62:6813","nonce":1551020300}]},"public_addr":"172.21.15.62:6809/1551020300","cluster_addr":"172.21.15.62:6811/1551020300","heartbeat_back_addr":"172.21.15.62:6815/1551020300","heartbeat_front_addr":"172.21.15.62:6813/1551020300","state":["exists","up"]},{"osd":6,"uuid":"f6ff81c6-f14d-4477-88e3-9116cc5a2992","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6824","nonce":2602310256},{"type":"v1","addr":"172.21.15.62:6825","nonce":2602310256}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6826","nonce":2602310256},{"type":"v1","addr":"172.21.15.62:6827","nonce":2602310256}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6830","nonce":2602310256},{"type":"v1","addr":"172.21.15.62:6831","nonce":2602310256}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6828","nonce":2602310256},{"type":"v1","addr":"172.21.15.62:6829","nonce":2602310256}]},"public_addr":"172.21.15.62:6825/2602310256","cluster_addr":"172.21.15.62:6827/2602310256","heartbeat_back_addr":"172.21.15.62:6831/2602310256","heartbeat_front_addr":"172.21.15.62:6829/2602310256","state":["exists","up"]},{"osd":7,"uuid":"ce395bc3-bcb5-4b94-a523-5bb9df491eca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6816","nonce":2912738359},{"type":"v1","addr":"172.21.15.62:6817","nonce":2912738359}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6818","nonce":2912738359},{"type":"v1","addr":"172.21.15.62:6819","nonce":2912738359}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6822","nonce":2912738359},{"type":"v1","addr":"172.21.15.62:6823","nonce":2912738359}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6820","nonce":2912738359},{"type":"v1","addr":"172.21.15.62:6821","nonce":2912738359}]},"public_addr":"172.21.15.62:6817/2912738359","cluster_addr":"172.21.15.62:6819/2912738359","heartbeat_back_addr":"172.21.15.62:6823/2912738359","heartbeat_front_addr":"172.21.15.62:6821/2912738359","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T19:46:39.302883+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T19:46:39.177705+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T19:46:39.188894+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T19:46:39.313009+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T19:46:38.870508+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T19:46:38.790900+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T19:46:38.979163+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T19:46:38.992348+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-17T19:47:02.466 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:02.474+0000 7fb854c00640 1 -- 172.21.15.44:0/4081046065 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7fb82c068380 msgr2=0x7fb82c06a890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:02.466 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:02.474+0000 7fb854c00640 1 --2- 172.21.15.44:0/4081046065 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7fb82c068380 0x7fb82c06a890 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fb8500cdb70 tx=0x7fb840008040 comp rx=0 tx=0).stop 2024-04-17T19:47:02.466 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:02.474+0000 7fb854c00640 1 -- 172.21.15.44:0/4081046065 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb850155de0 msgr2=0x7fb850143300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:02.467 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:02.474+0000 7fb854c00640 1 --2- 172.21.15.44:0/4081046065 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb850155de0 0x7fb850143300 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fb84801c820 tx=0x7fb85015cb60 comp rx=0 tx=0).stop 2024-04-17T19:47:02.467 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:02.478+0000 7fb854c00640 1 -- 172.21.15.44:0/4081046065 shutdown_connections 2024-04-17T19:47:02.467 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:02.478+0000 7fb854c00640 1 --2- 172.21.15.44:0/4081046065 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7fb82c068380 0x7fb82c06a890 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:02.467 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:02.478+0000 7fb854c00640 1 --2- 172.21.15.44:0/4081046065 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fb8500c5d40 0x7fb85013f390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:02.467 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:02.478+0000 7fb854c00640 1 --2- 172.21.15.44:0/4081046065 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb850155de0 0x7fb850143300 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:02.467 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:02.478+0000 7fb854c00640 1 --2- 172.21.15.44:0/4081046065 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb8500c3ed0 0x7fb8501538a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:02.467 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:02.478+0000 7fb854c00640 1 -- 172.21.15.44:0/4081046065 >> 172.21.15.44:0/4081046065 conn(0x7fb85006c380 msgr2=0x7fb850146860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:47:02.467 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:02.478+0000 7fb854c00640 1 -- 172.21.15.44:0/4081046065 shutdown_connections 2024-04-17T19:47:02.467 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:02.478+0000 7fb854c00640 1 -- 172.21.15.44:0/4081046065 wait complete. 2024-04-17T19:47:02.488 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-17T19:47:02.639 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:02.650+0000 7f2d3f800640 1 Processor -- start 2024-04-17T19:47:02.639 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:02.650+0000 7f2d3f800640 1 -- start start 2024-04-17T19:47:02.641 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:02.650+0000 7f2d3f800640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f2d380cb060 0x7f2d3815d760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:02.641 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:02.650+0000 7f2d3f800640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f2d38159920 0x7f2d38159d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:02.641 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:02.650+0000 7f2d3f800640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2d380ca430 con 0x7f2d381505d0 2024-04-17T19:47:02.641 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:02.650+0000 7f2d3f800640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 -- 0x7f2d381509e0 con 0x7f2d38159920 2024-04-17T19:47:02.641 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:02.650+0000 7f2d3f800640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 -- 0x7f2d380ca710 con 0x7f2d380cb060 2024-04-17T19:47:02.641 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:02.650+0000 7f2d3d800640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f2d38159920 0x7f2d38159d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:02.641 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:02.650+0000 7f2d3d800640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f2d38159920 0x7f2d38159d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:47540/0 (socket says 172.21.15.44:47540) 2024-04-17T19:47:02.641 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:02.650+0000 7f2d3d800640 1 -- 172.21.15.44:0/2684233036 learned_addr learned my addr 172.21.15.44:0/2684233036 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-04-17T19:47:02.641 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:02.650+0000 7f2d3ce00640 1 --2- 172.21.15.44:0/2684233036 >> v2:172.21.15.62:3300/0 conn(0x7f2d380cb060 0x7f2d3815d760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:02.642 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:02.650+0000 7f2d3d800640 1 -- 172.21.15.44:0/2684233036 >> v2:172.21.15.62:3300/0 conn(0x7f2d380cb060 msgr2=0x7f2d3815d760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T19:47:02.642 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:02.650+0000 7f2d3d800640 1 --2- 172.21.15.44:0/2684233036 >> v2:172.21.15.62:3300/0 conn(0x7f2d380cb060 0x7f2d3815d760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:02.642 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:02.650+0000 7f2d3d800640 1 -- 172.21.15.44:0/2684233036 >> v1:172.21.15.62:6789/0 conn(0x7f2d381505d0 legacy=0x7f2d38072630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:02.642 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:02.650+0000 7f2d3d800640 1 -- 172.21.15.44:0/2684233036 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2d380c43b0 con 0x7f2d38159920 2024-04-17T19:47:02.644 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:02.654+0000 7f2d3d800640 1 --2- 172.21.15.44:0/2684233036 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2d38159920 0x7f2d38159d30 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f2d38073ed0 tx=0x7f2d3001f1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=44456e90c3a733e5 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:47:02.644 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:02.654+0000 7f2d37400640 1 -- 172.21.15.44:0/2684233036 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d300b4070 con 0x7f2d38159920 2024-04-17T19:47:02.644 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:02.654+0000 7f2d37400640 1 -- 172.21.15.44:0/2684233036 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2d300af400 con 0x7f2d38159920 2024-04-17T19:47:02.644 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:02.654+0000 7f2d37400640 1 -- 172.21.15.44:0/2684233036 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d300af7d0 con 0x7f2d38159920 2024-04-17T19:47:02.645 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:02.654+0000 7f2d3f800640 1 -- 172.21.15.44:0/2684233036 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2d38159920 msgr2=0x7f2d38159d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:02.645 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:02.654+0000 7f2d3f800640 1 --2- 172.21.15.44:0/2684233036 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2d38159920 0x7f2d38159d30 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f2d38073ed0 tx=0x7f2d3001f1e0 comp rx=0 tx=0).stop 2024-04-17T19:47:02.645 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:02.654+0000 7f2d3f800640 1 -- 172.21.15.44:0/2684233036 shutdown_connections 2024-04-17T19:47:02.646 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:02.654+0000 7f2d3f800640 1 --2- 172.21.15.44:0/2684233036 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2d38159920 0x7f2d38159d30 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:02.646 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:02.654+0000 7f2d3f800640 1 --2- 172.21.15.44:0/2684233036 >> v2:172.21.15.62:3300/0 conn(0x7f2d380cb060 0x7f2d3815d760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:02.646 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:02.654+0000 7f2d3f800640 1 -- 172.21.15.44:0/2684233036 >> 172.21.15.44:0/2684233036 conn(0x7f2d38067eb0 msgr2=0x7f2d380682c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:47:02.646 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:02.654+0000 7f2d3f800640 1 -- 172.21.15.44:0/2684233036 shutdown_connections 2024-04-17T19:47:02.646 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:02.654+0000 7f2d3f800640 1 -- 172.21.15.44:0/2684233036 wait complete. 2024-04-17T19:47:02.647 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:02.658+0000 7f2d3f800640 1 Processor -- start 2024-04-17T19:47:02.647 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:02.658+0000 7f2d3f800640 1 -- start start 2024-04-17T19:47:02.650 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:02.658+0000 7f2d3f800640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f2d380cb060 0x7f2d381f56a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:02.650 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:02.658+0000 7f2d3f800640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2d381505d0 0x7f2d380c4eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:02.650 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:02.658+0000 7f2d3f800640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2d38159920 0x7f2d3814d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:02.650 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:02.658+0000 7f2d3f800640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f2d3815a270 con 0x7f2d381505d0 2024-04-17T19:47:02.651 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:02.658+0000 7f2d3f800640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f2d380c4970 con 0x7f2d38159920 2024-04-17T19:47:02.651 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:02.658+0000 7f2d3f800640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7f2d38072d40 con 0x7f2d380cb060 2024-04-17T19:47:02.651 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:02.658+0000 7f2d37e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2d381505d0 0x7f2d380c4eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:02.651 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:02.658+0000 7f2d37e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2d381505d0 0x7f2d380c4eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:47546/0 (socket says 172.21.15.44:47546) 2024-04-17T19:47:02.651 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:02.658+0000 7f2d37e00640 1 -- 172.21.15.44:0/3129482832 learned_addr learned my addr 172.21.15.44:0/3129482832 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-04-17T19:47:02.651 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:02.658+0000 7f2d3ce00640 1 --2- 172.21.15.44:0/3129482832 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f2d380cb060 0x7f2d381f56a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:02.651 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:02.658+0000 7f2d3d800640 1 --2- 172.21.15.44:0/3129482832 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2d38159920 0x7f2d3814d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:02.651 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:02.658+0000 7f2d37e00640 1 -- 172.21.15.44:0/3129482832 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f2d380cb060 msgr2=0x7f2d381f56a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:02.651 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:02.658+0000 7f2d37e00640 1 --2- 172.21.15.44:0/3129482832 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f2d380cb060 0x7f2d381f56a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:02.651 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:02.658+0000 7f2d37e00640 1 -- 172.21.15.44:0/3129482832 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2d38159920 msgr2=0x7f2d3814d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:02.651 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:02.658+0000 7f2d37e00640 1 --2- 172.21.15.44:0/3129482832 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2d38159920 0x7f2d3814d5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:02.651 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:02.658+0000 7f2d37e00640 1 -- 172.21.15.44:0/3129482832 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2d381f5be0 con 0x7f2d381505d0 2024-04-17T19:47:02.651 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:02.658+0000 7f2d37e00640 1 --2- 172.21.15.44:0/3129482832 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2d381505d0 0x7f2d380c4eb0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f2d2400c310 tx=0x7f2d2400c7d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:47:02.652 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:02.662+0000 7f2d34c00640 1 -- 172.21.15.44:0/3129482832 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d240052d0 con 0x7f2d381505d0 2024-04-17T19:47:02.652 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:02.662+0000 7f2d34c00640 1 -- 172.21.15.44:0/3129482832 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2d24005470 con 0x7f2d381505d0 2024-04-17T19:47:02.652 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:02.662+0000 7f2d3f800640 1 -- 172.21.15.44:0/3129482832 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2d38152e40 con 0x7f2d381505d0 2024-04-17T19:47:02.652 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:02.662+0000 7f2d34c00640 1 -- 172.21.15.44:0/3129482832 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d24007260 con 0x7f2d381505d0 2024-04-17T19:47:02.652 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:02.662+0000 7f2d3f800640 1 -- 172.21.15.44:0/3129482832 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2d38153400 con 0x7f2d381505d0 2024-04-17T19:47:02.652 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:02.662+0000 7f2d3f800640 1 -- 172.21.15.44:0/3129482832 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2d380cb470 con 0x7f2d381505d0 2024-04-17T19:47:02.652 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:02.662+0000 7f2d34c00640 1 -- 172.21.15.44:0/3129482832 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f2d24007400 con 0x7f2d381505d0 2024-04-17T19:47:02.654 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:02.662+0000 7f2d34c00640 1 --2- 172.21.15.44:0/3129482832 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f2d18068380 0x7f2d1806a890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:02.654 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:02.662+0000 7f2d34c00640 1 -- 172.21.15.44:0/3129482832 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f2d240860c0 con 0x7f2d381505d0 2024-04-17T19:47:02.654 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:02.666+0000 7f2d3ce00640 1 --2- 172.21.15.44:0/3129482832 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f2d18068380 0x7f2d1806a890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:02.655 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:02.666+0000 7f2d3ce00640 1 --2- 172.21.15.44:0/3129482832 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f2d18068380 0x7f2d1806a890 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f2d2c00b930 tx=0x7f2d2c008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:47:02.658 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:02.670+0000 7f2d34c00640 1 -- 172.21.15.44:0/3129482832 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f2d240563d0 con 0x7f2d381505d0 2024-04-17T19:47:02.827 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:02.838+0000 7f2d3f800640 1 -- 172.21.15.44:0/3129482832 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f2d3804ff10 con 0x7f2d381505d0 2024-04-17T19:47:02.828 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:02.838+0000 7f2d34c00640 1 -- 172.21.15.44:0/3129482832 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) ==== 74+0+18482 (secure 0 0 0) 0x7f2d24055cd0 con 0x7f2d381505d0 2024-04-17T19:47:02.829 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-04-17T19:47:02.829 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":25,"fsid":"703f77ca-79c6-4a66-b576-62c526cb1021","created":"2024-04-17T19:46:30.831994+0000","modified":"2024-04-17T19:47:01.141287+0000","last_up_change":"2024-04-17T19:46:41.988197+0000","last_in_change":"2024-04-17T19:46:33.407430+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-17T19:46:41.940380+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-17T19:46:54.222150+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-17T19:46:55.031694+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-17T19:46:58.707529+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"30520dc6-eea6-43d4-ab60-3ca9e92329dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6800","nonce":1018735925},{"type":"v1","addr":"172.21.15.44:6801","nonce":1018735925}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6802","nonce":1018735925},{"type":"v1","addr":"172.21.15.44:6803","nonce":1018735925}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6806","nonce":1018735925},{"type":"v1","addr":"172.21.15.44:6807","nonce":1018735925}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6804","nonce":1018735925},{"type":"v1","addr":"172.21.15.44:6805","nonce":1018735925}]},"public_addr":"172.21.15.44:6801/1018735925","cluster_addr":"172.21.15.44:6803/1018735925","heartbeat_back_addr":"172.21.15.44:6807/1018735925","heartbeat_front_addr":"172.21.15.44:6805/1018735925","state":["exists","up"]},{"osd":1,"uuid":"079bd511-b6ce-449b-8f11-17b311b12f7c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6817","nonce":1452577434},{"type":"v1","addr":"172.21.15.44:6820","nonce":1452577434}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6823","nonce":1452577434},{"type":"v1","addr":"172.21.15.44:6825","nonce":1452577434}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6830","nonce":1452577434},{"type":"v1","addr":"172.21.15.44:6831","nonce":1452577434}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6828","nonce":1452577434},{"type":"v1","addr":"172.21.15.44:6829","nonce":1452577434}]},"public_addr":"172.21.15.44:6820/1452577434","cluster_addr":"172.21.15.44:6825/1452577434","heartbeat_back_addr":"172.21.15.44:6831/1452577434","heartbeat_front_addr":"172.21.15.44:6829/1452577434","state":["exists","up"]},{"osd":2,"uuid":"34f0b9ab-b1d2-4ee9-841c-f15afbb6bec5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6816","nonce":1160071918},{"type":"v1","addr":"172.21.15.44:6818","nonce":1160071918}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6819","nonce":1160071918},{"type":"v1","addr":"172.21.15.44:6821","nonce":1160071918}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6826","nonce":1160071918},{"type":"v1","addr":"172.21.15.44:6827","nonce":1160071918}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6822","nonce":1160071918},{"type":"v1","addr":"172.21.15.44:6824","nonce":1160071918}]},"public_addr":"172.21.15.44:6818/1160071918","cluster_addr":"172.21.15.44:6821/1160071918","heartbeat_back_addr":"172.21.15.44:6827/1160071918","heartbeat_front_addr":"172.21.15.44:6824/1160071918","state":["exists","up"]},{"osd":3,"uuid":"4740032d-fe34-4b1b-bb85-f430896fc3c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6808","nonce":4236454921},{"type":"v1","addr":"172.21.15.44:6809","nonce":4236454921}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6810","nonce":4236454921},{"type":"v1","addr":"172.21.15.44:6811","nonce":4236454921}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6814","nonce":4236454921},{"type":"v1","addr":"172.21.15.44:6815","nonce":4236454921}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6812","nonce":4236454921},{"type":"v1","addr":"172.21.15.44:6813","nonce":4236454921}]},"public_addr":"172.21.15.44:6809/4236454921","cluster_addr":"172.21.15.44:6811/4236454921","heartbeat_back_addr":"172.21.15.44:6815/4236454921","heartbeat_front_addr":"172.21.15.44:6813/4236454921","state":["exists","up"]},{"osd":4,"uuid":"7dbedb00-302d-4d52-810c-e18839254da1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6800","nonce":2293251376},{"type":"v1","addr":"172.21.15.62:6801","nonce":2293251376}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6802","nonce":2293251376},{"type":"v1","addr":"172.21.15.62:6803","nonce":2293251376}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6806","nonce":2293251376},{"type":"v1","addr":"172.21.15.62:6807","nonce":2293251376}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6804","nonce":2293251376},{"type":"v1","addr":"172.21.15.62:6805","nonce":2293251376}]},"public_addr":"172.21.15.62:6801/2293251376","cluster_addr":"172.21.15.62:6803/2293251376","heartbeat_back_addr":"172.21.15.62:6807/2293251376","heartbeat_front_addr":"172.21.15.62:6805/2293251376","state":["exists","up"]},{"osd":5,"uuid":"38c1e8d9-393d-4f33-a97a-3295cf5c5b07","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6808","nonce":1551020300},{"type":"v1","addr":"172.21.15.62:6809","nonce":1551020300}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6810","nonce":1551020300},{"type":"v1","addr":"172.21.15.62:6811","nonce":1551020300}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6814","nonce":1551020300},{"type":"v1","addr":"172.21.15.62:6815","nonce":1551020300}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6812","nonce":1551020300},{"type":"v1","addr":"172.21.15.62:6813","nonce":1551020300}]},"public_addr":"172.21.15.62:6809/1551020300","cluster_addr":"172.21.15.62:6811/1551020300","heartbeat_back_addr":"172.21.15.62:6815/1551020300","heartbeat_front_addr":"172.21.15.62:6813/1551020300","state":["exists","up"]},{"osd":6,"uuid":"f6ff81c6-f14d-4477-88e3-9116cc5a2992","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6824","nonce":2602310256},{"type":"v1","addr":"172.21.15.62:6825","nonce":2602310256}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6826","nonce":2602310256},{"type":"v1","addr":"172.21.15.62:6827","nonce":2602310256}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6830","nonce":2602310256},{"type":"v1","addr":"172.21.15.62:6831","nonce":2602310256}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6828","nonce":2602310256},{"type":"v1","addr":"172.21.15.62:6829","nonce":2602310256}]},"public_addr":"172.21.15.62:6825/2602310256","cluster_addr":"172.21.15.62:6827/2602310256","heartbeat_back_addr":"172.21.15.62:6831/2602310256","heartbeat_front_addr":"172.21.15.62:6829/2602310256","state":["exists","up"]},{"osd":7,"uuid":"ce395bc3-bcb5-4b94-a523-5bb9df491eca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6816","nonce":2912738359},{"type":"v1","addr":"172.21.15.62:6817","nonce":2912738359}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6818","nonce":2912738359},{"type":"v1","addr":"172.21.15.62:6819","nonce":2912738359}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6822","nonce":2912738359},{"type":"v1","addr":"172.21.15.62:6823","nonce":2912738359}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6820","nonce":2912738359},{"type":"v1","addr":"172.21.15.62:6821","nonce":2912738359}]},"public_addr":"172.21.15.62:6817/2912738359","cluster_addr":"172.21.15.62:6819/2912738359","heartbeat_back_addr":"172.21.15.62:6823/2912738359","heartbeat_front_addr":"172.21.15.62:6821/2912738359","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T19:46:39.302883+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T19:46:39.177705+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T19:46:39.188894+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T19:46:39.313009+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T19:46:38.870508+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T19:46:38.790900+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T19:46:38.979163+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T19:46:38.992348+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-17T19:47:02.831 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:02.842+0000 7f2d3f800640 1 -- 172.21.15.44:0/3129482832 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f2d18068380 msgr2=0x7f2d1806a890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:02.831 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:02.842+0000 7f2d3f800640 1 --2- 172.21.15.44:0/3129482832 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f2d18068380 0x7f2d1806a890 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f2d2c00b930 tx=0x7f2d2c008040 comp rx=0 tx=0).stop 2024-04-17T19:47:02.831 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:02.842+0000 7f2d3f800640 1 -- 172.21.15.44:0/3129482832 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2d381505d0 msgr2=0x7f2d380c4eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:02.831 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:02.842+0000 7f2d3f800640 1 --2- 172.21.15.44:0/3129482832 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2d381505d0 0x7f2d380c4eb0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f2d2400c310 tx=0x7f2d2400c7d0 comp rx=0 tx=0).stop 2024-04-17T19:47:02.831 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:02.842+0000 7f2d3f800640 1 -- 172.21.15.44:0/3129482832 shutdown_connections 2024-04-17T19:47:02.831 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:02.842+0000 7f2d3f800640 1 --2- 172.21.15.44:0/3129482832 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f2d18068380 0x7f2d1806a890 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:02.831 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:02.842+0000 7f2d3f800640 1 --2- 172.21.15.44:0/3129482832 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2d38159920 0x7f2d3814d5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:02.831 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:02.842+0000 7f2d3f800640 1 --2- 172.21.15.44:0/3129482832 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2d381505d0 0x7f2d380c4eb0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:02.831 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:02.842+0000 7f2d3f800640 1 --2- 172.21.15.44:0/3129482832 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f2d380cb060 0x7f2d381f56a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:02.831 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:02.842+0000 7f2d3f800640 1 -- 172.21.15.44:0/3129482832 >> 172.21.15.44:0/3129482832 conn(0x7f2d38067eb0 msgr2=0x7f2d380b1ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:47:02.831 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:02.842+0000 7f2d3f800640 1 -- 172.21.15.44:0/3129482832 shutdown_connections 2024-04-17T19:47:02.831 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:02.842+0000 7f2d3f800640 1 -- 172.21.15.44:0/3129482832 wait complete. 2024-04-17T19:47:02.865 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-17T19:47:03.016 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:03.026+0000 7eff37200640 1 Processor -- start 2024-04-17T19:47:03.016 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:03.026+0000 7eff37200640 1 -- start start 2024-04-17T19:47:03.018 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:03.026+0000 7eff37200640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7eff300c4d90 0x7eff301652e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:03.018 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:03.026+0000 7eff37200640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7eff3015dea0 con 0x7eff30153a90 2024-04-17T19:47:03.018 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:03.026+0000 7eff37200640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7eff30159af0 con 0x7eff300cccd0 2024-04-17T19:47:03.018 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:03.026+0000 7eff37200640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 -- 0x7eff3015da10 con 0x7eff300c4d90 2024-04-17T19:47:03.018 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:03.026+0000 7eff2f400640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7eff30153a90 0x7eff300c4680 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:34408/0 (socket says 172.21.15.44:34408) 2024-04-17T19:47:03.018 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:03.026+0000 7eff2f400640 1 -- 172.21.15.44:0/3797678927 learned_addr learned my addr 172.21.15.44:0/3797678927 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-04-17T19:47:03.019 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:03.030+0000 7eff35200640 1 --2- 172.21.15.44:0/3797678927 >> v2:172.21.15.62:3300/0 conn(0x7eff300c4d90 0x7eff301652e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:03.019 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:03.030+0000 7eff2ea00640 1 -- 172.21.15.44:0/3797678927 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2022295979 0 0) 0x7eff3015dea0 con 0x7eff30153a90 2024-04-17T19:47:03.019 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:03.030+0000 7eff2ea00640 1 -- 172.21.15.44:0/3797678927 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7eff14003530 con 0x7eff30153a90 2024-04-17T19:47:03.020 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:03.030+0000 7eff2ea00640 1 -- 172.21.15.44:0/3797678927 <== mon.0 v1:172.21.15.44:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2473334556 0 0) 0x7eff14003530 con 0x7eff30153a90 2024-04-17T19:47:03.020 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:03.030+0000 7eff2ea00640 1 -- 172.21.15.44:0/3797678927 >> v2:172.21.15.62:3300/0 conn(0x7eff300c4d90 msgr2=0x7eff301652e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T19:47:03.020 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:03.030+0000 7eff2ea00640 1 --2- 172.21.15.44:0/3797678927 >> v2:172.21.15.62:3300/0 conn(0x7eff300c4d90 0x7eff301652e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:03.021 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:03.030+0000 7eff2ea00640 1 -- 172.21.15.44:0/3797678927 >> v1:172.21.15.62:6789/0 conn(0x7eff300cccd0 legacy=0x7eff300cda50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:03.021 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:03.030+0000 7eff2ea00640 1 -- 172.21.15.44:0/3797678927 --> v1:172.21.15.44:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7eff3015d0e0 con 0x7eff30153a90 2024-04-17T19:47:03.021 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:03.030+0000 7eff2ea00640 1 -- 172.21.15.44:0/3797678927 <== mon.0 v1:172.21.15.44:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1863569991 0 0) 0x7eff1c001680 con 0x7eff30153a90 2024-04-17T19:47:03.021 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:03.030+0000 7eff2ea00640 1 -- 172.21.15.44:0/3797678927 >> v1:172.21.15.44:6789/0 conn(0x7eff30153a90 legacy=0x7eff300c4680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:03.021 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:03.030+0000 7eff2ea00640 1 --2- 172.21.15.44:0/3797678927 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7eff140039c0 0x7eff14003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:03.021 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:03.030+0000 7eff2ea00640 1 --2- 172.21.15.44:0/3797678927 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7eff14004810 0x7eff14004c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:03.021 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:03.030+0000 7eff2ea00640 1 --2- 172.21.15.44:0/3797678927 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7eff14005260 0x7eff1400b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:03.021 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:03.030+0000 7eff2ea00640 1 -- 172.21.15.44:0/3797678927 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7eff3015da10 con 0x7eff14005260 2024-04-17T19:47:03.021 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:03.030+0000 7eff2ea00640 1 -- 172.21.15.44:0/3797678927 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7eff1400c1f0 con 0x7eff140039c0 2024-04-17T19:47:03.021 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:03.030+0000 7eff2ea00640 1 -- 172.21.15.44:0/3797678927 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7eff1400c3f0 con 0x7eff14004810 2024-04-17T19:47:03.021 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:03.030+0000 7eff35200640 1 --2- 172.21.15.44:0/3797678927 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7eff14005260 0x7eff1400b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:03.021 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:03.030+0000 7eff2fe00640 1 --2- 172.21.15.44:0/3797678927 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7eff140039c0 0x7eff14003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:03.021 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:03.030+0000 7eff2f400640 1 --2- 172.21.15.44:0/3797678927 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7eff14004810 0x7eff14004c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:03.022 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:03.030+0000 7eff35200640 1 -- 172.21.15.44:0/3797678927 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7eff14004810 msgr2=0x7eff14004c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T19:47:03.022 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:03.030+0000 7eff35200640 1 --2- 172.21.15.44:0/3797678927 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7eff14004810 0x7eff14004c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:03.022 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:03.030+0000 7eff35200640 1 -- 172.21.15.44:0/3797678927 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7eff140039c0 msgr2=0x7eff14003e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T19:47:03.022 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:03.030+0000 7eff35200640 1 --2- 172.21.15.44:0/3797678927 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7eff140039c0 0x7eff14003e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:03.022 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:03.030+0000 7eff35200640 1 -- 172.21.15.44:0/3797678927 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7eff14003530 con 0x7eff14005260 2024-04-17T19:47:03.023 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:03.034+0000 7eff35200640 1 -- 172.21.15.44:0/3797678927 reap_dead start 2024-04-17T19:47:03.023 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:03.034+0000 7eff35200640 1 --2- 172.21.15.44:0/3797678927 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7eff14005260 0x7eff1400b9d0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7eff300b25e0 tx=0x7eff2801cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=16e8a2d02a901aec server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:47:03.023 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:03.034+0000 7eff2ea00640 1 -- 172.21.15.44:0/3797678927 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff280b2070 con 0x7eff14005260 2024-04-17T19:47:03.023 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:03.034+0000 7eff2ea00640 1 -- 172.21.15.44:0/3797678927 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7eff280a5b60 con 0x7eff14005260 2024-04-17T19:47:03.023 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:03.034+0000 7eff2ea00640 1 -- 172.21.15.44:0/3797678927 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff28009c10 con 0x7eff14005260 2024-04-17T19:47:03.024 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:03.034+0000 7eff37200640 1 -- 172.21.15.44:0/3797678927 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7eff14005260 msgr2=0x7eff1400b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:03.024 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:03.034+0000 7eff37200640 1 --2- 172.21.15.44:0/3797678927 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7eff14005260 0x7eff1400b9d0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7eff300b25e0 tx=0x7eff2801cc60 comp rx=0 tx=0).stop 2024-04-17T19:47:03.024 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:03.034+0000 7eff37200640 1 -- 172.21.15.44:0/3797678927 shutdown_connections 2024-04-17T19:47:03.024 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:03.034+0000 7eff37200640 1 --2- 172.21.15.44:0/3797678927 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7eff14005260 0x7eff1400b9d0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:03.024 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:03.034+0000 7eff37200640 1 -- 172.21.15.44:0/3797678927 >> 172.21.15.44:0/3797678927 conn(0x7eff30070970 msgr2=0x7eff30072310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:47:03.024 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:03.034+0000 7eff37200640 1 -- 172.21.15.44:0/3797678927 shutdown_connections 2024-04-17T19:47:03.024 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:03.034+0000 7eff37200640 1 -- 172.21.15.44:0/3797678927 wait complete. 2024-04-17T19:47:03.025 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:03.034+0000 7eff37200640 1 Processor -- start 2024-04-17T19:47:03.026 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:03.034+0000 7eff37200640 1 -- start start 2024-04-17T19:47:03.028 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:03.038+0000 7eff37200640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7eff14005260 0x7eff30152790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:03.028 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:03.038+0000 7eff37200640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7eff3015c070 0x7eff3006db80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:03.029 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:03.038+0000 7eff37200640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7eff3015c480 0x7eff3014f7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:03.029 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:03.038+0000 7eff37200640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7eff3015d3c0 con 0x7eff14005260 2024-04-17T19:47:03.029 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:03.038+0000 7eff37200640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7eff30159950 con 0x7eff3015c480 2024-04-17T19:47:03.029 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:03.038+0000 7eff37200640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7eff3015d6a0 con 0x7eff3015c070 2024-04-17T19:47:03.029 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:03.038+0000 7eff2fe00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7eff14005260 0x7eff30152790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:03.029 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:03.038+0000 7eff2fe00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7eff14005260 0x7eff30152790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:47552/0 (socket says 172.21.15.44:47552) 2024-04-17T19:47:03.029 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:03.038+0000 7eff2fe00640 1 -- 172.21.15.44:0/2974548564 learned_addr learned my addr 172.21.15.44:0/2974548564 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-04-17T19:47:03.029 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:03.038+0000 7eff35200640 1 --2- 172.21.15.44:0/2974548564 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7eff3015c480 0x7eff3014f7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:03.029 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:03.038+0000 7eff2f400640 1 --2- 172.21.15.44:0/2974548564 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7eff3015c070 0x7eff3006db80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:03.029 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:03.038+0000 7eff2fe00640 1 -- 172.21.15.44:0/2974548564 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7eff3015c070 msgr2=0x7eff3006db80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:03.029 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:03.038+0000 7eff2fe00640 1 --2- 172.21.15.44:0/2974548564 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7eff3015c070 0x7eff3006db80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:03.029 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:03.038+0000 7eff2fe00640 1 -- 172.21.15.44:0/2974548564 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7eff3015c480 msgr2=0x7eff3014f7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:03.029 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:03.038+0000 7eff2fe00640 1 --2- 172.21.15.44:0/2974548564 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7eff3015c480 0x7eff3014f7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:03.029 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:03.038+0000 7eff2fe00640 1 -- 172.21.15.44:0/2974548564 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7eff3006eed0 con 0x7eff14005260 2024-04-17T19:47:03.030 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:03.038+0000 7eff2fe00640 1 --2- 172.21.15.44:0/2974548564 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7eff14005260 0x7eff30152790 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7eff2000f5b0 tx=0x7eff2000fa70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:47:03.030 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:03.038+0000 7eff27e00640 1 -- 172.21.15.44:0/2974548564 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff200053a0 con 0x7eff14005260 2024-04-17T19:47:03.030 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:03.038+0000 7eff27e00640 1 -- 172.21.15.44:0/2974548564 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7eff20018070 con 0x7eff14005260 2024-04-17T19:47:03.030 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:03.038+0000 7eff37200640 1 -- 172.21.15.44:0/2974548564 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7eff30152cd0 con 0x7eff14005260 2024-04-17T19:47:03.030 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:03.038+0000 7eff27e00640 1 -- 172.21.15.44:0/2974548564 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff20003840 con 0x7eff14005260 2024-04-17T19:47:03.030 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:03.038+0000 7eff37200640 1 -- 172.21.15.44:0/2974548564 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7eff3006ebf0 con 0x7eff14005260 2024-04-17T19:47:03.030 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:03.038+0000 7eff37200640 1 -- 172.21.15.44:0/2974548564 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7eff3004ff10 con 0x7eff14005260 2024-04-17T19:47:03.030 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:03.042+0000 7eff27e00640 1 -- 172.21.15.44:0/2974548564 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7eff200039e0 con 0x7eff14005260 2024-04-17T19:47:03.031 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:03.042+0000 7eff27e00640 1 --2- 172.21.15.44:0/2974548564 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7eff10068380 0x7eff1006a890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:03.031 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:03.042+0000 7eff27e00640 1 -- 172.21.15.44:0/2974548564 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7eff20086b60 con 0x7eff14005260 2024-04-17T19:47:03.032 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:03.042+0000 7eff2f400640 1 --2- 172.21.15.44:0/2974548564 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7eff10068380 0x7eff1006a890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:03.032 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:03.042+0000 7eff2f400640 1 --2- 172.21.15.44:0/2974548564 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7eff10068380 0x7eff1006a890 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7eff1c001060 tx=0x7eff1c009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:47:03.036 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:03.046+0000 7eff27e00640 1 -- 172.21.15.44:0/2974548564 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7eff20056700 con 0x7eff14005260 2024-04-17T19:47:03.235 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:03.246+0000 7eff37200640 1 -- 172.21.15.44:0/2974548564 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7eff300cd170 con 0x7eff14005260 2024-04-17T19:47:03.235 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:03.246+0000 7eff27e00640 1 -- 172.21.15.44:0/2974548564 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) ==== 93+0+6825 (secure 0 0 0) 0x7eff2005aa00 con 0x7eff14005260 2024-04-17T19:47:03.236 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-04-17T19:47:03.236 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4263,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.44:6835/1724891996","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6832","nonce":1724891996},{"type":"v1","addr":"172.21.15.44:6835","nonce":1724891996}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4266,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.44:6836/2201911513","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6833","nonce":2201911513},{"type":"v1","addr":"172.21.15.44:6836","nonce":2201911513}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4268,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.62:6837/3085335335","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6836","nonce":3085335335},{"type":"v1","addr":"172.21.15.62:6837","nonce":3085335335}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4269,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.44:6837/4073536070","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6834","nonce":4073536070},{"type":"v1","addr":"172.21.15.44:6837","nonce":4073536070}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4294,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.62:6835/2585862759","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6834","nonce":2585862759},{"type":"v1","addr":"172.21.15.62:6835","nonce":2585862759}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":5,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-17T19:46:56.083202+0000","modified":"2024-04-17T19:47:01.710184+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4306},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4306":{"gid":4306,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":5,"addr":"172.21.15.62:6839/1537667111","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6838","nonce":1537667111},{"type":"v1","addr":"172.21.15.62:6839","nonce":1537667111}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":4306,"qdb_cluster":[4306]},"id":1}]} 2024-04-17T19:47:03.236 INFO:teuthology.orchestra.run.smithi044.stderr:dumped fsmap epoch 6 2024-04-17T19:47:03.238 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:03.246+0000 7eff37200640 1 -- 172.21.15.44:0/2974548564 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7eff10068380 msgr2=0x7eff1006a890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:03.238 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:03.246+0000 7eff37200640 1 --2- 172.21.15.44:0/2974548564 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7eff10068380 0x7eff1006a890 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7eff1c001060 tx=0x7eff1c009040 comp rx=0 tx=0).stop 2024-04-17T19:47:03.238 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:03.246+0000 7eff37200640 1 -- 172.21.15.44:0/2974548564 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7eff14005260 msgr2=0x7eff30152790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:03.238 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:03.246+0000 7eff37200640 1 --2- 172.21.15.44:0/2974548564 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7eff14005260 0x7eff30152790 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7eff2000f5b0 tx=0x7eff2000fa70 comp rx=0 tx=0).stop 2024-04-17T19:47:03.238 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:03.246+0000 7eff37200640 1 -- 172.21.15.44:0/2974548564 shutdown_connections 2024-04-17T19:47:03.238 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:03.246+0000 7eff37200640 1 --2- 172.21.15.44:0/2974548564 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7eff10068380 0x7eff1006a890 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:03.238 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:03.246+0000 7eff37200640 1 --2- 172.21.15.44:0/2974548564 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7eff3015c070 0x7eff3006db80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:03.238 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:03.246+0000 7eff37200640 1 --2- 172.21.15.44:0/2974548564 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7eff3015c480 0x7eff3014f7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:03.239 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:03.246+0000 7eff37200640 1 --2- 172.21.15.44:0/2974548564 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7eff14005260 0x7eff30152790 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:03.239 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:03.246+0000 7eff37200640 1 -- 172.21.15.44:0/2974548564 >> 172.21.15.44:0/2974548564 conn(0x7eff30070970 msgr2=0x7eff300cda50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:47:03.239 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:03.246+0000 7eff37200640 1 -- 172.21.15.44:0/2974548564 shutdown_connections 2024-04-17T19:47:03.239 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:03.246+0000 7eff37200640 1 -- 172.21.15.44:0/2974548564 wait complete. 2024-04-17T19:47:03.258 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-17T19:47:03.410 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:03.418+0000 7fe8fb800640 1 Processor -- start 2024-04-17T19:47:03.410 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:03.418+0000 7fe8fb800640 1 -- start start 2024-04-17T19:47:03.412 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:03.422+0000 7fe8fb800640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fe8f406bf90 0x7fe8f406fba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:03.413 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:03.422+0000 7fe8fb800640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fe8f406c3a0 0x7fe8f40ca740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:03.413 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:03.422+0000 7fe8fb800640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fe8f40cac80 0x7fe8f415f0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:03.413 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:03.422+0000 7fe8fb800640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 -- 0x7fe8f415be90 con 0x7fe8f406bf90 2024-04-17T19:47:03.413 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:03.422+0000 7fe8fb800640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 -- 0x7fe8f415c150 con 0x7fe8f40cac80 2024-04-17T19:47:03.413 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:03.422+0000 7fe8fb800640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7fe8f415c430 con 0x7fe8f406c3a0 2024-04-17T19:47:03.413 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:03.422+0000 7fe8f8e00640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fe8f406bf90 0x7fe8f406fba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:03.413 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:03.422+0000 7fe8f8e00640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fe8f406bf90 0x7fe8f406fba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:47562/0 (socket says 172.21.15.44:47562) 2024-04-17T19:47:03.413 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:03.422+0000 7fe8f8e00640 1 -- 172.21.15.44:0/107221826 learned_addr learned my addr 172.21.15.44:0/107221826 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-04-17T19:47:03.413 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:03.422+0000 7fe8ebe00640 1 --2- 172.21.15.44:0/107221826 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fe8f406c3a0 0x7fe8f40ca740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:03.413 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:03.422+0000 7fe8f9800640 1 --2- 172.21.15.44:0/107221826 >> v2:172.21.15.62:3300/0 conn(0x7fe8f40cac80 0x7fe8f415f0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:03.413 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:03.422+0000 7fe8f8e00640 1 -- 172.21.15.44:0/107221826 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fe8f406c3a0 msgr2=0x7fe8f40ca740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T19:47:03.413 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:03.422+0000 7fe8f8e00640 1 --2- 172.21.15.44:0/107221826 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fe8f406c3a0 0x7fe8f40ca740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:03.413 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:03.422+0000 7fe8f8e00640 1 -- 172.21.15.44:0/107221826 >> v2:172.21.15.62:3300/0 conn(0x7fe8f40cac80 msgr2=0x7fe8f415f0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T19:47:03.413 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:03.422+0000 7fe8f8e00640 1 --2- 172.21.15.44:0/107221826 >> v2:172.21.15.62:3300/0 conn(0x7fe8f40cac80 0x7fe8f415f0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:03.414 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:03.422+0000 7fe8f8e00640 1 -- 172.21.15.44:0/107221826 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe8f415c710 con 0x7fe8f406bf90 2024-04-17T19:47:03.416 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:03.426+0000 7fe8f8e00640 1 --2- 172.21.15.44:0/107221826 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe8f406bf90 0x7fe8f406fba0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fe8e4009870 tx=0x7fe8e401ed10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=45489af42e48f432 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:47:03.416 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:03.426+0000 7fe8f3e00640 1 -- 172.21.15.44:0/107221826 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8e40b5070 con 0x7fe8f406bf90 2024-04-17T19:47:03.416 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:03.426+0000 7fe8f3e00640 1 -- 172.21.15.44:0/107221826 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe8e40a89d0 con 0x7fe8f406bf90 2024-04-17T19:47:03.416 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:03.426+0000 7fe8f3e00640 1 -- 172.21.15.44:0/107221826 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8e40a8da0 con 0x7fe8f406bf90 2024-04-17T19:47:03.417 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:03.426+0000 7fe8fb800640 1 -- 172.21.15.44:0/107221826 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe8f406bf90 msgr2=0x7fe8f406fba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:03.417 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:03.426+0000 7fe8fb800640 1 --2- 172.21.15.44:0/107221826 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe8f406bf90 0x7fe8f406fba0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fe8e4009870 tx=0x7fe8e401ed10 comp rx=0 tx=0).stop 2024-04-17T19:47:03.417 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:03.426+0000 7fe8fb800640 1 -- 172.21.15.44:0/107221826 shutdown_connections 2024-04-17T19:47:03.417 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:03.426+0000 7fe8fb800640 1 --2- 172.21.15.44:0/107221826 >> v2:172.21.15.62:3300/0 conn(0x7fe8f40cac80 0x7fe8f415f0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:03.417 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:03.426+0000 7fe8fb800640 1 --2- 172.21.15.44:0/107221826 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fe8f406c3a0 0x7fe8f40ca740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:03.417 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:03.426+0000 7fe8fb800640 1 --2- 172.21.15.44:0/107221826 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe8f406bf90 0x7fe8f406fba0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:03.417 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:03.426+0000 7fe8fb800640 1 -- 172.21.15.44:0/107221826 >> 172.21.15.44:0/107221826 conn(0x7fe8f4073650 msgr2=0x7fe8f4073a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:47:03.417 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:03.426+0000 7fe8fb800640 1 -- 172.21.15.44:0/107221826 shutdown_connections 2024-04-17T19:47:03.417 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:03.426+0000 7fe8fb800640 1 -- 172.21.15.44:0/107221826 wait complete. 2024-04-17T19:47:03.419 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:03.430+0000 7fe8fb800640 1 Processor -- start 2024-04-17T19:47:03.419 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:03.430+0000 7fe8fb800640 1 -- start start 2024-04-17T19:47:03.421 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:03.430+0000 7fe8fb800640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe8f406bf90 0x7fe8f41f5a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:03.421 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:03.430+0000 7fe8fb800640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe8f406c3a0 0x7fe8f4157e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:03.421 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:03.430+0000 7fe8fb800640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fe8f40cac80 0x7fe8f414a2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:03.421 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:03.430+0000 7fe8fb800640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fe8f406f680 con 0x7fe8f406c3a0 2024-04-17T19:47:03.421 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:03.430+0000 7fe8fb800640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7fe8f406f3a0 con 0x7fe8f406bf90 2024-04-17T19:47:03.421 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:03.430+0000 7fe8fb800640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7fe8f415bb80 con 0x7fe8f40cac80 2024-04-17T19:47:03.421 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:03.430+0000 7fe8ebe00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe8f406c3a0 0x7fe8f4157e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:03.421 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:03.430+0000 7fe8ebe00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe8f406c3a0 0x7fe8f4157e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:47576/0 (socket says 172.21.15.44:47576) 2024-04-17T19:47:03.422 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:03.430+0000 7fe8ebe00640 1 -- 172.21.15.44:0/3933556275 learned_addr learned my addr 172.21.15.44:0/3933556275 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-04-17T19:47:03.422 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:03.430+0000 7fe8f8e00640 1 --2- 172.21.15.44:0/3933556275 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe8f406bf90 0x7fe8f41f5a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:03.422 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:03.430+0000 7fe8f9800640 1 --2- 172.21.15.44:0/3933556275 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fe8f40cac80 0x7fe8f414a2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:03.422 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:03.430+0000 7fe8ebe00640 1 -- 172.21.15.44:0/3933556275 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fe8f40cac80 msgr2=0x7fe8f414a2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:03.422 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:03.430+0000 7fe8ebe00640 1 --2- 172.21.15.44:0/3933556275 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fe8f40cac80 0x7fe8f414a2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:03.422 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:03.430+0000 7fe8ebe00640 1 -- 172.21.15.44:0/3933556275 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe8f406bf90 msgr2=0x7fe8f41f5a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:03.422 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:03.430+0000 7fe8ebe00640 1 --2- 172.21.15.44:0/3933556275 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe8f406bf90 0x7fe8f41f5a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:03.422 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:03.430+0000 7fe8ebe00640 1 -- 172.21.15.44:0/3933556275 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe8f41f5f60 con 0x7fe8f406c3a0 2024-04-17T19:47:03.422 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:03.430+0000 7fe8f9800640 1 --2- 172.21.15.44:0/3933556275 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fe8f40cac80 0x7fe8f414a2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-17T19:47:03.422 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:03.430+0000 7fe8ebe00640 1 --2- 172.21.15.44:0/3933556275 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe8f406c3a0 0x7fe8f4157e00 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fe8dc00d830 tx=0x7fe8dc00dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:47:03.423 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:03.430+0000 7fe8f1600640 1 -- 172.21.15.44:0/3933556275 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8dc018030 con 0x7fe8f406c3a0 2024-04-17T19:47:03.423 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:03.430+0000 7fe8f1600640 1 -- 172.21.15.44:0/3933556275 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe8dc00be10 con 0x7fe8f406c3a0 2024-04-17T19:47:03.423 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:03.430+0000 7fe8fb800640 1 -- 172.21.15.44:0/3933556275 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe8f414f2f0 con 0x7fe8f406c3a0 2024-04-17T19:47:03.423 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:03.430+0000 7fe8f1600640 1 -- 172.21.15.44:0/3933556275 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8dc0098b0 con 0x7fe8f406c3a0 2024-04-17T19:47:03.423 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:03.430+0000 7fe8fb800640 1 -- 172.21.15.44:0/3933556275 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe8f414c780 con 0x7fe8f406c3a0 2024-04-17T19:47:03.423 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:03.434+0000 7fe8fb800640 1 -- 172.21.15.44:0/3933556275 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe8f404ff10 con 0x7fe8f406c3a0 2024-04-17T19:47:03.424 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:03.434+0000 7fe8f1600640 1 -- 172.21.15.44:0/3933556275 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fe8dc01b070 con 0x7fe8f406c3a0 2024-04-17T19:47:03.424 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:03.434+0000 7fe8f1600640 1 --2- 172.21.15.44:0/3933556275 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7fe8d00683b0 0x7fe8d006a8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:03.425 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:03.434+0000 7fe8f1600640 1 -- 172.21.15.44:0/3933556275 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fe8dc086e30 con 0x7fe8f406c3a0 2024-04-17T19:47:03.425 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:03.434+0000 7fe8f8e00640 1 --2- 172.21.15.44:0/3933556275 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7fe8d00683b0 0x7fe8d006a8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:03.426 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:03.434+0000 7fe8f8e00640 1 --2- 172.21.15.44:0/3933556275 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7fe8d00683b0 0x7fe8d006a8c0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fe8e40b2000 tx=0x7fe8e4009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:47:03.429 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:03.438+0000 7fe8f1600640 1 -- 172.21.15.44:0/3933556275 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fe8dc057010 con 0x7fe8f406c3a0 2024-04-17T19:47:03.594 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:03.606+0000 7fe8fb800640 1 -- 172.21.15.44:0/3933556275 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fe8f4155440 con 0x7fe8f406c3a0 2024-04-17T19:47:03.596 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:03.606+0000 7fe8f1600640 1 -- 172.21.15.44:0/3933556275 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) ==== 74+0+18482 (secure 0 0 0) 0x7fe8dc056910 con 0x7fe8f406c3a0 2024-04-17T19:47:03.596 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-04-17T19:47:03.596 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":25,"fsid":"703f77ca-79c6-4a66-b576-62c526cb1021","created":"2024-04-17T19:46:30.831994+0000","modified":"2024-04-17T19:47:01.141287+0000","last_up_change":"2024-04-17T19:46:41.988197+0000","last_in_change":"2024-04-17T19:46:33.407430+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-17T19:46:41.940380+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-17T19:46:54.222150+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-17T19:46:55.031694+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-17T19:46:58.707529+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"30520dc6-eea6-43d4-ab60-3ca9e92329dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6800","nonce":1018735925},{"type":"v1","addr":"172.21.15.44:6801","nonce":1018735925}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6802","nonce":1018735925},{"type":"v1","addr":"172.21.15.44:6803","nonce":1018735925}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6806","nonce":1018735925},{"type":"v1","addr":"172.21.15.44:6807","nonce":1018735925}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6804","nonce":1018735925},{"type":"v1","addr":"172.21.15.44:6805","nonce":1018735925}]},"public_addr":"172.21.15.44:6801/1018735925","cluster_addr":"172.21.15.44:6803/1018735925","heartbeat_back_addr":"172.21.15.44:6807/1018735925","heartbeat_front_addr":"172.21.15.44:6805/1018735925","state":["exists","up"]},{"osd":1,"uuid":"079bd511-b6ce-449b-8f11-17b311b12f7c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6817","nonce":1452577434},{"type":"v1","addr":"172.21.15.44:6820","nonce":1452577434}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6823","nonce":1452577434},{"type":"v1","addr":"172.21.15.44:6825","nonce":1452577434}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6830","nonce":1452577434},{"type":"v1","addr":"172.21.15.44:6831","nonce":1452577434}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6828","nonce":1452577434},{"type":"v1","addr":"172.21.15.44:6829","nonce":1452577434}]},"public_addr":"172.21.15.44:6820/1452577434","cluster_addr":"172.21.15.44:6825/1452577434","heartbeat_back_addr":"172.21.15.44:6831/1452577434","heartbeat_front_addr":"172.21.15.44:6829/1452577434","state":["exists","up"]},{"osd":2,"uuid":"34f0b9ab-b1d2-4ee9-841c-f15afbb6bec5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6816","nonce":1160071918},{"type":"v1","addr":"172.21.15.44:6818","nonce":1160071918}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6819","nonce":1160071918},{"type":"v1","addr":"172.21.15.44:6821","nonce":1160071918}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6826","nonce":1160071918},{"type":"v1","addr":"172.21.15.44:6827","nonce":1160071918}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6822","nonce":1160071918},{"type":"v1","addr":"172.21.15.44:6824","nonce":1160071918}]},"public_addr":"172.21.15.44:6818/1160071918","cluster_addr":"172.21.15.44:6821/1160071918","heartbeat_back_addr":"172.21.15.44:6827/1160071918","heartbeat_front_addr":"172.21.15.44:6824/1160071918","state":["exists","up"]},{"osd":3,"uuid":"4740032d-fe34-4b1b-bb85-f430896fc3c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6808","nonce":4236454921},{"type":"v1","addr":"172.21.15.44:6809","nonce":4236454921}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6810","nonce":4236454921},{"type":"v1","addr":"172.21.15.44:6811","nonce":4236454921}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6814","nonce":4236454921},{"type":"v1","addr":"172.21.15.44:6815","nonce":4236454921}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6812","nonce":4236454921},{"type":"v1","addr":"172.21.15.44:6813","nonce":4236454921}]},"public_addr":"172.21.15.44:6809/4236454921","cluster_addr":"172.21.15.44:6811/4236454921","heartbeat_back_addr":"172.21.15.44:6815/4236454921","heartbeat_front_addr":"172.21.15.44:6813/4236454921","state":["exists","up"]},{"osd":4,"uuid":"7dbedb00-302d-4d52-810c-e18839254da1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6800","nonce":2293251376},{"type":"v1","addr":"172.21.15.62:6801","nonce":2293251376}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6802","nonce":2293251376},{"type":"v1","addr":"172.21.15.62:6803","nonce":2293251376}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6806","nonce":2293251376},{"type":"v1","addr":"172.21.15.62:6807","nonce":2293251376}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6804","nonce":2293251376},{"type":"v1","addr":"172.21.15.62:6805","nonce":2293251376}]},"public_addr":"172.21.15.62:6801/2293251376","cluster_addr":"172.21.15.62:6803/2293251376","heartbeat_back_addr":"172.21.15.62:6807/2293251376","heartbeat_front_addr":"172.21.15.62:6805/2293251376","state":["exists","up"]},{"osd":5,"uuid":"38c1e8d9-393d-4f33-a97a-3295cf5c5b07","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6808","nonce":1551020300},{"type":"v1","addr":"172.21.15.62:6809","nonce":1551020300}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6810","nonce":1551020300},{"type":"v1","addr":"172.21.15.62:6811","nonce":1551020300}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6814","nonce":1551020300},{"type":"v1","addr":"172.21.15.62:6815","nonce":1551020300}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6812","nonce":1551020300},{"type":"v1","addr":"172.21.15.62:6813","nonce":1551020300}]},"public_addr":"172.21.15.62:6809/1551020300","cluster_addr":"172.21.15.62:6811/1551020300","heartbeat_back_addr":"172.21.15.62:6815/1551020300","heartbeat_front_addr":"172.21.15.62:6813/1551020300","state":["exists","up"]},{"osd":6,"uuid":"f6ff81c6-f14d-4477-88e3-9116cc5a2992","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6824","nonce":2602310256},{"type":"v1","addr":"172.21.15.62:6825","nonce":2602310256}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6826","nonce":2602310256},{"type":"v1","addr":"172.21.15.62:6827","nonce":2602310256}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6830","nonce":2602310256},{"type":"v1","addr":"172.21.15.62:6831","nonce":2602310256}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6828","nonce":2602310256},{"type":"v1","addr":"172.21.15.62:6829","nonce":2602310256}]},"public_addr":"172.21.15.62:6825/2602310256","cluster_addr":"172.21.15.62:6827/2602310256","heartbeat_back_addr":"172.21.15.62:6831/2602310256","heartbeat_front_addr":"172.21.15.62:6829/2602310256","state":["exists","up"]},{"osd":7,"uuid":"ce395bc3-bcb5-4b94-a523-5bb9df491eca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6816","nonce":2912738359},{"type":"v1","addr":"172.21.15.62:6817","nonce":2912738359}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6818","nonce":2912738359},{"type":"v1","addr":"172.21.15.62:6819","nonce":2912738359}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6822","nonce":2912738359},{"type":"v1","addr":"172.21.15.62:6823","nonce":2912738359}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6820","nonce":2912738359},{"type":"v1","addr":"172.21.15.62:6821","nonce":2912738359}]},"public_addr":"172.21.15.62:6817/2912738359","cluster_addr":"172.21.15.62:6819/2912738359","heartbeat_back_addr":"172.21.15.62:6823/2912738359","heartbeat_front_addr":"172.21.15.62:6821/2912738359","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T19:46:39.302883+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T19:46:39.177705+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T19:46:39.188894+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T19:46:39.313009+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T19:46:38.870508+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T19:46:38.790900+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T19:46:38.979163+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T19:46:38.992348+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-17T19:47:03.598 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:03.606+0000 7fe8fb800640 1 -- 172.21.15.44:0/3933556275 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7fe8d00683b0 msgr2=0x7fe8d006a8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:03.598 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:03.606+0000 7fe8fb800640 1 --2- 172.21.15.44:0/3933556275 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7fe8d00683b0 0x7fe8d006a8c0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fe8e40b2000 tx=0x7fe8e4009040 comp rx=0 tx=0).stop 2024-04-17T19:47:03.598 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:03.606+0000 7fe8fb800640 1 -- 172.21.15.44:0/3933556275 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe8f406c3a0 msgr2=0x7fe8f4157e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:03.598 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:03.606+0000 7fe8fb800640 1 --2- 172.21.15.44:0/3933556275 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe8f406c3a0 0x7fe8f4157e00 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fe8dc00d830 tx=0x7fe8dc00dcf0 comp rx=0 tx=0).stop 2024-04-17T19:47:03.599 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:03.606+0000 7fe8fb800640 1 -- 172.21.15.44:0/3933556275 shutdown_connections 2024-04-17T19:47:03.599 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:03.606+0000 7fe8fb800640 1 --2- 172.21.15.44:0/3933556275 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7fe8d00683b0 0x7fe8d006a8c0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:03.599 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:03.606+0000 7fe8fb800640 1 --2- 172.21.15.44:0/3933556275 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fe8f40cac80 0x7fe8f414a2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:03.599 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:03.606+0000 7fe8fb800640 1 --2- 172.21.15.44:0/3933556275 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe8f406c3a0 0x7fe8f4157e00 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:03.599 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:03.606+0000 7fe8fb800640 1 --2- 172.21.15.44:0/3933556275 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe8f406bf90 0x7fe8f41f5a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:03.599 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:03.606+0000 7fe8fb800640 1 -- 172.21.15.44:0/3933556275 >> 172.21.15.44:0/3933556275 conn(0x7fe8f4073650 msgr2=0x7fe8f4073a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:47:03.599 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:03.610+0000 7fe8fb800640 1 -- 172.21.15.44:0/3933556275 shutdown_connections 2024-04-17T19:47:03.599 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:03.610+0000 7fe8fb800640 1 -- 172.21.15.44:0/3933556275 wait complete. 2024-04-17T19:47:04.221 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 5, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-04-17T19:46:56.083202+0000', 'modified': '2024-04-17T19:47:01.710184+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4306}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4306': {'gid': 4306, 'name': 'b', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 5, 'addr': '172.21.15.62:6839/1537667111', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.62:6838', 'nonce': 1537667111}, {'type': 'v1', 'addr': '172.21.15.62:6839', 'nonce': 1537667111}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 1, 'qdb_leader': 4306, 'qdb_cluster': [4306]} 2024-04-17T19:47:04.222 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-04-17T19:47:04.222 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2024-04-17T19:47:04.382 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:04.394+0000 7fc0ca200640 1 Processor -- start 2024-04-17T19:47:04.382 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:04.394+0000 7fc0ca200640 1 -- start start 2024-04-17T19:47:04.385 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:04.394+0000 7fc0ca200640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fc0c40c80a0 0x7fc0c40c84b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:04.385 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:04.394+0000 7fc0ca200640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc0c40c89f0 con 0x7fc0c40c68b0 2024-04-17T19:47:04.385 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:04.394+0000 7fc0ca200640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc0c40c4000 con 0x7fc0c4152860 2024-04-17T19:47:04.385 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:04.394+0000 7fc0ca200640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 -- 0x7fc0c40c6eb0 con 0x7fc0c40c80a0 2024-04-17T19:47:04.385 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:04.394+0000 7fc0bbe00640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7fc0c40c68b0 0x7fc0c40c47e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:34422/0 (socket says 172.21.15.44:34422) 2024-04-17T19:47:04.385 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:04.394+0000 7fc0bbe00640 1 -- 172.21.15.44:0/3732037382 learned_addr learned my addr 172.21.15.44:0/3732037382 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-04-17T19:47:04.385 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:04.394+0000 7fc0c3e00640 1 --2- 172.21.15.44:0/3732037382 >> v2:172.21.15.44:3300/0 conn(0x7fc0c40c80a0 0x7fc0c40c84b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:04.385 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:04.394+0000 7fc0c2a00640 1 -- 172.21.15.44:0/3732037382 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 714032039 0 0) 0x7fc0ac001120 con 0x7fc0c40c68b0 2024-04-17T19:47:04.385 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:04.394+0000 7fc0c2a00640 1 -- 172.21.15.44:0/3732037382 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc0a8003530 con 0x7fc0c40c68b0 2024-04-17T19:47:04.385 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:04.394+0000 7fc0c3e00640 1 -- 172.21.15.44:0/3732037382 >> v1:172.21.15.62:6789/0 conn(0x7fc0c4152860 legacy=0x7fc0c4159140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:04.385 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:04.394+0000 7fc0c3e00640 1 -- 172.21.15.44:0/3732037382 >> v1:172.21.15.44:6789/0 conn(0x7fc0c40c68b0 legacy=0x7fc0c40c47e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:04.385 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:04.394+0000 7fc0c3e00640 1 -- 172.21.15.44:0/3732037382 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc0c40c42e0 con 0x7fc0c40c80a0 2024-04-17T19:47:04.388 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:04.398+0000 7fc0c3e00640 1 --2- 172.21.15.44:0/3732037382 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc0c40c80a0 0x7fc0c40c84b0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fc0bc009d90 tx=0x7fc0bc01c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=64860e9c283bbc73 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:47:04.388 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:04.398+0000 7fc0c2a00640 1 -- 172.21.15.44:0/3732037382 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0bc0b2070 con 0x7fc0c40c80a0 2024-04-17T19:47:04.388 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:04.398+0000 7fc0c2a00640 1 -- 172.21.15.44:0/3732037382 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc0bc0a57a0 con 0x7fc0c40c80a0 2024-04-17T19:47:04.388 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:04.398+0000 7fc0c2a00640 1 -- 172.21.15.44:0/3732037382 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0bc0a5b50 con 0x7fc0c40c80a0 2024-04-17T19:47:04.389 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:04.398+0000 7fc0ca200640 1 -- 172.21.15.44:0/3732037382 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc0c40c80a0 msgr2=0x7fc0c40c84b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:04.389 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:04.398+0000 7fc0ca200640 1 --2- 172.21.15.44:0/3732037382 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc0c40c80a0 0x7fc0c40c84b0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fc0bc009d90 tx=0x7fc0bc01c8e0 comp rx=0 tx=0).stop 2024-04-17T19:47:04.389 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:04.398+0000 7fc0ca200640 1 -- 172.21.15.44:0/3732037382 shutdown_connections 2024-04-17T19:47:04.389 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:04.398+0000 7fc0ca200640 1 --2- 172.21.15.44:0/3732037382 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc0c40c80a0 0x7fc0c40c84b0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:04.389 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:04.398+0000 7fc0ca200640 1 -- 172.21.15.44:0/3732037382 >> 172.21.15.44:0/3732037382 conn(0x7fc0c406c380 msgr2=0x7fc0c4070080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:47:04.389 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:04.398+0000 7fc0ca200640 1 -- 172.21.15.44:0/3732037382 shutdown_connections 2024-04-17T19:47:04.389 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:04.398+0000 7fc0ca200640 1 -- 172.21.15.44:0/3732037382 wait complete. 2024-04-17T19:47:04.391 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:04.402+0000 7fc0ca200640 1 Processor -- start 2024-04-17T19:47:04.391 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:04.402+0000 7fc0ca200640 1 -- start start 2024-04-17T19:47:04.394 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:04.402+0000 7fc0ca200640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc0c40c68b0 0x7fc0c4145fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:04.394 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:04.402+0000 7fc0ca200640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc0c40c80a0 0x7fc0c4145460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:04.394 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:04.402+0000 7fc0ca200640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fc0c4152860 0x7fc0c4147cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:04.394 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:04.402+0000 7fc0ca200640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fc0c40c5100 con 0x7fc0c40c68b0 2024-04-17T19:47:04.394 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:04.402+0000 7fc0ca200640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7fc0c40c78e0 con 0x7fc0c40c80a0 2024-04-17T19:47:04.394 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:04.402+0000 7fc0ca200640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7fc0c4166a80 con 0x7fc0c4152860 2024-04-17T19:47:04.394 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:04.402+0000 7fc0c3400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc0c40c68b0 0x7fc0c4145fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:04.394 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:04.402+0000 7fc0c3400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc0c40c68b0 0x7fc0c4145fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:47582/0 (socket says 172.21.15.44:47582) 2024-04-17T19:47:04.394 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:04.402+0000 7fc0c3400640 1 -- 172.21.15.44:0/1653068831 learned_addr learned my addr 172.21.15.44:0/1653068831 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-04-17T19:47:04.395 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:04.402+0000 7fc0bbe00640 1 --2- 172.21.15.44:0/1653068831 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc0c40c80a0 0x7fc0c4145460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:04.395 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:04.402+0000 7fc0c3e00640 1 --2- 172.21.15.44:0/1653068831 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fc0c4152860 0x7fc0c4147cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:04.395 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:04.402+0000 7fc0c3400640 1 -- 172.21.15.44:0/1653068831 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fc0c4152860 msgr2=0x7fc0c4147cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:04.395 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:04.402+0000 7fc0c3400640 1 --2- 172.21.15.44:0/1653068831 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fc0c4152860 0x7fc0c4147cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:04.395 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:04.402+0000 7fc0c3400640 1 -- 172.21.15.44:0/1653068831 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc0c40c80a0 msgr2=0x7fc0c4145460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:04.395 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:04.402+0000 7fc0c3400640 1 --2- 172.21.15.44:0/1653068831 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc0c40c80a0 0x7fc0c4145460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:04.395 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:04.402+0000 7fc0c3400640 1 -- 172.21.15.44:0/1653068831 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc0c4145bb0 con 0x7fc0c40c68b0 2024-04-17T19:47:04.395 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:04.402+0000 7fc0bbe00640 1 --2- 172.21.15.44:0/1653068831 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc0c40c80a0 0x7fc0c4145460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-17T19:47:04.395 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:04.402+0000 7fc0c3400640 1 --2- 172.21.15.44:0/1653068831 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc0c40c68b0 0x7fc0c4145fa0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fc0b400c340 tx=0x7fc0b400c800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:47:04.395 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:04.402+0000 7fc0bb400640 1 -- 172.21.15.44:0/1653068831 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0b40052d0 con 0x7fc0c40c68b0 2024-04-17T19:47:04.395 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:04.402+0000 7fc0bb400640 1 -- 172.21.15.44:0/1653068831 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc0b4005470 con 0x7fc0c40c68b0 2024-04-17T19:47:04.395 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:04.402+0000 7fc0bb400640 1 -- 172.21.15.44:0/1653068831 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0b4007260 con 0x7fc0c40c68b0 2024-04-17T19:47:04.395 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:04.402+0000 7fc0ca200640 1 -- 172.21.15.44:0/1653068831 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc0c41459a0 con 0x7fc0c40c68b0 2024-04-17T19:47:04.395 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:04.406+0000 7fc0ca200640 1 -- 172.21.15.44:0/1653068831 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc0c41585f0 con 0x7fc0c40c68b0 2024-04-17T19:47:04.396 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:04.406+0000 7fc0bb400640 1 -- 172.21.15.44:0/1653068831 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fc0b4007400 con 0x7fc0c40c68b0 2024-04-17T19:47:04.397 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:04.406+0000 7fc0bb400640 1 --2- 172.21.15.44:0/1653068831 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7fc0a00683b0 0x7fc0a006a8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:04.398 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:04.406+0000 7fc0bb400640 1 -- 172.21.15.44:0/1653068831 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fc0b4086090 con 0x7fc0c40c68b0 2024-04-17T19:47:04.398 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:04.410+0000 7fc0bbe00640 1 --2- 172.21.15.44:0/1653068831 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7fc0a00683b0 0x7fc0a006a8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:04.398 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:04.410+0000 7fc0d194f000 1 Processor -- start 2024-04-17T19:47:04.398 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:04.410+0000 7fc0d194f000 1 -- start start 2024-04-17T19:47:04.399 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:04.410+0000 7fc0bbe00640 1 --2- 172.21.15.44:0/1653068831 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7fc0a00683b0 0x7fc0a006a8c0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fc0c4157160 tx=0x7fc0ac009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:47:04.401 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:04.410+0000 7fc0d194f000 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x564cca8dfc10 0x564ccaa491b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:04.401 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:04.410+0000 7fc0d194f000 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564cca8d8930 0x564ccaa496f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:04.401 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:04.410+0000 7fc0d194f000 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x564cca4d8280 0x564ccaa49c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:04.401 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:04.410+0000 7fc0d194f000 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x564cca8564f0 con 0x564cca8d8930 2024-04-17T19:47:04.401 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:04.410+0000 7fc0d194f000 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x564cca7f0c10 con 0x564cca4d8280 2024-04-17T19:47:04.401 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:04.410+0000 7fc0d194f000 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x564cca8524b0 con 0x564cca8dfc10 2024-04-17T19:47:04.401 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:04.410+0000 7fc0bbe00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564cca8d8930 0x564ccaa496f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:04.401 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:04.410+0000 7fc0bbe00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564cca8d8930 0x564ccaa496f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:47596/0 (socket says 172.21.15.44:47596) 2024-04-17T19:47:04.401 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:04.410+0000 7fc0bbe00640 1 -- 172.21.15.44:0/2793838633 learned_addr learned my addr 172.21.15.44:0/2793838633 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-04-17T19:47:04.401 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:04.410+0000 7fc0c3400640 1 --2- 172.21.15.44:0/2793838633 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x564cca8dfc10 0x564ccaa491b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:04.401 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:04.410+0000 7fc0c3e00640 1 --2- 172.21.15.44:0/2793838633 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x564cca4d8280 0x564ccaa49c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:04.401 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:04.410+0000 7fc0bbe00640 1 -- 172.21.15.44:0/2793838633 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x564cca8dfc10 msgr2=0x564ccaa491b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T19:47:04.402 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:04.410+0000 7fc0bbe00640 1 --2- 172.21.15.44:0/2793838633 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x564cca8dfc10 0x564ccaa491b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:04.402 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:04.410+0000 7fc0bbe00640 1 -- 172.21.15.44:0/2793838633 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x564cca4d8280 msgr2=0x564ccaa49c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T19:47:04.402 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:04.410+0000 7fc0bbe00640 1 --2- 172.21.15.44:0/2793838633 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x564cca4d8280 0x564ccaa49c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:04.402 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:04.410+0000 7fc0bbe00640 1 -- 172.21.15.44:0/2793838633 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564cca7f0e60 con 0x564cca8d8930 2024-04-17T19:47:04.402 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:04.410+0000 7fc0c3e00640 1 --2- 172.21.15.44:0/2793838633 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x564cca4d8280 0x564ccaa49c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-17T19:47:04.402 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:04.410+0000 7fc0bbe00640 1 --2- 172.21.15.44:0/2793838633 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564cca8d8930 0x564ccaa496f0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fc0ac005920 tx=0x7fc0ac011000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e35747e36107abf2 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:47:04.403 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:04.410+0000 7fc0b3400640 1 -- 172.21.15.44:0/2793838633 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0ac00e7b0 con 0x564cca8d8930 2024-04-17T19:47:04.403 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:04.410+0000 7fc0b3400640 1 -- 172.21.15.44:0/2793838633 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc0ac00e950 con 0x564cca8d8930 2024-04-17T19:47:04.403 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:04.410+0000 7fc0b3400640 1 -- 172.21.15.44:0/2793838633 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0ac00ed00 con 0x564cca8d8930 2024-04-17T19:47:04.403 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:04.410+0000 7fc0d194f000 1 -- 172.21.15.44:0/2793838633 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564cca8d8930 msgr2=0x564ccaa496f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:04.403 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:04.410+0000 7fc0d194f000 1 --2- 172.21.15.44:0/2793838633 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564cca8d8930 0x564ccaa496f0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fc0ac005920 tx=0x7fc0ac011000 comp rx=0 tx=0).stop 2024-04-17T19:47:04.404 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:04.410+0000 7fc0d194f000 1 -- 172.21.15.44:0/2793838633 shutdown_connections 2024-04-17T19:47:04.404 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:04.410+0000 7fc0d194f000 1 --2- 172.21.15.44:0/2793838633 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x564cca4d8280 0x564ccaa49c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:04.404 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:04.410+0000 7fc0d194f000 1 --2- 172.21.15.44:0/2793838633 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564cca8d8930 0x564ccaa496f0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:04.404 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:04.410+0000 7fc0d194f000 1 --2- 172.21.15.44:0/2793838633 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x564cca8dfc10 0x564ccaa491b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:04.404 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:04.414+0000 7fc0d194f000 1 -- 172.21.15.44:0/2793838633 >> 172.21.15.44:0/2793838633 conn(0x564cca921670 msgr2=0x564ccaa46f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:47:04.404 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:04.414+0000 7fc0d194f000 1 -- 172.21.15.44:0/2793838633 shutdown_connections 2024-04-17T19:47:04.404 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:04.414+0000 7fc0d194f000 1 -- 172.21.15.44:0/2793838633 wait complete. 2024-04-17T19:47:04.404 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:04.414+0000 7fc0d194f000 1 -- start start 2024-04-17T19:47:04.404 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:04.414+0000 7fc0d194f000 1 Processor -- start 2024-04-17T19:47:04.406 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:04.414+0000 7fc0d194f000 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x564cca4d8280 0x564ccaa54440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:04.406 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:04.414+0000 7fc0d194f000 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564cca8d8930 0x564ccaa54980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:04.406 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:04.414+0000 7fc0d194f000 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x564cca8dfc10 0x564ccaa0ab70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:04.406 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:04.414+0000 7fc0d194f000 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x564cca8979e0 con 0x564cca8d8930 2024-04-17T19:47:04.406 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:04.414+0000 7fc0d194f000 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x564cca813a80 con 0x564cca8dfc10 2024-04-17T19:47:04.406 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:04.414+0000 7fc0d194f000 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x564cca811d10 con 0x564cca4d8280 2024-04-17T19:47:04.406 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:04.414+0000 7fc0d194f000 10 client.0 _ll_register_callbacks cb 0x564cca9f3b20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-17T19:47:04.406 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:04.414+0000 7fc0bbe00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564cca8d8930 0x564ccaa54980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:04.406 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:04.414+0000 7fc0bbe00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564cca8d8930 0x564ccaa54980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:47612/0 (socket says 172.21.15.44:47612) 2024-04-17T19:47:04.406 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:04.414+0000 7fc0bbe00640 1 -- 172.21.15.44:0/4112998677 learned_addr learned my addr 172.21.15.44:0/4112998677 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-04-17T19:47:04.406 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:04.414+0000 7fc0c3400640 1 --2- 172.21.15.44:0/4112998677 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x564cca4d8280 0x564ccaa54440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:04.406 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:04.414+0000 7fc0c3e00640 1 --2- 172.21.15.44:0/4112998677 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x564cca8dfc10 0x564ccaa0ab70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:04.407 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:04.414+0000 7fc0bbe00640 1 -- 172.21.15.44:0/4112998677 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x564cca4d8280 msgr2=0x564ccaa54440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T19:47:04.407 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:04.414+0000 7fc0bbe00640 1 --2- 172.21.15.44:0/4112998677 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x564cca4d8280 0x564ccaa54440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:04.407 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:04.414+0000 7fc0bbe00640 1 -- 172.21.15.44:0/4112998677 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x564cca8dfc10 msgr2=0x564ccaa0ab70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T19:47:04.407 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:04.414+0000 7fc0bbe00640 1 --2- 172.21.15.44:0/4112998677 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x564cca8dfc10 0x564ccaa0ab70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:04.407 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:04.414+0000 7fc0bbe00640 1 -- 172.21.15.44:0/4112998677 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564cca821e20 con 0x564cca8d8930 2024-04-17T19:47:04.407 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:04.414+0000 7fc0c3e00640 1 --2- 172.21.15.44:0/4112998677 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x564cca8dfc10 0x564ccaa0ab70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-17T19:47:04.409 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:04.414+0000 7fc0bbe00640 1 --2- 172.21.15.44:0/4112998677 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564cca8d8930 0x564ccaa54980 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x564cca85cbf0 tx=0x7fc0ac000ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7ea66f06c6ee772e server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:47:04.409 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:04.414+0000 7fc0a7e00640 10 client.0 ms_handle_connect on v2:172.21.15.44:3300/0 2024-04-17T19:47:04.409 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:04.418+0000 7fc0a7e00640 1 -- 172.21.15.44:0/4112998677 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0ac00e7b0 con 0x564cca8d8930 2024-04-17T19:47:04.409 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:04.418+0000 7fc0a7e00640 1 -- 172.21.15.44:0/4112998677 <== mon.0 v2:172.21.15.44:3300/0 2 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fc0ac0047f0 con 0x564cca8d8930 2024-04-17T19:47:04.409 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:04.418+0000 7fc0d194f000 1 -- 172.21.15.44:0/4112998677 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc0ac00e950 con 0x564cca8d8930 2024-04-17T19:47:04.409 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:04.418+0000 7fc0a7e00640 1 -- 172.21.15.44:0/4112998677 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_get_version_reply(handle=1 version=6) ==== 24+0+0 (secure 0 0 0) 0x7fc0ac031050 con 0x564cca8d8930 2024-04-17T19:47:04.409 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:04.418+0000 7fc0d194f000 10 client.4431 fetch_fsmap learned FSMap version 6 2024-04-17T19:47:04.409 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:04.418+0000 7fc0d194f000 1 -- 172.21.15.44:0/4112998677 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,fsmap=6,monmap=2+}) -- 0x564cca921a80 con 0x564cca8d8930 2024-04-17T19:47:04.409 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:04.418+0000 7fc0a7e00640 1 -- 172.21.15.44:0/4112998677 <== mon.0 v2:172.21.15.44:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc0ac00e950 con 0x564cca8d8930 2024-04-17T19:47:04.409 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:04.418+0000 7fc0a7e00640 1 -- 172.21.15.44:0/4112998677 <== mon.0 v2:172.21.15.44:3300/0 5 ==== fsmap(e 6) ==== 4712+0+0 (secure 0 0 0) 0x7fc0ac034020 con 0x564cca8d8930 2024-04-17T19:47:04.409 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:04.418+0000 7fc0d194f000 10 client.4431 fetch_fsmap finished waiting for FSMap version 6 2024-04-17T19:47:04.409 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:04.418+0000 7fc0d194f000 10 client.4431 resolve_mds: resolved name 'b' to daemon mds.b 2024-04-17T19:47:04.409 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:04.418+0000 7fc0d194f000 20 client.4431 populate_metadata read hostname 'smithi044' 2024-04-17T19:47:04.410 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:04.418+0000 7fc0d194f000 1 --2- 172.21.15.44:0/4112998677 >> [v2:172.21.15.62:6838/1537667111,v1:172.21.15.62:6839/1537667111] conn(0x564cca4fc7d0 0x564ccaa0b820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:04.410 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:04.418+0000 7fc0d194f000 4 client.4431 mds_command: new command op to 4306 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-17T19:47:04.410 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:04.418+0000 7fc0d194f000 1 -- 172.21.15.44:0/4112998677 --> [v2:172.21.15.62:6838/1537667111,v1:172.21.15.62:6839/1537667111] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x564cca7efbe0 con 0x564cca4fc7d0 2024-04-17T19:47:04.410 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:04.418+0000 7fc0c3400640 1 --2- 172.21.15.44:0/4112998677 >> [v2:172.21.15.62:6838/1537667111,v1:172.21.15.62:6839/1537667111] conn(0x564cca4fc7d0 0x564ccaa0b820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:04.410 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:04.418+0000 7fc0c3400640 1 --2- 172.21.15.44:0/4112998677 >> [v2:172.21.15.62:6838/1537667111,v1:172.21.15.62:6839/1537667111] conn(0x564cca4fc7d0 0x564ccaa0b820 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a29779d68324af79 server_cookie=c89e61a989c555c5 in_seq=0 out_seq=0 2024-04-17T19:47:04.410 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:04.418+0000 7fc0a7e00640 10 client.4431 ms_handle_connect on v2:172.21.15.62:6838/1537667111 2024-04-17T19:47:06.715 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:06.726+0000 7fc0a7e00640 1 -- 172.21.15.44:0/4112998677 <== mds.0 v2:172.21.15.62:6838/1537667111 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x564cca7efbe0 con 0x564cca4fc7d0 2024-04-17T19:47:06.715 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:06.726+0000 7fc0a7e00640 10 client.4431 handle_command_reply: tid=0 2024-04-17T19:47:06.715 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:06.726+0000 7fc0d194f000 1 client.4431 shutdown 2024-04-17T19:47:06.715 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:06.726+0000 7fc0d194f000 1 -- 172.21.15.44:0/4112998677 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564cca8d8930 msgr2=0x564ccaa54980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:06.715 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:06.726+0000 7fc0d194f000 1 --2- 172.21.15.44:0/4112998677 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564cca8d8930 0x564ccaa54980 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x564cca85cbf0 tx=0x7fc0ac000ee0 comp rx=0 tx=0).stop 2024-04-17T19:47:06.716 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:06.726+0000 7fc0d194f000 1 -- 172.21.15.44:0/4112998677 shutdown_connections 2024-04-17T19:47:06.716 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:06.726+0000 7fc0d194f000 1 --2- 172.21.15.44:0/4112998677 >> [v2:172.21.15.62:6838/1537667111,v1:172.21.15.62:6839/1537667111] conn(0x564cca4fc7d0 0x564ccaa0b820 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:06.716 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:06.726+0000 7fc0d194f000 1 --2- 172.21.15.44:0/4112998677 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x564cca8dfc10 0x564ccaa0ab70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:06.716 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:06.726+0000 7fc0d194f000 1 --2- 172.21.15.44:0/4112998677 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564cca8d8930 0x564ccaa54980 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:06.716 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:06.726+0000 7fc0d194f000 1 --2- 172.21.15.44:0/4112998677 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x564cca4d8280 0x564ccaa54440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:06.716 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:06.726+0000 7fc0a7e00640 0 client.4431 ms_handle_reset on v2:172.21.15.62:6838/1537667111 2024-04-17T19:47:06.716 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:06.726+0000 7fc0d194f000 1 -- 172.21.15.44:0/4112998677 >> 172.21.15.44:0/4112998677 conn(0x564cca921670 msgr2=0x564ccaa44720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:47:06.716 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:06.726+0000 7fc0d194f000 1 -- 172.21.15.44:0/4112998677 shutdown_connections 2024-04-17T19:47:06.717 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:06.726+0000 7fc0d194f000 1 -- 172.21.15.44:0/4112998677 wait complete. 2024-04-17T19:47:06.717 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:06.726+0000 7fc0d194f000 20 client.4431 trim_cache size 0 max 16384 2024-04-17T19:47:06.736 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:06.746+0000 7fc0d194f000 1 Processor -- start 2024-04-17T19:47:06.736 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:06.746+0000 7fc0d194f000 1 -- start start 2024-04-17T19:47:06.738 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:06.746+0000 7fc0d194f000 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564cca4d8280 0x564ccaa09b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:06.738 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:06.746+0000 7fc0d194f000 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x564cca8d8930 0x564ccaa0a060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:06.738 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:06.746+0000 7fc0d194f000 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x564cca8dfc10 0x564ccaa635d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:06.738 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:06.746+0000 7fc0d194f000 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fc0c4201ce0 con 0x564cca4d8280 2024-04-17T19:47:06.738 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:06.746+0000 7fc0d194f000 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x564cca855800 con 0x564cca8d8930 2024-04-17T19:47:06.738 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:06.746+0000 7fc0d194f000 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x564cca85ab20 con 0x564cca8dfc10 2024-04-17T19:47:06.738 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:06.746+0000 7fc0c3400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564cca4d8280 0x564ccaa09b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:06.739 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:06.750+0000 7fc0c3400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564cca4d8280 0x564ccaa09b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:42578/0 (socket says 172.21.15.44:42578) 2024-04-17T19:47:06.739 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:06.750+0000 7fc0c3400640 1 -- 172.21.15.44:0/3221030297 learned_addr learned my addr 172.21.15.44:0/3221030297 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-04-17T19:47:06.739 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:06.750+0000 7fc0bbe00640 1 --2- 172.21.15.44:0/3221030297 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x564cca8d8930 0x564ccaa0a060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:06.739 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:06.750+0000 7fc0c3e00640 1 --2- 172.21.15.44:0/3221030297 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x564cca8dfc10 0x564ccaa635d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:06.740 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:06.750+0000 7fc0c3400640 1 -- 172.21.15.44:0/3221030297 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x564cca8dfc10 msgr2=0x564ccaa635d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T19:47:06.740 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:06.750+0000 7fc0c3400640 1 --2- 172.21.15.44:0/3221030297 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x564cca8dfc10 0x564ccaa635d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:06.740 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:06.750+0000 7fc0c3400640 1 -- 172.21.15.44:0/3221030297 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x564cca8d8930 msgr2=0x564ccaa0a060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T19:47:06.740 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:06.750+0000 7fc0c3400640 1 --2- 172.21.15.44:0/3221030297 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x564cca8d8930 0x564ccaa0a060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:06.740 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:06.750+0000 7fc0c3400640 1 -- 172.21.15.44:0/3221030297 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564cca8afe30 con 0x564cca4d8280 2024-04-17T19:47:06.740 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:06.750+0000 7fc0c3400640 1 --2- 172.21.15.44:0/3221030297 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564cca4d8280 0x564ccaa09b20 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fc0b4052110 tx=0x7fc0b4005040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=beea3b878c2e9e56 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:47:06.740 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:06.750+0000 7fc0b2a00640 1 -- 172.21.15.44:0/3221030297 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0b4082030 con 0x564cca4d8280 2024-04-17T19:47:06.740 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:06.750+0000 7fc0b2a00640 1 -- 172.21.15.44:0/3221030297 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc0b40842f0 con 0x564cca4d8280 2024-04-17T19:47:06.740 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:06.750+0000 7fc0b2a00640 1 -- 172.21.15.44:0/3221030297 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0b4053fb0 con 0x564cca4d8280 2024-04-17T19:47:06.741 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:06.750+0000 7fc0d194f000 1 -- 172.21.15.44:0/3221030297 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564cca4d8280 msgr2=0x564ccaa09b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:06.741 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:06.750+0000 7fc0d194f000 1 --2- 172.21.15.44:0/3221030297 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564cca4d8280 0x564ccaa09b20 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fc0b4052110 tx=0x7fc0b4005040 comp rx=0 tx=0).stop 2024-04-17T19:47:06.741 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:06.750+0000 7fc0d194f000 1 -- 172.21.15.44:0/3221030297 shutdown_connections 2024-04-17T19:47:06.741 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:06.750+0000 7fc0d194f000 1 --2- 172.21.15.44:0/3221030297 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x564cca8dfc10 0x564ccaa635d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:06.741 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:06.750+0000 7fc0d194f000 1 --2- 172.21.15.44:0/3221030297 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x564cca8d8930 0x564ccaa0a060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:06.741 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:06.750+0000 7fc0d194f000 1 --2- 172.21.15.44:0/3221030297 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564cca4d8280 0x564ccaa09b20 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:06.741 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:06.750+0000 7fc0d194f000 1 -- 172.21.15.44:0/3221030297 >> 172.21.15.44:0/3221030297 conn(0x564cca921670 msgr2=0x564ccaa0e260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:47:06.741 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:06.750+0000 7fc0d194f000 1 -- 172.21.15.44:0/3221030297 shutdown_connections 2024-04-17T19:47:06.741 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:06.750+0000 7fc0d194f000 1 -- 172.21.15.44:0/3221030297 wait complete. 2024-04-17T19:47:06.742 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:06.750+0000 7fc0d194f000 1 -- start start 2024-04-17T19:47:06.742 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:06.750+0000 7fc0d194f000 1 Processor -- start 2024-04-17T19:47:06.744 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:06.754+0000 7fc0d194f000 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x564cca4d8280 0x564ccaabd700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:06.744 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:06.754+0000 7fc0d194f000 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x564cca8d8930 0x564ccaabdc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:06.744 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:06.754+0000 7fc0d194f000 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564cca8dfc10 0x564ccaa57570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:06.744 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:06.754+0000 7fc0d194f000 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x564cca7ec7d0 con 0x564cca8dfc10 2024-04-17T19:47:06.744 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:06.754+0000 7fc0d194f000 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x564cca863700 con 0x564cca4d8280 2024-04-17T19:47:06.744 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:06.754+0000 7fc0d194f000 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x564cca81cb10 con 0x564cca8d8930 2024-04-17T19:47:06.744 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:06.754+0000 7fc0d194f000 10 client.0 _ll_register_callbacks cb 0x7fc0b40010b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-17T19:47:06.744 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:06.754+0000 7fc0c3e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564cca8dfc10 0x564ccaa57570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:06.745 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:06.754+0000 7fc0c3e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564cca8dfc10 0x564ccaa57570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:42580/0 (socket says 172.21.15.44:42580) 2024-04-17T19:47:06.745 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:06.754+0000 7fc0c3e00640 1 -- 172.21.15.44:0/3883928936 learned_addr learned my addr 172.21.15.44:0/3883928936 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-04-17T19:47:06.745 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:06.754+0000 7fc0bbe00640 1 --2- 172.21.15.44:0/3883928936 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x564cca8d8930 0x564ccaabdc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:06.745 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:06.754+0000 7fc0c3400640 1 --2- 172.21.15.44:0/3883928936 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x564cca4d8280 0x564ccaabd700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:06.745 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:06.754+0000 7fc0c3e00640 1 -- 172.21.15.44:0/3883928936 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x564cca8d8930 msgr2=0x564ccaabdc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T19:47:06.745 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:06.754+0000 7fc0c3e00640 1 --2- 172.21.15.44:0/3883928936 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x564cca8d8930 0x564ccaabdc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:06.745 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:06.754+0000 7fc0c3e00640 1 -- 172.21.15.44:0/3883928936 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x564cca4d8280 msgr2=0x564ccaabd700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T19:47:06.745 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:06.754+0000 7fc0c3e00640 1 --2- 172.21.15.44:0/3883928936 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x564cca4d8280 0x564ccaabd700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:06.745 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:06.754+0000 7fc0c3e00640 1 -- 172.21.15.44:0/3883928936 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564cca7e87e0 con 0x564cca8dfc10 2024-04-17T19:47:06.747 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:06.754+0000 7fc0c3e00640 1 --2- 172.21.15.44:0/3883928936 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564cca8dfc10 0x564ccaa57570 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fc0bc009d90 tx=0x7fc0bc01b120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=53fdf136b9d83ba7 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:47:06.747 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:06.754+0000 7fc0a7e00640 10 client.0 ms_handle_connect on v2:172.21.15.44:3300/0 2024-04-17T19:47:06.747 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:06.754+0000 7fc0a7e00640 1 -- 172.21.15.44:0/3883928936 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0bc0b2040 con 0x564cca8dfc10 2024-04-17T19:47:06.747 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:06.754+0000 7fc0a7e00640 1 -- 172.21.15.44:0/3883928936 <== mon.0 v2:172.21.15.44:3300/0 2 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fc0bc0c5e00 con 0x564cca8dfc10 2024-04-17T19:47:06.747 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:06.754+0000 7fc0d194f000 1 -- 172.21.15.44:0/3883928936 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc0b40842f0 con 0x564cca8dfc10 2024-04-17T19:47:06.747 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:06.754+0000 7fc0a7e00640 1 -- 172.21.15.44:0/3883928936 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_get_version_reply(handle=1 version=6) ==== 24+0+0 (secure 0 0 0) 0x7fc0bc003c60 con 0x564cca8dfc10 2024-04-17T19:47:06.747 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:06.754+0000 7fc0d194f000 10 client.4437 fetch_fsmap learned FSMap version 6 2024-04-17T19:47:06.747 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:06.754+0000 7fc0d194f000 1 -- 172.21.15.44:0/3883928936 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,fsmap=6,monmap=2+}) -- 0x564cca7fb670 con 0x564cca8dfc10 2024-04-17T19:47:06.748 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:06.754+0000 7fc0a7e00640 1 -- 172.21.15.44:0/3883928936 <== mon.0 v2:172.21.15.44:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc0b40842f0 con 0x564cca8dfc10 2024-04-17T19:47:06.748 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:06.754+0000 7fc0a7e00640 1 -- 172.21.15.44:0/3883928936 <== mon.0 v2:172.21.15.44:3300/0 5 ==== fsmap(e 6) ==== 4712+0+0 (secure 0 0 0) 0x7fc0bc0cf700 con 0x564cca8dfc10 2024-04-17T19:47:06.748 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:06.754+0000 7fc0d194f000 10 client.4437 fetch_fsmap finished waiting for FSMap version 6 2024-04-17T19:47:06.748 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:06.754+0000 7fc0d194f000 10 client.4437 resolve_mds: resolved name 'b' to daemon mds.b 2024-04-17T19:47:06.748 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:06.754+0000 7fc0d194f000 20 client.4437 populate_metadata read hostname 'smithi044' 2024-04-17T19:47:06.748 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:06.754+0000 7fc0d194f000 1 --2- 172.21.15.44:0/3883928936 >> [v2:172.21.15.62:6838/1537667111,v1:172.21.15.62:6839/1537667111] conn(0x564cca4ea830 0x564ccaa581c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:06.748 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:06.754+0000 7fc0d194f000 4 client.4437 mds_command: new command op to 4306 tid=0 multi_id=0 [{"prefix": "status"}] 2024-04-17T19:47:06.748 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:06.754+0000 7fc0d194f000 1 -- 172.21.15.44:0/3883928936 --> [v2:172.21.15.62:6838/1537667111,v1:172.21.15.62:6839/1537667111] -- command(tid 0: {"prefix": "status"}) -- 0x564cca863f10 con 0x564cca4ea830 2024-04-17T19:47:06.748 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:06.758+0000 7fc0c3400640 1 --2- 172.21.15.44:0/3883928936 >> [v2:172.21.15.62:6838/1537667111,v1:172.21.15.62:6839/1537667111] conn(0x564cca4ea830 0x564ccaa581c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:06.748 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:06.758+0000 7fc0c3400640 1 --2- 172.21.15.44:0/3883928936 >> [v2:172.21.15.62:6838/1537667111,v1:172.21.15.62:6839/1537667111] conn(0x564cca4ea830 0x564ccaa581c0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bcc933ad879d877d server_cookie=d33635804b0fa1c9 in_seq=0 out_seq=0 2024-04-17T19:47:06.748 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:06.758+0000 7fc0a7e00640 10 client.4437 ms_handle_connect on v2:172.21.15.62:6838/1537667111 2024-04-17T19:47:06.749 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:06.758+0000 7fc0a7e00640 1 -- 172.21.15.44:0/3883928936 <== mds.0 v2:172.21.15.62:6838/1537667111 1 ==== command_reply(tid 0: 0 ) ==== 8+0+318 (crc 0 0 0) 0x564cca863f10 con 0x564cca4ea830 2024-04-17T19:47:06.749 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:06.758+0000 7fc0a7e00640 10 client.4437 handle_command_reply: tid=0 2024-04-17T19:47:06.749 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:06.758+0000 7fc0d194f000 1 client.4437 shutdown 2024-04-17T19:47:06.749 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:06.758+0000 7fc0d194f000 1 -- 172.21.15.44:0/3883928936 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564cca8dfc10 msgr2=0x564ccaa57570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:06.750 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:06.758+0000 7fc0d194f000 1 --2- 172.21.15.44:0/3883928936 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564cca8dfc10 0x564ccaa57570 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fc0bc009d90 tx=0x7fc0bc01b120 comp rx=0 tx=0).stop 2024-04-17T19:47:06.750 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:06.758+0000 7fc0d194f000 1 -- 172.21.15.44:0/3883928936 shutdown_connections 2024-04-17T19:47:06.750 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:06.758+0000 7fc0d194f000 1 --2- 172.21.15.44:0/3883928936 >> [v2:172.21.15.62:6838/1537667111,v1:172.21.15.62:6839/1537667111] conn(0x564cca4ea830 0x564ccaa581c0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:06.750 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:06.758+0000 7fc0d194f000 1 --2- 172.21.15.44:0/3883928936 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x564cca8d8930 0x564ccaabdc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:06.750 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:06.758+0000 7fc0d194f000 1 --2- 172.21.15.44:0/3883928936 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564cca8dfc10 0x564ccaa57570 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:06.750 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:06.758+0000 7fc0d194f000 1 --2- 172.21.15.44:0/3883928936 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x564cca4d8280 0x564ccaabd700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:06.750 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:06.758+0000 7fc0a7e00640 0 client.4437 ms_handle_reset on v2:172.21.15.62:6838/1537667111 2024-04-17T19:47:06.750 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:06.758+0000 7fc0d194f000 1 -- 172.21.15.44:0/3883928936 >> 172.21.15.44:0/3883928936 conn(0x564cca921670 msgr2=0x564ccaa0d830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:47:06.750 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:06.758+0000 7fc0d194f000 1 -- 172.21.15.44:0/3883928936 shutdown_connections 2024-04-17T19:47:06.750 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:06.758+0000 7fc0d194f000 1 -- 172.21.15.44:0/3883928936 wait complete. 2024-04-17T19:47:06.750 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:06.758+0000 7fc0d194f000 20 client.4437 trim_cache size 0 max 16384 2024-04-17T19:47:06.751 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2024-04-17T19:47:06.751 INFO:teuthology.orchestra.run.smithi044.stdout: "cluster_fsid": "703f77ca-79c6-4a66-b576-62c526cb1021", 2024-04-17T19:47:06.751 INFO:teuthology.orchestra.run.smithi044.stdout: "whoami": 0, 2024-04-17T19:47:06.751 INFO:teuthology.orchestra.run.smithi044.stdout: "id": 4306, 2024-04-17T19:47:06.751 INFO:teuthology.orchestra.run.smithi044.stdout: "want_state": "up:active", 2024-04-17T19:47:06.751 INFO:teuthology.orchestra.run.smithi044.stdout: "state": "up:active", 2024-04-17T19:47:06.751 INFO:teuthology.orchestra.run.smithi044.stdout: "fs_name": "cephfs", 2024-04-17T19:47:06.751 INFO:teuthology.orchestra.run.smithi044.stdout: "rank_uptime": 10.099980183, 2024-04-17T19:47:06.751 INFO:teuthology.orchestra.run.smithi044.stdout: "mdsmap_epoch": 5, 2024-04-17T19:47:06.751 INFO:teuthology.orchestra.run.smithi044.stdout: "osdmap_epoch": 25, 2024-04-17T19:47:06.751 INFO:teuthology.orchestra.run.smithi044.stdout: "osdmap_epoch_barrier": 25, 2024-04-17T19:47:06.751 INFO:teuthology.orchestra.run.smithi044.stdout: "uptime": 17.353727787 2024-04-17T19:47:06.751 INFO:teuthology.orchestra.run.smithi044.stdout:} 2024-04-17T19:47:06.752 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:06.758+0000 7fc0ca200640 1 -- 172.21.15.44:0/1653068831 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7fc0a00683b0 msgr2=0x7fc0a006a8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:06.752 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:06.758+0000 7fc0ca200640 1 --2- 172.21.15.44:0/1653068831 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7fc0a00683b0 0x7fc0a006a8c0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fc0c4157160 tx=0x7fc0ac009040 comp rx=0 tx=0).stop 2024-04-17T19:47:06.752 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:06.758+0000 7fc0ca200640 1 -- 172.21.15.44:0/1653068831 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc0c40c68b0 msgr2=0x7fc0c4145fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:06.752 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:06.758+0000 7fc0ca200640 1 --2- 172.21.15.44:0/1653068831 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc0c40c68b0 0x7fc0c4145fa0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fc0b400c340 tx=0x7fc0b400c800 comp rx=0 tx=0).stop 2024-04-17T19:47:06.752 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:06.758+0000 7fc0ca200640 1 -- 172.21.15.44:0/1653068831 shutdown_connections 2024-04-17T19:47:06.753 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:06.758+0000 7fc0ca200640 1 --2- 172.21.15.44:0/1653068831 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7fc0a00683b0 0x7fc0a006a8c0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:06.753 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:06.758+0000 7fc0ca200640 1 --2- 172.21.15.44:0/1653068831 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fc0c4152860 0x7fc0c4147cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:06.753 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:06.758+0000 7fc0ca200640 1 --2- 172.21.15.44:0/1653068831 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc0c40c80a0 0x7fc0c4145460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:06.753 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:06.758+0000 7fc0ca200640 1 --2- 172.21.15.44:0/1653068831 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc0c40c68b0 0x7fc0c4145fa0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:06.753 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:06.758+0000 7fc0ca200640 1 -- 172.21.15.44:0/1653068831 >> 172.21.15.44:0/1653068831 conn(0x7fc0c406c380 msgr2=0x7fc0c40c9ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:47:06.753 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:06.758+0000 7fc0ca200640 1 -- 172.21.15.44:0/1653068831 shutdown_connections 2024-04-17T19:47:06.753 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:06.758+0000 7fc0ca200640 1 -- 172.21.15.44:0/1653068831 wait complete. 2024-04-17T19:47:06.772 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-04-17T19:47:06.772 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.admin 2024-04-17T19:47:06.773 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-04-17T19:47:06.929 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:06.938+0000 7f84c7800640 1 Processor -- start 2024-04-17T19:47:06.929 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:06.938+0000 7f84c7800640 1 -- start start 2024-04-17T19:47:06.931 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:06.942+0000 7f84c7800640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f84c00ca550 0x7f84c00ca960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:06.931 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:06.942+0000 7f84c7800640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f84c015f200 con 0x7f84c00c3b70 2024-04-17T19:47:06.931 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:06.942+0000 7f84c7800640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f84c015f4e0 con 0x7f84c015c6b0 2024-04-17T19:47:06.931 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:06.942+0000 7f84c7800640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 -- 0x7f84c00caea0 con 0x7f84c00ca550 2024-04-17T19:47:06.931 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:06.942+0000 7f84c5800640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f84c00c3b70 0x7f84c00c3f80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:51400/0 (socket says 172.21.15.44:51400) 2024-04-17T19:47:06.931 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:06.942+0000 7f84c5800640 1 -- 172.21.15.44:0/3315867937 learned_addr learned my addr 172.21.15.44:0/3315867937 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-04-17T19:47:06.932 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:06.942+0000 7f84bfe00640 1 --2- 172.21.15.44:0/3315867937 >> v2:172.21.15.62:3300/0 conn(0x7f84c00ca550 0x7f84c00ca960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:06.932 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:06.942+0000 7f84bf400640 1 -- 172.21.15.44:0/3315867937 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2649334408 0 0) 0x7f84c015f200 con 0x7f84c00c3b70 2024-04-17T19:47:06.932 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:06.942+0000 7f84bf400640 1 -- 172.21.15.44:0/3315867937 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f84a8003530 con 0x7f84c00c3b70 2024-04-17T19:47:06.932 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:06.942+0000 7f84bfe00640 1 -- 172.21.15.44:0/3315867937 >> v1:172.21.15.62:6789/0 conn(0x7f84c015c6b0 legacy=0x7f84c00c8cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:06.932 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:06.942+0000 7f84bfe00640 1 -- 172.21.15.44:0/3315867937 >> v1:172.21.15.44:6789/0 conn(0x7f84c00c3b70 legacy=0x7f84c00c3f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:06.933 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:06.942+0000 7f84bfe00640 1 -- 172.21.15.44:0/3315867937 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f84c015f7c0 con 0x7f84c00ca550 2024-04-17T19:47:06.935 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:06.946+0000 7f84bfe00640 1 --2- 172.21.15.44:0/3315867937 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f84c00ca550 0x7f84c00ca960 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f84ac0097c0 tx=0x7f84ac01ec90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=41d34344a27ec96b server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:47:06.936 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:06.946+0000 7f84bf400640 1 -- 172.21.15.44:0/3315867937 <== mon.1 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84ac0b5070 con 0x7f84c00ca550 2024-04-17T19:47:06.936 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:06.946+0000 7f84bf400640 1 -- 172.21.15.44:0/3315867937 <== mon.1 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f84ac0a8990 con 0x7f84c00ca550 2024-04-17T19:47:06.936 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:06.946+0000 7f84bf400640 1 -- 172.21.15.44:0/3315867937 <== mon.1 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84ac0a8d40 con 0x7f84c00ca550 2024-04-17T19:47:06.937 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:06.946+0000 7f84c7800640 1 -- 172.21.15.44:0/3315867937 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f84c00ca550 msgr2=0x7f84c00ca960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:06.937 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:06.946+0000 7f84c7800640 1 --2- 172.21.15.44:0/3315867937 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f84c00ca550 0x7f84c00ca960 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f84ac0097c0 tx=0x7f84ac01ec90 comp rx=0 tx=0).stop 2024-04-17T19:47:06.937 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:06.946+0000 7f84c7800640 1 -- 172.21.15.44:0/3315867937 shutdown_connections 2024-04-17T19:47:06.937 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:06.946+0000 7f84c7800640 1 --2- 172.21.15.44:0/3315867937 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f84c00ca550 0x7f84c00ca960 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:06.937 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:06.946+0000 7f84c7800640 1 -- 172.21.15.44:0/3315867937 >> 172.21.15.44:0/3315867937 conn(0x7f84c0073650 msgr2=0x7f84c0073a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:47:06.937 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:06.946+0000 7f84c7800640 1 -- 172.21.15.44:0/3315867937 shutdown_connections 2024-04-17T19:47:06.937 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:06.946+0000 7f84c7800640 1 -- 172.21.15.44:0/3315867937 wait complete. 2024-04-17T19:47:06.939 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:06.950+0000 7f84c7800640 1 Processor -- start 2024-04-17T19:47:06.939 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:06.950+0000 7f84c7800640 1 -- start start 2024-04-17T19:47:06.941 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:06.950+0000 7f84c7800640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f84c00c3b70 0x7f84c006f570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:06.941 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:06.950+0000 7f84c7800640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f84c00ca550 0x7f84c01548b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:06.941 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:06.950+0000 7f84c7800640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f84c015c6b0 0x7f84c0154df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:06.941 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:06.950+0000 7f84c7800640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f84c00c93c0 con 0x7f84c00ca550 2024-04-17T19:47:06.942 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:06.950+0000 7f84c7800640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f84c015fe10 con 0x7f84c00c3b70 2024-04-17T19:47:06.942 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:06.950+0000 7f84c7800640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7f84c00c9540 con 0x7f84c015c6b0 2024-04-17T19:47:06.942 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:06.950+0000 7f84bfe00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f84c00ca550 0x7f84c01548b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:06.942 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:06.950+0000 7f84bfe00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f84c00ca550 0x7f84c01548b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:42584/0 (socket says 172.21.15.44:42584) 2024-04-17T19:47:06.942 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:06.950+0000 7f84bfe00640 1 -- 172.21.15.44:0/2919360593 learned_addr learned my addr 172.21.15.44:0/2919360593 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-04-17T19:47:06.942 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:06.950+0000 7f84c4e00640 1 --2- 172.21.15.44:0/2919360593 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f84c00c3b70 0x7f84c006f570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:06.942 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:06.950+0000 7f84c5800640 1 --2- 172.21.15.44:0/2919360593 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f84c015c6b0 0x7f84c0154df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:06.942 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:06.950+0000 7f84bfe00640 1 -- 172.21.15.44:0/2919360593 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f84c015c6b0 msgr2=0x7f84c0154df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:06.942 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:06.950+0000 7f84bfe00640 1 --2- 172.21.15.44:0/2919360593 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f84c015c6b0 0x7f84c0154df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:06.942 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:06.950+0000 7f84bfe00640 1 -- 172.21.15.44:0/2919360593 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f84c00c3b70 msgr2=0x7f84c006f570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:06.942 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:06.950+0000 7f84bfe00640 1 --2- 172.21.15.44:0/2919360593 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f84c00c3b70 0x7f84c006f570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:06.942 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:06.950+0000 7f84bfe00640 1 -- 172.21.15.44:0/2919360593 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f84c015e290 con 0x7f84c00ca550 2024-04-17T19:47:06.942 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:06.950+0000 7f84c4e00640 1 --2- 172.21.15.44:0/2919360593 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f84c00c3b70 0x7f84c006f570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-17T19:47:06.942 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:06.950+0000 7f84bfe00640 1 --2- 172.21.15.44:0/2919360593 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f84c00ca550 0x7f84c01548b0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f84ac0b3040 tx=0x7f84ac01ba30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:47:06.943 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:06.950+0000 7f84bcc00640 1 -- 172.21.15.44:0/2919360593 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84ac0b5040 con 0x7f84c00ca550 2024-04-17T19:47:06.943 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:06.950+0000 7f84bcc00640 1 -- 172.21.15.44:0/2919360593 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f84ac0c0070 con 0x7f84c00ca550 2024-04-17T19:47:06.943 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:06.950+0000 7f84c7800640 1 -- 172.21.15.44:0/2919360593 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f84c01f2ad0 con 0x7f84c00ca550 2024-04-17T19:47:06.943 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:06.950+0000 7f84bcc00640 1 -- 172.21.15.44:0/2919360593 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84ac003620 con 0x7f84c00ca550 2024-04-17T19:47:06.943 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:06.954+0000 7f84c7800640 1 -- 172.21.15.44:0/2919360593 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f84c01f2db0 con 0x7f84c00ca550 2024-04-17T19:47:06.943 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:06.954+0000 7f84c7800640 1 -- 172.21.15.44:0/2919360593 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f84c004ff10 con 0x7f84c00ca550 2024-04-17T19:47:06.944 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:06.954+0000 7f84bcc00640 1 -- 172.21.15.44:0/2919360593 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f84ac0037c0 con 0x7f84c00ca550 2024-04-17T19:47:06.945 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:06.954+0000 7f84bcc00640 1 --2- 172.21.15.44:0/2919360593 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f84a00683b0 0x7f84a006a8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:06.945 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:06.954+0000 7f84bcc00640 1 -- 172.21.15.44:0/2919360593 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f84ac124190 con 0x7f84c00ca550 2024-04-17T19:47:06.945 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:06.954+0000 7f84c4e00640 1 --2- 172.21.15.44:0/2919360593 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f84a00683b0 0x7f84a006a8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:06.946 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:06.958+0000 7f84c4e00640 1 --2- 172.21.15.44:0/2919360593 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f84a00683b0 0x7f84a006a8c0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f84b4000f70 tx=0x7f84b4009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:47:06.949 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:06.958+0000 7f84bcc00640 1 -- 172.21.15.44:0/2919360593 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f84ac0187f0 con 0x7f84c00ca550 2024-04-17T19:47:07.151 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:07.162+0000 7f84c7800640 1 -- 172.21.15.44:0/2919360593 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f84c00c97f0 con 0x7f84c00ca550 2024-04-17T19:47:07.151 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:07.162+0000 7f84bcc00640 1 -- 172.21.15.44:0/2919360593 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v6) ==== 53+0+88 (secure 0 0 0) 0x7f84ac0f42f0 con 0x7f84c00ca550 2024-04-17T19:47:07.151 INFO:teuthology.orchestra.run.smithi044.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2024-04-17T19:47:07.154 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:07.162+0000 7f84c7800640 1 -- 172.21.15.44:0/2919360593 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f84a00683b0 msgr2=0x7f84a006a8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:07.154 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:07.162+0000 7f84c7800640 1 --2- 172.21.15.44:0/2919360593 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f84a00683b0 0x7f84a006a8c0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f84b4000f70 tx=0x7f84b4009040 comp rx=0 tx=0).stop 2024-04-17T19:47:07.154 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:07.162+0000 7f84c7800640 1 -- 172.21.15.44:0/2919360593 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f84c00ca550 msgr2=0x7f84c01548b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:07.154 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:07.162+0000 7f84c7800640 1 --2- 172.21.15.44:0/2919360593 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f84c00ca550 0x7f84c01548b0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f84ac0b3040 tx=0x7f84ac01ba30 comp rx=0 tx=0).stop 2024-04-17T19:47:07.154 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:07.162+0000 7f84c7800640 1 -- 172.21.15.44:0/2919360593 shutdown_connections 2024-04-17T19:47:07.154 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:07.162+0000 7f84c7800640 1 --2- 172.21.15.44:0/2919360593 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f84a00683b0 0x7f84a006a8c0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:07.154 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:07.162+0000 7f84c7800640 1 --2- 172.21.15.44:0/2919360593 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f84c015c6b0 0x7f84c0154df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:07.154 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:07.162+0000 7f84c7800640 1 --2- 172.21.15.44:0/2919360593 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f84c00ca550 0x7f84c01548b0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:07.154 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:07.162+0000 7f84c7800640 1 --2- 172.21.15.44:0/2919360593 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f84c00c3b70 0x7f84c006f570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:07.154 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:07.162+0000 7f84c7800640 1 -- 172.21.15.44:0/2919360593 >> 172.21.15.44:0/2919360593 conn(0x7f84c0073650 msgr2=0x7f84c00cd1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:47:07.154 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:07.162+0000 7f84c7800640 1 -- 172.21.15.44:0/2919360593 shutdown_connections 2024-04-17T19:47:07.154 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:07.162+0000 7f84c7800640 1 -- 172.21.15.44:0/2919360593 wait complete. 2024-04-17T19:47:07.173 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-04-17T19:47:07.173 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-04-17T19:47:07.174 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi044.front.sepia.ceph.com 2024-04-17T19:47:07.174 INFO:tasks.cephfs.mount:self.client.name = client.admin 2024-04-17T19:47:07.174 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.admin 2024-04-17T19:47:07.174 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-04-17T19:47:07.174 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-04-17T19:47:07.174 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-04-17T19:47:07.174 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.admin' 2024-04-17T19:47:07.174 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-17T19:47:07.174 DEBUG:teuthology.orchestra.run.smithi044:> ip addr 2024-04-17T19:47:07.184 INFO:teuthology.orchestra.run.smithi044.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-17T19:47:07.184 INFO:teuthology.orchestra.run.smithi044.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-17T19:47:07.184 INFO:teuthology.orchestra.run.smithi044.stdout: inet 127.0.0.1/8 scope host lo 2024-04-17T19:47:07.184 INFO:teuthology.orchestra.run.smithi044.stdout: valid_lft forever preferred_lft forever 2024-04-17T19:47:07.184 INFO:teuthology.orchestra.run.smithi044.stdout: inet6 ::1/128 scope host 2024-04-17T19:47:07.184 INFO:teuthology.orchestra.run.smithi044.stdout: valid_lft forever preferred_lft forever 2024-04-17T19:47:07.184 INFO:teuthology.orchestra.run.smithi044.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-17T19:47:07.184 INFO:teuthology.orchestra.run.smithi044.stdout: link/ether 0c:c4:7a:6b:f7:8c brd ff:ff:ff:ff:ff:ff 2024-04-17T19:47:07.184 INFO:teuthology.orchestra.run.smithi044.stdout: altname enp7s0f0 2024-04-17T19:47:07.185 INFO:teuthology.orchestra.run.smithi044.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-17T19:47:07.185 INFO:teuthology.orchestra.run.smithi044.stdout: link/ether 0c:c4:7a:6b:f7:8d brd ff:ff:ff:ff:ff:ff 2024-04-17T19:47:07.185 INFO:teuthology.orchestra.run.smithi044.stdout: altname enp7s0f1 2024-04-17T19:47:07.185 INFO:teuthology.orchestra.run.smithi044.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-04-17T19:47:07.185 INFO:teuthology.orchestra.run.smithi044.stdout: link/ether 0c:c4:7a:bd:15:72 brd ff:ff:ff:ff:ff:ff 2024-04-17T19:47:07.185 INFO:teuthology.orchestra.run.smithi044.stdout: altname enp1s0f0 2024-04-17T19:47:07.185 INFO:teuthology.orchestra.run.smithi044.stdout: inet 172.21.15.44/20 brd 172.21.15.255 scope global dynamic ens1f0 2024-04-17T19:47:07.185 INFO:teuthology.orchestra.run.smithi044.stdout: valid_lft 42415sec preferred_lft 42415sec 2024-04-17T19:47:07.185 INFO:teuthology.orchestra.run.smithi044.stdout: inet6 fe80::ec4:7aff:febd:1572/64 scope link 2024-04-17T19:47:07.185 INFO:teuthology.orchestra.run.smithi044.stdout: valid_lft forever preferred_lft forever 2024-04-17T19:47:07.185 INFO:teuthology.orchestra.run.smithi044.stdout:5: ens1f1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-17T19:47:07.185 INFO:teuthology.orchestra.run.smithi044.stdout: link/ether 0c:c4:7a:bd:15:73 brd ff:ff:ff:ff:ff:ff 2024-04-17T19:47:07.185 INFO:teuthology.orchestra.run.smithi044.stdout: altname enp1s0f1 2024-04-17T19:47:07.185 INFO:teuthology.orchestra.run.smithi044.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-04-17T19:47:07.185 INFO:teuthology.orchestra.run.smithi044.stdout: link/ether 02:42:b8:20:f4:9e brd ff:ff:ff:ff:ff:ff 2024-04-17T19:47:07.185 INFO:teuthology.orchestra.run.smithi044.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-04-17T19:47:07.186 INFO:teuthology.orchestra.run.smithi044.stdout: valid_lft forever preferred_lft forever 2024-04-17T19:47:07.186 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-04-17T19:47:07.186 DEBUG:teuthology.orchestra.run.smithi044:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-17T19:47:07.186 DEBUG:teuthology.orchestra.run.smithi044:> set -e 2024-04-17T19:47:07.186 DEBUG:teuthology.orchestra.run.smithi044:> sudo ip link add name ceph-brx type bridge 2024-04-17T19:47:07.186 DEBUG:teuthology.orchestra.run.smithi044:> sudo ip addr flush dev ceph-brx 2024-04-17T19:47:07.186 DEBUG:teuthology.orchestra.run.smithi044:> sudo ip link set ceph-brx up 2024-04-17T19:47:07.186 DEBUG:teuthology.orchestra.run.smithi044:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-04-17T19:47:07.186 DEBUG:teuthology.orchestra.run.smithi044:> ') 2024-04-17T19:47:07.273 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:07 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-17T19:47:07.336 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:07 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-17T19:47:07.343 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-17T19:47:07.343 DEBUG:teuthology.orchestra.run.smithi044:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-04-17T19:47:07.361 INFO:teuthology.orchestra.run.smithi044.stdout:1 2024-04-17T19:47:07.364 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-17T19:47:07.364 DEBUG:teuthology.orchestra.run.smithi044:> route 2024-04-17T19:47:07.435 INFO:teuthology.orchestra.run.smithi044.stdout:Kernel IP routing table 2024-04-17T19:47:07.435 INFO:teuthology.orchestra.run.smithi044.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-04-17T19:47:07.436 INFO:teuthology.orchestra.run.smithi044.stdout:default _gateway 0.0.0.0 UG 0 0 0 ens1f0 2024-04-17T19:47:07.436 INFO:teuthology.orchestra.run.smithi044.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-04-17T19:47:07.436 INFO:teuthology.orchestra.run.smithi044.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 ens1f0 2024-04-17T19:47:07.436 INFO:teuthology.orchestra.run.smithi044.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-04-17T19:47:07.436 DEBUG:teuthology.orchestra.run.smithi044:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-17T19:47:07.436 DEBUG:teuthology.orchestra.run.smithi044:> set -e 2024-04-17T19:47:07.436 DEBUG:teuthology.orchestra.run.smithi044:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-04-17T19:47:07.436 DEBUG:teuthology.orchestra.run.smithi044:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-04-17T19:47:07.436 DEBUG:teuthology.orchestra.run.smithi044:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-04-17T19:47:07.436 DEBUG:teuthology.orchestra.run.smithi044:> ') 2024-04-17T19:47:07.525 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:07 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-17T19:47:07.567 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:07 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-17T19:47:07.573 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-17T19:47:07.573 DEBUG:teuthology.orchestra.run.smithi044:> ip netns list 2024-04-17T19:47:07.583 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-17T19:47:07.583 DEBUG:teuthology.orchestra.run.smithi044:> ip netns list-id 2024-04-17T19:47:07.634 DEBUG:teuthology.orchestra.run.smithi044:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-17T19:47:07.634 DEBUG:teuthology.orchestra.run.smithi044:> set -e 2024-04-17T19:47:07.634 DEBUG:teuthology.orchestra.run.smithi044:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-04-17T19:47:07.635 DEBUG:teuthology.orchestra.run.smithi044:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.admin 0 2024-04-17T19:47:07.635 DEBUG:teuthology.orchestra.run.smithi044:> ') 2024-04-17T19:47:07.725 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:07 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-17T19:47:07.758 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:07 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-17T19:47:07.765 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.admin' with 192.168.0.1/16 2024-04-17T19:47:07.765 DEBUG:teuthology.orchestra.run.smithi044:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-17T19:47:07.765 DEBUG:teuthology.orchestra.run.smithi044:> set -e 2024-04-17T19:47:07.766 DEBUG:teuthology.orchestra.run.smithi044:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.admin type veth peer name brx.0 2024-04-17T19:47:07.766 DEBUG:teuthology.orchestra.run.smithi044:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-04-17T19:47:07.766 DEBUG:teuthology.orchestra.run.smithi044:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set veth0 up 2024-04-17T19:47:07.766 DEBUG:teuthology.orchestra.run.smithi044:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set lo up 2024-04-17T19:47:07.766 DEBUG:teuthology.orchestra.run.smithi044:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip route add default via 192.168.255.254 2024-04-17T19:47:07.766 DEBUG:teuthology.orchestra.run.smithi044:> ') 2024-04-17T19:47:07.813 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:07 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-17T19:47:07.922 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:07 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-17T19:47:07.928 DEBUG:teuthology.orchestra.run.smithi044:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-17T19:47:07.928 DEBUG:teuthology.orchestra.run.smithi044:> set -e 2024-04-17T19:47:07.929 DEBUG:teuthology.orchestra.run.smithi044:> sudo ip link set brx.0 up 2024-04-17T19:47:07.929 DEBUG:teuthology.orchestra.run.smithi044:> sudo ip link set dev brx.0 master ceph-brx 2024-04-17T19:47:07.929 DEBUG:teuthology.orchestra.run.smithi044:> ') 2024-04-17T19:47:07.976 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:07 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-17T19:47:08.008 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:08 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-17T19:47:08.015 INFO:tasks.cephfs.fuse_mount:Client client.admin config is {} 2024-04-17T19:47:08.015 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-17T19:47:08.015 DEBUG:teuthology.orchestra.run.smithi044:> mkdir -p -v /home/ubuntu/cephtest/mnt.admin 2024-04-17T19:47:08.024 INFO:teuthology.orchestra.run.smithi044.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.admin' 2024-04-17T19:47:08.024 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-17T19:47:08.024 DEBUG:teuthology.orchestra.run.smithi044:> chmod 0000 /home/ubuntu/cephtest/mnt.admin 2024-04-17T19:47:08.073 DEBUG:teuthology.orchestra.run.smithi044:> sudo modprobe fuse 2024-04-17T19:47:08.134 DEBUG:teuthology.orchestra.run.smithi044:> cat /proc/self/mounts | awk '{print $2}' 2024-04-17T19:47:08.188 INFO:teuthology.orchestra.run.smithi044.stdout:/sys 2024-04-17T19:47:08.188 INFO:teuthology.orchestra.run.smithi044.stdout:/proc 2024-04-17T19:47:08.188 INFO:teuthology.orchestra.run.smithi044.stdout:/dev 2024-04-17T19:47:08.188 INFO:teuthology.orchestra.run.smithi044.stdout:/dev/pts 2024-04-17T19:47:08.188 INFO:teuthology.orchestra.run.smithi044.stdout:/run 2024-04-17T19:47:08.188 INFO:teuthology.orchestra.run.smithi044.stdout:/ 2024-04-17T19:47:08.188 INFO:teuthology.orchestra.run.smithi044.stdout:/sys/kernel/security 2024-04-17T19:47:08.188 INFO:teuthology.orchestra.run.smithi044.stdout:/dev/shm 2024-04-17T19:47:08.188 INFO:teuthology.orchestra.run.smithi044.stdout:/run/lock 2024-04-17T19:47:08.188 INFO:teuthology.orchestra.run.smithi044.stdout:/sys/fs/cgroup 2024-04-17T19:47:08.188 INFO:teuthology.orchestra.run.smithi044.stdout:/sys/fs/pstore 2024-04-17T19:47:08.189 INFO:teuthology.orchestra.run.smithi044.stdout:/sys/fs/bpf 2024-04-17T19:47:08.189 INFO:teuthology.orchestra.run.smithi044.stdout:/proc/sys/fs/binfmt_misc 2024-04-17T19:47:08.189 INFO:teuthology.orchestra.run.smithi044.stdout:/dev/hugepages 2024-04-17T19:47:08.189 INFO:teuthology.orchestra.run.smithi044.stdout:/dev/mqueue 2024-04-17T19:47:08.189 INFO:teuthology.orchestra.run.smithi044.stdout:/sys/kernel/debug 2024-04-17T19:47:08.189 INFO:teuthology.orchestra.run.smithi044.stdout:/sys/kernel/tracing 2024-04-17T19:47:08.189 INFO:teuthology.orchestra.run.smithi044.stdout:/proc/fs/nfsd 2024-04-17T19:47:08.189 INFO:teuthology.orchestra.run.smithi044.stdout:/sys/fs/fuse/connections 2024-04-17T19:47:08.189 INFO:teuthology.orchestra.run.smithi044.stdout:/sys/kernel/config 2024-04-17T19:47:08.189 INFO:teuthology.orchestra.run.smithi044.stdout:/run/credentials/systemd-sysusers.service 2024-04-17T19:47:08.189 INFO:teuthology.orchestra.run.smithi044.stdout:/run/rpc_pipefs 2024-04-17T19:47:08.189 INFO:teuthology.orchestra.run.smithi044.stdout:/run/user/1000 2024-04-17T19:47:08.189 INFO:teuthology.orchestra.run.smithi044.stdout:/var/lib/ceph 2024-04-17T19:47:08.189 INFO:teuthology.orchestra.run.smithi044.stdout:/var/lib/ceph/osd/ceph-0 2024-04-17T19:47:08.190 INFO:teuthology.orchestra.run.smithi044.stdout:/var/lib/ceph/osd/ceph-1 2024-04-17T19:47:08.190 INFO:teuthology.orchestra.run.smithi044.stdout:/var/lib/ceph/osd/ceph-2 2024-04-17T19:47:08.190 INFO:teuthology.orchestra.run.smithi044.stdout:/var/lib/ceph/osd/ceph-3 2024-04-17T19:47:08.190 INFO:teuthology.orchestra.run.smithi044.stdout:/run/netns 2024-04-17T19:47:08.190 INFO:teuthology.orchestra.run.smithi044.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-04-17T19:47:08.190 INFO:teuthology.orchestra.run.smithi044.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-04-17T19:47:08.191 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-17T19:47:08.191 DEBUG:teuthology.orchestra.run.smithi044:> ls /sys/fs/fuse/connections 2024-04-17T19:47:08.246 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-04-17T19:47:08.246 DEBUG:teuthology.orchestra.run.smithi044:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.admin --id admin --client_fs=cephfs) 2024-04-17T19:47:08.293 DEBUG:teuthology.orchestra.run.smithi044:> sudo modprobe fuse 2024-04-17T19:47:08.314 DEBUG:teuthology.orchestra.run.smithi044:> cat /proc/self/mounts | awk '{print $2}' 2024-04-17T19:47:08.367 INFO:teuthology.orchestra.run.smithi044.stdout:/sys 2024-04-17T19:47:08.367 INFO:teuthology.orchestra.run.smithi044.stdout:/proc 2024-04-17T19:47:08.367 INFO:teuthology.orchestra.run.smithi044.stdout:/dev 2024-04-17T19:47:08.367 INFO:teuthology.orchestra.run.smithi044.stdout:/dev/pts 2024-04-17T19:47:08.368 INFO:teuthology.orchestra.run.smithi044.stdout:/run 2024-04-17T19:47:08.368 INFO:teuthology.orchestra.run.smithi044.stdout:/ 2024-04-17T19:47:08.368 INFO:teuthology.orchestra.run.smithi044.stdout:/sys/kernel/security 2024-04-17T19:47:08.368 INFO:teuthology.orchestra.run.smithi044.stdout:/dev/shm 2024-04-17T19:47:08.368 INFO:teuthology.orchestra.run.smithi044.stdout:/run/lock 2024-04-17T19:47:08.368 INFO:teuthology.orchestra.run.smithi044.stdout:/sys/fs/cgroup 2024-04-17T19:47:08.368 INFO:teuthology.orchestra.run.smithi044.stdout:/sys/fs/pstore 2024-04-17T19:47:08.368 INFO:teuthology.orchestra.run.smithi044.stdout:/sys/fs/bpf 2024-04-17T19:47:08.368 INFO:teuthology.orchestra.run.smithi044.stdout:/proc/sys/fs/binfmt_misc 2024-04-17T19:47:08.368 INFO:teuthology.orchestra.run.smithi044.stdout:/dev/hugepages 2024-04-17T19:47:08.368 INFO:teuthology.orchestra.run.smithi044.stdout:/dev/mqueue 2024-04-17T19:47:08.368 INFO:teuthology.orchestra.run.smithi044.stdout:/sys/kernel/debug 2024-04-17T19:47:08.368 INFO:teuthology.orchestra.run.smithi044.stdout:/sys/kernel/tracing 2024-04-17T19:47:08.369 INFO:teuthology.orchestra.run.smithi044.stdout:/proc/fs/nfsd 2024-04-17T19:47:08.369 INFO:teuthology.orchestra.run.smithi044.stdout:/sys/fs/fuse/connections 2024-04-17T19:47:08.369 INFO:teuthology.orchestra.run.smithi044.stdout:/sys/kernel/config 2024-04-17T19:47:08.369 INFO:teuthology.orchestra.run.smithi044.stdout:/run/credentials/systemd-sysusers.service 2024-04-17T19:47:08.369 INFO:teuthology.orchestra.run.smithi044.stdout:/run/rpc_pipefs 2024-04-17T19:47:08.369 INFO:teuthology.orchestra.run.smithi044.stdout:/run/user/1000 2024-04-17T19:47:08.369 INFO:teuthology.orchestra.run.smithi044.stdout:/var/lib/ceph 2024-04-17T19:47:08.369 INFO:teuthology.orchestra.run.smithi044.stdout:/var/lib/ceph/osd/ceph-0 2024-04-17T19:47:08.369 INFO:teuthology.orchestra.run.smithi044.stdout:/var/lib/ceph/osd/ceph-1 2024-04-17T19:47:08.369 INFO:teuthology.orchestra.run.smithi044.stdout:/var/lib/ceph/osd/ceph-2 2024-04-17T19:47:08.369 INFO:teuthology.orchestra.run.smithi044.stdout:/var/lib/ceph/osd/ceph-3 2024-04-17T19:47:08.369 INFO:teuthology.orchestra.run.smithi044.stdout:/run/netns 2024-04-17T19:47:08.369 INFO:teuthology.orchestra.run.smithi044.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-04-17T19:47:08.370 INFO:teuthology.orchestra.run.smithi044.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-04-17T19:47:08.370 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-17T19:47:08.371 DEBUG:teuthology.orchestra.run.smithi044:> ls /sys/fs/fuse/connections 2024-04-17T19:47:08.402 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi044.stderr:2024-04-17T19:47:08.410+0000 7fca6c44d580 -1 init, newargv = 0x559b444a1c70 newargc=15 2024-04-17T19:47:08.402 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi044.stderr:ceph-fuse[32146]: starting ceph client 2024-04-17T19:47:08.416 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi044.stderr:ceph-fuse[32146]: starting fuse 2024-04-17T19:47:09.512 DEBUG:teuthology.orchestra.run.smithi044:> sudo modprobe fuse 2024-04-17T19:47:09.537 DEBUG:teuthology.orchestra.run.smithi044:> cat /proc/self/mounts | awk '{print $2}' 2024-04-17T19:47:09.588 INFO:teuthology.orchestra.run.smithi044.stdout:/sys 2024-04-17T19:47:09.588 INFO:teuthology.orchestra.run.smithi044.stdout:/proc 2024-04-17T19:47:09.589 INFO:teuthology.orchestra.run.smithi044.stdout:/dev 2024-04-17T19:47:09.589 INFO:teuthology.orchestra.run.smithi044.stdout:/dev/pts 2024-04-17T19:47:09.589 INFO:teuthology.orchestra.run.smithi044.stdout:/run 2024-04-17T19:47:09.589 INFO:teuthology.orchestra.run.smithi044.stdout:/ 2024-04-17T19:47:09.589 INFO:teuthology.orchestra.run.smithi044.stdout:/sys/kernel/security 2024-04-17T19:47:09.589 INFO:teuthology.orchestra.run.smithi044.stdout:/dev/shm 2024-04-17T19:47:09.589 INFO:teuthology.orchestra.run.smithi044.stdout:/run/lock 2024-04-17T19:47:09.589 INFO:teuthology.orchestra.run.smithi044.stdout:/sys/fs/cgroup 2024-04-17T19:47:09.589 INFO:teuthology.orchestra.run.smithi044.stdout:/sys/fs/pstore 2024-04-17T19:47:09.590 INFO:teuthology.orchestra.run.smithi044.stdout:/sys/fs/bpf 2024-04-17T19:47:09.590 INFO:teuthology.orchestra.run.smithi044.stdout:/proc/sys/fs/binfmt_misc 2024-04-17T19:47:09.590 INFO:teuthology.orchestra.run.smithi044.stdout:/dev/hugepages 2024-04-17T19:47:09.590 INFO:teuthology.orchestra.run.smithi044.stdout:/dev/mqueue 2024-04-17T19:47:09.590 INFO:teuthology.orchestra.run.smithi044.stdout:/sys/kernel/debug 2024-04-17T19:47:09.590 INFO:teuthology.orchestra.run.smithi044.stdout:/sys/kernel/tracing 2024-04-17T19:47:09.590 INFO:teuthology.orchestra.run.smithi044.stdout:/proc/fs/nfsd 2024-04-17T19:47:09.590 INFO:teuthology.orchestra.run.smithi044.stdout:/sys/fs/fuse/connections 2024-04-17T19:47:09.591 INFO:teuthology.orchestra.run.smithi044.stdout:/sys/kernel/config 2024-04-17T19:47:09.591 INFO:teuthology.orchestra.run.smithi044.stdout:/run/credentials/systemd-sysusers.service 2024-04-17T19:47:09.591 INFO:teuthology.orchestra.run.smithi044.stdout:/run/rpc_pipefs 2024-04-17T19:47:09.591 INFO:teuthology.orchestra.run.smithi044.stdout:/run/user/1000 2024-04-17T19:47:09.591 INFO:teuthology.orchestra.run.smithi044.stdout:/var/lib/ceph 2024-04-17T19:47:09.591 INFO:teuthology.orchestra.run.smithi044.stdout:/var/lib/ceph/osd/ceph-0 2024-04-17T19:47:09.591 INFO:teuthology.orchestra.run.smithi044.stdout:/var/lib/ceph/osd/ceph-1 2024-04-17T19:47:09.591 INFO:teuthology.orchestra.run.smithi044.stdout:/var/lib/ceph/osd/ceph-2 2024-04-17T19:47:09.591 INFO:teuthology.orchestra.run.smithi044.stdout:/var/lib/ceph/osd/ceph-3 2024-04-17T19:47:09.591 INFO:teuthology.orchestra.run.smithi044.stdout:/run/netns 2024-04-17T19:47:09.592 INFO:teuthology.orchestra.run.smithi044.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-04-17T19:47:09.592 INFO:teuthology.orchestra.run.smithi044.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-04-17T19:47:09.592 INFO:teuthology.orchestra.run.smithi044.stdout:/home/ubuntu/cephtest/mnt.admin 2024-04-17T19:47:09.593 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-17T19:47:09.593 DEBUG:teuthology.orchestra.run.smithi044:> ls /sys/fs/fuse/connections 2024-04-17T19:47:09.647 INFO:teuthology.orchestra.run.smithi044.stdout:44 2024-04-17T19:47:09.647 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [44] 2024-04-17T19:47:09.647 DEBUG:teuthology.orchestra.run.smithi044:> sudo stdin-killer -- python3 -c ' 2024-04-17T19:47:09.648 DEBUG:teuthology.orchestra.run.smithi044:> import glob 2024-04-17T19:47:09.648 DEBUG:teuthology.orchestra.run.smithi044:> import re 2024-04-17T19:47:09.648 DEBUG:teuthology.orchestra.run.smithi044:> import os 2024-04-17T19:47:09.648 DEBUG:teuthology.orchestra.run.smithi044:> import subprocess 2024-04-17T19:47:09.648 DEBUG:teuthology.orchestra.run.smithi044:> 2024-04-17T19:47:09.648 DEBUG:teuthology.orchestra.run.smithi044:> def _find_admin_socket(client_name): 2024-04-17T19:47:09.648 DEBUG:teuthology.orchestra.run.smithi044:> asok_path = "/var/run/ceph/ceph-client.admin.*.asok" 2024-04-17T19:47:09.648 DEBUG:teuthology.orchestra.run.smithi044:> files = glob.glob(asok_path) 2024-04-17T19:47:09.648 DEBUG:teuthology.orchestra.run.smithi044:> mountpoint = "/home/ubuntu/cephtest/mnt.admin" 2024-04-17T19:47:09.648 DEBUG:teuthology.orchestra.run.smithi044:> 2024-04-17T19:47:09.648 DEBUG:teuthology.orchestra.run.smithi044:> # Given a non-glob path, it better be there 2024-04-17T19:47:09.648 DEBUG:teuthology.orchestra.run.smithi044:> if "*" not in asok_path: 2024-04-17T19:47:09.649 DEBUG:teuthology.orchestra.run.smithi044:> assert(len(files) == 1) 2024-04-17T19:47:09.649 DEBUG:teuthology.orchestra.run.smithi044:> return files[0] 2024-04-17T19:47:09.649 DEBUG:teuthology.orchestra.run.smithi044:> 2024-04-17T19:47:09.649 DEBUG:teuthology.orchestra.run.smithi044:> for f in files: 2024-04-17T19:47:09.649 DEBUG:teuthology.orchestra.run.smithi044:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-04-17T19:47:09.649 DEBUG:teuthology.orchestra.run.smithi044:> if os.path.exists("/proc/{0}".format(pid)): 2024-04-17T19:47:09.649 DEBUG:teuthology.orchestra.run.smithi044:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-04-17T19:47:09.649 DEBUG:teuthology.orchestra.run.smithi044:> contents = proc_f.read() 2024-04-17T19:47:09.649 DEBUG:teuthology.orchestra.run.smithi044:> if mountpoint in contents: 2024-04-17T19:47:09.649 DEBUG:teuthology.orchestra.run.smithi044:> return f 2024-04-17T19:47:09.649 DEBUG:teuthology.orchestra.run.smithi044:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-04-17T19:47:09.649 DEBUG:teuthology.orchestra.run.smithi044:> 2024-04-17T19:47:09.649 DEBUG:teuthology.orchestra.run.smithi044:> print(_find_admin_socket("client.admin")) 2024-04-17T19:47:09.650 DEBUG:teuthology.orchestra.run.smithi044:> ' 2024-04-17T19:47:09.783 INFO:teuthology.orchestra.run.smithi044.stdout:/var/run/ceph/ceph-client.admin.32146.asok 2024-04-17T19:47:09.787 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:09 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-17T19:47:09.796 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.admin.32146.asok 2024-04-17T19:47:09.796 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-17T19:47:09.796 DEBUG:teuthology.orchestra.run.smithi044:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.admin.32146.asok status 2024-04-17T19:47:09.987 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2024-04-17T19:47:09.987 INFO:teuthology.orchestra.run.smithi044.stdout: "metadata": { 2024-04-17T19:47:09.987 INFO:teuthology.orchestra.run.smithi044.stdout: "ceph_sha1": "f3a98d3f110319c567ec86bf70955c141495ccf6", 2024-04-17T19:47:09.987 INFO:teuthology.orchestra.run.smithi044.stdout: "ceph_version": "ceph version 19.0.0-3146-gf3a98d3f (f3a98d3f110319c567ec86bf70955c141495ccf6) squid (dev)", 2024-04-17T19:47:09.987 INFO:teuthology.orchestra.run.smithi044.stdout: "entity_id": "admin", 2024-04-17T19:47:09.987 INFO:teuthology.orchestra.run.smithi044.stdout: "hostname": "smithi044", 2024-04-17T19:47:09.987 INFO:teuthology.orchestra.run.smithi044.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.admin", 2024-04-17T19:47:09.988 INFO:teuthology.orchestra.run.smithi044.stdout: "pid": "32146", 2024-04-17T19:47:09.988 INFO:teuthology.orchestra.run.smithi044.stdout: "root": "/" 2024-04-17T19:47:09.988 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T19:47:09.988 INFO:teuthology.orchestra.run.smithi044.stdout: "dentry_count": 0, 2024-04-17T19:47:09.988 INFO:teuthology.orchestra.run.smithi044.stdout: "dentry_pinned_count": 0, 2024-04-17T19:47:09.988 INFO:teuthology.orchestra.run.smithi044.stdout: "id": 4449, 2024-04-17T19:47:09.988 INFO:teuthology.orchestra.run.smithi044.stdout: "inst": { 2024-04-17T19:47:09.988 INFO:teuthology.orchestra.run.smithi044.stdout: "name": { 2024-04-17T19:47:09.988 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "client", 2024-04-17T19:47:09.988 INFO:teuthology.orchestra.run.smithi044.stdout: "num": 4449 2024-04-17T19:47:09.988 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T19:47:09.989 INFO:teuthology.orchestra.run.smithi044.stdout: "addr": { 2024-04-17T19:47:09.989 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "v1", 2024-04-17T19:47:09.989 INFO:teuthology.orchestra.run.smithi044.stdout: "addr": "192.168.0.1:0", 2024-04-17T19:47:09.989 INFO:teuthology.orchestra.run.smithi044.stdout: "nonce": 4248931876 2024-04-17T19:47:09.989 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T19:47:09.989 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T19:47:09.989 INFO:teuthology.orchestra.run.smithi044.stdout: "addr": { 2024-04-17T19:47:09.989 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "v1", 2024-04-17T19:47:09.989 INFO:teuthology.orchestra.run.smithi044.stdout: "addr": "192.168.0.1:0", 2024-04-17T19:47:09.989 INFO:teuthology.orchestra.run.smithi044.stdout: "nonce": 4248931876 2024-04-17T19:47:09.989 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T19:47:09.989 INFO:teuthology.orchestra.run.smithi044.stdout: "inst_str": "client.4449 192.168.0.1:0/4248931876", 2024-04-17T19:47:09.990 INFO:teuthology.orchestra.run.smithi044.stdout: "addr_str": "192.168.0.1:0/4248931876", 2024-04-17T19:47:09.990 INFO:teuthology.orchestra.run.smithi044.stdout: "inode_count": 1, 2024-04-17T19:47:09.990 INFO:teuthology.orchestra.run.smithi044.stdout: "mds_epoch": 5, 2024-04-17T19:47:09.990 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_epoch": 25, 2024-04-17T19:47:09.990 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_epoch_barrier": 0, 2024-04-17T19:47:09.990 INFO:teuthology.orchestra.run.smithi044.stdout: "blocklisted": false, 2024-04-17T19:47:09.990 INFO:teuthology.orchestra.run.smithi044.stdout: "fs_name": "cephfs" 2024-04-17T19:47:09.990 INFO:teuthology.orchestra.run.smithi044.stdout:} 2024-04-17T19:47:10.003 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-17T19:47:10.003 DEBUG:teuthology.orchestra.run.smithi044:> stat --file-system '--printf=%T 2024-04-17T19:47:10.003 DEBUG:teuthology.orchestra.run.smithi044:> ' -- /home/ubuntu/cephtest/mnt.admin 2024-04-17T19:47:10.013 INFO:teuthology.orchestra.run.smithi044.stdout:fuseblk 2024-04-17T19:47:10.013 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.admin 2024-04-17T19:47:10.013 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-17T19:47:10.014 DEBUG:teuthology.orchestra.run.smithi044:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.admin 2024-04-17T19:47:10.079 DEBUG:teuthology.orchestra.run.smithi044:> (cd /home/ubuntu/cephtest/mnt.admin && exec stdin-killer --timeout=900 -- bash -c 'setfattr -n ceph.dir.layout.pool -v cephfs_data_ec . && getfattr -n ceph.dir.layout .') 2024-04-17T19:47:10.175 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:10 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-04-17T19:47:10.212 INFO:teuthology.orchestra.run.smithi044.stdout:# file: . 2024-04-17T19:47:10.212 INFO:teuthology.orchestra.run.smithi044.stdout:ceph.dir.layout="stripe_unit=4194304 stripe_count=1 object_size=4194304 pool=cephfs_data_ec" 2024-04-17T19:47:10.212 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-04-17T19:47:10.213 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:10 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-17T19:47:10.219 DEBUG:teuthology.orchestra.run.smithi044:> set -ex 2024-04-17T19:47:10.219 DEBUG:teuthology.orchestra.run.smithi044:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-17T19:47:10.229 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-17T19:47:10.319 INFO:tasks.ceph.mds.b.smithi062.stderr:2024-04-17T19:47:10.329+0000 7f319ee9e640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-04-17T19:47:10.422 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:10.430+0000 7fc78e200640 1 Processor -- start 2024-04-17T19:47:10.422 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:10.430+0000 7fc78e200640 1 -- start start 2024-04-17T19:47:10.424 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:10.434+0000 7fc78e200640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fc7880c66d0 0x7fc7881536a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:10.424 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:10.434+0000 7fc78e200640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fc788153be0 0x7fc788073820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:10.424 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:10.434+0000 7fc78e200640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc788153ff0 con 0x7fc788073d60 2024-04-17T19:47:10.424 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:10.434+0000 7fc78e200640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 -- 0x7fc788159ad0 con 0x7fc788153be0 2024-04-17T19:47:10.425 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:10.434+0000 7fc78e200640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7fc788159db0 con 0x7fc7880c66d0 2024-04-17T19:47:10.425 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:10.434+0000 7fc787400640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fc7880c66d0 0x7fc7881536a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:10.425 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:10.434+0000 7fc787400640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fc7880c66d0 0x7fc7881536a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3301/0 says I am v2:172.21.15.44:47512/0 (socket says 172.21.15.44:47512) 2024-04-17T19:47:10.425 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:10.434+0000 7fc787400640 1 -- 172.21.15.44:0/1107656454 learned_addr learned my addr 172.21.15.44:0/1107656454 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-04-17T19:47:10.425 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:10.434+0000 7fc77ea00640 1 --2- 172.21.15.44:0/1107656454 >> v2:172.21.15.62:3300/0 conn(0x7fc788153be0 0x7fc788073820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:10.426 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:10.434+0000 7fc787400640 1 -- 172.21.15.44:0/1107656454 >> v2:172.21.15.62:3300/0 conn(0x7fc788153be0 msgr2=0x7fc788073820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T19:47:10.426 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:10.434+0000 7fc787400640 1 --2- 172.21.15.44:0/1107656454 >> v2:172.21.15.62:3300/0 conn(0x7fc788153be0 0x7fc788073820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:10.426 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:10.434+0000 7fc787400640 1 -- 172.21.15.44:0/1107656454 >> v1:172.21.15.62:6789/0 conn(0x7fc788073d60 legacy=0x7fc7880725b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:10.426 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:10.434+0000 7fc787400640 1 -- 172.21.15.44:0/1107656454 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc78815a090 con 0x7fc7880c66d0 2024-04-17T19:47:10.428 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:10.438+0000 7fc787400640 1 --2- 172.21.15.44:0/1107656454 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fc7880c66d0 0x7fc7881536a0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fc778009870 tx=0x7fc77801c560 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5ef8324df57ddc8f server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:47:10.428 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:10.438+0000 7fc786a00640 1 -- 172.21.15.44:0/1107656454 <== mon.2 v2:172.21.15.62:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7780b2070 con 0x7fc7880c66d0 2024-04-17T19:47:10.428 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:10.438+0000 7fc786a00640 1 -- 172.21.15.44:0/1107656454 <== mon.2 v2:172.21.15.62:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc7780a9070 con 0x7fc7880c66d0 2024-04-17T19:47:10.428 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:10.438+0000 7fc786a00640 1 -- 172.21.15.44:0/1107656454 <== mon.2 v2:172.21.15.62:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7780ad880 con 0x7fc7880c66d0 2024-04-17T19:47:10.429 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:10.438+0000 7fc78e200640 1 -- 172.21.15.44:0/1107656454 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fc7880c66d0 msgr2=0x7fc7881536a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:10.430 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:10.438+0000 7fc78e200640 1 --2- 172.21.15.44:0/1107656454 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fc7880c66d0 0x7fc7881536a0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fc778009870 tx=0x7fc77801c560 comp rx=0 tx=0).stop 2024-04-17T19:47:10.430 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:10.438+0000 7fc78e200640 1 -- 172.21.15.44:0/1107656454 shutdown_connections 2024-04-17T19:47:10.430 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:10.438+0000 7fc78e200640 1 --2- 172.21.15.44:0/1107656454 >> v2:172.21.15.62:3300/0 conn(0x7fc788153be0 0x7fc788073820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:10.430 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:10.438+0000 7fc78e200640 1 --2- 172.21.15.44:0/1107656454 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fc7880c66d0 0x7fc7881536a0 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:10.430 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:10.438+0000 7fc78e200640 1 -- 172.21.15.44:0/1107656454 >> 172.21.15.44:0/1107656454 conn(0x7fc78806c380 msgr2=0x7fc788070080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:47:10.430 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:10.438+0000 7fc78e200640 1 -- 172.21.15.44:0/1107656454 shutdown_connections 2024-04-17T19:47:10.430 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:10.438+0000 7fc78e200640 1 -- 172.21.15.44:0/1107656454 wait complete. 2024-04-17T19:47:10.431 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:10.442+0000 7fc78e200640 1 Processor -- start 2024-04-17T19:47:10.431 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:10.442+0000 7fc78e200640 1 -- start start 2024-04-17T19:47:10.433 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:10.442+0000 7fc78e200640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fc788073d60 0x7fc7880cb990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:10.434 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:10.442+0000 7fc78e200640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc7880c66d0 0x7fc7881f87c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:10.434 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:10.442+0000 7fc78e200640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc788153be0 0x7fc7881f8d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:10.434 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:10.442+0000 7fc78e200640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fc7880c8890 con 0x7fc7880c66d0 2024-04-17T19:47:10.434 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:10.442+0000 7fc78e200640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7fc7880c8710 con 0x7fc788153be0 2024-04-17T19:47:10.434 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:10.442+0000 7fc78e200640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7fc788166a80 con 0x7fc788073d60 2024-04-17T19:47:10.434 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:10.442+0000 7fc77ea00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc7880c66d0 0x7fc7881f87c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:10.434 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:10.442+0000 7fc77ea00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc7880c66d0 0x7fc7881f87c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:42592/0 (socket says 172.21.15.44:42592) 2024-04-17T19:47:10.434 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:10.442+0000 7fc77ea00640 1 -- 172.21.15.44:0/2255872913 learned_addr learned my addr 172.21.15.44:0/2255872913 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-04-17T19:47:10.434 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:10.442+0000 7fc787e00640 1 --2- 172.21.15.44:0/2255872913 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc788153be0 0x7fc7881f8d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:10.435 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:10.442+0000 7fc787400640 1 --2- 172.21.15.44:0/2255872913 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fc788073d60 0x7fc7880cb990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:10.435 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:10.442+0000 7fc77ea00640 1 -- 172.21.15.44:0/2255872913 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fc788073d60 msgr2=0x7fc7880cb990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:10.435 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:10.442+0000 7fc77ea00640 1 --2- 172.21.15.44:0/2255872913 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fc788073d60 0x7fc7880cb990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:10.435 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:10.442+0000 7fc77ea00640 1 -- 172.21.15.44:0/2255872913 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc788153be0 msgr2=0x7fc7881f8d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:10.435 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:10.442+0000 7fc77ea00640 1 --2- 172.21.15.44:0/2255872913 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc788153be0 0x7fc7881f8d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:10.435 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:10.442+0000 7fc77ea00640 1 -- 172.21.15.44:0/2255872913 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc7880cbed0 con 0x7fc7880c66d0 2024-04-17T19:47:10.436 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:10.442+0000 7fc77ea00640 1 --2- 172.21.15.44:0/2255872913 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc7880c66d0 0x7fc7881f87c0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fc77000e870 tx=0x7fc77000ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:47:10.436 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:10.446+0000 7fc77fe00640 1 -- 172.21.15.44:0/2255872913 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc770017070 con 0x7fc7880c66d0 2024-04-17T19:47:10.437 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:10.446+0000 7fc77fe00640 1 -- 172.21.15.44:0/2255872913 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc77000c940 con 0x7fc7880c66d0 2024-04-17T19:47:10.437 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:10.446+0000 7fc77fe00640 1 -- 172.21.15.44:0/2255872913 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc77000ccf0 con 0x7fc7880c66d0 2024-04-17T19:47:10.437 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:10.446+0000 7fc78e200640 1 -- 172.21.15.44:0/2255872913 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc7880ccfe0 con 0x7fc7880c66d0 2024-04-17T19:47:10.437 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:10.446+0000 7fc78e200640 1 -- 172.21.15.44:0/2255872913 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc7880cd560 con 0x7fc7880c66d0 2024-04-17T19:47:10.437 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:10.446+0000 7fc78e200640 1 -- 172.21.15.44:0/2255872913 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc78804ff10 con 0x7fc7880c66d0 2024-04-17T19:47:10.437 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:10.446+0000 7fc77fe00640 1 -- 172.21.15.44:0/2255872913 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fc77001a070 con 0x7fc7880c66d0 2024-04-17T19:47:10.438 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:10.446+0000 7fc77fe00640 1 --2- 172.21.15.44:0/2255872913 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7fc7640683b0 0x7fc76406a8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:10.438 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:10.446+0000 7fc77fe00640 1 -- 172.21.15.44:0/2255872913 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fc770086fa0 con 0x7fc7880c66d0 2024-04-17T19:47:10.438 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:10.446+0000 7fc787400640 1 --2- 172.21.15.44:0/2255872913 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7fc7640683b0 0x7fc76406a8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:10.439 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:10.450+0000 7fc787400640 1 --2- 172.21.15.44:0/2255872913 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7fc7640683b0 0x7fc76406a8c0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fc7780af000 tx=0x7fc7780a7000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:47:10.442 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:10.450+0000 7fc77fe00640 1 -- 172.21.15.44:0/2255872913 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fc770056ab0 con 0x7fc7880c66d0 2024-04-17T19:47:10.609 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:10.618+0000 7fc78e200640 1 -- 172.21.15.44:0/2255872913 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fc7880c98e0 con 0x7fc7880c66d0 2024-04-17T19:47:10.610 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:10.618+0000 7fc77fe00640 1 -- 172.21.15.44:0/2255872913 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) ==== 74+0+18482 (secure 0 0 0) 0x7fc77005adb0 con 0x7fc7880c66d0 2024-04-17T19:47:10.610 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-04-17T19:47:10.611 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":25,"fsid":"703f77ca-79c6-4a66-b576-62c526cb1021","created":"2024-04-17T19:46:30.831994+0000","modified":"2024-04-17T19:47:01.141287+0000","last_up_change":"2024-04-17T19:46:41.988197+0000","last_in_change":"2024-04-17T19:46:33.407430+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-17T19:46:41.940380+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-17T19:46:54.222150+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-17T19:46:55.031694+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-17T19:46:58.707529+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"30520dc6-eea6-43d4-ab60-3ca9e92329dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6800","nonce":1018735925},{"type":"v1","addr":"172.21.15.44:6801","nonce":1018735925}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6802","nonce":1018735925},{"type":"v1","addr":"172.21.15.44:6803","nonce":1018735925}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6806","nonce":1018735925},{"type":"v1","addr":"172.21.15.44:6807","nonce":1018735925}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6804","nonce":1018735925},{"type":"v1","addr":"172.21.15.44:6805","nonce":1018735925}]},"public_addr":"172.21.15.44:6801/1018735925","cluster_addr":"172.21.15.44:6803/1018735925","heartbeat_back_addr":"172.21.15.44:6807/1018735925","heartbeat_front_addr":"172.21.15.44:6805/1018735925","state":["exists","up"]},{"osd":1,"uuid":"079bd511-b6ce-449b-8f11-17b311b12f7c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6817","nonce":1452577434},{"type":"v1","addr":"172.21.15.44:6820","nonce":1452577434}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6823","nonce":1452577434},{"type":"v1","addr":"172.21.15.44:6825","nonce":1452577434}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6830","nonce":1452577434},{"type":"v1","addr":"172.21.15.44:6831","nonce":1452577434}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6828","nonce":1452577434},{"type":"v1","addr":"172.21.15.44:6829","nonce":1452577434}]},"public_addr":"172.21.15.44:6820/1452577434","cluster_addr":"172.21.15.44:6825/1452577434","heartbeat_back_addr":"172.21.15.44:6831/1452577434","heartbeat_front_addr":"172.21.15.44:6829/1452577434","state":["exists","up"]},{"osd":2,"uuid":"34f0b9ab-b1d2-4ee9-841c-f15afbb6bec5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6816","nonce":1160071918},{"type":"v1","addr":"172.21.15.44:6818","nonce":1160071918}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6819","nonce":1160071918},{"type":"v1","addr":"172.21.15.44:6821","nonce":1160071918}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6826","nonce":1160071918},{"type":"v1","addr":"172.21.15.44:6827","nonce":1160071918}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6822","nonce":1160071918},{"type":"v1","addr":"172.21.15.44:6824","nonce":1160071918}]},"public_addr":"172.21.15.44:6818/1160071918","cluster_addr":"172.21.15.44:6821/1160071918","heartbeat_back_addr":"172.21.15.44:6827/1160071918","heartbeat_front_addr":"172.21.15.44:6824/1160071918","state":["exists","up"]},{"osd":3,"uuid":"4740032d-fe34-4b1b-bb85-f430896fc3c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6808","nonce":4236454921},{"type":"v1","addr":"172.21.15.44:6809","nonce":4236454921}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6810","nonce":4236454921},{"type":"v1","addr":"172.21.15.44:6811","nonce":4236454921}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6814","nonce":4236454921},{"type":"v1","addr":"172.21.15.44:6815","nonce":4236454921}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6812","nonce":4236454921},{"type":"v1","addr":"172.21.15.44:6813","nonce":4236454921}]},"public_addr":"172.21.15.44:6809/4236454921","cluster_addr":"172.21.15.44:6811/4236454921","heartbeat_back_addr":"172.21.15.44:6815/4236454921","heartbeat_front_addr":"172.21.15.44:6813/4236454921","state":["exists","up"]},{"osd":4,"uuid":"7dbedb00-302d-4d52-810c-e18839254da1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6800","nonce":2293251376},{"type":"v1","addr":"172.21.15.62:6801","nonce":2293251376}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6802","nonce":2293251376},{"type":"v1","addr":"172.21.15.62:6803","nonce":2293251376}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6806","nonce":2293251376},{"type":"v1","addr":"172.21.15.62:6807","nonce":2293251376}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6804","nonce":2293251376},{"type":"v1","addr":"172.21.15.62:6805","nonce":2293251376}]},"public_addr":"172.21.15.62:6801/2293251376","cluster_addr":"172.21.15.62:6803/2293251376","heartbeat_back_addr":"172.21.15.62:6807/2293251376","heartbeat_front_addr":"172.21.15.62:6805/2293251376","state":["exists","up"]},{"osd":5,"uuid":"38c1e8d9-393d-4f33-a97a-3295cf5c5b07","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6808","nonce":1551020300},{"type":"v1","addr":"172.21.15.62:6809","nonce":1551020300}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6810","nonce":1551020300},{"type":"v1","addr":"172.21.15.62:6811","nonce":1551020300}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6814","nonce":1551020300},{"type":"v1","addr":"172.21.15.62:6815","nonce":1551020300}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6812","nonce":1551020300},{"type":"v1","addr":"172.21.15.62:6813","nonce":1551020300}]},"public_addr":"172.21.15.62:6809/1551020300","cluster_addr":"172.21.15.62:6811/1551020300","heartbeat_back_addr":"172.21.15.62:6815/1551020300","heartbeat_front_addr":"172.21.15.62:6813/1551020300","state":["exists","up"]},{"osd":6,"uuid":"f6ff81c6-f14d-4477-88e3-9116cc5a2992","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6824","nonce":2602310256},{"type":"v1","addr":"172.21.15.62:6825","nonce":2602310256}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6826","nonce":2602310256},{"type":"v1","addr":"172.21.15.62:6827","nonce":2602310256}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6830","nonce":2602310256},{"type":"v1","addr":"172.21.15.62:6831","nonce":2602310256}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6828","nonce":2602310256},{"type":"v1","addr":"172.21.15.62:6829","nonce":2602310256}]},"public_addr":"172.21.15.62:6825/2602310256","cluster_addr":"172.21.15.62:6827/2602310256","heartbeat_back_addr":"172.21.15.62:6831/2602310256","heartbeat_front_addr":"172.21.15.62:6829/2602310256","state":["exists","up"]},{"osd":7,"uuid":"ce395bc3-bcb5-4b94-a523-5bb9df491eca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6816","nonce":2912738359},{"type":"v1","addr":"172.21.15.62:6817","nonce":2912738359}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6818","nonce":2912738359},{"type":"v1","addr":"172.21.15.62:6819","nonce":2912738359}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6822","nonce":2912738359},{"type":"v1","addr":"172.21.15.62:6823","nonce":2912738359}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6820","nonce":2912738359},{"type":"v1","addr":"172.21.15.62:6821","nonce":2912738359}]},"public_addr":"172.21.15.62:6817/2912738359","cluster_addr":"172.21.15.62:6819/2912738359","heartbeat_back_addr":"172.21.15.62:6823/2912738359","heartbeat_front_addr":"172.21.15.62:6821/2912738359","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T19:46:39.302883+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T19:46:39.177705+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T19:46:39.188894+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T19:46:39.313009+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T19:46:38.870508+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T19:46:38.790900+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T19:46:38.979163+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T19:46:38.992348+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-17T19:47:10.613 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:10.622+0000 7fc78e200640 1 -- 172.21.15.44:0/2255872913 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7fc7640683b0 msgr2=0x7fc76406a8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:10.613 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:10.622+0000 7fc78e200640 1 --2- 172.21.15.44:0/2255872913 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7fc7640683b0 0x7fc76406a8c0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fc7780af000 tx=0x7fc7780a7000 comp rx=0 tx=0).stop 2024-04-17T19:47:10.613 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:10.622+0000 7fc78e200640 1 -- 172.21.15.44:0/2255872913 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc7880c66d0 msgr2=0x7fc7881f87c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:10.613 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:10.622+0000 7fc78e200640 1 --2- 172.21.15.44:0/2255872913 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc7880c66d0 0x7fc7881f87c0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fc77000e870 tx=0x7fc77000ec70 comp rx=0 tx=0).stop 2024-04-17T19:47:10.613 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:10.622+0000 7fc78e200640 1 -- 172.21.15.44:0/2255872913 shutdown_connections 2024-04-17T19:47:10.613 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:10.622+0000 7fc78e200640 1 --2- 172.21.15.44:0/2255872913 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7fc7640683b0 0x7fc76406a8c0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:10.613 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:10.622+0000 7fc78e200640 1 --2- 172.21.15.44:0/2255872913 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc788153be0 0x7fc7881f8d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:10.613 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:10.622+0000 7fc78e200640 1 --2- 172.21.15.44:0/2255872913 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc7880c66d0 0x7fc7881f87c0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:10.613 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:10.622+0000 7fc78e200640 1 --2- 172.21.15.44:0/2255872913 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fc788073d60 0x7fc7880cb990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:10.613 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:10.622+0000 7fc78e200640 1 -- 172.21.15.44:0/2255872913 >> 172.21.15.44:0/2255872913 conn(0x7fc78806c380 msgr2=0x7fc7880c9e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:47:10.614 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:10.622+0000 7fc78e200640 1 -- 172.21.15.44:0/2255872913 shutdown_connections 2024-04-17T19:47:10.614 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:10.622+0000 7fc78e200640 1 -- 172.21.15.44:0/2255872913 wait complete. 2024-04-17T19:47:10.632 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-17T19:46:41.940380+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-17T19:46:54.222150+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-17T19:46:55.031694+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-04-17T19:46:58.707529+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-04-17T19:47:10.633 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-17T19:47:10.788 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:10.798+0000 7f91b3e00640 1 Processor -- start 2024-04-17T19:47:10.788 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:10.798+0000 7f91b3e00640 1 -- start start 2024-04-17T19:47:10.790 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:10.798+0000 7f91b3e00640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f91ac0c7c50 0x7f91ac0c2f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:10.790 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:10.798+0000 7f91b3e00640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f91ac070f10 con 0x7f91ac0c6c50 2024-04-17T19:47:10.790 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:10.798+0000 7f91b3e00640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f91ac0711f0 con 0x7f91ac0c8060 2024-04-17T19:47:10.790 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:10.798+0000 7f91b3e00640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 -- 0x7f91ac0c9050 con 0x7f91ac0c7c50 2024-04-17T19:47:10.790 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:10.798+0000 7f91b1e00640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f91ac0c6c50 0x7f91ac0c7060 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:51408/0 (socket says 172.21.15.44:51408) 2024-04-17T19:47:10.790 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:10.798+0000 7f91b1e00640 1 -- 172.21.15.44:0/3658206215 learned_addr learned my addr 172.21.15.44:0/3658206215 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-04-17T19:47:10.790 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:10.798+0000 7f91b1400640 1 --2- 172.21.15.44:0/3658206215 >> v2:172.21.15.62:3300/0 conn(0x7f91ac0c7c50 0x7f91ac0c2f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:10.791 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:10.802+0000 7f91abe00640 1 -- 172.21.15.44:0/3658206215 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2297182966 0 0) 0x7f91ac070f10 con 0x7f91ac0c6c50 2024-04-17T19:47:10.791 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:10.802+0000 7f91abe00640 1 -- 172.21.15.44:0/3658206215 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9194005740 con 0x7f91ac0c6c50 2024-04-17T19:47:10.791 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:10.802+0000 7f91b1400640 1 -- 172.21.15.44:0/3658206215 >> v1:172.21.15.62:6789/0 conn(0x7f91ac0c8060 legacy=0x7f91ac0c3a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:10.791 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:10.802+0000 7f91b1400640 1 -- 172.21.15.44:0/3658206215 >> v1:172.21.15.44:6789/0 conn(0x7f91ac0c6c50 legacy=0x7f91ac0c7060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:10.791 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:10.802+0000 7f91b1400640 1 -- 172.21.15.44:0/3658206215 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f91ac0714d0 con 0x7f91ac0c7c50 2024-04-17T19:47:10.794 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:10.802+0000 7f91b1400640 1 --2- 172.21.15.44:0/3658206215 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f91ac0c7c50 0x7f91ac0c2f50 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f91a00097c0 tx=0x7f91a001c410 comp rx=0 tx=0).ready entity=mon.1 client_cookie=19919b9466b4524e server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:47:10.794 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:10.802+0000 7f91abe00640 1 -- 172.21.15.44:0/3658206215 <== mon.1 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91a00b0070 con 0x7f91ac0c7c50 2024-04-17T19:47:10.794 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:10.802+0000 7f91abe00640 1 -- 172.21.15.44:0/3658206215 <== mon.1 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f91a00ab600 con 0x7f91ac0c7c50 2024-04-17T19:47:10.794 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:10.802+0000 7f91abe00640 1 -- 172.21.15.44:0/3658206215 <== mon.1 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91a00ab9b0 con 0x7f91ac0c7c50 2024-04-17T19:47:10.795 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:10.806+0000 7f91b3e00640 1 -- 172.21.15.44:0/3658206215 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f91ac0c7c50 msgr2=0x7f91ac0c2f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:10.795 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:10.806+0000 7f91b3e00640 1 --2- 172.21.15.44:0/3658206215 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f91ac0c7c50 0x7f91ac0c2f50 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f91a00097c0 tx=0x7f91a001c410 comp rx=0 tx=0).stop 2024-04-17T19:47:10.795 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:10.806+0000 7f91b3e00640 1 -- 172.21.15.44:0/3658206215 shutdown_connections 2024-04-17T19:47:10.795 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:10.806+0000 7f91b3e00640 1 --2- 172.21.15.44:0/3658206215 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f91ac0c7c50 0x7f91ac0c2f50 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:10.795 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:10.806+0000 7f91b3e00640 1 -- 172.21.15.44:0/3658206215 >> 172.21.15.44:0/3658206215 conn(0x7f91ac06ce90 msgr2=0x7f91ac06d2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:47:10.795 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:10.806+0000 7f91b3e00640 1 -- 172.21.15.44:0/3658206215 shutdown_connections 2024-04-17T19:47:10.795 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:10.806+0000 7f91b3e00640 1 -- 172.21.15.44:0/3658206215 wait complete. 2024-04-17T19:47:10.797 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:10.806+0000 7f91b3e00640 1 Processor -- start 2024-04-17T19:47:10.797 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:10.806+0000 7f91b3e00640 1 -- start start 2024-04-17T19:47:10.799 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:10.806+0000 7f91b3e00640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f91ac0c6c50 0x7f91ac1f06c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:10.799 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:10.806+0000 7f91b3e00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f91ac0c7c50 0x7f91ac1f1b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:10.799 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:10.810+0000 7f91b3e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f91ac0c8060 0x7f91ac1f3560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:10.799 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:10.810+0000 7f91b3e00640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f91ac158a10 con 0x7f91ac0c8060 2024-04-17T19:47:10.799 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:10.810+0000 7f91b3e00640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f91ac158890 con 0x7f91ac0c7c50 2024-04-17T19:47:10.799 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:10.810+0000 7f91b3e00640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7f91ac06c590 con 0x7f91ac0c6c50 2024-04-17T19:47:10.800 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:10.810+0000 7f91b1e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f91ac0c8060 0x7f91ac1f3560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:10.800 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:10.810+0000 7f91b1e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f91ac0c8060 0x7f91ac1f3560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:42600/0 (socket says 172.21.15.44:42600) 2024-04-17T19:47:10.800 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:10.810+0000 7f91b1e00640 1 -- 172.21.15.44:0/1018190785 learned_addr learned my addr 172.21.15.44:0/1018190785 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-04-17T19:47:10.800 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:10.810+0000 7f91b1400640 1 --2- 172.21.15.44:0/1018190785 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f91ac0c6c50 0x7f91ac1f06c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:10.800 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:10.810+0000 7f91b0a00640 1 --2- 172.21.15.44:0/1018190785 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f91ac0c7c50 0x7f91ac1f1b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:10.800 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:10.810+0000 7f91b1e00640 1 -- 172.21.15.44:0/1018190785 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f91ac0c6c50 msgr2=0x7f91ac1f06c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:10.800 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:10.810+0000 7f91b1e00640 1 --2- 172.21.15.44:0/1018190785 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f91ac0c6c50 0x7f91ac1f06c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:10.800 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:10.810+0000 7f91b1e00640 1 -- 172.21.15.44:0/1018190785 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f91ac0c7c50 msgr2=0x7f91ac1f1b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:10.800 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:10.810+0000 7f91b1e00640 1 --2- 172.21.15.44:0/1018190785 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f91ac0c7c50 0x7f91ac1f1b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:10.800 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:10.810+0000 7f91b1e00640 1 -- 172.21.15.44:0/1018190785 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f91ac1f2200 con 0x7f91ac0c8060 2024-04-17T19:47:10.800 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:10.810+0000 7f91b1e00640 1 --2- 172.21.15.44:0/1018190785 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f91ac0c8060 0x7f91ac1f3560 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f91a400caa0 tx=0x7f91a400cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:47:10.801 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:10.810+0000 7f91a9600640 1 -- 172.21.15.44:0/1018190785 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91a4017070 con 0x7f91ac0c8060 2024-04-17T19:47:10.801 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:10.810+0000 7f91a9600640 1 -- 172.21.15.44:0/1018190785 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f91a400ac00 con 0x7f91ac0c8060 2024-04-17T19:47:10.801 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:10.810+0000 7f91a9600640 1 -- 172.21.15.44:0/1018190785 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91a4012400 con 0x7f91ac0c8060 2024-04-17T19:47:10.801 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:10.810+0000 7f91b3e00640 1 -- 172.21.15.44:0/1018190785 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f91ac1f24c0 con 0x7f91ac0c8060 2024-04-17T19:47:10.801 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:10.810+0000 7f91b3e00640 1 -- 172.21.15.44:0/1018190785 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f91ac1f2a80 con 0x7f91ac0c8060 2024-04-17T19:47:10.802 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:10.810+0000 7f91b3e00640 1 -- 172.21.15.44:0/1018190785 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f91ac04ff10 con 0x7f91ac0c8060 2024-04-17T19:47:10.802 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:10.810+0000 7f91a9600640 1 -- 172.21.15.44:0/1018190785 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f91a401a070 con 0x7f91ac0c8060 2024-04-17T19:47:10.803 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:10.814+0000 7f91a9600640 1 --2- 172.21.15.44:0/1018190785 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f918c068380 0x7f918c06a890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:10.803 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:10.814+0000 7f91a9600640 1 -- 172.21.15.44:0/1018190785 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f91a4086ab0 con 0x7f91ac0c8060 2024-04-17T19:47:10.804 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:10.814+0000 7f91b1400640 1 --2- 172.21.15.44:0/1018190785 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f918c068380 0x7f918c06a890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:10.805 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:10.814+0000 7f91b1400640 1 --2- 172.21.15.44:0/1018190785 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f918c068380 0x7f918c06a890 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f91a00ad000 tx=0x7f91a0008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:47:10.808 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:10.818+0000 7f91a9600640 1 -- 172.21.15.44:0/1018190785 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f91a40565b0 con 0x7f91ac0c8060 2024-04-17T19:47:10.974 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:10.982+0000 7f91b3e00640 1 -- 172.21.15.44:0/1018190785 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f91ac0c9200 con 0x7f91ac0c8060 2024-04-17T19:47:10.974 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:10.982+0000 7f91a9600640 1 -- 172.21.15.44:0/1018190785 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v25) ==== 93+0+10 (secure 0 0 0) 0x7f91a405a8b0 con 0x7f91ac0c8060 2024-04-17T19:47:10.974 INFO:teuthology.orchestra.run.smithi044.stdout:pg_num: 1 2024-04-17T19:47:10.976 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:10.986+0000 7f91b3e00640 1 -- 172.21.15.44:0/1018190785 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f918c068380 msgr2=0x7f918c06a890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:10.976 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:10.986+0000 7f91b3e00640 1 --2- 172.21.15.44:0/1018190785 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f918c068380 0x7f918c06a890 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f91a00ad000 tx=0x7f91a0008040 comp rx=0 tx=0).stop 2024-04-17T19:47:10.976 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:10.986+0000 7f91b3e00640 1 -- 172.21.15.44:0/1018190785 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f91ac0c8060 msgr2=0x7f91ac1f3560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:10.977 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:10.986+0000 7f91b3e00640 1 --2- 172.21.15.44:0/1018190785 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f91ac0c8060 0x7f91ac1f3560 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f91a400caa0 tx=0x7f91a400cf60 comp rx=0 tx=0).stop 2024-04-17T19:47:10.977 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:10.986+0000 7f91b3e00640 1 -- 172.21.15.44:0/1018190785 shutdown_connections 2024-04-17T19:47:10.977 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:10.986+0000 7f91b3e00640 1 --2- 172.21.15.44:0/1018190785 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f918c068380 0x7f918c06a890 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:10.977 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:10.986+0000 7f91b3e00640 1 --2- 172.21.15.44:0/1018190785 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f91ac0c8060 0x7f91ac1f3560 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:10.977 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:10.986+0000 7f91b3e00640 1 --2- 172.21.15.44:0/1018190785 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f91ac0c7c50 0x7f91ac1f1b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:10.977 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:10.986+0000 7f91b3e00640 1 --2- 172.21.15.44:0/1018190785 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f91ac0c6c50 0x7f91ac1f06c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:10.977 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:10.986+0000 7f91b3e00640 1 -- 172.21.15.44:0/1018190785 >> 172.21.15.44:0/1018190785 conn(0x7f91ac06ce90 msgr2=0x7f91ac157760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:47:10.977 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:10.986+0000 7f91b3e00640 1 -- 172.21.15.44:0/1018190785 shutdown_connections 2024-04-17T19:47:10.977 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:10.986+0000 7f91b3e00640 1 -- 172.21.15.44:0/1018190785 wait complete. 2024-04-17T19:47:10.996 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-17T19:47:11.150 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:11.158+0000 7fa2a8200640 1 Processor -- start 2024-04-17T19:47:11.150 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:11.158+0000 7fa2a8200640 1 -- start start 2024-04-17T19:47:11.154 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:11.162+0000 7fa2a8200640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fa2a0155d00 0x7fa2a00cf0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:11.155 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:11.162+0000 7fa2a8200640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa2a00c5f80 con 0x7fa2a015b980 2024-04-17T19:47:11.155 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:11.162+0000 7fa2a8200640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa2a00c56e0 con 0x7fa2a00cf5e0 2024-04-17T19:47:11.155 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:11.162+0000 7fa2a8200640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7fa2a00cf9f0 con 0x7fa2a0155d00 2024-04-17T19:47:11.155 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:11.162+0000 7fa2a5800640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7fa2a015b980 0x7fa2a015f810 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:51420/0 (socket says 172.21.15.44:51420) 2024-04-17T19:47:11.155 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:11.162+0000 7fa2a5800640 1 -- 172.21.15.44:0/2567009164 learned_addr learned my addr 172.21.15.44:0/2567009164 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-04-17T19:47:11.155 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:11.162+0000 7fa2a4e00640 1 --2- 172.21.15.44:0/2567009164 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fa2a0155d00 0x7fa2a00cf0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:11.155 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:11.162+0000 7fa29fe00640 1 -- 172.21.15.44:0/2567009164 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1227586278 0 0) 0x7fa2a00c5f80 con 0x7fa2a015b980 2024-04-17T19:47:11.155 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:11.162+0000 7fa29fe00640 1 -- 172.21.15.44:0/2567009164 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa288003530 con 0x7fa2a015b980 2024-04-17T19:47:11.155 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:11.162+0000 7fa29fe00640 1 -- 172.21.15.44:0/2567009164 <== mon.1 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2673779602 0 0) 0x7fa2a00c56e0 con 0x7fa2a00cf5e0 2024-04-17T19:47:11.156 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:11.162+0000 7fa29fe00640 1 -- 172.21.15.44:0/2567009164 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa2a00c5f80 con 0x7fa2a00cf5e0 2024-04-17T19:47:11.156 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:11.162+0000 7fa29fe00640 1 -- 172.21.15.44:0/2567009164 <== mon.0 v1:172.21.15.44:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3348327686 0 0) 0x7fa288003530 con 0x7fa2a015b980 2024-04-17T19:47:11.156 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:11.162+0000 7fa29fe00640 1 -- 172.21.15.44:0/2567009164 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fa2a0155d00 msgr2=0x7fa2a00cf0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T19:47:11.156 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:11.162+0000 7fa29fe00640 1 --2- 172.21.15.44:0/2567009164 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fa2a0155d00 0x7fa2a00cf0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:11.156 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:11.162+0000 7fa29fe00640 1 -- 172.21.15.44:0/2567009164 >> v1:172.21.15.62:6789/0 conn(0x7fa2a00cf5e0 legacy=0x7fa2a006d450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:11.156 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:11.162+0000 7fa29fe00640 1 -- 172.21.15.44:0/2567009164 --> v1:172.21.15.44:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa2a00c59c0 con 0x7fa2a015b980 2024-04-17T19:47:11.156 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:11.162+0000 7fa29fe00640 1 -- 172.21.15.44:0/2567009164 <== mon.0 v1:172.21.15.44:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1863569991 0 0) 0x7fa294001680 con 0x7fa2a015b980 2024-04-17T19:47:11.156 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:11.162+0000 7fa29fe00640 1 -- 172.21.15.44:0/2567009164 >> v1:172.21.15.44:6789/0 conn(0x7fa2a015b980 legacy=0x7fa2a015f810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:11.156 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:11.162+0000 7fa29fe00640 1 --2- 172.21.15.44:0/2567009164 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa288003b80 0x7fa288003fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:11.156 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:11.162+0000 7fa29fe00640 1 --2- 172.21.15.44:0/2567009164 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fa2a0155d00 0x7fa288004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:11.157 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:11.162+0000 7fa29fe00640 1 --2- 172.21.15.44:0/2567009164 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa288004d50 0x7fa2880051a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:11.157 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:11.162+0000 7fa29fe00640 1 -- 172.21.15.44:0/2567009164 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fa28800bb60 con 0x7fa288003b80 2024-04-17T19:47:11.157 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:11.162+0000 7fa29fe00640 1 -- 172.21.15.44:0/2567009164 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7fa28800bce0 con 0x7fa288004d50 2024-04-17T19:47:11.157 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:11.162+0000 7fa29fe00640 1 -- 172.21.15.44:0/2567009164 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7fa28800beb0 con 0x7fa2a0155d00 2024-04-17T19:47:11.157 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:11.162+0000 7fa2a5800640 1 --2- 172.21.15.44:0/2567009164 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa288003b80 0x7fa288003fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:11.157 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:11.162+0000 7fa2a4e00640 1 --2- 172.21.15.44:0/2567009164 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fa2a0155d00 0x7fa288004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:11.157 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:11.162+0000 7fa2a6200640 1 --2- 172.21.15.44:0/2567009164 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa288004d50 0x7fa2880051a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:11.157 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:11.162+0000 7fa2a5800640 1 -- 172.21.15.44:0/2567009164 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fa2a0155d00 msgr2=0x7fa288004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T19:47:11.157 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:11.162+0000 7fa2a5800640 1 --2- 172.21.15.44:0/2567009164 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fa2a0155d00 0x7fa288004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:11.157 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:11.162+0000 7fa2a5800640 1 -- 172.21.15.44:0/2567009164 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa288004d50 msgr2=0x7fa2880051a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T19:47:11.158 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:11.162+0000 7fa2a5800640 1 --2- 172.21.15.44:0/2567009164 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa288004d50 0x7fa2880051a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:11.158 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:11.162+0000 7fa2a5800640 1 -- 172.21.15.44:0/2567009164 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa288003530 con 0x7fa288003b80 2024-04-17T19:47:11.159 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:11.166+0000 7fa2a5800640 1 --2- 172.21.15.44:0/2567009164 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa288003b80 0x7fa288003fd0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fa294007fd0 tx=0x7fa29401cb40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7bde9f1139c1b6dd server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:47:11.159 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:11.166+0000 7fa29fe00640 1 -- 172.21.15.44:0/2567009164 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa294007bf0 con 0x7fa288003b80 2024-04-17T19:47:11.159 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:11.166+0000 7fa29fe00640 1 -- 172.21.15.44:0/2567009164 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa2940a9020 con 0x7fa288003b80 2024-04-17T19:47:11.159 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:11.166+0000 7fa29fe00640 1 -- 172.21.15.44:0/2567009164 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa294005b00 con 0x7fa288003b80 2024-04-17T19:47:11.160 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:11.166+0000 7fa2a8200640 1 -- 172.21.15.44:0/2567009164 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa288003b80 msgr2=0x7fa288003fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:11.160 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:11.166+0000 7fa2a8200640 1 --2- 172.21.15.44:0/2567009164 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa288003b80 0x7fa288003fd0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fa294007fd0 tx=0x7fa29401cb40 comp rx=0 tx=0).stop 2024-04-17T19:47:11.160 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:11.166+0000 7fa2a6200640 1 -- 172.21.15.44:0/2567009164 reap_dead start 2024-04-17T19:47:11.160 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:11.166+0000 7fa2a8200640 1 -- 172.21.15.44:0/2567009164 shutdown_connections 2024-04-17T19:47:11.160 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:11.166+0000 7fa2a8200640 1 -- 172.21.15.44:0/2567009164 >> 172.21.15.44:0/2567009164 conn(0x7fa2a0067eb0 msgr2=0x7fa2a00682c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:47:11.160 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:11.166+0000 7fa2a8200640 1 -- 172.21.15.44:0/2567009164 shutdown_connections 2024-04-17T19:47:11.160 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:11.166+0000 7fa2a8200640 1 -- 172.21.15.44:0/2567009164 wait complete. 2024-04-17T19:47:11.161 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:11.170+0000 7fa2a8200640 1 Processor -- start 2024-04-17T19:47:11.161 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:11.170+0000 7fa2a8200640 1 -- start start 2024-04-17T19:47:11.163 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:11.170+0000 7fa2a8200640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fa288003b80 0x7fa2a00cdd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:11.163 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:11.170+0000 7fa2a8200640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa2a01e79d0 0x7fa2a0150f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:11.163 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:11.170+0000 7fa2a8200640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa2a0149520 0x7fa2a0149930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:11.163 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:11.170+0000 7fa2a8200640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fa2a006db60 con 0x7fa2a0149520 2024-04-17T19:47:11.163 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:11.170+0000 7fa2a8200640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7fa2a015f010 con 0x7fa2a01e79d0 2024-04-17T19:47:11.164 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:11.170+0000 7fa2a8200640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7fa2a006dce0 con 0x7fa288003b80 2024-04-17T19:47:11.164 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:11.170+0000 7fa2a6200640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa2a0149520 0x7fa2a0149930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:11.164 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:11.170+0000 7fa2a6200640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa2a0149520 0x7fa2a0149930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:42618/0 (socket says 172.21.15.44:42618) 2024-04-17T19:47:11.164 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:11.170+0000 7fa2a6200640 1 -- 172.21.15.44:0/1950325241 learned_addr learned my addr 172.21.15.44:0/1950325241 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-04-17T19:47:11.164 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:11.170+0000 7fa2a5800640 1 --2- 172.21.15.44:0/1950325241 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fa288003b80 0x7fa2a00cdd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:11.164 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:11.170+0000 7fa2a4e00640 1 --2- 172.21.15.44:0/1950325241 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa2a01e79d0 0x7fa2a0150f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:11.164 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:11.174+0000 7fa2a6200640 1 -- 172.21.15.44:0/1950325241 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fa288003b80 msgr2=0x7fa2a00cdd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:11.164 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:11.174+0000 7fa2a6200640 1 --2- 172.21.15.44:0/1950325241 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fa288003b80 0x7fa2a00cdd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:11.164 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:11.174+0000 7fa2a6200640 1 -- 172.21.15.44:0/1950325241 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa2a01e79d0 msgr2=0x7fa2a0150f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:11.164 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:11.174+0000 7fa2a6200640 1 --2- 172.21.15.44:0/1950325241 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa2a01e79d0 0x7fa2a0150f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:11.164 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:11.174+0000 7fa2a6200640 1 -- 172.21.15.44:0/1950325241 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa2a01f4eb0 con 0x7fa2a0149520 2024-04-17T19:47:11.165 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:11.174+0000 7fa2a4e00640 1 --2- 172.21.15.44:0/1950325241 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa2a01e79d0 0x7fa2a0150f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-17T19:47:11.165 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:11.174+0000 7fa2a6200640 1 --2- 172.21.15.44:0/1950325241 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa2a0149520 0x7fa2a0149930 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fa2a006fec0 tx=0x7fa298011f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:47:11.165 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:11.174+0000 7fa29d600640 1 -- 172.21.15.44:0/1950325241 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa298010040 con 0x7fa2a0149520 2024-04-17T19:47:11.165 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:11.174+0000 7fa29d600640 1 -- 172.21.15.44:0/1950325241 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa29801a070 con 0x7fa2a0149520 2024-04-17T19:47:11.165 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:11.174+0000 7fa2a8200640 1 -- 172.21.15.44:0/1950325241 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa2a00cd230 con 0x7fa2a0149520 2024-04-17T19:47:11.165 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:11.174+0000 7fa29d600640 1 -- 172.21.15.44:0/1950325241 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa298015410 con 0x7fa2a0149520 2024-04-17T19:47:11.165 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:11.174+0000 7fa2a8200640 1 -- 172.21.15.44:0/1950325241 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa2a01558d0 con 0x7fa2a0149520 2024-04-17T19:47:11.166 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:11.174+0000 7fa2a8200640 1 -- 172.21.15.44:0/1950325241 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa2a01e6800 con 0x7fa2a0149520 2024-04-17T19:47:11.166 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:11.174+0000 7fa29d600640 1 -- 172.21.15.44:0/1950325241 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fa2980155b0 con 0x7fa2a0149520 2024-04-17T19:47:11.166 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:11.174+0000 7fa29d600640 1 --2- 172.21.15.44:0/1950325241 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7fa2800683b0 0x7fa28006a8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:11.166 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:11.174+0000 7fa29d600640 1 -- 172.21.15.44:0/1950325241 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fa298089fe0 con 0x7fa2a0149520 2024-04-17T19:47:11.167 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:11.178+0000 7fa2a5800640 1 --2- 172.21.15.44:0/1950325241 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7fa2800683b0 0x7fa28006a8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:11.167 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:11.178+0000 7fa2a5800640 1 --2- 172.21.15.44:0/1950325241 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7fa2800683b0 0x7fa28006a8c0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fa2940aa000 tx=0x7fa2940b0040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:47:11.170 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:11.182+0000 7fa29d600640 1 -- 172.21.15.44:0/1950325241 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fa29805a200 con 0x7fa2a0149520 2024-04-17T19:47:11.333 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:11.342+0000 7fa2a8200640 1 -- 172.21.15.44:0/1950325241 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7fa2a004ff10 con 0x7fa2a0149520 2024-04-17T19:47:11.334 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:11.342+0000 7fa29d600640 1 -- 172.21.15.44:0/1950325241 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v25) ==== 104+0+11 (secure 0 0 0) 0x7fa298059b00 con 0x7fa2a0149520 2024-04-17T19:47:11.334 INFO:teuthology.orchestra.run.smithi044.stdout:pg_num: 32 2024-04-17T19:47:11.336 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:11.346+0000 7fa2a8200640 1 -- 172.21.15.44:0/1950325241 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7fa2800683b0 msgr2=0x7fa28006a8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:11.337 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:11.346+0000 7fa2a8200640 1 --2- 172.21.15.44:0/1950325241 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7fa2800683b0 0x7fa28006a8c0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fa2940aa000 tx=0x7fa2940b0040 comp rx=0 tx=0).stop 2024-04-17T19:47:11.337 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:11.346+0000 7fa2a8200640 1 -- 172.21.15.44:0/1950325241 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa2a0149520 msgr2=0x7fa2a0149930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:11.337 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:11.346+0000 7fa2a8200640 1 --2- 172.21.15.44:0/1950325241 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa2a0149520 0x7fa2a0149930 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fa2a006fec0 tx=0x7fa298011f90 comp rx=0 tx=0).stop 2024-04-17T19:47:11.337 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:11.346+0000 7fa2a8200640 1 -- 172.21.15.44:0/1950325241 shutdown_connections 2024-04-17T19:47:11.337 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:11.346+0000 7fa2a8200640 1 --2- 172.21.15.44:0/1950325241 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7fa2800683b0 0x7fa28006a8c0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:11.337 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:11.346+0000 7fa2a8200640 1 --2- 172.21.15.44:0/1950325241 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa2a0149520 0x7fa2a0149930 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:11.337 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:11.346+0000 7fa2a8200640 1 --2- 172.21.15.44:0/1950325241 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa2a01e79d0 0x7fa2a0150f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:11.337 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:11.346+0000 7fa2a8200640 1 --2- 172.21.15.44:0/1950325241 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fa288003b80 0x7fa2a00cdd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:11.337 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:11.346+0000 7fa2a8200640 1 -- 172.21.15.44:0/1950325241 >> 172.21.15.44:0/1950325241 conn(0x7fa2a0067eb0 msgr2=0x7fa2a015bf20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:47:11.337 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:11.346+0000 7fa2a8200640 1 -- 172.21.15.44:0/1950325241 shutdown_connections 2024-04-17T19:47:11.337 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:11.346+0000 7fa2a8200640 1 -- 172.21.15.44:0/1950325241 wait complete. 2024-04-17T19:47:11.356 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-17T19:47:11.510 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:11.518+0000 7effcde00640 1 Processor -- start 2024-04-17T19:47:11.510 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:11.522+0000 7effcde00640 1 -- start start 2024-04-17T19:47:11.512 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:11.522+0000 7effcde00640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7effc815fc20 0x7effc806d450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:11.512 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:11.522+0000 7effcde00640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7effc806d990 0x7effc8166300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:11.512 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:11.522+0000 7effcde00640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7effc80c5650 con 0x7effc815f810 2024-04-17T19:47:11.512 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:11.522+0000 7effcde00640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 -- 0x7effc815f380 con 0x7effc815fc20 2024-04-17T19:47:11.512 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:11.522+0000 7effcde00640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7effc80c5930 con 0x7effc806d990 2024-04-17T19:47:11.513 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:11.522+0000 7effc7400640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7effc806d990 0x7effc8166300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:11.513 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:11.522+0000 7effc7400640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7effc806d990 0x7effc8166300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3301/0 says I am v2:172.21.15.44:47562/0 (socket says 172.21.15.44:47562) 2024-04-17T19:47:11.513 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:11.522+0000 7effc7400640 1 -- 172.21.15.44:0/1234931706 learned_addr learned my addr 172.21.15.44:0/1234931706 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-04-17T19:47:11.513 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:11.522+0000 7effc6000640 1 --2- 172.21.15.44:0/1234931706 >> v2:172.21.15.62:3300/0 conn(0x7effc815fc20 0x7effc806d450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:11.513 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:11.522+0000 7effc7400640 1 -- 172.21.15.44:0/1234931706 >> v2:172.21.15.62:3300/0 conn(0x7effc815fc20 msgr2=0x7effc806d450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T19:47:11.513 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:11.522+0000 7effc7400640 1 --2- 172.21.15.44:0/1234931706 >> v2:172.21.15.62:3300/0 conn(0x7effc815fc20 0x7effc806d450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:11.513 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:11.522+0000 7effc7400640 1 -- 172.21.15.44:0/1234931706 >> v1:172.21.15.62:6789/0 conn(0x7effc815f810 legacy=0x7effc80cf000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:11.514 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:11.522+0000 7effc7400640 1 -- 172.21.15.44:0/1234931706 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7effc80c5c10 con 0x7effc806d990 2024-04-17T19:47:11.516 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:11.526+0000 7effc7400640 1 --2- 172.21.15.44:0/1234931706 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7effc806d990 0x7effc8166300 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7effc0009e50 tx=0x7effc001f210 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3f186364b7ea2e37 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:47:11.517 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:11.526+0000 7effc5600640 1 -- 172.21.15.44:0/1234931706 <== mon.2 v2:172.21.15.62:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7effc00b4070 con 0x7effc806d990 2024-04-17T19:47:11.517 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:11.526+0000 7effc5600640 1 -- 172.21.15.44:0/1234931706 <== mon.2 v2:172.21.15.62:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7effc00af400 con 0x7effc806d990 2024-04-17T19:47:11.517 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:11.526+0000 7effc5600640 1 -- 172.21.15.44:0/1234931706 <== mon.2 v2:172.21.15.62:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7effc00af7d0 con 0x7effc806d990 2024-04-17T19:47:11.517 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:11.526+0000 7effcde00640 1 -- 172.21.15.44:0/1234931706 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7effc806d990 msgr2=0x7effc8166300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:11.518 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:11.526+0000 7effcde00640 1 --2- 172.21.15.44:0/1234931706 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7effc806d990 0x7effc8166300 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7effc0009e50 tx=0x7effc001f210 comp rx=0 tx=0).stop 2024-04-17T19:47:11.518 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:11.526+0000 7effcde00640 1 -- 172.21.15.44:0/1234931706 shutdown_connections 2024-04-17T19:47:11.518 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:11.526+0000 7effcde00640 1 --2- 172.21.15.44:0/1234931706 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7effc806d990 0x7effc8166300 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:11.518 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:11.526+0000 7effcde00640 1 --2- 172.21.15.44:0/1234931706 >> v2:172.21.15.62:3300/0 conn(0x7effc815fc20 0x7effc806d450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:11.518 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:11.526+0000 7effcde00640 1 -- 172.21.15.44:0/1234931706 >> 172.21.15.44:0/1234931706 conn(0x7effc8067eb0 msgr2=0x7effc80682c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:47:11.518 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:11.526+0000 7effcde00640 1 -- 172.21.15.44:0/1234931706 shutdown_connections 2024-04-17T19:47:11.518 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:11.526+0000 7effcde00640 1 -- 172.21.15.44:0/1234931706 wait complete. 2024-04-17T19:47:11.520 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:11.530+0000 7effcde00640 1 Processor -- start 2024-04-17T19:47:11.520 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:11.530+0000 7effcde00640 1 -- start start 2024-04-17T19:47:11.522 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:11.530+0000 7effcde00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7effc806d990 0x7effc81f2ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:11.522 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:11.530+0000 7effcde00640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7effc815f810 0x7effc81f6160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:11.522 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:11.530+0000 7effcde00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7effc815fc20 0x7effc815b310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:11.522 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:11.530+0000 7effcde00640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7effc80c5ef0 con 0x7effc815fc20 2024-04-17T19:47:11.522 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:11.530+0000 7effcde00640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7effc806dda0 con 0x7effc806d990 2024-04-17T19:47:11.522 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:11.530+0000 7effcde00640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7effc80cf710 con 0x7effc815f810 2024-04-17T19:47:11.522 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:11.530+0000 7effc7400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7effc815fc20 0x7effc815b310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:11.522 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:11.530+0000 7effc7400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7effc815fc20 0x7effc815b310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:42626/0 (socket says 172.21.15.44:42626) 2024-04-17T19:47:11.522 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:11.530+0000 7effc7400640 1 -- 172.21.15.44:0/2768822629 learned_addr learned my addr 172.21.15.44:0/2768822629 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-04-17T19:47:11.523 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:11.530+0000 7effc6000640 1 --2- 172.21.15.44:0/2768822629 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7effc815f810 0x7effc81f6160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:11.523 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:11.530+0000 7effc6a00640 1 --2- 172.21.15.44:0/2768822629 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7effc806d990 0x7effc81f2ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:11.523 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:11.530+0000 7effc7400640 1 -- 172.21.15.44:0/2768822629 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7effc815f810 msgr2=0x7effc81f6160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:11.523 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:11.530+0000 7effc7400640 1 --2- 172.21.15.44:0/2768822629 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7effc815f810 0x7effc81f6160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:11.523 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:11.530+0000 7effc7400640 1 -- 172.21.15.44:0/2768822629 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7effc806d990 msgr2=0x7effc81f2ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:11.523 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:11.530+0000 7effc7400640 1 --2- 172.21.15.44:0/2768822629 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7effc806d990 0x7effc81f2ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:11.523 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:11.530+0000 7effc7400640 1 -- 172.21.15.44:0/2768822629 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7effc81e7450 con 0x7effc815fc20 2024-04-17T19:47:11.524 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:11.534+0000 7effc7400640 1 --2- 172.21.15.44:0/2768822629 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7effc815fc20 0x7effc815b310 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7effc00b2040 tx=0x7effc001bfb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:47:11.524 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:11.534+0000 7effbf400640 1 -- 172.21.15.44:0/2768822629 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7effc00b4040 con 0x7effc815fc20 2024-04-17T19:47:11.524 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:11.534+0000 7effbf400640 1 -- 172.21.15.44:0/2768822629 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7effc00090d0 con 0x7effc815fc20 2024-04-17T19:47:11.524 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:11.534+0000 7effbf400640 1 -- 172.21.15.44:0/2768822629 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7effc0009510 con 0x7effc815fc20 2024-04-17T19:47:11.524 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:11.534+0000 7effcde00640 1 -- 172.21.15.44:0/2768822629 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7effc81f21e0 con 0x7effc815fc20 2024-04-17T19:47:11.524 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:11.534+0000 7effcde00640 1 -- 172.21.15.44:0/2768822629 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7effc81e79f0 con 0x7effc815fc20 2024-04-17T19:47:11.524 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:11.534+0000 7effcde00640 1 -- 172.21.15.44:0/2768822629 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7effc804ff10 con 0x7effc815fc20 2024-04-17T19:47:11.525 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:11.534+0000 7effbf400640 1 -- 172.21.15.44:0/2768822629 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7effc00a8d10 con 0x7effc815fc20 2024-04-17T19:47:11.525 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:11.534+0000 7effbf400640 1 --2- 172.21.15.44:0/2768822629 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7effa80683b0 0x7effa806a8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:11.525 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:11.534+0000 7effbf400640 1 -- 172.21.15.44:0/2768822629 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7effc0124440 con 0x7effc815fc20 2024-04-17T19:47:11.526 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:11.534+0000 7effc6a00640 1 --2- 172.21.15.44:0/2768822629 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7effa80683b0 0x7effa806a8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:11.527 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:11.538+0000 7effc6a00640 1 --2- 172.21.15.44:0/2768822629 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7effa80683b0 0x7effa806a8c0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7effb8000f70 tx=0x7effb8009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:47:11.529 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:11.538+0000 7effbf400640 1 -- 172.21.15.44:0/2768822629 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7effc0018d70 con 0x7effc815fc20 2024-04-17T19:47:11.698 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:11.706+0000 7effcde00640 1 -- 172.21.15.44:0/2768822629 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7effc80cead0 con 0x7effc815fc20 2024-04-17T19:47:11.698 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:11.710+0000 7effbf400640 1 -- 172.21.15.44:0/2768822629 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v25) ==== 100+0+11 (secure 0 0 0) 0x7effc00f4770 con 0x7effc815fc20 2024-04-17T19:47:11.698 INFO:teuthology.orchestra.run.smithi044.stdout:pg_num: 64 2024-04-17T19:47:11.701 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:11.710+0000 7effcde00640 1 -- 172.21.15.44:0/2768822629 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7effa80683b0 msgr2=0x7effa806a8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:11.701 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:11.710+0000 7effcde00640 1 --2- 172.21.15.44:0/2768822629 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7effa80683b0 0x7effa806a8c0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7effb8000f70 tx=0x7effb8009040 comp rx=0 tx=0).stop 2024-04-17T19:47:11.701 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:11.710+0000 7effcde00640 1 -- 172.21.15.44:0/2768822629 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7effc815fc20 msgr2=0x7effc815b310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:11.701 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:11.710+0000 7effcde00640 1 --2- 172.21.15.44:0/2768822629 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7effc815fc20 0x7effc815b310 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7effc00b2040 tx=0x7effc001bfb0 comp rx=0 tx=0).stop 2024-04-17T19:47:11.701 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:11.710+0000 7effcde00640 1 -- 172.21.15.44:0/2768822629 shutdown_connections 2024-04-17T19:47:11.701 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:11.710+0000 7effcde00640 1 --2- 172.21.15.44:0/2768822629 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7effa80683b0 0x7effa806a8c0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:11.701 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:11.710+0000 7effcde00640 1 --2- 172.21.15.44:0/2768822629 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7effc815f810 0x7effc81f6160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:11.701 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:11.710+0000 7effcde00640 1 --2- 172.21.15.44:0/2768822629 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7effc815fc20 0x7effc815b310 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:11.701 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:11.710+0000 7effcde00640 1 --2- 172.21.15.44:0/2768822629 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7effc806d990 0x7effc81f2ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:11.701 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:11.710+0000 7effcde00640 1 -- 172.21.15.44:0/2768822629 >> 172.21.15.44:0/2768822629 conn(0x7effc8067eb0 msgr2=0x7effc8152bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:47:11.701 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:11.710+0000 7effcde00640 1 -- 172.21.15.44:0/2768822629 shutdown_connections 2024-04-17T19:47:11.701 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:11.710+0000 7effcde00640 1 -- 172.21.15.44:0/2768822629 wait complete. 2024-04-17T19:47:11.720 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-04-17T19:47:11.875 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:11.886+0000 7f889da00640 1 Processor -- start 2024-04-17T19:47:11.875 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:11.886+0000 7f889da00640 1 -- start start 2024-04-17T19:47:11.877 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:11.886+0000 7f889da00640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f889815d940 0x7f88981537e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:11.877 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:11.886+0000 7f889da00640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f889815a230 con 0x7f88980b1ab0 2024-04-17T19:47:11.877 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:11.886+0000 7f889da00640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f889815a510 con 0x7f88980cb030 2024-04-17T19:47:11.877 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:11.886+0000 7f889da00640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 -- 0x7f88980cb440 con 0x7f889815d940 2024-04-17T19:47:11.877 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:11.886+0000 7f8896a00640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f88980b1ab0 0x7f8898072710 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:51424/0 (socket says 172.21.15.44:51424) 2024-04-17T19:47:11.877 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:11.886+0000 7f8896a00640 1 -- 172.21.15.44:0/3034517116 learned_addr learned my addr 172.21.15.44:0/3034517116 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-04-17T19:47:11.877 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:11.886+0000 7f8897400640 1 --2- 172.21.15.44:0/3034517116 >> v2:172.21.15.62:3300/0 conn(0x7f889815d940 0x7f88981537e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:11.879 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:11.886+0000 7f8896000640 1 -- 172.21.15.44:0/3034517116 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3270536928 0 0) 0x7f889815a230 con 0x7f88980b1ab0 2024-04-17T19:47:11.879 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:11.886+0000 7f8896000640 1 -- 172.21.15.44:0/3034517116 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f887c003530 con 0x7f88980b1ab0 2024-04-17T19:47:11.879 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:11.886+0000 7f8896000640 1 -- 172.21.15.44:0/3034517116 <== mon.0 v1:172.21.15.44:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1202547933 0 0) 0x7f887c003530 con 0x7f88980b1ab0 2024-04-17T19:47:11.879 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:11.886+0000 7f8896000640 1 -- 172.21.15.44:0/3034517116 >> v2:172.21.15.62:3300/0 conn(0x7f889815d940 msgr2=0x7f88981537e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T19:47:11.879 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:11.886+0000 7f8896000640 1 --2- 172.21.15.44:0/3034517116 >> v2:172.21.15.62:3300/0 conn(0x7f889815d940 0x7f88981537e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:11.879 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:11.886+0000 7f8896000640 1 -- 172.21.15.44:0/3034517116 >> v1:172.21.15.62:6789/0 conn(0x7f88980cb030 legacy=0x7f889815d230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:11.880 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:11.886+0000 7f8896000640 1 -- 172.21.15.44:0/3034517116 --> v1:172.21.15.44:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f88980ca3e0 con 0x7f88980b1ab0 2024-04-17T19:47:11.880 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:11.886+0000 7f8896000640 1 -- 172.21.15.44:0/3034517116 <== mon.0 v1:172.21.15.44:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1863569991 0 0) 0x7f8888001680 con 0x7f88980b1ab0 2024-04-17T19:47:11.880 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:11.886+0000 7f8896000640 1 -- 172.21.15.44:0/3034517116 >> v1:172.21.15.44:6789/0 conn(0x7f88980b1ab0 legacy=0x7f8898072710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:11.880 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:11.886+0000 7f8896000640 1 --2- 172.21.15.44:0/3034517116 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f887c0039c0 0x7f887c003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:11.880 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:11.886+0000 7f8896000640 1 --2- 172.21.15.44:0/3034517116 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f887c004810 0x7f887c004c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:11.880 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:11.886+0000 7f8896000640 1 --2- 172.21.15.44:0/3034517116 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f887c0051d0 0x7f887c00b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:11.880 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:11.886+0000 7f8896000640 1 -- 172.21.15.44:0/3034517116 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f88980cb440 con 0x7f887c0039c0 2024-04-17T19:47:11.880 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:11.886+0000 7f8896000640 1 -- 172.21.15.44:0/3034517116 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f887c00c160 con 0x7f887c004810 2024-04-17T19:47:11.880 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:11.886+0000 7f8896000640 1 -- 172.21.15.44:0/3034517116 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7f887c00c360 con 0x7f887c0051d0 2024-04-17T19:47:11.880 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:11.886+0000 7f8896a00640 1 --2- 172.21.15.44:0/3034517116 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f887c0039c0 0x7f887c003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:11.880 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:11.890+0000 7f888fe00640 1 --2- 172.21.15.44:0/3034517116 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f887c004810 0x7f887c004c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:11.880 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:11.890+0000 7f8897400640 1 --2- 172.21.15.44:0/3034517116 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f887c0051d0 0x7f887c00b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:11.880 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:11.890+0000 7f8896a00640 1 -- 172.21.15.44:0/3034517116 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f887c0051d0 msgr2=0x7f887c00b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T19:47:11.880 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:11.890+0000 7f8896a00640 1 --2- 172.21.15.44:0/3034517116 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f887c0051d0 0x7f887c00b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:11.881 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:11.890+0000 7f8896a00640 1 -- 172.21.15.44:0/3034517116 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f887c004810 msgr2=0x7f887c004c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T19:47:11.881 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:11.890+0000 7f8896a00640 1 --2- 172.21.15.44:0/3034517116 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f887c004810 0x7f887c004c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:11.881 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:11.890+0000 7f8896a00640 1 -- 172.21.15.44:0/3034517116 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f887c003530 con 0x7f887c0039c0 2024-04-17T19:47:11.881 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:11.890+0000 7f8897400640 1 -- 172.21.15.44:0/3034517116 reap_dead start 2024-04-17T19:47:11.881 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:11.890+0000 7f8896a00640 1 --2- 172.21.15.44:0/3034517116 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f887c0039c0 0x7f887c003e30 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f888800c210 tx=0x7f888801f2b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f86156361b445e85 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:47:11.881 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:11.890+0000 7f8896000640 1 -- 172.21.15.44:0/3034517116 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8888007d40 con 0x7f887c0039c0 2024-04-17T19:47:11.882 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:11.890+0000 7f8896000640 1 -- 172.21.15.44:0/3034517116 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f88880ac070 con 0x7f887c0039c0 2024-04-17T19:47:11.882 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:11.890+0000 7f8896000640 1 -- 172.21.15.44:0/3034517116 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8888005b20 con 0x7f887c0039c0 2024-04-17T19:47:11.882 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:11.894+0000 7f889da00640 1 -- 172.21.15.44:0/3034517116 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f887c0039c0 msgr2=0x7f887c003e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:11.882 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:11.894+0000 7f889da00640 1 --2- 172.21.15.44:0/3034517116 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f887c0039c0 0x7f887c003e30 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f888800c210 tx=0x7f888801f2b0 comp rx=0 tx=0).stop 2024-04-17T19:47:11.883 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:11.894+0000 7f889da00640 1 -- 172.21.15.44:0/3034517116 shutdown_connections 2024-04-17T19:47:11.883 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:11.894+0000 7f889da00640 1 --2- 172.21.15.44:0/3034517116 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f887c0039c0 0x7f887c003e30 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:11.883 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:11.894+0000 7f889da00640 1 -- 172.21.15.44:0/3034517116 >> 172.21.15.44:0/3034517116 conn(0x7f8898067eb0 msgr2=0x7f88980682c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:47:11.883 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:11.894+0000 7f889da00640 1 -- 172.21.15.44:0/3034517116 shutdown_connections 2024-04-17T19:47:11.883 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:11.894+0000 7f889da00640 1 -- 172.21.15.44:0/3034517116 wait complete. 2024-04-17T19:47:11.885 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:11.894+0000 7f889da00640 1 Processor -- start 2024-04-17T19:47:11.885 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:11.894+0000 7f889da00640 1 -- start start 2024-04-17T19:47:11.888 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:11.898+0000 7f889da00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f887c0039c0 0x7f88980aedb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:11.888 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:11.898+0000 7f889da00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f88981f2930 0x7f88980cdcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:11.888 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:11.898+0000 7f889da00640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f889806e9f0 0x7f88980ce210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:11.888 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:11.898+0000 7f889da00640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f88981537e0 con 0x7f887c0039c0 2024-04-17T19:47:11.888 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:11.898+0000 7f889da00640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f889815cda0 con 0x7f88981f2930 2024-04-17T19:47:11.888 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:11.898+0000 7f889da00640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7f8898153960 con 0x7f889806e9f0 2024-04-17T19:47:11.888 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:11.898+0000 7f8896a00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f887c0039c0 0x7f88980aedb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:11.888 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:11.898+0000 7f8896a00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f887c0039c0 0x7f88980aedb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:42640/0 (socket says 172.21.15.44:42640) 2024-04-17T19:47:11.888 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:11.898+0000 7f8896a00640 1 -- 172.21.15.44:0/1257286815 learned_addr learned my addr 172.21.15.44:0/1257286815 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-04-17T19:47:11.889 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:11.898+0000 7f888fe00640 1 --2- 172.21.15.44:0/1257286815 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f88981f2930 0x7f88980cdcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:11.889 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:11.898+0000 7f8897400640 1 --2- 172.21.15.44:0/1257286815 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f889806e9f0 0x7f88980ce210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:11.889 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:11.898+0000 7f8896a00640 1 -- 172.21.15.44:0/1257286815 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f889806e9f0 msgr2=0x7f88980ce210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:11.889 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:11.898+0000 7f8896a00640 1 --2- 172.21.15.44:0/1257286815 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f889806e9f0 0x7f88980ce210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:11.889 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:11.898+0000 7f8896a00640 1 -- 172.21.15.44:0/1257286815 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f88981f2930 msgr2=0x7f88980cdcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:11.889 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:11.898+0000 7f8896a00640 1 --2- 172.21.15.44:0/1257286815 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f88981f2930 0x7f88980cdcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:11.889 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:11.898+0000 7f8896a00640 1 -- 172.21.15.44:0/1257286815 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f889806e780 con 0x7f887c0039c0 2024-04-17T19:47:11.889 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:11.898+0000 7f888fe00640 1 --2- 172.21.15.44:0/1257286815 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f88981f2930 0x7f88980cdcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-17T19:47:11.889 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:11.898+0000 7f8896a00640 1 --2- 172.21.15.44:0/1257286815 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f887c0039c0 0x7f88980aedb0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f888801f0e0 tx=0x7f887c005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:47:11.889 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:11.898+0000 7f888ea00640 1 -- 172.21.15.44:0/1257286815 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8888000ee0 con 0x7f887c0039c0 2024-04-17T19:47:11.889 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:11.898+0000 7f888ea00640 1 -- 172.21.15.44:0/1257286815 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8888007d20 con 0x7f887c0039c0 2024-04-17T19:47:11.889 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:11.898+0000 7f888ea00640 1 -- 172.21.15.44:0/1257286815 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8888001680 con 0x7f887c0039c0 2024-04-17T19:47:11.889 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:11.898+0000 7f889da00640 1 -- 172.21.15.44:0/1257286815 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f889815ac40 con 0x7f887c0039c0 2024-04-17T19:47:11.889 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:11.898+0000 7f889da00640 1 -- 172.21.15.44:0/1257286815 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f88981f2130 con 0x7f887c0039c0 2024-04-17T19:47:11.890 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:11.898+0000 7f889da00640 1 -- 172.21.15.44:0/1257286815 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f88981f1c40 con 0x7f887c0039c0 2024-04-17T19:47:11.890 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:11.898+0000 7f888ea00640 1 -- 172.21.15.44:0/1257286815 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f8888007140 con 0x7f887c0039c0 2024-04-17T19:47:11.890 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:11.902+0000 7f888ea00640 1 --2- 172.21.15.44:0/1257286815 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f8874068550 0x7f887406aa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:11.891 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:11.902+0000 7f888ea00640 1 -- 172.21.15.44:0/1257286815 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f8888123fe0 con 0x7f887c0039c0 2024-04-17T19:47:11.891 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:11.902+0000 7f888fe00640 1 --2- 172.21.15.44:0/1257286815 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f8874068550 0x7f887406aa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:11.892 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:11.902+0000 7f888fe00640 1 --2- 172.21.15.44:0/1257286815 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f8874068550 0x7f887406aa60 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f88981f2d70 tx=0x7f8880009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:47:11.895 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:11.906+0000 7f888ea00640 1 -- 172.21.15.44:0/1257286815 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f8888018fc0 con 0x7f887c0039c0 2024-04-17T19:47:12.062 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:12.074+0000 7f889da00640 1 -- 172.21.15.44:0/1257286815 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) -- 0x7f889804ff10 con 0x7f887c0039c0 2024-04-17T19:47:12.063 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:12.074+0000 7f888ea00640 1 -- 172.21.15.44:0/1257286815 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v25) ==== 103+0+11 (secure 0 0 0) 0x7f88880f4290 con 0x7f887c0039c0 2024-04-17T19:47:12.063 INFO:teuthology.orchestra.run.smithi044.stdout:pg_num: 32 2024-04-17T19:47:12.065 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:12.074+0000 7f889da00640 1 -- 172.21.15.44:0/1257286815 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f8874068550 msgr2=0x7f887406aa60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:12.066 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:12.074+0000 7f889da00640 1 --2- 172.21.15.44:0/1257286815 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f8874068550 0x7f887406aa60 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f88981f2d70 tx=0x7f8880009040 comp rx=0 tx=0).stop 2024-04-17T19:47:12.066 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:12.074+0000 7f889da00640 1 -- 172.21.15.44:0/1257286815 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f887c0039c0 msgr2=0x7f88980aedb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:12.066 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:12.074+0000 7f889da00640 1 --2- 172.21.15.44:0/1257286815 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f887c0039c0 0x7f88980aedb0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f888801f0e0 tx=0x7f887c005840 comp rx=0 tx=0).stop 2024-04-17T19:47:12.066 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:12.074+0000 7f889da00640 1 -- 172.21.15.44:0/1257286815 shutdown_connections 2024-04-17T19:47:12.066 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:12.074+0000 7f889da00640 1 --2- 172.21.15.44:0/1257286815 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f8874068550 0x7f887406aa60 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:12.066 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:12.074+0000 7f889da00640 1 --2- 172.21.15.44:0/1257286815 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f889806e9f0 0x7f88980ce210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:12.066 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:12.074+0000 7f889da00640 1 --2- 172.21.15.44:0/1257286815 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f88981f2930 0x7f88980cdcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:12.066 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:12.074+0000 7f889da00640 1 --2- 172.21.15.44:0/1257286815 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f887c0039c0 0x7f88980aedb0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:12.066 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:12.074+0000 7f889da00640 1 -- 172.21.15.44:0/1257286815 >> 172.21.15.44:0/1257286815 conn(0x7f8898067eb0 msgr2=0x7f889815d230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:47:12.066 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:12.074+0000 7f889da00640 1 -- 172.21.15.44:0/1257286815 shutdown_connections 2024-04-17T19:47:12.066 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:12.074+0000 7f889da00640 1 -- 172.21.15.44:0/1257286815 wait complete. 2024-04-17T19:47:12.086 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-17T19:47:12.239 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:12.250+0000 7f1ee9400640 1 Processor -- start 2024-04-17T19:47:12.239 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:12.250+0000 7f1ee9400640 1 -- start start 2024-04-17T19:47:12.241 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:12.250+0000 7f1ee9400640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f1ee40c9430 0x7f1ee40c36a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:12.241 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:12.250+0000 7f1ee9400640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1ee406c330 con 0x7f1ee4153c30 2024-04-17T19:47:12.241 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:12.250+0000 7f1ee9400640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1ee406fb90 con 0x7f1ee40c45b0 2024-04-17T19:47:12.242 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:12.250+0000 7f1ee9400640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 -- 0x7f1ee406f5d0 con 0x7f1ee40c9430 2024-04-17T19:47:12.242 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:12.250+0000 7f1ed9e00640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f1ee40c9430 0x7f1ee40c36a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:12.242 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:12.250+0000 7f1ed9e00640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f1ee40c9430 0x7f1ee40c36a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:42642/0 (socket says 172.21.15.44:42642) 2024-04-17T19:47:12.242 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:12.250+0000 7f1ee2800640 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f1ee40c45b0 0x7f1ee40c7290 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.44:46092/0 (socket says 172.21.15.44:46092) 2024-04-17T19:47:12.242 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:12.250+0000 7f1ed9e00640 1 -- 172.21.15.44:0/2219557761 learned_addr learned my addr 172.21.15.44:0/2219557761 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-04-17T19:47:12.242 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:12.250+0000 7f1ed9e00640 1 -- 172.21.15.44:0/2219557761 >> v1:172.21.15.62:6789/0 conn(0x7f1ee40c45b0 legacy=0x7f1ee40c7290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:12.242 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:12.250+0000 7f1ed9e00640 1 -- 172.21.15.44:0/2219557761 >> v1:172.21.15.44:6789/0 conn(0x7f1ee4153c30 legacy=0x7f1ee41641f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:12.242 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:12.250+0000 7f1ed9e00640 1 -- 172.21.15.44:0/2219557761 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1ee406f8b0 con 0x7f1ee40c9430 2024-04-17T19:47:12.243 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:12.250+0000 7f1ee1e00640 1 -- 172.21.15.44:0/2219557761 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 517840805 0 0) 0x7f1ee406c330 con 0x7f1ee4153c30 2024-04-17T19:47:12.245 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:12.254+0000 7f1ed9e00640 1 --2- 172.21.15.44:0/2219557761 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1ee40c9430 0x7f1ee40c36a0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f1ecc009870 tx=0x7f1ecc01ed50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8058c0d8045895a2 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:47:12.245 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:12.254+0000 7f1ee1e00640 1 -- 172.21.15.44:0/2219557761 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ecc0b5070 con 0x7f1ee40c9430 2024-04-17T19:47:12.245 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:12.254+0000 7f1ee1e00640 1 -- 172.21.15.44:0/2219557761 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1ecc0a8a50 con 0x7f1ee40c9430 2024-04-17T19:47:12.245 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:12.254+0000 7f1ee1e00640 1 -- 172.21.15.44:0/2219557761 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ecc0a8e20 con 0x7f1ee40c9430 2024-04-17T19:47:12.246 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:12.254+0000 7f1ee9400640 1 -- 172.21.15.44:0/2219557761 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1ee40c9430 msgr2=0x7f1ee40c36a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:12.246 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:12.254+0000 7f1ee9400640 1 --2- 172.21.15.44:0/2219557761 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1ee40c9430 0x7f1ee40c36a0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f1ecc009870 tx=0x7f1ecc01ed50 comp rx=0 tx=0).stop 2024-04-17T19:47:12.246 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:12.254+0000 7f1ee9400640 1 -- 172.21.15.44:0/2219557761 shutdown_connections 2024-04-17T19:47:12.246 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:12.254+0000 7f1ee9400640 1 --2- 172.21.15.44:0/2219557761 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1ee40c9430 0x7f1ee40c36a0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:12.247 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:12.254+0000 7f1ee9400640 1 -- 172.21.15.44:0/2219557761 >> 172.21.15.44:0/2219557761 conn(0x7f1ee4071900 msgr2=0x7f1ee40cdb80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:47:12.247 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:12.254+0000 7f1ee9400640 1 -- 172.21.15.44:0/2219557761 shutdown_connections 2024-04-17T19:47:12.247 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:12.254+0000 7f1ee9400640 1 -- 172.21.15.44:0/2219557761 wait complete. 2024-04-17T19:47:12.248 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:12.258+0000 7f1ee9400640 1 Processor -- start 2024-04-17T19:47:12.248 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:12.258+0000 7f1ee9400640 1 -- start start 2024-04-17T19:47:12.251 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:12.258+0000 7f1ee9400640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f1ee40c45b0 0x7f1ee41f7130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:12.251 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:12.258+0000 7f1ee9400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1ee40c9430 0x7f1ee40c5720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:12.251 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:12.258+0000 7f1ee9400640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1ee4153c30 0x7f1ee40b2ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:12.251 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:12.258+0000 7f1ee9400640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f1ee406bf80 con 0x7f1ee40c9430 2024-04-17T19:47:12.251 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:12.258+0000 7f1ee9400640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f1ee4154040 con 0x7f1ee4153c30 2024-04-17T19:47:12.251 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:12.258+0000 7f1ee9400640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7f1ee40c6130 con 0x7f1ee40c45b0 2024-04-17T19:47:12.251 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:12.258+0000 7f1ed9e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1ee40c9430 0x7f1ee40c5720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:12.251 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:12.258+0000 7f1ed9e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1ee40c9430 0x7f1ee40c5720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:42654/0 (socket says 172.21.15.44:42654) 2024-04-17T19:47:12.252 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:12.258+0000 7f1ed9e00640 1 -- 172.21.15.44:0/1330754632 learned_addr learned my addr 172.21.15.44:0/1330754632 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-04-17T19:47:12.252 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:12.258+0000 7f1ee2800640 1 --2- 172.21.15.44:0/1330754632 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f1ee40c45b0 0x7f1ee41f7130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:12.252 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:12.262+0000 7f1ee3200640 1 --2- 172.21.15.44:0/1330754632 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1ee4153c30 0x7f1ee40b2ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:12.252 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:12.262+0000 7f1ed9e00640 1 -- 172.21.15.44:0/1330754632 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f1ee40c45b0 msgr2=0x7f1ee41f7130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:12.252 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:12.262+0000 7f1ed9e00640 1 --2- 172.21.15.44:0/1330754632 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f1ee40c45b0 0x7f1ee41f7130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:12.252 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:12.262+0000 7f1ed9e00640 1 -- 172.21.15.44:0/1330754632 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1ee4153c30 msgr2=0x7f1ee40b2ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:12.252 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:12.262+0000 7f1ed9e00640 1 --2- 172.21.15.44:0/1330754632 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1ee4153c30 0x7f1ee40b2ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:12.252 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:12.262+0000 7f1ed9e00640 1 -- 172.21.15.44:0/1330754632 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1ee40c5c60 con 0x7f1ee40c9430 2024-04-17T19:47:12.252 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:12.262+0000 7f1ee3200640 1 --2- 172.21.15.44:0/1330754632 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1ee4153c30 0x7f1ee40b2ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-17T19:47:12.252 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:12.262+0000 7f1ed9e00640 1 --2- 172.21.15.44:0/1330754632 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1ee40c9430 0x7f1ee40c5720 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f1ecc0b3040 tx=0x7f1ecc01baf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:47:12.252 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:12.262+0000 7f1edb400640 1 -- 172.21.15.44:0/1330754632 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ecc0b5040 con 0x7f1ee40c9430 2024-04-17T19:47:12.252 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:12.262+0000 7f1edb400640 1 -- 172.21.15.44:0/1330754632 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1ecc0b0ba0 con 0x7f1ee40c9430 2024-04-17T19:47:12.252 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:12.262+0000 7f1edb400640 1 -- 172.21.15.44:0/1330754632 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ecc004020 con 0x7f1ee40c9430 2024-04-17T19:47:12.252 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:12.262+0000 7f1ee9400640 1 -- 172.21.15.44:0/1330754632 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1ee40cd380 con 0x7f1ee40c9430 2024-04-17T19:47:12.252 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:12.262+0000 7f1ee9400640 1 -- 172.21.15.44:0/1330754632 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1ee4151da0 con 0x7f1ee40c9430 2024-04-17T19:47:12.253 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:12.262+0000 7f1ee9400640 1 -- 172.21.15.44:0/1330754632 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1ee40c6f50 con 0x7f1ee40c9430 2024-04-17T19:47:12.253 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:12.262+0000 7f1edb400640 1 -- 172.21.15.44:0/1330754632 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f1ecc0c2060 con 0x7f1ee40c9430 2024-04-17T19:47:12.254 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:12.266+0000 7f1edb400640 1 --2- 172.21.15.44:0/1330754632 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f1ec0068380 0x7f1ec006a890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:12.254 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:12.266+0000 7f1edb400640 1 -- 172.21.15.44:0/1330754632 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f1ecc1238b0 con 0x7f1ee40c9430 2024-04-17T19:47:12.255 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:12.266+0000 7f1ee2800640 1 --2- 172.21.15.44:0/1330754632 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f1ec0068380 0x7f1ec006a890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:12.256 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:12.266+0000 7f1ee2800640 1 --2- 172.21.15.44:0/1330754632 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f1ec0068380 0x7f1ec006a890 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f1ed4004db0 tx=0x7f1ed4007e50 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:47:12.259 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:12.270+0000 7f1edb400640 1 -- 172.21.15.44:0/1330754632 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f1ecc0188b0 con 0x7f1ee40c9430 2024-04-17T19:47:12.434 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:12.446+0000 7f1ee9400640 1 -- 172.21.15.44:0/1330754632 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f1ee40c5080 con 0x7f1ee40c9430 2024-04-17T19:47:12.435 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:12.446+0000 7f1edb400640 1 -- 172.21.15.44:0/1330754632 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v25) ==== 80+0+0 (secure 0 0 0) 0x7f1ecc0f3bc0 con 0x7f1ee40c9430 2024-04-17T19:47:12.435 INFO:teuthology.orchestra.run.smithi044.stderr:listed 0 entries 2024-04-17T19:47:12.437 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:12.446+0000 7f1ee9400640 1 -- 172.21.15.44:0/1330754632 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f1ec0068380 msgr2=0x7f1ec006a890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:12.437 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:12.446+0000 7f1ee9400640 1 --2- 172.21.15.44:0/1330754632 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f1ec0068380 0x7f1ec006a890 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f1ed4004db0 tx=0x7f1ed4007e50 comp rx=0 tx=0).stop 2024-04-17T19:47:12.437 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:12.446+0000 7f1ee9400640 1 -- 172.21.15.44:0/1330754632 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1ee40c9430 msgr2=0x7f1ee40c5720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:12.437 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:12.446+0000 7f1ee9400640 1 --2- 172.21.15.44:0/1330754632 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1ee40c9430 0x7f1ee40c5720 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f1ecc0b3040 tx=0x7f1ecc01baf0 comp rx=0 tx=0).stop 2024-04-17T19:47:12.437 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:12.446+0000 7f1ee9400640 1 -- 172.21.15.44:0/1330754632 shutdown_connections 2024-04-17T19:47:12.438 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:12.446+0000 7f1ee9400640 1 --2- 172.21.15.44:0/1330754632 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f1ec0068380 0x7f1ec006a890 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:12.438 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:12.446+0000 7f1ee9400640 1 --2- 172.21.15.44:0/1330754632 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1ee4153c30 0x7f1ee40b2ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:12.438 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:12.446+0000 7f1ee9400640 1 --2- 172.21.15.44:0/1330754632 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1ee40c9430 0x7f1ee40c5720 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:12.438 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:12.446+0000 7f1ee9400640 1 --2- 172.21.15.44:0/1330754632 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f1ee40c45b0 0x7f1ee41f7130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:12.438 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:12.446+0000 7f1ee9400640 1 -- 172.21.15.44:0/1330754632 >> 172.21.15.44:0/1330754632 conn(0x7f1ee4071900 msgr2=0x7f1ee40cdca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:47:12.438 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:12.446+0000 7f1ee9400640 1 -- 172.21.15.44:0/1330754632 shutdown_connections 2024-04-17T19:47:12.438 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:12.446+0000 7f1ee9400640 1 -- 172.21.15.44:0/1330754632 wait complete. 2024-04-17T19:47:12.459 DEBUG:teuthology.orchestra.run.smithi044:> set -ex 2024-04-17T19:47:12.459 DEBUG:teuthology.orchestra.run.smithi044:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-17T19:47:12.467 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-17T19:47:12.664 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:12.674+0000 7f401b800640 1 Processor -- start 2024-04-17T19:47:12.664 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:12.674+0000 7f401b800640 1 -- start start 2024-04-17T19:47:12.667 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:12.678+0000 7f401b800640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f4014162ff0 0x7f4014165410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:12.667 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:12.678+0000 7f401b800640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4014068370 con 0x7f401406ee20 2024-04-17T19:47:12.667 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:12.678+0000 7f401b800640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4014153af0 con 0x7f4014159ca0 2024-04-17T19:47:12.667 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:12.678+0000 7f401b800640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 -- 0x7f4014068090 con 0x7f4014162ff0 2024-04-17T19:47:12.667 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:12.678+0000 7f4018e00640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f401406ee20 0x7f40140c6930 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:51444/0 (socket says 172.21.15.44:51444) 2024-04-17T19:47:12.667 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:12.678+0000 7f4018e00640 1 -- 172.21.15.44:0/879149078 learned_addr learned my addr 172.21.15.44:0/879149078 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-04-17T19:47:12.667 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:12.678+0000 7f4019800640 1 --2- 172.21.15.44:0/879149078 >> v2:172.21.15.62:3300/0 conn(0x7f4014162ff0 0x7f4014165410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:12.668 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:12.678+0000 7f4013400640 1 -- 172.21.15.44:0/879149078 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3236036402 0 0) 0x7f4014068370 con 0x7f401406ee20 2024-04-17T19:47:12.668 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:12.678+0000 7f4013400640 1 -- 172.21.15.44:0/879149078 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3ffc003530 con 0x7f401406ee20 2024-04-17T19:47:12.668 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:12.678+0000 7f4019800640 1 -- 172.21.15.44:0/879149078 >> v1:172.21.15.62:6789/0 conn(0x7f4014159ca0 legacy=0x7f401415a0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:12.668 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:12.678+0000 7f4013400640 1 -- 172.21.15.44:0/879149078 <== mon.0 v1:172.21.15.44:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3534756231 0 0) 0x7f3ffc003530 con 0x7f401406ee20 2024-04-17T19:47:12.668 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:12.678+0000 7f4019800640 1 -- 172.21.15.44:0/879149078 >> v1:172.21.15.44:6789/0 conn(0x7f401406ee20 legacy=0x7f40140c6930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:12.668 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:12.678+0000 7f4019800640 1 -- 172.21.15.44:0/879149078 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f40140c86f0 con 0x7f4014162ff0 2024-04-17T19:47:12.670 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:12.682+0000 7f4019800640 1 --2- 172.21.15.44:0/879149078 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4014162ff0 0x7f4014165410 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f400c009d90 tx=0x7f400c01c860 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c90444c44a6f8b56 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:47:12.671 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:12.682+0000 7f4013400640 1 -- 172.21.15.44:0/879149078 <== mon.1 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f400c0b2070 con 0x7f4014162ff0 2024-04-17T19:47:12.671 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:12.682+0000 7f4013400640 1 -- 172.21.15.44:0/879149078 <== mon.1 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f400c0a56a0 con 0x7f4014162ff0 2024-04-17T19:47:12.671 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:12.682+0000 7f4013400640 1 -- 172.21.15.44:0/879149078 <== mon.1 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40080016a0 con 0x7f4014162ff0 2024-04-17T19:47:12.672 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:12.682+0000 7f401b800640 1 -- 172.21.15.44:0/879149078 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4014162ff0 msgr2=0x7f4014165410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:12.672 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:12.682+0000 7f401b800640 1 --2- 172.21.15.44:0/879149078 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4014162ff0 0x7f4014165410 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f400c009d90 tx=0x7f400c01c860 comp rx=0 tx=0).stop 2024-04-17T19:47:12.672 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:12.682+0000 7f401b800640 1 -- 172.21.15.44:0/879149078 shutdown_connections 2024-04-17T19:47:12.672 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:12.682+0000 7f401b800640 1 --2- 172.21.15.44:0/879149078 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4014162ff0 0x7f4014165410 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:12.672 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:12.682+0000 7f401b800640 1 -- 172.21.15.44:0/879149078 >> 172.21.15.44:0/879149078 conn(0x7f4014070740 msgr2=0x7f4014070b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:47:12.673 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:12.682+0000 7f401b800640 1 -- 172.21.15.44:0/879149078 shutdown_connections 2024-04-17T19:47:12.673 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:12.682+0000 7f401b800640 1 -- 172.21.15.44:0/879149078 wait complete. 2024-04-17T19:47:12.675 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:12.686+0000 7f401b800640 1 Processor -- start 2024-04-17T19:47:12.675 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:12.686+0000 7f401b800640 1 -- start start 2024-04-17T19:47:12.677 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:12.686+0000 7f401b800640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f401406ee20 0x7f401414f9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:12.677 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:12.686+0000 7f401b800640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4014159ca0 0x7f40141f8f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:12.677 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:12.686+0000 7f401b800640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f4014162ff0 0x7f401414c6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:12.677 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:12.686+0000 7f401b800640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f40140c8e30 con 0x7f4014159ca0 2024-04-17T19:47:12.677 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:12.686+0000 7f401b800640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f40140c8cb0 con 0x7f401406ee20 2024-04-17T19:47:12.677 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:12.686+0000 7f401b800640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7f401406f230 con 0x7f4014162ff0 2024-04-17T19:47:12.677 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:12.686+0000 7f4013e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4014159ca0 0x7f40141f8f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:12.677 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:12.686+0000 7f4013e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4014159ca0 0x7f40141f8f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:42670/0 (socket says 172.21.15.44:42670) 2024-04-17T19:47:12.677 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:12.686+0000 7f4013e00640 1 -- 172.21.15.44:0/2159459231 learned_addr learned my addr 172.21.15.44:0/2159459231 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-04-17T19:47:12.677 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:12.686+0000 7f4018e00640 1 --2- 172.21.15.44:0/2159459231 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f401406ee20 0x7f401414f9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:12.678 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:12.686+0000 7f4019800640 1 --2- 172.21.15.44:0/2159459231 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f4014162ff0 0x7f401414c6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:12.678 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:12.686+0000 7f4013e00640 1 -- 172.21.15.44:0/2159459231 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f4014162ff0 msgr2=0x7f401414c6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:12.678 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:12.686+0000 7f4013e00640 1 --2- 172.21.15.44:0/2159459231 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f4014162ff0 0x7f401414c6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:12.678 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:12.686+0000 7f4013e00640 1 -- 172.21.15.44:0/2159459231 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f401406ee20 msgr2=0x7f401414f9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:12.678 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:12.686+0000 7f4013e00640 1 --2- 172.21.15.44:0/2159459231 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f401406ee20 0x7f401414f9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:12.679 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:12.686+0000 7f4013e00640 1 -- 172.21.15.44:0/2159459231 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f40141f94d0 con 0x7f4014159ca0 2024-04-17T19:47:12.679 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:12.686+0000 7f4013e00640 1 --2- 172.21.15.44:0/2159459231 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4014159ca0 0x7f40141f8f90 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f400000c3f0 tx=0x7f400000c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:47:12.679 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:12.690+0000 7f4010c00640 1 -- 172.21.15.44:0/2159459231 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4000017070 con 0x7f4014159ca0 2024-04-17T19:47:12.679 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:12.690+0000 7f4010c00640 1 -- 172.21.15.44:0/2159459231 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f40000052d0 con 0x7f4014159ca0 2024-04-17T19:47:12.679 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:12.690+0000 7f4010c00640 1 -- 172.21.15.44:0/2159459231 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4000003840 con 0x7f4014159ca0 2024-04-17T19:47:12.679 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:12.690+0000 7f401b800640 1 -- 172.21.15.44:0/2159459231 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f401414dca0 con 0x7f4014159ca0 2024-04-17T19:47:12.679 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:12.690+0000 7f401b800640 1 -- 172.21.15.44:0/2159459231 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f401414e260 con 0x7f4014159ca0 2024-04-17T19:47:12.680 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:12.690+0000 7f401b800640 1 -- 172.21.15.44:0/2159459231 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f40141500b0 con 0x7f4014159ca0 2024-04-17T19:47:12.681 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:12.690+0000 7f4010c00640 1 -- 172.21.15.44:0/2159459231 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f400001a070 con 0x7f4014159ca0 2024-04-17T19:47:12.682 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:12.690+0000 7f4010c00640 1 --2- 172.21.15.44:0/2159459231 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f3ff40683b0 0x7f3ff406a8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:12.682 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:12.690+0000 7f4010c00640 1 -- 172.21.15.44:0/2159459231 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f4000085ff0 con 0x7f4014159ca0 2024-04-17T19:47:12.682 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:12.694+0000 7f4018e00640 1 --2- 172.21.15.44:0/2159459231 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f3ff40683b0 0x7f3ff406a8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:12.683 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:12.694+0000 7f4018e00640 1 --2- 172.21.15.44:0/2159459231 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f3ff40683b0 0x7f3ff406a8c0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f4008000fc0 tx=0x7f4008001e30 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:47:12.687 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:12.698+0000 7f4010c00640 1 -- 172.21.15.44:0/2159459231 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f4000005480 con 0x7f4014159ca0 2024-04-17T19:47:12.854 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:12.862+0000 7f401b800640 1 -- 172.21.15.44:0/2159459231 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f401404ff10 con 0x7f4014159ca0 2024-04-17T19:47:12.855 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:12.866+0000 7f4010c00640 1 -- 172.21.15.44:0/2159459231 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) ==== 74+0+18482 (secure 0 0 0) 0x7f4000055ba0 con 0x7f4014159ca0 2024-04-17T19:47:12.856 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-04-17T19:47:12.856 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":25,"fsid":"703f77ca-79c6-4a66-b576-62c526cb1021","created":"2024-04-17T19:46:30.831994+0000","modified":"2024-04-17T19:47:01.141287+0000","last_up_change":"2024-04-17T19:46:41.988197+0000","last_in_change":"2024-04-17T19:46:33.407430+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-17T19:46:41.940380+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-17T19:46:54.222150+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-17T19:46:55.031694+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-17T19:46:58.707529+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"30520dc6-eea6-43d4-ab60-3ca9e92329dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6800","nonce":1018735925},{"type":"v1","addr":"172.21.15.44:6801","nonce":1018735925}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6802","nonce":1018735925},{"type":"v1","addr":"172.21.15.44:6803","nonce":1018735925}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6806","nonce":1018735925},{"type":"v1","addr":"172.21.15.44:6807","nonce":1018735925}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6804","nonce":1018735925},{"type":"v1","addr":"172.21.15.44:6805","nonce":1018735925}]},"public_addr":"172.21.15.44:6801/1018735925","cluster_addr":"172.21.15.44:6803/1018735925","heartbeat_back_addr":"172.21.15.44:6807/1018735925","heartbeat_front_addr":"172.21.15.44:6805/1018735925","state":["exists","up"]},{"osd":1,"uuid":"079bd511-b6ce-449b-8f11-17b311b12f7c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6817","nonce":1452577434},{"type":"v1","addr":"172.21.15.44:6820","nonce":1452577434}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6823","nonce":1452577434},{"type":"v1","addr":"172.21.15.44:6825","nonce":1452577434}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6830","nonce":1452577434},{"type":"v1","addr":"172.21.15.44:6831","nonce":1452577434}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6828","nonce":1452577434},{"type":"v1","addr":"172.21.15.44:6829","nonce":1452577434}]},"public_addr":"172.21.15.44:6820/1452577434","cluster_addr":"172.21.15.44:6825/1452577434","heartbeat_back_addr":"172.21.15.44:6831/1452577434","heartbeat_front_addr":"172.21.15.44:6829/1452577434","state":["exists","up"]},{"osd":2,"uuid":"34f0b9ab-b1d2-4ee9-841c-f15afbb6bec5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6816","nonce":1160071918},{"type":"v1","addr":"172.21.15.44:6818","nonce":1160071918}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6819","nonce":1160071918},{"type":"v1","addr":"172.21.15.44:6821","nonce":1160071918}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6826","nonce":1160071918},{"type":"v1","addr":"172.21.15.44:6827","nonce":1160071918}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6822","nonce":1160071918},{"type":"v1","addr":"172.21.15.44:6824","nonce":1160071918}]},"public_addr":"172.21.15.44:6818/1160071918","cluster_addr":"172.21.15.44:6821/1160071918","heartbeat_back_addr":"172.21.15.44:6827/1160071918","heartbeat_front_addr":"172.21.15.44:6824/1160071918","state":["exists","up"]},{"osd":3,"uuid":"4740032d-fe34-4b1b-bb85-f430896fc3c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6808","nonce":4236454921},{"type":"v1","addr":"172.21.15.44:6809","nonce":4236454921}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6810","nonce":4236454921},{"type":"v1","addr":"172.21.15.44:6811","nonce":4236454921}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6814","nonce":4236454921},{"type":"v1","addr":"172.21.15.44:6815","nonce":4236454921}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6812","nonce":4236454921},{"type":"v1","addr":"172.21.15.44:6813","nonce":4236454921}]},"public_addr":"172.21.15.44:6809/4236454921","cluster_addr":"172.21.15.44:6811/4236454921","heartbeat_back_addr":"172.21.15.44:6815/4236454921","heartbeat_front_addr":"172.21.15.44:6813/4236454921","state":["exists","up"]},{"osd":4,"uuid":"7dbedb00-302d-4d52-810c-e18839254da1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6800","nonce":2293251376},{"type":"v1","addr":"172.21.15.62:6801","nonce":2293251376}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6802","nonce":2293251376},{"type":"v1","addr":"172.21.15.62:6803","nonce":2293251376}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6806","nonce":2293251376},{"type":"v1","addr":"172.21.15.62:6807","nonce":2293251376}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6804","nonce":2293251376},{"type":"v1","addr":"172.21.15.62:6805","nonce":2293251376}]},"public_addr":"172.21.15.62:6801/2293251376","cluster_addr":"172.21.15.62:6803/2293251376","heartbeat_back_addr":"172.21.15.62:6807/2293251376","heartbeat_front_addr":"172.21.15.62:6805/2293251376","state":["exists","up"]},{"osd":5,"uuid":"38c1e8d9-393d-4f33-a97a-3295cf5c5b07","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6808","nonce":1551020300},{"type":"v1","addr":"172.21.15.62:6809","nonce":1551020300}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6810","nonce":1551020300},{"type":"v1","addr":"172.21.15.62:6811","nonce":1551020300}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6814","nonce":1551020300},{"type":"v1","addr":"172.21.15.62:6815","nonce":1551020300}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6812","nonce":1551020300},{"type":"v1","addr":"172.21.15.62:6813","nonce":1551020300}]},"public_addr":"172.21.15.62:6809/1551020300","cluster_addr":"172.21.15.62:6811/1551020300","heartbeat_back_addr":"172.21.15.62:6815/1551020300","heartbeat_front_addr":"172.21.15.62:6813/1551020300","state":["exists","up"]},{"osd":6,"uuid":"f6ff81c6-f14d-4477-88e3-9116cc5a2992","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6824","nonce":2602310256},{"type":"v1","addr":"172.21.15.62:6825","nonce":2602310256}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6826","nonce":2602310256},{"type":"v1","addr":"172.21.15.62:6827","nonce":2602310256}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6830","nonce":2602310256},{"type":"v1","addr":"172.21.15.62:6831","nonce":2602310256}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6828","nonce":2602310256},{"type":"v1","addr":"172.21.15.62:6829","nonce":2602310256}]},"public_addr":"172.21.15.62:6825/2602310256","cluster_addr":"172.21.15.62:6827/2602310256","heartbeat_back_addr":"172.21.15.62:6831/2602310256","heartbeat_front_addr":"172.21.15.62:6829/2602310256","state":["exists","up"]},{"osd":7,"uuid":"ce395bc3-bcb5-4b94-a523-5bb9df491eca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6816","nonce":2912738359},{"type":"v1","addr":"172.21.15.62:6817","nonce":2912738359}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6818","nonce":2912738359},{"type":"v1","addr":"172.21.15.62:6819","nonce":2912738359}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6822","nonce":2912738359},{"type":"v1","addr":"172.21.15.62:6823","nonce":2912738359}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6820","nonce":2912738359},{"type":"v1","addr":"172.21.15.62:6821","nonce":2912738359}]},"public_addr":"172.21.15.62:6817/2912738359","cluster_addr":"172.21.15.62:6819/2912738359","heartbeat_back_addr":"172.21.15.62:6823/2912738359","heartbeat_front_addr":"172.21.15.62:6821/2912738359","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T19:46:39.302883+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T19:46:39.177705+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T19:46:39.188894+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T19:46:39.313009+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T19:46:38.870508+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T19:46:38.790900+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T19:46:38.979163+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T19:46:38.992348+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-17T19:47:12.857 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:12.866+0000 7f401b800640 1 -- 172.21.15.44:0/2159459231 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f3ff40683b0 msgr2=0x7f3ff406a8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:12.857 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:12.866+0000 7f401b800640 1 --2- 172.21.15.44:0/2159459231 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f3ff40683b0 0x7f3ff406a8c0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f4008000fc0 tx=0x7f4008001e30 comp rx=0 tx=0).stop 2024-04-17T19:47:12.858 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:12.866+0000 7f401b800640 1 -- 172.21.15.44:0/2159459231 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4014159ca0 msgr2=0x7f40141f8f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:12.858 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:12.866+0000 7f401b800640 1 --2- 172.21.15.44:0/2159459231 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4014159ca0 0x7f40141f8f90 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f400000c3f0 tx=0x7f400000c8b0 comp rx=0 tx=0).stop 2024-04-17T19:47:12.858 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:12.866+0000 7f401b800640 1 -- 172.21.15.44:0/2159459231 shutdown_connections 2024-04-17T19:47:12.858 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:12.866+0000 7f401b800640 1 --2- 172.21.15.44:0/2159459231 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f3ff40683b0 0x7f3ff406a8c0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:12.858 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:12.866+0000 7f401b800640 1 --2- 172.21.15.44:0/2159459231 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f4014162ff0 0x7f401414c6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:12.858 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:12.866+0000 7f401b800640 1 --2- 172.21.15.44:0/2159459231 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4014159ca0 0x7f40141f8f90 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:12.858 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:12.866+0000 7f401b800640 1 --2- 172.21.15.44:0/2159459231 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f401406ee20 0x7f401414f9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:12.858 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:12.866+0000 7f401b800640 1 -- 172.21.15.44:0/2159459231 >> 172.21.15.44:0/2159459231 conn(0x7f4014070740 msgr2=0x7f401406c810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:47:12.858 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:12.866+0000 7f401b800640 1 -- 172.21.15.44:0/2159459231 shutdown_connections 2024-04-17T19:47:12.858 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:12.866+0000 7f401b800640 1 -- 172.21.15.44:0/2159459231 wait complete. 2024-04-17T19:47:12.878 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-17T19:46:41.940380+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-17T19:46:54.222150+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-17T19:46:55.031694+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-04-17T19:46:58.707529+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-04-17T19:47:12.878 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-17T19:47:13.032 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:13.042+0000 7f1275000640 1 Processor -- start 2024-04-17T19:47:13.033 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:13.042+0000 7f1275000640 1 -- start start 2024-04-17T19:47:13.035 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:13.046+0000 7f1275000640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f1270152860 0x7f12700c68b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:13.035 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:13.046+0000 7f1275000640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f12700c80a0 0x7f12700c84b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:13.035 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:13.046+0000 7f1275000640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f12700c89f0 con 0x7f1270159140 2024-04-17T19:47:13.035 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:13.046+0000 7f1275000640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 -- 0x7f12700c6eb0 con 0x7f12700c80a0 2024-04-17T19:47:13.035 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:13.046+0000 7f1275000640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 -- 0x7f12700c78e0 con 0x7f1270152860 2024-04-17T19:47:13.035 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:13.046+0000 7f126e800640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f12700c80a0 0x7f12700c84b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:13.035 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:13.046+0000 7f126e800640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f12700c80a0 0x7f12700c84b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:42672/0 (socket says 172.21.15.44:42672) 2024-04-17T19:47:13.035 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:13.046+0000 7f126e800640 1 -- 172.21.15.44:0/4275497458 learned_addr learned my addr 172.21.15.44:0/4275497458 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-04-17T19:47:13.035 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:13.046+0000 7f126de00640 1 --2- 172.21.15.44:0/4275497458 >> v2:172.21.15.62:3300/0 conn(0x7f1270152860 0x7f12700c68b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:13.036 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:13.046+0000 7f126e800640 1 -- 172.21.15.44:0/4275497458 >> v2:172.21.15.62:3300/0 conn(0x7f1270152860 msgr2=0x7f12700c68b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T19:47:13.036 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:13.046+0000 7f126e800640 1 --2- 172.21.15.44:0/4275497458 >> v2:172.21.15.62:3300/0 conn(0x7f1270152860 0x7f12700c68b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:13.036 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:13.046+0000 7f126e800640 1 -- 172.21.15.44:0/4275497458 >> v1:172.21.15.62:6789/0 conn(0x7f1270159140 legacy=0x7f12700c47e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:13.036 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:13.046+0000 7f126e800640 1 -- 172.21.15.44:0/4275497458 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f12700c4000 con 0x7f12700c80a0 2024-04-17T19:47:13.038 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:13.046+0000 7f126e800640 1 --2- 172.21.15.44:0/4275497458 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f12700c80a0 0x7f12700c84b0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f127006cc70 tx=0x7f126801c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e39eb9b784ee5129 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:47:13.038 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:13.050+0000 7f126d400640 1 -- 172.21.15.44:0/4275497458 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12680b0070 con 0x7f12700c80a0 2024-04-17T19:47:13.038 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:13.050+0000 7f126d400640 1 -- 172.21.15.44:0/4275497458 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f12680ab600 con 0x7f12700c80a0 2024-04-17T19:47:13.039 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:13.050+0000 7f126d400640 1 -- 172.21.15.44:0/4275497458 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12680ab9d0 con 0x7f12700c80a0 2024-04-17T19:47:13.039 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:13.050+0000 7f1275000640 1 -- 172.21.15.44:0/4275497458 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f12700c80a0 msgr2=0x7f12700c84b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:13.039 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:13.050+0000 7f1275000640 1 --2- 172.21.15.44:0/4275497458 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f12700c80a0 0x7f12700c84b0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f127006cc70 tx=0x7f126801c490 comp rx=0 tx=0).stop 2024-04-17T19:47:13.039 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:13.050+0000 7f1275000640 1 -- 172.21.15.44:0/4275497458 shutdown_connections 2024-04-17T19:47:13.039 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:13.050+0000 7f1275000640 1 --2- 172.21.15.44:0/4275497458 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f12700c80a0 0x7f12700c84b0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:13.039 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:13.050+0000 7f1275000640 1 --2- 172.21.15.44:0/4275497458 >> v2:172.21.15.62:3300/0 conn(0x7f1270152860 0x7f12700c68b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:13.039 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:13.050+0000 7f1275000640 1 -- 172.21.15.44:0/4275497458 >> 172.21.15.44:0/4275497458 conn(0x7f127006c380 msgr2=0x7f1270070080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:47:13.040 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:13.050+0000 7f1275000640 1 -- 172.21.15.44:0/4275497458 shutdown_connections 2024-04-17T19:47:13.040 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:13.050+0000 7f1275000640 1 -- 172.21.15.44:0/4275497458 wait complete. 2024-04-17T19:47:13.041 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:13.050+0000 7f1275000640 1 Processor -- start 2024-04-17T19:47:13.041 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:13.050+0000 7f1275000640 1 -- start start 2024-04-17T19:47:13.043 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:13.054+0000 7f1275000640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f12700c80a0 0x7f12701f8ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:13.043 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:13.054+0000 7f1275000640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f1270152860 0x7f12701f5880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:13.043 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:13.054+0000 7f1275000640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1270159140 0x7f12701566e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:13.043 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:13.054+0000 7f1275000640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f12700c5070 con 0x7f1270159140 2024-04-17T19:47:13.043 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:13.054+0000 7f1275000640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f12700c4ef0 con 0x7f12700c80a0 2024-04-17T19:47:13.043 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:13.054+0000 7f1275000640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7f1270165860 con 0x7f1270152860 2024-04-17T19:47:13.043 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:13.054+0000 7f126e800640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1270159140 0x7f12701566e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:13.043 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:13.054+0000 7f126e800640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1270159140 0x7f12701566e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:42678/0 (socket says 172.21.15.44:42678) 2024-04-17T19:47:13.043 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:13.054+0000 7f126e800640 1 -- 172.21.15.44:0/62963325 learned_addr learned my addr 172.21.15.44:0/62963325 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-04-17T19:47:13.044 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:13.054+0000 7f126de00640 1 --2- 172.21.15.44:0/62963325 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f12700c80a0 0x7f12701f8ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:13.044 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:13.054+0000 7f1265400640 1 --2- 172.21.15.44:0/62963325 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f1270152860 0x7f12701f5880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:13.045 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:13.054+0000 7f126e800640 1 -- 172.21.15.44:0/62963325 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f1270152860 msgr2=0x7f12701f5880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:13.045 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:13.054+0000 7f126e800640 1 --2- 172.21.15.44:0/62963325 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f1270152860 0x7f12701f5880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:13.045 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:13.054+0000 7f126e800640 1 -- 172.21.15.44:0/62963325 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f12700c80a0 msgr2=0x7f12701f8ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:13.045 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:13.054+0000 7f126e800640 1 --2- 172.21.15.44:0/62963325 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f12700c80a0 0x7f12701f8ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:13.045 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:13.054+0000 7f126e800640 1 -- 172.21.15.44:0/62963325 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f127014d240 con 0x7f1270159140 2024-04-17T19:47:13.045 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:13.054+0000 7f126e800640 1 --2- 172.21.15.44:0/62963325 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1270159140 0x7f12701566e0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f12680ae040 tx=0x7f1268019230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:47:13.045 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:13.054+0000 7f1266a00640 1 -- 172.21.15.44:0/62963325 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12680b0040 con 0x7f1270159140 2024-04-17T19:47:13.045 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:13.054+0000 7f1266a00640 1 -- 172.21.15.44:0/62963325 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f12680ba070 con 0x7f1270159140 2024-04-17T19:47:13.045 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:13.054+0000 7f1275000640 1 -- 172.21.15.44:0/62963325 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f12701f9400 con 0x7f1270159140 2024-04-17T19:47:13.045 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:13.054+0000 7f1266a00640 1 -- 172.21.15.44:0/62963325 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12680b4650 con 0x7f1270159140 2024-04-17T19:47:13.045 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:13.054+0000 7f1275000640 1 -- 172.21.15.44:0/62963325 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f12701f5dc0 con 0x7f1270159140 2024-04-17T19:47:13.046 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:13.054+0000 7f1275000640 1 -- 172.21.15.44:0/62963325 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f127014e070 con 0x7f1270159140 2024-04-17T19:47:13.046 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:13.058+0000 7f1266a00640 1 -- 172.21.15.44:0/62963325 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f12680b47f0 con 0x7f1270159140 2024-04-17T19:47:13.047 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:13.058+0000 7f1266a00640 1 --2- 172.21.15.44:0/62963325 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f124c0683b0 0x7f124c06a8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:13.047 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:13.058+0000 7f1266a00640 1 -- 172.21.15.44:0/62963325 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f1268120840 con 0x7f1270159140 2024-04-17T19:47:13.047 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:13.058+0000 7f126de00640 1 --2- 172.21.15.44:0/62963325 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f124c0683b0 0x7f124c06a8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:13.048 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:13.058+0000 7f126de00640 1 --2- 172.21.15.44:0/62963325 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f124c0683b0 0x7f124c06a8c0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f1260003ab0 tx=0x7f1260009830 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:47:13.051 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:13.062+0000 7f1266a00640 1 -- 172.21.15.44:0/62963325 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f1268016110 con 0x7f1270159140 2024-04-17T19:47:13.217 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:13.226+0000 7f1275000640 1 -- 172.21.15.44:0/62963325 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f127004ff10 con 0x7f1270159140 2024-04-17T19:47:13.217 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:13.226+0000 7f1266a00640 1 -- 172.21.15.44:0/62963325 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v25) ==== 93+0+10 (secure 0 0 0) 0x7f12680f0ab0 con 0x7f1270159140 2024-04-17T19:47:13.217 INFO:teuthology.orchestra.run.smithi044.stdout:pg_num: 1 2024-04-17T19:47:13.219 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:13.230+0000 7f1275000640 1 -- 172.21.15.44:0/62963325 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f124c0683b0 msgr2=0x7f124c06a8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:13.219 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:13.230+0000 7f1275000640 1 --2- 172.21.15.44:0/62963325 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f124c0683b0 0x7f124c06a8c0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f1260003ab0 tx=0x7f1260009830 comp rx=0 tx=0).stop 2024-04-17T19:47:13.220 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:13.230+0000 7f1275000640 1 -- 172.21.15.44:0/62963325 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1270159140 msgr2=0x7f12701566e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:13.220 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:13.230+0000 7f1275000640 1 --2- 172.21.15.44:0/62963325 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1270159140 0x7f12701566e0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f12680ae040 tx=0x7f1268019230 comp rx=0 tx=0).stop 2024-04-17T19:47:13.220 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:13.230+0000 7f1275000640 1 -- 172.21.15.44:0/62963325 shutdown_connections 2024-04-17T19:47:13.220 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:13.230+0000 7f1275000640 1 --2- 172.21.15.44:0/62963325 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f124c0683b0 0x7f124c06a8c0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:13.220 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:13.230+0000 7f1275000640 1 --2- 172.21.15.44:0/62963325 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f1270152860 0x7f12701f5880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:13.220 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:13.230+0000 7f1275000640 1 --2- 172.21.15.44:0/62963325 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1270159140 0x7f12701566e0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:13.220 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:13.230+0000 7f1275000640 1 --2- 172.21.15.44:0/62963325 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f12700c80a0 0x7f12701f8ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:13.220 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:13.230+0000 7f1275000640 1 -- 172.21.15.44:0/62963325 >> 172.21.15.44:0/62963325 conn(0x7f127006c380 msgr2=0x7f1270150e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:47:13.220 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:13.230+0000 7f1275000640 1 -- 172.21.15.44:0/62963325 shutdown_connections 2024-04-17T19:47:13.220 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:13.230+0000 7f1275000640 1 -- 172.21.15.44:0/62963325 wait complete. 2024-04-17T19:47:13.239 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-17T19:47:13.395 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:13.406+0000 7f3210800640 1 Processor -- start 2024-04-17T19:47:13.396 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:13.406+0000 7f3210800640 1 -- start start 2024-04-17T19:47:13.397 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:13.406+0000 7f3210800640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f3208153bc0 0x7f320806c260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:13.398 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:13.406+0000 7f3210800640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f32080c7290 0x7f32080c76a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:13.398 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:13.406+0000 7f3210800640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f320806f970 con 0x7f3208159f10 2024-04-17T19:47:13.398 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:13.406+0000 7f3210800640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 -- 0x7f320806fe40 con 0x7f32080c7290 2024-04-17T19:47:13.398 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:13.406+0000 7f3210800640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7f3208070650 con 0x7f3208153bc0 2024-04-17T19:47:13.398 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:13.406+0000 7f320e800640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f3208159f10 0x7f320815a320 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:51446/0 (socket says 172.21.15.44:51446) 2024-04-17T19:47:13.398 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:13.406+0000 7f320e800640 1 -- 172.21.15.44:0/2792500529 learned_addr learned my addr 172.21.15.44:0/2792500529 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-04-17T19:47:13.398 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:13.406+0000 7f320de00640 1 --2- 172.21.15.44:0/2792500529 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f3208153bc0 0x7f320806c260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:13.398 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:13.406+0000 7f320d400640 1 --2- 172.21.15.44:0/2792500529 >> v2:172.21.15.62:3300/0 conn(0x7f32080c7290 0x7f32080c76a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:13.399 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:13.406+0000 7f320ca00640 1 -- 172.21.15.44:0/2792500529 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2990561860 0 0) 0x7f320806f970 con 0x7f3208159f10 2024-04-17T19:47:13.399 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:13.410+0000 7f320ca00640 1 -- 172.21.15.44:0/2792500529 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f31f0003530 con 0x7f3208159f10 2024-04-17T19:47:13.399 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:13.410+0000 7f320d400640 1 -- 172.21.15.44:0/2792500529 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f3208153bc0 msgr2=0x7f320806c260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T19:47:13.399 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:13.410+0000 7f320d400640 1 --2- 172.21.15.44:0/2792500529 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f3208153bc0 0x7f320806c260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:13.399 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:13.410+0000 7f320d400640 1 -- 172.21.15.44:0/2792500529 >> v1:172.21.15.44:6789/0 conn(0x7f3208159f10 legacy=0x7f320815a320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:13.399 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:13.410+0000 7f320d400640 1 -- 172.21.15.44:0/2792500529 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3208070090 con 0x7f32080c7290 2024-04-17T19:47:13.401 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:13.410+0000 7f320d400640 1 --2- 172.21.15.44:0/2792500529 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f32080c7290 0x7f32080c76a0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f31f80097c0 tx=0x7f31f801ec90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8272c850f1b16a1e server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:47:13.402 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:13.410+0000 7f320ca00640 1 -- 172.21.15.44:0/2792500529 <== mon.1 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31f80b5070 con 0x7f32080c7290 2024-04-17T19:47:13.402 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:13.410+0000 7f320ca00640 1 -- 172.21.15.44:0/2792500529 <== mon.1 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f31f80a8990 con 0x7f32080c7290 2024-04-17T19:47:13.402 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:13.410+0000 7f320ca00640 1 -- 172.21.15.44:0/2792500529 <== mon.1 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31f80a8d40 con 0x7f32080c7290 2024-04-17T19:47:13.403 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:13.414+0000 7f3210800640 1 -- 172.21.15.44:0/2792500529 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f32080c7290 msgr2=0x7f32080c76a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:13.403 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:13.414+0000 7f3210800640 1 --2- 172.21.15.44:0/2792500529 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f32080c7290 0x7f32080c76a0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f31f80097c0 tx=0x7f31f801ec90 comp rx=0 tx=0).stop 2024-04-17T19:47:13.403 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:13.414+0000 7f3210800640 1 -- 172.21.15.44:0/2792500529 shutdown_connections 2024-04-17T19:47:13.403 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:13.414+0000 7f3210800640 1 --2- 172.21.15.44:0/2792500529 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f32080c7290 0x7f32080c76a0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:13.403 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:13.414+0000 7f3210800640 1 --2- 172.21.15.44:0/2792500529 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f3208153bc0 0x7f320806c260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:13.403 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:13.414+0000 7f3210800640 1 -- 172.21.15.44:0/2792500529 >> 172.21.15.44:0/2792500529 conn(0x7f3208071900 msgr2=0x7f32080cdb80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:47:13.403 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:13.414+0000 7f3210800640 1 -- 172.21.15.44:0/2792500529 shutdown_connections 2024-04-17T19:47:13.403 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:13.414+0000 7f3210800640 1 -- 172.21.15.44:0/2792500529 wait complete. 2024-04-17T19:47:13.405 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:13.414+0000 7f3210800640 1 Processor -- start 2024-04-17T19:47:13.405 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:13.414+0000 7f3210800640 1 -- start start 2024-04-17T19:47:13.407 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:13.418+0000 7f3210800640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f32080c7290 0x7f3208152220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:13.407 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:13.418+0000 7f3210800640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3208153bc0 0x7f32081f0ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:13.407 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:13.418+0000 7f3210800640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f3208159f10 0x7f32081e3640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:13.407 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:13.418+0000 7f3210800640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f320806bff0 con 0x7f3208153bc0 2024-04-17T19:47:13.407 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:13.418+0000 7f3210800640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f32081599f0 con 0x7f32080c7290 2024-04-17T19:47:13.407 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:13.418+0000 7f3210800640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7f3208153fd0 con 0x7f3208159f10 2024-04-17T19:47:13.408 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:13.418+0000 7f320d400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3208153bc0 0x7f32081f0ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:13.408 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:13.418+0000 7f320d400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3208153bc0 0x7f32081f0ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:42692/0 (socket says 172.21.15.44:42692) 2024-04-17T19:47:13.408 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:13.418+0000 7f320d400640 1 -- 172.21.15.44:0/519297347 learned_addr learned my addr 172.21.15.44:0/519297347 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-04-17T19:47:13.408 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:13.418+0000 7f320de00640 1 --2- 172.21.15.44:0/519297347 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f32080c7290 0x7f3208152220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:13.408 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:13.418+0000 7f320e800640 1 --2- 172.21.15.44:0/519297347 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f3208159f10 0x7f32081e3640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:13.409 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:13.418+0000 7f320d400640 1 -- 172.21.15.44:0/519297347 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f3208159f10 msgr2=0x7f32081e3640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:13.409 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:13.418+0000 7f320d400640 1 --2- 172.21.15.44:0/519297347 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f3208159f10 0x7f32081e3640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:13.409 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:13.418+0000 7f320d400640 1 -- 172.21.15.44:0/519297347 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f32080c7290 msgr2=0x7f3208152220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:13.409 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:13.418+0000 7f320d400640 1 --2- 172.21.15.44:0/519297347 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f32080c7290 0x7f3208152220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:13.409 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:13.418+0000 7f320d400640 1 -- 172.21.15.44:0/519297347 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3208153110 con 0x7f3208153bc0 2024-04-17T19:47:13.409 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:13.418+0000 7f320d400640 1 --2- 172.21.15.44:0/519297347 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3208153bc0 0x7f32081f0ce0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f31f801c8c0 tx=0x7f31f801ba30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:47:13.409 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:13.418+0000 7f3202000640 1 -- 172.21.15.44:0/519297347 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31f80b5040 con 0x7f3208153bc0 2024-04-17T19:47:13.409 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:13.418+0000 7f3202000640 1 -- 172.21.15.44:0/519297347 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f31f8004040 con 0x7f3208153bc0 2024-04-17T19:47:13.409 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:13.418+0000 7f3210800640 1 -- 172.21.15.44:0/519297347 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3208151460 con 0x7f3208153bc0 2024-04-17T19:47:13.410 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:13.418+0000 7f3202000640 1 -- 172.21.15.44:0/519297347 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31f80043f0 con 0x7f3208153bc0 2024-04-17T19:47:13.410 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:13.418+0000 7f3210800640 1 -- 172.21.15.44:0/519297347 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3208151a20 con 0x7f3208153bc0 2024-04-17T19:47:13.410 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:13.418+0000 7f3210800640 1 -- 172.21.15.44:0/519297347 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f320804ff10 con 0x7f3208153bc0 2024-04-17T19:47:13.410 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:13.422+0000 7f3202000640 1 -- 172.21.15.44:0/519297347 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f31f80c1020 con 0x7f3208153bc0 2024-04-17T19:47:13.411 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:13.422+0000 7f3202000640 1 --2- 172.21.15.44:0/519297347 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f31ec0683b0 0x7f31ec06a8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:13.411 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:13.422+0000 7f3202000640 1 -- 172.21.15.44:0/519297347 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f31f8123410 con 0x7f3208153bc0 2024-04-17T19:47:13.411 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:13.422+0000 7f320de00640 1 --2- 172.21.15.44:0/519297347 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f31ec0683b0 0x7f31ec06a8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:13.412 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:13.422+0000 7f320de00640 1 --2- 172.21.15.44:0/519297347 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f31ec0683b0 0x7f31ec06a8c0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f31fc009ac0 tx=0x7f31fc009190 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:47:13.415 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:13.426+0000 7f3202000640 1 -- 172.21.15.44:0/519297347 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f31f80187f0 con 0x7f3208153bc0 2024-04-17T19:47:13.581 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:13.590+0000 7f3210800640 1 -- 172.21.15.44:0/519297347 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f32080c44e0 con 0x7f3208153bc0 2024-04-17T19:47:13.581 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:13.590+0000 7f3202000640 1 -- 172.21.15.44:0/519297347 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v25) ==== 104+0+11 (secure 0 0 0) 0x7f31f80f3030 con 0x7f3208153bc0 2024-04-17T19:47:13.581 INFO:teuthology.orchestra.run.smithi044.stdout:pg_num: 32 2024-04-17T19:47:13.583 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:13.594+0000 7f3210800640 1 -- 172.21.15.44:0/519297347 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f31ec0683b0 msgr2=0x7f31ec06a8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:13.584 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:13.594+0000 7f3210800640 1 --2- 172.21.15.44:0/519297347 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f31ec0683b0 0x7f31ec06a8c0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f31fc009ac0 tx=0x7f31fc009190 comp rx=0 tx=0).stop 2024-04-17T19:47:13.584 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:13.594+0000 7f3210800640 1 -- 172.21.15.44:0/519297347 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3208153bc0 msgr2=0x7f32081f0ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:13.584 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:13.594+0000 7f3210800640 1 --2- 172.21.15.44:0/519297347 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3208153bc0 0x7f32081f0ce0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f31f801c8c0 tx=0x7f31f801ba30 comp rx=0 tx=0).stop 2024-04-17T19:47:13.584 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:13.594+0000 7f3210800640 1 -- 172.21.15.44:0/519297347 shutdown_connections 2024-04-17T19:47:13.584 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:13.594+0000 7f3210800640 1 --2- 172.21.15.44:0/519297347 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f31ec0683b0 0x7f31ec06a8c0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:13.584 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:13.594+0000 7f3210800640 1 --2- 172.21.15.44:0/519297347 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f3208159f10 0x7f32081e3640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:13.584 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:13.594+0000 7f3210800640 1 --2- 172.21.15.44:0/519297347 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3208153bc0 0x7f32081f0ce0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:13.584 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:13.594+0000 7f3210800640 1 --2- 172.21.15.44:0/519297347 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f32080c7290 0x7f3208152220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:13.584 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:13.594+0000 7f3210800640 1 -- 172.21.15.44:0/519297347 >> 172.21.15.44:0/519297347 conn(0x7f3208071900 msgr2=0x7f320814e850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:47:13.584 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:13.594+0000 7f3210800640 1 -- 172.21.15.44:0/519297347 shutdown_connections 2024-04-17T19:47:13.584 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:13.594+0000 7f3210800640 1 -- 172.21.15.44:0/519297347 wait complete. 2024-04-17T19:47:13.603 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-17T19:47:13.758 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:13.766+0000 7fb9ad000640 1 Processor -- start 2024-04-17T19:47:13.758 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:13.766+0000 7fb9ad000640 1 -- start start 2024-04-17T19:47:13.759 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:13.770+0000 7fb9ad000640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fb9a80c41b0 0x7fb9a8153a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:13.759 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:13.770+0000 7fb9ad000640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fb9a815a340 0x7fb9a8164060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:13.760 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:13.770+0000 7fb9ad000640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb9a80ca3e0 con 0x7fb9a8159f30 2024-04-17T19:47:13.760 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:13.770+0000 7fb9ad000640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 -- 0x7fb9a80ca650 con 0x7fb9a80c41b0 2024-04-17T19:47:13.760 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:13.770+0000 7fb9ad000640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7fb9a80ca930 con 0x7fb9a815a340 2024-04-17T19:47:13.760 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:13.770+0000 7fb9a7e00640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fb9a815a340 0x7fb9a8164060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:13.760 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:13.770+0000 7fb9a7400640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fb9a80c41b0 0x7fb9a8153a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:13.760 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:13.770+0000 7fb99fe00640 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7fb9a8159f30 0x7fb9a80cb9b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.44:46114/0 (socket says 172.21.15.44:46114) 2024-04-17T19:47:13.760 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:13.770+0000 7fb99fe00640 1 -- 172.21.15.44:0/2730495246 learned_addr learned my addr 172.21.15.44:0/2730495246 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-04-17T19:47:13.761 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:13.770+0000 7fb9a6a00640 1 -- 172.21.15.44:0/2730495246 <== mon.1 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1847990948 0 0) 0x7fb9a80ca3e0 con 0x7fb9a8159f30 2024-04-17T19:47:13.761 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:13.770+0000 7fb9a6a00640 1 -- 172.21.15.44:0/2730495246 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb98c003530 con 0x7fb9a8159f30 2024-04-17T19:47:13.761 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:13.770+0000 7fb9a7e00640 1 -- 172.21.15.44:0/2730495246 >> v2:172.21.15.62:3300/0 conn(0x7fb9a80c41b0 msgr2=0x7fb9a8153a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T19:47:13.761 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:13.770+0000 7fb9a7e00640 1 --2- 172.21.15.44:0/2730495246 >> v2:172.21.15.62:3300/0 conn(0x7fb9a80c41b0 0x7fb9a8153a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:13.761 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:13.770+0000 7fb9a7e00640 1 -- 172.21.15.44:0/2730495246 >> v1:172.21.15.62:6789/0 conn(0x7fb9a8159f30 legacy=0x7fb9a80cb9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:13.761 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:13.770+0000 7fb9a7e00640 1 -- 172.21.15.44:0/2730495246 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb9a8159a10 con 0x7fb9a815a340 2024-04-17T19:47:13.761 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:13.770+0000 7fb9a7400640 1 --2- 172.21.15.44:0/2730495246 >> v2:172.21.15.62:3300/0 conn(0x7fb9a80c41b0 0x7fb9a8153a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-17T19:47:13.764 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:13.774+0000 7fb9a7e00640 1 --2- 172.21.15.44:0/2730495246 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fb9a815a340 0x7fb9a8164060 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fb9a0009d90 tx=0x7fb9a001f150 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f962d12fa79fd9d2 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:47:13.764 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:13.774+0000 7fb9a6a00640 1 -- 172.21.15.44:0/2730495246 <== mon.2 v2:172.21.15.62:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9a00b4070 con 0x7fb9a815a340 2024-04-17T19:47:13.764 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:13.774+0000 7fb9a6a00640 1 -- 172.21.15.44:0/2730495246 <== mon.2 v2:172.21.15.62:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb9a00af600 con 0x7fb9a815a340 2024-04-17T19:47:13.764 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:13.774+0000 7fb9a6a00640 1 -- 172.21.15.44:0/2730495246 <== mon.2 v2:172.21.15.62:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9a00af9d0 con 0x7fb9a815a340 2024-04-17T19:47:13.765 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:13.774+0000 7fb9ad000640 1 -- 172.21.15.44:0/2730495246 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fb9a815a340 msgr2=0x7fb9a8164060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:13.765 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:13.774+0000 7fb9ad000640 1 --2- 172.21.15.44:0/2730495246 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fb9a815a340 0x7fb9a8164060 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fb9a0009d90 tx=0x7fb9a001f150 comp rx=0 tx=0).stop 2024-04-17T19:47:13.765 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:13.774+0000 7fb9ad000640 1 -- 172.21.15.44:0/2730495246 shutdown_connections 2024-04-17T19:47:13.765 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:13.774+0000 7fb9ad000640 1 --2- 172.21.15.44:0/2730495246 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fb9a815a340 0x7fb9a8164060 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:13.766 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:13.774+0000 7fb9ad000640 1 --2- 172.21.15.44:0/2730495246 >> v2:172.21.15.62:3300/0 conn(0x7fb9a80c41b0 0x7fb9a8153a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:13.766 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:13.774+0000 7fb9ad000640 1 -- 172.21.15.44:0/2730495246 >> 172.21.15.44:0/2730495246 conn(0x7fb9a8072320 msgr2=0x7fb9a8072730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:47:13.766 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:13.774+0000 7fb9ad000640 1 -- 172.21.15.44:0/2730495246 shutdown_connections 2024-04-17T19:47:13.766 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:13.774+0000 7fb9ad000640 1 -- 172.21.15.44:0/2730495246 wait complete. 2024-04-17T19:47:13.768 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:13.778+0000 7fb9ad000640 1 Processor -- start 2024-04-17T19:47:13.768 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:13.778+0000 7fb9ad000640 1 -- start start 2024-04-17T19:47:13.770 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:13.778+0000 7fb9ad000640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb9a80c41b0 0x7fb9a81e4ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:13.770 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:13.778+0000 7fb9ad000640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fb9a8159f30 0x7fb9a81f25a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:13.770 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:13.778+0000 7fb9ad000640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb9a815a340 0x7fb9a815aa70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:13.770 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:13.778+0000 7fb9ad000640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fb9a80c4890 con 0x7fb9a80c41b0 2024-04-17T19:47:13.770 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:13.778+0000 7fb9ad000640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7fb9a81596e0 con 0x7fb9a815a340 2024-04-17T19:47:13.770 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:13.778+0000 7fb9ad000640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7fb9a80cc0c0 con 0x7fb9a8159f30 2024-04-17T19:47:13.770 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:13.778+0000 7fb9a7400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb9a80c41b0 0x7fb9a81e4ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:13.770 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:13.778+0000 7fb9a7400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb9a80c41b0 0x7fb9a81e4ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:42700/0 (socket says 172.21.15.44:42700) 2024-04-17T19:47:13.770 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:13.778+0000 7fb9a7400640 1 -- 172.21.15.44:0/3328134286 learned_addr learned my addr 172.21.15.44:0/3328134286 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-04-17T19:47:13.770 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:13.778+0000 7fb99fe00640 1 --2- 172.21.15.44:0/3328134286 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fb9a8159f30 0x7fb9a81f25a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:13.770 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:13.778+0000 7fb9a7e00640 1 --2- 172.21.15.44:0/3328134286 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb9a815a340 0x7fb9a815aa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:13.771 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:13.778+0000 7fb9a7400640 1 -- 172.21.15.44:0/3328134286 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fb9a8159f30 msgr2=0x7fb9a81f25a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:13.771 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:13.778+0000 7fb9a7400640 1 --2- 172.21.15.44:0/3328134286 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fb9a8159f30 0x7fb9a81f25a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:13.771 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:13.778+0000 7fb9a7400640 1 -- 172.21.15.44:0/3328134286 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb9a815a340 msgr2=0x7fb9a815aa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:13.771 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:13.778+0000 7fb9a7400640 1 --2- 172.21.15.44:0/3328134286 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb9a815a340 0x7fb9a815aa70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:13.771 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:13.778+0000 7fb9a7400640 1 -- 172.21.15.44:0/3328134286 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb9a806ed50 con 0x7fb9a80c41b0 2024-04-17T19:47:13.772 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:13.782+0000 7fb9a7400640 1 --2- 172.21.15.44:0/3328134286 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb9a80c41b0 0x7fb9a81e4ad0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fb99800e9b0 tx=0x7fb99800ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:47:13.772 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:13.782+0000 7fb99f400640 1 -- 172.21.15.44:0/3328134286 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb998017070 con 0x7fb9a80c41b0 2024-04-17T19:47:13.772 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:13.782+0000 7fb99f400640 1 -- 172.21.15.44:0/3328134286 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb99800ca00 con 0x7fb9a80c41b0 2024-04-17T19:47:13.772 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:13.782+0000 7fb99f400640 1 -- 172.21.15.44:0/3328134286 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb99800cdd0 con 0x7fb9a80c41b0 2024-04-17T19:47:13.772 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:13.782+0000 7fb9ad000640 1 -- 172.21.15.44:0/3328134286 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb9a81e3ff0 con 0x7fb9a80c41b0 2024-04-17T19:47:13.772 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:13.782+0000 7fb9ad000640 1 -- 172.21.15.44:0/3328134286 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb9a815afb0 con 0x7fb9a80c41b0 2024-04-17T19:47:13.772 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:13.782+0000 7fb9ad000640 1 -- 172.21.15.44:0/3328134286 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb9a804fea0 con 0x7fb9a80c41b0 2024-04-17T19:47:13.772 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:13.782+0000 7fb99f400640 1 -- 172.21.15.44:0/3328134286 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fb99801a070 con 0x7fb9a80c41b0 2024-04-17T19:47:13.773 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:13.782+0000 7fb99f400640 1 --2- 172.21.15.44:0/3328134286 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7fb9840683b0 0x7fb98406a8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:13.773 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:13.782+0000 7fb99f400640 1 -- 172.21.15.44:0/3328134286 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fb998086fa0 con 0x7fb9a80c41b0 2024-04-17T19:47:13.774 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:13.782+0000 7fb99fe00640 1 --2- 172.21.15.44:0/3328134286 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7fb9840683b0 0x7fb98406a8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:13.774 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:13.786+0000 7fb99fe00640 1 --2- 172.21.15.44:0/3328134286 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7fb9840683b0 0x7fb98406a8c0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fb9a81e6b90 tx=0x7fb990009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:47:13.777 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:13.786+0000 7fb99f400640 1 -- 172.21.15.44:0/3328134286 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fb998057180 con 0x7fb9a80c41b0 2024-04-17T19:47:13.942 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:13.950+0000 7fb9ad000640 1 -- 172.21.15.44:0/3328134286 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7fb9a80b21d0 con 0x7fb9a80c41b0 2024-04-17T19:47:13.942 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:13.954+0000 7fb99f400640 1 -- 172.21.15.44:0/3328134286 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v25) ==== 100+0+11 (secure 0 0 0) 0x7fb998056a80 con 0x7fb9a80c41b0 2024-04-17T19:47:13.942 INFO:teuthology.orchestra.run.smithi044.stdout:pg_num: 64 2024-04-17T19:47:13.944 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:13.954+0000 7fb9ad000640 1 -- 172.21.15.44:0/3328134286 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7fb9840683b0 msgr2=0x7fb98406a8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:13.944 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:13.954+0000 7fb9ad000640 1 --2- 172.21.15.44:0/3328134286 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7fb9840683b0 0x7fb98406a8c0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fb9a81e6b90 tx=0x7fb990009040 comp rx=0 tx=0).stop 2024-04-17T19:47:13.945 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:13.954+0000 7fb9ad000640 1 -- 172.21.15.44:0/3328134286 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb9a80c41b0 msgr2=0x7fb9a81e4ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:13.945 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:13.954+0000 7fb9ad000640 1 --2- 172.21.15.44:0/3328134286 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb9a80c41b0 0x7fb9a81e4ad0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fb99800e9b0 tx=0x7fb99800ee70 comp rx=0 tx=0).stop 2024-04-17T19:47:13.945 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:13.954+0000 7fb9ad000640 1 -- 172.21.15.44:0/3328134286 shutdown_connections 2024-04-17T19:47:13.945 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:13.954+0000 7fb9ad000640 1 --2- 172.21.15.44:0/3328134286 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7fb9840683b0 0x7fb98406a8c0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:13.945 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:13.954+0000 7fb9ad000640 1 --2- 172.21.15.44:0/3328134286 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fb9a8159f30 0x7fb9a81f25a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:13.945 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:13.954+0000 7fb9ad000640 1 --2- 172.21.15.44:0/3328134286 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb9a815a340 0x7fb9a815aa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:13.945 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:13.954+0000 7fb9ad000640 1 --2- 172.21.15.44:0/3328134286 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb9a80c41b0 0x7fb9a81e4ad0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:13.945 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:13.954+0000 7fb9ad000640 1 -- 172.21.15.44:0/3328134286 >> 172.21.15.44:0/3328134286 conn(0x7fb9a8072320 msgr2=0x7fb9a80c9000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:47:13.945 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:13.954+0000 7fb9ad000640 1 -- 172.21.15.44:0/3328134286 shutdown_connections 2024-04-17T19:47:13.945 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:13.954+0000 7fb9ad000640 1 -- 172.21.15.44:0/3328134286 wait complete. 2024-04-17T19:47:13.964 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-04-17T19:47:14.119 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:14.130+0000 7f04d2600640 1 Processor -- start 2024-04-17T19:47:14.119 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:14.130+0000 7f04d2600640 1 -- start start 2024-04-17T19:47:14.121 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:14.130+0000 7f04d2600640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f04cc152860 0x7f04cc0c68b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:14.121 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:14.130+0000 7f04d2600640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f04cc159140 0x7f04cc0c47e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:14.121 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:14.130+0000 7f04d2600640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f04cc0c4000 con 0x7f04cc0c4d20 2024-04-17T19:47:14.121 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:14.130+0000 7f04d2600640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 -- 0x7f04cc0c6eb0 con 0x7f04cc159140 2024-04-17T19:47:14.121 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:14.130+0000 7f04d2600640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 -- 0x7f04cc0c78e0 con 0x7f04cc152860 2024-04-17T19:47:14.121 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:14.130+0000 7f04caa00640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f04cc159140 0x7f04cc0c47e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:14.121 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:14.130+0000 7f04caa00640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f04cc159140 0x7f04cc0c47e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:42704/0 (socket says 172.21.15.44:42704) 2024-04-17T19:47:14.121 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:14.130+0000 7f04caa00640 1 -- 172.21.15.44:0/3301537227 learned_addr learned my addr 172.21.15.44:0/3301537227 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-04-17T19:47:14.121 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:14.130+0000 7f04cb400640 1 --2- 172.21.15.44:0/3301537227 >> v2:172.21.15.62:3300/0 conn(0x7f04cc152860 0x7f04cc0c68b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:14.122 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:14.130+0000 7f04caa00640 1 -- 172.21.15.44:0/3301537227 >> v2:172.21.15.62:3300/0 conn(0x7f04cc152860 msgr2=0x7f04cc0c68b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T19:47:14.122 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:14.130+0000 7f04caa00640 1 --2- 172.21.15.44:0/3301537227 >> v2:172.21.15.62:3300/0 conn(0x7f04cc152860 0x7f04cc0c68b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:14.122 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:14.130+0000 7f04caa00640 1 -- 172.21.15.44:0/3301537227 >> v1:172.21.15.62:6789/0 conn(0x7f04cc0c4d20 legacy=0x7f04cc0c80a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:14.122 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:14.130+0000 7f04caa00640 1 -- 172.21.15.44:0/3301537227 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f04cc0c42e0 con 0x7f04cc159140 2024-04-17T19:47:14.124 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:14.134+0000 7f04caa00640 1 --2- 172.21.15.44:0/3301537227 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f04cc159140 0x7f04cc0c47e0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f04cc06cc70 tx=0x7f04b801c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=84f79fd1266044f server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:47:14.124 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:14.134+0000 7f04ca000640 1 -- 172.21.15.44:0/3301537227 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04b80b0070 con 0x7f04cc159140 2024-04-17T19:47:14.124 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:14.134+0000 7f04ca000640 1 -- 172.21.15.44:0/3301537227 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f04b80ab600 con 0x7f04cc159140 2024-04-17T19:47:14.125 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:14.134+0000 7f04ca000640 1 -- 172.21.15.44:0/3301537227 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04b80ab9d0 con 0x7f04cc159140 2024-04-17T19:47:14.125 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:14.134+0000 7f04d2600640 1 -- 172.21.15.44:0/3301537227 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f04cc159140 msgr2=0x7f04cc0c47e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:14.125 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:14.134+0000 7f04d2600640 1 --2- 172.21.15.44:0/3301537227 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f04cc159140 0x7f04cc0c47e0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f04cc06cc70 tx=0x7f04b801c490 comp rx=0 tx=0).stop 2024-04-17T19:47:14.125 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:14.134+0000 7f04d2600640 1 -- 172.21.15.44:0/3301537227 shutdown_connections 2024-04-17T19:47:14.125 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:14.134+0000 7f04d2600640 1 --2- 172.21.15.44:0/3301537227 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f04cc159140 0x7f04cc0c47e0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:14.126 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:14.134+0000 7f04d2600640 1 --2- 172.21.15.44:0/3301537227 >> v2:172.21.15.62:3300/0 conn(0x7f04cc152860 0x7f04cc0c68b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:14.126 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:14.134+0000 7f04d2600640 1 -- 172.21.15.44:0/3301537227 >> 172.21.15.44:0/3301537227 conn(0x7f04cc06c380 msgr2=0x7f04cc070080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:47:14.126 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:14.134+0000 7f04d2600640 1 -- 172.21.15.44:0/3301537227 shutdown_connections 2024-04-17T19:47:14.126 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:14.134+0000 7f04d2600640 1 -- 172.21.15.44:0/3301537227 wait complete. 2024-04-17T19:47:14.127 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:14.138+0000 7f04d2600640 1 Processor -- start 2024-04-17T19:47:14.127 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:14.138+0000 7f04d2600640 1 -- start start 2024-04-17T19:47:14.130 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:14.138+0000 7f04d2600640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f04cc0c4d20 0x7f04cc146ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:14.131 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:14.138+0000 7f04d2600640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f04cc152860 0x7f04cc1f3360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:14.131 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:14.138+0000 7f04d2600640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f04cc159140 0x7f04cc0cba70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:14.131 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:14.138+0000 7f04d2600640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f04cc0c5130 con 0x7f04cc0c4d20 2024-04-17T19:47:14.131 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:14.138+0000 7f04d2600640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f04cc163850 con 0x7f04cc159140 2024-04-17T19:47:14.131 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:14.138+0000 7f04d2600640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7f04cc1639d0 con 0x7f04cc152860 2024-04-17T19:47:14.131 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:14.138+0000 7f04cb400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f04cc0c4d20 0x7f04cc146ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:14.131 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:14.138+0000 7f04cb400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f04cc0c4d20 0x7f04cc146ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:42706/0 (socket says 172.21.15.44:42706) 2024-04-17T19:47:14.131 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:14.138+0000 7f04cb400640 1 -- 172.21.15.44:0/2413364178 learned_addr learned my addr 172.21.15.44:0/2413364178 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-04-17T19:47:14.131 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:14.138+0000 7f04caa00640 1 --2- 172.21.15.44:0/2413364178 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f04cc152860 0x7f04cc1f3360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:14.131 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:14.138+0000 7f04cbe00640 1 --2- 172.21.15.44:0/2413364178 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f04cc159140 0x7f04cc0cba70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:14.131 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:14.138+0000 7f04cb400640 1 -- 172.21.15.44:0/2413364178 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f04cc152860 msgr2=0x7f04cc1f3360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:14.131 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:14.138+0000 7f04cb400640 1 --2- 172.21.15.44:0/2413364178 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f04cc152860 0x7f04cc1f3360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:14.131 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:14.138+0000 7f04cb400640 1 -- 172.21.15.44:0/2413364178 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f04cc159140 msgr2=0x7f04cc0cba70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:14.132 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:14.138+0000 7f04cb400640 1 --2- 172.21.15.44:0/2413364178 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f04cc159140 0x7f04cc0cba70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:14.132 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:14.138+0000 7f04cb400640 1 -- 172.21.15.44:0/2413364178 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f04cc156650 con 0x7f04cc0c4d20 2024-04-17T19:47:14.132 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:14.138+0000 7f04cbe00640 1 --2- 172.21.15.44:0/2413364178 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f04cc159140 0x7f04cc0cba70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-17T19:47:14.132 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:14.138+0000 7f04cb400640 1 --2- 172.21.15.44:0/2413364178 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f04cc0c4d20 0x7f04cc146ea0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f04bc00e8a0 tx=0x7f04bc00eca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:47:14.132 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:14.142+0000 7f04c3400640 1 -- 172.21.15.44:0/2413364178 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04bc017070 con 0x7f04cc0c4d20 2024-04-17T19:47:14.132 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:14.142+0000 7f04c3400640 1 -- 172.21.15.44:0/2413364178 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f04bc00c940 con 0x7f04cc0c4d20 2024-04-17T19:47:14.132 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:14.142+0000 7f04c3400640 1 -- 172.21.15.44:0/2413364178 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04bc00ccf0 con 0x7f04cc0c4d20 2024-04-17T19:47:14.132 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:14.142+0000 7f04d2600640 1 -- 172.21.15.44:0/2413364178 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f04cc1473e0 con 0x7f04cc0c4d20 2024-04-17T19:47:14.132 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:14.142+0000 7f04d2600640 1 -- 172.21.15.44:0/2413364178 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f04cc149ff0 con 0x7f04cc0c4d20 2024-04-17T19:47:14.133 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:14.142+0000 7f04d2600640 1 -- 172.21.15.44:0/2413364178 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f04cc04ff10 con 0x7f04cc0c4d20 2024-04-17T19:47:14.133 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:14.142+0000 7f04c3400640 1 -- 172.21.15.44:0/2413364178 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f04bc01a070 con 0x7f04cc0c4d20 2024-04-17T19:47:14.134 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:14.142+0000 7f04c3400640 1 --2- 172.21.15.44:0/2413364178 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f04ac068380 0x7f04ac06a890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:14.134 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:14.142+0000 7f04c3400640 1 -- 172.21.15.44:0/2413364178 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f04bc086b80 con 0x7f04cc0c4d20 2024-04-17T19:47:14.134 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:14.146+0000 7f04caa00640 1 --2- 172.21.15.44:0/2413364178 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f04ac068380 0x7f04ac06a890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:14.135 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:14.146+0000 7f04caa00640 1 --2- 172.21.15.44:0/2413364178 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f04ac068380 0x7f04ac06a890 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f04b80ad000 tx=0x7f04b8008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:47:14.138 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:14.150+0000 7f04c3400640 1 -- 172.21.15.44:0/2413364178 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f04bc0567b0 con 0x7f04cc0c4d20 2024-04-17T19:47:14.306 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:14.314+0000 7f04d2600640 1 -- 172.21.15.44:0/2413364178 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) -- 0x7f04cc0c7e80 con 0x7f04cc0c4d20 2024-04-17T19:47:14.306 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:14.318+0000 7f04c3400640 1 -- 172.21.15.44:0/2413364178 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v25) ==== 103+0+11 (secure 0 0 0) 0x7f04bc05aab0 con 0x7f04cc0c4d20 2024-04-17T19:47:14.306 INFO:teuthology.orchestra.run.smithi044.stdout:pg_num: 32 2024-04-17T19:47:14.309 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:14.318+0000 7f04d2600640 1 -- 172.21.15.44:0/2413364178 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f04ac068380 msgr2=0x7f04ac06a890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:14.309 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:14.318+0000 7f04d2600640 1 --2- 172.21.15.44:0/2413364178 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f04ac068380 0x7f04ac06a890 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f04b80ad000 tx=0x7f04b8008040 comp rx=0 tx=0).stop 2024-04-17T19:47:14.309 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:14.318+0000 7f04d2600640 1 -- 172.21.15.44:0/2413364178 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f04cc0c4d20 msgr2=0x7f04cc146ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:14.309 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:14.318+0000 7f04d2600640 1 --2- 172.21.15.44:0/2413364178 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f04cc0c4d20 0x7f04cc146ea0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f04bc00e8a0 tx=0x7f04bc00eca0 comp rx=0 tx=0).stop 2024-04-17T19:47:14.309 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:14.318+0000 7f04d2600640 1 -- 172.21.15.44:0/2413364178 shutdown_connections 2024-04-17T19:47:14.309 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:14.318+0000 7f04d2600640 1 --2- 172.21.15.44:0/2413364178 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f04ac068380 0x7f04ac06a890 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:14.309 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:14.318+0000 7f04d2600640 1 --2- 172.21.15.44:0/2413364178 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f04cc152860 0x7f04cc1f3360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:14.309 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:14.318+0000 7f04d2600640 1 --2- 172.21.15.44:0/2413364178 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f04cc159140 0x7f04cc0cba70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:14.309 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:14.318+0000 7f04d2600640 1 --2- 172.21.15.44:0/2413364178 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f04cc0c4d20 0x7f04cc146ea0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:14.309 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:14.318+0000 7f04d2600640 1 -- 172.21.15.44:0/2413364178 >> 172.21.15.44:0/2413364178 conn(0x7f04cc06c380 msgr2=0x7f04cc0c80a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:47:14.309 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:14.318+0000 7f04d2600640 1 -- 172.21.15.44:0/2413364178 shutdown_connections 2024-04-17T19:47:14.309 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:14.318+0000 7f04d2600640 1 -- 172.21.15.44:0/2413364178 wait complete. 2024-04-17T19:47:14.328 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-17T19:47:14.480 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:14.490+0000 7f1867000640 1 Processor -- start 2024-04-17T19:47:14.480 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:14.490+0000 7f1867000640 1 -- start start 2024-04-17T19:47:14.482 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:14.490+0000 7f1867000640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f1860153a00 0x7f18600cb9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:14.482 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:14.490+0000 7f1867000640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f18600cbef0 0x7f1860164060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:14.482 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:14.490+0000 7f1867000640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f18600ca3e0 con 0x7f18600c41b0 2024-04-17T19:47:14.482 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:14.490+0000 7f1867000640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 -- 0x7f1860153e10 con 0x7f1860153a00 2024-04-17T19:47:14.482 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:14.490+0000 7f1867000640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7f18600ca650 con 0x7f18600cbef0 2024-04-17T19:47:14.482 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:14.490+0000 7f1865200640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f1860153a00 0x7f18600cb9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:14.482 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:14.490+0000 7f1865200640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f1860153a00 0x7f18600cb9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:42722/0 (socket says 172.21.15.44:42722) 2024-04-17T19:47:14.482 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:14.490+0000 7f1865200640 1 -- 172.21.15.44:0/2871925442 learned_addr learned my addr 172.21.15.44:0/2871925442 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-04-17T19:47:14.482 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:14.490+0000 7f1866600640 1 --2- 172.21.15.44:0/2871925442 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f18600cbef0 0x7f1860164060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:14.483 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:14.494+0000 7f1865200640 1 -- 172.21.15.44:0/2871925442 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f18600cbef0 msgr2=0x7f1860164060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T19:47:14.483 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:14.494+0000 7f1865200640 1 --2- 172.21.15.44:0/2871925442 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f18600cbef0 0x7f1860164060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:14.483 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:14.494+0000 7f1865200640 1 -- 172.21.15.44:0/2871925442 >> v1:172.21.15.62:6789/0 conn(0x7f18600c41b0 legacy=0x7f1860159f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:14.483 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:14.494+0000 7f1865200640 1 -- 172.21.15.44:0/2871925442 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f186015a640 con 0x7f1860153a00 2024-04-17T19:47:14.485 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:14.494+0000 7f1865200640 1 --2- 172.21.15.44:0/2871925442 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1860153a00 0x7f18600cb9b0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f184c009870 tx=0x7f184c01ed50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=642f9823509d9220 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:47:14.486 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:14.494+0000 7f185fe00640 1 -- 172.21.15.44:0/2871925442 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f184c0b5070 con 0x7f1860153a00 2024-04-17T19:47:14.486 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:14.494+0000 7f185fe00640 1 -- 172.21.15.44:0/2871925442 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f184c0a8a50 con 0x7f1860153a00 2024-04-17T19:47:14.486 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:14.494+0000 7f185fe00640 1 -- 172.21.15.44:0/2871925442 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f184c0a8e20 con 0x7f1860153a00 2024-04-17T19:47:14.486 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:14.498+0000 7f1867000640 1 -- 172.21.15.44:0/2871925442 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1860153a00 msgr2=0x7f18600cb9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:14.486 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:14.498+0000 7f1867000640 1 --2- 172.21.15.44:0/2871925442 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1860153a00 0x7f18600cb9b0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f184c009870 tx=0x7f184c01ed50 comp rx=0 tx=0).stop 2024-04-17T19:47:14.487 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:14.498+0000 7f1867000640 1 -- 172.21.15.44:0/2871925442 shutdown_connections 2024-04-17T19:47:14.487 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:14.498+0000 7f1867000640 1 --2- 172.21.15.44:0/2871925442 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f18600cbef0 0x7f1860164060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:14.487 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:14.498+0000 7f1867000640 1 --2- 172.21.15.44:0/2871925442 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1860153a00 0x7f18600cb9b0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:14.487 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:14.498+0000 7f1867000640 1 -- 172.21.15.44:0/2871925442 >> 172.21.15.44:0/2871925442 conn(0x7f1860072320 msgr2=0x7f1860072730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:47:14.487 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:14.498+0000 7f1867000640 1 -- 172.21.15.44:0/2871925442 shutdown_connections 2024-04-17T19:47:14.487 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:14.498+0000 7f1867000640 1 -- 172.21.15.44:0/2871925442 wait complete. 2024-04-17T19:47:14.488 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:14.498+0000 7f1867000640 1 Processor -- start 2024-04-17T19:47:14.488 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:14.498+0000 7f1867000640 1 -- start start 2024-04-17T19:47:14.490 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:14.498+0000 7f1867000640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f18600c41b0 0x7f18601f5aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:14.490 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:14.498+0000 7f1867000640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f18600cbef0 0x7f186006e6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:14.490 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:14.498+0000 7f1867000640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1860153a00 0x7f186015b2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:14.490 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:14.498+0000 7f1867000640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f186015dbb0 con 0x7f1860153a00 2024-04-17T19:47:14.490 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:14.498+0000 7f1867000640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f1860159a10 con 0x7f18600c41b0 2024-04-17T19:47:14.490 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:14.498+0000 7f1867000640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7f18601596e0 con 0x7f18600cbef0 2024-04-17T19:47:14.491 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:14.502+0000 7f1866600640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1860153a00 0x7f186015b2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:14.492 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:14.502+0000 7f1866600640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1860153a00 0x7f186015b2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:42724/0 (socket says 172.21.15.44:42724) 2024-04-17T19:47:14.492 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:14.502+0000 7f1866600640 1 -- 172.21.15.44:0/3411156195 learned_addr learned my addr 172.21.15.44:0/3411156195 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-04-17T19:47:14.492 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:14.502+0000 7f1865200640 1 --2- 172.21.15.44:0/3411156195 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f18600cbef0 0x7f186006e6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:14.492 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:14.502+0000 7f1865c00640 1 --2- 172.21.15.44:0/3411156195 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f18600c41b0 0x7f18601f5aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:14.492 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:14.502+0000 7f1866600640 1 -- 172.21.15.44:0/3411156195 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f18600cbef0 msgr2=0x7f186006e6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:14.492 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:14.502+0000 7f1866600640 1 --2- 172.21.15.44:0/3411156195 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f18600cbef0 0x7f186006e6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:14.492 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:14.502+0000 7f1866600640 1 -- 172.21.15.44:0/3411156195 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f18600c41b0 msgr2=0x7f18601f5aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:14.492 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:14.502+0000 7f1866600640 1 --2- 172.21.15.44:0/3411156195 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f18600c41b0 0x7f18601f5aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:14.492 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:14.502+0000 7f1866600640 1 -- 172.21.15.44:0/3411156195 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f186006ec30 con 0x7f1860153a00 2024-04-17T19:47:14.492 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:14.502+0000 7f1866600640 1 --2- 172.21.15.44:0/3411156195 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1860153a00 0x7f186015b2f0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f1858007e60 tx=0x7f185800e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:47:14.492 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:14.502+0000 7f185d600640 1 -- 172.21.15.44:0/3411156195 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1858014420 con 0x7f1860153a00 2024-04-17T19:47:14.492 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:14.502+0000 7f185d600640 1 -- 172.21.15.44:0/3411156195 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1858019070 con 0x7f1860153a00 2024-04-17T19:47:14.492 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:14.502+0000 7f185d600640 1 -- 172.21.15.44:0/3411156195 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1858014820 con 0x7f1860153a00 2024-04-17T19:47:14.492 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:14.502+0000 7f1867000640 1 -- 172.21.15.44:0/3411156195 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f186015b830 con 0x7f1860153a00 2024-04-17T19:47:14.492 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:14.502+0000 7f1867000640 1 -- 172.21.15.44:0/3411156195 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1860151ab0 con 0x7f1860153a00 2024-04-17T19:47:14.493 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:14.502+0000 7f1867000640 1 -- 172.21.15.44:0/3411156195 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f186004fea0 con 0x7f1860153a00 2024-04-17T19:47:14.494 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:14.502+0000 7f185d600640 1 -- 172.21.15.44:0/3411156195 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f18580149c0 con 0x7f1860153a00 2024-04-17T19:47:14.495 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:14.506+0000 7f185d600640 1 --2- 172.21.15.44:0/3411156195 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f1840068380 0x7f184006a890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:14.495 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:14.506+0000 7f185d600640 1 -- 172.21.15.44:0/3411156195 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f1858087520 con 0x7f1860153a00 2024-04-17T19:47:14.495 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:14.506+0000 7f1865c00640 1 --2- 172.21.15.44:0/3411156195 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f1840068380 0x7f184006a890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:14.496 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:14.506+0000 7f1865c00640 1 --2- 172.21.15.44:0/3411156195 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f1840068380 0x7f184006a890 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f1854007fd0 tx=0x7f1854009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:47:14.499 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:14.510+0000 7f185d600640 1 -- 172.21.15.44:0/3411156195 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f186006ec30 con 0x7f1860153a00 2024-04-17T19:47:14.679 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:14.690+0000 7f1867000640 1 -- 172.21.15.44:0/3411156195 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f18600cac30 con 0x7f1860153a00 2024-04-17T19:47:14.680 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:14.690+0000 7f185d600640 1 -- 172.21.15.44:0/3411156195 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v25) ==== 80+0+0 (secure 0 0 0) 0x7f18580570a0 con 0x7f1860153a00 2024-04-17T19:47:14.680 INFO:teuthology.orchestra.run.smithi044.stderr:listed 0 entries 2024-04-17T19:47:14.683 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:14.690+0000 7f1867000640 1 -- 172.21.15.44:0/3411156195 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f1840068380 msgr2=0x7f184006a890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:14.683 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:14.690+0000 7f1867000640 1 --2- 172.21.15.44:0/3411156195 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f1840068380 0x7f184006a890 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f1854007fd0 tx=0x7f1854009040 comp rx=0 tx=0).stop 2024-04-17T19:47:14.683 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:14.690+0000 7f1867000640 1 -- 172.21.15.44:0/3411156195 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1860153a00 msgr2=0x7f186015b2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:14.683 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:14.690+0000 7f1867000640 1 --2- 172.21.15.44:0/3411156195 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1860153a00 0x7f186015b2f0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f1858007e60 tx=0x7f185800e4b0 comp rx=0 tx=0).stop 2024-04-17T19:47:14.683 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:14.690+0000 7f1867000640 1 -- 172.21.15.44:0/3411156195 shutdown_connections 2024-04-17T19:47:14.683 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:14.690+0000 7f1867000640 1 --2- 172.21.15.44:0/3411156195 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f1840068380 0x7f184006a890 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:14.683 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:14.690+0000 7f1867000640 1 --2- 172.21.15.44:0/3411156195 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f18600cbef0 0x7f186006e6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:14.683 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:14.690+0000 7f1867000640 1 --2- 172.21.15.44:0/3411156195 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1860153a00 0x7f186015b2f0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:14.683 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:14.690+0000 7f1867000640 1 --2- 172.21.15.44:0/3411156195 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f18600c41b0 0x7f18601f5aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:14.684 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:14.690+0000 7f1867000640 1 -- 172.21.15.44:0/3411156195 >> 172.21.15.44:0/3411156195 conn(0x7f1860072320 msgr2=0x7f1860149a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:47:14.684 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:14.690+0000 7f1867000640 1 -- 172.21.15.44:0/3411156195 shutdown_connections 2024-04-17T19:47:14.684 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:14.690+0000 7f1867000640 1 -- 172.21.15.44:0/3411156195 wait complete. 2024-04-17T19:47:14.702 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi044.front.sepia.ceph.com... 2024-04-17T19:47:14.702 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-17T19:47:14.702 DEBUG:teuthology.orchestra.run.smithi044:> sudo fusermount -u /home/ubuntu/cephtest/mnt.admin 2024-04-17T19:47:14.726 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi044.stderr:ceph-fuse[32146]: fuse finished with error 0 and tester_r 0 2024-04-17T19:47:14.730 INFO:teuthology.orchestra.run:waiting for 300 2024-04-17T19:47:14.777 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi044.front.sepia.ceph.com 2024-04-17T19:47:14.777 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-17T19:47:14.778 DEBUG:teuthology.orchestra.run.smithi044:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.admin) 2024-04-17T19:47:14.789 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-17T19:47:14.980 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:14.990+0000 7f31d9400640 1 Processor -- start 2024-04-17T19:47:14.981 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:14.990+0000 7f31d9400640 1 -- start start 2024-04-17T19:47:14.982 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:14.994+0000 7f31d9400640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f31d4152a60 0x7f31d40c6920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:14.983 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:14.994+0000 7f31d9400640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f31d41592c0 0x7f31d4163100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:14.983 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:14.994+0000 7f31d9400640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f31d4152e70 con 0x7f31d4158eb0 2024-04-17T19:47:14.983 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:14.994+0000 7f31d9400640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 -- 0x7f31d40c52c0 con 0x7f31d4152a60 2024-04-17T19:47:14.983 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:14.994+0000 7f31d9400640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7f31d40c8840 con 0x7f31d41592c0 2024-04-17T19:47:14.983 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:14.994+0000 7f31d3200640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f31d41592c0 0x7f31d4163100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:14.984 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:14.994+0000 7f31d2800640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f31d4152a60 0x7f31d40c6920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:14.984 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:14.994+0000 7f31cbe00640 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f31d4158eb0 0x7f31d40c47c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.44:46140/0 (socket says 172.21.15.44:46140) 2024-04-17T19:47:14.984 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:14.994+0000 7f31d3200640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f31d41592c0 0x7f31d4163100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3301/0 says I am v2:172.21.15.44:47692/0 (socket says 172.21.15.44:47692) 2024-04-17T19:47:14.984 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:14.994+0000 7f31cbe00640 1 -- 172.21.15.44:0/1735170628 learned_addr learned my addr 172.21.15.44:0/1735170628 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-04-17T19:47:14.984 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:14.994+0000 7f31d2800640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f31d4152a60 0x7f31d40c6920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.44:39790/0 (socket says 172.21.15.44:39790) 2024-04-17T19:47:14.984 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:14.994+0000 7f31d3200640 1 -- 172.21.15.44:0/1735170628 >> v2:172.21.15.62:3300/0 conn(0x7f31d4152a60 msgr2=0x7f31d40c6920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T19:47:14.984 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:14.994+0000 7f31d3200640 1 --2- 172.21.15.44:0/1735170628 >> v2:172.21.15.62:3300/0 conn(0x7f31d4152a60 0x7f31d40c6920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:14.984 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:14.994+0000 7f31d3200640 1 -- 172.21.15.44:0/1735170628 >> v1:172.21.15.62:6789/0 conn(0x7f31d4158eb0 legacy=0x7f31d40c47c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:14.984 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:14.994+0000 7f31d3200640 1 -- 172.21.15.44:0/1735170628 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f31d40c8b20 con 0x7f31d41592c0 2024-04-17T19:47:14.986 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:14.998+0000 7f31d3200640 1 --2- 172.21.15.44:0/1735170628 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f31d41592c0 0x7f31d4163100 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f31cc00bfa0 tx=0x7f31cc021350 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ddf44ba32b55fbec server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:47:14.987 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:14.998+0000 7f31d1e00640 1 -- 172.21.15.44:0/1735170628 <== mon.2 v2:172.21.15.62:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31cc0b6070 con 0x7f31d41592c0 2024-04-17T19:47:14.987 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:14.998+0000 7f31d1e00640 1 -- 172.21.15.44:0/1735170628 <== mon.2 v2:172.21.15.62:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f31cc0aae50 con 0x7f31d41592c0 2024-04-17T19:47:14.987 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:14.998+0000 7f31d1e00640 1 -- 172.21.15.44:0/1735170628 <== mon.2 v2:172.21.15.62:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31cc009540 con 0x7f31d41592c0 2024-04-17T19:47:14.988 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:14.998+0000 7f31d9400640 1 -- 172.21.15.44:0/1735170628 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f31d41592c0 msgr2=0x7f31d4163100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:14.988 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:14.998+0000 7f31d9400640 1 --2- 172.21.15.44:0/1735170628 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f31d41592c0 0x7f31d4163100 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f31cc00bfa0 tx=0x7f31cc021350 comp rx=0 tx=0).stop 2024-04-17T19:47:14.988 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:14.998+0000 7f31d9400640 1 -- 172.21.15.44:0/1735170628 shutdown_connections 2024-04-17T19:47:14.988 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:14.998+0000 7f31d9400640 1 --2- 172.21.15.44:0/1735170628 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f31d41592c0 0x7f31d4163100 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:14.988 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:14.998+0000 7f31d9400640 1 --2- 172.21.15.44:0/1735170628 >> v2:172.21.15.62:3300/0 conn(0x7f31d4152a60 0x7f31d40c6920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:14.988 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:14.998+0000 7f31d9400640 1 -- 172.21.15.44:0/1735170628 >> 172.21.15.44:0/1735170628 conn(0x7f31d406c380 msgr2=0x7f31d4070080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:47:14.988 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:14.998+0000 7f31d9400640 1 -- 172.21.15.44:0/1735170628 shutdown_connections 2024-04-17T19:47:14.988 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:14.998+0000 7f31d9400640 1 -- 172.21.15.44:0/1735170628 wait complete. 2024-04-17T19:47:14.990 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:14.998+0000 7f31d9400640 1 Processor -- start 2024-04-17T19:47:14.990 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:15.002+0000 7f31d9400640 1 -- start start 2024-04-17T19:47:14.992 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:15.002+0000 7f31d9400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f31d4152a60 0x7f31d41f57d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:14.992 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:15.002+0000 7f31d9400640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f31d4158eb0 0x7f31d41474d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:14.992 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:15.002+0000 7f31d9400640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f31d41592c0 0x7f31d4144db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:14.992 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:15.002+0000 7f31d9400640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f31d4158990 con 0x7f31d4152a60 2024-04-17T19:47:14.992 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:15.002+0000 7f31d9400640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f31d40c90e0 con 0x7f31d4158eb0 2024-04-17T19:47:14.992 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:15.002+0000 7f31d9400640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7f31d40c6e60 con 0x7f31d41592c0 2024-04-17T19:47:14.992 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:15.002+0000 7f31d2800640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f31d4152a60 0x7f31d41f57d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:14.992 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:15.002+0000 7f31d2800640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f31d4152a60 0x7f31d41f57d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:42726/0 (socket says 172.21.15.44:42726) 2024-04-17T19:47:14.992 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:15.002+0000 7f31d2800640 1 -- 172.21.15.44:0/2360553356 learned_addr learned my addr 172.21.15.44:0/2360553356 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-04-17T19:47:14.992 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:15.002+0000 7f31cbe00640 1 --2- 172.21.15.44:0/2360553356 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f31d4158eb0 0x7f31d41474d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:14.992 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:15.002+0000 7f31d3200640 1 --2- 172.21.15.44:0/2360553356 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f31d41592c0 0x7f31d4144db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:14.993 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:15.002+0000 7f31d2800640 1 -- 172.21.15.44:0/2360553356 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f31d41592c0 msgr2=0x7f31d4144db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:14.994 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:15.002+0000 7f31d2800640 1 --2- 172.21.15.44:0/2360553356 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f31d41592c0 0x7f31d4144db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:14.994 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:15.002+0000 7f31d2800640 1 -- 172.21.15.44:0/2360553356 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f31d4158eb0 msgr2=0x7f31d41474d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:14.994 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:15.002+0000 7f31d2800640 1 --2- 172.21.15.44:0/2360553356 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f31d4158eb0 0x7f31d41474d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:14.994 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:15.002+0000 7f31d2800640 1 -- 172.21.15.44:0/2360553356 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f31d41f5d10 con 0x7f31d4152a60 2024-04-17T19:47:14.994 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:15.002+0000 7f31cbe00640 1 --2- 172.21.15.44:0/2360553356 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f31d4158eb0 0x7f31d41474d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-17T19:47:14.994 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:15.002+0000 7f31d2800640 1 --2- 172.21.15.44:0/2360553356 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f31d4152a60 0x7f31d41f57d0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f31c400e8a0 tx=0x7f31c400eca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:47:14.994 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:15.002+0000 7f31caa00640 1 -- 172.21.15.44:0/2360553356 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31c4017070 con 0x7f31d4152a60 2024-04-17T19:47:14.994 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:15.002+0000 7f31caa00640 1 -- 172.21.15.44:0/2360553356 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f31c400c940 con 0x7f31d4152a60 2024-04-17T19:47:14.994 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:15.002+0000 7f31caa00640 1 -- 172.21.15.44:0/2360553356 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31c400ccf0 con 0x7f31d4152a60 2024-04-17T19:47:14.994 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:15.002+0000 7f31d9400640 1 -- 172.21.15.44:0/2360553356 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f31d41510e0 con 0x7f31d4152a60 2024-04-17T19:47:14.994 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:15.002+0000 7f31d9400640 1 -- 172.21.15.44:0/2360553356 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f31d4148620 con 0x7f31d4152a60 2024-04-17T19:47:14.994 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:15.002+0000 7f31d9400640 1 -- 172.21.15.44:0/2360553356 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f31d404ff10 con 0x7f31d4152a60 2024-04-17T19:47:14.995 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:15.006+0000 7f31caa00640 1 -- 172.21.15.44:0/2360553356 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f31c401a070 con 0x7f31d4152a60 2024-04-17T19:47:14.996 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:15.006+0000 7f31caa00640 1 --2- 172.21.15.44:0/2360553356 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f31b00683b0 0x7f31b006a8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:14.996 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:15.006+0000 7f31caa00640 1 -- 172.21.15.44:0/2360553356 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f31c4086ab0 con 0x7f31d4152a60 2024-04-17T19:47:14.996 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:15.006+0000 7f31cbe00640 1 --2- 172.21.15.44:0/2360553356 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f31b00683b0 0x7f31b006a8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:14.997 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:15.006+0000 7f31cbe00640 1 --2- 172.21.15.44:0/2360553356 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f31b00683b0 0x7f31b006a8c0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f31d4072a00 tx=0x7f31bc009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:47:15.000 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:15.010+0000 7f31caa00640 1 -- 172.21.15.44:0/2360553356 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f31c40566d0 con 0x7f31d4152a60 2024-04-17T19:47:15.165 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:15.174+0000 7f31d9400640 1 -- 172.21.15.44:0/2360553356 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f31d40c7ea0 con 0x7f31d4152a60 2024-04-17T19:47:15.167 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:15.178+0000 7f31caa00640 1 -- 172.21.15.44:0/2360553356 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) ==== 74+0+18482 (secure 0 0 0) 0x7f31c405a9d0 con 0x7f31d4152a60 2024-04-17T19:47:15.167 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-04-17T19:47:15.167 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":25,"fsid":"703f77ca-79c6-4a66-b576-62c526cb1021","created":"2024-04-17T19:46:30.831994+0000","modified":"2024-04-17T19:47:01.141287+0000","last_up_change":"2024-04-17T19:46:41.988197+0000","last_in_change":"2024-04-17T19:46:33.407430+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-17T19:46:41.940380+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-17T19:46:54.222150+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-17T19:46:55.031694+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-17T19:46:58.707529+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"30520dc6-eea6-43d4-ab60-3ca9e92329dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6800","nonce":1018735925},{"type":"v1","addr":"172.21.15.44:6801","nonce":1018735925}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6802","nonce":1018735925},{"type":"v1","addr":"172.21.15.44:6803","nonce":1018735925}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6806","nonce":1018735925},{"type":"v1","addr":"172.21.15.44:6807","nonce":1018735925}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6804","nonce":1018735925},{"type":"v1","addr":"172.21.15.44:6805","nonce":1018735925}]},"public_addr":"172.21.15.44:6801/1018735925","cluster_addr":"172.21.15.44:6803/1018735925","heartbeat_back_addr":"172.21.15.44:6807/1018735925","heartbeat_front_addr":"172.21.15.44:6805/1018735925","state":["exists","up"]},{"osd":1,"uuid":"079bd511-b6ce-449b-8f11-17b311b12f7c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6817","nonce":1452577434},{"type":"v1","addr":"172.21.15.44:6820","nonce":1452577434}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6823","nonce":1452577434},{"type":"v1","addr":"172.21.15.44:6825","nonce":1452577434}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6830","nonce":1452577434},{"type":"v1","addr":"172.21.15.44:6831","nonce":1452577434}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6828","nonce":1452577434},{"type":"v1","addr":"172.21.15.44:6829","nonce":1452577434}]},"public_addr":"172.21.15.44:6820/1452577434","cluster_addr":"172.21.15.44:6825/1452577434","heartbeat_back_addr":"172.21.15.44:6831/1452577434","heartbeat_front_addr":"172.21.15.44:6829/1452577434","state":["exists","up"]},{"osd":2,"uuid":"34f0b9ab-b1d2-4ee9-841c-f15afbb6bec5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6816","nonce":1160071918},{"type":"v1","addr":"172.21.15.44:6818","nonce":1160071918}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6819","nonce":1160071918},{"type":"v1","addr":"172.21.15.44:6821","nonce":1160071918}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6826","nonce":1160071918},{"type":"v1","addr":"172.21.15.44:6827","nonce":1160071918}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6822","nonce":1160071918},{"type":"v1","addr":"172.21.15.44:6824","nonce":1160071918}]},"public_addr":"172.21.15.44:6818/1160071918","cluster_addr":"172.21.15.44:6821/1160071918","heartbeat_back_addr":"172.21.15.44:6827/1160071918","heartbeat_front_addr":"172.21.15.44:6824/1160071918","state":["exists","up"]},{"osd":3,"uuid":"4740032d-fe34-4b1b-bb85-f430896fc3c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6808","nonce":4236454921},{"type":"v1","addr":"172.21.15.44:6809","nonce":4236454921}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6810","nonce":4236454921},{"type":"v1","addr":"172.21.15.44:6811","nonce":4236454921}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6814","nonce":4236454921},{"type":"v1","addr":"172.21.15.44:6815","nonce":4236454921}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6812","nonce":4236454921},{"type":"v1","addr":"172.21.15.44:6813","nonce":4236454921}]},"public_addr":"172.21.15.44:6809/4236454921","cluster_addr":"172.21.15.44:6811/4236454921","heartbeat_back_addr":"172.21.15.44:6815/4236454921","heartbeat_front_addr":"172.21.15.44:6813/4236454921","state":["exists","up"]},{"osd":4,"uuid":"7dbedb00-302d-4d52-810c-e18839254da1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6800","nonce":2293251376},{"type":"v1","addr":"172.21.15.62:6801","nonce":2293251376}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6802","nonce":2293251376},{"type":"v1","addr":"172.21.15.62:6803","nonce":2293251376}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6806","nonce":2293251376},{"type":"v1","addr":"172.21.15.62:6807","nonce":2293251376}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6804","nonce":2293251376},{"type":"v1","addr":"172.21.15.62:6805","nonce":2293251376}]},"public_addr":"172.21.15.62:6801/2293251376","cluster_addr":"172.21.15.62:6803/2293251376","heartbeat_back_addr":"172.21.15.62:6807/2293251376","heartbeat_front_addr":"172.21.15.62:6805/2293251376","state":["exists","up"]},{"osd":5,"uuid":"38c1e8d9-393d-4f33-a97a-3295cf5c5b07","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6808","nonce":1551020300},{"type":"v1","addr":"172.21.15.62:6809","nonce":1551020300}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6810","nonce":1551020300},{"type":"v1","addr":"172.21.15.62:6811","nonce":1551020300}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6814","nonce":1551020300},{"type":"v1","addr":"172.21.15.62:6815","nonce":1551020300}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6812","nonce":1551020300},{"type":"v1","addr":"172.21.15.62:6813","nonce":1551020300}]},"public_addr":"172.21.15.62:6809/1551020300","cluster_addr":"172.21.15.62:6811/1551020300","heartbeat_back_addr":"172.21.15.62:6815/1551020300","heartbeat_front_addr":"172.21.15.62:6813/1551020300","state":["exists","up"]},{"osd":6,"uuid":"f6ff81c6-f14d-4477-88e3-9116cc5a2992","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6824","nonce":2602310256},{"type":"v1","addr":"172.21.15.62:6825","nonce":2602310256}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6826","nonce":2602310256},{"type":"v1","addr":"172.21.15.62:6827","nonce":2602310256}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6830","nonce":2602310256},{"type":"v1","addr":"172.21.15.62:6831","nonce":2602310256}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6828","nonce":2602310256},{"type":"v1","addr":"172.21.15.62:6829","nonce":2602310256}]},"public_addr":"172.21.15.62:6825/2602310256","cluster_addr":"172.21.15.62:6827/2602310256","heartbeat_back_addr":"172.21.15.62:6831/2602310256","heartbeat_front_addr":"172.21.15.62:6829/2602310256","state":["exists","up"]},{"osd":7,"uuid":"ce395bc3-bcb5-4b94-a523-5bb9df491eca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6816","nonce":2912738359},{"type":"v1","addr":"172.21.15.62:6817","nonce":2912738359}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6818","nonce":2912738359},{"type":"v1","addr":"172.21.15.62:6819","nonce":2912738359}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6822","nonce":2912738359},{"type":"v1","addr":"172.21.15.62:6823","nonce":2912738359}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6820","nonce":2912738359},{"type":"v1","addr":"172.21.15.62:6821","nonce":2912738359}]},"public_addr":"172.21.15.62:6817/2912738359","cluster_addr":"172.21.15.62:6819/2912738359","heartbeat_back_addr":"172.21.15.62:6823/2912738359","heartbeat_front_addr":"172.21.15.62:6821/2912738359","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T19:46:39.302883+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T19:46:39.177705+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T19:46:39.188894+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T19:46:39.313009+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T19:46:38.870508+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T19:46:38.790900+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T19:46:38.979163+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T19:46:38.992348+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-17T19:47:15.169 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:15.178+0000 7f31d9400640 1 -- 172.21.15.44:0/2360553356 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f31b00683b0 msgr2=0x7f31b006a8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:15.169 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:15.178+0000 7f31d9400640 1 --2- 172.21.15.44:0/2360553356 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f31b00683b0 0x7f31b006a8c0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f31d4072a00 tx=0x7f31bc009040 comp rx=0 tx=0).stop 2024-04-17T19:47:15.169 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:15.178+0000 7f31d9400640 1 -- 172.21.15.44:0/2360553356 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f31d4152a60 msgr2=0x7f31d41f57d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:15.169 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:15.178+0000 7f31d9400640 1 --2- 172.21.15.44:0/2360553356 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f31d4152a60 0x7f31d41f57d0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f31c400e8a0 tx=0x7f31c400eca0 comp rx=0 tx=0).stop 2024-04-17T19:47:15.169 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:15.178+0000 7f31d9400640 1 -- 172.21.15.44:0/2360553356 shutdown_connections 2024-04-17T19:47:15.170 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:15.178+0000 7f31d9400640 1 --2- 172.21.15.44:0/2360553356 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f31b00683b0 0x7f31b006a8c0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:15.170 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:15.178+0000 7f31d9400640 1 --2- 172.21.15.44:0/2360553356 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f31d41592c0 0x7f31d4144db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:15.170 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:15.178+0000 7f31d9400640 1 --2- 172.21.15.44:0/2360553356 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f31d4158eb0 0x7f31d41474d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:15.170 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:15.178+0000 7f31d9400640 1 --2- 172.21.15.44:0/2360553356 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f31d4152a60 0x7f31d41f57d0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:15.170 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:15.178+0000 7f31d9400640 1 -- 172.21.15.44:0/2360553356 >> 172.21.15.44:0/2360553356 conn(0x7f31d406c380 msgr2=0x7f31d40cca50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:47:15.170 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:15.178+0000 7f31d9400640 1 -- 172.21.15.44:0/2360553356 shutdown_connections 2024-04-17T19:47:15.170 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:15.178+0000 7f31d9400640 1 -- 172.21.15.44:0/2360553356 wait complete. 2024-04-17T19:47:15.189 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-17T19:47:15.340 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:15.350+0000 7f1c6fc00640 1 Processor -- start 2024-04-17T19:47:15.340 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:15.350+0000 7f1c6fc00640 1 -- start start 2024-04-17T19:47:15.342 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:15.350+0000 7f1c6fc00640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f1c680c9620 0x7f1c680c9a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:15.342 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:15.350+0000 7f1c6fc00640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f1c6815bdc0 0x7f1c6815c1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:15.342 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:15.350+0000 7f1c6fc00640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1c680cf310 con 0x7f1c68155d50 2024-04-17T19:47:15.342 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:15.350+0000 7f1c6fc00640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 -- 0x7f1c680c53e0 con 0x7f1c680c9620 2024-04-17T19:47:15.342 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:15.350+0000 7f1c6fc00640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7f1c680c47d0 con 0x7f1c6815bdc0 2024-04-17T19:47:15.343 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:15.354+0000 7f1c6dc00640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f1c6815bdc0 0x7f1c6815c1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:15.343 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:15.354+0000 7f1c67e00640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f1c680c9620 0x7f1c680c9a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:15.343 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:15.354+0000 7f1c6dc00640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f1c6815bdc0 0x7f1c6815c1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3301/0 says I am v2:172.21.15.44:43082/0 (socket says 172.21.15.44:43082) 2024-04-17T19:47:15.343 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:15.354+0000 7f1c6dc00640 1 -- 172.21.15.44:0/619664119 learned_addr learned my addr 172.21.15.44:0/619664119 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-04-17T19:47:15.343 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:15.354+0000 7f1c67e00640 1 -- 172.21.15.44:0/619664119 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f1c6815bdc0 msgr2=0x7f1c6815c1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T19:47:15.343 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:15.354+0000 7f1c67e00640 1 --2- 172.21.15.44:0/619664119 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f1c6815bdc0 0x7f1c6815c1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:15.343 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:15.354+0000 7f1c67e00640 1 -- 172.21.15.44:0/619664119 >> v1:172.21.15.62:6789/0 conn(0x7f1c68155d50 legacy=0x7f1c680cec00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:15.343 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:15.354+0000 7f1c67e00640 1 -- 172.21.15.44:0/619664119 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1c680c4ab0 con 0x7f1c680c9620 2024-04-17T19:47:15.346 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:15.354+0000 7f1c67e00640 1 --2- 172.21.15.44:0/619664119 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1c680c9620 0x7f1c680c9a30 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f1c540097c0 tx=0x7f1c5401ec90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a569f24b079f218b server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:47:15.346 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:15.358+0000 7f1c67400640 1 -- 172.21.15.44:0/619664119 <== mon.1 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c540b5070 con 0x7f1c680c9620 2024-04-17T19:47:15.346 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:15.358+0000 7f1c67400640 1 -- 172.21.15.44:0/619664119 <== mon.1 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1c540a8990 con 0x7f1c680c9620 2024-04-17T19:47:15.346 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:15.358+0000 7f1c67400640 1 -- 172.21.15.44:0/619664119 <== mon.1 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c540a8d60 con 0x7f1c680c9620 2024-04-17T19:47:15.347 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:15.358+0000 7f1c6fc00640 1 -- 172.21.15.44:0/619664119 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1c680c9620 msgr2=0x7f1c680c9a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:15.347 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:15.358+0000 7f1c6fc00640 1 --2- 172.21.15.44:0/619664119 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1c680c9620 0x7f1c680c9a30 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f1c540097c0 tx=0x7f1c5401ec90 comp rx=0 tx=0).stop 2024-04-17T19:47:15.347 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:15.358+0000 7f1c6fc00640 1 -- 172.21.15.44:0/619664119 shutdown_connections 2024-04-17T19:47:15.347 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:15.358+0000 7f1c6fc00640 1 --2- 172.21.15.44:0/619664119 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f1c6815bdc0 0x7f1c6815c1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:15.347 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:15.358+0000 7f1c6fc00640 1 --2- 172.21.15.44:0/619664119 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1c680c9620 0x7f1c680c9a30 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:15.348 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:15.358+0000 7f1c6fc00640 1 -- 172.21.15.44:0/619664119 >> 172.21.15.44:0/619664119 conn(0x7f1c68070be0 msgr2=0x7f1c68072330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:47:15.348 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:15.358+0000 7f1c6fc00640 1 -- 172.21.15.44:0/619664119 shutdown_connections 2024-04-17T19:47:15.348 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:15.358+0000 7f1c6fc00640 1 -- 172.21.15.44:0/619664119 wait complete. 2024-04-17T19:47:15.349 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:15.358+0000 7f1c6fc00640 1 Processor -- start 2024-04-17T19:47:15.349 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:15.358+0000 7f1c6fc00640 1 -- start start 2024-04-17T19:47:15.351 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:15.362+0000 7f1c6fc00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1c680c9620 0x7f1c681f43c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:15.351 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:15.362+0000 7f1c6fc00640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f1c68155d50 0x7f1c681f55f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:15.351 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:15.362+0000 7f1c6fc00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1c6815bdc0 0x7f1c681f5b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:15.352 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:15.362+0000 7f1c6fc00640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f1c6815c710 con 0x7f1c6815bdc0 2024-04-17T19:47:15.352 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:15.362+0000 7f1c6fc00640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f1c680c5070 con 0x7f1c680c9620 2024-04-17T19:47:15.352 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:15.362+0000 7f1c6fc00640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7f1c680c5ce0 con 0x7f1c68155d50 2024-04-17T19:47:15.352 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:15.362+0000 7f1c6dc00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1c6815bdc0 0x7f1c681f5b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:15.352 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:15.362+0000 7f1c67e00640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f1c68155d50 0x7f1c681f55f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:15.352 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:15.362+0000 7f1c6dc00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1c6815bdc0 0x7f1c681f5b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:42480/0 (socket says 172.21.15.44:42480) 2024-04-17T19:47:15.352 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:15.362+0000 7f1c6dc00640 1 -- 172.21.15.44:0/1623636108 learned_addr learned my addr 172.21.15.44:0/1623636108 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-04-17T19:47:15.352 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:15.362+0000 7f1c6d200640 1 --2- 172.21.15.44:0/1623636108 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1c680c9620 0x7f1c681f43c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:15.353 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:15.362+0000 7f1c6dc00640 1 -- 172.21.15.44:0/1623636108 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f1c68155d50 msgr2=0x7f1c681f55f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:15.353 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:15.362+0000 7f1c6dc00640 1 --2- 172.21.15.44:0/1623636108 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f1c68155d50 0x7f1c681f55f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:15.353 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:15.362+0000 7f1c6dc00640 1 -- 172.21.15.44:0/1623636108 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1c680c9620 msgr2=0x7f1c681f43c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:15.353 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:15.362+0000 7f1c6dc00640 1 --2- 172.21.15.44:0/1623636108 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1c680c9620 0x7f1c681f43c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:15.353 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:15.362+0000 7f1c6dc00640 1 -- 172.21.15.44:0/1623636108 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1c681f4900 con 0x7f1c6815bdc0 2024-04-17T19:47:15.354 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:15.362+0000 7f1c6dc00640 1 --2- 172.21.15.44:0/1623636108 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1c6815bdc0 0x7f1c681f5b30 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f1c6000efc0 tx=0x7f1c6000c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:47:15.354 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:15.362+0000 7f1c64c00640 1 -- 172.21.15.44:0/1623636108 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c6000cac0 con 0x7f1c6815bdc0 2024-04-17T19:47:15.354 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:15.362+0000 7f1c64c00640 1 -- 172.21.15.44:0/1623636108 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1c6000cc60 con 0x7f1c6815bdc0 2024-04-17T19:47:15.354 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:15.362+0000 7f1c64c00640 1 -- 172.21.15.44:0/1623636108 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c60003be0 con 0x7f1c6815bdc0 2024-04-17T19:47:15.354 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:15.362+0000 7f1c6fc00640 1 -- 172.21.15.44:0/1623636108 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1c681f61f0 con 0x7f1c6815bdc0 2024-04-17T19:47:15.354 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:15.362+0000 7f1c6fc00640 1 -- 172.21.15.44:0/1623636108 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1c681f3600 con 0x7f1c6815bdc0 2024-04-17T19:47:15.354 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:15.362+0000 7f1c6fc00640 1 -- 172.21.15.44:0/1623636108 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1c6804ff10 con 0x7f1c6815bdc0 2024-04-17T19:47:15.354 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:15.366+0000 7f1c64c00640 1 -- 172.21.15.44:0/1623636108 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f1c60012050 con 0x7f1c6815bdc0 2024-04-17T19:47:15.356 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:15.366+0000 7f1c64c00640 1 --2- 172.21.15.44:0/1623636108 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f1c480683b0 0x7f1c4806a8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:15.356 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:15.366+0000 7f1c64c00640 1 -- 172.21.15.44:0/1623636108 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f1c60086fc0 con 0x7f1c6815bdc0 2024-04-17T19:47:15.356 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:15.366+0000 7f1c6d200640 1 --2- 172.21.15.44:0/1623636108 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f1c480683b0 0x7f1c4806a8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:15.357 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:15.366+0000 7f1c6d200640 1 --2- 172.21.15.44:0/1623636108 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f1c480683b0 0x7f1c4806a8c0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f1c5c001770 tx=0x7f1c5c009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:47:15.360 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:15.370+0000 7f1c64c00640 1 -- 172.21.15.44:0/1623636108 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f1c60010040 con 0x7f1c6815bdc0 2024-04-17T19:47:15.527 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:15.538+0000 7f1c6fc00640 1 -- 172.21.15.44:0/1623636108 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f1c680cc500 con 0x7f1c6815bdc0 2024-04-17T19:47:15.528 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:15.538+0000 7f1c64c00640 1 -- 172.21.15.44:0/1623636108 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) ==== 74+0+18482 (secure 0 0 0) 0x7f1c60056b50 con 0x7f1c6815bdc0 2024-04-17T19:47:15.529 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-04-17T19:47:15.529 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":25,"fsid":"703f77ca-79c6-4a66-b576-62c526cb1021","created":"2024-04-17T19:46:30.831994+0000","modified":"2024-04-17T19:47:01.141287+0000","last_up_change":"2024-04-17T19:46:41.988197+0000","last_in_change":"2024-04-17T19:46:33.407430+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-17T19:46:41.940380+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-17T19:46:54.222150+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-17T19:46:55.031694+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-17T19:46:58.707529+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"30520dc6-eea6-43d4-ab60-3ca9e92329dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6800","nonce":1018735925},{"type":"v1","addr":"172.21.15.44:6801","nonce":1018735925}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6802","nonce":1018735925},{"type":"v1","addr":"172.21.15.44:6803","nonce":1018735925}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6806","nonce":1018735925},{"type":"v1","addr":"172.21.15.44:6807","nonce":1018735925}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6804","nonce":1018735925},{"type":"v1","addr":"172.21.15.44:6805","nonce":1018735925}]},"public_addr":"172.21.15.44:6801/1018735925","cluster_addr":"172.21.15.44:6803/1018735925","heartbeat_back_addr":"172.21.15.44:6807/1018735925","heartbeat_front_addr":"172.21.15.44:6805/1018735925","state":["exists","up"]},{"osd":1,"uuid":"079bd511-b6ce-449b-8f11-17b311b12f7c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6817","nonce":1452577434},{"type":"v1","addr":"172.21.15.44:6820","nonce":1452577434}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6823","nonce":1452577434},{"type":"v1","addr":"172.21.15.44:6825","nonce":1452577434}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6830","nonce":1452577434},{"type":"v1","addr":"172.21.15.44:6831","nonce":1452577434}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6828","nonce":1452577434},{"type":"v1","addr":"172.21.15.44:6829","nonce":1452577434}]},"public_addr":"172.21.15.44:6820/1452577434","cluster_addr":"172.21.15.44:6825/1452577434","heartbeat_back_addr":"172.21.15.44:6831/1452577434","heartbeat_front_addr":"172.21.15.44:6829/1452577434","state":["exists","up"]},{"osd":2,"uuid":"34f0b9ab-b1d2-4ee9-841c-f15afbb6bec5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6816","nonce":1160071918},{"type":"v1","addr":"172.21.15.44:6818","nonce":1160071918}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6819","nonce":1160071918},{"type":"v1","addr":"172.21.15.44:6821","nonce":1160071918}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6826","nonce":1160071918},{"type":"v1","addr":"172.21.15.44:6827","nonce":1160071918}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6822","nonce":1160071918},{"type":"v1","addr":"172.21.15.44:6824","nonce":1160071918}]},"public_addr":"172.21.15.44:6818/1160071918","cluster_addr":"172.21.15.44:6821/1160071918","heartbeat_back_addr":"172.21.15.44:6827/1160071918","heartbeat_front_addr":"172.21.15.44:6824/1160071918","state":["exists","up"]},{"osd":3,"uuid":"4740032d-fe34-4b1b-bb85-f430896fc3c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6808","nonce":4236454921},{"type":"v1","addr":"172.21.15.44:6809","nonce":4236454921}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6810","nonce":4236454921},{"type":"v1","addr":"172.21.15.44:6811","nonce":4236454921}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6814","nonce":4236454921},{"type":"v1","addr":"172.21.15.44:6815","nonce":4236454921}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6812","nonce":4236454921},{"type":"v1","addr":"172.21.15.44:6813","nonce":4236454921}]},"public_addr":"172.21.15.44:6809/4236454921","cluster_addr":"172.21.15.44:6811/4236454921","heartbeat_back_addr":"172.21.15.44:6815/4236454921","heartbeat_front_addr":"172.21.15.44:6813/4236454921","state":["exists","up"]},{"osd":4,"uuid":"7dbedb00-302d-4d52-810c-e18839254da1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6800","nonce":2293251376},{"type":"v1","addr":"172.21.15.62:6801","nonce":2293251376}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6802","nonce":2293251376},{"type":"v1","addr":"172.21.15.62:6803","nonce":2293251376}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6806","nonce":2293251376},{"type":"v1","addr":"172.21.15.62:6807","nonce":2293251376}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6804","nonce":2293251376},{"type":"v1","addr":"172.21.15.62:6805","nonce":2293251376}]},"public_addr":"172.21.15.62:6801/2293251376","cluster_addr":"172.21.15.62:6803/2293251376","heartbeat_back_addr":"172.21.15.62:6807/2293251376","heartbeat_front_addr":"172.21.15.62:6805/2293251376","state":["exists","up"]},{"osd":5,"uuid":"38c1e8d9-393d-4f33-a97a-3295cf5c5b07","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6808","nonce":1551020300},{"type":"v1","addr":"172.21.15.62:6809","nonce":1551020300}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6810","nonce":1551020300},{"type":"v1","addr":"172.21.15.62:6811","nonce":1551020300}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6814","nonce":1551020300},{"type":"v1","addr":"172.21.15.62:6815","nonce":1551020300}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6812","nonce":1551020300},{"type":"v1","addr":"172.21.15.62:6813","nonce":1551020300}]},"public_addr":"172.21.15.62:6809/1551020300","cluster_addr":"172.21.15.62:6811/1551020300","heartbeat_back_addr":"172.21.15.62:6815/1551020300","heartbeat_front_addr":"172.21.15.62:6813/1551020300","state":["exists","up"]},{"osd":6,"uuid":"f6ff81c6-f14d-4477-88e3-9116cc5a2992","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6824","nonce":2602310256},{"type":"v1","addr":"172.21.15.62:6825","nonce":2602310256}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6826","nonce":2602310256},{"type":"v1","addr":"172.21.15.62:6827","nonce":2602310256}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6830","nonce":2602310256},{"type":"v1","addr":"172.21.15.62:6831","nonce":2602310256}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6828","nonce":2602310256},{"type":"v1","addr":"172.21.15.62:6829","nonce":2602310256}]},"public_addr":"172.21.15.62:6825/2602310256","cluster_addr":"172.21.15.62:6827/2602310256","heartbeat_back_addr":"172.21.15.62:6831/2602310256","heartbeat_front_addr":"172.21.15.62:6829/2602310256","state":["exists","up"]},{"osd":7,"uuid":"ce395bc3-bcb5-4b94-a523-5bb9df491eca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6816","nonce":2912738359},{"type":"v1","addr":"172.21.15.62:6817","nonce":2912738359}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6818","nonce":2912738359},{"type":"v1","addr":"172.21.15.62:6819","nonce":2912738359}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6822","nonce":2912738359},{"type":"v1","addr":"172.21.15.62:6823","nonce":2912738359}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6820","nonce":2912738359},{"type":"v1","addr":"172.21.15.62:6821","nonce":2912738359}]},"public_addr":"172.21.15.62:6817/2912738359","cluster_addr":"172.21.15.62:6819/2912738359","heartbeat_back_addr":"172.21.15.62:6823/2912738359","heartbeat_front_addr":"172.21.15.62:6821/2912738359","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T19:46:39.302883+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T19:46:39.177705+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T19:46:39.188894+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T19:46:39.313009+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T19:46:38.870508+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T19:46:38.790900+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T19:46:38.979163+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T19:46:38.992348+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-17T19:47:15.531 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:15.542+0000 7f1c6fc00640 1 -- 172.21.15.44:0/1623636108 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f1c480683b0 msgr2=0x7f1c4806a8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:15.531 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:15.542+0000 7f1c6fc00640 1 --2- 172.21.15.44:0/1623636108 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f1c480683b0 0x7f1c4806a8c0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f1c5c001770 tx=0x7f1c5c009040 comp rx=0 tx=0).stop 2024-04-17T19:47:15.531 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:15.542+0000 7f1c6fc00640 1 -- 172.21.15.44:0/1623636108 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1c6815bdc0 msgr2=0x7f1c681f5b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:15.531 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:15.542+0000 7f1c6fc00640 1 --2- 172.21.15.44:0/1623636108 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1c6815bdc0 0x7f1c681f5b30 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f1c6000efc0 tx=0x7f1c6000c490 comp rx=0 tx=0).stop 2024-04-17T19:47:15.531 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:15.542+0000 7f1c6fc00640 1 -- 172.21.15.44:0/1623636108 shutdown_connections 2024-04-17T19:47:15.531 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:15.542+0000 7f1c6fc00640 1 --2- 172.21.15.44:0/1623636108 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f1c480683b0 0x7f1c4806a8c0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:15.531 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:15.542+0000 7f1c6fc00640 1 --2- 172.21.15.44:0/1623636108 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f1c68155d50 0x7f1c681f55f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:15.531 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:15.542+0000 7f1c6fc00640 1 --2- 172.21.15.44:0/1623636108 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1c6815bdc0 0x7f1c681f5b30 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:15.531 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:15.542+0000 7f1c6fc00640 1 --2- 172.21.15.44:0/1623636108 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1c680c9620 0x7f1c681f43c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:15.532 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:15.542+0000 7f1c6fc00640 1 -- 172.21.15.44:0/1623636108 >> 172.21.15.44:0/1623636108 conn(0x7f1c68070be0 msgr2=0x7f1c681e5630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:47:15.532 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:15.542+0000 7f1c6fc00640 1 -- 172.21.15.44:0/1623636108 shutdown_connections 2024-04-17T19:47:15.532 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:15.542+0000 7f1c6fc00640 1 -- 172.21.15.44:0/1623636108 wait complete. 2024-04-17T19:47:15.551 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-04-17T19:47:15.705 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:15.714+0000 7fa048c00640 1 Processor -- start 2024-04-17T19:47:15.705 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:15.714+0000 7fa048c00640 1 -- start start 2024-04-17T19:47:15.707 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:15.718+0000 7fa048c00640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fa044072700 0x7fa044153a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:15.707 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:15.718+0000 7fa048c00640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa044072d60 con 0x7fa04415a4f0 2024-04-17T19:47:15.707 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:15.718+0000 7fa048c00640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa044073810 con 0x7fa0440c60e0 2024-04-17T19:47:15.707 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:15.718+0000 7fa048c00640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 -- 0x7fa044072b10 con 0x7fa044072700 2024-04-17T19:47:15.707 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:15.718+0000 7fa042800640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7fa04415a4f0 0x7fa044164130 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:50352/0 (socket says 172.21.15.44:50352) 2024-04-17T19:47:15.707 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:15.718+0000 7fa042800640 1 -- 172.21.15.44:0/1760405298 learned_addr learned my addr 172.21.15.44:0/1760405298 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-04-17T19:47:15.708 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:15.718+0000 7fa041e00640 1 --2- 172.21.15.44:0/1760405298 >> v2:172.21.15.62:3300/0 conn(0x7fa044072700 0x7fa044153a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:15.708 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:15.718+0000 7fa041400640 1 -- 172.21.15.44:0/1760405298 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1898274094 0 0) 0x7fa044072d60 con 0x7fa04415a4f0 2024-04-17T19:47:15.708 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:15.718+0000 7fa041400640 1 -- 172.21.15.44:0/1760405298 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa028003530 con 0x7fa04415a4f0 2024-04-17T19:47:15.708 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:15.718+0000 7fa041e00640 1 -- 172.21.15.44:0/1760405298 >> v1:172.21.15.62:6789/0 conn(0x7fa0440c60e0 legacy=0x7fa044159de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:15.708 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:15.718+0000 7fa041e00640 1 -- 172.21.15.44:0/1760405298 >> v1:172.21.15.44:6789/0 conn(0x7fa04415a4f0 legacy=0x7fa044164130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:15.708 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:15.718+0000 7fa041400640 1 -- 172.21.15.44:0/1760405298 <== mon.0 v1:172.21.15.44:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3882935482 0 0) 0x7fa028003530 con 0x7fa04415a4f0 2024-04-17T19:47:15.708 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:15.718+0000 7fa041e00640 1 -- 172.21.15.44:0/1760405298 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa044073af0 con 0x7fa044072700 2024-04-17T19:47:15.711 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:15.722+0000 7fa041e00640 1 --2- 172.21.15.44:0/1760405298 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa044072700 0x7fa044153a00 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fa034009d90 tx=0x7fa03401f080 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e4612807bb952510 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:47:15.711 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:15.722+0000 7fa041400640 1 -- 172.21.15.44:0/1760405298 <== mon.1 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0340b5070 con 0x7fa044072700 2024-04-17T19:47:15.711 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:15.722+0000 7fa041400640 1 -- 172.21.15.44:0/1760405298 <== mon.1 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa0340a8c10 con 0x7fa044072700 2024-04-17T19:47:15.711 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:15.722+0000 7fa041400640 1 -- 172.21.15.44:0/1760405298 <== mon.1 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa03c0016a0 con 0x7fa044072700 2024-04-17T19:47:15.712 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:15.722+0000 7fa048c00640 1 -- 172.21.15.44:0/1760405298 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa044072700 msgr2=0x7fa044153a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:15.712 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:15.722+0000 7fa048c00640 1 --2- 172.21.15.44:0/1760405298 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa044072700 0x7fa044153a00 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fa034009d90 tx=0x7fa03401f080 comp rx=0 tx=0).stop 2024-04-17T19:47:15.712 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:15.722+0000 7fa048c00640 1 -- 172.21.15.44:0/1760405298 shutdown_connections 2024-04-17T19:47:15.712 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:15.722+0000 7fa048c00640 1 --2- 172.21.15.44:0/1760405298 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa044072700 0x7fa044153a00 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:15.712 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:15.722+0000 7fa048c00640 1 -- 172.21.15.44:0/1760405298 >> 172.21.15.44:0/1760405298 conn(0x7fa04406c380 msgr2=0x7fa044070080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:47:15.712 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:15.722+0000 7fa048c00640 1 -- 172.21.15.44:0/1760405298 shutdown_connections 2024-04-17T19:47:15.712 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:15.722+0000 7fa048c00640 1 -- 172.21.15.44:0/1760405298 wait complete. 2024-04-17T19:47:15.714 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:15.726+0000 7fa048c00640 1 Processor -- start 2024-04-17T19:47:15.714 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:15.726+0000 7fa048c00640 1 -- start start 2024-04-17T19:47:15.716 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:15.726+0000 7fa048c00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa044072700 0x7fa04414f380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:15.716 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:15.726+0000 7fa048c00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa0440c60e0 0x7fa0441f24b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:15.716 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:15.726+0000 7fa048c00640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fa044149300 0x7fa044151ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:15.716 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:15.726+0000 7fa048c00640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fa044074390 con 0x7fa044072700 2024-04-17T19:47:15.716 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:15.726+0000 7fa048c00640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7fa0440740b0 con 0x7fa0440c60e0 2024-04-17T19:47:15.716 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:15.726+0000 7fa048c00640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7fa0441598c0 con 0x7fa044149300 2024-04-17T19:47:15.716 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:15.726+0000 7fa041e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa044072700 0x7fa04414f380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:15.717 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:15.726+0000 7fa041e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa044072700 0x7fa04414f380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:42490/0 (socket says 172.21.15.44:42490) 2024-04-17T19:47:15.717 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:15.726+0000 7fa041e00640 1 -- 172.21.15.44:0/1837175602 learned_addr learned my addr 172.21.15.44:0/1837175602 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-04-17T19:47:15.717 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:15.726+0000 7fa039400640 1 --2- 172.21.15.44:0/1837175602 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa0440c60e0 0x7fa0441f24b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:15.717 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:15.726+0000 7fa042800640 1 --2- 172.21.15.44:0/1837175602 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fa044149300 0x7fa044151ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:15.718 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:15.726+0000 7fa041e00640 1 -- 172.21.15.44:0/1837175602 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fa044149300 msgr2=0x7fa044151ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:15.718 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:15.726+0000 7fa041e00640 1 --2- 172.21.15.44:0/1837175602 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fa044149300 0x7fa044151ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:15.718 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:15.726+0000 7fa041e00640 1 -- 172.21.15.44:0/1837175602 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa0440c60e0 msgr2=0x7fa0441f24b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:15.718 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:15.726+0000 7fa041e00640 1 --2- 172.21.15.44:0/1837175602 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa0440c60e0 0x7fa0441f24b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:15.718 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:15.726+0000 7fa041e00640 1 -- 172.21.15.44:0/1837175602 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa044148710 con 0x7fa044072700 2024-04-17T19:47:15.718 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:15.726+0000 7fa041e00640 1 --2- 172.21.15.44:0/1837175602 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa044072700 0x7fa04414f380 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fa03401ccb0 tx=0x7fa03401be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:47:15.718 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:15.726+0000 7fa03aa00640 1 -- 172.21.15.44:0/1837175602 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0340c0020 con 0x7fa044072700 2024-04-17T19:47:15.718 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:15.726+0000 7fa03aa00640 1 -- 172.21.15.44:0/1837175602 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa034004240 con 0x7fa044072700 2024-04-17T19:47:15.718 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:15.726+0000 7fa03aa00640 1 -- 172.21.15.44:0/1837175602 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0340b5040 con 0x7fa044072700 2024-04-17T19:47:15.718 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:15.726+0000 7fa048c00640 1 -- 172.21.15.44:0/1837175602 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa0440c5220 con 0x7fa044072700 2024-04-17T19:47:15.718 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:15.726+0000 7fa048c00640 1 -- 172.21.15.44:0/1837175602 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa04414eb80 con 0x7fa044072700 2024-04-17T19:47:15.719 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:15.730+0000 7fa048c00640 1 -- 172.21.15.44:0/1837175602 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa04404ff10 con 0x7fa044072700 2024-04-17T19:47:15.719 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:15.730+0000 7fa03aa00640 1 -- 172.21.15.44:0/1837175602 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fa0340c3070 con 0x7fa044072700 2024-04-17T19:47:15.720 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:15.730+0000 7fa03aa00640 1 --2- 172.21.15.44:0/1837175602 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7fa0200683b0 0x7fa02006a8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:15.720 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:15.730+0000 7fa03aa00640 1 -- 172.21.15.44:0/1837175602 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fa034124520 con 0x7fa044072700 2024-04-17T19:47:15.721 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:15.730+0000 7fa039400640 1 --2- 172.21.15.44:0/1837175602 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7fa0200683b0 0x7fa02006a8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:15.722 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:15.730+0000 7fa039400640 1 --2- 172.21.15.44:0/1837175602 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7fa0200683b0 0x7fa02006a8c0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fa04414fb50 tx=0x7fa02c009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:47:15.725 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:15.734+0000 7fa03aa00640 1 -- 172.21.15.44:0/1837175602 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fa034018be0 con 0x7fa044072700 2024-04-17T19:47:15.930 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:15.942+0000 7fa048c00640 1 -- 172.21.15.44:0/1837175602 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7fa0440c78b0 con 0x7fa044072700 2024-04-17T19:47:16.753 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:16.762+0000 7fa03aa00640 1 -- 172.21.15.44:0/1837175602 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v7) ==== 118+0+0 (secure 0 0 0) 0x7fa0340f40b0 con 0x7fa044072700 2024-04-17T19:47:16.756 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:16.766+0000 7fa048c00640 1 -- 172.21.15.44:0/1837175602 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7fa0200683b0 msgr2=0x7fa02006a8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:16.756 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:16.766+0000 7fa048c00640 1 --2- 172.21.15.44:0/1837175602 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7fa0200683b0 0x7fa02006a8c0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fa04414fb50 tx=0x7fa02c009040 comp rx=0 tx=0).stop 2024-04-17T19:47:16.756 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:16.766+0000 7fa048c00640 1 -- 172.21.15.44:0/1837175602 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa044072700 msgr2=0x7fa04414f380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:16.756 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:16.766+0000 7fa048c00640 1 --2- 172.21.15.44:0/1837175602 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa044072700 0x7fa04414f380 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fa03401ccb0 tx=0x7fa03401be20 comp rx=0 tx=0).stop 2024-04-17T19:47:16.756 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:16.766+0000 7fa048c00640 1 -- 172.21.15.44:0/1837175602 shutdown_connections 2024-04-17T19:47:16.756 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:16.766+0000 7fa048c00640 1 --2- 172.21.15.44:0/1837175602 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7fa0200683b0 0x7fa02006a8c0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:16.756 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:16.766+0000 7fa048c00640 1 --2- 172.21.15.44:0/1837175602 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fa044149300 0x7fa044151ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:16.756 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:16.766+0000 7fa048c00640 1 --2- 172.21.15.44:0/1837175602 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa0440c60e0 0x7fa0441f24b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:16.756 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:16.766+0000 7fa048c00640 1 --2- 172.21.15.44:0/1837175602 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa044072700 0x7fa04414f380 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:16.756 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:16.766+0000 7fa048c00640 1 -- 172.21.15.44:0/1837175602 >> 172.21.15.44:0/1837175602 conn(0x7fa04406c380 msgr2=0x7fa044158500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:47:16.757 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:16.766+0000 7fa048c00640 1 -- 172.21.15.44:0/1837175602 shutdown_connections 2024-04-17T19:47:16.757 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:16.766+0000 7fa048c00640 1 -- 172.21.15.44:0/1837175602 wait complete. 2024-04-17T19:47:16.781 DEBUG:tasks.cephfs.filesystem:fs_config: {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd'], 'max_mds': 5, 'session_timeout': 300} 2024-04-17T19:47:16.781 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs max_mds 5 2024-04-17T19:47:16.938 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:16.949+0000 7f9e49400640 1 Processor -- start 2024-04-17T19:47:16.939 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:16.949+0000 7f9e49400640 1 -- start start 2024-04-17T19:47:16.941 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:16.949+0000 7f9e49400640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f9e44152310 0x7f9e4415be50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:16.941 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:16.949+0000 7f9e49400640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f9e440c7530 0x7f9e440c7940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:16.941 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:16.949+0000 7f9e49400640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9e44157e50 con 0x7f9e44073f10 2024-04-17T19:47:16.941 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:16.949+0000 7f9e49400640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 -- 0x7f9e440c7e80 con 0x7f9e440c7530 2024-04-17T19:47:16.941 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:16.949+0000 7f9e49400640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7f9e4415c390 con 0x7f9e44152310 2024-04-17T19:47:16.942 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:16.949+0000 7f9e43200640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f9e440c7530 0x7f9e440c7940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:16.942 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:16.949+0000 7f9e43200640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f9e440c7530 0x7f9e440c7940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:42496/0 (socket says 172.21.15.44:42496) 2024-04-17T19:47:16.942 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:16.949+0000 7f9e43200640 1 -- 172.21.15.44:0/1244990486 learned_addr learned my addr 172.21.15.44:0/1244990486 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-04-17T19:47:16.942 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:16.949+0000 7f9e41e00640 1 --2- 172.21.15.44:0/1244990486 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f9e44152310 0x7f9e4415be50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:16.942 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:16.949+0000 7f9e43200640 1 -- 172.21.15.44:0/1244990486 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f9e44152310 msgr2=0x7f9e4415be50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T19:47:16.942 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:16.949+0000 7f9e43200640 1 --2- 172.21.15.44:0/1244990486 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f9e44152310 0x7f9e4415be50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:16.942 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:16.949+0000 7f9e43200640 1 -- 172.21.15.44:0/1244990486 >> v1:172.21.15.62:6789/0 conn(0x7f9e44073f10 legacy=0x7f9e441588d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:16.942 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:16.949+0000 7f9e43200640 1 -- 172.21.15.44:0/1244990486 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9e440c4310 con 0x7f9e440c7530 2024-04-17T19:47:16.944 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:16.953+0000 7f9e43200640 1 --2- 172.21.15.44:0/1244990486 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9e440c7530 0x7f9e440c7940 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f9e3c00d150 tx=0x7f9e3c01ec30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8daa71152b24cbed server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:47:16.944 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:16.953+0000 7f9e41400640 1 -- 172.21.15.44:0/1244990486 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e3c00b2d0 con 0x7f9e440c7530 2024-04-17T19:47:16.944 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:16.953+0000 7f9e41400640 1 -- 172.21.15.44:0/1244990486 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9e3c00b470 con 0x7f9e440c7530 2024-04-17T19:47:16.944 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:16.953+0000 7f9e41400640 1 -- 172.21.15.44:0/1244990486 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e3c0a7aa0 con 0x7f9e440c7530 2024-04-17T19:47:16.945 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:16.953+0000 7f9e49400640 1 -- 172.21.15.44:0/1244990486 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9e440c7530 msgr2=0x7f9e440c7940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:16.945 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:16.953+0000 7f9e49400640 1 --2- 172.21.15.44:0/1244990486 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9e440c7530 0x7f9e440c7940 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f9e3c00d150 tx=0x7f9e3c01ec30 comp rx=0 tx=0).stop 2024-04-17T19:47:16.945 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:16.953+0000 7f9e49400640 1 -- 172.21.15.44:0/1244990486 shutdown_connections 2024-04-17T19:47:16.945 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:16.953+0000 7f9e49400640 1 --2- 172.21.15.44:0/1244990486 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9e440c7530 0x7f9e440c7940 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:16.945 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:16.953+0000 7f9e49400640 1 --2- 172.21.15.44:0/1244990486 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f9e44152310 0x7f9e4415be50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:16.945 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:16.953+0000 7f9e49400640 1 -- 172.21.15.44:0/1244990486 >> 172.21.15.44:0/1244990486 conn(0x7f9e4406c380 msgr2=0x7f9e44070080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:47:16.945 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:16.953+0000 7f9e49400640 1 -- 172.21.15.44:0/1244990486 shutdown_connections 2024-04-17T19:47:16.946 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:16.953+0000 7f9e49400640 1 -- 172.21.15.44:0/1244990486 wait complete. 2024-04-17T19:47:16.947 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:16.957+0000 7f9e49400640 1 Processor -- start 2024-04-17T19:47:16.947 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:16.957+0000 7f9e49400640 1 -- start start 2024-04-17T19:47:16.950 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:16.957+0000 7f9e49400640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f9e44073f10 0x7f9e4415aef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:16.950 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:16.957+0000 7f9e49400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9e440c7530 0x7f9e4414bbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:16.950 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:16.957+0000 7f9e49400640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9e44152310 0x7f9e44148330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:16.950 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:16.957+0000 7f9e49400640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f9e440c3ed0 con 0x7f9e440c7530 2024-04-17T19:47:16.951 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:16.957+0000 7f9e49400640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f9e441583b0 con 0x7f9e44152310 2024-04-17T19:47:16.951 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:16.957+0000 7f9e49400640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7f9e440c4050 con 0x7f9e44073f10 2024-04-17T19:47:16.951 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:16.957+0000 7f9e41e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9e440c7530 0x7f9e4414bbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:16.951 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:16.957+0000 7f9e41e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9e440c7530 0x7f9e4414bbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:42504/0 (socket says 172.21.15.44:42504) 2024-04-17T19:47:16.951 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:16.957+0000 7f9e41e00640 1 -- 172.21.15.44:0/2226865468 learned_addr learned my addr 172.21.15.44:0/2226865468 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-04-17T19:47:16.951 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:16.957+0000 7f9e43200640 1 --2- 172.21.15.44:0/2226865468 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9e44152310 0x7f9e44148330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:16.951 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:16.957+0000 7f9e42800640 1 --2- 172.21.15.44:0/2226865468 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f9e44073f10 0x7f9e4415aef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:16.951 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:16.957+0000 7f9e41e00640 1 -- 172.21.15.44:0/2226865468 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f9e44073f10 msgr2=0x7f9e4415aef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:16.951 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:16.957+0000 7f9e41e00640 1 --2- 172.21.15.44:0/2226865468 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f9e44073f10 0x7f9e4415aef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:16.951 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:16.957+0000 7f9e41e00640 1 -- 172.21.15.44:0/2226865468 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9e44152310 msgr2=0x7f9e44148330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:16.951 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:16.957+0000 7f9e41e00640 1 --2- 172.21.15.44:0/2226865468 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9e44152310 0x7f9e44148330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:16.951 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:16.957+0000 7f9e41e00640 1 -- 172.21.15.44:0/2226865468 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9e4415b430 con 0x7f9e440c7530 2024-04-17T19:47:16.951 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:16.957+0000 7f9e43200640 1 --2- 172.21.15.44:0/2226865468 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9e44152310 0x7f9e44148330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-17T19:47:16.951 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:16.957+0000 7f9e42800640 1 --2- 172.21.15.44:0/2226865468 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f9e44073f10 0x7f9e4415aef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-17T19:47:16.951 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:16.957+0000 7f9e41e00640 1 --2- 172.21.15.44:0/2226865468 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9e440c7530 0x7f9e4414bbe0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f9e3000d620 tx=0x7f9e3000dae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:47:16.952 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:16.957+0000 7f9e3aa00640 1 -- 172.21.15.44:0/2226865468 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e3000b620 con 0x7f9e440c7530 2024-04-17T19:47:16.952 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:16.957+0000 7f9e3aa00640 1 -- 172.21.15.44:0/2226865468 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9e30019070 con 0x7f9e440c7530 2024-04-17T19:47:16.952 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:16.957+0000 7f9e49400640 1 -- 172.21.15.44:0/2226865468 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9e441f4d80 con 0x7f9e440c7530 2024-04-17T19:47:16.952 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:16.957+0000 7f9e3aa00640 1 -- 172.21.15.44:0/2226865468 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e3000b9e0 con 0x7f9e440c7530 2024-04-17T19:47:16.952 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:16.957+0000 7f9e49400640 1 -- 172.21.15.44:0/2226865468 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9e4415a130 con 0x7f9e440c7530 2024-04-17T19:47:16.952 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:16.961+0000 7f9e49400640 1 -- 172.21.15.44:0/2226865468 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9e4404ff10 con 0x7f9e440c7530 2024-04-17T19:47:16.952 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:16.961+0000 7f9e3aa00640 1 -- 172.21.15.44:0/2226865468 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f9e3000bb80 con 0x7f9e440c7530 2024-04-17T19:47:16.953 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:16.961+0000 7f9e3aa00640 1 --2- 172.21.15.44:0/2226865468 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f9e24068400 0x7f9e2406a910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:16.953 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:16.961+0000 7f9e3aa00640 1 -- 172.21.15.44:0/2226865468 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f9e30087100 con 0x7f9e440c7530 2024-04-17T19:47:16.953 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:16.961+0000 7f9e42800640 1 --2- 172.21.15.44:0/2226865468 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f9e24068400 0x7f9e2406a910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:16.954 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:16.965+0000 7f9e42800640 1 --2- 172.21.15.44:0/2226865468 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f9e24068400 0x7f9e2406a910 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f9e34001670 tx=0x7f9e34009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:47:16.957 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:16.965+0000 7f9e3aa00640 1 -- 172.21.15.44:0/2226865468 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f9e30057350 con 0x7f9e440c7530 2024-04-17T19:47:17.157 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:17.165+0000 7f9e49400640 1 -- 172.21.15.44:0/2226865468 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"} v 0) -- 0x7f9e4414c930 con 0x7f9e440c7530 2024-04-17T19:47:17.762 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:17.769+0000 7f9e3aa00640 1 -- 172.21.15.44:0/2226865468 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]=0 v8) ==== 105+0+0 (secure 0 0 0) 0x7f9e30056c50 con 0x7f9e440c7530 2024-04-17T19:47:17.765 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:17.773+0000 7f9e49400640 1 -- 172.21.15.44:0/2226865468 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f9e24068400 msgr2=0x7f9e2406a910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:17.765 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:17.773+0000 7f9e49400640 1 --2- 172.21.15.44:0/2226865468 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f9e24068400 0x7f9e2406a910 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f9e34001670 tx=0x7f9e34009040 comp rx=0 tx=0).stop 2024-04-17T19:47:17.765 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:17.773+0000 7f9e49400640 1 -- 172.21.15.44:0/2226865468 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9e440c7530 msgr2=0x7f9e4414bbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:17.765 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:17.773+0000 7f9e49400640 1 --2- 172.21.15.44:0/2226865468 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9e440c7530 0x7f9e4414bbe0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f9e3000d620 tx=0x7f9e3000dae0 comp rx=0 tx=0).stop 2024-04-17T19:47:17.765 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:17.773+0000 7f9e49400640 1 -- 172.21.15.44:0/2226865468 shutdown_connections 2024-04-17T19:47:17.766 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:17.773+0000 7f9e49400640 1 --2- 172.21.15.44:0/2226865468 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f9e24068400 0x7f9e2406a910 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:17.766 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:17.773+0000 7f9e49400640 1 --2- 172.21.15.44:0/2226865468 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9e44152310 0x7f9e44148330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:17.766 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:17.773+0000 7f9e49400640 1 --2- 172.21.15.44:0/2226865468 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9e440c7530 0x7f9e4414bbe0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:17.766 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:17.773+0000 7f9e49400640 1 --2- 172.21.15.44:0/2226865468 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f9e44073f10 0x7f9e4415aef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:17.766 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:17.773+0000 7f9e49400640 1 -- 172.21.15.44:0/2226865468 >> 172.21.15.44:0/2226865468 conn(0x7f9e4406c380 msgr2=0x7f9e4414efa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:47:17.766 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:17.773+0000 7f9e49400640 1 -- 172.21.15.44:0/2226865468 shutdown_connections 2024-04-17T19:47:17.766 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:17.773+0000 7f9e49400640 1 -- 172.21.15.44:0/2226865468 wait complete. 2024-04-17T19:47:17.790 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-04-17T19:47:17.950 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:17.957+0000 7ff721e00640 1 Processor -- start 2024-04-17T19:47:17.950 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:17.957+0000 7ff721e00640 1 -- start start 2024-04-17T19:47:17.952 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:17.961+0000 7ff721e00640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7ff71c155db0 0x7ff71c15f320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:17.953 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:17.961+0000 7ff721e00640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7ff71c15f860 0x7ff71c166370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:17.953 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:17.961+0000 7ff721e00640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff71c070d30 con 0x7ff71c070740 2024-04-17T19:47:17.953 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:17.961+0000 7ff721e00640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 -- 0x7ff71c070fd0 con 0x7ff71c15f860 2024-04-17T19:47:17.953 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:17.961+0000 7ff721e00640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7ff71c06d760 con 0x7ff71c155db0 2024-04-17T19:47:17.953 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:17.961+0000 7ff720a00640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7ff71c070740 0x7ff71c0ca450 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:50360/0 (socket says 172.21.15.44:50360) 2024-04-17T19:47:17.953 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:17.961+0000 7ff720a00640 1 -- 172.21.15.44:0/2203796433 learned_addr learned my addr 172.21.15.44:0/2203796433 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-04-17T19:47:17.953 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:17.961+0000 7ff721400640 1 --2- 172.21.15.44:0/2203796433 >> v2:172.21.15.62:3300/0 conn(0x7ff71c15f860 0x7ff71c166370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:17.953 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:17.961+0000 7ff71be00640 1 --2- 172.21.15.44:0/2203796433 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7ff71c155db0 0x7ff71c15f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:17.953 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:17.961+0000 7ff71b400640 1 -- 172.21.15.44:0/2203796433 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2843897309 0 0) 0x7ff71c070d30 con 0x7ff71c070740 2024-04-17T19:47:17.953 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:17.961+0000 7ff71b400640 1 -- 172.21.15.44:0/2203796433 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff704003530 con 0x7ff71c070740 2024-04-17T19:47:17.954 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:17.961+0000 7ff721400640 1 -- 172.21.15.44:0/2203796433 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7ff71c155db0 msgr2=0x7ff71c15f320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T19:47:17.954 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:17.961+0000 7ff721400640 1 --2- 172.21.15.44:0/2203796433 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7ff71c155db0 0x7ff71c15f320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:17.954 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:17.961+0000 7ff71b400640 1 -- 172.21.15.44:0/2203796433 <== mon.0 v1:172.21.15.44:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3289073195 0 0) 0x7ff704003530 con 0x7ff71c070740 2024-04-17T19:47:17.954 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:17.961+0000 7ff721400640 1 -- 172.21.15.44:0/2203796433 >> v1:172.21.15.44:6789/0 conn(0x7ff71c070740 legacy=0x7ff71c0ca450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:17.954 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:17.961+0000 7ff721400640 1 -- 172.21.15.44:0/2203796433 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff71c06da40 con 0x7ff71c15f860 2024-04-17T19:47:17.954 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:17.961+0000 7ff71be00640 1 --2- 172.21.15.44:0/2203796433 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7ff71c155db0 0x7ff71c15f320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-17T19:47:17.956 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:17.965+0000 7ff721400640 1 --2- 172.21.15.44:0/2203796433 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff71c15f860 0x7ff71c166370 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7ff714009d90 tx=0x7ff71401c890 comp rx=0 tx=0).ready entity=mon.1 client_cookie=311c47af2adbfb42 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:47:17.957 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:17.965+0000 7ff71b400640 1 -- 172.21.15.44:0/2203796433 <== mon.1 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7140b2070 con 0x7ff71c15f860 2024-04-17T19:47:17.957 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:17.965+0000 7ff71b400640 1 -- 172.21.15.44:0/2203796433 <== mon.1 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff7140a5580 con 0x7ff71c15f860 2024-04-17T19:47:17.957 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:17.965+0000 7ff71b400640 1 -- 172.21.15.44:0/2203796433 <== mon.1 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff710001680 con 0x7ff71c15f860 2024-04-17T19:47:17.958 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:17.965+0000 7ff721e00640 1 -- 172.21.15.44:0/2203796433 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff71c15f860 msgr2=0x7ff71c166370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:17.958 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:17.965+0000 7ff721e00640 1 --2- 172.21.15.44:0/2203796433 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff71c15f860 0x7ff71c166370 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7ff714009d90 tx=0x7ff71401c890 comp rx=0 tx=0).stop 2024-04-17T19:47:17.958 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:17.965+0000 7ff721e00640 1 -- 172.21.15.44:0/2203796433 shutdown_connections 2024-04-17T19:47:17.958 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:17.965+0000 7ff721e00640 1 --2- 172.21.15.44:0/2203796433 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff71c15f860 0x7ff71c166370 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:17.958 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:17.965+0000 7ff721e00640 1 --2- 172.21.15.44:0/2203796433 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7ff71c155db0 0x7ff71c15f320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:17.958 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:17.965+0000 7ff721e00640 1 -- 172.21.15.44:0/2203796433 >> 172.21.15.44:0/2203796433 conn(0x7ff71c072660 msgr2=0x7ff71c072aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:47:17.958 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:17.965+0000 7ff721e00640 1 -- 172.21.15.44:0/2203796433 shutdown_connections 2024-04-17T19:47:17.958 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:17.965+0000 7ff721e00640 1 -- 172.21.15.44:0/2203796433 wait complete. 2024-04-17T19:47:17.960 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:17.969+0000 7ff721e00640 1 Processor -- start 2024-04-17T19:47:17.960 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:17.969+0000 7ff721e00640 1 -- start start 2024-04-17T19:47:17.963 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:17.969+0000 7ff721e00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff71c070740 0x7ff71c156a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:17.963 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:17.969+0000 7ff721e00640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7ff71c155db0 0x7ff71c158d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:17.963 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:17.969+0000 7ff721e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff71c15f860 0x7ff71c1f7ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:17.963 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:17.969+0000 7ff721e00640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7ff71c1561c0 con 0x7ff71c15f860 2024-04-17T19:47:17.963 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:17.969+0000 7ff721e00640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7ff71c15fc70 con 0x7ff71c070740 2024-04-17T19:47:17.963 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:17.969+0000 7ff721e00640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7ff71c0c5d60 con 0x7ff71c155db0 2024-04-17T19:47:17.964 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:17.969+0000 7ff721400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff71c15f860 0x7ff71c1f7ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:17.964 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:17.969+0000 7ff721400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff71c15f860 0x7ff71c1f7ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:42512/0 (socket says 172.21.15.44:42512) 2024-04-17T19:47:17.964 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:17.969+0000 7ff721400640 1 -- 172.21.15.44:0/215887195 learned_addr learned my addr 172.21.15.44:0/215887195 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-04-17T19:47:17.964 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:17.969+0000 7ff71be00640 1 --2- 172.21.15.44:0/215887195 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7ff71c155db0 0x7ff71c158d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:17.964 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:17.969+0000 7ff720a00640 1 --2- 172.21.15.44:0/215887195 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff71c070740 0x7ff71c156a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:17.964 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:17.973+0000 7ff721400640 1 -- 172.21.15.44:0/215887195 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7ff71c155db0 msgr2=0x7ff71c158d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:17.964 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:17.973+0000 7ff721400640 1 --2- 172.21.15.44:0/215887195 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7ff71c155db0 0x7ff71c158d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:17.964 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:17.973+0000 7ff721400640 1 -- 172.21.15.44:0/215887195 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff71c070740 msgr2=0x7ff71c156a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:17.964 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:17.973+0000 7ff721400640 1 --2- 172.21.15.44:0/215887195 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff71c070740 0x7ff71c156a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:17.964 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:17.973+0000 7ff721400640 1 -- 172.21.15.44:0/215887195 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff71c156fa0 con 0x7ff71c15f860 2024-04-17T19:47:17.964 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:17.973+0000 7ff720a00640 1 --2- 172.21.15.44:0/215887195 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff71c070740 0x7ff71c156a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-17T19:47:17.964 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:17.973+0000 7ff721400640 1 --2- 172.21.15.44:0/215887195 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff71c15f860 0x7ff71c1f7ff0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7ff71401d130 tx=0x7ff714019630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:47:17.964 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:17.973+0000 7ff718c00640 1 -- 172.21.15.44:0/215887195 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7140bd020 con 0x7ff71c15f860 2024-04-17T19:47:17.965 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:17.973+0000 7ff718c00640 1 -- 172.21.15.44:0/215887195 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff7140b8670 con 0x7ff71c15f860 2024-04-17T19:47:17.965 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:17.973+0000 7ff718c00640 1 -- 172.21.15.44:0/215887195 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7140b2040 con 0x7ff71c15f860 2024-04-17T19:47:17.965 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:17.973+0000 7ff721e00640 1 -- 172.21.15.44:0/215887195 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff71c151420 con 0x7ff71c15f860 2024-04-17T19:47:17.965 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:17.973+0000 7ff721e00640 1 -- 172.21.15.44:0/215887195 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff71c0cf400 con 0x7ff71c15f860 2024-04-17T19:47:17.965 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:17.973+0000 7ff721e00640 1 -- 172.21.15.44:0/215887195 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff71c04fea0 con 0x7ff71c15f860 2024-04-17T19:47:17.965 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:17.973+0000 7ff718c00640 1 -- 172.21.15.44:0/215887195 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7ff7140c0020 con 0x7ff71c15f860 2024-04-17T19:47:17.966 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:17.973+0000 7ff718c00640 1 --2- 172.21.15.44:0/215887195 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7ff6fc0683b0 0x7ff6fc06a8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:17.966 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:17.973+0000 7ff718c00640 1 -- 172.21.15.44:0/215887195 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7ff714121980 con 0x7ff71c15f860 2024-04-17T19:47:17.966 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:17.977+0000 7ff720a00640 1 --2- 172.21.15.44:0/215887195 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7ff6fc0683b0 0x7ff6fc06a8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:17.967 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:17.977+0000 7ff720a00640 1 --2- 172.21.15.44:0/215887195 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7ff6fc0683b0 0x7ff6fc06a8c0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7ff710007a10 tx=0x7ff710009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:47:17.970 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:17.977+0000 7ff718c00640 1 -- 172.21.15.44:0/215887195 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7ff7140c7030 con 0x7ff71c15f860 2024-04-17T19:47:18.174 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:18.181+0000 7ff721e00640 1 -- 172.21.15.44:0/215887195 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7ff71c06d330 con 0x7ff71c15f860 2024-04-17T19:47:18.777 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:18.785+0000 7ff718c00640 1 -- 172.21.15.44:0/215887195 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v10) ==== 122+0+0 (secure 0 0 0) 0x7ff714016480 con 0x7ff71c15f860 2024-04-17T19:47:18.780 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:18.789+0000 7ff721e00640 1 -- 172.21.15.44:0/215887195 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7ff6fc0683b0 msgr2=0x7ff6fc06a8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:18.781 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:18.789+0000 7ff721e00640 1 --2- 172.21.15.44:0/215887195 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7ff6fc0683b0 0x7ff6fc06a8c0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7ff710007a10 tx=0x7ff710009040 comp rx=0 tx=0).stop 2024-04-17T19:47:18.781 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:18.789+0000 7ff721e00640 1 -- 172.21.15.44:0/215887195 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff71c15f860 msgr2=0x7ff71c1f7ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:18.781 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:18.789+0000 7ff721e00640 1 --2- 172.21.15.44:0/215887195 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff71c15f860 0x7ff71c1f7ff0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7ff71401d130 tx=0x7ff714019630 comp rx=0 tx=0).stop 2024-04-17T19:47:18.781 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:18.789+0000 7ff721e00640 1 -- 172.21.15.44:0/215887195 shutdown_connections 2024-04-17T19:47:18.781 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:18.789+0000 7ff721e00640 1 --2- 172.21.15.44:0/215887195 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7ff6fc0683b0 0x7ff6fc06a8c0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:18.781 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:18.789+0000 7ff721e00640 1 --2- 172.21.15.44:0/215887195 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7ff71c155db0 0x7ff71c158d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:18.781 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:18.789+0000 7ff721e00640 1 --2- 172.21.15.44:0/215887195 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff71c15f860 0x7ff71c1f7ff0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:18.781 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:18.789+0000 7ff721e00640 1 --2- 172.21.15.44:0/215887195 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff71c070740 0x7ff71c156a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:18.781 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:18.789+0000 7ff721e00640 1 -- 172.21.15.44:0/215887195 >> 172.21.15.44:0/215887195 conn(0x7ff71c072660 msgr2=0x7ff71c154730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:47:18.781 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:18.789+0000 7ff721e00640 1 -- 172.21.15.44:0/215887195 shutdown_connections 2024-04-17T19:47:18.782 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:18.789+0000 7ff721e00640 1 -- 172.21.15.44:0/215887195 wait complete. 2024-04-17T19:47:18.805 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs session_timeout 300 2024-04-17T19:47:18.965 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:18.973+0000 7f38e8200640 1 Processor -- start 2024-04-17T19:47:18.965 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:18.973+0000 7f38e8200640 1 -- start start 2024-04-17T19:47:18.967 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:18.977+0000 7f38e8200640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f38e015bbf0 0x7f38e00c9750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:18.967 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:18.977+0000 7f38e8200640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f38e0155d60 0x7f38e00ceb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:18.967 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:18.977+0000 7f38e8200640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f38e006e430 con 0x7f38e00cf0d0 2024-04-17T19:47:18.967 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:18.977+0000 7f38e8200640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 -- 0x7f38e00c4860 con 0x7f38e0155d60 2024-04-17T19:47:18.967 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:18.977+0000 7f38e8200640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7f38e015c0a0 con 0x7f38e015bbf0 2024-04-17T19:47:18.968 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:18.977+0000 7f38e4e00640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f38e0155d60 0x7f38e00ceb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:18.968 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:18.977+0000 7f38e6200640 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f38e00cf0d0 0x7f38e00c4cf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.44:60800/0 (socket says 172.21.15.44:60800) 2024-04-17T19:47:18.968 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:18.977+0000 7f38e6200640 1 -- 172.21.15.44:0/407409838 learned_addr learned my addr 172.21.15.44:0/407409838 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-04-17T19:47:18.969 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:18.977+0000 7f38e5800640 1 --2- 172.21.15.44:0/407409838 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f38e015bbf0 0x7f38e00c9750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:18.969 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:18.977+0000 7f38e4e00640 1 -- 172.21.15.44:0/407409838 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f38e015bbf0 msgr2=0x7f38e00c9750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T19:47:18.969 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:18.977+0000 7f38e4e00640 1 --2- 172.21.15.44:0/407409838 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f38e015bbf0 0x7f38e00c9750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:18.969 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:18.977+0000 7f38e4e00640 1 -- 172.21.15.44:0/407409838 >> v1:172.21.15.62:6789/0 conn(0x7f38e00cf0d0 legacy=0x7f38e00c4cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:18.969 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:18.977+0000 7f38e4e00640 1 -- 172.21.15.44:0/407409838 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f38e015c380 con 0x7f38e0155d60 2024-04-17T19:47:18.971 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:18.981+0000 7f38e4e00640 1 --2- 172.21.15.44:0/407409838 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f38e0155d60 0x7f38e00ceb90 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f38cc0097c0 tx=0x7f38cc01ec90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8a3e65f364376c3c server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:47:18.972 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:18.981+0000 7f38dfe00640 1 -- 172.21.15.44:0/407409838 <== mon.1 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38cc0b5070 con 0x7f38e0155d60 2024-04-17T19:47:18.972 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:18.981+0000 7f38dfe00640 1 -- 172.21.15.44:0/407409838 <== mon.1 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f38cc0a8990 con 0x7f38e0155d60 2024-04-17T19:47:18.972 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:18.981+0000 7f38dfe00640 1 -- 172.21.15.44:0/407409838 <== mon.1 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38cc0a8d60 con 0x7f38e0155d60 2024-04-17T19:47:18.973 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:18.981+0000 7f38e8200640 1 -- 172.21.15.44:0/407409838 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f38e0155d60 msgr2=0x7f38e00ceb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:18.973 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:18.981+0000 7f38e8200640 1 --2- 172.21.15.44:0/407409838 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f38e0155d60 0x7f38e00ceb90 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f38cc0097c0 tx=0x7f38cc01ec90 comp rx=0 tx=0).stop 2024-04-17T19:47:18.973 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:18.981+0000 7f38e8200640 1 -- 172.21.15.44:0/407409838 shutdown_connections 2024-04-17T19:47:18.973 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:18.981+0000 7f38e8200640 1 --2- 172.21.15.44:0/407409838 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f38e0155d60 0x7f38e00ceb90 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:18.973 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:18.981+0000 7f38e8200640 1 --2- 172.21.15.44:0/407409838 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f38e015bbf0 0x7f38e00c9750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:18.973 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:18.981+0000 7f38e8200640 1 -- 172.21.15.44:0/407409838 >> 172.21.15.44:0/407409838 conn(0x7f38e0070a10 msgr2=0x7f38e0067ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:47:18.973 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:18.981+0000 7f38e8200640 1 -- 172.21.15.44:0/407409838 shutdown_connections 2024-04-17T19:47:18.973 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:18.981+0000 7f38e8200640 1 -- 172.21.15.44:0/407409838 wait complete. 2024-04-17T19:47:18.975 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:18.985+0000 7f38e8200640 1 Processor -- start 2024-04-17T19:47:18.975 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:18.985+0000 7f38e8200640 1 -- start start 2024-04-17T19:47:18.977 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:18.985+0000 7f38e8200640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f38e00cf0d0 0x7f38e015efd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:18.977 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:18.985+0000 7f38e8200640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f38e0155d60 0x7f38e015dcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:18.977 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:18.985+0000 7f38e8200640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f38e015bbf0 0x7f38e00cdd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:18.977 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:18.985+0000 7f38e8200640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f38e0156170 con 0x7f38e00cf0d0 2024-04-17T19:47:18.977 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:18.985+0000 7f38e8200640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f38e015c940 con 0x7f38e0155d60 2024-04-17T19:47:18.978 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:18.985+0000 7f38e8200640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7f38e01562f0 con 0x7f38e015bbf0 2024-04-17T19:47:18.978 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:18.985+0000 7f38e5800640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f38e00cf0d0 0x7f38e015efd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:18.978 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:18.985+0000 7f38e5800640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f38e00cf0d0 0x7f38e015efd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:42528/0 (socket says 172.21.15.44:42528) 2024-04-17T19:47:18.978 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:18.985+0000 7f38e5800640 1 -- 172.21.15.44:0/2425345877 learned_addr learned my addr 172.21.15.44:0/2425345877 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-04-17T19:47:18.978 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:18.985+0000 7f38e4e00640 1 --2- 172.21.15.44:0/2425345877 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f38e0155d60 0x7f38e015dcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:18.978 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:18.985+0000 7f38e6200640 1 --2- 172.21.15.44:0/2425345877 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f38e015bbf0 0x7f38e00cdd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:18.978 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:18.985+0000 7f38e5800640 1 -- 172.21.15.44:0/2425345877 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f38e015bbf0 msgr2=0x7f38e00cdd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:18.978 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:18.985+0000 7f38e5800640 1 --2- 172.21.15.44:0/2425345877 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f38e015bbf0 0x7f38e00cdd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:18.978 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:18.985+0000 7f38e5800640 1 -- 172.21.15.44:0/2425345877 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f38e0155d60 msgr2=0x7f38e015dcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:18.978 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:18.985+0000 7f38e5800640 1 --2- 172.21.15.44:0/2425345877 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f38e0155d60 0x7f38e015dcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:18.978 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:18.985+0000 7f38e5800640 1 -- 172.21.15.44:0/2425345877 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f38e015e1f0 con 0x7f38e00cf0d0 2024-04-17T19:47:18.978 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:18.985+0000 7f38e5800640 1 --2- 172.21.15.44:0/2425345877 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f38e00cf0d0 0x7f38e015efd0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f38d400e870 tx=0x7f38d400ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:47:18.980 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:18.985+0000 7f38dd600640 1 -- 172.21.15.44:0/2425345877 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38d4017070 con 0x7f38e00cf0d0 2024-04-17T19:47:18.980 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:18.985+0000 7f38dd600640 1 -- 172.21.15.44:0/2425345877 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f38d400c940 con 0x7f38e00cf0d0 2024-04-17T19:47:18.980 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:18.985+0000 7f38e8200640 1 -- 172.21.15.44:0/2425345877 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f38e015cef0 con 0x7f38e00cf0d0 2024-04-17T19:47:18.980 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:18.985+0000 7f38dd600640 1 -- 172.21.15.44:0/2425345877 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38d400ccf0 con 0x7f38e00cf0d0 2024-04-17T19:47:18.980 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:18.985+0000 7f38e8200640 1 -- 172.21.15.44:0/2425345877 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f38e015d4b0 con 0x7f38e00cf0d0 2024-04-17T19:47:18.980 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:18.989+0000 7f38e8200640 1 -- 172.21.15.44:0/2425345877 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f38e015e3c0 con 0x7f38e00cf0d0 2024-04-17T19:47:18.980 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:18.989+0000 7f38dd600640 1 -- 172.21.15.44:0/2425345877 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f38d401a070 con 0x7f38e00cf0d0 2024-04-17T19:47:18.981 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:18.989+0000 7f38dd600640 1 --2- 172.21.15.44:0/2425345877 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f38c0068380 0x7f38c006a890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:18.981 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:18.989+0000 7f38dd600640 1 -- 172.21.15.44:0/2425345877 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f38d4086c00 con 0x7f38e00cf0d0 2024-04-17T19:47:18.981 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:18.989+0000 7f38e4e00640 1 --2- 172.21.15.44:0/2425345877 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f38c0068380 0x7f38c006a890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:18.982 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:18.989+0000 7f38e4e00640 1 --2- 172.21.15.44:0/2425345877 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f38c0068380 0x7f38c006a890 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f38cc0b2000 tx=0x7f38cc008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:47:18.985 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:18.993+0000 7f38dd600640 1 -- 172.21.15.44:0/2425345877 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f38d4056700 con 0x7f38e00cf0d0 2024-04-17T19:47:19.186 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:19.193+0000 7f38e8200640 1 -- 172.21.15.44:0/2425345877 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"} v 0) -- 0x7f38e004ff10 con 0x7f38e00cf0d0 2024-04-17T19:47:19.780 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:19.789+0000 7f38dd600640 1 -- 172.21.15.44:0/2425345877 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]=0 v11) ==== 115+0+0 (secure 0 0 0) 0x7f38d405aa00 con 0x7f38e00cf0d0 2024-04-17T19:47:19.782 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:19.789+0000 7f38e8200640 1 -- 172.21.15.44:0/2425345877 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f38c0068380 msgr2=0x7f38c006a890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:19.783 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:19.789+0000 7f38e8200640 1 --2- 172.21.15.44:0/2425345877 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f38c0068380 0x7f38c006a890 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f38cc0b2000 tx=0x7f38cc008040 comp rx=0 tx=0).stop 2024-04-17T19:47:19.783 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:19.789+0000 7f38e8200640 1 -- 172.21.15.44:0/2425345877 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f38e00cf0d0 msgr2=0x7f38e015efd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:19.783 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:19.789+0000 7f38e8200640 1 --2- 172.21.15.44:0/2425345877 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f38e00cf0d0 0x7f38e015efd0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f38d400e870 tx=0x7f38d400ec70 comp rx=0 tx=0).stop 2024-04-17T19:47:19.783 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:19.789+0000 7f38e8200640 1 -- 172.21.15.44:0/2425345877 shutdown_connections 2024-04-17T19:47:19.783 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:19.789+0000 7f38e8200640 1 --2- 172.21.15.44:0/2425345877 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f38c0068380 0x7f38c006a890 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:19.783 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:19.789+0000 7f38e8200640 1 --2- 172.21.15.44:0/2425345877 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f38e015bbf0 0x7f38e00cdd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:19.783 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:19.789+0000 7f38e8200640 1 --2- 172.21.15.44:0/2425345877 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f38e0155d60 0x7f38e015dcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:19.783 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:19.789+0000 7f38e8200640 1 --2- 172.21.15.44:0/2425345877 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f38e00cf0d0 0x7f38e015efd0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:19.783 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:19.789+0000 7f38e8200640 1 -- 172.21.15.44:0/2425345877 >> 172.21.15.44:0/2425345877 conn(0x7f38e0070a10 msgr2=0x7f38e01541b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:47:19.783 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:19.789+0000 7f38e8200640 1 -- 172.21.15.44:0/2425345877 shutdown_connections 2024-04-17T19:47:19.783 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:19.789+0000 7f38e8200640 1 -- 172.21.15.44:0/2425345877 wait complete. 2024-04-17T19:47:19.806 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-04-17T19:47:19.806 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-17T19:47:19.961 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:19.969+0000 7f53f5000640 1 Processor -- start 2024-04-17T19:47:19.961 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:19.969+0000 7f53f5000640 1 -- start start 2024-04-17T19:47:19.964 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:19.973+0000 7f53f5000640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f53f0073ca0 0x7f53f00c6ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:19.964 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:19.973+0000 7f53f5000640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f53f00c73f0 0x7f53f0157f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:19.964 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:19.973+0000 7f53f5000640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f53f00c6060 con 0x7f53f01520c0 2024-04-17T19:47:19.964 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:19.973+0000 7f53f5000640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 -- 0x7f53f00c4aa0 con 0x7f53f0073ca0 2024-04-17T19:47:19.964 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:19.973+0000 7f53f5000640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 -- 0x7f53f00c79c0 con 0x7f53f00c73f0 2024-04-17T19:47:19.965 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:19.973+0000 7f53ede00640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f53f0073ca0 0x7f53f00c6ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:19.965 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:19.973+0000 7f53ede00640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f53f0073ca0 0x7f53f00c6ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:42542/0 (socket says 172.21.15.44:42542) 2024-04-17T19:47:19.965 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:19.973+0000 7f53ede00640 1 -- 172.21.15.44:0/1819984245 learned_addr learned my addr 172.21.15.44:0/1819984245 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-04-17T19:47:19.965 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:19.973+0000 7f53ed400640 1 --2- 172.21.15.44:0/1819984245 >> v2:172.21.15.62:3300/0 conn(0x7f53f00c73f0 0x7f53f0157f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:19.965 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:19.973+0000 7f53ede00640 1 -- 172.21.15.44:0/1819984245 >> v2:172.21.15.62:3300/0 conn(0x7f53f00c73f0 msgr2=0x7f53f0157f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T19:47:19.965 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:19.973+0000 7f53ede00640 1 --2- 172.21.15.44:0/1819984245 >> v2:172.21.15.62:3300/0 conn(0x7f53f00c73f0 0x7f53f0157f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:19.965 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:19.973+0000 7f53ede00640 1 -- 172.21.15.44:0/1819984245 >> v1:172.21.15.62:6789/0 conn(0x7f53f01520c0 legacy=0x7f53f00c9430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:19.965 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:19.973+0000 7f53ede00640 1 -- 172.21.15.44:0/1819984245 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f53f00c7ca0 con 0x7f53f0073ca0 2024-04-17T19:47:19.965 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:19.973+0000 7f53ed400640 1 --2- 172.21.15.44:0/1819984245 >> v2:172.21.15.62:3300/0 conn(0x7f53f00c73f0 0x7f53f0157f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-17T19:47:19.966 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:19.973+0000 7f53ede00640 1 --2- 172.21.15.44:0/1819984245 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f53f0073ca0 0x7f53f00c6ad0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f53f00ca380 tx=0x7f53e001c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=af8a1ce56ab88c17 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:47:19.967 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:19.977+0000 7f53eca00640 1 -- 172.21.15.44:0/1819984245 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53e00b0070 con 0x7f53f0073ca0 2024-04-17T19:47:19.968 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:19.977+0000 7f53eca00640 1 -- 172.21.15.44:0/1819984245 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f53e00ab600 con 0x7f53f0073ca0 2024-04-17T19:47:19.968 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:19.977+0000 7f53eca00640 1 -- 172.21.15.44:0/1819984245 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53e00ab9d0 con 0x7f53f0073ca0 2024-04-17T19:47:19.968 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:19.977+0000 7f53f5000640 1 -- 172.21.15.44:0/1819984245 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f53f0073ca0 msgr2=0x7f53f00c6ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:19.968 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:19.977+0000 7f53f5000640 1 --2- 172.21.15.44:0/1819984245 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f53f0073ca0 0x7f53f00c6ad0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f53f00ca380 tx=0x7f53e001c520 comp rx=0 tx=0).stop 2024-04-17T19:47:19.968 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:19.977+0000 7f53f5000640 1 -- 172.21.15.44:0/1819984245 shutdown_connections 2024-04-17T19:47:19.968 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:19.977+0000 7f53f5000640 1 --2- 172.21.15.44:0/1819984245 >> v2:172.21.15.62:3300/0 conn(0x7f53f00c73f0 0x7f53f0157f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:19.968 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:19.977+0000 7f53f5000640 1 --2- 172.21.15.44:0/1819984245 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f53f0073ca0 0x7f53f00c6ad0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:19.968 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:19.977+0000 7f53f5000640 1 -- 172.21.15.44:0/1819984245 >> 172.21.15.44:0/1819984245 conn(0x7f53f006c380 msgr2=0x7f53f0070080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:47:19.968 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:19.977+0000 7f53f5000640 1 -- 172.21.15.44:0/1819984245 shutdown_connections 2024-04-17T19:47:19.969 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:19.977+0000 7f53f5000640 1 -- 172.21.15.44:0/1819984245 wait complete. 2024-04-17T19:47:19.969 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:19.977+0000 7f53f5000640 1 Processor -- start 2024-04-17T19:47:19.970 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:19.977+0000 7f53f5000640 1 -- start start 2024-04-17T19:47:19.973 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:19.981+0000 7f53f5000640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f53f0073ca0 0x7f53f0164c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:19.973 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:19.981+0000 7f53f5000640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f53f00c73f0 0x7f53f01537f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:19.973 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:19.981+0000 7f53f5000640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f53f01520c0 0x7f53f01418f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:19.973 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:19.981+0000 7f53f5000640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f53f00c9cc0 con 0x7f53f00c73f0 2024-04-17T19:47:19.973 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:19.981+0000 7f53f5000640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f53f00c9b40 con 0x7f53f01520c0 2024-04-17T19:47:19.973 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:19.981+0000 7f53f5000640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7f53f0166bc0 con 0x7f53f0073ca0 2024-04-17T19:47:19.973 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:19.981+0000 7f53ed400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f53f00c73f0 0x7f53f01537f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:19.973 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:19.981+0000 7f53ed400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f53f00c73f0 0x7f53f01537f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:42550/0 (socket says 172.21.15.44:42550) 2024-04-17T19:47:19.973 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:19.981+0000 7f53ed400640 1 -- 172.21.15.44:0/643122737 learned_addr learned my addr 172.21.15.44:0/643122737 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-04-17T19:47:19.974 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:19.981+0000 7f53ee800640 1 --2- 172.21.15.44:0/643122737 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f53f01520c0 0x7f53f01418f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:19.974 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:19.981+0000 7f53ede00640 1 --2- 172.21.15.44:0/643122737 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f53f0073ca0 0x7f53f0164c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:19.974 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:19.981+0000 7f53ed400640 1 -- 172.21.15.44:0/643122737 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f53f0073ca0 msgr2=0x7f53f0164c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:19.974 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:19.981+0000 7f53ed400640 1 --2- 172.21.15.44:0/643122737 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f53f0073ca0 0x7f53f0164c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:19.974 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:19.981+0000 7f53ed400640 1 -- 172.21.15.44:0/643122737 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f53f01520c0 msgr2=0x7f53f01418f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:19.974 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:19.981+0000 7f53ed400640 1 --2- 172.21.15.44:0/643122737 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f53f01520c0 0x7f53f01418f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:19.974 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:19.981+0000 7f53ed400640 1 -- 172.21.15.44:0/643122737 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f53f0165160 con 0x7f53f00c73f0 2024-04-17T19:47:19.974 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:19.981+0000 7f53ed400640 1 --2- 172.21.15.44:0/643122737 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f53f00c73f0 0x7f53f01537f0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f53dc00d830 tx=0x7f53dc00dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:47:19.974 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:19.981+0000 7f53e6000640 1 -- 172.21.15.44:0/643122737 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53dc0096a0 con 0x7f53f00c73f0 2024-04-17T19:47:19.975 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:19.981+0000 7f53e6000640 1 -- 172.21.15.44:0/643122737 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f53dc019070 con 0x7f53f00c73f0 2024-04-17T19:47:19.975 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:19.981+0000 7f53e6000640 1 -- 172.21.15.44:0/643122737 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53dc009a60 con 0x7f53f00c73f0 2024-04-17T19:47:19.975 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:19.981+0000 7f53f5000640 1 -- 172.21.15.44:0/643122737 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f53f0140b70 con 0x7f53f00c73f0 2024-04-17T19:47:19.975 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:19.981+0000 7f53f5000640 1 -- 172.21.15.44:0/643122737 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f53f0140460 con 0x7f53f00c73f0 2024-04-17T19:47:19.976 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:19.981+0000 7f53f5000640 1 -- 172.21.15.44:0/643122737 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f53f004ff10 con 0x7f53f00c73f0 2024-04-17T19:47:19.976 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:19.985+0000 7f53e6000640 1 -- 172.21.15.44:0/643122737 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f53dc01e460 con 0x7f53f00c73f0 2024-04-17T19:47:19.976 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:19.985+0000 7f53e6000640 1 --2- 172.21.15.44:0/643122737 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f53d00683b0 0x7f53d006a8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:19.976 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:19.985+0000 7f53e6000640 1 -- 172.21.15.44:0/643122737 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f53dc087220 con 0x7f53f00c73f0 2024-04-17T19:47:19.976 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:19.985+0000 7f53ede00640 1 --2- 172.21.15.44:0/643122737 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f53d00683b0 0x7f53d006a8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:19.977 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:19.985+0000 7f53ede00640 1 --2- 172.21.15.44:0/643122737 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f53d00683b0 0x7f53d006a8c0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f53e00ad000 tx=0x7f53e0008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:47:19.981 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:19.989+0000 7f53e6000640 1 -- 172.21.15.44:0/643122737 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f53dc056db0 con 0x7f53f00c73f0 2024-04-17T19:47:20.178 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:20.185+0000 7f53f5000640 1 -- 172.21.15.44:0/643122737 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f53f0155930 con 0x7f53f00c73f0 2024-04-17T19:47:20.179 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:20.189+0000 7f53e6000640 1 -- 172.21.15.44:0/643122737 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 11 v11) ==== 94+0+6844 (secure 0 0 0) 0x7f53dc05b0b0 con 0x7f53f00c73f0 2024-04-17T19:47:20.179 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-04-17T19:47:20.179 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":11,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4263,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.44:6835/1724891996","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6832","nonce":1724891996},{"type":"v1","addr":"172.21.15.44:6835","nonce":1724891996}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4266,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.44:6836/2201911513","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6833","nonce":2201911513},{"type":"v1","addr":"172.21.15.44:6836","nonce":2201911513}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4268,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.62:6837/3085335335","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6836","nonce":3085335335},{"type":"v1","addr":"172.21.15.62:6837","nonce":3085335335}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4269,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.44:6837/4073536070","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6834","nonce":4073536070},{"type":"v1","addr":"172.21.15.44:6837","nonce":4073536070}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":11,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-17T19:46:56.083202+0000","modified":"2024-04-17T19:47:19.201344+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1],"up":{"mds_0":4306,"mds_1":4294},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4294":{"gid":4294,"name":"d","rank":1,"incarnation":9,"state":"up:creating","state_seq":1,"addr":"172.21.15.62:6835/2585862759","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6834","nonce":2585862759},{"type":"v1","addr":"172.21.15.62:6835","nonce":2585862759}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4306":{"gid":4306,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":5,"addr":"172.21.15.62:6839/1537667111","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6838","nonce":1537667111},{"type":"v1","addr":"172.21.15.62:6839","nonce":1537667111}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4306,"qdb_cluster":[4306]},"id":1}]} 2024-04-17T19:47:20.179 INFO:teuthology.orchestra.run.smithi044.stderr:dumped fsmap epoch 11 2024-04-17T19:47:20.181 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:20.189+0000 7f53f5000640 1 -- 172.21.15.44:0/643122737 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f53d00683b0 msgr2=0x7f53d006a8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:20.181 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:20.189+0000 7f53f5000640 1 --2- 172.21.15.44:0/643122737 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f53d00683b0 0x7f53d006a8c0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f53e00ad000 tx=0x7f53e0008040 comp rx=0 tx=0).stop 2024-04-17T19:47:20.181 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:20.189+0000 7f53f5000640 1 -- 172.21.15.44:0/643122737 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f53f00c73f0 msgr2=0x7f53f01537f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:20.181 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:20.189+0000 7f53f5000640 1 --2- 172.21.15.44:0/643122737 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f53f00c73f0 0x7f53f01537f0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f53dc00d830 tx=0x7f53dc00dcf0 comp rx=0 tx=0).stop 2024-04-17T19:47:20.181 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:20.189+0000 7f53f5000640 1 -- 172.21.15.44:0/643122737 shutdown_connections 2024-04-17T19:47:20.181 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:20.189+0000 7f53f5000640 1 --2- 172.21.15.44:0/643122737 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f53d00683b0 0x7f53d006a8c0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:20.181 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:20.189+0000 7f53f5000640 1 --2- 172.21.15.44:0/643122737 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f53f01520c0 0x7f53f01418f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:20.181 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:20.189+0000 7f53f5000640 1 --2- 172.21.15.44:0/643122737 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f53f00c73f0 0x7f53f01537f0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:20.182 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:20.189+0000 7f53f5000640 1 --2- 172.21.15.44:0/643122737 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f53f0073ca0 0x7f53f0164c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:20.182 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:20.189+0000 7f53f5000640 1 -- 172.21.15.44:0/643122737 >> 172.21.15.44:0/643122737 conn(0x7f53f006c380 msgr2=0x7f53f00cb740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:47:20.182 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:20.189+0000 7f53f5000640 1 -- 172.21.15.44:0/643122737 shutdown_connections 2024-04-17T19:47:20.182 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:20.189+0000 7f53f5000640 1 -- 172.21.15.44:0/643122737 wait complete. 2024-04-17T19:47:20.201 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-17T19:47:20.354 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:20.361+0000 7f0547400640 1 Processor -- start 2024-04-17T19:47:20.354 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:20.361+0000 7f0547400640 1 -- start start 2024-04-17T19:47:20.356 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:20.365+0000 7f0547400640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f054006c620 0x7f05400c8ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:20.356 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:20.365+0000 7f0547400640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f05401641d0 0x7f05401665f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:20.356 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:20.365+0000 7f0547400640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f054006d2e0 con 0x7f054006ca30 2024-04-17T19:47:20.356 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:20.365+0000 7f0547400640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 -- 0x7f054015c7d0 con 0x7f05401641d0 2024-04-17T19:47:20.357 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:20.365+0000 7f0547400640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7f054015c4f0 con 0x7f054006c620 2024-04-17T19:47:20.357 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:20.365+0000 7f0545400640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f05401641d0 0x7f05401665f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:20.357 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:20.365+0000 7f0544a00640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f054006c620 0x7f05400c8ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:20.357 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:20.365+0000 7f053fe00640 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f054006ca30 0x7f05400c91e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.44:60814/0 (socket says 172.21.15.44:60814) 2024-04-17T19:47:20.357 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:20.365+0000 7f053fe00640 1 -- 172.21.15.44:0/2687608465 learned_addr learned my addr 172.21.15.44:0/2687608465 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-04-17T19:47:20.357 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:20.365+0000 7f0545400640 1 -- 172.21.15.44:0/2687608465 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f054006c620 msgr2=0x7f05400c8ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T19:47:20.358 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:20.365+0000 7f0545400640 1 --2- 172.21.15.44:0/2687608465 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f054006c620 0x7f05400c8ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:20.358 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:20.365+0000 7f0545400640 1 -- 172.21.15.44:0/2687608465 >> v1:172.21.15.62:6789/0 conn(0x7f054006ca30 legacy=0x7f05400c91e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:20.358 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:20.365+0000 7f0545400640 1 -- 172.21.15.44:0/2687608465 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f054006be20 con 0x7f05401641d0 2024-04-17T19:47:20.360 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:20.369+0000 7f0545400640 1 --2- 172.21.15.44:0/2687608465 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f05401641d0 0x7f05401665f0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f0538009d90 tx=0x7f053801f150 comp rx=0 tx=0).ready entity=mon.1 client_cookie=79f75bd5d580d336 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:47:20.360 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:20.369+0000 7f053f400640 1 -- 172.21.15.44:0/2687608465 <== mon.1 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05380b4070 con 0x7f05401641d0 2024-04-17T19:47:20.360 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:20.369+0000 7f053f400640 1 -- 172.21.15.44:0/2687608465 <== mon.1 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f05380af600 con 0x7f05401641d0 2024-04-17T19:47:20.360 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:20.369+0000 7f053f400640 1 -- 172.21.15.44:0/2687608465 <== mon.1 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05380af9d0 con 0x7f05401641d0 2024-04-17T19:47:20.361 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:20.369+0000 7f0547400640 1 -- 172.21.15.44:0/2687608465 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f05401641d0 msgr2=0x7f05401665f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:20.361 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:20.369+0000 7f0547400640 1 --2- 172.21.15.44:0/2687608465 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f05401641d0 0x7f05401665f0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f0538009d90 tx=0x7f053801f150 comp rx=0 tx=0).stop 2024-04-17T19:47:20.362 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:20.369+0000 7f0547400640 1 -- 172.21.15.44:0/2687608465 shutdown_connections 2024-04-17T19:47:20.362 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:20.369+0000 7f0547400640 1 --2- 172.21.15.44:0/2687608465 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f05401641d0 0x7f05401665f0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:20.362 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:20.369+0000 7f0547400640 1 --2- 172.21.15.44:0/2687608465 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f054006c620 0x7f05400c8ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:20.362 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:20.369+0000 7f0547400640 1 -- 172.21.15.44:0/2687608465 >> 172.21.15.44:0/2687608465 conn(0x7f0540070740 msgr2=0x7f0540070b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:47:20.362 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:20.369+0000 7f0547400640 1 -- 172.21.15.44:0/2687608465 shutdown_connections 2024-04-17T19:47:20.362 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:20.369+0000 7f0547400640 1 -- 172.21.15.44:0/2687608465 wait complete. 2024-04-17T19:47:20.363 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:20.373+0000 7f0547400640 1 Processor -- start 2024-04-17T19:47:20.363 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:20.373+0000 7f0547400640 1 -- start start 2024-04-17T19:47:20.366 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:20.373+0000 7f0547400640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f054006c620 0x7f05401f2c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:20.366 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:20.373+0000 7f0547400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f054006ca30 0x7f054015e5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:20.367 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:20.373+0000 7f0547400640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f05401641d0 0x7f0540144da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:20.367 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:20.373+0000 7f0547400640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f0540067ce0 con 0x7f054006ca30 2024-04-17T19:47:20.367 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:20.373+0000 7f0547400640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f05400c58d0 con 0x7f05401641d0 2024-04-17T19:47:20.367 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:20.373+0000 7f0547400640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7f054006e460 con 0x7f054006c620 2024-04-17T19:47:20.367 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:20.373+0000 7f053fe00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f054006ca30 0x7f054015e5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:20.367 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:20.373+0000 7f053fe00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f054006ca30 0x7f054015e5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:42560/0 (socket says 172.21.15.44:42560) 2024-04-17T19:47:20.367 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:20.373+0000 7f053fe00640 1 -- 172.21.15.44:0/3953917745 learned_addr learned my addr 172.21.15.44:0/3953917745 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-04-17T19:47:20.367 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:20.373+0000 7f0544a00640 1 --2- 172.21.15.44:0/3953917745 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f054006c620 0x7f05401f2c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:20.367 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:20.373+0000 7f0545400640 1 --2- 172.21.15.44:0/3953917745 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f05401641d0 0x7f0540144da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:20.368 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:20.373+0000 7f053fe00640 1 -- 172.21.15.44:0/3953917745 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f054006c620 msgr2=0x7f05401f2c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:20.368 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:20.373+0000 7f053fe00640 1 --2- 172.21.15.44:0/3953917745 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f054006c620 0x7f05401f2c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:20.368 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:20.373+0000 7f053fe00640 1 -- 172.21.15.44:0/3953917745 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f05401641d0 msgr2=0x7f0540144da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:20.368 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:20.373+0000 7f053fe00640 1 --2- 172.21.15.44:0/3953917745 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f05401641d0 0x7f0540144da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:20.368 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:20.373+0000 7f053fe00640 1 -- 172.21.15.44:0/3953917745 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f05401f3150 con 0x7f054006ca30 2024-04-17T19:47:20.368 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:20.373+0000 7f053fe00640 1 --2- 172.21.15.44:0/3953917745 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f054006ca30 0x7f054015e5a0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f052c00c3c0 tx=0x7f052c00c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:47:20.368 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:20.373+0000 7f053cc00640 1 -- 172.21.15.44:0/3953917745 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f052c017070 con 0x7f054006ca30 2024-04-17T19:47:20.368 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:20.373+0000 7f053cc00640 1 -- 172.21.15.44:0/3953917745 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f052c005d10 con 0x7f054006ca30 2024-04-17T19:47:20.368 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:20.373+0000 7f053cc00640 1 -- 172.21.15.44:0/3953917745 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f052c007310 con 0x7f054006ca30 2024-04-17T19:47:20.368 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:20.373+0000 7f0547400640 1 -- 172.21.15.44:0/3953917745 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f054015f570 con 0x7f054006ca30 2024-04-17T19:47:20.369 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:20.373+0000 7f0547400640 1 -- 172.21.15.44:0/3953917745 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f054014c920 con 0x7f054006ca30 2024-04-17T19:47:20.370 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:20.377+0000 7f0547400640 1 -- 172.21.15.44:0/3953917745 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f054004ff10 con 0x7f054006ca30 2024-04-17T19:47:20.370 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:20.377+0000 7f053cc00640 1 -- 172.21.15.44:0/3953917745 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f052c01a070 con 0x7f054006ca30 2024-04-17T19:47:20.370 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:20.377+0000 7f053cc00640 1 --2- 172.21.15.44:0/3953917745 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f0520068380 0x7f052006a890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:20.370 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:20.377+0000 7f053cc00640 1 -- 172.21.15.44:0/3953917745 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f052c085f30 con 0x7f054006ca30 2024-04-17T19:47:20.370 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:20.377+0000 7f0544a00640 1 --2- 172.21.15.44:0/3953917745 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f0520068380 0x7f052006a890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:20.371 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:20.377+0000 7f0544a00640 1 --2- 172.21.15.44:0/3953917745 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f0520068380 0x7f052006a890 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f0534009ac0 tx=0x7f0534009190 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:47:20.373 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:20.381+0000 7f053cc00640 1 -- 172.21.15.44:0/3953917745 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f052c055ac0 con 0x7f054006ca30 2024-04-17T19:47:20.538 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:20.545+0000 7f0547400640 1 -- 172.21.15.44:0/3953917745 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f05400c8870 con 0x7f054006ca30 2024-04-17T19:47:20.542 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:20.549+0000 7f053cc00640 1 -- 172.21.15.44:0/3953917745 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) ==== 74+0+18482 (secure 0 0 0) 0x7f052c059dc0 con 0x7f054006ca30 2024-04-17T19:47:20.542 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-04-17T19:47:20.542 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":25,"fsid":"703f77ca-79c6-4a66-b576-62c526cb1021","created":"2024-04-17T19:46:30.831994+0000","modified":"2024-04-17T19:47:01.141287+0000","last_up_change":"2024-04-17T19:46:41.988197+0000","last_in_change":"2024-04-17T19:46:33.407430+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-17T19:46:41.940380+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-17T19:46:54.222150+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-17T19:46:55.031694+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-17T19:46:58.707529+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"30520dc6-eea6-43d4-ab60-3ca9e92329dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6800","nonce":1018735925},{"type":"v1","addr":"172.21.15.44:6801","nonce":1018735925}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6802","nonce":1018735925},{"type":"v1","addr":"172.21.15.44:6803","nonce":1018735925}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6806","nonce":1018735925},{"type":"v1","addr":"172.21.15.44:6807","nonce":1018735925}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6804","nonce":1018735925},{"type":"v1","addr":"172.21.15.44:6805","nonce":1018735925}]},"public_addr":"172.21.15.44:6801/1018735925","cluster_addr":"172.21.15.44:6803/1018735925","heartbeat_back_addr":"172.21.15.44:6807/1018735925","heartbeat_front_addr":"172.21.15.44:6805/1018735925","state":["exists","up"]},{"osd":1,"uuid":"079bd511-b6ce-449b-8f11-17b311b12f7c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6817","nonce":1452577434},{"type":"v1","addr":"172.21.15.44:6820","nonce":1452577434}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6823","nonce":1452577434},{"type":"v1","addr":"172.21.15.44:6825","nonce":1452577434}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6830","nonce":1452577434},{"type":"v1","addr":"172.21.15.44:6831","nonce":1452577434}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6828","nonce":1452577434},{"type":"v1","addr":"172.21.15.44:6829","nonce":1452577434}]},"public_addr":"172.21.15.44:6820/1452577434","cluster_addr":"172.21.15.44:6825/1452577434","heartbeat_back_addr":"172.21.15.44:6831/1452577434","heartbeat_front_addr":"172.21.15.44:6829/1452577434","state":["exists","up"]},{"osd":2,"uuid":"34f0b9ab-b1d2-4ee9-841c-f15afbb6bec5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6816","nonce":1160071918},{"type":"v1","addr":"172.21.15.44:6818","nonce":1160071918}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6819","nonce":1160071918},{"type":"v1","addr":"172.21.15.44:6821","nonce":1160071918}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6826","nonce":1160071918},{"type":"v1","addr":"172.21.15.44:6827","nonce":1160071918}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6822","nonce":1160071918},{"type":"v1","addr":"172.21.15.44:6824","nonce":1160071918}]},"public_addr":"172.21.15.44:6818/1160071918","cluster_addr":"172.21.15.44:6821/1160071918","heartbeat_back_addr":"172.21.15.44:6827/1160071918","heartbeat_front_addr":"172.21.15.44:6824/1160071918","state":["exists","up"]},{"osd":3,"uuid":"4740032d-fe34-4b1b-bb85-f430896fc3c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6808","nonce":4236454921},{"type":"v1","addr":"172.21.15.44:6809","nonce":4236454921}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6810","nonce":4236454921},{"type":"v1","addr":"172.21.15.44:6811","nonce":4236454921}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6814","nonce":4236454921},{"type":"v1","addr":"172.21.15.44:6815","nonce":4236454921}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6812","nonce":4236454921},{"type":"v1","addr":"172.21.15.44:6813","nonce":4236454921}]},"public_addr":"172.21.15.44:6809/4236454921","cluster_addr":"172.21.15.44:6811/4236454921","heartbeat_back_addr":"172.21.15.44:6815/4236454921","heartbeat_front_addr":"172.21.15.44:6813/4236454921","state":["exists","up"]},{"osd":4,"uuid":"7dbedb00-302d-4d52-810c-e18839254da1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6800","nonce":2293251376},{"type":"v1","addr":"172.21.15.62:6801","nonce":2293251376}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6802","nonce":2293251376},{"type":"v1","addr":"172.21.15.62:6803","nonce":2293251376}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6806","nonce":2293251376},{"type":"v1","addr":"172.21.15.62:6807","nonce":2293251376}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6804","nonce":2293251376},{"type":"v1","addr":"172.21.15.62:6805","nonce":2293251376}]},"public_addr":"172.21.15.62:6801/2293251376","cluster_addr":"172.21.15.62:6803/2293251376","heartbeat_back_addr":"172.21.15.62:6807/2293251376","heartbeat_front_addr":"172.21.15.62:6805/2293251376","state":["exists","up"]},{"osd":5,"uuid":"38c1e8d9-393d-4f33-a97a-3295cf5c5b07","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6808","nonce":1551020300},{"type":"v1","addr":"172.21.15.62:6809","nonce":1551020300}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6810","nonce":1551020300},{"type":"v1","addr":"172.21.15.62:6811","nonce":1551020300}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6814","nonce":1551020300},{"type":"v1","addr":"172.21.15.62:6815","nonce":1551020300}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6812","nonce":1551020300},{"type":"v1","addr":"172.21.15.62:6813","nonce":1551020300}]},"public_addr":"172.21.15.62:6809/1551020300","cluster_addr":"172.21.15.62:6811/1551020300","heartbeat_back_addr":"172.21.15.62:6815/1551020300","heartbeat_front_addr":"172.21.15.62:6813/1551020300","state":["exists","up"]},{"osd":6,"uuid":"f6ff81c6-f14d-4477-88e3-9116cc5a2992","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6824","nonce":2602310256},{"type":"v1","addr":"172.21.15.62:6825","nonce":2602310256}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6826","nonce":2602310256},{"type":"v1","addr":"172.21.15.62:6827","nonce":2602310256}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6830","nonce":2602310256},{"type":"v1","addr":"172.21.15.62:6831","nonce":2602310256}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6828","nonce":2602310256},{"type":"v1","addr":"172.21.15.62:6829","nonce":2602310256}]},"public_addr":"172.21.15.62:6825/2602310256","cluster_addr":"172.21.15.62:6827/2602310256","heartbeat_back_addr":"172.21.15.62:6831/2602310256","heartbeat_front_addr":"172.21.15.62:6829/2602310256","state":["exists","up"]},{"osd":7,"uuid":"ce395bc3-bcb5-4b94-a523-5bb9df491eca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6816","nonce":2912738359},{"type":"v1","addr":"172.21.15.62:6817","nonce":2912738359}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6818","nonce":2912738359},{"type":"v1","addr":"172.21.15.62:6819","nonce":2912738359}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6822","nonce":2912738359},{"type":"v1","addr":"172.21.15.62:6823","nonce":2912738359}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6820","nonce":2912738359},{"type":"v1","addr":"172.21.15.62:6821","nonce":2912738359}]},"public_addr":"172.21.15.62:6817/2912738359","cluster_addr":"172.21.15.62:6819/2912738359","heartbeat_back_addr":"172.21.15.62:6823/2912738359","heartbeat_front_addr":"172.21.15.62:6821/2912738359","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T19:46:39.302883+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T19:46:39.177705+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T19:46:39.188894+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T19:46:39.313009+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T19:46:38.870508+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T19:46:38.790900+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T19:46:38.979163+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T19:46:38.992348+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-17T19:47:20.543 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:20.549+0000 7f0547400640 1 -- 172.21.15.44:0/3953917745 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f0520068380 msgr2=0x7f052006a890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:20.544 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:20.549+0000 7f0547400640 1 --2- 172.21.15.44:0/3953917745 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f0520068380 0x7f052006a890 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f0534009ac0 tx=0x7f0534009190 comp rx=0 tx=0).stop 2024-04-17T19:47:20.544 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:20.549+0000 7f0547400640 1 -- 172.21.15.44:0/3953917745 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f054006ca30 msgr2=0x7f054015e5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:20.544 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:20.549+0000 7f0547400640 1 --2- 172.21.15.44:0/3953917745 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f054006ca30 0x7f054015e5a0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f052c00c3c0 tx=0x7f052c00c880 comp rx=0 tx=0).stop 2024-04-17T19:47:20.544 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:20.549+0000 7f0547400640 1 -- 172.21.15.44:0/3953917745 shutdown_connections 2024-04-17T19:47:20.544 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:20.549+0000 7f0547400640 1 --2- 172.21.15.44:0/3953917745 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f0520068380 0x7f052006a890 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:20.544 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:20.549+0000 7f0547400640 1 --2- 172.21.15.44:0/3953917745 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f05401641d0 0x7f0540144da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:20.544 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:20.549+0000 7f0547400640 1 --2- 172.21.15.44:0/3953917745 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f054006ca30 0x7f054015e5a0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:20.544 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:20.549+0000 7f0547400640 1 --2- 172.21.15.44:0/3953917745 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f054006c620 0x7f05401f2c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:20.544 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:20.549+0000 7f0547400640 1 -- 172.21.15.44:0/3953917745 >> 172.21.15.44:0/3953917745 conn(0x7f0540070740 msgr2=0x7f05400c94a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:47:20.545 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:20.549+0000 7f0547400640 1 -- 172.21.15.44:0/3953917745 shutdown_connections 2024-04-17T19:47:20.545 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:20.549+0000 7f0547400640 1 -- 172.21.15.44:0/3953917745 wait complete. 2024-04-17T19:47:20.564 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2024-04-17T19:47:20.564 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-17T19:47:20.720 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:20.729+0000 7f9472400640 1 Processor -- start 2024-04-17T19:47:20.720 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:20.729+0000 7f9472400640 1 -- start start 2024-04-17T19:47:20.722 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:20.729+0000 7f9472400640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f946c15ba30 0x7f946c06bd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:20.723 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:20.729+0000 7f9472400640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f946c06fa60 0x7f946c06fe70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:20.723 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:20.729+0000 7f9472400640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f946c15bee0 con 0x7f946c0c8cb0 2024-04-17T19:47:20.723 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:20.729+0000 7f9472400640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 -- 0x7f946c06f5d0 con 0x7f946c06fa60 2024-04-17T19:47:20.723 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:20.729+0000 7f9472400640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7f946c15c1c0 con 0x7f946c15ba30 2024-04-17T19:47:20.723 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:20.729+0000 7f946be00640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f946c0c8cb0 0x7f946c15efa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:50364/0 (socket says 172.21.15.44:50364) 2024-04-17T19:47:20.723 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:20.729+0000 7f946be00640 1 -- 172.21.15.44:0/279249728 learned_addr learned my addr 172.21.15.44:0/279249728 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-04-17T19:47:20.723 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:20.729+0000 7f946b400640 1 --2- 172.21.15.44:0/279249728 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f946c15ba30 0x7f946c06bd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:20.723 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:20.729+0000 7f9462a00640 1 --2- 172.21.15.44:0/279249728 >> v2:172.21.15.62:3300/0 conn(0x7f946c06fa60 0x7f946c06fe70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:20.724 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:20.729+0000 7f946aa00640 1 -- 172.21.15.44:0/279249728 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 365388100 0 0) 0x7f946c15bee0 con 0x7f946c0c8cb0 2024-04-17T19:47:20.724 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:20.729+0000 7f946aa00640 1 -- 172.21.15.44:0/279249728 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9450003530 con 0x7f946c0c8cb0 2024-04-17T19:47:20.724 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:20.729+0000 7f946b400640 1 -- 172.21.15.44:0/279249728 >> v2:172.21.15.62:3300/0 conn(0x7f946c06fa60 msgr2=0x7f946c06fe70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T19:47:20.724 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:20.729+0000 7f946b400640 1 --2- 172.21.15.44:0/279249728 >> v2:172.21.15.62:3300/0 conn(0x7f946c06fa60 0x7f946c06fe70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:20.724 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:20.729+0000 7f946b400640 1 -- 172.21.15.44:0/279249728 >> v1:172.21.15.44:6789/0 conn(0x7f946c0c8cb0 legacy=0x7f946c15efa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:20.724 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:20.729+0000 7f946aa00640 1 -- 172.21.15.44:0/279249728 <== mon.0 v1:172.21.15.44:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2031489642 0 0) 0x7f9450003530 con 0x7f946c0c8cb0 2024-04-17T19:47:20.724 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:20.729+0000 7f946b400640 1 -- 172.21.15.44:0/279249728 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f946c15c4a0 con 0x7f946c15ba30 2024-04-17T19:47:20.725 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:20.733+0000 7f946b400640 1 --2- 172.21.15.44:0/279249728 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f946c15ba30 0x7f946c06bd80 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f946c06f750 tx=0x7f945c01c3c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=74a453994e4976c3 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:47:20.726 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:20.733+0000 7f946aa00640 1 -- 172.21.15.44:0/279249728 <== mon.2 v2:172.21.15.62:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f945c0b0070 con 0x7f946c15ba30 2024-04-17T19:47:20.726 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:20.733+0000 7f946aa00640 1 -- 172.21.15.44:0/279249728 <== mon.2 v2:172.21.15.62:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f945c0ab400 con 0x7f946c15ba30 2024-04-17T19:47:20.726 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:20.733+0000 7f946aa00640 1 -- 172.21.15.44:0/279249728 <== mon.2 v2:172.21.15.62:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9464001680 con 0x7f946c15ba30 2024-04-17T19:47:20.727 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:20.733+0000 7f9472400640 1 -- 172.21.15.44:0/279249728 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f946c15ba30 msgr2=0x7f946c06bd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:20.728 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:20.733+0000 7f9472400640 1 --2- 172.21.15.44:0/279249728 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f946c15ba30 0x7f946c06bd80 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f946c06f750 tx=0x7f945c01c3c0 comp rx=0 tx=0).stop 2024-04-17T19:47:20.728 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:20.737+0000 7f9472400640 1 -- 172.21.15.44:0/279249728 shutdown_connections 2024-04-17T19:47:20.728 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:20.737+0000 7f9472400640 1 --2- 172.21.15.44:0/279249728 >> v2:172.21.15.62:3300/0 conn(0x7f946c06fa60 0x7f946c06fe70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:20.728 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:20.737+0000 7f9472400640 1 --2- 172.21.15.44:0/279249728 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f946c15ba30 0x7f946c06bd80 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:20.728 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:20.737+0000 7f9472400640 1 -- 172.21.15.44:0/279249728 >> 172.21.15.44:0/279249728 conn(0x7f946c073650 msgr2=0x7f946c073a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:47:20.728 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:20.737+0000 7f9472400640 1 -- 172.21.15.44:0/279249728 shutdown_connections 2024-04-17T19:47:20.728 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:20.737+0000 7f9472400640 1 -- 172.21.15.44:0/279249728 wait complete. 2024-04-17T19:47:20.729 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:20.737+0000 7f9472400640 1 Processor -- start 2024-04-17T19:47:20.729 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:20.737+0000 7f9472400640 1 -- start start 2024-04-17T19:47:20.732 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:20.737+0000 7f9472400640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f946c06fa60 0x7f946c158800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:20.732 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:20.737+0000 7f9472400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f946c0c8cb0 0x7f946c0af1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:20.732 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:20.737+0000 7f9472400640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f946c15ba30 0x7f946c0af6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:20.733 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:20.737+0000 7f9472400640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f946c0cb2d0 con 0x7f946c0c8cb0 2024-04-17T19:47:20.733 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:20.737+0000 7f9472400640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f946c06c4d0 con 0x7f946c06fa60 2024-04-17T19:47:20.733 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:20.737+0000 7f9472400640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7f946c0cb450 con 0x7f946c15ba30 2024-04-17T19:47:20.733 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:20.737+0000 7f9462a00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f946c0c8cb0 0x7f946c0af1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:20.733 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:20.741+0000 7f9462a00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f946c0c8cb0 0x7f946c0af1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:42572/0 (socket says 172.21.15.44:42572) 2024-04-17T19:47:20.733 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:20.741+0000 7f9462a00640 1 -- 172.21.15.44:0/3158569404 learned_addr learned my addr 172.21.15.44:0/3158569404 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-04-17T19:47:20.733 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:20.741+0000 7f946b400640 1 --2- 172.21.15.44:0/3158569404 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f946c06fa60 0x7f946c158800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:20.733 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:20.741+0000 7f946be00640 1 --2- 172.21.15.44:0/3158569404 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f946c15ba30 0x7f946c0af6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:20.734 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:20.741+0000 7f9462a00640 1 -- 172.21.15.44:0/3158569404 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f946c15ba30 msgr2=0x7f946c0af6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:20.734 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:20.741+0000 7f9462a00640 1 --2- 172.21.15.44:0/3158569404 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f946c15ba30 0x7f946c0af6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:20.734 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:20.741+0000 7f9462a00640 1 -- 172.21.15.44:0/3158569404 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f946c06fa60 msgr2=0x7f946c158800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:20.734 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:20.741+0000 7f9462a00640 1 --2- 172.21.15.44:0/3158569404 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f946c06fa60 0x7f946c158800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:20.734 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:20.741+0000 7f9462a00640 1 -- 172.21.15.44:0/3158569404 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f946c153970 con 0x7f946c0c8cb0 2024-04-17T19:47:20.734 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:20.741+0000 7f9462a00640 1 --2- 172.21.15.44:0/3158569404 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f946c0c8cb0 0x7f946c0af1b0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f9454009cd0 tx=0x7f945400c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:47:20.734 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:20.741+0000 7f9463e00640 1 -- 172.21.15.44:0/3158569404 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9454018020 con 0x7f946c0c8cb0 2024-04-17T19:47:20.735 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:20.741+0000 7f9463e00640 1 -- 172.21.15.44:0/3158569404 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9454014480 con 0x7f946c0c8cb0 2024-04-17T19:47:20.735 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:20.741+0000 7f9472400640 1 -- 172.21.15.44:0/3158569404 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f946c152bb0 con 0x7f946c0c8cb0 2024-04-17T19:47:20.735 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:20.741+0000 7f9463e00640 1 -- 172.21.15.44:0/3158569404 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9454014850 con 0x7f946c0c8cb0 2024-04-17T19:47:20.735 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:20.741+0000 7f9472400640 1 -- 172.21.15.44:0/3158569404 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f946c153170 con 0x7f946c0c8cb0 2024-04-17T19:47:20.736 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:20.741+0000 7f9472400640 1 -- 172.21.15.44:0/3158569404 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f946c04ff10 con 0x7f946c0c8cb0 2024-04-17T19:47:20.736 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:20.741+0000 7f9463e00640 1 -- 172.21.15.44:0/3158569404 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f945401b020 con 0x7f946c0c8cb0 2024-04-17T19:47:20.737 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:20.745+0000 7f9463e00640 1 --2- 172.21.15.44:0/3158569404 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f94480683b0 0x7f944806a8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:20.737 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:20.745+0000 7f9463e00640 1 -- 172.21.15.44:0/3158569404 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f9454087a00 con 0x7f946c0c8cb0 2024-04-17T19:47:20.737 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:20.745+0000 7f946b400640 1 --2- 172.21.15.44:0/3158569404 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f94480683b0 0x7f944806a8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:20.737 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:20.745+0000 7f946b400640 1 --2- 172.21.15.44:0/3158569404 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f94480683b0 0x7f944806a8c0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f945c0ad000 tx=0x7f945c0a6000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:47:20.740 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:20.749+0000 7f9463e00640 1 -- 172.21.15.44:0/3158569404 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f9454022020 con 0x7f946c0c8cb0 2024-04-17T19:47:20.904 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:20.913+0000 7f9472400640 1 -- 172.21.15.44:0/3158569404 --> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f946c150ea0 con 0x7f94480683b0 2024-04-17T19:47:20.963 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:20.973+0000 7f9463e00640 1 -- 172.21.15.44:0/3158569404 <== mgr.4102 v2:172.21.15.62:6832/1020159798 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+332631 (secure 0 0 0) 0x7f946c150ea0 con 0x7f94480683b0 2024-04-17T19:47:20.964 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-04-17T19:47:20.970 INFO:teuthology.orchestra.run.smithi044.stderr:dumped all 2024-04-17T19:47:20.971 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:20.977+0000 7f9472400640 1 -- 172.21.15.44:0/3158569404 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f94480683b0 msgr2=0x7f944806a8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:20.971 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:20.977+0000 7f9472400640 1 --2- 172.21.15.44:0/3158569404 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f94480683b0 0x7f944806a8c0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f945c0ad000 tx=0x7f945c0a6000 comp rx=0 tx=0).stop 2024-04-17T19:47:20.971 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:20.977+0000 7f9472400640 1 -- 172.21.15.44:0/3158569404 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f946c0c8cb0 msgr2=0x7f946c0af1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:20.971 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:20.977+0000 7f9472400640 1 --2- 172.21.15.44:0/3158569404 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f946c0c8cb0 0x7f946c0af1b0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f9454009cd0 tx=0x7f945400c490 comp rx=0 tx=0).stop 2024-04-17T19:47:20.972 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:20.977+0000 7f9472400640 1 -- 172.21.15.44:0/3158569404 shutdown_connections 2024-04-17T19:47:20.972 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:20.977+0000 7f9472400640 1 --2- 172.21.15.44:0/3158569404 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f94480683b0 0x7f944806a8c0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:20.972 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:20.977+0000 7f9472400640 1 --2- 172.21.15.44:0/3158569404 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f946c15ba30 0x7f946c0af6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:20.972 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:20.977+0000 7f9472400640 1 --2- 172.21.15.44:0/3158569404 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f946c0c8cb0 0x7f946c0af1b0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:20.972 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:20.977+0000 7f9472400640 1 --2- 172.21.15.44:0/3158569404 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f946c06fa60 0x7f946c158800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:20.972 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:20.977+0000 7f9472400640 1 -- 172.21.15.44:0/3158569404 >> 172.21.15.44:0/3158569404 conn(0x7f946c073650 msgr2=0x7f946c15a1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:47:20.972 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:20.977+0000 7f9472400640 1 -- 172.21.15.44:0/3158569404 shutdown_connections 2024-04-17T19:47:20.972 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:20.977+0000 7f9472400640 1 -- 172.21.15.44:0/3158569404 wait complete. 2024-04-17T19:47:20.988 INFO:teuthology.orchestra.run.smithi044.stdout:{"pg_ready":true,"pg_map":{"version":38,"stamp":"2024-04-17T19:47:19.903614+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595008,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":207,"num_write_kb":2434,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":159,"ondisk_log_size":159,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":218364,"kb_used_data":2208,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754756356,"statfs":{"total":773094113280,"available":772870508544,"internally_reserved":0,"allocated":2260992,"data_stored":2004872,"data_compressed":66496,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":12751,"internal_metadata":221236785},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2230,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.006178"},"pg_stats":[{"pgid":"2.1f","version":"24'4","reported_seq":26,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T19:47:01.718542+0000","last_change":"2024-04-17T19:46:55.688623+0000","last_active":"2024-04-17T19:47:01.718542+0000","last_peered":"2024-04-17T19:47:01.718542+0000","last_clean":"2024-04-17T19:47:01.718542+0000","last_became_active":"2024-04-17T19:46:55.687455+0000","last_became_peered":"2024-04-17T19:46:55.687455+0000","last_unstale":"2024-04-17T19:47:01.718542+0000","last_undegraded":"2024-04-17T19:47:01.718542+0000","last_fullsized":"2024-04-17T19:47:01.718542+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:54.640133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:54.640133+0000","last_clean_scrub_stamp":"2024-04-17T19:46:54.640133+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:02:52.057635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T19:47:01.719008+0000","last_change":"2024-04-17T19:46:56.683770+0000","last_active":"2024-04-17T19:47:01.719008+0000","last_peered":"2024-04-17T19:47:01.719008+0000","last_clean":"2024-04-17T19:47:01.719008+0000","last_became_active":"2024-04-17T19:46:56.683111+0000","last_became_peered":"2024-04-17T19:46:56.683111+0000","last_unstale":"2024-04-17T19:47:01.719008+0000","last_undegraded":"2024-04-17T19:47:01.719008+0000","last_fullsized":"2024-04-17T19:47:01.719008+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_clean_scrub_stamp":"2024-04-17T19:46:55.648649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T22:25:59.135091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T19:47:02.881985+0000","last_change":"2024-04-17T19:47:00.788461+0000","last_active":"2024-04-17T19:47:02.881985+0000","last_peered":"2024-04-17T19:47:02.881985+0000","last_clean":"2024-04-17T19:47:02.881985+0000","last_became_active":"2024-04-17T19:47:00.787654+0000","last_became_peered":"2024-04-17T19:47:00.787654+0000","last_unstale":"2024-04-17T19:47:02.881985+0000","last_undegraded":"2024-04-17T19:47:02.881985+0000","last_fullsized":"2024-04-17T19:47:02.881985+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_clean_scrub_stamp":"2024-04-17T19:46:59.695482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T07:28:34.234670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4,1],"acting":[7,6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1e","version":"24'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T19:47:01.719064+0000","last_change":"2024-04-17T19:46:55.703749+0000","last_active":"2024-04-17T19:47:01.719064+0000","last_peered":"2024-04-17T19:47:01.719064+0000","last_clean":"2024-04-17T19:47:01.719064+0000","last_became_active":"2024-04-17T19:46:55.695191+0000","last_became_peered":"2024-04-17T19:46:55.695191+0000","last_unstale":"2024-04-17T19:47:01.719064+0000","last_undegraded":"2024-04-17T19:47:01.719064+0000","last_fullsized":"2024-04-17T19:47:01.719064+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:54.640133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:54.640133+0000","last_clean_scrub_stamp":"2024-04-17T19:46:54.640133+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:24:42.573542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T19:47:01.717983+0000","last_change":"2024-04-17T19:46:56.684814+0000","last_active":"2024-04-17T19:47:01.717983+0000","last_peered":"2024-04-17T19:47:01.717983+0000","last_clean":"2024-04-17T19:47:01.717983+0000","last_became_active":"2024-04-17T19:46:56.684475+0000","last_became_peered":"2024-04-17T19:46:56.684475+0000","last_unstale":"2024-04-17T19:47:01.717983+0000","last_undegraded":"2024-04-17T19:47:01.717983+0000","last_fullsized":"2024-04-17T19:47:01.717983+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_clean_scrub_stamp":"2024-04-17T19:46:55.648649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T05:38:55.394025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T19:47:01.869722+0000","last_change":"2024-04-17T19:47:00.769813+0000","last_active":"2024-04-17T19:47:01.869722+0000","last_peered":"2024-04-17T19:47:01.869722+0000","last_clean":"2024-04-17T19:47:01.869722+0000","last_became_active":"2024-04-17T19:47:00.769370+0000","last_became_peered":"2024-04-17T19:47:00.769370+0000","last_unstale":"2024-04-17T19:47:01.869722+0000","last_undegraded":"2024-04-17T19:47:01.869722+0000","last_fullsized":"2024-04-17T19:47:01.869722+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_clean_scrub_stamp":"2024-04-17T19:46:59.695482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:23:20.430751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,4,6],"acting":[2,7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1d","version":"24'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T19:47:02.723599+0000","last_change":"2024-04-17T19:46:55.695159+0000","last_active":"2024-04-17T19:47:02.723599+0000","last_peered":"2024-04-17T19:47:02.723599+0000","last_clean":"2024-04-17T19:47:02.723599+0000","last_became_active":"2024-04-17T19:46:55.694285+0000","last_became_peered":"2024-04-17T19:46:55.694285+0000","last_unstale":"2024-04-17T19:47:02.723599+0000","last_undegraded":"2024-04-17T19:47:02.723599+0000","last_fullsized":"2024-04-17T19:47:02.723599+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:54.640133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:54.640133+0000","last_clean_scrub_stamp":"2024-04-17T19:46:54.640133+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T04:52:16.008572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T19:47:02.880050+0000","last_change":"2024-04-17T19:46:56.700734+0000","last_active":"2024-04-17T19:47:02.880050+0000","last_peered":"2024-04-17T19:47:02.880050+0000","last_clean":"2024-04-17T19:47:02.880050+0000","last_became_active":"2024-04-17T19:46:56.700413+0000","last_became_peered":"2024-04-17T19:46:56.700413+0000","last_unstale":"2024-04-17T19:47:02.880050+0000","last_undegraded":"2024-04-17T19:47:02.880050+0000","last_fullsized":"2024-04-17T19:47:02.880050+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_clean_scrub_stamp":"2024-04-17T19:46:55.648649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:57:40.700986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T19:47:01.869999+0000","last_change":"2024-04-17T19:47:00.772341+0000","last_active":"2024-04-17T19:47:01.869999+0000","last_peered":"2024-04-17T19:47:01.869999+0000","last_clean":"2024-04-17T19:47:01.869999+0000","last_became_active":"2024-04-17T19:47:00.771578+0000","last_became_peered":"2024-04-17T19:47:00.771578+0000","last_unstale":"2024-04-17T19:47:01.869999+0000","last_undegraded":"2024-04-17T19:47:01.869999+0000","last_fullsized":"2024-04-17T19:47:01.869999+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_clean_scrub_stamp":"2024-04-17T19:46:59.695482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:51:07.602172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,3,6],"acting":[2,5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1c","version":"24'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T19:47:02.723800+0000","last_change":"2024-04-17T19:46:55.687607+0000","last_active":"2024-04-17T19:47:02.723800+0000","last_peered":"2024-04-17T19:47:02.723800+0000","last_clean":"2024-04-17T19:47:02.723800+0000","last_became_active":"2024-04-17T19:46:55.687282+0000","last_became_peered":"2024-04-17T19:46:55.687282+0000","last_unstale":"2024-04-17T19:47:02.723800+0000","last_undegraded":"2024-04-17T19:47:02.723800+0000","last_fullsized":"2024-04-17T19:47:02.723800+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:54.640133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:54.640133+0000","last_clean_scrub_stamp":"2024-04-17T19:46:54.640133+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T05:52:32.550876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T19:47:01.714880+0000","last_change":"2024-04-17T19:46:56.690268+0000","last_active":"2024-04-17T19:47:01.714880+0000","last_peered":"2024-04-17T19:47:01.714880+0000","last_clean":"2024-04-17T19:47:01.714880+0000","last_became_active":"2024-04-17T19:46:56.689988+0000","last_became_peered":"2024-04-17T19:46:56.689988+0000","last_unstale":"2024-04-17T19:47:01.714880+0000","last_undegraded":"2024-04-17T19:47:01.714880+0000","last_fullsized":"2024-04-17T19:47:01.714880+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_clean_scrub_stamp":"2024-04-17T19:46:55.648649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T01:29:59.423734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T19:47:01.869747+0000","last_change":"2024-04-17T19:47:00.759608+0000","last_active":"2024-04-17T19:47:01.869747+0000","last_peered":"2024-04-17T19:47:01.869747+0000","last_clean":"2024-04-17T19:47:01.869747+0000","last_became_active":"2024-04-17T19:47:00.759059+0000","last_became_peered":"2024-04-17T19:47:00.759059+0000","last_unstale":"2024-04-17T19:47:01.869747+0000","last_undegraded":"2024-04-17T19:47:01.869747+0000","last_fullsized":"2024-04-17T19:47:01.869747+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_clean_scrub_stamp":"2024-04-17T19:46:59.695482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:22:37.460235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,5,7],"acting":[2,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T19:47:01.714081+0000","last_change":"2024-04-17T19:46:56.688273+0000","last_active":"2024-04-17T19:47:01.714081+0000","last_peered":"2024-04-17T19:47:01.714081+0000","last_clean":"2024-04-17T19:47:01.714081+0000","last_became_active":"2024-04-17T19:46:56.687662+0000","last_became_peered":"2024-04-17T19:46:56.687662+0000","last_unstale":"2024-04-17T19:47:01.714081+0000","last_undegraded":"2024-04-17T19:47:01.714081+0000","last_fullsized":"2024-04-17T19:47:01.714081+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_clean_scrub_stamp":"2024-04-17T19:46:55.648649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:51:46.684685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"24'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T19:47:01.714436+0000","last_change":"2024-04-17T19:46:55.692833+0000","last_active":"2024-04-17T19:47:01.714436+0000","last_peered":"2024-04-17T19:47:01.714436+0000","last_clean":"2024-04-17T19:47:01.714436+0000","last_became_active":"2024-04-17T19:46:55.689006+0000","last_became_peered":"2024-04-17T19:46:55.689006+0000","last_unstale":"2024-04-17T19:47:01.714436+0000","last_undegraded":"2024-04-17T19:47:01.714436+0000","last_fullsized":"2024-04-17T19:47:01.714436+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:54.640133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:54.640133+0000","last_clean_scrub_stamp":"2024-04-17T19:46:54.640133+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:57:39.692470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T19:47:01.714813+0000","last_change":"2024-04-17T19:47:00.757063+0000","last_active":"2024-04-17T19:47:01.714813+0000","last_peered":"2024-04-17T19:47:01.714813+0000","last_clean":"2024-04-17T19:47:01.714813+0000","last_became_active":"2024-04-17T19:47:00.756456+0000","last_became_peered":"2024-04-17T19:47:00.756456+0000","last_unstale":"2024-04-17T19:47:01.714813+0000","last_undegraded":"2024-04-17T19:47:01.714813+0000","last_fullsized":"2024-04-17T19:47:01.714813+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_clean_scrub_stamp":"2024-04-17T19:46:59.695482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T02:52:51.655611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,5],"acting":[3,1,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T19:47:02.884821+0000","last_change":"2024-04-17T19:46:56.691544+0000","last_active":"2024-04-17T19:47:02.884821+0000","last_peered":"2024-04-17T19:47:02.884821+0000","last_clean":"2024-04-17T19:47:02.884821+0000","last_became_active":"2024-04-17T19:46:56.690828+0000","last_became_peered":"2024-04-17T19:46:56.690828+0000","last_unstale":"2024-04-17T19:47:02.884821+0000","last_undegraded":"2024-04-17T19:47:02.884821+0000","last_fullsized":"2024-04-17T19:47:02.884821+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_clean_scrub_stamp":"2024-04-17T19:46:55.648649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:11:01.745657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T19:47:02.881826+0000","last_change":"2024-04-17T19:46:55.715857+0000","last_active":"2024-04-17T19:47:02.881826+0000","last_peered":"2024-04-17T19:47:02.881826+0000","last_clean":"2024-04-17T19:47:02.881826+0000","last_became_active":"2024-04-17T19:46:55.715197+0000","last_became_peered":"2024-04-17T19:46:55.715197+0000","last_unstale":"2024-04-17T19:47:02.881826+0000","last_undegraded":"2024-04-17T19:47:02.881826+0000","last_fullsized":"2024-04-17T19:47:02.881826+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:54.640133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:54.640133+0000","last_clean_scrub_stamp":"2024-04-17T19:46:54.640133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:25:07.379181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T19:47:02.723301+0000","last_change":"2024-04-17T19:47:00.773528+0000","last_active":"2024-04-17T19:47:02.723301+0000","last_peered":"2024-04-17T19:47:02.723301+0000","last_clean":"2024-04-17T19:47:02.723301+0000","last_became_active":"2024-04-17T19:47:00.773077+0000","last_became_peered":"2024-04-17T19:47:00.773077+0000","last_unstale":"2024-04-17T19:47:02.723301+0000","last_undegraded":"2024-04-17T19:47:02.723301+0000","last_fullsized":"2024-04-17T19:47:02.723301+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_clean_scrub_stamp":"2024-04-17T19:46:59.695482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T02:53:18.654740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,6,1],"acting":[0,4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T19:47:01.715767+0000","last_change":"2024-04-17T19:46:56.695617+0000","last_active":"2024-04-17T19:47:01.715767+0000","last_peered":"2024-04-17T19:47:01.715767+0000","last_clean":"2024-04-17T19:47:01.715767+0000","last_became_active":"2024-04-17T19:46:56.695205+0000","last_became_peered":"2024-04-17T19:46:56.695205+0000","last_unstale":"2024-04-17T19:47:01.715767+0000","last_undegraded":"2024-04-17T19:47:01.715767+0000","last_fullsized":"2024-04-17T19:47:01.715767+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_clean_scrub_stamp":"2024-04-17T19:46:55.648649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T05:05:36.718886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T19:47:01.716676+0000","last_change":"2024-04-17T19:46:55.686220+0000","last_active":"2024-04-17T19:47:01.716676+0000","last_peered":"2024-04-17T19:47:01.716676+0000","last_clean":"2024-04-17T19:47:01.716676+0000","last_became_active":"2024-04-17T19:46:55.684782+0000","last_became_peered":"2024-04-17T19:46:55.684782+0000","last_unstale":"2024-04-17T19:47:01.716676+0000","last_undegraded":"2024-04-17T19:47:01.716676+0000","last_fullsized":"2024-04-17T19:47:01.716676+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:54.640133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:54.640133+0000","last_clean_scrub_stamp":"2024-04-17T19:46:54.640133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:57:31.750325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T19:47:02.884208+0000","last_change":"2024-04-17T19:47:00.774664+0000","last_active":"2024-04-17T19:47:02.884208+0000","last_peered":"2024-04-17T19:47:02.884208+0000","last_clean":"2024-04-17T19:47:02.884208+0000","last_became_active":"2024-04-17T19:47:00.774008+0000","last_became_peered":"2024-04-17T19:47:00.774008+0000","last_unstale":"2024-04-17T19:47:02.884208+0000","last_undegraded":"2024-04-17T19:47:02.884208+0000","last_fullsized":"2024-04-17T19:47:02.884208+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_clean_scrub_stamp":"2024-04-17T19:46:59.695482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T04:04:16.650657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,2,3],"acting":[7,4,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T19:47:01.713826+0000","last_change":"2024-04-17T19:46:56.700069+0000","last_active":"2024-04-17T19:47:01.713826+0000","last_peered":"2024-04-17T19:47:01.713826+0000","last_clean":"2024-04-17T19:47:01.713826+0000","last_became_active":"2024-04-17T19:46:56.699525+0000","last_became_peered":"2024-04-17T19:46:56.699525+0000","last_unstale":"2024-04-17T19:47:01.713826+0000","last_undegraded":"2024-04-17T19:47:01.713826+0000","last_fullsized":"2024-04-17T19:47:01.713826+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_clean_scrub_stamp":"2024-04-17T19:46:55.648649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T00:28:36.944531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T19:47:02.722871+0000","last_change":"2024-04-17T19:46:55.684594+0000","last_active":"2024-04-17T19:47:02.722871+0000","last_peered":"2024-04-17T19:47:02.722871+0000","last_clean":"2024-04-17T19:47:02.722871+0000","last_became_active":"2024-04-17T19:46:55.683145+0000","last_became_peered":"2024-04-17T19:46:55.683145+0000","last_unstale":"2024-04-17T19:47:02.722871+0000","last_undegraded":"2024-04-17T19:47:02.722871+0000","last_fullsized":"2024-04-17T19:47:02.722871+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:54.640133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:54.640133+0000","last_clean_scrub_stamp":"2024-04-17T19:46:54.640133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T02:39:08.241534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T19:47:01.870328+0000","last_change":"2024-04-17T19:47:00.768781+0000","last_active":"2024-04-17T19:47:01.870328+0000","last_peered":"2024-04-17T19:47:01.870328+0000","last_clean":"2024-04-17T19:47:01.870328+0000","last_became_active":"2024-04-17T19:47:00.768277+0000","last_became_peered":"2024-04-17T19:47:00.768277+0000","last_unstale":"2024-04-17T19:47:01.870328+0000","last_undegraded":"2024-04-17T19:47:01.870328+0000","last_fullsized":"2024-04-17T19:47:01.870328+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_clean_scrub_stamp":"2024-04-17T19:46:59.695482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:07:00.936098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,7],"acting":[2,1,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T19:47:01.717916+0000","last_change":"2024-04-17T19:46:56.695528+0000","last_active":"2024-04-17T19:47:01.717916+0000","last_peered":"2024-04-17T19:47:01.717916+0000","last_clean":"2024-04-17T19:47:01.717916+0000","last_became_active":"2024-04-17T19:46:56.694993+0000","last_became_peered":"2024-04-17T19:46:56.694993+0000","last_unstale":"2024-04-17T19:47:01.717916+0000","last_undegraded":"2024-04-17T19:47:01.717916+0000","last_fullsized":"2024-04-17T19:47:01.717916+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_clean_scrub_stamp":"2024-04-17T19:46:55.648649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:08:14.848448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"24'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T19:47:01.715609+0000","last_change":"2024-04-17T19:46:55.688859+0000","last_active":"2024-04-17T19:47:01.715609+0000","last_peered":"2024-04-17T19:47:01.715609+0000","last_clean":"2024-04-17T19:47:01.715609+0000","last_became_active":"2024-04-17T19:46:55.688507+0000","last_became_peered":"2024-04-17T19:46:55.688507+0000","last_unstale":"2024-04-17T19:47:01.715609+0000","last_undegraded":"2024-04-17T19:47:01.715609+0000","last_fullsized":"2024-04-17T19:47:01.715609+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:54.640133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:54.640133+0000","last_clean_scrub_stamp":"2024-04-17T19:46:54.640133+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T01:53:38.377482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T19:47:01.869773+0000","last_change":"2024-04-17T19:47:00.781482+0000","last_active":"2024-04-17T19:47:01.869773+0000","last_peered":"2024-04-17T19:47:01.869773+0000","last_clean":"2024-04-17T19:47:01.869773+0000","last_became_active":"2024-04-17T19:47:00.780994+0000","last_became_peered":"2024-04-17T19:47:00.780994+0000","last_unstale":"2024-04-17T19:47:01.869773+0000","last_undegraded":"2024-04-17T19:47:01.869773+0000","last_fullsized":"2024-04-17T19:47:01.869773+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_clean_scrub_stamp":"2024-04-17T19:46:59.695482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T01:46:40.550031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,3,1],"acting":[2,6,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T19:47:01.718456+0000","last_change":"2024-04-17T19:46:56.695874+0000","last_active":"2024-04-17T19:47:01.718456+0000","last_peered":"2024-04-17T19:47:01.718456+0000","last_clean":"2024-04-17T19:47:01.718456+0000","last_became_active":"2024-04-17T19:46:56.694650+0000","last_became_peered":"2024-04-17T19:46:56.694650+0000","last_unstale":"2024-04-17T19:47:01.718456+0000","last_undegraded":"2024-04-17T19:47:01.718456+0000","last_fullsized":"2024-04-17T19:47:01.718456+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_clean_scrub_stamp":"2024-04-17T19:46:55.648649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:44:38.787541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"25'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T19:47:01.718214+0000","last_change":"2024-04-17T19:46:55.684490+0000","last_active":"2024-04-17T19:47:01.718214+0000","last_peered":"2024-04-17T19:47:01.718214+0000","last_clean":"2024-04-17T19:47:01.718214+0000","last_became_active":"2024-04-17T19:46:55.680100+0000","last_became_peered":"2024-04-17T19:46:55.680100+0000","last_unstale":"2024-04-17T19:47:01.718214+0000","last_undegraded":"2024-04-17T19:47:01.718214+0000","last_fullsized":"2024-04-17T19:47:01.718214+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:54.640133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:54.640133+0000","last_clean_scrub_stamp":"2024-04-17T19:46:54.640133+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:27:38.256174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T19:47:01.715596+0000","last_change":"2024-04-17T19:47:00.777588+0000","last_active":"2024-04-17T19:47:01.715596+0000","last_peered":"2024-04-17T19:47:01.715596+0000","last_clean":"2024-04-17T19:47:01.715596+0000","last_became_active":"2024-04-17T19:47:00.776873+0000","last_became_peered":"2024-04-17T19:47:00.776873+0000","last_unstale":"2024-04-17T19:47:01.715596+0000","last_undegraded":"2024-04-17T19:47:01.715596+0000","last_fullsized":"2024-04-17T19:47:01.715596+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_clean_scrub_stamp":"2024-04-17T19:46:59.695482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T02:52:42.471996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,6,3],"acting":[4,1,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T19:47:02.884485+0000","last_change":"2024-04-17T19:46:56.681681+0000","last_active":"2024-04-17T19:47:02.884485+0000","last_peered":"2024-04-17T19:47:02.884485+0000","last_clean":"2024-04-17T19:47:02.884485+0000","last_became_active":"2024-04-17T19:46:56.681316+0000","last_became_peered":"2024-04-17T19:46:56.681316+0000","last_unstale":"2024-04-17T19:47:02.884485+0000","last_undegraded":"2024-04-17T19:47:02.884485+0000","last_fullsized":"2024-04-17T19:47:02.884485+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_clean_scrub_stamp":"2024-04-17T19:46:55.648649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T07:28:30.187837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T19:47:01.715168+0000","last_change":"2024-04-17T19:46:55.692826+0000","last_active":"2024-04-17T19:47:01.715168+0000","last_peered":"2024-04-17T19:47:01.715168+0000","last_clean":"2024-04-17T19:47:01.715168+0000","last_became_active":"2024-04-17T19:46:55.691031+0000","last_became_peered":"2024-04-17T19:46:55.691031+0000","last_unstale":"2024-04-17T19:47:01.715168+0000","last_undegraded":"2024-04-17T19:47:01.715168+0000","last_fullsized":"2024-04-17T19:47:01.715168+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:54.640133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:54.640133+0000","last_clean_scrub_stamp":"2024-04-17T19:46:54.640133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T05:52:32.550876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T19:47:02.882070+0000","last_change":"2024-04-17T19:47:00.777416+0000","last_active":"2024-04-17T19:47:02.882070+0000","last_peered":"2024-04-17T19:47:02.882070+0000","last_clean":"2024-04-17T19:47:02.882070+0000","last_became_active":"2024-04-17T19:47:00.771531+0000","last_became_peered":"2024-04-17T19:47:00.771531+0000","last_unstale":"2024-04-17T19:47:02.882070+0000","last_undegraded":"2024-04-17T19:47:02.882070+0000","last_fullsized":"2024-04-17T19:47:02.882070+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_clean_scrub_stamp":"2024-04-17T19:46:59.695482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:30:31.288100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,2,7],"acting":[6,0,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T19:47:01.870267+0000","last_change":"2024-04-17T19:46:56.692250+0000","last_active":"2024-04-17T19:47:01.870267+0000","last_peered":"2024-04-17T19:47:01.870267+0000","last_clean":"2024-04-17T19:47:01.870267+0000","last_became_active":"2024-04-17T19:46:56.691801+0000","last_became_peered":"2024-04-17T19:46:56.691801+0000","last_unstale":"2024-04-17T19:47:01.870267+0000","last_undegraded":"2024-04-17T19:47:01.870267+0000","last_fullsized":"2024-04-17T19:47:01.870267+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_clean_scrub_stamp":"2024-04-17T19:46:55.648649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T01:53:39.385998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T19:47:01.716158+0000","last_change":"2024-04-17T19:46:55.713556+0000","last_active":"2024-04-17T19:47:01.716158+0000","last_peered":"2024-04-17T19:47:01.716158+0000","last_clean":"2024-04-17T19:47:01.716158+0000","last_became_active":"2024-04-17T19:46:55.712908+0000","last_became_peered":"2024-04-17T19:46:55.712908+0000","last_unstale":"2024-04-17T19:47:01.716158+0000","last_undegraded":"2024-04-17T19:47:01.716158+0000","last_fullsized":"2024-04-17T19:47:01.716158+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:54.640133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:54.640133+0000","last_clean_scrub_stamp":"2024-04-17T19:46:54.640133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:57:31.750325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T19:47:02.881295+0000","last_change":"2024-04-17T19:47:00.776868+0000","last_active":"2024-04-17T19:47:02.881295+0000","last_peered":"2024-04-17T19:47:02.881295+0000","last_clean":"2024-04-17T19:47:02.881295+0000","last_became_active":"2024-04-17T19:47:00.771385+0000","last_became_peered":"2024-04-17T19:47:00.771385+0000","last_unstale":"2024-04-17T19:47:02.881295+0000","last_undegraded":"2024-04-17T19:47:02.881295+0000","last_fullsized":"2024-04-17T19:47:02.881295+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_clean_scrub_stamp":"2024-04-17T19:46:59.695482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T01:46:40.550031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5,7],"acting":[6,3,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T19:47:02.723383+0000","last_change":"2024-04-17T19:46:56.709288+0000","last_active":"2024-04-17T19:47:02.723383+0000","last_peered":"2024-04-17T19:47:02.723383+0000","last_clean":"2024-04-17T19:47:02.723383+0000","last_became_active":"2024-04-17T19:46:56.708572+0000","last_became_peered":"2024-04-17T19:46:56.708572+0000","last_unstale":"2024-04-17T19:47:02.723383+0000","last_undegraded":"2024-04-17T19:47:02.723383+0000","last_fullsized":"2024-04-17T19:47:02.723383+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_clean_scrub_stamp":"2024-04-17T19:46:55.648649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:51:03.555339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T19:47:01.714531+0000","last_change":"2024-04-17T19:46:55.708506+0000","last_active":"2024-04-17T19:47:01.714531+0000","last_peered":"2024-04-17T19:47:01.714531+0000","last_clean":"2024-04-17T19:47:01.714531+0000","last_became_active":"2024-04-17T19:46:55.708175+0000","last_became_peered":"2024-04-17T19:46:55.708175+0000","last_unstale":"2024-04-17T19:47:01.714531+0000","last_undegraded":"2024-04-17T19:47:01.714531+0000","last_fullsized":"2024-04-17T19:47:01.714531+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:54.640133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:54.640133+0000","last_clean_scrub_stamp":"2024-04-17T19:46:54.640133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T22:25:04.163982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T19:47:02.885589+0000","last_change":"2024-04-17T19:47:00.786657+0000","last_active":"2024-04-17T19:47:02.885589+0000","last_peered":"2024-04-17T19:47:02.885589+0000","last_clean":"2024-04-17T19:47:02.885589+0000","last_became_active":"2024-04-17T19:47:00.780743+0000","last_became_peered":"2024-04-17T19:47:00.780743+0000","last_unstale":"2024-04-17T19:47:02.885589+0000","last_undegraded":"2024-04-17T19:47:02.885589+0000","last_fullsized":"2024-04-17T19:47:02.885589+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_clean_scrub_stamp":"2024-04-17T19:46:59.695482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:07:00.936098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0,3],"acting":[6,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T19:47:01.715163+0000","last_change":"2024-04-17T19:46:56.679752+0000","last_active":"2024-04-17T19:47:01.715163+0000","last_peered":"2024-04-17T19:47:01.715163+0000","last_clean":"2024-04-17T19:47:01.715163+0000","last_became_active":"2024-04-17T19:46:56.679230+0000","last_became_peered":"2024-04-17T19:46:56.679230+0000","last_unstale":"2024-04-17T19:47:01.715163+0000","last_undegraded":"2024-04-17T19:47:01.715163+0000","last_fullsized":"2024-04-17T19:47:01.715163+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_clean_scrub_stamp":"2024-04-17T19:46:55.648649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:08:14.848448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T19:47:02.882120+0000","last_change":"2024-04-17T19:46:55.715967+0000","last_active":"2024-04-17T19:47:02.882120+0000","last_peered":"2024-04-17T19:47:02.882120+0000","last_clean":"2024-04-17T19:47:02.882120+0000","last_became_active":"2024-04-17T19:46:55.715247+0000","last_became_peered":"2024-04-17T19:46:55.715247+0000","last_unstale":"2024-04-17T19:47:02.882120+0000","last_undegraded":"2024-04-17T19:47:02.882120+0000","last_fullsized":"2024-04-17T19:47:02.882120+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:54.640133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:54.640133+0000","last_clean_scrub_stamp":"2024-04-17T19:46:54.640133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T00:40:58.757373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T19:47:02.884271+0000","last_change":"2024-04-17T19:47:00.769901+0000","last_active":"2024-04-17T19:47:02.884271+0000","last_peered":"2024-04-17T19:47:02.884271+0000","last_clean":"2024-04-17T19:47:02.884271+0000","last_became_active":"2024-04-17T19:47:00.768634+0000","last_became_peered":"2024-04-17T19:47:00.768634+0000","last_unstale":"2024-04-17T19:47:02.884271+0000","last_undegraded":"2024-04-17T19:47:02.884271+0000","last_fullsized":"2024-04-17T19:47:02.884271+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_clean_scrub_stamp":"2024-04-17T19:46:59.695482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T04:48:47.816818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,7],"acting":[6,0,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T19:47:02.880908+0000","last_change":"2024-04-17T19:46:56.703467+0000","last_active":"2024-04-17T19:47:02.880908+0000","last_peered":"2024-04-17T19:47:02.880908+0000","last_clean":"2024-04-17T19:47:02.880908+0000","last_became_active":"2024-04-17T19:46:56.703148+0000","last_became_peered":"2024-04-17T19:46:56.703148+0000","last_unstale":"2024-04-17T19:47:02.880908+0000","last_undegraded":"2024-04-17T19:47:02.880908+0000","last_fullsized":"2024-04-17T19:47:02.880908+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_clean_scrub_stamp":"2024-04-17T19:46:55.648649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T22:01:49.863892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T19:47:01.714021+0000","last_change":"2024-04-17T19:46:55.715941+0000","last_active":"2024-04-17T19:47:01.714021+0000","last_peered":"2024-04-17T19:47:01.714021+0000","last_clean":"2024-04-17T19:47:01.714021+0000","last_became_active":"2024-04-17T19:46:55.715527+0000","last_became_peered":"2024-04-17T19:46:55.715527+0000","last_unstale":"2024-04-17T19:47:01.714021+0000","last_undegraded":"2024-04-17T19:47:01.714021+0000","last_fullsized":"2024-04-17T19:47:01.714021+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:54.640133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:54.640133+0000","last_clean_scrub_stamp":"2024-04-17T19:46:54.640133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:11:00.737141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T19:47:01.718674+0000","last_change":"2024-04-17T19:47:00.784031+0000","last_active":"2024-04-17T19:47:01.718674+0000","last_peered":"2024-04-17T19:47:01.718674+0000","last_clean":"2024-04-17T19:47:01.718674+0000","last_became_active":"2024-04-17T19:47:00.783386+0000","last_became_peered":"2024-04-17T19:47:00.783386+0000","last_unstale":"2024-04-17T19:47:01.718674+0000","last_undegraded":"2024-04-17T19:47:01.718674+0000","last_fullsized":"2024-04-17T19:47:01.718674+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_clean_scrub_stamp":"2024-04-17T19:46:59.695482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:00:44.689926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6,1],"acting":[5,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T19:47:01.717334+0000","last_change":"2024-04-17T19:46:56.692287+0000","last_active":"2024-04-17T19:47:01.717334+0000","last_peered":"2024-04-17T19:47:01.717334+0000","last_clean":"2024-04-17T19:47:01.717334+0000","last_became_active":"2024-04-17T19:46:56.691917+0000","last_became_peered":"2024-04-17T19:46:56.691917+0000","last_unstale":"2024-04-17T19:47:01.717334+0000","last_undegraded":"2024-04-17T19:47:01.717334+0000","last_fullsized":"2024-04-17T19:47:01.717334+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_clean_scrub_stamp":"2024-04-17T19:46:55.648649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T07:37:05.790432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T19:47:01.714558+0000","last_change":"2024-04-17T19:46:55.686031+0000","last_active":"2024-04-17T19:47:01.714558+0000","last_peered":"2024-04-17T19:47:01.714558+0000","last_clean":"2024-04-17T19:47:01.714558+0000","last_became_active":"2024-04-17T19:46:55.685599+0000","last_became_peered":"2024-04-17T19:46:55.685599+0000","last_unstale":"2024-04-17T19:47:01.714558+0000","last_undegraded":"2024-04-17T19:47:01.714558+0000","last_fullsized":"2024-04-17T19:47:01.714558+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:54.640133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:54.640133+0000","last_clean_scrub_stamp":"2024-04-17T19:46:54.640133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T01:39:32.586696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":178,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T19:47:02.879822+0000","last_change":"2024-04-17T19:46:43.000943+0000","last_active":"2024-04-17T19:47:02.879822+0000","last_peered":"2024-04-17T19:47:02.879822+0000","last_clean":"2024-04-17T19:47:02.879822+0000","last_became_active":"2024-04-17T19:46:43.000652+0000","last_became_peered":"2024-04-17T19:46:43.000652+0000","last_unstale":"2024-04-17T19:47:02.879822+0000","last_undegraded":"2024-04-17T19:47:02.879822+0000","last_fullsized":"2024-04-17T19:47:02.879822+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:41.988197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:41.988197+0000","last_clean_scrub_stamp":"2024-04-17T19:46:41.988197+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T19:53:52.845547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T19:47:01.715109+0000","last_change":"2024-04-17T19:47:00.731680+0000","last_active":"2024-04-17T19:47:01.715109+0000","last_peered":"2024-04-17T19:47:01.715109+0000","last_clean":"2024-04-17T19:47:01.715109+0000","last_became_active":"2024-04-17T19:47:00.731093+0000","last_became_peered":"2024-04-17T19:47:00.731093+0000","last_unstale":"2024-04-17T19:47:01.715109+0000","last_undegraded":"2024-04-17T19:47:01.715109+0000","last_fullsized":"2024-04-17T19:47:01.715109+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_clean_scrub_stamp":"2024-04-17T19:46:59.695482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T04:59:23.336626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T19:47:01.714967+0000","last_change":"2024-04-17T19:46:56.692443+0000","last_active":"2024-04-17T19:47:01.714967+0000","last_peered":"2024-04-17T19:47:01.714967+0000","last_clean":"2024-04-17T19:47:01.714967+0000","last_became_active":"2024-04-17T19:46:56.692106+0000","last_became_peered":"2024-04-17T19:46:56.692106+0000","last_unstale":"2024-04-17T19:47:01.714967+0000","last_undegraded":"2024-04-17T19:47:01.714967+0000","last_fullsized":"2024-04-17T19:47:01.714967+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_clean_scrub_stamp":"2024-04-17T19:46:55.648649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T04:07:54.102221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T19:47:02.884978+0000","last_change":"2024-04-17T19:46:55.689884+0000","last_active":"2024-04-17T19:47:02.884978+0000","last_peered":"2024-04-17T19:47:02.884978+0000","last_clean":"2024-04-17T19:47:02.884978+0000","last_became_active":"2024-04-17T19:46:55.689059+0000","last_became_peered":"2024-04-17T19:46:55.689059+0000","last_unstale":"2024-04-17T19:47:02.884978+0000","last_undegraded":"2024-04-17T19:47:02.884978+0000","last_fullsized":"2024-04-17T19:47:02.884978+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:54.640133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:54.640133+0000","last_clean_scrub_stamp":"2024-04-17T19:46:54.640133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T04:52:16.008572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T19:47:01.869956+0000","last_change":"2024-04-17T19:47:00.760432+0000","last_active":"2024-04-17T19:47:01.869956+0000","last_peered":"2024-04-17T19:47:01.869956+0000","last_clean":"2024-04-17T19:47:01.869956+0000","last_became_active":"2024-04-17T19:47:00.759946+0000","last_became_peered":"2024-04-17T19:47:00.759946+0000","last_unstale":"2024-04-17T19:47:01.869956+0000","last_undegraded":"2024-04-17T19:47:01.869956+0000","last_fullsized":"2024-04-17T19:47:01.869956+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_clean_scrub_stamp":"2024-04-17T19:46:59.695482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:30:31.288100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,7,4],"acting":[2,3,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T19:47:02.723729+0000","last_change":"2024-04-17T19:46:56.695109+0000","last_active":"2024-04-17T19:47:02.723729+0000","last_peered":"2024-04-17T19:47:02.723729+0000","last_clean":"2024-04-17T19:47:02.723729+0000","last_became_active":"2024-04-17T19:46:56.694764+0000","last_became_peered":"2024-04-17T19:46:56.694764+0000","last_unstale":"2024-04-17T19:47:02.723729+0000","last_undegraded":"2024-04-17T19:47:02.723729+0000","last_fullsized":"2024-04-17T19:47:02.723729+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_clean_scrub_stamp":"2024-04-17T19:46:55.648649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T00:28:36.944531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"24'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T19:47:01.717531+0000","last_change":"2024-04-17T19:46:55.704346+0000","last_active":"2024-04-17T19:47:01.717531+0000","last_peered":"2024-04-17T19:47:01.717531+0000","last_clean":"2024-04-17T19:47:01.717531+0000","last_became_active":"2024-04-17T19:46:55.703334+0000","last_became_peered":"2024-04-17T19:46:55.703334+0000","last_unstale":"2024-04-17T19:47:01.717531+0000","last_undegraded":"2024-04-17T19:47:01.717531+0000","last_fullsized":"2024-04-17T19:47:01.717531+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:54.640133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:54.640133+0000","last_clean_scrub_stamp":"2024-04-17T19:46:54.640133+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:01:11.327106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T19:47:01.716304+0000","last_change":"2024-04-17T19:47:00.745450+0000","last_active":"2024-04-17T19:47:01.716304+0000","last_peered":"2024-04-17T19:47:01.716304+0000","last_clean":"2024-04-17T19:47:01.716304+0000","last_became_active":"2024-04-17T19:47:00.744227+0000","last_became_peered":"2024-04-17T19:47:00.744227+0000","last_unstale":"2024-04-17T19:47:01.716304+0000","last_undegraded":"2024-04-17T19:47:01.716304+0000","last_fullsized":"2024-04-17T19:47:01.716304+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_clean_scrub_stamp":"2024-04-17T19:46:59.695482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:52:15.523817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1,3],"acting":[5,4,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T19:47:02.723996+0000","last_change":"2024-04-17T19:46:56.687926+0000","last_active":"2024-04-17T19:47:02.723996+0000","last_peered":"2024-04-17T19:47:02.723996+0000","last_clean":"2024-04-17T19:47:02.723996+0000","last_became_active":"2024-04-17T19:46:56.687352+0000","last_became_peered":"2024-04-17T19:46:56.687352+0000","last_unstale":"2024-04-17T19:47:02.723996+0000","last_undegraded":"2024-04-17T19:47:02.723996+0000","last_fullsized":"2024-04-17T19:47:02.723996+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_clean_scrub_stamp":"2024-04-17T19:46:55.648649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T01:32:52.608291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.e","version":"24'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T19:47:01.717920+0000","last_change":"2024-04-17T19:46:55.716397+0000","last_active":"2024-04-17T19:47:01.717920+0000","last_peered":"2024-04-17T19:47:01.717920+0000","last_clean":"2024-04-17T19:47:01.717920+0000","last_became_active":"2024-04-17T19:46:55.715196+0000","last_became_peered":"2024-04-17T19:46:55.715196+0000","last_unstale":"2024-04-17T19:47:01.717920+0000","last_undegraded":"2024-04-17T19:47:01.717920+0000","last_fullsized":"2024-04-17T19:47:01.717920+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:54.640133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:54.640133+0000","last_clean_scrub_stamp":"2024-04-17T19:46:54.640133+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:24:42.573542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T19:47:01.713746+0000","last_change":"2024-04-17T19:47:00.735608+0000","last_active":"2024-04-17T19:47:01.713746+0000","last_peered":"2024-04-17T19:47:01.713746+0000","last_clean":"2024-04-17T19:47:01.713746+0000","last_became_active":"2024-04-17T19:47:00.735120+0000","last_became_peered":"2024-04-17T19:47:00.735120+0000","last_unstale":"2024-04-17T19:47:01.713746+0000","last_undegraded":"2024-04-17T19:47:01.713746+0000","last_fullsized":"2024-04-17T19:47:01.713746+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_clean_scrub_stamp":"2024-04-17T19:46:59.695482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T04:40:43.846198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T19:47:01.870376+0000","last_change":"2024-04-17T19:46:56.706026+0000","last_active":"2024-04-17T19:47:01.870376+0000","last_peered":"2024-04-17T19:47:01.870376+0000","last_clean":"2024-04-17T19:47:01.870376+0000","last_became_active":"2024-04-17T19:46:56.704786+0000","last_became_peered":"2024-04-17T19:46:56.704786+0000","last_unstale":"2024-04-17T19:47:01.870376+0000","last_undegraded":"2024-04-17T19:47:01.870376+0000","last_fullsized":"2024-04-17T19:47:01.870376+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_clean_scrub_stamp":"2024-04-17T19:46:55.648649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:59:17.441539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.f","version":"24'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T19:47:02.723994+0000","last_change":"2024-04-17T19:46:55.707082+0000","last_active":"2024-04-17T19:47:02.723994+0000","last_peered":"2024-04-17T19:47:02.723994+0000","last_clean":"2024-04-17T19:47:02.723994+0000","last_became_active":"2024-04-17T19:46:55.706729+0000","last_became_peered":"2024-04-17T19:46:55.706729+0000","last_unstale":"2024-04-17T19:47:02.723994+0000","last_undegraded":"2024-04-17T19:47:02.723994+0000","last_fullsized":"2024-04-17T19:47:02.723994+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:54.640133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:54.640133+0000","last_clean_scrub_stamp":"2024-04-17T19:46:54.640133+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:11:00.737141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T19:47:02.879853+0000","last_change":"2024-04-17T19:47:00.744054+0000","last_active":"2024-04-17T19:47:02.879853+0000","last_peered":"2024-04-17T19:47:02.879853+0000","last_clean":"2024-04-17T19:47:02.879853+0000","last_became_active":"2024-04-17T19:47:00.743582+0000","last_became_peered":"2024-04-17T19:47:00.743582+0000","last_unstale":"2024-04-17T19:47:02.879853+0000","last_undegraded":"2024-04-17T19:47:02.879853+0000","last_fullsized":"2024-04-17T19:47:02.879853+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_clean_scrub_stamp":"2024-04-17T19:46:59.695482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T22:25:09.219331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,2],"acting":[1,5,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T19:47:01.713775+0000","last_change":"2024-04-17T19:46:56.692435+0000","last_active":"2024-04-17T19:47:01.713775+0000","last_peered":"2024-04-17T19:47:01.713775+0000","last_clean":"2024-04-17T19:47:01.713775+0000","last_became_active":"2024-04-17T19:46:56.692038+0000","last_became_peered":"2024-04-17T19:46:56.692038+0000","last_unstale":"2024-04-17T19:47:01.713775+0000","last_undegraded":"2024-04-17T19:47:01.713775+0000","last_fullsized":"2024-04-17T19:47:01.713775+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_clean_scrub_stamp":"2024-04-17T19:46:55.648649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:06:56.889266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.10","version":"24'8","reported_seq":30,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T19:47:01.715884+0000","last_change":"2024-04-17T19:46:55.692188+0000","last_active":"2024-04-17T19:47:01.715884+0000","last_peered":"2024-04-17T19:47:01.715884+0000","last_clean":"2024-04-17T19:47:01.715884+0000","last_became_active":"2024-04-17T19:46:55.691286+0000","last_became_peered":"2024-04-17T19:46:55.691286+0000","last_unstale":"2024-04-17T19:47:01.715884+0000","last_undegraded":"2024-04-17T19:47:01.715884+0000","last_fullsized":"2024-04-17T19:47:01.715884+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:54.640133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:54.640133+0000","last_clean_scrub_stamp":"2024-04-17T19:46:54.640133+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:01:11.327106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T19:47:01.718903+0000","last_change":"2024-04-17T19:47:00.781167+0000","last_active":"2024-04-17T19:47:01.718903+0000","last_peered":"2024-04-17T19:47:01.718903+0000","last_clean":"2024-04-17T19:47:01.718903+0000","last_became_active":"2024-04-17T19:47:00.780167+0000","last_became_peered":"2024-04-17T19:47:00.780167+0000","last_unstale":"2024-04-17T19:47:01.718903+0000","last_undegraded":"2024-04-17T19:47:01.718903+0000","last_fullsized":"2024-04-17T19:47:01.718903+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_clean_scrub_stamp":"2024-04-17T19:46:59.695482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T00:07:51.831352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1,6],"acting":[5,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T19:47:02.879680+0000","last_change":"2024-04-17T19:46:56.676150+0000","last_active":"2024-04-17T19:47:02.879680+0000","last_peered":"2024-04-17T19:47:02.879680+0000","last_clean":"2024-04-17T19:47:02.879680+0000","last_became_active":"2024-04-17T19:46:56.675826+0000","last_became_peered":"2024-04-17T19:46:56.675826+0000","last_unstale":"2024-04-17T19:47:02.879680+0000","last_undegraded":"2024-04-17T19:47:02.879680+0000","last_fullsized":"2024-04-17T19:47:02.879680+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_clean_scrub_stamp":"2024-04-17T19:46:55.648649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T04:52:17.017088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T19:47:02.723099+0000","last_change":"2024-04-17T19:46:55.682001+0000","last_active":"2024-04-17T19:47:02.723099+0000","last_peered":"2024-04-17T19:47:02.723099+0000","last_clean":"2024-04-17T19:47:02.723099+0000","last_became_active":"2024-04-17T19:46:55.681607+0000","last_became_peered":"2024-04-17T19:46:55.681607+0000","last_unstale":"2024-04-17T19:47:02.723099+0000","last_undegraded":"2024-04-17T19:47:02.723099+0000","last_fullsized":"2024-04-17T19:47:02.723099+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:54.640133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:54.640133+0000","last_clean_scrub_stamp":"2024-04-17T19:46:54.640133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T04:43:37.994081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T19:47:01.717753+0000","last_change":"2024-04-17T19:47:00.756396+0000","last_active":"2024-04-17T19:47:01.717753+0000","last_peered":"2024-04-17T19:47:01.717753+0000","last_clean":"2024-04-17T19:47:01.717753+0000","last_became_active":"2024-04-17T19:47:00.755282+0000","last_became_peered":"2024-04-17T19:47:00.755282+0000","last_unstale":"2024-04-17T19:47:01.717753+0000","last_undegraded":"2024-04-17T19:47:01.717753+0000","last_fullsized":"2024-04-17T19:47:01.717753+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_clean_scrub_stamp":"2024-04-17T19:46:59.695482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:08:25.082826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6,4],"acting":[5,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T19:47:01.714233+0000","last_change":"2024-04-17T19:46:56.694764+0000","last_active":"2024-04-17T19:47:01.714233+0000","last_peered":"2024-04-17T19:47:01.714233+0000","last_clean":"2024-04-17T19:47:01.714233+0000","last_became_active":"2024-04-17T19:46:56.694449+0000","last_became_peered":"2024-04-17T19:46:56.694449+0000","last_unstale":"2024-04-17T19:47:01.714233+0000","last_undegraded":"2024-04-17T19:47:01.714233+0000","last_fullsized":"2024-04-17T19:47:01.714233+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_clean_scrub_stamp":"2024-04-17T19:46:55.648649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T02:53:14.607908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T19:47:01.714414+0000","last_change":"2024-04-17T19:46:55.689900+0000","last_active":"2024-04-17T19:47:01.714414+0000","last_peered":"2024-04-17T19:47:01.714414+0000","last_clean":"2024-04-17T19:47:01.714414+0000","last_became_active":"2024-04-17T19:46:55.689607+0000","last_became_peered":"2024-04-17T19:46:55.689607+0000","last_unstale":"2024-04-17T19:47:01.714414+0000","last_undegraded":"2024-04-17T19:47:01.714414+0000","last_fullsized":"2024-04-17T19:47:01.714414+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:54.640133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:54.640133+0000","last_clean_scrub_stamp":"2024-04-17T19:46:54.640133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:59:16.433023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T19:47:02.884022+0000","last_change":"2024-04-17T19:47:00.786434+0000","last_active":"2024-04-17T19:47:02.884022+0000","last_peered":"2024-04-17T19:47:02.884022+0000","last_clean":"2024-04-17T19:47:02.884022+0000","last_became_active":"2024-04-17T19:47:00.781025+0000","last_became_peered":"2024-04-17T19:47:00.781025+0000","last_unstale":"2024-04-17T19:47:02.884022+0000","last_undegraded":"2024-04-17T19:47:02.884022+0000","last_fullsized":"2024-04-17T19:47:02.884022+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_clean_scrub_stamp":"2024-04-17T19:46:59.695482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:51:07.602172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0,7],"acting":[6,4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T19:47:02.881470+0000","last_change":"2024-04-17T19:46:56.693555+0000","last_active":"2024-04-17T19:47:02.881470+0000","last_peered":"2024-04-17T19:47:02.881470+0000","last_clean":"2024-04-17T19:47:02.881470+0000","last_became_active":"2024-04-17T19:46:56.687385+0000","last_became_peered":"2024-04-17T19:46:56.687385+0000","last_unstale":"2024-04-17T19:47:02.881470+0000","last_undegraded":"2024-04-17T19:47:02.881470+0000","last_fullsized":"2024-04-17T19:47:02.881470+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_clean_scrub_stamp":"2024-04-17T19:46:55.648649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T05:52:33.559392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"24'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T19:47:02.883275+0000","last_change":"2024-04-17T19:46:55.700010+0000","last_active":"2024-04-17T19:47:02.883275+0000","last_peered":"2024-04-17T19:47:02.883275+0000","last_clean":"2024-04-17T19:47:02.883275+0000","last_became_active":"2024-04-17T19:46:55.698962+0000","last_became_peered":"2024-04-17T19:46:55.698962+0000","last_unstale":"2024-04-17T19:47:02.883275+0000","last_undegraded":"2024-04-17T19:47:02.883275+0000","last_fullsized":"2024-04-17T19:47:02.883275+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:54.640133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:54.640133+0000","last_clean_scrub_stamp":"2024-04-17T19:46:54.640133+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T01:25:12.780134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T19:47:01.714898+0000","last_change":"2024-04-17T19:47:00.760341+0000","last_active":"2024-04-17T19:47:01.714898+0000","last_peered":"2024-04-17T19:47:01.714898+0000","last_clean":"2024-04-17T19:47:01.714898+0000","last_became_active":"2024-04-17T19:47:00.759892+0000","last_became_peered":"2024-04-17T19:47:00.759892+0000","last_unstale":"2024-04-17T19:47:01.714898+0000","last_undegraded":"2024-04-17T19:47:01.714898+0000","last_fullsized":"2024-04-17T19:47:01.714898+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_clean_scrub_stamp":"2024-04-17T19:46:59.695482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T05:15:30.939022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5,6],"acting":[3,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T19:47:02.723476+0000","last_change":"2024-04-17T19:46:56.696716+0000","last_active":"2024-04-17T19:47:02.723476+0000","last_peered":"2024-04-17T19:47:02.723476+0000","last_clean":"2024-04-17T19:47:02.723476+0000","last_became_active":"2024-04-17T19:46:56.696355+0000","last_became_peered":"2024-04-17T19:46:56.696355+0000","last_unstale":"2024-04-17T19:47:02.723476+0000","last_undegraded":"2024-04-17T19:47:02.723476+0000","last_fullsized":"2024-04-17T19:47:02.723476+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_clean_scrub_stamp":"2024-04-17T19:46:55.648649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:06:56.889266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.14","version":"25'9","reported_seq":31,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T19:47:10.213408+0000","last_change":"2024-04-17T19:46:55.697242+0000","last_active":"2024-04-17T19:47:10.213408+0000","last_peered":"2024-04-17T19:47:10.213408+0000","last_clean":"2024-04-17T19:47:10.213408+0000","last_became_active":"2024-04-17T19:46:55.696876+0000","last_became_peered":"2024-04-17T19:46:55.696876+0000","last_unstale":"2024-04-17T19:47:10.213408+0000","last_undegraded":"2024-04-17T19:47:10.213408+0000","last_fullsized":"2024-04-17T19:47:10.213408+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:54.640133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:54.640133+0000","last_clean_scrub_stamp":"2024-04-17T19:46:54.640133+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:24:28.029324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3842,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T19:47:01.717017+0000","last_change":"2024-04-17T19:47:00.743810+0000","last_active":"2024-04-17T19:47:01.717017+0000","last_peered":"2024-04-17T19:47:01.717017+0000","last_clean":"2024-04-17T19:47:01.717017+0000","last_became_active":"2024-04-17T19:47:00.742290+0000","last_became_peered":"2024-04-17T19:47:00.742290+0000","last_unstale":"2024-04-17T19:47:01.717017+0000","last_undegraded":"2024-04-17T19:47:01.717017+0000","last_fullsized":"2024-04-17T19:47:01.717017+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_clean_scrub_stamp":"2024-04-17T19:46:59.695482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T04:20:00.039224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,5,0],"acting":[4,3,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T19:47:01.714061+0000","last_change":"2024-04-17T19:46:56.680527+0000","last_active":"2024-04-17T19:47:01.714061+0000","last_peered":"2024-04-17T19:47:01.714061+0000","last_clean":"2024-04-17T19:47:01.714061+0000","last_became_active":"2024-04-17T19:46:56.680171+0000","last_became_peered":"2024-04-17T19:46:56.680171+0000","last_unstale":"2024-04-17T19:47:01.714061+0000","last_undegraded":"2024-04-17T19:47:01.714061+0000","last_fullsized":"2024-04-17T19:47:01.714061+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_clean_scrub_stamp":"2024-04-17T19:46:55.648649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T07:11:10.748292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.15","version":"24'3","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T19:47:02.883827+0000","last_change":"2024-04-17T19:46:55.707717+0000","last_active":"2024-04-17T19:47:02.883827+0000","last_peered":"2024-04-17T19:47:02.883827+0000","last_clean":"2024-04-17T19:47:02.883827+0000","last_became_active":"2024-04-17T19:46:55.706967+0000","last_became_peered":"2024-04-17T19:46:55.706967+0000","last_unstale":"2024-04-17T19:47:02.883827+0000","last_undegraded":"2024-04-17T19:47:02.883827+0000","last_fullsized":"2024-04-17T19:47:02.883827+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:54.640133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:54.640133+0000","last_clean_scrub_stamp":"2024-04-17T19:46:54.640133+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T05:10:04.380307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T19:47:01.870166+0000","last_change":"2024-04-17T19:47:00.758723+0000","last_active":"2024-04-17T19:47:01.870166+0000","last_peered":"2024-04-17T19:47:01.870166+0000","last_clean":"2024-04-17T19:47:01.870166+0000","last_became_active":"2024-04-17T19:47:00.758209+0000","last_became_peered":"2024-04-17T19:47:00.758209+0000","last_unstale":"2024-04-17T19:47:01.870166+0000","last_undegraded":"2024-04-17T19:47:01.870166+0000","last_fullsized":"2024-04-17T19:47:01.870166+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_clean_scrub_stamp":"2024-04-17T19:46:59.695482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T04:48:47.816818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1,7],"acting":[2,3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T19:47:01.718073+0000","last_change":"2024-04-17T19:46:56.684067+0000","last_active":"2024-04-17T19:47:01.718073+0000","last_peered":"2024-04-17T19:47:01.718073+0000","last_clean":"2024-04-17T19:47:01.718073+0000","last_became_active":"2024-04-17T19:46:56.683685+0000","last_became_peered":"2024-04-17T19:46:56.683685+0000","last_unstale":"2024-04-17T19:47:01.718073+0000","last_undegraded":"2024-04-17T19:47:01.718073+0000","last_fullsized":"2024-04-17T19:47:01.718073+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_clean_scrub_stamp":"2024-04-17T19:46:55.648649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T02:52:38.425163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T19:47:02.723716+0000","last_change":"2024-04-17T19:46:55.687311+0000","last_active":"2024-04-17T19:47:02.723716+0000","last_peered":"2024-04-17T19:47:02.723716+0000","last_clean":"2024-04-17T19:47:02.723716+0000","last_became_active":"2024-04-17T19:46:55.687019+0000","last_became_peered":"2024-04-17T19:46:55.687019+0000","last_unstale":"2024-04-17T19:47:02.723716+0000","last_undegraded":"2024-04-17T19:47:02.723716+0000","last_fullsized":"2024-04-17T19:47:02.723716+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:54.640133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:54.640133+0000","last_clean_scrub_stamp":"2024-04-17T19:46:54.640133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T01:53:38.377482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T19:47:02.881723+0000","last_change":"2024-04-17T19:47:00.780072+0000","last_active":"2024-04-17T19:47:02.881723+0000","last_peered":"2024-04-17T19:47:02.881723+0000","last_clean":"2024-04-17T19:47:02.881723+0000","last_became_active":"2024-04-17T19:47:00.777053+0000","last_became_peered":"2024-04-17T19:47:00.777053+0000","last_unstale":"2024-04-17T19:47:02.881723+0000","last_undegraded":"2024-04-17T19:47:02.881723+0000","last_fullsized":"2024-04-17T19:47:02.881723+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_clean_scrub_stamp":"2024-04-17T19:46:59.695482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T22:01:53.910725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,3,2],"acting":[7,1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T19:47:01.870331+0000","last_change":"2024-04-17T19:46:56.692985+0000","last_active":"2024-04-17T19:47:01.870331+0000","last_peered":"2024-04-17T19:47:01.870331+0000","last_clean":"2024-04-17T19:47:01.870331+0000","last_became_active":"2024-04-17T19:46:56.692287+0000","last_became_peered":"2024-04-17T19:46:56.692287+0000","last_unstale":"2024-04-17T19:47:01.870331+0000","last_undegraded":"2024-04-17T19:47:01.870331+0000","last_fullsized":"2024-04-17T19:47:01.870331+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_clean_scrub_stamp":"2024-04-17T19:46:55.648649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:20:50.341776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T19:47:02.880504+0000","last_change":"2024-04-17T19:46:55.691681+0000","last_active":"2024-04-17T19:47:02.880504+0000","last_peered":"2024-04-17T19:47:02.880504+0000","last_clean":"2024-04-17T19:47:02.880504+0000","last_became_active":"2024-04-17T19:46:55.691354+0000","last_became_peered":"2024-04-17T19:46:55.691354+0000","last_unstale":"2024-04-17T19:47:02.880504+0000","last_undegraded":"2024-04-17T19:47:02.880504+0000","last_fullsized":"2024-04-17T19:47:02.880504+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:54.640133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:54.640133+0000","last_clean_scrub_stamp":"2024-04-17T19:46:54.640133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T00:40:58.757373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T19:47:01.716521+0000","last_change":"2024-04-17T19:47:00.764854+0000","last_active":"2024-04-17T19:47:01.716521+0000","last_peered":"2024-04-17T19:47:01.716521+0000","last_clean":"2024-04-17T19:47:01.716521+0000","last_became_active":"2024-04-17T19:47:00.763550+0000","last_became_peered":"2024-04-17T19:47:00.763550+0000","last_unstale":"2024-04-17T19:47:01.716521+0000","last_undegraded":"2024-04-17T19:47:01.716521+0000","last_fullsized":"2024-04-17T19:47:01.716521+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_clean_scrub_stamp":"2024-04-17T19:46:59.695482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T04:26:38.527427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,3,7],"acting":[4,0,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T19:47:01.717807+0000","last_change":"2024-04-17T19:47:00.746028+0000","last_active":"2024-04-17T19:47:01.717807+0000","last_peered":"2024-04-17T19:47:01.717807+0000","last_clean":"2024-04-17T19:47:01.717807+0000","last_became_active":"2024-04-17T19:47:00.744828+0000","last_became_peered":"2024-04-17T19:47:00.744828+0000","last_unstale":"2024-04-17T19:47:01.717807+0000","last_undegraded":"2024-04-17T19:47:01.717807+0000","last_fullsized":"2024-04-17T19:47:01.717807+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_clean_scrub_stamp":"2024-04-17T19:46:59.695482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T22:37:58.836823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,5,3],"acting":[4,1,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T19:47:01.716479+0000","last_change":"2024-04-17T19:46:56.691650+0000","last_active":"2024-04-17T19:47:01.716479+0000","last_peered":"2024-04-17T19:47:01.716479+0000","last_clean":"2024-04-17T19:47:01.716479+0000","last_became_active":"2024-04-17T19:46:56.690810+0000","last_became_peered":"2024-04-17T19:46:56.690810+0000","last_unstale":"2024-04-17T19:47:01.716479+0000","last_undegraded":"2024-04-17T19:47:01.716479+0000","last_fullsized":"2024-04-17T19:47:01.716479+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_clean_scrub_stamp":"2024-04-17T19:46:55.648649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T04:25:07.123916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T19:47:01.714013+0000","last_change":"2024-04-17T19:46:55.691871+0000","last_active":"2024-04-17T19:47:01.714013+0000","last_peered":"2024-04-17T19:47:01.714013+0000","last_clean":"2024-04-17T19:47:01.714013+0000","last_became_active":"2024-04-17T19:46:55.690539+0000","last_became_peered":"2024-04-17T19:46:55.690539+0000","last_unstale":"2024-04-17T19:47:01.714013+0000","last_undegraded":"2024-04-17T19:47:01.714013+0000","last_fullsized":"2024-04-17T19:47:01.714013+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:54.640133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:54.640133+0000","last_clean_scrub_stamp":"2024-04-17T19:46:54.640133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T04:52:16.008572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T19:47:01.715456+0000","last_change":"2024-04-17T19:47:00.749616+0000","last_active":"2024-04-17T19:47:01.715456+0000","last_peered":"2024-04-17T19:47:01.715456+0000","last_clean":"2024-04-17T19:47:01.715456+0000","last_became_active":"2024-04-17T19:47:00.749061+0000","last_became_peered":"2024-04-17T19:47:00.749061+0000","last_unstale":"2024-04-17T19:47:01.715456+0000","last_undegraded":"2024-04-17T19:47:01.715456+0000","last_fullsized":"2024-04-17T19:47:01.715456+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_clean_scrub_stamp":"2024-04-17T19:46:59.695482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:33:36.676817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5,1],"acting":[3,2,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T19:47:01.715322+0000","last_change":"2024-04-17T19:46:56.692190+0000","last_active":"2024-04-17T19:47:01.715322+0000","last_peered":"2024-04-17T19:47:01.715322+0000","last_clean":"2024-04-17T19:47:01.715322+0000","last_became_active":"2024-04-17T19:46:56.691524+0000","last_became_peered":"2024-04-17T19:46:56.691524+0000","last_unstale":"2024-04-17T19:47:01.715322+0000","last_undegraded":"2024-04-17T19:47:01.715322+0000","last_fullsized":"2024-04-17T19:47:01.715322+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_clean_scrub_stamp":"2024-04-17T19:46:55.648649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:44:38.787541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T19:47:02.880985+0000","last_change":"2024-04-17T19:46:55.700265+0000","last_active":"2024-04-17T19:47:02.880985+0000","last_peered":"2024-04-17T19:47:02.880985+0000","last_clean":"2024-04-17T19:47:02.880985+0000","last_became_active":"2024-04-17T19:46:55.699166+0000","last_became_peered":"2024-04-17T19:46:55.699166+0000","last_unstale":"2024-04-17T19:47:02.880985+0000","last_undegraded":"2024-04-17T19:47:02.880985+0000","last_fullsized":"2024-04-17T19:47:02.880985+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:54.640133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:54.640133+0000","last_clean_scrub_stamp":"2024-04-17T19:46:54.640133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T02:39:08.241534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"24'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T19:47:01.714291+0000","last_change":"2024-04-17T19:46:55.687779+0000","last_active":"2024-04-17T19:47:01.714291+0000","last_peered":"2024-04-17T19:47:01.714291+0000","last_clean":"2024-04-17T19:47:01.714291+0000","last_became_active":"2024-04-17T19:46:55.687401+0000","last_became_peered":"2024-04-17T19:46:55.687401+0000","last_unstale":"2024-04-17T19:47:01.714291+0000","last_undegraded":"2024-04-17T19:47:01.714291+0000","last_fullsized":"2024-04-17T19:47:01.714291+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:54.640133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:54.640133+0000","last_clean_scrub_stamp":"2024-04-17T19:46:54.640133+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:20:49.333260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T19:47:01.716820+0000","last_change":"2024-04-17T19:46:56.691635+0000","last_active":"2024-04-17T19:47:01.716820+0000","last_peered":"2024-04-17T19:47:01.716820+0000","last_clean":"2024-04-17T19:47:01.716820+0000","last_became_active":"2024-04-17T19:46:56.691199+0000","last_became_peered":"2024-04-17T19:46:56.691199+0000","last_unstale":"2024-04-17T19:47:01.716820+0000","last_undegraded":"2024-04-17T19:47:01.716820+0000","last_fullsized":"2024-04-17T19:47:01.716820+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_clean_scrub_stamp":"2024-04-17T19:46:55.648649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:00:10.859769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T19:47:01.717329+0000","last_change":"2024-04-17T19:47:00.776142+0000","last_active":"2024-04-17T19:47:01.717329+0000","last_peered":"2024-04-17T19:47:01.717329+0000","last_clean":"2024-04-17T19:47:01.717329+0000","last_became_active":"2024-04-17T19:47:00.774592+0000","last_became_peered":"2024-04-17T19:47:00.774592+0000","last_unstale":"2024-04-17T19:47:01.717329+0000","last_undegraded":"2024-04-17T19:47:01.717329+0000","last_fullsized":"2024-04-17T19:47:01.717329+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_clean_scrub_stamp":"2024-04-17T19:46:59.695482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:04:03.656402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,7],"acting":[4,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"24'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T19:47:01.716933+0000","last_change":"2024-04-17T19:46:55.713656+0000","last_active":"2024-04-17T19:47:01.716933+0000","last_peered":"2024-04-17T19:47:01.716933+0000","last_clean":"2024-04-17T19:47:01.716933+0000","last_became_active":"2024-04-17T19:46:55.712982+0000","last_became_peered":"2024-04-17T19:46:55.712982+0000","last_unstale":"2024-04-17T19:47:01.716933+0000","last_undegraded":"2024-04-17T19:47:01.716933+0000","last_fullsized":"2024-04-17T19:47:01.716933+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:54.640133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:54.640133+0000","last_clean_scrub_stamp":"2024-04-17T19:46:54.640133+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:02:52.057635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T19:47:02.879756+0000","last_change":"2024-04-17T19:46:56.681984+0000","last_active":"2024-04-17T19:47:02.879756+0000","last_peered":"2024-04-17T19:47:02.879756+0000","last_clean":"2024-04-17T19:47:02.879756+0000","last_became_active":"2024-04-17T19:46:56.679830+0000","last_became_peered":"2024-04-17T19:46:56.679830+0000","last_unstale":"2024-04-17T19:47:02.879756+0000","last_undegraded":"2024-04-17T19:47:02.879756+0000","last_fullsized":"2024-04-17T19:47:02.879756+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_clean_scrub_stamp":"2024-04-17T19:46:55.648649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:11:01.745657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T19:47:02.883151+0000","last_change":"2024-04-17T19:47:00.777411+0000","last_active":"2024-04-17T19:47:02.883151+0000","last_peered":"2024-04-17T19:47:02.883151+0000","last_clean":"2024-04-17T19:47:02.883151+0000","last_became_active":"2024-04-17T19:47:00.776357+0000","last_became_peered":"2024-04-17T19:47:00.776357+0000","last_unstale":"2024-04-17T19:47:02.883151+0000","last_undegraded":"2024-04-17T19:47:02.883151+0000","last_fullsized":"2024-04-17T19:47:02.883151+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_clean_scrub_stamp":"2024-04-17T19:46:59.695482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:41:22.030097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,1,0],"acting":[7,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T19:47:01.869642+0000","last_change":"2024-04-17T19:46:56.706021+0000","last_active":"2024-04-17T19:47:01.869642+0000","last_peered":"2024-04-17T19:47:01.869642+0000","last_clean":"2024-04-17T19:47:01.869642+0000","last_became_active":"2024-04-17T19:46:56.702724+0000","last_became_peered":"2024-04-17T19:46:56.702724+0000","last_unstale":"2024-04-17T19:47:01.869642+0000","last_undegraded":"2024-04-17T19:47:01.869642+0000","last_fullsized":"2024-04-17T19:47:01.869642+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_clean_scrub_stamp":"2024-04-17T19:46:55.648649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:11:01.745657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T19:47:02.881763+0000","last_change":"2024-04-17T19:46:56.685239+0000","last_active":"2024-04-17T19:47:02.881763+0000","last_peered":"2024-04-17T19:47:02.881763+0000","last_clean":"2024-04-17T19:47:02.881763+0000","last_became_active":"2024-04-17T19:46:56.684771+0000","last_became_peered":"2024-04-17T19:46:56.684771+0000","last_unstale":"2024-04-17T19:47:02.881763+0000","last_undegraded":"2024-04-17T19:47:02.881763+0000","last_fullsized":"2024-04-17T19:47:02.881763+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_clean_scrub_stamp":"2024-04-17T19:46:55.648649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T04:52:17.017088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T19:47:01.713945+0000","last_change":"2024-04-17T19:46:56.686238+0000","last_active":"2024-04-17T19:47:01.713945+0000","last_peered":"2024-04-17T19:47:01.713945+0000","last_clean":"2024-04-17T19:47:01.713945+0000","last_became_active":"2024-04-17T19:46:56.685745+0000","last_became_peered":"2024-04-17T19:46:56.685745+0000","last_unstale":"2024-04-17T19:47:01.713945+0000","last_undegraded":"2024-04-17T19:47:01.713945+0000","last_fullsized":"2024-04-17T19:47:01.713945+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_clean_scrub_stamp":"2024-04-17T19:46:55.648649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:01:01.006486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T19:47:01.716621+0000","last_change":"2024-04-17T19:46:56.675844+0000","last_active":"2024-04-17T19:47:01.716621+0000","last_peered":"2024-04-17T19:47:01.716621+0000","last_clean":"2024-04-17T19:47:01.716621+0000","last_became_active":"2024-04-17T19:46:56.675519+0000","last_became_peered":"2024-04-17T19:46:56.675519+0000","last_unstale":"2024-04-17T19:47:01.716621+0000","last_undegraded":"2024-04-17T19:47:01.716621+0000","last_fullsized":"2024-04-17T19:47:01.716621+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_clean_scrub_stamp":"2024-04-17T19:46:55.648649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T00:46:07.348168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T19:47:02.884195+0000","last_change":"2024-04-17T19:46:56.699663+0000","last_active":"2024-04-17T19:47:02.884195+0000","last_peered":"2024-04-17T19:47:02.884195+0000","last_clean":"2024-04-17T19:47:02.884195+0000","last_became_active":"2024-04-17T19:46:56.699293+0000","last_became_peered":"2024-04-17T19:46:56.699293+0000","last_unstale":"2024-04-17T19:47:02.884195+0000","last_undegraded":"2024-04-17T19:47:02.884195+0000","last_fullsized":"2024-04-17T19:47:02.884195+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_clean_scrub_stamp":"2024-04-17T19:46:55.648649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T22:25:05.172498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T19:47:02.883978+0000","last_change":"2024-04-17T19:46:56.684368+0000","last_active":"2024-04-17T19:47:02.883978+0000","last_peered":"2024-04-17T19:47:02.883978+0000","last_clean":"2024-04-17T19:47:02.883978+0000","last_became_active":"2024-04-17T19:46:56.683963+0000","last_became_peered":"2024-04-17T19:46:56.683963+0000","last_unstale":"2024-04-17T19:47:02.883978+0000","last_undegraded":"2024-04-17T19:47:02.883978+0000","last_fullsized":"2024-04-17T19:47:02.883978+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_clean_scrub_stamp":"2024-04-17T19:46:55.648649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:41:17.983264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T19:47:01.870215+0000","last_change":"2024-04-17T19:46:56.704924+0000","last_active":"2024-04-17T19:47:01.870215+0000","last_peered":"2024-04-17T19:47:01.870215+0000","last_clean":"2024-04-17T19:47:01.870215+0000","last_became_active":"2024-04-17T19:46:56.692688+0000","last_became_peered":"2024-04-17T19:46:56.692688+0000","last_unstale":"2024-04-17T19:47:01.870215+0000","last_undegraded":"2024-04-17T19:47:01.870215+0000","last_fullsized":"2024-04-17T19:47:01.870215+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_clean_scrub_stamp":"2024-04-17T19:46:55.648649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T01:39:33.595213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T19:47:01.717583+0000","last_change":"2024-04-17T19:46:56.685081+0000","last_active":"2024-04-17T19:47:01.717583+0000","last_peered":"2024-04-17T19:47:01.717583+0000","last_clean":"2024-04-17T19:47:01.717583+0000","last_became_active":"2024-04-17T19:46:56.684714+0000","last_became_peered":"2024-04-17T19:46:56.684714+0000","last_unstale":"2024-04-17T19:47:01.717583+0000","last_undegraded":"2024-04-17T19:47:01.717583+0000","last_fullsized":"2024-04-17T19:47:01.717583+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_clean_scrub_stamp":"2024-04-17T19:46:55.648649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T04:26:34.480594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T19:47:01.713823+0000","last_change":"2024-04-17T19:46:56.681089+0000","last_active":"2024-04-17T19:47:01.713823+0000","last_peered":"2024-04-17T19:47:01.713823+0000","last_clean":"2024-04-17T19:47:01.713823+0000","last_became_active":"2024-04-17T19:46:56.679818+0000","last_became_peered":"2024-04-17T19:46:56.679818+0000","last_unstale":"2024-04-17T19:47:01.713823+0000","last_undegraded":"2024-04-17T19:47:01.713823+0000","last_fullsized":"2024-04-17T19:47:01.713823+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_clean_scrub_stamp":"2024-04-17T19:46:55.648649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T01:32:52.608291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T19:47:01.716037+0000","last_change":"2024-04-17T19:46:56.674556+0000","last_active":"2024-04-17T19:47:01.716037+0000","last_peered":"2024-04-17T19:47:01.716037+0000","last_clean":"2024-04-17T19:47:01.716037+0000","last_became_active":"2024-04-17T19:46:56.674164+0000","last_became_peered":"2024-04-17T19:46:56.674164+0000","last_unstale":"2024-04-17T19:47:01.716037+0000","last_undegraded":"2024-04-17T19:47:01.716037+0000","last_fullsized":"2024-04-17T19:47:01.716037+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_clean_scrub_stamp":"2024-04-17T19:46:55.648649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T22:53:45.664676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T19:47:02.879682+0000","last_change":"2024-04-17T19:46:56.697359+0000","last_active":"2024-04-17T19:47:02.879682+0000","last_peered":"2024-04-17T19:47:02.879682+0000","last_clean":"2024-04-17T19:47:02.879682+0000","last_became_active":"2024-04-17T19:46:56.695255+0000","last_became_peered":"2024-04-17T19:46:56.695255+0000","last_unstale":"2024-04-17T19:47:02.879682+0000","last_undegraded":"2024-04-17T19:47:02.879682+0000","last_fullsized":"2024-04-17T19:47:02.879682+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_clean_scrub_stamp":"2024-04-17T19:46:55.648649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T01:53:39.385998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T19:47:01.716676+0000","last_change":"2024-04-17T19:46:56.692366+0000","last_active":"2024-04-17T19:47:01.716676+0000","last_peered":"2024-04-17T19:47:01.716676+0000","last_clean":"2024-04-17T19:47:01.716676+0000","last_became_active":"2024-04-17T19:46:56.691942+0000","last_became_peered":"2024-04-17T19:46:56.691942+0000","last_unstale":"2024-04-17T19:47:01.716676+0000","last_undegraded":"2024-04-17T19:47:01.716676+0000","last_fullsized":"2024-04-17T19:47:01.716676+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_clean_scrub_stamp":"2024-04-17T19:46:55.648649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T02:34:05.358659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T19:47:02.723676+0000","last_change":"2024-04-17T19:46:56.693507+0000","last_active":"2024-04-17T19:47:02.723676+0000","last_peered":"2024-04-17T19:47:02.723676+0000","last_clean":"2024-04-17T19:47:02.723676+0000","last_became_active":"2024-04-17T19:46:56.691938+0000","last_became_peered":"2024-04-17T19:46:56.691938+0000","last_unstale":"2024-04-17T19:47:02.723676+0000","last_undegraded":"2024-04-17T19:47:02.723676+0000","last_fullsized":"2024-04-17T19:47:02.723676+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_clean_scrub_stamp":"2024-04-17T19:46:55.648649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T04:48:43.769985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T19:47:01.715076+0000","last_change":"2024-04-17T19:46:56.700707+0000","last_active":"2024-04-17T19:47:01.715076+0000","last_peered":"2024-04-17T19:47:01.715076+0000","last_clean":"2024-04-17T19:47:01.715076+0000","last_became_active":"2024-04-17T19:46:56.700346+0000","last_became_peered":"2024-04-17T19:46:56.700346+0000","last_unstale":"2024-04-17T19:47:01.715076+0000","last_undegraded":"2024-04-17T19:47:01.715076+0000","last_fullsized":"2024-04-17T19:47:01.715076+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_clean_scrub_stamp":"2024-04-17T19:46:55.648649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:58:35.976326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T19:47:02.883782+0000","last_change":"2024-04-17T19:46:56.705410+0000","last_active":"2024-04-17T19:47:02.883782+0000","last_peered":"2024-04-17T19:47:02.883782+0000","last_clean":"2024-04-17T19:47:02.883782+0000","last_became_active":"2024-04-17T19:46:56.705076+0000","last_became_peered":"2024-04-17T19:46:56.705076+0000","last_unstale":"2024-04-17T19:47:02.883782+0000","last_undegraded":"2024-04-17T19:47:02.883782+0000","last_fullsized":"2024-04-17T19:47:02.883782+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_clean_scrub_stamp":"2024-04-17T19:46:55.648649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T01:53:39.385998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T19:47:01.715553+0000","last_change":"2024-04-17T19:46:56.697436+0000","last_active":"2024-04-17T19:47:01.715553+0000","last_peered":"2024-04-17T19:47:01.715553+0000","last_clean":"2024-04-17T19:47:01.715553+0000","last_became_active":"2024-04-17T19:46:56.696667+0000","last_became_peered":"2024-04-17T19:46:56.696667+0000","last_unstale":"2024-04-17T19:47:01.715553+0000","last_undegraded":"2024-04-17T19:47:01.715553+0000","last_fullsized":"2024-04-17T19:47:01.715553+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_clean_scrub_stamp":"2024-04-17T19:46:55.648649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:54:05.520742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T19:47:01.713821+0000","last_change":"2024-04-17T19:46:56.680847+0000","last_active":"2024-04-17T19:47:01.713821+0000","last_peered":"2024-04-17T19:47:01.713821+0000","last_clean":"2024-04-17T19:47:01.713821+0000","last_became_active":"2024-04-17T19:46:56.680224+0000","last_became_peered":"2024-04-17T19:46:56.680224+0000","last_unstale":"2024-04-17T19:47:01.713821+0000","last_undegraded":"2024-04-17T19:47:01.713821+0000","last_fullsized":"2024-04-17T19:47:01.713821+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_clean_scrub_stamp":"2024-04-17T19:46:55.648649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T04:48:43.769985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T19:47:01.715770+0000","last_change":"2024-04-17T19:46:56.688647+0000","last_active":"2024-04-17T19:47:01.715770+0000","last_peered":"2024-04-17T19:47:01.715770+0000","last_clean":"2024-04-17T19:47:01.715770+0000","last_became_active":"2024-04-17T19:46:56.688294+0000","last_became_peered":"2024-04-17T19:46:56.688294+0000","last_unstale":"2024-04-17T19:47:01.715770+0000","last_undegraded":"2024-04-17T19:47:01.715770+0000","last_fullsized":"2024-04-17T19:47:01.715770+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_clean_scrub_stamp":"2024-04-17T19:46:55.648649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T02:34:05.358659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T19:47:02.881299+0000","last_change":"2024-04-17T19:46:56.686415+0000","last_active":"2024-04-17T19:47:02.881299+0000","last_peered":"2024-04-17T19:47:02.881299+0000","last_clean":"2024-04-17T19:47:02.881299+0000","last_became_active":"2024-04-17T19:46:56.684639+0000","last_became_peered":"2024-04-17T19:46:56.684639+0000","last_unstale":"2024-04-17T19:47:02.881299+0000","last_undegraded":"2024-04-17T19:47:02.881299+0000","last_fullsized":"2024-04-17T19:47:02.881299+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_clean_scrub_stamp":"2024-04-17T19:46:55.648649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:20:50.341776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T19:47:02.882440+0000","last_change":"2024-04-17T19:46:56.694678+0000","last_active":"2024-04-17T19:47:02.882440+0000","last_peered":"2024-04-17T19:47:02.882440+0000","last_clean":"2024-04-17T19:47:02.882440+0000","last_became_active":"2024-04-17T19:46:56.694213+0000","last_became_peered":"2024-04-17T19:46:56.694213+0000","last_unstale":"2024-04-17T19:47:02.882440+0000","last_undegraded":"2024-04-17T19:47:02.882440+0000","last_fullsized":"2024-04-17T19:47:02.882440+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_clean_scrub_stamp":"2024-04-17T19:46:55.648649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:59:17.441539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T19:47:02.723614+0000","last_change":"2024-04-17T19:46:56.693810+0000","last_active":"2024-04-17T19:47:02.723614+0000","last_peered":"2024-04-17T19:47:02.723614+0000","last_clean":"2024-04-17T19:47:02.723614+0000","last_became_active":"2024-04-17T19:46:56.692874+0000","last_became_peered":"2024-04-17T19:46:56.692874+0000","last_unstale":"2024-04-17T19:47:02.723614+0000","last_undegraded":"2024-04-17T19:47:02.723614+0000","last_fullsized":"2024-04-17T19:47:02.723614+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_clean_scrub_stamp":"2024-04-17T19:46:55.648649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:30:27.241267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T19:47:02.723470+0000","last_change":"2024-04-17T19:46:56.700330+0000","last_active":"2024-04-17T19:47:02.723470+0000","last_peered":"2024-04-17T19:47:02.723470+0000","last_clean":"2024-04-17T19:47:02.723470+0000","last_became_active":"2024-04-17T19:46:56.700013+0000","last_became_peered":"2024-04-17T19:46:56.700013+0000","last_unstale":"2024-04-17T19:47:02.723470+0000","last_undegraded":"2024-04-17T19:47:02.723470+0000","last_fullsized":"2024-04-17T19:47:02.723470+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_clean_scrub_stamp":"2024-04-17T19:46:55.648649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:23:16.383918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T19:47:02.723614+0000","last_change":"2024-04-17T19:46:56.709400+0000","last_active":"2024-04-17T19:47:02.723614+0000","last_peered":"2024-04-17T19:47:02.723614+0000","last_clean":"2024-04-17T19:47:02.723614+0000","last_became_active":"2024-04-17T19:46:56.708606+0000","last_became_peered":"2024-04-17T19:46:56.708606+0000","last_unstale":"2024-04-17T19:47:02.723614+0000","last_undegraded":"2024-04-17T19:47:02.723614+0000","last_fullsized":"2024-04-17T19:47:02.723614+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_clean_scrub_stamp":"2024-04-17T19:46:55.648649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T01:46:36.503198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T19:47:02.880442+0000","last_change":"2024-04-17T19:46:56.681267+0000","last_active":"2024-04-17T19:47:02.880442+0000","last_peered":"2024-04-17T19:47:02.880442+0000","last_clean":"2024-04-17T19:47:02.880442+0000","last_became_active":"2024-04-17T19:46:56.680919+0000","last_became_peered":"2024-04-17T19:46:56.680919+0000","last_unstale":"2024-04-17T19:47:02.880442+0000","last_undegraded":"2024-04-17T19:47:02.880442+0000","last_fullsized":"2024-04-17T19:47:02.880442+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_clean_scrub_stamp":"2024-04-17T19:46:55.648649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T01:39:33.595213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T19:47:01.714992+0000","last_change":"2024-04-17T19:46:56.688682+0000","last_active":"2024-04-17T19:47:01.714992+0000","last_peered":"2024-04-17T19:47:01.714992+0000","last_clean":"2024-04-17T19:47:01.714992+0000","last_became_active":"2024-04-17T19:46:56.688320+0000","last_became_peered":"2024-04-17T19:46:56.688320+0000","last_unstale":"2024-04-17T19:47:01.714992+0000","last_undegraded":"2024-04-17T19:47:01.714992+0000","last_fullsized":"2024-04-17T19:47:01.714992+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_clean_scrub_stamp":"2024-04-17T19:46:55.648649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:00:10.859769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T19:47:02.723099+0000","last_change":"2024-04-17T19:46:56.699129+0000","last_active":"2024-04-17T19:47:02.723099+0000","last_peered":"2024-04-17T19:47:02.723099+0000","last_clean":"2024-04-17T19:47:02.723099+0000","last_became_active":"2024-04-17T19:46:56.698840+0000","last_became_peered":"2024-04-17T19:46:56.698840+0000","last_unstale":"2024-04-17T19:47:02.723099+0000","last_undegraded":"2024-04-17T19:47:02.723099+0000","last_fullsized":"2024-04-17T19:47:02.723099+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_clean_scrub_stamp":"2024-04-17T19:46:55.648649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T05:35:47.746622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T19:47:01.870059+0000","last_change":"2024-04-17T19:46:56.705903+0000","last_active":"2024-04-17T19:47:01.870059+0000","last_peered":"2024-04-17T19:47:01.870059+0000","last_clean":"2024-04-17T19:47:01.870059+0000","last_became_active":"2024-04-17T19:46:56.705539+0000","last_became_peered":"2024-04-17T19:46:56.705539+0000","last_unstale":"2024-04-17T19:47:01.870059+0000","last_undegraded":"2024-04-17T19:47:01.870059+0000","last_fullsized":"2024-04-17T19:47:01.870059+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_clean_scrub_stamp":"2024-04-17T19:46:55.648649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:57:40.700986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T19:47:02.723301+0000","last_change":"2024-04-17T19:46:56.694456+0000","last_active":"2024-04-17T19:47:02.723301+0000","last_peered":"2024-04-17T19:47:02.723301+0000","last_clean":"2024-04-17T19:47:02.723301+0000","last_became_active":"2024-04-17T19:46:56.693954+0000","last_became_peered":"2024-04-17T19:46:56.693954+0000","last_unstale":"2024-04-17T19:47:02.723301+0000","last_undegraded":"2024-04-17T19:47:02.723301+0000","last_fullsized":"2024-04-17T19:47:02.723301+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_clean_scrub_stamp":"2024-04-17T19:46:55.648649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:22:33.413402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T19:47:01.869795+0000","last_change":"2024-04-17T19:46:56.706411+0000","last_active":"2024-04-17T19:47:01.869795+0000","last_peered":"2024-04-17T19:47:01.869795+0000","last_clean":"2024-04-17T19:47:01.869795+0000","last_became_active":"2024-04-17T19:46:56.706021+0000","last_became_peered":"2024-04-17T19:46:56.706021+0000","last_unstale":"2024-04-17T19:47:01.869795+0000","last_undegraded":"2024-04-17T19:47:01.869795+0000","last_fullsized":"2024-04-17T19:47:01.869795+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_clean_scrub_stamp":"2024-04-17T19:46:55.648649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T05:52:33.559392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T19:47:01.717212+0000","last_change":"2024-04-17T19:46:56.696930+0000","last_active":"2024-04-17T19:47:01.717212+0000","last_peered":"2024-04-17T19:47:01.717212+0000","last_clean":"2024-04-17T19:47:01.717212+0000","last_became_active":"2024-04-17T19:46:56.696492+0000","last_became_peered":"2024-04-17T19:46:56.696492+0000","last_unstale":"2024-04-17T19:47:01.717212+0000","last_undegraded":"2024-04-17T19:47:01.717212+0000","last_fullsized":"2024-04-17T19:47:01.717212+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_clean_scrub_stamp":"2024-04-17T19:46:55.648649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:43:54.268148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T19:47:01.718855+0000","last_change":"2024-04-17T19:46:56.683448+0000","last_active":"2024-04-17T19:47:01.718855+0000","last_peered":"2024-04-17T19:47:01.718855+0000","last_clean":"2024-04-17T19:47:01.718855+0000","last_became_active":"2024-04-17T19:46:56.682772+0000","last_became_peered":"2024-04-17T19:46:56.682772+0000","last_unstale":"2024-04-17T19:47:01.718855+0000","last_undegraded":"2024-04-17T19:47:01.718855+0000","last_fullsized":"2024-04-17T19:47:01.718855+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_clean_scrub_stamp":"2024-04-17T19:46:55.648649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T22:39:31.496708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T19:47:02.723937+0000","last_change":"2024-04-17T19:46:56.695275+0000","last_active":"2024-04-17T19:47:02.723937+0000","last_peered":"2024-04-17T19:47:02.723937+0000","last_clean":"2024-04-17T19:47:02.723937+0000","last_became_active":"2024-04-17T19:46:56.694743+0000","last_became_peered":"2024-04-17T19:46:56.694743+0000","last_unstale":"2024-04-17T19:47:02.723937+0000","last_undegraded":"2024-04-17T19:47:02.723937+0000","last_fullsized":"2024-04-17T19:47:02.723937+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_clean_scrub_stamp":"2024-04-17T19:46:55.648649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:01:01.006486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4640,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":66496,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509449,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27280,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344560,"statfs":{"total":96636764160,"available":96608829440,"internally_reserved":0,"allocated":266240,"data_stored":101981,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509450,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27272,"kb_used_data":252,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344568,"statfs":{"total":96636764160,"available":96608837632,"internally_reserved":0,"allocated":258048,"data_stored":101857,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509450,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":256,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":262144,"data_stored":102439,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509450,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27280,"kb_used_data":264,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344560,"statfs":{"total":96636764160,"available":96608829440,"internally_reserved":0,"allocated":270336,"data_stored":105699,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509449,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27340,"kb_used_data":320,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344500,"statfs":{"total":96636764160,"available":96608768000,"internally_reserved":0,"allocated":327680,"data_stored":692295,"data_compressed":33248,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509449,"num_pgs":45,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27280,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344560,"statfs":{"total":96636764160,"available":96608829440,"internally_reserved":0,"allocated":266240,"data_stored":101913,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574857,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27348,"kb_used_data":324,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344492,"statfs":{"total":96636764160,"available":96608759808,"internally_reserved":0,"allocated":331776,"data_stored":692317,"data_compressed":33248,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574857,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27288,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":278528,"data_stored":106371,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33248,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33248,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":4514,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-17T19:47:20.994 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-17T19:47:21.185 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:21.193+0000 7fe33c600640 1 Processor -- start 2024-04-17T19:47:21.185 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:21.193+0000 7fe33c600640 1 -- start start 2024-04-17T19:47:21.187 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:21.197+0000 7fe33c600640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fe334152a60 0x7fe3340c6920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:21.187 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:21.197+0000 7fe33c600640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fe334158eb0 0x7fe3341592c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:21.187 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:21.197+0000 7fe33c600640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe334152e70 con 0x7fe3340c47c0 2024-04-17T19:47:21.187 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:21.197+0000 7fe33c600640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 -- 0x7fe3340c52c0 con 0x7fe334152a60 2024-04-17T19:47:21.187 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:21.197+0000 7fe33c600640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7fe3340c8840 con 0x7fe334158eb0 2024-04-17T19:47:21.188 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:21.197+0000 7fe339c00640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fe334152a60 0x7fe3340c6920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:21.188 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:21.197+0000 7fe339200640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fe334158eb0 0x7fe3341592c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:21.188 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:21.197+0000 7fe33a600640 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7fe3340c47c0 0x7fe33415bd70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.44:60822/0 (socket says 172.21.15.44:60822) 2024-04-17T19:47:21.188 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:21.197+0000 7fe33a600640 1 -- 172.21.15.44:0/562818418 learned_addr learned my addr 172.21.15.44:0/562818418 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-04-17T19:47:21.188 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:21.197+0000 7fe339c00640 1 -- 172.21.15.44:0/562818418 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fe334158eb0 msgr2=0x7fe3341592c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T19:47:21.188 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:21.197+0000 7fe339c00640 1 --2- 172.21.15.44:0/562818418 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fe334158eb0 0x7fe3341592c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:21.188 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:21.197+0000 7fe339c00640 1 -- 172.21.15.44:0/562818418 >> v1:172.21.15.62:6789/0 conn(0x7fe3340c47c0 legacy=0x7fe33415bd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:21.188 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:21.197+0000 7fe339c00640 1 -- 172.21.15.44:0/562818418 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe3340c8b20 con 0x7fe334152a60 2024-04-17T19:47:21.188 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:21.197+0000 7fe333e00640 1 -- 172.21.15.44:0/562818418 <== mon.1 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 18428678 0 0) 0x7fe334152e70 con 0x7fe3340c47c0 2024-04-17T19:47:21.191 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:21.201+0000 7fe339c00640 1 --2- 172.21.15.44:0/562818418 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe334152a60 0x7fe3340c6920 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fe334153040 tx=0x7fe32801ec90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b9ed752fc19e3bc8 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:47:21.191 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:21.201+0000 7fe333e00640 1 -- 172.21.15.44:0/562818418 <== mon.1 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3280b5070 con 0x7fe334152a60 2024-04-17T19:47:21.192 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:21.201+0000 7fe333e00640 1 -- 172.21.15.44:0/562818418 <== mon.1 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe3280a8990 con 0x7fe334152a60 2024-04-17T19:47:21.192 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:21.201+0000 7fe333e00640 1 -- 172.21.15.44:0/562818418 <== mon.1 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3280a8d60 con 0x7fe334152a60 2024-04-17T19:47:21.192 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:21.201+0000 7fe33c600640 1 -- 172.21.15.44:0/562818418 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe334152a60 msgr2=0x7fe3340c6920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:21.192 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:21.201+0000 7fe33c600640 1 --2- 172.21.15.44:0/562818418 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe334152a60 0x7fe3340c6920 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fe334153040 tx=0x7fe32801ec90 comp rx=0 tx=0).stop 2024-04-17T19:47:21.193 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:21.201+0000 7fe33c600640 1 -- 172.21.15.44:0/562818418 shutdown_connections 2024-04-17T19:47:21.193 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:21.201+0000 7fe33c600640 1 --2- 172.21.15.44:0/562818418 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fe334158eb0 0x7fe3341592c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:21.193 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:21.201+0000 7fe33c600640 1 --2- 172.21.15.44:0/562818418 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe334152a60 0x7fe3340c6920 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:21.193 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:21.201+0000 7fe33c600640 1 -- 172.21.15.44:0/562818418 >> 172.21.15.44:0/562818418 conn(0x7fe33406c380 msgr2=0x7fe334070080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:47:21.193 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:21.201+0000 7fe33c600640 1 -- 172.21.15.44:0/562818418 shutdown_connections 2024-04-17T19:47:21.193 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:21.201+0000 7fe33c600640 1 -- 172.21.15.44:0/562818418 wait complete. 2024-04-17T19:47:21.194 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:21.205+0000 7fe33c600640 1 Processor -- start 2024-04-17T19:47:21.194 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:21.205+0000 7fe33c600640 1 -- start start 2024-04-17T19:47:21.197 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:21.205+0000 7fe33c600640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe3340c47c0 0x7fe3341546b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:21.198 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:21.205+0000 7fe33c600640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fe334152a60 0x7fe334151ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:21.198 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:21.205+0000 7fe33c600640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe334158eb0 0x7fe334153220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:21.198 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:21.205+0000 7fe33c600640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fe334158990 con 0x7fe3340c47c0 2024-04-17T19:47:21.198 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:21.205+0000 7fe33c600640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7fe3340c90e0 con 0x7fe334158eb0 2024-04-17T19:47:21.198 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:21.205+0000 7fe33c600640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7fe3340c6e60 con 0x7fe334152a60 2024-04-17T19:47:21.198 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:21.205+0000 7fe339c00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe3340c47c0 0x7fe3341546b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:21.198 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:21.205+0000 7fe339c00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe3340c47c0 0x7fe3341546b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:42588/0 (socket says 172.21.15.44:42588) 2024-04-17T19:47:21.198 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:21.205+0000 7fe339c00640 1 -- 172.21.15.44:0/531115025 learned_addr learned my addr 172.21.15.44:0/531115025 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-04-17T19:47:21.198 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:21.205+0000 7fe339200640 1 --2- 172.21.15.44:0/531115025 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fe334152a60 0x7fe334151ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:21.198 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:21.205+0000 7fe33a600640 1 --2- 172.21.15.44:0/531115025 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe334158eb0 0x7fe334153220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:21.198 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:21.205+0000 7fe339c00640 1 -- 172.21.15.44:0/531115025 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fe334152a60 msgr2=0x7fe334151ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:21.198 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:21.205+0000 7fe339c00640 1 --2- 172.21.15.44:0/531115025 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fe334152a60 0x7fe334151ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:21.199 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:21.205+0000 7fe339c00640 1 -- 172.21.15.44:0/531115025 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe334158eb0 msgr2=0x7fe334153220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:21.199 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:21.205+0000 7fe339c00640 1 --2- 172.21.15.44:0/531115025 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe334158eb0 0x7fe334153220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:21.199 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:21.205+0000 7fe339c00640 1 -- 172.21.15.44:0/531115025 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe3341523e0 con 0x7fe3340c47c0 2024-04-17T19:47:21.199 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:21.205+0000 7fe339c00640 1 --2- 172.21.15.44:0/531115025 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe3340c47c0 0x7fe3341546b0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fe32801c8c0 tx=0x7fe32801ba30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:47:21.199 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:21.205+0000 7fe331600640 1 -- 172.21.15.44:0/531115025 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3280c0070 con 0x7fe3340c47c0 2024-04-17T19:47:21.199 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:21.205+0000 7fe331600640 1 -- 172.21.15.44:0/531115025 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe328004230 con 0x7fe3340c47c0 2024-04-17T19:47:21.199 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:21.205+0000 7fe33c600640 1 -- 172.21.15.44:0/531115025 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe334150570 con 0x7fe3340c47c0 2024-04-17T19:47:21.199 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:21.205+0000 7fe331600640 1 -- 172.21.15.44:0/531115025 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3280b5040 con 0x7fe3340c47c0 2024-04-17T19:47:21.199 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:21.205+0000 7fe33c600640 1 -- 172.21.15.44:0/531115025 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe33414c2d0 con 0x7fe3340c47c0 2024-04-17T19:47:21.200 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:21.205+0000 7fe33c600640 1 -- 172.21.15.44:0/531115025 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe33404ff10 con 0x7fe3340c47c0 2024-04-17T19:47:21.200 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:21.209+0000 7fe331600640 1 -- 172.21.15.44:0/531115025 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fe3280c3070 con 0x7fe3340c47c0 2024-04-17T19:47:21.200 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:21.209+0000 7fe331600640 1 --2- 172.21.15.44:0/531115025 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7fe314068380 0x7fe31406a890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:21.200 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:21.209+0000 7fe331600640 1 -- 172.21.15.44:0/531115025 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fe328123440 con 0x7fe3340c47c0 2024-04-17T19:47:21.201 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:21.209+0000 7fe339200640 1 --2- 172.21.15.44:0/531115025 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7fe314068380 0x7fe31406a890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:21.201 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:21.209+0000 7fe339200640 1 --2- 172.21.15.44:0/531115025 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7fe314068380 0x7fe31406a890 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fe334148d90 tx=0x7fe320009190 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:47:21.204 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:21.213+0000 7fe331600640 1 -- 172.21.15.44:0/531115025 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fe3280187f0 con 0x7fe3340c47c0 2024-04-17T19:47:21.368 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:21.377+0000 7fe33c600640 1 -- 172.21.15.44:0/531115025 --> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fe334150320 con 0x7fe314068380 2024-04-17T19:47:21.393 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:21.401+0000 7fe331600640 1 -- 172.21.15.44:0/531115025 <== mgr.4102 v2:172.21.15.62:6832/1020159798 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+332631 (secure 0 0 0) 0x7fe334150320 con 0x7fe314068380 2024-04-17T19:47:21.397 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-04-17T19:47:21.399 INFO:teuthology.orchestra.run.smithi044.stderr:dumped all 2024-04-17T19:47:21.400 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:21.405+0000 7fe33c600640 1 -- 172.21.15.44:0/531115025 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7fe314068380 msgr2=0x7fe31406a890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:21.400 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:21.405+0000 7fe33c600640 1 --2- 172.21.15.44:0/531115025 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7fe314068380 0x7fe31406a890 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fe334148d90 tx=0x7fe320009190 comp rx=0 tx=0).stop 2024-04-17T19:47:21.400 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:21.405+0000 7fe33c600640 1 -- 172.21.15.44:0/531115025 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe3340c47c0 msgr2=0x7fe3341546b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:21.400 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:21.405+0000 7fe33c600640 1 --2- 172.21.15.44:0/531115025 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe3340c47c0 0x7fe3341546b0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fe32801c8c0 tx=0x7fe32801ba30 comp rx=0 tx=0).stop 2024-04-17T19:47:21.400 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:21.405+0000 7fe33c600640 1 -- 172.21.15.44:0/531115025 shutdown_connections 2024-04-17T19:47:21.400 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:21.405+0000 7fe33c600640 1 --2- 172.21.15.44:0/531115025 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7fe314068380 0x7fe31406a890 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:21.400 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:21.405+0000 7fe33c600640 1 --2- 172.21.15.44:0/531115025 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fe334152a60 0x7fe334151ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:21.400 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:21.405+0000 7fe33c600640 1 --2- 172.21.15.44:0/531115025 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe334158eb0 0x7fe334153220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:21.400 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:21.405+0000 7fe33c600640 1 --2- 172.21.15.44:0/531115025 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe3340c47c0 0x7fe3341546b0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:21.400 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:21.405+0000 7fe33c600640 1 -- 172.21.15.44:0/531115025 >> 172.21.15.44:0/531115025 conn(0x7fe33406c380 msgr2=0x7fe3340725b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:47:21.400 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:21.405+0000 7fe33c600640 1 -- 172.21.15.44:0/531115025 shutdown_connections 2024-04-17T19:47:21.401 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:21.405+0000 7fe33c600640 1 -- 172.21.15.44:0/531115025 wait complete. 2024-04-17T19:47:21.418 INFO:teuthology.orchestra.run.smithi044.stdout:{"pg_ready":true,"pg_map":{"version":38,"stamp":"2024-04-17T19:47:19.903614+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595008,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":207,"num_write_kb":2434,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":159,"ondisk_log_size":159,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":218364,"kb_used_data":2208,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754756356,"statfs":{"total":773094113280,"available":772870508544,"internally_reserved":0,"allocated":2260992,"data_stored":2004872,"data_compressed":66496,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":12751,"internal_metadata":221236785},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2230,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.006178"},"pg_stats":[{"pgid":"2.1f","version":"24'4","reported_seq":26,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T19:47:01.718542+0000","last_change":"2024-04-17T19:46:55.688623+0000","last_active":"2024-04-17T19:47:01.718542+0000","last_peered":"2024-04-17T19:47:01.718542+0000","last_clean":"2024-04-17T19:47:01.718542+0000","last_became_active":"2024-04-17T19:46:55.687455+0000","last_became_peered":"2024-04-17T19:46:55.687455+0000","last_unstale":"2024-04-17T19:47:01.718542+0000","last_undegraded":"2024-04-17T19:47:01.718542+0000","last_fullsized":"2024-04-17T19:47:01.718542+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:54.640133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:54.640133+0000","last_clean_scrub_stamp":"2024-04-17T19:46:54.640133+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:02:52.057635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T19:47:01.719008+0000","last_change":"2024-04-17T19:46:56.683770+0000","last_active":"2024-04-17T19:47:01.719008+0000","last_peered":"2024-04-17T19:47:01.719008+0000","last_clean":"2024-04-17T19:47:01.719008+0000","last_became_active":"2024-04-17T19:46:56.683111+0000","last_became_peered":"2024-04-17T19:46:56.683111+0000","last_unstale":"2024-04-17T19:47:01.719008+0000","last_undegraded":"2024-04-17T19:47:01.719008+0000","last_fullsized":"2024-04-17T19:47:01.719008+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_clean_scrub_stamp":"2024-04-17T19:46:55.648649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T22:25:59.135091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T19:47:02.881985+0000","last_change":"2024-04-17T19:47:00.788461+0000","last_active":"2024-04-17T19:47:02.881985+0000","last_peered":"2024-04-17T19:47:02.881985+0000","last_clean":"2024-04-17T19:47:02.881985+0000","last_became_active":"2024-04-17T19:47:00.787654+0000","last_became_peered":"2024-04-17T19:47:00.787654+0000","last_unstale":"2024-04-17T19:47:02.881985+0000","last_undegraded":"2024-04-17T19:47:02.881985+0000","last_fullsized":"2024-04-17T19:47:02.881985+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_clean_scrub_stamp":"2024-04-17T19:46:59.695482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T07:28:34.234670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4,1],"acting":[7,6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1e","version":"24'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T19:47:01.719064+0000","last_change":"2024-04-17T19:46:55.703749+0000","last_active":"2024-04-17T19:47:01.719064+0000","last_peered":"2024-04-17T19:47:01.719064+0000","last_clean":"2024-04-17T19:47:01.719064+0000","last_became_active":"2024-04-17T19:46:55.695191+0000","last_became_peered":"2024-04-17T19:46:55.695191+0000","last_unstale":"2024-04-17T19:47:01.719064+0000","last_undegraded":"2024-04-17T19:47:01.719064+0000","last_fullsized":"2024-04-17T19:47:01.719064+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:54.640133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:54.640133+0000","last_clean_scrub_stamp":"2024-04-17T19:46:54.640133+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:24:42.573542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T19:47:01.717983+0000","last_change":"2024-04-17T19:46:56.684814+0000","last_active":"2024-04-17T19:47:01.717983+0000","last_peered":"2024-04-17T19:47:01.717983+0000","last_clean":"2024-04-17T19:47:01.717983+0000","last_became_active":"2024-04-17T19:46:56.684475+0000","last_became_peered":"2024-04-17T19:46:56.684475+0000","last_unstale":"2024-04-17T19:47:01.717983+0000","last_undegraded":"2024-04-17T19:47:01.717983+0000","last_fullsized":"2024-04-17T19:47:01.717983+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_clean_scrub_stamp":"2024-04-17T19:46:55.648649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T05:38:55.394025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T19:47:01.869722+0000","last_change":"2024-04-17T19:47:00.769813+0000","last_active":"2024-04-17T19:47:01.869722+0000","last_peered":"2024-04-17T19:47:01.869722+0000","last_clean":"2024-04-17T19:47:01.869722+0000","last_became_active":"2024-04-17T19:47:00.769370+0000","last_became_peered":"2024-04-17T19:47:00.769370+0000","last_unstale":"2024-04-17T19:47:01.869722+0000","last_undegraded":"2024-04-17T19:47:01.869722+0000","last_fullsized":"2024-04-17T19:47:01.869722+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_clean_scrub_stamp":"2024-04-17T19:46:59.695482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:23:20.430751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,4,6],"acting":[2,7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1d","version":"24'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T19:47:02.723599+0000","last_change":"2024-04-17T19:46:55.695159+0000","last_active":"2024-04-17T19:47:02.723599+0000","last_peered":"2024-04-17T19:47:02.723599+0000","last_clean":"2024-04-17T19:47:02.723599+0000","last_became_active":"2024-04-17T19:46:55.694285+0000","last_became_peered":"2024-04-17T19:46:55.694285+0000","last_unstale":"2024-04-17T19:47:02.723599+0000","last_undegraded":"2024-04-17T19:47:02.723599+0000","last_fullsized":"2024-04-17T19:47:02.723599+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:54.640133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:54.640133+0000","last_clean_scrub_stamp":"2024-04-17T19:46:54.640133+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T04:52:16.008572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T19:47:02.880050+0000","last_change":"2024-04-17T19:46:56.700734+0000","last_active":"2024-04-17T19:47:02.880050+0000","last_peered":"2024-04-17T19:47:02.880050+0000","last_clean":"2024-04-17T19:47:02.880050+0000","last_became_active":"2024-04-17T19:46:56.700413+0000","last_became_peered":"2024-04-17T19:46:56.700413+0000","last_unstale":"2024-04-17T19:47:02.880050+0000","last_undegraded":"2024-04-17T19:47:02.880050+0000","last_fullsized":"2024-04-17T19:47:02.880050+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_clean_scrub_stamp":"2024-04-17T19:46:55.648649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:57:40.700986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T19:47:01.869999+0000","last_change":"2024-04-17T19:47:00.772341+0000","last_active":"2024-04-17T19:47:01.869999+0000","last_peered":"2024-04-17T19:47:01.869999+0000","last_clean":"2024-04-17T19:47:01.869999+0000","last_became_active":"2024-04-17T19:47:00.771578+0000","last_became_peered":"2024-04-17T19:47:00.771578+0000","last_unstale":"2024-04-17T19:47:01.869999+0000","last_undegraded":"2024-04-17T19:47:01.869999+0000","last_fullsized":"2024-04-17T19:47:01.869999+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_clean_scrub_stamp":"2024-04-17T19:46:59.695482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:51:07.602172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,3,6],"acting":[2,5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1c","version":"24'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T19:47:02.723800+0000","last_change":"2024-04-17T19:46:55.687607+0000","last_active":"2024-04-17T19:47:02.723800+0000","last_peered":"2024-04-17T19:47:02.723800+0000","last_clean":"2024-04-17T19:47:02.723800+0000","last_became_active":"2024-04-17T19:46:55.687282+0000","last_became_peered":"2024-04-17T19:46:55.687282+0000","last_unstale":"2024-04-17T19:47:02.723800+0000","last_undegraded":"2024-04-17T19:47:02.723800+0000","last_fullsized":"2024-04-17T19:47:02.723800+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:54.640133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:54.640133+0000","last_clean_scrub_stamp":"2024-04-17T19:46:54.640133+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T05:52:32.550876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T19:47:01.714880+0000","last_change":"2024-04-17T19:46:56.690268+0000","last_active":"2024-04-17T19:47:01.714880+0000","last_peered":"2024-04-17T19:47:01.714880+0000","last_clean":"2024-04-17T19:47:01.714880+0000","last_became_active":"2024-04-17T19:46:56.689988+0000","last_became_peered":"2024-04-17T19:46:56.689988+0000","last_unstale":"2024-04-17T19:47:01.714880+0000","last_undegraded":"2024-04-17T19:47:01.714880+0000","last_fullsized":"2024-04-17T19:47:01.714880+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_clean_scrub_stamp":"2024-04-17T19:46:55.648649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T01:29:59.423734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T19:47:01.869747+0000","last_change":"2024-04-17T19:47:00.759608+0000","last_active":"2024-04-17T19:47:01.869747+0000","last_peered":"2024-04-17T19:47:01.869747+0000","last_clean":"2024-04-17T19:47:01.869747+0000","last_became_active":"2024-04-17T19:47:00.759059+0000","last_became_peered":"2024-04-17T19:47:00.759059+0000","last_unstale":"2024-04-17T19:47:01.869747+0000","last_undegraded":"2024-04-17T19:47:01.869747+0000","last_fullsized":"2024-04-17T19:47:01.869747+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_clean_scrub_stamp":"2024-04-17T19:46:59.695482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:22:37.460235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,5,7],"acting":[2,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T19:47:01.714081+0000","last_change":"2024-04-17T19:46:56.688273+0000","last_active":"2024-04-17T19:47:01.714081+0000","last_peered":"2024-04-17T19:47:01.714081+0000","last_clean":"2024-04-17T19:47:01.714081+0000","last_became_active":"2024-04-17T19:46:56.687662+0000","last_became_peered":"2024-04-17T19:46:56.687662+0000","last_unstale":"2024-04-17T19:47:01.714081+0000","last_undegraded":"2024-04-17T19:47:01.714081+0000","last_fullsized":"2024-04-17T19:47:01.714081+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_clean_scrub_stamp":"2024-04-17T19:46:55.648649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:51:46.684685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"24'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T19:47:01.714436+0000","last_change":"2024-04-17T19:46:55.692833+0000","last_active":"2024-04-17T19:47:01.714436+0000","last_peered":"2024-04-17T19:47:01.714436+0000","last_clean":"2024-04-17T19:47:01.714436+0000","last_became_active":"2024-04-17T19:46:55.689006+0000","last_became_peered":"2024-04-17T19:46:55.689006+0000","last_unstale":"2024-04-17T19:47:01.714436+0000","last_undegraded":"2024-04-17T19:47:01.714436+0000","last_fullsized":"2024-04-17T19:47:01.714436+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:54.640133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:54.640133+0000","last_clean_scrub_stamp":"2024-04-17T19:46:54.640133+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:57:39.692470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T19:47:01.714813+0000","last_change":"2024-04-17T19:47:00.757063+0000","last_active":"2024-04-17T19:47:01.714813+0000","last_peered":"2024-04-17T19:47:01.714813+0000","last_clean":"2024-04-17T19:47:01.714813+0000","last_became_active":"2024-04-17T19:47:00.756456+0000","last_became_peered":"2024-04-17T19:47:00.756456+0000","last_unstale":"2024-04-17T19:47:01.714813+0000","last_undegraded":"2024-04-17T19:47:01.714813+0000","last_fullsized":"2024-04-17T19:47:01.714813+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_clean_scrub_stamp":"2024-04-17T19:46:59.695482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T02:52:51.655611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,5],"acting":[3,1,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T19:47:02.884821+0000","last_change":"2024-04-17T19:46:56.691544+0000","last_active":"2024-04-17T19:47:02.884821+0000","last_peered":"2024-04-17T19:47:02.884821+0000","last_clean":"2024-04-17T19:47:02.884821+0000","last_became_active":"2024-04-17T19:46:56.690828+0000","last_became_peered":"2024-04-17T19:46:56.690828+0000","last_unstale":"2024-04-17T19:47:02.884821+0000","last_undegraded":"2024-04-17T19:47:02.884821+0000","last_fullsized":"2024-04-17T19:47:02.884821+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_clean_scrub_stamp":"2024-04-17T19:46:55.648649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:11:01.745657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T19:47:02.881826+0000","last_change":"2024-04-17T19:46:55.715857+0000","last_active":"2024-04-17T19:47:02.881826+0000","last_peered":"2024-04-17T19:47:02.881826+0000","last_clean":"2024-04-17T19:47:02.881826+0000","last_became_active":"2024-04-17T19:46:55.715197+0000","last_became_peered":"2024-04-17T19:46:55.715197+0000","last_unstale":"2024-04-17T19:47:02.881826+0000","last_undegraded":"2024-04-17T19:47:02.881826+0000","last_fullsized":"2024-04-17T19:47:02.881826+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:54.640133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:54.640133+0000","last_clean_scrub_stamp":"2024-04-17T19:46:54.640133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:25:07.379181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T19:47:02.723301+0000","last_change":"2024-04-17T19:47:00.773528+0000","last_active":"2024-04-17T19:47:02.723301+0000","last_peered":"2024-04-17T19:47:02.723301+0000","last_clean":"2024-04-17T19:47:02.723301+0000","last_became_active":"2024-04-17T19:47:00.773077+0000","last_became_peered":"2024-04-17T19:47:00.773077+0000","last_unstale":"2024-04-17T19:47:02.723301+0000","last_undegraded":"2024-04-17T19:47:02.723301+0000","last_fullsized":"2024-04-17T19:47:02.723301+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_clean_scrub_stamp":"2024-04-17T19:46:59.695482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T02:53:18.654740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,6,1],"acting":[0,4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T19:47:01.715767+0000","last_change":"2024-04-17T19:46:56.695617+0000","last_active":"2024-04-17T19:47:01.715767+0000","last_peered":"2024-04-17T19:47:01.715767+0000","last_clean":"2024-04-17T19:47:01.715767+0000","last_became_active":"2024-04-17T19:46:56.695205+0000","last_became_peered":"2024-04-17T19:46:56.695205+0000","last_unstale":"2024-04-17T19:47:01.715767+0000","last_undegraded":"2024-04-17T19:47:01.715767+0000","last_fullsized":"2024-04-17T19:47:01.715767+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_clean_scrub_stamp":"2024-04-17T19:46:55.648649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T05:05:36.718886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T19:47:01.716676+0000","last_change":"2024-04-17T19:46:55.686220+0000","last_active":"2024-04-17T19:47:01.716676+0000","last_peered":"2024-04-17T19:47:01.716676+0000","last_clean":"2024-04-17T19:47:01.716676+0000","last_became_active":"2024-04-17T19:46:55.684782+0000","last_became_peered":"2024-04-17T19:46:55.684782+0000","last_unstale":"2024-04-17T19:47:01.716676+0000","last_undegraded":"2024-04-17T19:47:01.716676+0000","last_fullsized":"2024-04-17T19:47:01.716676+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:54.640133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:54.640133+0000","last_clean_scrub_stamp":"2024-04-17T19:46:54.640133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:57:31.750325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T19:47:02.884208+0000","last_change":"2024-04-17T19:47:00.774664+0000","last_active":"2024-04-17T19:47:02.884208+0000","last_peered":"2024-04-17T19:47:02.884208+0000","last_clean":"2024-04-17T19:47:02.884208+0000","last_became_active":"2024-04-17T19:47:00.774008+0000","last_became_peered":"2024-04-17T19:47:00.774008+0000","last_unstale":"2024-04-17T19:47:02.884208+0000","last_undegraded":"2024-04-17T19:47:02.884208+0000","last_fullsized":"2024-04-17T19:47:02.884208+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_clean_scrub_stamp":"2024-04-17T19:46:59.695482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T04:04:16.650657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,2,3],"acting":[7,4,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T19:47:01.713826+0000","last_change":"2024-04-17T19:46:56.700069+0000","last_active":"2024-04-17T19:47:01.713826+0000","last_peered":"2024-04-17T19:47:01.713826+0000","last_clean":"2024-04-17T19:47:01.713826+0000","last_became_active":"2024-04-17T19:46:56.699525+0000","last_became_peered":"2024-04-17T19:46:56.699525+0000","last_unstale":"2024-04-17T19:47:01.713826+0000","last_undegraded":"2024-04-17T19:47:01.713826+0000","last_fullsized":"2024-04-17T19:47:01.713826+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_clean_scrub_stamp":"2024-04-17T19:46:55.648649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T00:28:36.944531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T19:47:02.722871+0000","last_change":"2024-04-17T19:46:55.684594+0000","last_active":"2024-04-17T19:47:02.722871+0000","last_peered":"2024-04-17T19:47:02.722871+0000","last_clean":"2024-04-17T19:47:02.722871+0000","last_became_active":"2024-04-17T19:46:55.683145+0000","last_became_peered":"2024-04-17T19:46:55.683145+0000","last_unstale":"2024-04-17T19:47:02.722871+0000","last_undegraded":"2024-04-17T19:47:02.722871+0000","last_fullsized":"2024-04-17T19:47:02.722871+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:54.640133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:54.640133+0000","last_clean_scrub_stamp":"2024-04-17T19:46:54.640133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T02:39:08.241534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T19:47:01.870328+0000","last_change":"2024-04-17T19:47:00.768781+0000","last_active":"2024-04-17T19:47:01.870328+0000","last_peered":"2024-04-17T19:47:01.870328+0000","last_clean":"2024-04-17T19:47:01.870328+0000","last_became_active":"2024-04-17T19:47:00.768277+0000","last_became_peered":"2024-04-17T19:47:00.768277+0000","last_unstale":"2024-04-17T19:47:01.870328+0000","last_undegraded":"2024-04-17T19:47:01.870328+0000","last_fullsized":"2024-04-17T19:47:01.870328+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_clean_scrub_stamp":"2024-04-17T19:46:59.695482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:07:00.936098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,7],"acting":[2,1,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T19:47:01.717916+0000","last_change":"2024-04-17T19:46:56.695528+0000","last_active":"2024-04-17T19:47:01.717916+0000","last_peered":"2024-04-17T19:47:01.717916+0000","last_clean":"2024-04-17T19:47:01.717916+0000","last_became_active":"2024-04-17T19:46:56.694993+0000","last_became_peered":"2024-04-17T19:46:56.694993+0000","last_unstale":"2024-04-17T19:47:01.717916+0000","last_undegraded":"2024-04-17T19:47:01.717916+0000","last_fullsized":"2024-04-17T19:47:01.717916+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_clean_scrub_stamp":"2024-04-17T19:46:55.648649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:08:14.848448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"24'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T19:47:01.715609+0000","last_change":"2024-04-17T19:46:55.688859+0000","last_active":"2024-04-17T19:47:01.715609+0000","last_peered":"2024-04-17T19:47:01.715609+0000","last_clean":"2024-04-17T19:47:01.715609+0000","last_became_active":"2024-04-17T19:46:55.688507+0000","last_became_peered":"2024-04-17T19:46:55.688507+0000","last_unstale":"2024-04-17T19:47:01.715609+0000","last_undegraded":"2024-04-17T19:47:01.715609+0000","last_fullsized":"2024-04-17T19:47:01.715609+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:54.640133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:54.640133+0000","last_clean_scrub_stamp":"2024-04-17T19:46:54.640133+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T01:53:38.377482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T19:47:01.869773+0000","last_change":"2024-04-17T19:47:00.781482+0000","last_active":"2024-04-17T19:47:01.869773+0000","last_peered":"2024-04-17T19:47:01.869773+0000","last_clean":"2024-04-17T19:47:01.869773+0000","last_became_active":"2024-04-17T19:47:00.780994+0000","last_became_peered":"2024-04-17T19:47:00.780994+0000","last_unstale":"2024-04-17T19:47:01.869773+0000","last_undegraded":"2024-04-17T19:47:01.869773+0000","last_fullsized":"2024-04-17T19:47:01.869773+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_clean_scrub_stamp":"2024-04-17T19:46:59.695482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T01:46:40.550031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,3,1],"acting":[2,6,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T19:47:01.718456+0000","last_change":"2024-04-17T19:46:56.695874+0000","last_active":"2024-04-17T19:47:01.718456+0000","last_peered":"2024-04-17T19:47:01.718456+0000","last_clean":"2024-04-17T19:47:01.718456+0000","last_became_active":"2024-04-17T19:46:56.694650+0000","last_became_peered":"2024-04-17T19:46:56.694650+0000","last_unstale":"2024-04-17T19:47:01.718456+0000","last_undegraded":"2024-04-17T19:47:01.718456+0000","last_fullsized":"2024-04-17T19:47:01.718456+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_clean_scrub_stamp":"2024-04-17T19:46:55.648649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:44:38.787541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"25'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T19:47:01.718214+0000","last_change":"2024-04-17T19:46:55.684490+0000","last_active":"2024-04-17T19:47:01.718214+0000","last_peered":"2024-04-17T19:47:01.718214+0000","last_clean":"2024-04-17T19:47:01.718214+0000","last_became_active":"2024-04-17T19:46:55.680100+0000","last_became_peered":"2024-04-17T19:46:55.680100+0000","last_unstale":"2024-04-17T19:47:01.718214+0000","last_undegraded":"2024-04-17T19:47:01.718214+0000","last_fullsized":"2024-04-17T19:47:01.718214+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:54.640133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:54.640133+0000","last_clean_scrub_stamp":"2024-04-17T19:46:54.640133+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:27:38.256174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T19:47:01.715596+0000","last_change":"2024-04-17T19:47:00.777588+0000","last_active":"2024-04-17T19:47:01.715596+0000","last_peered":"2024-04-17T19:47:01.715596+0000","last_clean":"2024-04-17T19:47:01.715596+0000","last_became_active":"2024-04-17T19:47:00.776873+0000","last_became_peered":"2024-04-17T19:47:00.776873+0000","last_unstale":"2024-04-17T19:47:01.715596+0000","last_undegraded":"2024-04-17T19:47:01.715596+0000","last_fullsized":"2024-04-17T19:47:01.715596+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_clean_scrub_stamp":"2024-04-17T19:46:59.695482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T02:52:42.471996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,6,3],"acting":[4,1,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T19:47:02.884485+0000","last_change":"2024-04-17T19:46:56.681681+0000","last_active":"2024-04-17T19:47:02.884485+0000","last_peered":"2024-04-17T19:47:02.884485+0000","last_clean":"2024-04-17T19:47:02.884485+0000","last_became_active":"2024-04-17T19:46:56.681316+0000","last_became_peered":"2024-04-17T19:46:56.681316+0000","last_unstale":"2024-04-17T19:47:02.884485+0000","last_undegraded":"2024-04-17T19:47:02.884485+0000","last_fullsized":"2024-04-17T19:47:02.884485+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_clean_scrub_stamp":"2024-04-17T19:46:55.648649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T07:28:30.187837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T19:47:01.715168+0000","last_change":"2024-04-17T19:46:55.692826+0000","last_active":"2024-04-17T19:47:01.715168+0000","last_peered":"2024-04-17T19:47:01.715168+0000","last_clean":"2024-04-17T19:47:01.715168+0000","last_became_active":"2024-04-17T19:46:55.691031+0000","last_became_peered":"2024-04-17T19:46:55.691031+0000","last_unstale":"2024-04-17T19:47:01.715168+0000","last_undegraded":"2024-04-17T19:47:01.715168+0000","last_fullsized":"2024-04-17T19:47:01.715168+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:54.640133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:54.640133+0000","last_clean_scrub_stamp":"2024-04-17T19:46:54.640133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T05:52:32.550876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T19:47:02.882070+0000","last_change":"2024-04-17T19:47:00.777416+0000","last_active":"2024-04-17T19:47:02.882070+0000","last_peered":"2024-04-17T19:47:02.882070+0000","last_clean":"2024-04-17T19:47:02.882070+0000","last_became_active":"2024-04-17T19:47:00.771531+0000","last_became_peered":"2024-04-17T19:47:00.771531+0000","last_unstale":"2024-04-17T19:47:02.882070+0000","last_undegraded":"2024-04-17T19:47:02.882070+0000","last_fullsized":"2024-04-17T19:47:02.882070+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_clean_scrub_stamp":"2024-04-17T19:46:59.695482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:30:31.288100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,2,7],"acting":[6,0,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T19:47:01.870267+0000","last_change":"2024-04-17T19:46:56.692250+0000","last_active":"2024-04-17T19:47:01.870267+0000","last_peered":"2024-04-17T19:47:01.870267+0000","last_clean":"2024-04-17T19:47:01.870267+0000","last_became_active":"2024-04-17T19:46:56.691801+0000","last_became_peered":"2024-04-17T19:46:56.691801+0000","last_unstale":"2024-04-17T19:47:01.870267+0000","last_undegraded":"2024-04-17T19:47:01.870267+0000","last_fullsized":"2024-04-17T19:47:01.870267+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_clean_scrub_stamp":"2024-04-17T19:46:55.648649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T01:53:39.385998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T19:47:01.716158+0000","last_change":"2024-04-17T19:46:55.713556+0000","last_active":"2024-04-17T19:47:01.716158+0000","last_peered":"2024-04-17T19:47:01.716158+0000","last_clean":"2024-04-17T19:47:01.716158+0000","last_became_active":"2024-04-17T19:46:55.712908+0000","last_became_peered":"2024-04-17T19:46:55.712908+0000","last_unstale":"2024-04-17T19:47:01.716158+0000","last_undegraded":"2024-04-17T19:47:01.716158+0000","last_fullsized":"2024-04-17T19:47:01.716158+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:54.640133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:54.640133+0000","last_clean_scrub_stamp":"2024-04-17T19:46:54.640133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:57:31.750325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T19:47:02.881295+0000","last_change":"2024-04-17T19:47:00.776868+0000","last_active":"2024-04-17T19:47:02.881295+0000","last_peered":"2024-04-17T19:47:02.881295+0000","last_clean":"2024-04-17T19:47:02.881295+0000","last_became_active":"2024-04-17T19:47:00.771385+0000","last_became_peered":"2024-04-17T19:47:00.771385+0000","last_unstale":"2024-04-17T19:47:02.881295+0000","last_undegraded":"2024-04-17T19:47:02.881295+0000","last_fullsized":"2024-04-17T19:47:02.881295+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_clean_scrub_stamp":"2024-04-17T19:46:59.695482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T01:46:40.550031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5,7],"acting":[6,3,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T19:47:02.723383+0000","last_change":"2024-04-17T19:46:56.709288+0000","last_active":"2024-04-17T19:47:02.723383+0000","last_peered":"2024-04-17T19:47:02.723383+0000","last_clean":"2024-04-17T19:47:02.723383+0000","last_became_active":"2024-04-17T19:46:56.708572+0000","last_became_peered":"2024-04-17T19:46:56.708572+0000","last_unstale":"2024-04-17T19:47:02.723383+0000","last_undegraded":"2024-04-17T19:47:02.723383+0000","last_fullsized":"2024-04-17T19:47:02.723383+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_clean_scrub_stamp":"2024-04-17T19:46:55.648649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:51:03.555339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T19:47:01.714531+0000","last_change":"2024-04-17T19:46:55.708506+0000","last_active":"2024-04-17T19:47:01.714531+0000","last_peered":"2024-04-17T19:47:01.714531+0000","last_clean":"2024-04-17T19:47:01.714531+0000","last_became_active":"2024-04-17T19:46:55.708175+0000","last_became_peered":"2024-04-17T19:46:55.708175+0000","last_unstale":"2024-04-17T19:47:01.714531+0000","last_undegraded":"2024-04-17T19:47:01.714531+0000","last_fullsized":"2024-04-17T19:47:01.714531+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:54.640133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:54.640133+0000","last_clean_scrub_stamp":"2024-04-17T19:46:54.640133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T22:25:04.163982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T19:47:02.885589+0000","last_change":"2024-04-17T19:47:00.786657+0000","last_active":"2024-04-17T19:47:02.885589+0000","last_peered":"2024-04-17T19:47:02.885589+0000","last_clean":"2024-04-17T19:47:02.885589+0000","last_became_active":"2024-04-17T19:47:00.780743+0000","last_became_peered":"2024-04-17T19:47:00.780743+0000","last_unstale":"2024-04-17T19:47:02.885589+0000","last_undegraded":"2024-04-17T19:47:02.885589+0000","last_fullsized":"2024-04-17T19:47:02.885589+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_clean_scrub_stamp":"2024-04-17T19:46:59.695482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:07:00.936098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0,3],"acting":[6,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T19:47:01.715163+0000","last_change":"2024-04-17T19:46:56.679752+0000","last_active":"2024-04-17T19:47:01.715163+0000","last_peered":"2024-04-17T19:47:01.715163+0000","last_clean":"2024-04-17T19:47:01.715163+0000","last_became_active":"2024-04-17T19:46:56.679230+0000","last_became_peered":"2024-04-17T19:46:56.679230+0000","last_unstale":"2024-04-17T19:47:01.715163+0000","last_undegraded":"2024-04-17T19:47:01.715163+0000","last_fullsized":"2024-04-17T19:47:01.715163+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_clean_scrub_stamp":"2024-04-17T19:46:55.648649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:08:14.848448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T19:47:02.882120+0000","last_change":"2024-04-17T19:46:55.715967+0000","last_active":"2024-04-17T19:47:02.882120+0000","last_peered":"2024-04-17T19:47:02.882120+0000","last_clean":"2024-04-17T19:47:02.882120+0000","last_became_active":"2024-04-17T19:46:55.715247+0000","last_became_peered":"2024-04-17T19:46:55.715247+0000","last_unstale":"2024-04-17T19:47:02.882120+0000","last_undegraded":"2024-04-17T19:47:02.882120+0000","last_fullsized":"2024-04-17T19:47:02.882120+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:54.640133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:54.640133+0000","last_clean_scrub_stamp":"2024-04-17T19:46:54.640133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T00:40:58.757373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T19:47:02.884271+0000","last_change":"2024-04-17T19:47:00.769901+0000","last_active":"2024-04-17T19:47:02.884271+0000","last_peered":"2024-04-17T19:47:02.884271+0000","last_clean":"2024-04-17T19:47:02.884271+0000","last_became_active":"2024-04-17T19:47:00.768634+0000","last_became_peered":"2024-04-17T19:47:00.768634+0000","last_unstale":"2024-04-17T19:47:02.884271+0000","last_undegraded":"2024-04-17T19:47:02.884271+0000","last_fullsized":"2024-04-17T19:47:02.884271+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_clean_scrub_stamp":"2024-04-17T19:46:59.695482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T04:48:47.816818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,7],"acting":[6,0,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T19:47:02.880908+0000","last_change":"2024-04-17T19:46:56.703467+0000","last_active":"2024-04-17T19:47:02.880908+0000","last_peered":"2024-04-17T19:47:02.880908+0000","last_clean":"2024-04-17T19:47:02.880908+0000","last_became_active":"2024-04-17T19:46:56.703148+0000","last_became_peered":"2024-04-17T19:46:56.703148+0000","last_unstale":"2024-04-17T19:47:02.880908+0000","last_undegraded":"2024-04-17T19:47:02.880908+0000","last_fullsized":"2024-04-17T19:47:02.880908+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_clean_scrub_stamp":"2024-04-17T19:46:55.648649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T22:01:49.863892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T19:47:01.714021+0000","last_change":"2024-04-17T19:46:55.715941+0000","last_active":"2024-04-17T19:47:01.714021+0000","last_peered":"2024-04-17T19:47:01.714021+0000","last_clean":"2024-04-17T19:47:01.714021+0000","last_became_active":"2024-04-17T19:46:55.715527+0000","last_became_peered":"2024-04-17T19:46:55.715527+0000","last_unstale":"2024-04-17T19:47:01.714021+0000","last_undegraded":"2024-04-17T19:47:01.714021+0000","last_fullsized":"2024-04-17T19:47:01.714021+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:54.640133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:54.640133+0000","last_clean_scrub_stamp":"2024-04-17T19:46:54.640133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:11:00.737141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T19:47:01.718674+0000","last_change":"2024-04-17T19:47:00.784031+0000","last_active":"2024-04-17T19:47:01.718674+0000","last_peered":"2024-04-17T19:47:01.718674+0000","last_clean":"2024-04-17T19:47:01.718674+0000","last_became_active":"2024-04-17T19:47:00.783386+0000","last_became_peered":"2024-04-17T19:47:00.783386+0000","last_unstale":"2024-04-17T19:47:01.718674+0000","last_undegraded":"2024-04-17T19:47:01.718674+0000","last_fullsized":"2024-04-17T19:47:01.718674+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_clean_scrub_stamp":"2024-04-17T19:46:59.695482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:00:44.689926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6,1],"acting":[5,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T19:47:01.717334+0000","last_change":"2024-04-17T19:46:56.692287+0000","last_active":"2024-04-17T19:47:01.717334+0000","last_peered":"2024-04-17T19:47:01.717334+0000","last_clean":"2024-04-17T19:47:01.717334+0000","last_became_active":"2024-04-17T19:46:56.691917+0000","last_became_peered":"2024-04-17T19:46:56.691917+0000","last_unstale":"2024-04-17T19:47:01.717334+0000","last_undegraded":"2024-04-17T19:47:01.717334+0000","last_fullsized":"2024-04-17T19:47:01.717334+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_clean_scrub_stamp":"2024-04-17T19:46:55.648649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T07:37:05.790432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T19:47:01.714558+0000","last_change":"2024-04-17T19:46:55.686031+0000","last_active":"2024-04-17T19:47:01.714558+0000","last_peered":"2024-04-17T19:47:01.714558+0000","last_clean":"2024-04-17T19:47:01.714558+0000","last_became_active":"2024-04-17T19:46:55.685599+0000","last_became_peered":"2024-04-17T19:46:55.685599+0000","last_unstale":"2024-04-17T19:47:01.714558+0000","last_undegraded":"2024-04-17T19:47:01.714558+0000","last_fullsized":"2024-04-17T19:47:01.714558+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:54.640133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:54.640133+0000","last_clean_scrub_stamp":"2024-04-17T19:46:54.640133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T01:39:32.586696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":178,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T19:47:02.879822+0000","last_change":"2024-04-17T19:46:43.000943+0000","last_active":"2024-04-17T19:47:02.879822+0000","last_peered":"2024-04-17T19:47:02.879822+0000","last_clean":"2024-04-17T19:47:02.879822+0000","last_became_active":"2024-04-17T19:46:43.000652+0000","last_became_peered":"2024-04-17T19:46:43.000652+0000","last_unstale":"2024-04-17T19:47:02.879822+0000","last_undegraded":"2024-04-17T19:47:02.879822+0000","last_fullsized":"2024-04-17T19:47:02.879822+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:41.988197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:41.988197+0000","last_clean_scrub_stamp":"2024-04-17T19:46:41.988197+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T19:53:52.845547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T19:47:01.715109+0000","last_change":"2024-04-17T19:47:00.731680+0000","last_active":"2024-04-17T19:47:01.715109+0000","last_peered":"2024-04-17T19:47:01.715109+0000","last_clean":"2024-04-17T19:47:01.715109+0000","last_became_active":"2024-04-17T19:47:00.731093+0000","last_became_peered":"2024-04-17T19:47:00.731093+0000","last_unstale":"2024-04-17T19:47:01.715109+0000","last_undegraded":"2024-04-17T19:47:01.715109+0000","last_fullsized":"2024-04-17T19:47:01.715109+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_clean_scrub_stamp":"2024-04-17T19:46:59.695482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T04:59:23.336626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T19:47:01.714967+0000","last_change":"2024-04-17T19:46:56.692443+0000","last_active":"2024-04-17T19:47:01.714967+0000","last_peered":"2024-04-17T19:47:01.714967+0000","last_clean":"2024-04-17T19:47:01.714967+0000","last_became_active":"2024-04-17T19:46:56.692106+0000","last_became_peered":"2024-04-17T19:46:56.692106+0000","last_unstale":"2024-04-17T19:47:01.714967+0000","last_undegraded":"2024-04-17T19:47:01.714967+0000","last_fullsized":"2024-04-17T19:47:01.714967+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_clean_scrub_stamp":"2024-04-17T19:46:55.648649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T04:07:54.102221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T19:47:02.884978+0000","last_change":"2024-04-17T19:46:55.689884+0000","last_active":"2024-04-17T19:47:02.884978+0000","last_peered":"2024-04-17T19:47:02.884978+0000","last_clean":"2024-04-17T19:47:02.884978+0000","last_became_active":"2024-04-17T19:46:55.689059+0000","last_became_peered":"2024-04-17T19:46:55.689059+0000","last_unstale":"2024-04-17T19:47:02.884978+0000","last_undegraded":"2024-04-17T19:47:02.884978+0000","last_fullsized":"2024-04-17T19:47:02.884978+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:54.640133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:54.640133+0000","last_clean_scrub_stamp":"2024-04-17T19:46:54.640133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T04:52:16.008572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T19:47:01.869956+0000","last_change":"2024-04-17T19:47:00.760432+0000","last_active":"2024-04-17T19:47:01.869956+0000","last_peered":"2024-04-17T19:47:01.869956+0000","last_clean":"2024-04-17T19:47:01.869956+0000","last_became_active":"2024-04-17T19:47:00.759946+0000","last_became_peered":"2024-04-17T19:47:00.759946+0000","last_unstale":"2024-04-17T19:47:01.869956+0000","last_undegraded":"2024-04-17T19:47:01.869956+0000","last_fullsized":"2024-04-17T19:47:01.869956+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_clean_scrub_stamp":"2024-04-17T19:46:59.695482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:30:31.288100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,7,4],"acting":[2,3,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T19:47:02.723729+0000","last_change":"2024-04-17T19:46:56.695109+0000","last_active":"2024-04-17T19:47:02.723729+0000","last_peered":"2024-04-17T19:47:02.723729+0000","last_clean":"2024-04-17T19:47:02.723729+0000","last_became_active":"2024-04-17T19:46:56.694764+0000","last_became_peered":"2024-04-17T19:46:56.694764+0000","last_unstale":"2024-04-17T19:47:02.723729+0000","last_undegraded":"2024-04-17T19:47:02.723729+0000","last_fullsized":"2024-04-17T19:47:02.723729+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_clean_scrub_stamp":"2024-04-17T19:46:55.648649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T00:28:36.944531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"24'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T19:47:01.717531+0000","last_change":"2024-04-17T19:46:55.704346+0000","last_active":"2024-04-17T19:47:01.717531+0000","last_peered":"2024-04-17T19:47:01.717531+0000","last_clean":"2024-04-17T19:47:01.717531+0000","last_became_active":"2024-04-17T19:46:55.703334+0000","last_became_peered":"2024-04-17T19:46:55.703334+0000","last_unstale":"2024-04-17T19:47:01.717531+0000","last_undegraded":"2024-04-17T19:47:01.717531+0000","last_fullsized":"2024-04-17T19:47:01.717531+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:54.640133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:54.640133+0000","last_clean_scrub_stamp":"2024-04-17T19:46:54.640133+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:01:11.327106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T19:47:01.716304+0000","last_change":"2024-04-17T19:47:00.745450+0000","last_active":"2024-04-17T19:47:01.716304+0000","last_peered":"2024-04-17T19:47:01.716304+0000","last_clean":"2024-04-17T19:47:01.716304+0000","last_became_active":"2024-04-17T19:47:00.744227+0000","last_became_peered":"2024-04-17T19:47:00.744227+0000","last_unstale":"2024-04-17T19:47:01.716304+0000","last_undegraded":"2024-04-17T19:47:01.716304+0000","last_fullsized":"2024-04-17T19:47:01.716304+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_clean_scrub_stamp":"2024-04-17T19:46:59.695482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:52:15.523817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1,3],"acting":[5,4,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T19:47:02.723996+0000","last_change":"2024-04-17T19:46:56.687926+0000","last_active":"2024-04-17T19:47:02.723996+0000","last_peered":"2024-04-17T19:47:02.723996+0000","last_clean":"2024-04-17T19:47:02.723996+0000","last_became_active":"2024-04-17T19:46:56.687352+0000","last_became_peered":"2024-04-17T19:46:56.687352+0000","last_unstale":"2024-04-17T19:47:02.723996+0000","last_undegraded":"2024-04-17T19:47:02.723996+0000","last_fullsized":"2024-04-17T19:47:02.723996+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_clean_scrub_stamp":"2024-04-17T19:46:55.648649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T01:32:52.608291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.e","version":"24'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T19:47:01.717920+0000","last_change":"2024-04-17T19:46:55.716397+0000","last_active":"2024-04-17T19:47:01.717920+0000","last_peered":"2024-04-17T19:47:01.717920+0000","last_clean":"2024-04-17T19:47:01.717920+0000","last_became_active":"2024-04-17T19:46:55.715196+0000","last_became_peered":"2024-04-17T19:46:55.715196+0000","last_unstale":"2024-04-17T19:47:01.717920+0000","last_undegraded":"2024-04-17T19:47:01.717920+0000","last_fullsized":"2024-04-17T19:47:01.717920+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:54.640133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:54.640133+0000","last_clean_scrub_stamp":"2024-04-17T19:46:54.640133+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:24:42.573542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T19:47:01.713746+0000","last_change":"2024-04-17T19:47:00.735608+0000","last_active":"2024-04-17T19:47:01.713746+0000","last_peered":"2024-04-17T19:47:01.713746+0000","last_clean":"2024-04-17T19:47:01.713746+0000","last_became_active":"2024-04-17T19:47:00.735120+0000","last_became_peered":"2024-04-17T19:47:00.735120+0000","last_unstale":"2024-04-17T19:47:01.713746+0000","last_undegraded":"2024-04-17T19:47:01.713746+0000","last_fullsized":"2024-04-17T19:47:01.713746+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_clean_scrub_stamp":"2024-04-17T19:46:59.695482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T04:40:43.846198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T19:47:01.870376+0000","last_change":"2024-04-17T19:46:56.706026+0000","last_active":"2024-04-17T19:47:01.870376+0000","last_peered":"2024-04-17T19:47:01.870376+0000","last_clean":"2024-04-17T19:47:01.870376+0000","last_became_active":"2024-04-17T19:46:56.704786+0000","last_became_peered":"2024-04-17T19:46:56.704786+0000","last_unstale":"2024-04-17T19:47:01.870376+0000","last_undegraded":"2024-04-17T19:47:01.870376+0000","last_fullsized":"2024-04-17T19:47:01.870376+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_clean_scrub_stamp":"2024-04-17T19:46:55.648649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:59:17.441539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.f","version":"24'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T19:47:02.723994+0000","last_change":"2024-04-17T19:46:55.707082+0000","last_active":"2024-04-17T19:47:02.723994+0000","last_peered":"2024-04-17T19:47:02.723994+0000","last_clean":"2024-04-17T19:47:02.723994+0000","last_became_active":"2024-04-17T19:46:55.706729+0000","last_became_peered":"2024-04-17T19:46:55.706729+0000","last_unstale":"2024-04-17T19:47:02.723994+0000","last_undegraded":"2024-04-17T19:47:02.723994+0000","last_fullsized":"2024-04-17T19:47:02.723994+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:54.640133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:54.640133+0000","last_clean_scrub_stamp":"2024-04-17T19:46:54.640133+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:11:00.737141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T19:47:02.879853+0000","last_change":"2024-04-17T19:47:00.744054+0000","last_active":"2024-04-17T19:47:02.879853+0000","last_peered":"2024-04-17T19:47:02.879853+0000","last_clean":"2024-04-17T19:47:02.879853+0000","last_became_active":"2024-04-17T19:47:00.743582+0000","last_became_peered":"2024-04-17T19:47:00.743582+0000","last_unstale":"2024-04-17T19:47:02.879853+0000","last_undegraded":"2024-04-17T19:47:02.879853+0000","last_fullsized":"2024-04-17T19:47:02.879853+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_clean_scrub_stamp":"2024-04-17T19:46:59.695482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T22:25:09.219331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,2],"acting":[1,5,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T19:47:01.713775+0000","last_change":"2024-04-17T19:46:56.692435+0000","last_active":"2024-04-17T19:47:01.713775+0000","last_peered":"2024-04-17T19:47:01.713775+0000","last_clean":"2024-04-17T19:47:01.713775+0000","last_became_active":"2024-04-17T19:46:56.692038+0000","last_became_peered":"2024-04-17T19:46:56.692038+0000","last_unstale":"2024-04-17T19:47:01.713775+0000","last_undegraded":"2024-04-17T19:47:01.713775+0000","last_fullsized":"2024-04-17T19:47:01.713775+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_clean_scrub_stamp":"2024-04-17T19:46:55.648649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:06:56.889266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.10","version":"24'8","reported_seq":30,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T19:47:01.715884+0000","last_change":"2024-04-17T19:46:55.692188+0000","last_active":"2024-04-17T19:47:01.715884+0000","last_peered":"2024-04-17T19:47:01.715884+0000","last_clean":"2024-04-17T19:47:01.715884+0000","last_became_active":"2024-04-17T19:46:55.691286+0000","last_became_peered":"2024-04-17T19:46:55.691286+0000","last_unstale":"2024-04-17T19:47:01.715884+0000","last_undegraded":"2024-04-17T19:47:01.715884+0000","last_fullsized":"2024-04-17T19:47:01.715884+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:54.640133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:54.640133+0000","last_clean_scrub_stamp":"2024-04-17T19:46:54.640133+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:01:11.327106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T19:47:01.718903+0000","last_change":"2024-04-17T19:47:00.781167+0000","last_active":"2024-04-17T19:47:01.718903+0000","last_peered":"2024-04-17T19:47:01.718903+0000","last_clean":"2024-04-17T19:47:01.718903+0000","last_became_active":"2024-04-17T19:47:00.780167+0000","last_became_peered":"2024-04-17T19:47:00.780167+0000","last_unstale":"2024-04-17T19:47:01.718903+0000","last_undegraded":"2024-04-17T19:47:01.718903+0000","last_fullsized":"2024-04-17T19:47:01.718903+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_clean_scrub_stamp":"2024-04-17T19:46:59.695482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T00:07:51.831352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1,6],"acting":[5,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T19:47:02.879680+0000","last_change":"2024-04-17T19:46:56.676150+0000","last_active":"2024-04-17T19:47:02.879680+0000","last_peered":"2024-04-17T19:47:02.879680+0000","last_clean":"2024-04-17T19:47:02.879680+0000","last_became_active":"2024-04-17T19:46:56.675826+0000","last_became_peered":"2024-04-17T19:46:56.675826+0000","last_unstale":"2024-04-17T19:47:02.879680+0000","last_undegraded":"2024-04-17T19:47:02.879680+0000","last_fullsized":"2024-04-17T19:47:02.879680+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_clean_scrub_stamp":"2024-04-17T19:46:55.648649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T04:52:17.017088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T19:47:02.723099+0000","last_change":"2024-04-17T19:46:55.682001+0000","last_active":"2024-04-17T19:47:02.723099+0000","last_peered":"2024-04-17T19:47:02.723099+0000","last_clean":"2024-04-17T19:47:02.723099+0000","last_became_active":"2024-04-17T19:46:55.681607+0000","last_became_peered":"2024-04-17T19:46:55.681607+0000","last_unstale":"2024-04-17T19:47:02.723099+0000","last_undegraded":"2024-04-17T19:47:02.723099+0000","last_fullsized":"2024-04-17T19:47:02.723099+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:54.640133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:54.640133+0000","last_clean_scrub_stamp":"2024-04-17T19:46:54.640133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T04:43:37.994081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T19:47:01.717753+0000","last_change":"2024-04-17T19:47:00.756396+0000","last_active":"2024-04-17T19:47:01.717753+0000","last_peered":"2024-04-17T19:47:01.717753+0000","last_clean":"2024-04-17T19:47:01.717753+0000","last_became_active":"2024-04-17T19:47:00.755282+0000","last_became_peered":"2024-04-17T19:47:00.755282+0000","last_unstale":"2024-04-17T19:47:01.717753+0000","last_undegraded":"2024-04-17T19:47:01.717753+0000","last_fullsized":"2024-04-17T19:47:01.717753+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_clean_scrub_stamp":"2024-04-17T19:46:59.695482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:08:25.082826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6,4],"acting":[5,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T19:47:01.714233+0000","last_change":"2024-04-17T19:46:56.694764+0000","last_active":"2024-04-17T19:47:01.714233+0000","last_peered":"2024-04-17T19:47:01.714233+0000","last_clean":"2024-04-17T19:47:01.714233+0000","last_became_active":"2024-04-17T19:46:56.694449+0000","last_became_peered":"2024-04-17T19:46:56.694449+0000","last_unstale":"2024-04-17T19:47:01.714233+0000","last_undegraded":"2024-04-17T19:47:01.714233+0000","last_fullsized":"2024-04-17T19:47:01.714233+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_clean_scrub_stamp":"2024-04-17T19:46:55.648649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T02:53:14.607908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T19:47:01.714414+0000","last_change":"2024-04-17T19:46:55.689900+0000","last_active":"2024-04-17T19:47:01.714414+0000","last_peered":"2024-04-17T19:47:01.714414+0000","last_clean":"2024-04-17T19:47:01.714414+0000","last_became_active":"2024-04-17T19:46:55.689607+0000","last_became_peered":"2024-04-17T19:46:55.689607+0000","last_unstale":"2024-04-17T19:47:01.714414+0000","last_undegraded":"2024-04-17T19:47:01.714414+0000","last_fullsized":"2024-04-17T19:47:01.714414+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:54.640133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:54.640133+0000","last_clean_scrub_stamp":"2024-04-17T19:46:54.640133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:59:16.433023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T19:47:02.884022+0000","last_change":"2024-04-17T19:47:00.786434+0000","last_active":"2024-04-17T19:47:02.884022+0000","last_peered":"2024-04-17T19:47:02.884022+0000","last_clean":"2024-04-17T19:47:02.884022+0000","last_became_active":"2024-04-17T19:47:00.781025+0000","last_became_peered":"2024-04-17T19:47:00.781025+0000","last_unstale":"2024-04-17T19:47:02.884022+0000","last_undegraded":"2024-04-17T19:47:02.884022+0000","last_fullsized":"2024-04-17T19:47:02.884022+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_clean_scrub_stamp":"2024-04-17T19:46:59.695482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:51:07.602172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0,7],"acting":[6,4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T19:47:02.881470+0000","last_change":"2024-04-17T19:46:56.693555+0000","last_active":"2024-04-17T19:47:02.881470+0000","last_peered":"2024-04-17T19:47:02.881470+0000","last_clean":"2024-04-17T19:47:02.881470+0000","last_became_active":"2024-04-17T19:46:56.687385+0000","last_became_peered":"2024-04-17T19:46:56.687385+0000","last_unstale":"2024-04-17T19:47:02.881470+0000","last_undegraded":"2024-04-17T19:47:02.881470+0000","last_fullsized":"2024-04-17T19:47:02.881470+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_clean_scrub_stamp":"2024-04-17T19:46:55.648649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T05:52:33.559392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"24'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T19:47:02.883275+0000","last_change":"2024-04-17T19:46:55.700010+0000","last_active":"2024-04-17T19:47:02.883275+0000","last_peered":"2024-04-17T19:47:02.883275+0000","last_clean":"2024-04-17T19:47:02.883275+0000","last_became_active":"2024-04-17T19:46:55.698962+0000","last_became_peered":"2024-04-17T19:46:55.698962+0000","last_unstale":"2024-04-17T19:47:02.883275+0000","last_undegraded":"2024-04-17T19:47:02.883275+0000","last_fullsized":"2024-04-17T19:47:02.883275+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:54.640133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:54.640133+0000","last_clean_scrub_stamp":"2024-04-17T19:46:54.640133+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T01:25:12.780134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T19:47:01.714898+0000","last_change":"2024-04-17T19:47:00.760341+0000","last_active":"2024-04-17T19:47:01.714898+0000","last_peered":"2024-04-17T19:47:01.714898+0000","last_clean":"2024-04-17T19:47:01.714898+0000","last_became_active":"2024-04-17T19:47:00.759892+0000","last_became_peered":"2024-04-17T19:47:00.759892+0000","last_unstale":"2024-04-17T19:47:01.714898+0000","last_undegraded":"2024-04-17T19:47:01.714898+0000","last_fullsized":"2024-04-17T19:47:01.714898+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_clean_scrub_stamp":"2024-04-17T19:46:59.695482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T05:15:30.939022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5,6],"acting":[3,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T19:47:02.723476+0000","last_change":"2024-04-17T19:46:56.696716+0000","last_active":"2024-04-17T19:47:02.723476+0000","last_peered":"2024-04-17T19:47:02.723476+0000","last_clean":"2024-04-17T19:47:02.723476+0000","last_became_active":"2024-04-17T19:46:56.696355+0000","last_became_peered":"2024-04-17T19:46:56.696355+0000","last_unstale":"2024-04-17T19:47:02.723476+0000","last_undegraded":"2024-04-17T19:47:02.723476+0000","last_fullsized":"2024-04-17T19:47:02.723476+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_clean_scrub_stamp":"2024-04-17T19:46:55.648649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:06:56.889266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.14","version":"25'9","reported_seq":31,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T19:47:10.213408+0000","last_change":"2024-04-17T19:46:55.697242+0000","last_active":"2024-04-17T19:47:10.213408+0000","last_peered":"2024-04-17T19:47:10.213408+0000","last_clean":"2024-04-17T19:47:10.213408+0000","last_became_active":"2024-04-17T19:46:55.696876+0000","last_became_peered":"2024-04-17T19:46:55.696876+0000","last_unstale":"2024-04-17T19:47:10.213408+0000","last_undegraded":"2024-04-17T19:47:10.213408+0000","last_fullsized":"2024-04-17T19:47:10.213408+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:54.640133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:54.640133+0000","last_clean_scrub_stamp":"2024-04-17T19:46:54.640133+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:24:28.029324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3842,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T19:47:01.717017+0000","last_change":"2024-04-17T19:47:00.743810+0000","last_active":"2024-04-17T19:47:01.717017+0000","last_peered":"2024-04-17T19:47:01.717017+0000","last_clean":"2024-04-17T19:47:01.717017+0000","last_became_active":"2024-04-17T19:47:00.742290+0000","last_became_peered":"2024-04-17T19:47:00.742290+0000","last_unstale":"2024-04-17T19:47:01.717017+0000","last_undegraded":"2024-04-17T19:47:01.717017+0000","last_fullsized":"2024-04-17T19:47:01.717017+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_clean_scrub_stamp":"2024-04-17T19:46:59.695482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T04:20:00.039224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,5,0],"acting":[4,3,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T19:47:01.714061+0000","last_change":"2024-04-17T19:46:56.680527+0000","last_active":"2024-04-17T19:47:01.714061+0000","last_peered":"2024-04-17T19:47:01.714061+0000","last_clean":"2024-04-17T19:47:01.714061+0000","last_became_active":"2024-04-17T19:46:56.680171+0000","last_became_peered":"2024-04-17T19:46:56.680171+0000","last_unstale":"2024-04-17T19:47:01.714061+0000","last_undegraded":"2024-04-17T19:47:01.714061+0000","last_fullsized":"2024-04-17T19:47:01.714061+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_clean_scrub_stamp":"2024-04-17T19:46:55.648649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T07:11:10.748292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.15","version":"24'3","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T19:47:02.883827+0000","last_change":"2024-04-17T19:46:55.707717+0000","last_active":"2024-04-17T19:47:02.883827+0000","last_peered":"2024-04-17T19:47:02.883827+0000","last_clean":"2024-04-17T19:47:02.883827+0000","last_became_active":"2024-04-17T19:46:55.706967+0000","last_became_peered":"2024-04-17T19:46:55.706967+0000","last_unstale":"2024-04-17T19:47:02.883827+0000","last_undegraded":"2024-04-17T19:47:02.883827+0000","last_fullsized":"2024-04-17T19:47:02.883827+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:54.640133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:54.640133+0000","last_clean_scrub_stamp":"2024-04-17T19:46:54.640133+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T05:10:04.380307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T19:47:01.870166+0000","last_change":"2024-04-17T19:47:00.758723+0000","last_active":"2024-04-17T19:47:01.870166+0000","last_peered":"2024-04-17T19:47:01.870166+0000","last_clean":"2024-04-17T19:47:01.870166+0000","last_became_active":"2024-04-17T19:47:00.758209+0000","last_became_peered":"2024-04-17T19:47:00.758209+0000","last_unstale":"2024-04-17T19:47:01.870166+0000","last_undegraded":"2024-04-17T19:47:01.870166+0000","last_fullsized":"2024-04-17T19:47:01.870166+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_clean_scrub_stamp":"2024-04-17T19:46:59.695482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T04:48:47.816818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1,7],"acting":[2,3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T19:47:01.718073+0000","last_change":"2024-04-17T19:46:56.684067+0000","last_active":"2024-04-17T19:47:01.718073+0000","last_peered":"2024-04-17T19:47:01.718073+0000","last_clean":"2024-04-17T19:47:01.718073+0000","last_became_active":"2024-04-17T19:46:56.683685+0000","last_became_peered":"2024-04-17T19:46:56.683685+0000","last_unstale":"2024-04-17T19:47:01.718073+0000","last_undegraded":"2024-04-17T19:47:01.718073+0000","last_fullsized":"2024-04-17T19:47:01.718073+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_clean_scrub_stamp":"2024-04-17T19:46:55.648649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T02:52:38.425163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T19:47:02.723716+0000","last_change":"2024-04-17T19:46:55.687311+0000","last_active":"2024-04-17T19:47:02.723716+0000","last_peered":"2024-04-17T19:47:02.723716+0000","last_clean":"2024-04-17T19:47:02.723716+0000","last_became_active":"2024-04-17T19:46:55.687019+0000","last_became_peered":"2024-04-17T19:46:55.687019+0000","last_unstale":"2024-04-17T19:47:02.723716+0000","last_undegraded":"2024-04-17T19:47:02.723716+0000","last_fullsized":"2024-04-17T19:47:02.723716+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:54.640133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:54.640133+0000","last_clean_scrub_stamp":"2024-04-17T19:46:54.640133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T01:53:38.377482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T19:47:02.881723+0000","last_change":"2024-04-17T19:47:00.780072+0000","last_active":"2024-04-17T19:47:02.881723+0000","last_peered":"2024-04-17T19:47:02.881723+0000","last_clean":"2024-04-17T19:47:02.881723+0000","last_became_active":"2024-04-17T19:47:00.777053+0000","last_became_peered":"2024-04-17T19:47:00.777053+0000","last_unstale":"2024-04-17T19:47:02.881723+0000","last_undegraded":"2024-04-17T19:47:02.881723+0000","last_fullsized":"2024-04-17T19:47:02.881723+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_clean_scrub_stamp":"2024-04-17T19:46:59.695482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T22:01:53.910725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,3,2],"acting":[7,1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T19:47:01.870331+0000","last_change":"2024-04-17T19:46:56.692985+0000","last_active":"2024-04-17T19:47:01.870331+0000","last_peered":"2024-04-17T19:47:01.870331+0000","last_clean":"2024-04-17T19:47:01.870331+0000","last_became_active":"2024-04-17T19:46:56.692287+0000","last_became_peered":"2024-04-17T19:46:56.692287+0000","last_unstale":"2024-04-17T19:47:01.870331+0000","last_undegraded":"2024-04-17T19:47:01.870331+0000","last_fullsized":"2024-04-17T19:47:01.870331+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_clean_scrub_stamp":"2024-04-17T19:46:55.648649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:20:50.341776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T19:47:02.880504+0000","last_change":"2024-04-17T19:46:55.691681+0000","last_active":"2024-04-17T19:47:02.880504+0000","last_peered":"2024-04-17T19:47:02.880504+0000","last_clean":"2024-04-17T19:47:02.880504+0000","last_became_active":"2024-04-17T19:46:55.691354+0000","last_became_peered":"2024-04-17T19:46:55.691354+0000","last_unstale":"2024-04-17T19:47:02.880504+0000","last_undegraded":"2024-04-17T19:47:02.880504+0000","last_fullsized":"2024-04-17T19:47:02.880504+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:54.640133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:54.640133+0000","last_clean_scrub_stamp":"2024-04-17T19:46:54.640133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T00:40:58.757373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T19:47:01.716521+0000","last_change":"2024-04-17T19:47:00.764854+0000","last_active":"2024-04-17T19:47:01.716521+0000","last_peered":"2024-04-17T19:47:01.716521+0000","last_clean":"2024-04-17T19:47:01.716521+0000","last_became_active":"2024-04-17T19:47:00.763550+0000","last_became_peered":"2024-04-17T19:47:00.763550+0000","last_unstale":"2024-04-17T19:47:01.716521+0000","last_undegraded":"2024-04-17T19:47:01.716521+0000","last_fullsized":"2024-04-17T19:47:01.716521+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_clean_scrub_stamp":"2024-04-17T19:46:59.695482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T04:26:38.527427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,3,7],"acting":[4,0,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T19:47:01.717807+0000","last_change":"2024-04-17T19:47:00.746028+0000","last_active":"2024-04-17T19:47:01.717807+0000","last_peered":"2024-04-17T19:47:01.717807+0000","last_clean":"2024-04-17T19:47:01.717807+0000","last_became_active":"2024-04-17T19:47:00.744828+0000","last_became_peered":"2024-04-17T19:47:00.744828+0000","last_unstale":"2024-04-17T19:47:01.717807+0000","last_undegraded":"2024-04-17T19:47:01.717807+0000","last_fullsized":"2024-04-17T19:47:01.717807+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_clean_scrub_stamp":"2024-04-17T19:46:59.695482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T22:37:58.836823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,5,3],"acting":[4,1,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T19:47:01.716479+0000","last_change":"2024-04-17T19:46:56.691650+0000","last_active":"2024-04-17T19:47:01.716479+0000","last_peered":"2024-04-17T19:47:01.716479+0000","last_clean":"2024-04-17T19:47:01.716479+0000","last_became_active":"2024-04-17T19:46:56.690810+0000","last_became_peered":"2024-04-17T19:46:56.690810+0000","last_unstale":"2024-04-17T19:47:01.716479+0000","last_undegraded":"2024-04-17T19:47:01.716479+0000","last_fullsized":"2024-04-17T19:47:01.716479+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_clean_scrub_stamp":"2024-04-17T19:46:55.648649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T04:25:07.123916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T19:47:01.714013+0000","last_change":"2024-04-17T19:46:55.691871+0000","last_active":"2024-04-17T19:47:01.714013+0000","last_peered":"2024-04-17T19:47:01.714013+0000","last_clean":"2024-04-17T19:47:01.714013+0000","last_became_active":"2024-04-17T19:46:55.690539+0000","last_became_peered":"2024-04-17T19:46:55.690539+0000","last_unstale":"2024-04-17T19:47:01.714013+0000","last_undegraded":"2024-04-17T19:47:01.714013+0000","last_fullsized":"2024-04-17T19:47:01.714013+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:54.640133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:54.640133+0000","last_clean_scrub_stamp":"2024-04-17T19:46:54.640133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T04:52:16.008572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T19:47:01.715456+0000","last_change":"2024-04-17T19:47:00.749616+0000","last_active":"2024-04-17T19:47:01.715456+0000","last_peered":"2024-04-17T19:47:01.715456+0000","last_clean":"2024-04-17T19:47:01.715456+0000","last_became_active":"2024-04-17T19:47:00.749061+0000","last_became_peered":"2024-04-17T19:47:00.749061+0000","last_unstale":"2024-04-17T19:47:01.715456+0000","last_undegraded":"2024-04-17T19:47:01.715456+0000","last_fullsized":"2024-04-17T19:47:01.715456+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_clean_scrub_stamp":"2024-04-17T19:46:59.695482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:33:36.676817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5,1],"acting":[3,2,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T19:47:01.715322+0000","last_change":"2024-04-17T19:46:56.692190+0000","last_active":"2024-04-17T19:47:01.715322+0000","last_peered":"2024-04-17T19:47:01.715322+0000","last_clean":"2024-04-17T19:47:01.715322+0000","last_became_active":"2024-04-17T19:46:56.691524+0000","last_became_peered":"2024-04-17T19:46:56.691524+0000","last_unstale":"2024-04-17T19:47:01.715322+0000","last_undegraded":"2024-04-17T19:47:01.715322+0000","last_fullsized":"2024-04-17T19:47:01.715322+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_clean_scrub_stamp":"2024-04-17T19:46:55.648649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:44:38.787541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T19:47:02.880985+0000","last_change":"2024-04-17T19:46:55.700265+0000","last_active":"2024-04-17T19:47:02.880985+0000","last_peered":"2024-04-17T19:47:02.880985+0000","last_clean":"2024-04-17T19:47:02.880985+0000","last_became_active":"2024-04-17T19:46:55.699166+0000","last_became_peered":"2024-04-17T19:46:55.699166+0000","last_unstale":"2024-04-17T19:47:02.880985+0000","last_undegraded":"2024-04-17T19:47:02.880985+0000","last_fullsized":"2024-04-17T19:47:02.880985+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:54.640133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:54.640133+0000","last_clean_scrub_stamp":"2024-04-17T19:46:54.640133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T02:39:08.241534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"24'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T19:47:01.714291+0000","last_change":"2024-04-17T19:46:55.687779+0000","last_active":"2024-04-17T19:47:01.714291+0000","last_peered":"2024-04-17T19:47:01.714291+0000","last_clean":"2024-04-17T19:47:01.714291+0000","last_became_active":"2024-04-17T19:46:55.687401+0000","last_became_peered":"2024-04-17T19:46:55.687401+0000","last_unstale":"2024-04-17T19:47:01.714291+0000","last_undegraded":"2024-04-17T19:47:01.714291+0000","last_fullsized":"2024-04-17T19:47:01.714291+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:54.640133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:54.640133+0000","last_clean_scrub_stamp":"2024-04-17T19:46:54.640133+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:20:49.333260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T19:47:01.716820+0000","last_change":"2024-04-17T19:46:56.691635+0000","last_active":"2024-04-17T19:47:01.716820+0000","last_peered":"2024-04-17T19:47:01.716820+0000","last_clean":"2024-04-17T19:47:01.716820+0000","last_became_active":"2024-04-17T19:46:56.691199+0000","last_became_peered":"2024-04-17T19:46:56.691199+0000","last_unstale":"2024-04-17T19:47:01.716820+0000","last_undegraded":"2024-04-17T19:47:01.716820+0000","last_fullsized":"2024-04-17T19:47:01.716820+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_clean_scrub_stamp":"2024-04-17T19:46:55.648649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:00:10.859769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T19:47:01.717329+0000","last_change":"2024-04-17T19:47:00.776142+0000","last_active":"2024-04-17T19:47:01.717329+0000","last_peered":"2024-04-17T19:47:01.717329+0000","last_clean":"2024-04-17T19:47:01.717329+0000","last_became_active":"2024-04-17T19:47:00.774592+0000","last_became_peered":"2024-04-17T19:47:00.774592+0000","last_unstale":"2024-04-17T19:47:01.717329+0000","last_undegraded":"2024-04-17T19:47:01.717329+0000","last_fullsized":"2024-04-17T19:47:01.717329+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_clean_scrub_stamp":"2024-04-17T19:46:59.695482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:04:03.656402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,7],"acting":[4,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"24'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T19:47:01.716933+0000","last_change":"2024-04-17T19:46:55.713656+0000","last_active":"2024-04-17T19:47:01.716933+0000","last_peered":"2024-04-17T19:47:01.716933+0000","last_clean":"2024-04-17T19:47:01.716933+0000","last_became_active":"2024-04-17T19:46:55.712982+0000","last_became_peered":"2024-04-17T19:46:55.712982+0000","last_unstale":"2024-04-17T19:47:01.716933+0000","last_undegraded":"2024-04-17T19:47:01.716933+0000","last_fullsized":"2024-04-17T19:47:01.716933+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:54.640133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:54.640133+0000","last_clean_scrub_stamp":"2024-04-17T19:46:54.640133+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:02:52.057635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T19:47:02.879756+0000","last_change":"2024-04-17T19:46:56.681984+0000","last_active":"2024-04-17T19:47:02.879756+0000","last_peered":"2024-04-17T19:47:02.879756+0000","last_clean":"2024-04-17T19:47:02.879756+0000","last_became_active":"2024-04-17T19:46:56.679830+0000","last_became_peered":"2024-04-17T19:46:56.679830+0000","last_unstale":"2024-04-17T19:47:02.879756+0000","last_undegraded":"2024-04-17T19:47:02.879756+0000","last_fullsized":"2024-04-17T19:47:02.879756+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_clean_scrub_stamp":"2024-04-17T19:46:55.648649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:11:01.745657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T19:47:02.883151+0000","last_change":"2024-04-17T19:47:00.777411+0000","last_active":"2024-04-17T19:47:02.883151+0000","last_peered":"2024-04-17T19:47:02.883151+0000","last_clean":"2024-04-17T19:47:02.883151+0000","last_became_active":"2024-04-17T19:47:00.776357+0000","last_became_peered":"2024-04-17T19:47:00.776357+0000","last_unstale":"2024-04-17T19:47:02.883151+0000","last_undegraded":"2024-04-17T19:47:02.883151+0000","last_fullsized":"2024-04-17T19:47:02.883151+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_clean_scrub_stamp":"2024-04-17T19:46:59.695482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:41:22.030097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,1,0],"acting":[7,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T19:47:01.869642+0000","last_change":"2024-04-17T19:46:56.706021+0000","last_active":"2024-04-17T19:47:01.869642+0000","last_peered":"2024-04-17T19:47:01.869642+0000","last_clean":"2024-04-17T19:47:01.869642+0000","last_became_active":"2024-04-17T19:46:56.702724+0000","last_became_peered":"2024-04-17T19:46:56.702724+0000","last_unstale":"2024-04-17T19:47:01.869642+0000","last_undegraded":"2024-04-17T19:47:01.869642+0000","last_fullsized":"2024-04-17T19:47:01.869642+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_clean_scrub_stamp":"2024-04-17T19:46:55.648649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:11:01.745657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T19:47:02.881763+0000","last_change":"2024-04-17T19:46:56.685239+0000","last_active":"2024-04-17T19:47:02.881763+0000","last_peered":"2024-04-17T19:47:02.881763+0000","last_clean":"2024-04-17T19:47:02.881763+0000","last_became_active":"2024-04-17T19:46:56.684771+0000","last_became_peered":"2024-04-17T19:46:56.684771+0000","last_unstale":"2024-04-17T19:47:02.881763+0000","last_undegraded":"2024-04-17T19:47:02.881763+0000","last_fullsized":"2024-04-17T19:47:02.881763+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_clean_scrub_stamp":"2024-04-17T19:46:55.648649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T04:52:17.017088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T19:47:01.713945+0000","last_change":"2024-04-17T19:46:56.686238+0000","last_active":"2024-04-17T19:47:01.713945+0000","last_peered":"2024-04-17T19:47:01.713945+0000","last_clean":"2024-04-17T19:47:01.713945+0000","last_became_active":"2024-04-17T19:46:56.685745+0000","last_became_peered":"2024-04-17T19:46:56.685745+0000","last_unstale":"2024-04-17T19:47:01.713945+0000","last_undegraded":"2024-04-17T19:47:01.713945+0000","last_fullsized":"2024-04-17T19:47:01.713945+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_clean_scrub_stamp":"2024-04-17T19:46:55.648649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:01:01.006486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T19:47:01.716621+0000","last_change":"2024-04-17T19:46:56.675844+0000","last_active":"2024-04-17T19:47:01.716621+0000","last_peered":"2024-04-17T19:47:01.716621+0000","last_clean":"2024-04-17T19:47:01.716621+0000","last_became_active":"2024-04-17T19:46:56.675519+0000","last_became_peered":"2024-04-17T19:46:56.675519+0000","last_unstale":"2024-04-17T19:47:01.716621+0000","last_undegraded":"2024-04-17T19:47:01.716621+0000","last_fullsized":"2024-04-17T19:47:01.716621+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_clean_scrub_stamp":"2024-04-17T19:46:55.648649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T00:46:07.348168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T19:47:02.884195+0000","last_change":"2024-04-17T19:46:56.699663+0000","last_active":"2024-04-17T19:47:02.884195+0000","last_peered":"2024-04-17T19:47:02.884195+0000","last_clean":"2024-04-17T19:47:02.884195+0000","last_became_active":"2024-04-17T19:46:56.699293+0000","last_became_peered":"2024-04-17T19:46:56.699293+0000","last_unstale":"2024-04-17T19:47:02.884195+0000","last_undegraded":"2024-04-17T19:47:02.884195+0000","last_fullsized":"2024-04-17T19:47:02.884195+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_clean_scrub_stamp":"2024-04-17T19:46:55.648649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T22:25:05.172498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T19:47:02.883978+0000","last_change":"2024-04-17T19:46:56.684368+0000","last_active":"2024-04-17T19:47:02.883978+0000","last_peered":"2024-04-17T19:47:02.883978+0000","last_clean":"2024-04-17T19:47:02.883978+0000","last_became_active":"2024-04-17T19:46:56.683963+0000","last_became_peered":"2024-04-17T19:46:56.683963+0000","last_unstale":"2024-04-17T19:47:02.883978+0000","last_undegraded":"2024-04-17T19:47:02.883978+0000","last_fullsized":"2024-04-17T19:47:02.883978+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_clean_scrub_stamp":"2024-04-17T19:46:55.648649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:41:17.983264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T19:47:01.870215+0000","last_change":"2024-04-17T19:46:56.704924+0000","last_active":"2024-04-17T19:47:01.870215+0000","last_peered":"2024-04-17T19:47:01.870215+0000","last_clean":"2024-04-17T19:47:01.870215+0000","last_became_active":"2024-04-17T19:46:56.692688+0000","last_became_peered":"2024-04-17T19:46:56.692688+0000","last_unstale":"2024-04-17T19:47:01.870215+0000","last_undegraded":"2024-04-17T19:47:01.870215+0000","last_fullsized":"2024-04-17T19:47:01.870215+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_clean_scrub_stamp":"2024-04-17T19:46:55.648649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T01:39:33.595213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T19:47:01.717583+0000","last_change":"2024-04-17T19:46:56.685081+0000","last_active":"2024-04-17T19:47:01.717583+0000","last_peered":"2024-04-17T19:47:01.717583+0000","last_clean":"2024-04-17T19:47:01.717583+0000","last_became_active":"2024-04-17T19:46:56.684714+0000","last_became_peered":"2024-04-17T19:46:56.684714+0000","last_unstale":"2024-04-17T19:47:01.717583+0000","last_undegraded":"2024-04-17T19:47:01.717583+0000","last_fullsized":"2024-04-17T19:47:01.717583+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_clean_scrub_stamp":"2024-04-17T19:46:55.648649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T04:26:34.480594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T19:47:01.713823+0000","last_change":"2024-04-17T19:46:56.681089+0000","last_active":"2024-04-17T19:47:01.713823+0000","last_peered":"2024-04-17T19:47:01.713823+0000","last_clean":"2024-04-17T19:47:01.713823+0000","last_became_active":"2024-04-17T19:46:56.679818+0000","last_became_peered":"2024-04-17T19:46:56.679818+0000","last_unstale":"2024-04-17T19:47:01.713823+0000","last_undegraded":"2024-04-17T19:47:01.713823+0000","last_fullsized":"2024-04-17T19:47:01.713823+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_clean_scrub_stamp":"2024-04-17T19:46:55.648649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T01:32:52.608291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T19:47:01.716037+0000","last_change":"2024-04-17T19:46:56.674556+0000","last_active":"2024-04-17T19:47:01.716037+0000","last_peered":"2024-04-17T19:47:01.716037+0000","last_clean":"2024-04-17T19:47:01.716037+0000","last_became_active":"2024-04-17T19:46:56.674164+0000","last_became_peered":"2024-04-17T19:46:56.674164+0000","last_unstale":"2024-04-17T19:47:01.716037+0000","last_undegraded":"2024-04-17T19:47:01.716037+0000","last_fullsized":"2024-04-17T19:47:01.716037+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_clean_scrub_stamp":"2024-04-17T19:46:55.648649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T22:53:45.664676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T19:47:02.879682+0000","last_change":"2024-04-17T19:46:56.697359+0000","last_active":"2024-04-17T19:47:02.879682+0000","last_peered":"2024-04-17T19:47:02.879682+0000","last_clean":"2024-04-17T19:47:02.879682+0000","last_became_active":"2024-04-17T19:46:56.695255+0000","last_became_peered":"2024-04-17T19:46:56.695255+0000","last_unstale":"2024-04-17T19:47:02.879682+0000","last_undegraded":"2024-04-17T19:47:02.879682+0000","last_fullsized":"2024-04-17T19:47:02.879682+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_clean_scrub_stamp":"2024-04-17T19:46:55.648649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T01:53:39.385998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T19:47:01.716676+0000","last_change":"2024-04-17T19:46:56.692366+0000","last_active":"2024-04-17T19:47:01.716676+0000","last_peered":"2024-04-17T19:47:01.716676+0000","last_clean":"2024-04-17T19:47:01.716676+0000","last_became_active":"2024-04-17T19:46:56.691942+0000","last_became_peered":"2024-04-17T19:46:56.691942+0000","last_unstale":"2024-04-17T19:47:01.716676+0000","last_undegraded":"2024-04-17T19:47:01.716676+0000","last_fullsized":"2024-04-17T19:47:01.716676+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_clean_scrub_stamp":"2024-04-17T19:46:55.648649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T02:34:05.358659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T19:47:02.723676+0000","last_change":"2024-04-17T19:46:56.693507+0000","last_active":"2024-04-17T19:47:02.723676+0000","last_peered":"2024-04-17T19:47:02.723676+0000","last_clean":"2024-04-17T19:47:02.723676+0000","last_became_active":"2024-04-17T19:46:56.691938+0000","last_became_peered":"2024-04-17T19:46:56.691938+0000","last_unstale":"2024-04-17T19:47:02.723676+0000","last_undegraded":"2024-04-17T19:47:02.723676+0000","last_fullsized":"2024-04-17T19:47:02.723676+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_clean_scrub_stamp":"2024-04-17T19:46:55.648649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T04:48:43.769985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T19:47:01.715076+0000","last_change":"2024-04-17T19:46:56.700707+0000","last_active":"2024-04-17T19:47:01.715076+0000","last_peered":"2024-04-17T19:47:01.715076+0000","last_clean":"2024-04-17T19:47:01.715076+0000","last_became_active":"2024-04-17T19:46:56.700346+0000","last_became_peered":"2024-04-17T19:46:56.700346+0000","last_unstale":"2024-04-17T19:47:01.715076+0000","last_undegraded":"2024-04-17T19:47:01.715076+0000","last_fullsized":"2024-04-17T19:47:01.715076+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_clean_scrub_stamp":"2024-04-17T19:46:55.648649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:58:35.976326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T19:47:02.883782+0000","last_change":"2024-04-17T19:46:56.705410+0000","last_active":"2024-04-17T19:47:02.883782+0000","last_peered":"2024-04-17T19:47:02.883782+0000","last_clean":"2024-04-17T19:47:02.883782+0000","last_became_active":"2024-04-17T19:46:56.705076+0000","last_became_peered":"2024-04-17T19:46:56.705076+0000","last_unstale":"2024-04-17T19:47:02.883782+0000","last_undegraded":"2024-04-17T19:47:02.883782+0000","last_fullsized":"2024-04-17T19:47:02.883782+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_clean_scrub_stamp":"2024-04-17T19:46:55.648649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T01:53:39.385998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T19:47:01.715553+0000","last_change":"2024-04-17T19:46:56.697436+0000","last_active":"2024-04-17T19:47:01.715553+0000","last_peered":"2024-04-17T19:47:01.715553+0000","last_clean":"2024-04-17T19:47:01.715553+0000","last_became_active":"2024-04-17T19:46:56.696667+0000","last_became_peered":"2024-04-17T19:46:56.696667+0000","last_unstale":"2024-04-17T19:47:01.715553+0000","last_undegraded":"2024-04-17T19:47:01.715553+0000","last_fullsized":"2024-04-17T19:47:01.715553+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_clean_scrub_stamp":"2024-04-17T19:46:55.648649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:54:05.520742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T19:47:01.713821+0000","last_change":"2024-04-17T19:46:56.680847+0000","last_active":"2024-04-17T19:47:01.713821+0000","last_peered":"2024-04-17T19:47:01.713821+0000","last_clean":"2024-04-17T19:47:01.713821+0000","last_became_active":"2024-04-17T19:46:56.680224+0000","last_became_peered":"2024-04-17T19:46:56.680224+0000","last_unstale":"2024-04-17T19:47:01.713821+0000","last_undegraded":"2024-04-17T19:47:01.713821+0000","last_fullsized":"2024-04-17T19:47:01.713821+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_clean_scrub_stamp":"2024-04-17T19:46:55.648649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T04:48:43.769985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T19:47:01.715770+0000","last_change":"2024-04-17T19:46:56.688647+0000","last_active":"2024-04-17T19:47:01.715770+0000","last_peered":"2024-04-17T19:47:01.715770+0000","last_clean":"2024-04-17T19:47:01.715770+0000","last_became_active":"2024-04-17T19:46:56.688294+0000","last_became_peered":"2024-04-17T19:46:56.688294+0000","last_unstale":"2024-04-17T19:47:01.715770+0000","last_undegraded":"2024-04-17T19:47:01.715770+0000","last_fullsized":"2024-04-17T19:47:01.715770+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_clean_scrub_stamp":"2024-04-17T19:46:55.648649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T02:34:05.358659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T19:47:02.881299+0000","last_change":"2024-04-17T19:46:56.686415+0000","last_active":"2024-04-17T19:47:02.881299+0000","last_peered":"2024-04-17T19:47:02.881299+0000","last_clean":"2024-04-17T19:47:02.881299+0000","last_became_active":"2024-04-17T19:46:56.684639+0000","last_became_peered":"2024-04-17T19:46:56.684639+0000","last_unstale":"2024-04-17T19:47:02.881299+0000","last_undegraded":"2024-04-17T19:47:02.881299+0000","last_fullsized":"2024-04-17T19:47:02.881299+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_clean_scrub_stamp":"2024-04-17T19:46:55.648649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:20:50.341776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T19:47:02.882440+0000","last_change":"2024-04-17T19:46:56.694678+0000","last_active":"2024-04-17T19:47:02.882440+0000","last_peered":"2024-04-17T19:47:02.882440+0000","last_clean":"2024-04-17T19:47:02.882440+0000","last_became_active":"2024-04-17T19:46:56.694213+0000","last_became_peered":"2024-04-17T19:46:56.694213+0000","last_unstale":"2024-04-17T19:47:02.882440+0000","last_undegraded":"2024-04-17T19:47:02.882440+0000","last_fullsized":"2024-04-17T19:47:02.882440+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_clean_scrub_stamp":"2024-04-17T19:46:55.648649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:59:17.441539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T19:47:02.723614+0000","last_change":"2024-04-17T19:46:56.693810+0000","last_active":"2024-04-17T19:47:02.723614+0000","last_peered":"2024-04-17T19:47:02.723614+0000","last_clean":"2024-04-17T19:47:02.723614+0000","last_became_active":"2024-04-17T19:46:56.692874+0000","last_became_peered":"2024-04-17T19:46:56.692874+0000","last_unstale":"2024-04-17T19:47:02.723614+0000","last_undegraded":"2024-04-17T19:47:02.723614+0000","last_fullsized":"2024-04-17T19:47:02.723614+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_clean_scrub_stamp":"2024-04-17T19:46:55.648649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:30:27.241267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T19:47:02.723470+0000","last_change":"2024-04-17T19:46:56.700330+0000","last_active":"2024-04-17T19:47:02.723470+0000","last_peered":"2024-04-17T19:47:02.723470+0000","last_clean":"2024-04-17T19:47:02.723470+0000","last_became_active":"2024-04-17T19:46:56.700013+0000","last_became_peered":"2024-04-17T19:46:56.700013+0000","last_unstale":"2024-04-17T19:47:02.723470+0000","last_undegraded":"2024-04-17T19:47:02.723470+0000","last_fullsized":"2024-04-17T19:47:02.723470+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_clean_scrub_stamp":"2024-04-17T19:46:55.648649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:23:16.383918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T19:47:02.723614+0000","last_change":"2024-04-17T19:46:56.709400+0000","last_active":"2024-04-17T19:47:02.723614+0000","last_peered":"2024-04-17T19:47:02.723614+0000","last_clean":"2024-04-17T19:47:02.723614+0000","last_became_active":"2024-04-17T19:46:56.708606+0000","last_became_peered":"2024-04-17T19:46:56.708606+0000","last_unstale":"2024-04-17T19:47:02.723614+0000","last_undegraded":"2024-04-17T19:47:02.723614+0000","last_fullsized":"2024-04-17T19:47:02.723614+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_clean_scrub_stamp":"2024-04-17T19:46:55.648649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T01:46:36.503198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T19:47:02.880442+0000","last_change":"2024-04-17T19:46:56.681267+0000","last_active":"2024-04-17T19:47:02.880442+0000","last_peered":"2024-04-17T19:47:02.880442+0000","last_clean":"2024-04-17T19:47:02.880442+0000","last_became_active":"2024-04-17T19:46:56.680919+0000","last_became_peered":"2024-04-17T19:46:56.680919+0000","last_unstale":"2024-04-17T19:47:02.880442+0000","last_undegraded":"2024-04-17T19:47:02.880442+0000","last_fullsized":"2024-04-17T19:47:02.880442+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_clean_scrub_stamp":"2024-04-17T19:46:55.648649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T01:39:33.595213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T19:47:01.714992+0000","last_change":"2024-04-17T19:46:56.688682+0000","last_active":"2024-04-17T19:47:01.714992+0000","last_peered":"2024-04-17T19:47:01.714992+0000","last_clean":"2024-04-17T19:47:01.714992+0000","last_became_active":"2024-04-17T19:46:56.688320+0000","last_became_peered":"2024-04-17T19:46:56.688320+0000","last_unstale":"2024-04-17T19:47:01.714992+0000","last_undegraded":"2024-04-17T19:47:01.714992+0000","last_fullsized":"2024-04-17T19:47:01.714992+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_clean_scrub_stamp":"2024-04-17T19:46:55.648649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:00:10.859769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T19:47:02.723099+0000","last_change":"2024-04-17T19:46:56.699129+0000","last_active":"2024-04-17T19:47:02.723099+0000","last_peered":"2024-04-17T19:47:02.723099+0000","last_clean":"2024-04-17T19:47:02.723099+0000","last_became_active":"2024-04-17T19:46:56.698840+0000","last_became_peered":"2024-04-17T19:46:56.698840+0000","last_unstale":"2024-04-17T19:47:02.723099+0000","last_undegraded":"2024-04-17T19:47:02.723099+0000","last_fullsized":"2024-04-17T19:47:02.723099+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_clean_scrub_stamp":"2024-04-17T19:46:55.648649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T05:35:47.746622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T19:47:01.870059+0000","last_change":"2024-04-17T19:46:56.705903+0000","last_active":"2024-04-17T19:47:01.870059+0000","last_peered":"2024-04-17T19:47:01.870059+0000","last_clean":"2024-04-17T19:47:01.870059+0000","last_became_active":"2024-04-17T19:46:56.705539+0000","last_became_peered":"2024-04-17T19:46:56.705539+0000","last_unstale":"2024-04-17T19:47:01.870059+0000","last_undegraded":"2024-04-17T19:47:01.870059+0000","last_fullsized":"2024-04-17T19:47:01.870059+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_clean_scrub_stamp":"2024-04-17T19:46:55.648649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:57:40.700986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T19:47:02.723301+0000","last_change":"2024-04-17T19:46:56.694456+0000","last_active":"2024-04-17T19:47:02.723301+0000","last_peered":"2024-04-17T19:47:02.723301+0000","last_clean":"2024-04-17T19:47:02.723301+0000","last_became_active":"2024-04-17T19:46:56.693954+0000","last_became_peered":"2024-04-17T19:46:56.693954+0000","last_unstale":"2024-04-17T19:47:02.723301+0000","last_undegraded":"2024-04-17T19:47:02.723301+0000","last_fullsized":"2024-04-17T19:47:02.723301+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_clean_scrub_stamp":"2024-04-17T19:46:55.648649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:22:33.413402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T19:47:01.869795+0000","last_change":"2024-04-17T19:46:56.706411+0000","last_active":"2024-04-17T19:47:01.869795+0000","last_peered":"2024-04-17T19:47:01.869795+0000","last_clean":"2024-04-17T19:47:01.869795+0000","last_became_active":"2024-04-17T19:46:56.706021+0000","last_became_peered":"2024-04-17T19:46:56.706021+0000","last_unstale":"2024-04-17T19:47:01.869795+0000","last_undegraded":"2024-04-17T19:47:01.869795+0000","last_fullsized":"2024-04-17T19:47:01.869795+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_clean_scrub_stamp":"2024-04-17T19:46:55.648649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T05:52:33.559392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T19:47:01.717212+0000","last_change":"2024-04-17T19:46:56.696930+0000","last_active":"2024-04-17T19:47:01.717212+0000","last_peered":"2024-04-17T19:47:01.717212+0000","last_clean":"2024-04-17T19:47:01.717212+0000","last_became_active":"2024-04-17T19:46:56.696492+0000","last_became_peered":"2024-04-17T19:46:56.696492+0000","last_unstale":"2024-04-17T19:47:01.717212+0000","last_undegraded":"2024-04-17T19:47:01.717212+0000","last_fullsized":"2024-04-17T19:47:01.717212+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_clean_scrub_stamp":"2024-04-17T19:46:55.648649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:43:54.268148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T19:47:01.718855+0000","last_change":"2024-04-17T19:46:56.683448+0000","last_active":"2024-04-17T19:47:01.718855+0000","last_peered":"2024-04-17T19:47:01.718855+0000","last_clean":"2024-04-17T19:47:01.718855+0000","last_became_active":"2024-04-17T19:46:56.682772+0000","last_became_peered":"2024-04-17T19:46:56.682772+0000","last_unstale":"2024-04-17T19:47:01.718855+0000","last_undegraded":"2024-04-17T19:47:01.718855+0000","last_fullsized":"2024-04-17T19:47:01.718855+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_clean_scrub_stamp":"2024-04-17T19:46:55.648649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T22:39:31.496708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T19:47:02.723937+0000","last_change":"2024-04-17T19:46:56.695275+0000","last_active":"2024-04-17T19:47:02.723937+0000","last_peered":"2024-04-17T19:47:02.723937+0000","last_clean":"2024-04-17T19:47:02.723937+0000","last_became_active":"2024-04-17T19:46:56.694743+0000","last_became_peered":"2024-04-17T19:46:56.694743+0000","last_unstale":"2024-04-17T19:47:02.723937+0000","last_undegraded":"2024-04-17T19:47:02.723937+0000","last_fullsized":"2024-04-17T19:47:02.723937+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_clean_scrub_stamp":"2024-04-17T19:46:55.648649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:01:01.006486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4640,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":66496,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509449,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27280,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344560,"statfs":{"total":96636764160,"available":96608829440,"internally_reserved":0,"allocated":266240,"data_stored":101981,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509450,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27272,"kb_used_data":252,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344568,"statfs":{"total":96636764160,"available":96608837632,"internally_reserved":0,"allocated":258048,"data_stored":101857,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509450,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":256,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":262144,"data_stored":102439,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509450,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27280,"kb_used_data":264,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344560,"statfs":{"total":96636764160,"available":96608829440,"internally_reserved":0,"allocated":270336,"data_stored":105699,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509449,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27340,"kb_used_data":320,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344500,"statfs":{"total":96636764160,"available":96608768000,"internally_reserved":0,"allocated":327680,"data_stored":692295,"data_compressed":33248,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509449,"num_pgs":45,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27280,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344560,"statfs":{"total":96636764160,"available":96608829440,"internally_reserved":0,"allocated":266240,"data_stored":101913,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574857,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27348,"kb_used_data":324,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344492,"statfs":{"total":96636764160,"available":96608759808,"internally_reserved":0,"allocated":331776,"data_stored":692317,"data_compressed":33248,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574857,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27288,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":278528,"data_stored":106371,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33248,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33248,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":4514,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-17T19:47:21.423 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2024-04-17T19:47:21.423 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-04-17T19:47:21.423 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2024-04-17T19:47:21.423 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2024-04-17T19:47:21.424 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2024-04-17T19:47:21.613 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:21.621+0000 7f12fd600640 1 Processor -- start 2024-04-17T19:47:21.613 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:21.621+0000 7f12fd600640 1 -- start start 2024-04-17T19:47:21.615 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:21.625+0000 7f12fd600640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f12f8153db0 0x7f12f8073820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:21.615 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:21.625+0000 7f12fd600640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f12f8073d60 0x7f12f80725b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:21.615 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:21.625+0000 7f12fd600640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f12f8159ad0 con 0x7f12f80c66d0 2024-04-17T19:47:21.615 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:21.625+0000 7f12fd600640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 -- 0x7f12f8159db0 con 0x7f12f8153db0 2024-04-17T19:47:21.616 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:21.625+0000 7f12fd600640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 -- 0x7f12f815a090 con 0x7f12f8073d60 2024-04-17T19:47:21.616 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:21.625+0000 7f12efe00640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f12f8153db0 0x7f12f8073820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:21.616 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:21.625+0000 7f12efe00640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f12f8153db0 0x7f12f8073820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:42602/0 (socket says 172.21.15.44:42602) 2024-04-17T19:47:21.616 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:21.625+0000 7f12efe00640 1 -- 172.21.15.44:0/1570097440 learned_addr learned my addr 172.21.15.44:0/1570097440 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-04-17T19:47:21.616 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:21.625+0000 7f12f7400640 1 --2- 172.21.15.44:0/1570097440 >> v2:172.21.15.62:3300/0 conn(0x7f12f8073d60 0x7f12f80725b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:21.616 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:21.625+0000 7f12efe00640 1 -- 172.21.15.44:0/1570097440 >> v2:172.21.15.62:3300/0 conn(0x7f12f8073d60 msgr2=0x7f12f80725b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T19:47:21.616 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:21.625+0000 7f12efe00640 1 --2- 172.21.15.44:0/1570097440 >> v2:172.21.15.62:3300/0 conn(0x7f12f8073d60 0x7f12f80725b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:21.616 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:21.625+0000 7f12efe00640 1 -- 172.21.15.44:0/1570097440 >> v1:172.21.15.62:6789/0 conn(0x7f12f80c66d0 legacy=0x7f12f81536a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:21.616 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:21.625+0000 7f12efe00640 1 -- 172.21.15.44:0/1570097440 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f12f815a370 con 0x7f12f8153db0 2024-04-17T19:47:21.618 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:21.625+0000 7f12efe00640 1 --2- 172.21.15.44:0/1570097440 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f12f8153db0 0x7f12f8073820 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f12f8070d20 tx=0x7f12e001c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ab2dd4edef381393 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:47:21.619 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:21.629+0000 7f12f6000640 1 -- 172.21.15.44:0/1570097440 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12e00ab5f0 con 0x7f12f8153db0 2024-04-17T19:47:21.619 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:21.629+0000 7f12f6000640 1 -- 172.21.15.44:0/1570097440 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f12e00b0070 con 0x7f12f8153db0 2024-04-17T19:47:21.619 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:21.629+0000 7f12f6000640 1 -- 172.21.15.44:0/1570097440 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12e00ab9b0 con 0x7f12f8153db0 2024-04-17T19:47:21.619 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:21.629+0000 7f12fd600640 1 -- 172.21.15.44:0/1570097440 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f12f8153db0 msgr2=0x7f12f8073820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:21.619 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:21.629+0000 7f12fd600640 1 --2- 172.21.15.44:0/1570097440 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f12f8153db0 0x7f12f8073820 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f12f8070d20 tx=0x7f12e001c520 comp rx=0 tx=0).stop 2024-04-17T19:47:21.620 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:21.629+0000 7f12fd600640 1 -- 172.21.15.44:0/1570097440 shutdown_connections 2024-04-17T19:47:21.620 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:21.629+0000 7f12fd600640 1 --2- 172.21.15.44:0/1570097440 >> v2:172.21.15.62:3300/0 conn(0x7f12f8073d60 0x7f12f80725b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:21.620 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:21.629+0000 7f12fd600640 1 --2- 172.21.15.44:0/1570097440 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f12f8153db0 0x7f12f8073820 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:21.620 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:21.629+0000 7f12fd600640 1 -- 172.21.15.44:0/1570097440 >> 172.21.15.44:0/1570097440 conn(0x7f12f806c380 msgr2=0x7f12f8070080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:47:21.620 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:21.629+0000 7f12fd600640 1 -- 172.21.15.44:0/1570097440 shutdown_connections 2024-04-17T19:47:21.620 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:21.629+0000 7f12fd600640 1 -- 172.21.15.44:0/1570097440 wait complete. 2024-04-17T19:47:21.622 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:21.629+0000 7f12fd600640 1 Processor -- start 2024-04-17T19:47:21.622 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:21.629+0000 7f12fd600640 1 -- start start 2024-04-17T19:47:21.624 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:21.633+0000 7f12fd600640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f12f8073d60 0x7f12f8137b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:21.625 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:21.633+0000 7f12fd600640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f12f80c66d0 0x7f12f81f7e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:21.625 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:21.633+0000 7f12fd600640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f12f8153db0 0x7f12f81f83d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:21.625 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:21.633+0000 7f12fd600640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f12f80c8890 con 0x7f12f8153db0 2024-04-17T19:47:21.625 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:21.633+0000 7f12fd600640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f12f80c8710 con 0x7f12f8073d60 2024-04-17T19:47:21.625 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:21.633+0000 7f12fd600640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7f12f8166a80 con 0x7f12f80c66d0 2024-04-17T19:47:21.625 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:21.633+0000 7f12f7400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f12f8153db0 0x7f12f81f83d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:21.625 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:21.633+0000 7f12f7400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f12f8153db0 0x7f12f81f83d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:42606/0 (socket says 172.21.15.44:42606) 2024-04-17T19:47:21.625 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:21.633+0000 7f12f7400640 1 -- 172.21.15.44:0/967059863 learned_addr learned my addr 172.21.15.44:0/967059863 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-04-17T19:47:21.625 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:21.633+0000 7f12f6a00640 1 --2- 172.21.15.44:0/967059863 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f12f8073d60 0x7f12f8137b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:21.625 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:21.633+0000 7f12efe00640 1 --2- 172.21.15.44:0/967059863 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f12f80c66d0 0x7f12f81f7e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:21.625 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:21.633+0000 7f12f7400640 1 -- 172.21.15.44:0/967059863 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f12f80c66d0 msgr2=0x7f12f81f7e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:21.625 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:21.633+0000 7f12f7400640 1 --2- 172.21.15.44:0/967059863 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f12f80c66d0 0x7f12f81f7e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:21.625 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:21.633+0000 7f12f7400640 1 -- 172.21.15.44:0/967059863 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f12f8073d60 msgr2=0x7f12f8137b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:21.625 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:21.633+0000 7f12f7400640 1 --2- 172.21.15.44:0/967059863 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f12f8073d60 0x7f12f8137b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:21.626 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:21.633+0000 7f12f7400640 1 -- 172.21.15.44:0/967059863 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f12f81416c0 con 0x7f12f8153db0 2024-04-17T19:47:21.626 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:21.633+0000 7f12f7400640 1 --2- 172.21.15.44:0/967059863 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f12f8153db0 0x7f12f81f83d0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f12f0009fd0 tx=0x7f12f000e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:47:21.626 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:21.633+0000 7f12eea00640 1 -- 172.21.15.44:0/967059863 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12f0014420 con 0x7f12f8153db0 2024-04-17T19:47:21.626 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:21.633+0000 7f12eea00640 1 -- 172.21.15.44:0/967059863 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f12f0019070 con 0x7f12f8153db0 2024-04-17T19:47:21.626 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:21.633+0000 7f12eea00640 1 -- 172.21.15.44:0/967059863 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12f0014800 con 0x7f12f8153db0 2024-04-17T19:47:21.626 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:21.633+0000 7f12fd600640 1 -- 172.21.15.44:0/967059863 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f12f8134e70 con 0x7f12f8153db0 2024-04-17T19:47:21.626 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:21.633+0000 7f12fd600640 1 -- 172.21.15.44:0/967059863 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f12f8142110 con 0x7f12f8153db0 2024-04-17T19:47:21.626 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:21.633+0000 7f12fd600640 1 -- 172.21.15.44:0/967059863 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f12f804ff10 con 0x7f12f8153db0 2024-04-17T19:47:21.627 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:21.637+0000 7f12eea00640 1 -- 172.21.15.44:0/967059863 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f12f00149a0 con 0x7f12f8153db0 2024-04-17T19:47:21.627 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:21.637+0000 7f12eea00640 1 --2- 172.21.15.44:0/967059863 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f12d4068380 0x7f12d406a890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:21.627 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:21.637+0000 7f12eea00640 1 -- 172.21.15.44:0/967059863 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f12f00874c0 con 0x7f12f8153db0 2024-04-17T19:47:21.628 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:21.637+0000 7f12f6a00640 1 --2- 172.21.15.44:0/967059863 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f12d4068380 0x7f12d406a890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:21.629 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:21.637+0000 7f12f6a00640 1 --2- 172.21.15.44:0/967059863 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f12d4068380 0x7f12d406a890 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f12e80015b0 tx=0x7f12e8009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:47:21.632 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:21.641+0000 7f12eea00640 1 -- 172.21.15.44:0/967059863 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f12f00577d0 con 0x7f12f8153db0 2024-04-17T19:47:21.836 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:21.845+0000 7f12fd600640 1 -- 172.21.15.44:0/967059863 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) -- 0x7f12f8069400 con 0x7f12f8153db0 2024-04-17T19:47:21.840 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:21.849+0000 7f12eea00640 1 -- 172.21.15.44:0/967059863 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) ==== 74+0+168084 (secure 0 0 0) 0x7f12f00570d0 con 0x7f12f8153db0 2024-04-17T19:47:21.842 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-04-17T19:47:21.843 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:21.853+0000 7f12fd600640 1 -- 172.21.15.44:0/967059863 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f12d4068380 msgr2=0x7f12d406a890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:21.843 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:21.853+0000 7f12fd600640 1 --2- 172.21.15.44:0/967059863 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f12d4068380 0x7f12d406a890 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f12e80015b0 tx=0x7f12e8009040 comp rx=0 tx=0).stop 2024-04-17T19:47:21.843 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:21.853+0000 7f12fd600640 1 -- 172.21.15.44:0/967059863 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f12f8153db0 msgr2=0x7f12f81f83d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:21.843 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:21.853+0000 7f12fd600640 1 --2- 172.21.15.44:0/967059863 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f12f8153db0 0x7f12f81f83d0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f12f0009fd0 tx=0x7f12f000e4b0 comp rx=0 tx=0).stop 2024-04-17T19:47:21.843 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:21.853+0000 7f12fd600640 1 -- 172.21.15.44:0/967059863 shutdown_connections 2024-04-17T19:47:21.843 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:21.853+0000 7f12fd600640 1 --2- 172.21.15.44:0/967059863 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f12d4068380 0x7f12d406a890 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:21.844 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:21.853+0000 7f12fd600640 1 --2- 172.21.15.44:0/967059863 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f12f80c66d0 0x7f12f81f7e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:21.844 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:21.853+0000 7f12fd600640 1 --2- 172.21.15.44:0/967059863 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f12f8153db0 0x7f12f81f83d0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:21.844 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:21.853+0000 7f12fd600640 1 --2- 172.21.15.44:0/967059863 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f12f8073d60 0x7f12f8137b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:21.844 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:21.853+0000 7f12fd600640 1 -- 172.21.15.44:0/967059863 >> 172.21.15.44:0/967059863 conn(0x7f12f806c380 msgr2=0x7f12f81576b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:47:21.844 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:21.853+0000 7f12fd600640 1 -- 172.21.15.44:0/967059863 shutdown_connections 2024-04-17T19:47:21.844 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:21.853+0000 7f12fd600640 1 -- 172.21.15.44:0/967059863 wait complete. 2024-04-17T19:47:21.863 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":5,"flags":0,"active_gid":4102,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6832","nonce":1020159798},{"type":"v1","addr":"172.21.15.62:6833","nonce":1020159798}]},"active_addr":"172.21.15.62:6833/1020159798","active_change":"2024-04-17T19:46:35.862094+0000","active_mgr_features":4540701547738038271,"available":true,"standbys":[{"gid":4110,"name":"y","mgr_features":4540701547738038271,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.1","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.1","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.62:0","nonce":3776970163}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.62:0","nonce":154580224}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.62:0","nonce":2626339275}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.62:0","nonce":2987405140}]}]} 2024-04-17T19:47:21.867 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2024-04-17T19:47:21.867 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-04-17T19:47:21.867 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-17T19:47:22.019 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.029+0000 7f1041600640 1 Processor -- start 2024-04-17T19:47:22.019 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.029+0000 7f1041600640 1 -- start start 2024-04-17T19:47:22.022 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.029+0000 7f1041600640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f103c0c70a0 0x7f103c0c74b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:22.022 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.029+0000 7f1041600640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f103c159df0 0x7f103c15a200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:22.022 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.029+0000 7f1041600640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f103c0c8e10 con 0x7f103c153a80 2024-04-17T19:47:22.022 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.029+0000 7f1041600640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 -- 0x7f103c153e90 con 0x7f103c0c70a0 2024-04-17T19:47:22.022 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.029+0000 7f1041600640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7f103c15a740 con 0x7f103c159df0 2024-04-17T19:47:22.022 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.029+0000 7f1032000640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f103c0c70a0 0x7f103c0c74b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:22.022 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.029+0000 7f103aa00640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f103c153a80 0x7f103c0ca3e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:50368/0 (socket says 172.21.15.44:50368) 2024-04-17T19:47:22.022 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.029+0000 7f103aa00640 1 -- 172.21.15.44:0/3589243630 learned_addr learned my addr 172.21.15.44:0/3589243630 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-04-17T19:47:22.022 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.029+0000 7f103b400640 1 --2- 172.21.15.44:0/3589243630 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f103c159df0 0x7f103c15a200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:22.022 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.029+0000 7f1032000640 1 -- 172.21.15.44:0/3589243630 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f103c159df0 msgr2=0x7f103c15a200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T19:47:22.022 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.029+0000 7f1032000640 1 --2- 172.21.15.44:0/3589243630 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f103c159df0 0x7f103c15a200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:22.023 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.029+0000 7f1032000640 1 -- 172.21.15.44:0/3589243630 >> v1:172.21.15.44:6789/0 conn(0x7f103c153a80 legacy=0x7f103c0ca3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:22.023 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.029+0000 7f1032000640 1 -- 172.21.15.44:0/3589243630 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f103c0c90f0 con 0x7f103c0c70a0 2024-04-17T19:47:22.024 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.033+0000 7f1032000640 1 --2- 172.21.15.44:0/3589243630 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f103c0c70a0 0x7f103c0c74b0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f10240097c0 tx=0x7f102401ec90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1218e26e771053a8 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:47:22.025 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.033+0000 7f103a000640 1 -- 172.21.15.44:0/3589243630 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10240b5070 con 0x7f103c0c70a0 2024-04-17T19:47:22.025 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.033+0000 7f103a000640 1 -- 172.21.15.44:0/3589243630 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f10240a8990 con 0x7f103c0c70a0 2024-04-17T19:47:22.025 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.033+0000 7f103a000640 1 -- 172.21.15.44:0/3589243630 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10240a8d60 con 0x7f103c0c70a0 2024-04-17T19:47:22.026 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.033+0000 7f1041600640 1 -- 172.21.15.44:0/3589243630 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f103c0c70a0 msgr2=0x7f103c0c74b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:22.026 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.033+0000 7f1041600640 1 --2- 172.21.15.44:0/3589243630 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f103c0c70a0 0x7f103c0c74b0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f10240097c0 tx=0x7f102401ec90 comp rx=0 tx=0).stop 2024-04-17T19:47:22.026 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.033+0000 7f1041600640 1 -- 172.21.15.44:0/3589243630 shutdown_connections 2024-04-17T19:47:22.026 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.033+0000 7f1041600640 1 --2- 172.21.15.44:0/3589243630 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f103c159df0 0x7f103c15a200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:22.026 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.033+0000 7f1041600640 1 --2- 172.21.15.44:0/3589243630 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f103c0c70a0 0x7f103c0c74b0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:22.026 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.033+0000 7f1041600640 1 -- 172.21.15.44:0/3589243630 >> 172.21.15.44:0/3589243630 conn(0x7f103c073bb0 msgr2=0x7f103c06ce90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:47:22.026 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.033+0000 7f1041600640 1 -- 172.21.15.44:0/3589243630 shutdown_connections 2024-04-17T19:47:22.026 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.033+0000 7f1041600640 1 -- 172.21.15.44:0/3589243630 wait complete. 2024-04-17T19:47:22.028 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.037+0000 7f1041600640 1 Processor -- start 2024-04-17T19:47:22.028 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.037+0000 7f1041600640 1 -- start start 2024-04-17T19:47:22.030 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.037+0000 7f1041600640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f103c0c70a0 0x7f103c1f4880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:22.030 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.037+0000 7f1041600640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f103c153a80 0x7f103c1f6650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:22.030 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.037+0000 7f1041600640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f103c159df0 0x7f103c15bd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:22.030 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.037+0000 7f1041600640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f103c0c96b0 con 0x7f103c0c70a0 2024-04-17T19:47:22.031 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.037+0000 7f1041600640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f103c1598d0 con 0x7f103c153a80 2024-04-17T19:47:22.031 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.037+0000 7f1041600640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7f103c0caaf0 con 0x7f103c159df0 2024-04-17T19:47:22.031 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.037+0000 7f103aa00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f103c0c70a0 0x7f103c1f4880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:22.031 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.037+0000 7f103aa00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f103c0c70a0 0x7f103c1f4880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:42630/0 (socket says 172.21.15.44:42630) 2024-04-17T19:47:22.031 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.037+0000 7f103aa00640 1 -- 172.21.15.44:0/940121219 learned_addr learned my addr 172.21.15.44:0/940121219 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-04-17T19:47:22.031 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.037+0000 7f1032000640 1 --2- 172.21.15.44:0/940121219 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f103c153a80 0x7f103c1f6650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:22.031 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.037+0000 7f103b400640 1 --2- 172.21.15.44:0/940121219 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f103c159df0 0x7f103c15bd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:22.031 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.041+0000 7f103aa00640 1 -- 172.21.15.44:0/940121219 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f103c159df0 msgr2=0x7f103c15bd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:22.031 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.041+0000 7f103aa00640 1 --2- 172.21.15.44:0/940121219 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f103c159df0 0x7f103c15bd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:22.031 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.041+0000 7f103aa00640 1 -- 172.21.15.44:0/940121219 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f103c153a80 msgr2=0x7f103c1f6650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:22.031 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.041+0000 7f103aa00640 1 --2- 172.21.15.44:0/940121219 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f103c153a80 0x7f103c1f6650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:22.031 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.041+0000 7f103aa00640 1 -- 172.21.15.44:0/940121219 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f103c1f4dc0 con 0x7f103c0c70a0 2024-04-17T19:47:22.032 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.041+0000 7f103aa00640 1 --2- 172.21.15.44:0/940121219 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f103c0c70a0 0x7f103c1f4880 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f102c00c370 tx=0x7f102c00c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:47:22.032 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.041+0000 7f1033400640 1 -- 172.21.15.44:0/940121219 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f102c017070 con 0x7f103c0c70a0 2024-04-17T19:47:22.032 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.041+0000 7f1033400640 1 -- 172.21.15.44:0/940121219 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f102c005cf0 con 0x7f103c0c70a0 2024-04-17T19:47:22.032 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.041+0000 7f1033400640 1 -- 172.21.15.44:0/940121219 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f102c0072f0 con 0x7f103c0c70a0 2024-04-17T19:47:22.032 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.041+0000 7f1041600640 1 -- 172.21.15.44:0/940121219 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f103c1f6b90 con 0x7f103c0c70a0 2024-04-17T19:47:22.033 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.041+0000 7f1041600640 1 -- 172.21.15.44:0/940121219 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f103c1f3da0 con 0x7f103c0c70a0 2024-04-17T19:47:22.033 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.041+0000 7f1041600640 1 -- 172.21.15.44:0/940121219 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f103c1f3b90 con 0x7f103c0c70a0 2024-04-17T19:47:22.033 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.041+0000 7f1033400640 1 -- 172.21.15.44:0/940121219 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f102c01a070 con 0x7f103c0c70a0 2024-04-17T19:47:22.034 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.041+0000 7f1033400640 1 --2- 172.21.15.44:0/940121219 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f10180683b0 0x7f101806a8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:22.034 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.041+0000 7f1033400640 1 -- 172.21.15.44:0/940121219 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f102c085ff0 con 0x7f103c0c70a0 2024-04-17T19:47:22.034 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.045+0000 7f1032000640 1 --2- 172.21.15.44:0/940121219 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f10180683b0 0x7f101806a8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:22.035 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.045+0000 7f1032000640 1 --2- 172.21.15.44:0/940121219 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f10180683b0 0x7f101806a8c0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f10240b2000 tx=0x7f1024008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:47:22.038 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.049+0000 7f1033400640 1 -- 172.21.15.44:0/940121219 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f102c055b80 con 0x7f103c0c70a0 2024-04-17T19:47:22.205 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.213+0000 7f1041600640 1 -- 172.21.15.44:0/940121219 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f103c04ff10 con 0x7f103c0c70a0 2024-04-17T19:47:22.206 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.213+0000 7f1033400640 1 -- 172.21.15.44:0/940121219 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) ==== 74+0+18482 (secure 0 0 0) 0x7f102c059e80 con 0x7f103c0c70a0 2024-04-17T19:47:22.207 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-04-17T19:47:22.207 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":25,"fsid":"703f77ca-79c6-4a66-b576-62c526cb1021","created":"2024-04-17T19:46:30.831994+0000","modified":"2024-04-17T19:47:01.141287+0000","last_up_change":"2024-04-17T19:46:41.988197+0000","last_in_change":"2024-04-17T19:46:33.407430+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-17T19:46:41.940380+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-17T19:46:54.222150+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-17T19:46:55.031694+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-17T19:46:58.707529+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"30520dc6-eea6-43d4-ab60-3ca9e92329dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6800","nonce":1018735925},{"type":"v1","addr":"172.21.15.44:6801","nonce":1018735925}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6802","nonce":1018735925},{"type":"v1","addr":"172.21.15.44:6803","nonce":1018735925}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6806","nonce":1018735925},{"type":"v1","addr":"172.21.15.44:6807","nonce":1018735925}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6804","nonce":1018735925},{"type":"v1","addr":"172.21.15.44:6805","nonce":1018735925}]},"public_addr":"172.21.15.44:6801/1018735925","cluster_addr":"172.21.15.44:6803/1018735925","heartbeat_back_addr":"172.21.15.44:6807/1018735925","heartbeat_front_addr":"172.21.15.44:6805/1018735925","state":["exists","up"]},{"osd":1,"uuid":"079bd511-b6ce-449b-8f11-17b311b12f7c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6817","nonce":1452577434},{"type":"v1","addr":"172.21.15.44:6820","nonce":1452577434}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6823","nonce":1452577434},{"type":"v1","addr":"172.21.15.44:6825","nonce":1452577434}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6830","nonce":1452577434},{"type":"v1","addr":"172.21.15.44:6831","nonce":1452577434}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6828","nonce":1452577434},{"type":"v1","addr":"172.21.15.44:6829","nonce":1452577434}]},"public_addr":"172.21.15.44:6820/1452577434","cluster_addr":"172.21.15.44:6825/1452577434","heartbeat_back_addr":"172.21.15.44:6831/1452577434","heartbeat_front_addr":"172.21.15.44:6829/1452577434","state":["exists","up"]},{"osd":2,"uuid":"34f0b9ab-b1d2-4ee9-841c-f15afbb6bec5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6816","nonce":1160071918},{"type":"v1","addr":"172.21.15.44:6818","nonce":1160071918}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6819","nonce":1160071918},{"type":"v1","addr":"172.21.15.44:6821","nonce":1160071918}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6826","nonce":1160071918},{"type":"v1","addr":"172.21.15.44:6827","nonce":1160071918}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6822","nonce":1160071918},{"type":"v1","addr":"172.21.15.44:6824","nonce":1160071918}]},"public_addr":"172.21.15.44:6818/1160071918","cluster_addr":"172.21.15.44:6821/1160071918","heartbeat_back_addr":"172.21.15.44:6827/1160071918","heartbeat_front_addr":"172.21.15.44:6824/1160071918","state":["exists","up"]},{"osd":3,"uuid":"4740032d-fe34-4b1b-bb85-f430896fc3c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6808","nonce":4236454921},{"type":"v1","addr":"172.21.15.44:6809","nonce":4236454921}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6810","nonce":4236454921},{"type":"v1","addr":"172.21.15.44:6811","nonce":4236454921}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6814","nonce":4236454921},{"type":"v1","addr":"172.21.15.44:6815","nonce":4236454921}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6812","nonce":4236454921},{"type":"v1","addr":"172.21.15.44:6813","nonce":4236454921}]},"public_addr":"172.21.15.44:6809/4236454921","cluster_addr":"172.21.15.44:6811/4236454921","heartbeat_back_addr":"172.21.15.44:6815/4236454921","heartbeat_front_addr":"172.21.15.44:6813/4236454921","state":["exists","up"]},{"osd":4,"uuid":"7dbedb00-302d-4d52-810c-e18839254da1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6800","nonce":2293251376},{"type":"v1","addr":"172.21.15.62:6801","nonce":2293251376}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6802","nonce":2293251376},{"type":"v1","addr":"172.21.15.62:6803","nonce":2293251376}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6806","nonce":2293251376},{"type":"v1","addr":"172.21.15.62:6807","nonce":2293251376}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6804","nonce":2293251376},{"type":"v1","addr":"172.21.15.62:6805","nonce":2293251376}]},"public_addr":"172.21.15.62:6801/2293251376","cluster_addr":"172.21.15.62:6803/2293251376","heartbeat_back_addr":"172.21.15.62:6807/2293251376","heartbeat_front_addr":"172.21.15.62:6805/2293251376","state":["exists","up"]},{"osd":5,"uuid":"38c1e8d9-393d-4f33-a97a-3295cf5c5b07","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6808","nonce":1551020300},{"type":"v1","addr":"172.21.15.62:6809","nonce":1551020300}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6810","nonce":1551020300},{"type":"v1","addr":"172.21.15.62:6811","nonce":1551020300}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6814","nonce":1551020300},{"type":"v1","addr":"172.21.15.62:6815","nonce":1551020300}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6812","nonce":1551020300},{"type":"v1","addr":"172.21.15.62:6813","nonce":1551020300}]},"public_addr":"172.21.15.62:6809/1551020300","cluster_addr":"172.21.15.62:6811/1551020300","heartbeat_back_addr":"172.21.15.62:6815/1551020300","heartbeat_front_addr":"172.21.15.62:6813/1551020300","state":["exists","up"]},{"osd":6,"uuid":"f6ff81c6-f14d-4477-88e3-9116cc5a2992","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6824","nonce":2602310256},{"type":"v1","addr":"172.21.15.62:6825","nonce":2602310256}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6826","nonce":2602310256},{"type":"v1","addr":"172.21.15.62:6827","nonce":2602310256}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6830","nonce":2602310256},{"type":"v1","addr":"172.21.15.62:6831","nonce":2602310256}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6828","nonce":2602310256},{"type":"v1","addr":"172.21.15.62:6829","nonce":2602310256}]},"public_addr":"172.21.15.62:6825/2602310256","cluster_addr":"172.21.15.62:6827/2602310256","heartbeat_back_addr":"172.21.15.62:6831/2602310256","heartbeat_front_addr":"172.21.15.62:6829/2602310256","state":["exists","up"]},{"osd":7,"uuid":"ce395bc3-bcb5-4b94-a523-5bb9df491eca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6816","nonce":2912738359},{"type":"v1","addr":"172.21.15.62:6817","nonce":2912738359}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6818","nonce":2912738359},{"type":"v1","addr":"172.21.15.62:6819","nonce":2912738359}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6822","nonce":2912738359},{"type":"v1","addr":"172.21.15.62:6823","nonce":2912738359}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6820","nonce":2912738359},{"type":"v1","addr":"172.21.15.62:6821","nonce":2912738359}]},"public_addr":"172.21.15.62:6817/2912738359","cluster_addr":"172.21.15.62:6819/2912738359","heartbeat_back_addr":"172.21.15.62:6823/2912738359","heartbeat_front_addr":"172.21.15.62:6821/2912738359","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T19:46:39.302883+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T19:46:39.177705+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T19:46:39.188894+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T19:46:39.313009+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T19:46:38.870508+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T19:46:38.790900+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T19:46:38.979163+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T19:46:38.992348+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-17T19:47:22.209 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.217+0000 7f1041600640 1 -- 172.21.15.44:0/940121219 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f10180683b0 msgr2=0x7f101806a8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:22.209 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.217+0000 7f1041600640 1 --2- 172.21.15.44:0/940121219 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f10180683b0 0x7f101806a8c0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f10240b2000 tx=0x7f1024008040 comp rx=0 tx=0).stop 2024-04-17T19:47:22.209 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.217+0000 7f1041600640 1 -- 172.21.15.44:0/940121219 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f103c0c70a0 msgr2=0x7f103c1f4880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:22.209 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.217+0000 7f1041600640 1 --2- 172.21.15.44:0/940121219 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f103c0c70a0 0x7f103c1f4880 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f102c00c370 tx=0x7f102c00c830 comp rx=0 tx=0).stop 2024-04-17T19:47:22.209 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.217+0000 7f1041600640 1 -- 172.21.15.44:0/940121219 shutdown_connections 2024-04-17T19:47:22.209 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.217+0000 7f1041600640 1 --2- 172.21.15.44:0/940121219 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f10180683b0 0x7f101806a8c0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:22.209 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.217+0000 7f1041600640 1 --2- 172.21.15.44:0/940121219 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f103c159df0 0x7f103c15bd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:22.209 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.217+0000 7f1041600640 1 --2- 172.21.15.44:0/940121219 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f103c153a80 0x7f103c1f6650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:22.209 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.217+0000 7f1041600640 1 --2- 172.21.15.44:0/940121219 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f103c0c70a0 0x7f103c1f4880 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:22.209 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.217+0000 7f1041600640 1 -- 172.21.15.44:0/940121219 >> 172.21.15.44:0/940121219 conn(0x7f103c073bb0 msgr2=0x7f103c158430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:47:22.209 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.217+0000 7f1041600640 1 -- 172.21.15.44:0/940121219 shutdown_connections 2024-04-17T19:47:22.209 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.217+0000 7f1041600640 1 -- 172.21.15.44:0/940121219 wait complete. 2024-04-17T19:47:22.228 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-04-17T19:47:22.228 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-17T19:47:22.380 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.389+0000 7f4364600640 1 Processor -- start 2024-04-17T19:47:22.380 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.389+0000 7f4364600640 1 -- start start 2024-04-17T19:47:22.382 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.389+0000 7f4364600640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f435c152a60 0x7f435c0c6920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:22.382 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.389+0000 7f4364600640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f435c158eb0 0x7f435c1592c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:22.382 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.389+0000 7f4364600640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f435c152e70 con 0x7f435c0c47c0 2024-04-17T19:47:22.382 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.389+0000 7f4364600640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 -- 0x7f435c0c52c0 con 0x7f435c158eb0 2024-04-17T19:47:22.382 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.389+0000 7f4364600640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 -- 0x7f435c0c8840 con 0x7f435c152a60 2024-04-17T19:47:22.382 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.389+0000 7f4361200640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f435c158eb0 0x7f435c1592c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:22.382 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.389+0000 7f4362600640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f435c0c47c0 0x7f435c15bd70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:50370/0 (socket says 172.21.15.44:50370) 2024-04-17T19:47:22.382 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.389+0000 7f4362600640 1 -- 172.21.15.44:0/2703546489 learned_addr learned my addr 172.21.15.44:0/2703546489 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-04-17T19:47:22.382 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.389+0000 7f4361c00640 1 --2- 172.21.15.44:0/2703546489 >> v2:172.21.15.62:3300/0 conn(0x7f435c152a60 0x7f435c0c6920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:22.383 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.389+0000 7f4361200640 1 -- 172.21.15.44:0/2703546489 >> v2:172.21.15.62:3300/0 conn(0x7f435c152a60 msgr2=0x7f435c0c6920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T19:47:22.383 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.389+0000 7f4361200640 1 --2- 172.21.15.44:0/2703546489 >> v2:172.21.15.62:3300/0 conn(0x7f435c152a60 0x7f435c0c6920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:22.383 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.389+0000 7f4361200640 1 -- 172.21.15.44:0/2703546489 >> v1:172.21.15.44:6789/0 conn(0x7f435c0c47c0 legacy=0x7f435c15bd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:22.383 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.393+0000 7f4361200640 1 -- 172.21.15.44:0/2703546489 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f435c0c8b20 con 0x7f435c158eb0 2024-04-17T19:47:22.385 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.393+0000 7f4361200640 1 --2- 172.21.15.44:0/2703546489 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f435c158eb0 0x7f435c1592c0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f435c06cc70 tx=0x7f4348020e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=884cb70a27d95e3e server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:47:22.385 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.393+0000 7f435be00640 1 -- 172.21.15.44:0/2703546489 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43480b7070 con 0x7f435c158eb0 2024-04-17T19:47:22.386 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.393+0000 7f435be00640 1 -- 172.21.15.44:0/2703546489 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f43480aab80 con 0x7f435c158eb0 2024-04-17T19:47:22.386 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.393+0000 7f435be00640 1 -- 172.21.15.44:0/2703546489 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43480b2440 con 0x7f435c158eb0 2024-04-17T19:47:22.386 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.393+0000 7f4364600640 1 -- 172.21.15.44:0/2703546489 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f435c158eb0 msgr2=0x7f435c1592c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:22.386 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.393+0000 7f4364600640 1 --2- 172.21.15.44:0/2703546489 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f435c158eb0 0x7f435c1592c0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f435c06cc70 tx=0x7f4348020e80 comp rx=0 tx=0).stop 2024-04-17T19:47:22.387 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.393+0000 7f4364600640 1 -- 172.21.15.44:0/2703546489 shutdown_connections 2024-04-17T19:47:22.387 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.393+0000 7f4364600640 1 --2- 172.21.15.44:0/2703546489 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f435c158eb0 0x7f435c1592c0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:22.387 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.393+0000 7f4364600640 1 --2- 172.21.15.44:0/2703546489 >> v2:172.21.15.62:3300/0 conn(0x7f435c152a60 0x7f435c0c6920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:22.387 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.393+0000 7f4364600640 1 -- 172.21.15.44:0/2703546489 >> 172.21.15.44:0/2703546489 conn(0x7f435c06c380 msgr2=0x7f435c070080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:47:22.387 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.397+0000 7f4364600640 1 -- 172.21.15.44:0/2703546489 shutdown_connections 2024-04-17T19:47:22.387 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.397+0000 7f4364600640 1 -- 172.21.15.44:0/2703546489 wait complete. 2024-04-17T19:47:22.388 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.397+0000 7f4364600640 1 Processor -- start 2024-04-17T19:47:22.388 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.397+0000 7f4364600640 1 -- start start 2024-04-17T19:47:22.391 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.397+0000 7f4364600640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f435c0c47c0 0x7f435c148590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:22.391 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.397+0000 7f4364600640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f435c152a60 0x7f435c146e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:22.392 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.397+0000 7f4364600640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f435c158eb0 0x7f435c1e1de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:22.392 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.397+0000 7f4364600640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f435c158990 con 0x7f435c152a60 2024-04-17T19:47:22.392 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.397+0000 7f4364600640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f435c0c90e0 con 0x7f435c158eb0 2024-04-17T19:47:22.392 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.397+0000 7f4364600640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7f435c0c6e60 con 0x7f435c0c47c0 2024-04-17T19:47:22.392 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.397+0000 7f4361200640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f435c152a60 0x7f435c146e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:22.392 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.397+0000 7f4361200640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f435c152a60 0x7f435c146e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:42646/0 (socket says 172.21.15.44:42646) 2024-04-17T19:47:22.392 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.397+0000 7f4361200640 1 -- 172.21.15.44:0/1338483378 learned_addr learned my addr 172.21.15.44:0/1338483378 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-04-17T19:47:22.392 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.401+0000 7f4362600640 1 --2- 172.21.15.44:0/1338483378 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f435c158eb0 0x7f435c1e1de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:22.392 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.401+0000 7f4361c00640 1 --2- 172.21.15.44:0/1338483378 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f435c0c47c0 0x7f435c148590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:22.392 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.401+0000 7f4361200640 1 -- 172.21.15.44:0/1338483378 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f435c0c47c0 msgr2=0x7f435c148590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:22.392 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.401+0000 7f4361200640 1 --2- 172.21.15.44:0/1338483378 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f435c0c47c0 0x7f435c148590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:22.392 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.401+0000 7f4361200640 1 -- 172.21.15.44:0/1338483378 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f435c158eb0 msgr2=0x7f435c1e1de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:22.392 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.401+0000 7f4361200640 1 --2- 172.21.15.44:0/1338483378 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f435c158eb0 0x7f435c1e1de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:22.393 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.401+0000 7f4361200640 1 -- 172.21.15.44:0/1338483378 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f435c148ad0 con 0x7f435c152a60 2024-04-17T19:47:22.393 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.401+0000 7f4362600640 1 --2- 172.21.15.44:0/1338483378 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f435c158eb0 0x7f435c1e1de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-17T19:47:22.393 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.401+0000 7f4361200640 1 --2- 172.21.15.44:0/1338483378 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f435c152a60 0x7f435c146e80 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f43480b5040 tx=0x7f434801dc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:47:22.393 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.401+0000 7f4359600640 1 -- 172.21.15.44:0/1338483378 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43480c1070 con 0x7f435c152a60 2024-04-17T19:47:22.393 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.401+0000 7f4359600640 1 -- 172.21.15.44:0/1338483378 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f43480b2bd0 con 0x7f435c152a60 2024-04-17T19:47:22.393 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.401+0000 7f4364600640 1 -- 172.21.15.44:0/1338483378 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f435c152060 con 0x7f435c152a60 2024-04-17T19:47:22.393 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.401+0000 7f4359600640 1 -- 172.21.15.44:0/1338483378 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43480b7040 con 0x7f435c152a60 2024-04-17T19:47:22.393 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.401+0000 7f4364600640 1 -- 172.21.15.44:0/1338483378 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f435c148ce0 con 0x7f435c152a60 2024-04-17T19:47:22.393 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.401+0000 7f4364600640 1 -- 172.21.15.44:0/1338483378 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f435c04ff10 con 0x7f435c152a60 2024-04-17T19:47:22.394 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.401+0000 7f4359600640 1 -- 172.21.15.44:0/1338483378 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f43480c4070 con 0x7f435c152a60 2024-04-17T19:47:22.395 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.405+0000 7f4359600640 1 --2- 172.21.15.44:0/1338483378 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f433c068380 0x7f433c06a890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:22.395 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.405+0000 7f4359600640 1 -- 172.21.15.44:0/1338483378 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f4348125960 con 0x7f435c152a60 2024-04-17T19:47:22.395 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.405+0000 7f4361c00640 1 --2- 172.21.15.44:0/1338483378 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f433c068380 0x7f433c06a890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:22.396 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.405+0000 7f4361c00640 1 --2- 172.21.15.44:0/1338483378 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f433c068380 0x7f433c06a890 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f4350009a50 tx=0x7f4350008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:47:22.399 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.409+0000 7f4359600640 1 -- 172.21.15.44:0/1338483378 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f434801a9e0 con 0x7f435c152a60 2024-04-17T19:47:22.566 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.573+0000 7f4364600640 1 -- 172.21.15.44:0/1338483378 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f435c0c7ea0 con 0x7f435c152a60 2024-04-17T19:47:22.567 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.577+0000 7f4359600640 1 -- 172.21.15.44:0/1338483378 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) ==== 74+0+18482 (secure 0 0 0) 0x7f43480f5b40 con 0x7f435c152a60 2024-04-17T19:47:22.568 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-04-17T19:47:22.568 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":25,"fsid":"703f77ca-79c6-4a66-b576-62c526cb1021","created":"2024-04-17T19:46:30.831994+0000","modified":"2024-04-17T19:47:01.141287+0000","last_up_change":"2024-04-17T19:46:41.988197+0000","last_in_change":"2024-04-17T19:46:33.407430+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-17T19:46:41.940380+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-17T19:46:54.222150+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-17T19:46:55.031694+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-17T19:46:58.707529+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"30520dc6-eea6-43d4-ab60-3ca9e92329dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6800","nonce":1018735925},{"type":"v1","addr":"172.21.15.44:6801","nonce":1018735925}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6802","nonce":1018735925},{"type":"v1","addr":"172.21.15.44:6803","nonce":1018735925}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6806","nonce":1018735925},{"type":"v1","addr":"172.21.15.44:6807","nonce":1018735925}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6804","nonce":1018735925},{"type":"v1","addr":"172.21.15.44:6805","nonce":1018735925}]},"public_addr":"172.21.15.44:6801/1018735925","cluster_addr":"172.21.15.44:6803/1018735925","heartbeat_back_addr":"172.21.15.44:6807/1018735925","heartbeat_front_addr":"172.21.15.44:6805/1018735925","state":["exists","up"]},{"osd":1,"uuid":"079bd511-b6ce-449b-8f11-17b311b12f7c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6817","nonce":1452577434},{"type":"v1","addr":"172.21.15.44:6820","nonce":1452577434}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6823","nonce":1452577434},{"type":"v1","addr":"172.21.15.44:6825","nonce":1452577434}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6830","nonce":1452577434},{"type":"v1","addr":"172.21.15.44:6831","nonce":1452577434}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6828","nonce":1452577434},{"type":"v1","addr":"172.21.15.44:6829","nonce":1452577434}]},"public_addr":"172.21.15.44:6820/1452577434","cluster_addr":"172.21.15.44:6825/1452577434","heartbeat_back_addr":"172.21.15.44:6831/1452577434","heartbeat_front_addr":"172.21.15.44:6829/1452577434","state":["exists","up"]},{"osd":2,"uuid":"34f0b9ab-b1d2-4ee9-841c-f15afbb6bec5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6816","nonce":1160071918},{"type":"v1","addr":"172.21.15.44:6818","nonce":1160071918}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6819","nonce":1160071918},{"type":"v1","addr":"172.21.15.44:6821","nonce":1160071918}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6826","nonce":1160071918},{"type":"v1","addr":"172.21.15.44:6827","nonce":1160071918}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6822","nonce":1160071918},{"type":"v1","addr":"172.21.15.44:6824","nonce":1160071918}]},"public_addr":"172.21.15.44:6818/1160071918","cluster_addr":"172.21.15.44:6821/1160071918","heartbeat_back_addr":"172.21.15.44:6827/1160071918","heartbeat_front_addr":"172.21.15.44:6824/1160071918","state":["exists","up"]},{"osd":3,"uuid":"4740032d-fe34-4b1b-bb85-f430896fc3c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6808","nonce":4236454921},{"type":"v1","addr":"172.21.15.44:6809","nonce":4236454921}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6810","nonce":4236454921},{"type":"v1","addr":"172.21.15.44:6811","nonce":4236454921}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6814","nonce":4236454921},{"type":"v1","addr":"172.21.15.44:6815","nonce":4236454921}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6812","nonce":4236454921},{"type":"v1","addr":"172.21.15.44:6813","nonce":4236454921}]},"public_addr":"172.21.15.44:6809/4236454921","cluster_addr":"172.21.15.44:6811/4236454921","heartbeat_back_addr":"172.21.15.44:6815/4236454921","heartbeat_front_addr":"172.21.15.44:6813/4236454921","state":["exists","up"]},{"osd":4,"uuid":"7dbedb00-302d-4d52-810c-e18839254da1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6800","nonce":2293251376},{"type":"v1","addr":"172.21.15.62:6801","nonce":2293251376}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6802","nonce":2293251376},{"type":"v1","addr":"172.21.15.62:6803","nonce":2293251376}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6806","nonce":2293251376},{"type":"v1","addr":"172.21.15.62:6807","nonce":2293251376}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6804","nonce":2293251376},{"type":"v1","addr":"172.21.15.62:6805","nonce":2293251376}]},"public_addr":"172.21.15.62:6801/2293251376","cluster_addr":"172.21.15.62:6803/2293251376","heartbeat_back_addr":"172.21.15.62:6807/2293251376","heartbeat_front_addr":"172.21.15.62:6805/2293251376","state":["exists","up"]},{"osd":5,"uuid":"38c1e8d9-393d-4f33-a97a-3295cf5c5b07","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6808","nonce":1551020300},{"type":"v1","addr":"172.21.15.62:6809","nonce":1551020300}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6810","nonce":1551020300},{"type":"v1","addr":"172.21.15.62:6811","nonce":1551020300}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6814","nonce":1551020300},{"type":"v1","addr":"172.21.15.62:6815","nonce":1551020300}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6812","nonce":1551020300},{"type":"v1","addr":"172.21.15.62:6813","nonce":1551020300}]},"public_addr":"172.21.15.62:6809/1551020300","cluster_addr":"172.21.15.62:6811/1551020300","heartbeat_back_addr":"172.21.15.62:6815/1551020300","heartbeat_front_addr":"172.21.15.62:6813/1551020300","state":["exists","up"]},{"osd":6,"uuid":"f6ff81c6-f14d-4477-88e3-9116cc5a2992","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6824","nonce":2602310256},{"type":"v1","addr":"172.21.15.62:6825","nonce":2602310256}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6826","nonce":2602310256},{"type":"v1","addr":"172.21.15.62:6827","nonce":2602310256}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6830","nonce":2602310256},{"type":"v1","addr":"172.21.15.62:6831","nonce":2602310256}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6828","nonce":2602310256},{"type":"v1","addr":"172.21.15.62:6829","nonce":2602310256}]},"public_addr":"172.21.15.62:6825/2602310256","cluster_addr":"172.21.15.62:6827/2602310256","heartbeat_back_addr":"172.21.15.62:6831/2602310256","heartbeat_front_addr":"172.21.15.62:6829/2602310256","state":["exists","up"]},{"osd":7,"uuid":"ce395bc3-bcb5-4b94-a523-5bb9df491eca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6816","nonce":2912738359},{"type":"v1","addr":"172.21.15.62:6817","nonce":2912738359}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6818","nonce":2912738359},{"type":"v1","addr":"172.21.15.62:6819","nonce":2912738359}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6822","nonce":2912738359},{"type":"v1","addr":"172.21.15.62:6823","nonce":2912738359}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6820","nonce":2912738359},{"type":"v1","addr":"172.21.15.62:6821","nonce":2912738359}]},"public_addr":"172.21.15.62:6817/2912738359","cluster_addr":"172.21.15.62:6819/2912738359","heartbeat_back_addr":"172.21.15.62:6823/2912738359","heartbeat_front_addr":"172.21.15.62:6821/2912738359","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T19:46:39.302883+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T19:46:39.177705+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T19:46:39.188894+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T19:46:39.313009+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T19:46:38.870508+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T19:46:38.790900+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T19:46:38.979163+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T19:46:38.992348+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-17T19:47:22.570 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.577+0000 7f4364600640 1 -- 172.21.15.44:0/1338483378 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f433c068380 msgr2=0x7f433c06a890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:22.570 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.577+0000 7f4364600640 1 --2- 172.21.15.44:0/1338483378 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f433c068380 0x7f433c06a890 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f4350009a50 tx=0x7f4350008040 comp rx=0 tx=0).stop 2024-04-17T19:47:22.570 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.577+0000 7f4364600640 1 -- 172.21.15.44:0/1338483378 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f435c152a60 msgr2=0x7f435c146e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:22.570 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.577+0000 7f4364600640 1 --2- 172.21.15.44:0/1338483378 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f435c152a60 0x7f435c146e80 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f43480b5040 tx=0x7f434801dc20 comp rx=0 tx=0).stop 2024-04-17T19:47:22.570 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.577+0000 7f4364600640 1 -- 172.21.15.44:0/1338483378 shutdown_connections 2024-04-17T19:47:22.570 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.577+0000 7f4364600640 1 --2- 172.21.15.44:0/1338483378 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f433c068380 0x7f433c06a890 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:22.570 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.577+0000 7f4364600640 1 --2- 172.21.15.44:0/1338483378 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f435c158eb0 0x7f435c1e1de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:22.570 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.577+0000 7f4364600640 1 --2- 172.21.15.44:0/1338483378 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f435c152a60 0x7f435c146e80 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:22.570 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.577+0000 7f4364600640 1 --2- 172.21.15.44:0/1338483378 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f435c0c47c0 0x7f435c148590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:22.571 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.577+0000 7f4364600640 1 -- 172.21.15.44:0/1338483378 >> 172.21.15.44:0/1338483378 conn(0x7f435c06c380 msgr2=0x7f435c073040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:47:22.571 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.577+0000 7f4364600640 1 -- 172.21.15.44:0/1338483378 shutdown_connections 2024-04-17T19:47:22.571 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.577+0000 7f4364600640 1 -- 172.21.15.44:0/1338483378 wait complete. 2024-04-17T19:47:22.590 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-04-17T19:47:22.591 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-04-17T19:47:22.591 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-04-17T19:47:22.591 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2024-04-17T19:47:22.592 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2024-04-17T19:47:22.592 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2024-04-17T19:47:22.592 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2024-04-17T19:47:22.593 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2024-04-17T19:47:22.876 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.885+0000 7f3633200640 1 Processor -- start 2024-04-17T19:47:22.876 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.885+0000 7f3633200640 1 -- start start 2024-04-17T19:47:22.876 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.885+0000 7f748be00640 1 Processor -- start 2024-04-17T19:47:22.876 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.885+0000 7f748be00640 1 -- start start 2024-04-17T19:47:22.877 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.885+0000 7fac49a00640 1 Processor -- start 2024-04-17T19:47:22.877 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.885+0000 7fac49a00640 1 -- start start 2024-04-17T19:47:22.878 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.885+0000 7f3633200640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f3634151c30 0x7f363406fec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:22.878 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.885+0000 7f3633200640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f36340724d0 0x7f3634162ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:22.878 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.885+0000 7f3633200640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f36340c4210 con 0x7f3634070400 2024-04-17T19:47:22.879 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.889+0000 7f0dfbe00640 1 Processor -- start 2024-04-17T19:47:22.880 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.889+0000 7f0dfbe00640 1 -- start start 2024-04-17T19:47:22.881 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.885+0000 7f3633200640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 -- 0x7f36340c3410 con 0x7f3634151c30 2024-04-17T19:47:22.881 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.885+0000 7f3633200640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 -- 0x7f36340c36f0 con 0x7f36340724d0 2024-04-17T19:47:22.881 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.889+0000 7f3631400640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f3634070400 0x7f3634157f30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:50380/0 (socket says 172.21.15.44:50380) 2024-04-17T19:47:22.881 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.889+0000 7f3631400640 1 -- 172.21.15.44:0/1557677077 learned_addr learned my addr 172.21.15.44:0/1557677077 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-04-17T19:47:22.882 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.889+0000 7f3632800640 1 --2- 172.21.15.44:0/1557677077 >> v2:172.21.15.62:3300/0 conn(0x7f36340724d0 0x7f3634162ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:22.882 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.889+0000 7f3632800640 1 -- 172.21.15.44:0/1557677077 >> v2:172.21.15.44:3300/0 conn(0x7f3634151c30 msgr2=0x7f363406fec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T19:47:22.882 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.889+0000 7f3632800640 1 --2- 172.21.15.44:0/1557677077 >> v2:172.21.15.44:3300/0 conn(0x7f3634151c30 0x7f363406fec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:22.882 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.889+0000 7f3632800640 1 -- 172.21.15.44:0/1557677077 >> v1:172.21.15.44:6789/0 conn(0x7f3634070400 legacy=0x7f3634157f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:22.882 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.889+0000 7f3632800640 1 -- 172.21.15.44:0/1557677077 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f36340c39d0 con 0x7f36340724d0 2024-04-17T19:47:22.882 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.889+0000 7f748be00640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f748c0c8cf0 0x7f748c151a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:22.882 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.889+0000 7f748be00640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f748c06fec0 0x7f748c0702d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:22.883 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.889+0000 7f748aa00640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f748c0c8cf0 0x7f748c151a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:22.883 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.889+0000 7f748aa00640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f748c0c8cf0 0x7f748c151a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:42662/0 (socket says 172.21.15.44:42662) 2024-04-17T19:47:22.883 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.889+0000 7f748be00640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f748c157f30 0x7f748c158340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:22.883 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.889+0000 7f748be00640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 -- 0x7f748c0c3410 con 0x7f748c0c8cf0 2024-04-17T19:47:22.883 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.889+0000 7f748be00640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 -- 0x7f748c0c36f0 con 0x7f748c157f30 2024-04-17T19:47:22.883 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.889+0000 7f748be00640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7f748c0c39d0 con 0x7f748c06fec0 2024-04-17T19:47:22.883 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.889+0000 7f748a000640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f748c06fec0 0x7f748c0702d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:22.883 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.889+0000 7f748aa00640 1 -- 172.21.15.44:0/2184447815 learned_addr learned my addr 172.21.15.44:0/2184447815 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-04-17T19:47:22.883 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.889+0000 7f748b400640 1 --2- 172.21.15.44:0/2184447815 >> v2:172.21.15.62:3300/0 conn(0x7f748c157f30 0x7f748c158340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:22.884 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.889+0000 7fac49a00640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fac3c0db2b0 0x7fac3c04bb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:22.884 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.889+0000 7fac49a00640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fac3c047540 con 0x7fac3c04c070 2024-04-17T19:47:22.884 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.889+0000 7fac49a00640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fac3c0461c0 con 0x7fac3c04c8e0 2024-04-17T19:47:22.884 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.889+0000 7fac49a00640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 -- 0x7fac3c0464a0 con 0x7fac3c0db2b0 2024-04-17T19:47:22.884 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.893+0000 7f0dfbe00640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f0df4045360 0x7f0df4046070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:22.884 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.893+0000 7f0dfbe00640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f0df40465b0 0x7f0df40e6150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:22.884 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.889+0000 7fac42000640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fac3c0db2b0 0x7fac3c04bb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:22.884 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.889+0000 7fac42a00640 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7fac3c04c8e0 0x7fac3c0060f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.44:60842/0 (socket says 172.21.15.44:60842) 2024-04-17T19:47:22.885 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.889+0000 7fac42a00640 1 -- 172.21.15.44:0/1970616076 learned_addr learned my addr 172.21.15.44:0/1970616076 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-04-17T19:47:22.885 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.893+0000 7fac41600640 1 -- 172.21.15.44:0/1970616076 <== mon.1 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1437325006 0 0) 0x7fac3c0461c0 con 0x7fac3c04c8e0 2024-04-17T19:47:22.885 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.893+0000 7fac41600640 1 -- 172.21.15.44:0/1970616076 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fac28003530 con 0x7fac3c04c8e0 2024-04-17T19:47:22.885 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.893+0000 7f0dfbe00640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0df4036450 con 0x7f0df4036040 2024-04-17T19:47:22.885 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.893+0000 7f0dfbe00640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 -- 0x7f0df40dc740 con 0x7f0df40465b0 2024-04-17T19:47:22.885 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.893+0000 7f0dfbe00640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 -- 0x7f0df4045770 con 0x7f0df4045360 2024-04-17T19:47:22.886 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.893+0000 7fac41600640 1 -- 172.21.15.44:0/1970616076 <== mon.1 v1:172.21.15.62:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3752818128 0 0) 0x7fac28003530 con 0x7fac3c04c8e0 2024-04-17T19:47:22.886 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.893+0000 7fac41600640 1 -- 172.21.15.44:0/1970616076 >> v2:172.21.15.62:3300/0 conn(0x7fac3c0db2b0 msgr2=0x7fac3c04bb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T19:47:22.886 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.893+0000 7fac41600640 1 --2- 172.21.15.44:0/1970616076 >> v2:172.21.15.62:3300/0 conn(0x7fac3c0db2b0 0x7fac3c04bb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:22.886 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.893+0000 7fac41600640 1 -- 172.21.15.44:0/1970616076 >> v1:172.21.15.44:6789/0 conn(0x7fac3c04c070 legacy=0x7fac3c0dfc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T19:47:22.886 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.893+0000 7fac41600640 1 -- 172.21.15.44:0/1970616076 --> v1:172.21.15.62:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fac3c046780 con 0x7fac3c04c8e0 2024-04-17T19:47:22.886 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.893+0000 7fac41600640 1 -- 172.21.15.44:0/1970616076 <== mon.1 v1:172.21.15.62:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1863569991 0 0) 0x7fac440775a0 con 0x7fac3c04c8e0 2024-04-17T19:47:22.886 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.893+0000 7f748a000640 1 -- 172.21.15.44:0/2184447815 >> v2:172.21.15.62:3300/0 conn(0x7f748c157f30 msgr2=0x7f748c158340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T19:47:22.886 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.893+0000 7f748a000640 1 --2- 172.21.15.44:0/2184447815 >> v2:172.21.15.62:3300/0 conn(0x7f748c157f30 0x7f748c158340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:22.886 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.893+0000 7f748a000640 1 -- 172.21.15.44:0/2184447815 >> v2:172.21.15.44:3300/0 conn(0x7f748c0c8cf0 msgr2=0x7f748c151a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T19:47:22.886 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.893+0000 7f748a000640 1 --2- 172.21.15.44:0/2184447815 >> v2:172.21.15.44:3300/0 conn(0x7f748c0c8cf0 0x7f748c151a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:22.886 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.893+0000 7f748a000640 1 -- 172.21.15.44:0/2184447815 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f748c158880 con 0x7f748c06fec0 2024-04-17T19:47:22.887 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.893+0000 7fac41600640 1 -- 172.21.15.44:0/1970616076 >> v1:172.21.15.62:6789/0 conn(0x7fac3c04c8e0 legacy=0x7fac3c0060f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:22.887 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.893+0000 7fac41600640 1 --2- 172.21.15.44:0/1970616076 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fac280039c0 0x7fac28003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:22.887 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.893+0000 7fac41600640 1 --2- 172.21.15.44:0/1970616076 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fac28004810 0x7fac28004c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:22.887 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.893+0000 7fac41600640 1 --2- 172.21.15.44:0/1970616076 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fac28005160 0x7fac2800b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:22.887 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.893+0000 7fac41600640 1 -- 172.21.15.44:0/1970616076 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fac3c0464a0 con 0x7fac280039c0 2024-04-17T19:47:22.887 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.893+0000 7fac41600640 1 -- 172.21.15.44:0/1970616076 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7fac2800c150 con 0x7fac28004810 2024-04-17T19:47:22.887 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.893+0000 7fac41600640 1 -- 172.21.15.44:0/1970616076 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7fac2800c350 con 0x7fac28005160 2024-04-17T19:47:22.888 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.893+0000 7f0dfb400640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f0df40465b0 0x7f0df40e6150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:22.888 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.893+0000 7fac43400640 1 --2- 172.21.15.44:0/1970616076 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fac28005160 0x7fac2800b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:22.888 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.893+0000 7fac42a00640 1 --2- 172.21.15.44:0/1970616076 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fac280039c0 0x7fac28003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:22.888 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.893+0000 7f0dfb400640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f0df40465b0 0x7f0df40e6150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:42666/0 (socket says 172.21.15.44:42666) 2024-04-17T19:47:22.888 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.893+0000 7f0dfb400640 1 -- 172.21.15.44:0/1761354411 learned_addr learned my addr 172.21.15.44:0/1761354411 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-04-17T19:47:22.888 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.897+0000 7fac43400640 1 -- 172.21.15.44:0/1970616076 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fac28004810 msgr2=0x7fac28004c20 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-17T19:47:22.889 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.897+0000 7fac43400640 1 --2- 172.21.15.44:0/1970616076 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fac28004810 0x7fac28004c20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:22.889 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.897+0000 7fac43400640 1 -- 172.21.15.44:0/1970616076 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fac280039c0 msgr2=0x7fac28003e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T19:47:22.889 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.897+0000 7fac43400640 1 --2- 172.21.15.44:0/1970616076 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fac280039c0 0x7fac28003e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:22.889 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.897+0000 7fac43400640 1 -- 172.21.15.44:0/1970616076 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fac28003530 con 0x7fac28005160 2024-04-17T19:47:22.889 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.897+0000 7f0dfa000640 1 --2- 172.21.15.44:0/1761354411 >> v2:172.21.15.62:3300/0 conn(0x7f0df4045360 0x7f0df4046070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:22.889 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.897+0000 7f0df9600640 1 -- 172.21.15.44:0/1761354411 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 604399392 0 0) 0x7f0df4036450 con 0x7f0df4036040 2024-04-17T19:47:22.889 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.897+0000 7f0df9600640 1 -- 172.21.15.44:0/1761354411 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0de0003530 con 0x7f0df4036040 2024-04-17T19:47:22.889 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.897+0000 7f0dfa000640 1 -- 172.21.15.44:0/1761354411 >> v2:172.21.15.44:3300/0 conn(0x7f0df40465b0 msgr2=0x7f0df40e6150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T19:47:22.889 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.897+0000 7f0dfa000640 1 --2- 172.21.15.44:0/1761354411 >> v2:172.21.15.44:3300/0 conn(0x7f0df40465b0 0x7f0df40e6150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:22.889 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.897+0000 7f0dfa000640 1 -- 172.21.15.44:0/1761354411 >> v1:172.21.15.44:6789/0 conn(0x7f0df4036040 legacy=0x7f0df4006980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:22.890 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.897+0000 7f0dfa000640 1 -- 172.21.15.44:0/1761354411 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0df40db8e0 con 0x7f0df4045360 2024-04-17T19:47:22.890 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.897+0000 7f3632800640 1 --2- 172.21.15.44:0/1557677077 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f36340724d0 0x7f3634162ad0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f36340cd910 tx=0x7f362c025160 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8073a5704f1ac09 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:47:22.890 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.897+0000 7f3630a00640 1 -- 172.21.15.44:0/1557677077 <== mon.1 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f362c0b9070 con 0x7f36340724d0 2024-04-17T19:47:22.890 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.897+0000 7f3630a00640 1 -- 172.21.15.44:0/1557677077 <== mon.1 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f362c00b2d0 con 0x7f36340724d0 2024-04-17T19:47:22.890 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.897+0000 7f3630a00640 1 -- 172.21.15.44:0/1557677077 <== mon.1 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f362c009780 con 0x7f36340724d0 2024-04-17T19:47:22.891 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.897+0000 7f748a000640 1 --2- 172.21.15.44:0/2184447815 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f748c06fec0 0x7f748c0702d0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f748c06cc90 tx=0x7f747c01ecb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ee5a27e4887d3c2d server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:47:22.891 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.897+0000 7f7489600640 1 -- 172.21.15.44:0/2184447815 <== mon.2 v2:172.21.15.62:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f747c0b5070 con 0x7f748c06fec0 2024-04-17T19:47:22.891 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.897+0000 7f7489600640 1 -- 172.21.15.44:0/2184447815 <== mon.2 v2:172.21.15.62:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f747c0a8930 con 0x7f748c06fec0 2024-04-17T19:47:22.891 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.897+0000 7f7489600640 1 -- 172.21.15.44:0/2184447815 <== mon.2 v2:172.21.15.62:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f747c0a8d00 con 0x7f748c06fec0 2024-04-17T19:47:22.891 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.901+0000 7f3633200640 1 -- 172.21.15.44:0/1557677077 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f36340724d0 msgr2=0x7f3634162ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:22.892 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.901+0000 7f3633200640 1 --2- 172.21.15.44:0/1557677077 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f36340724d0 0x7f3634162ad0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f36340cd910 tx=0x7f362c025160 comp rx=0 tx=0).stop 2024-04-17T19:47:22.892 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.901+0000 7f3633200640 1 -- 172.21.15.44:0/1557677077 shutdown_connections 2024-04-17T19:47:22.892 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.901+0000 7f3633200640 1 --2- 172.21.15.44:0/1557677077 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f36340724d0 0x7f3634162ad0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:22.892 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.901+0000 7f3633200640 1 --2- 172.21.15.44:0/1557677077 >> v2:172.21.15.44:3300/0 conn(0x7f3634151c30 0x7f363406fec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:22.892 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.901+0000 7f3633200640 1 -- 172.21.15.44:0/1557677077 >> 172.21.15.44:0/1557677077 conn(0x7f36340ccf60 msgr2=0x7f363406bd80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:47:22.892 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.901+0000 7fac43400640 1 -- 172.21.15.44:0/1970616076 reap_dead start 2024-04-17T19:47:22.892 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.901+0000 7f3633200640 1 -- 172.21.15.44:0/1557677077 shutdown_connections 2024-04-17T19:47:22.893 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.901+0000 7f748be00640 1 -- 172.21.15.44:0/2184447815 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f748c06fec0 msgr2=0x7f748c0702d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:22.893 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.901+0000 7f748be00640 1 --2- 172.21.15.44:0/2184447815 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f748c06fec0 0x7f748c0702d0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f748c06cc90 tx=0x7f747c01ecb0 comp rx=0 tx=0).stop 2024-04-17T19:47:22.893 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.901+0000 7fac43400640 1 --2- 172.21.15.44:0/1970616076 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fac28005160 0x7fac2800b9d0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fac3c00c040 tx=0x7fac3001c320 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3726be3644899b20 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:47:22.893 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.901+0000 7fac41600640 1 -- 172.21.15.44:0/1970616076 <== mon.2 v2:172.21.15.62:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac30001270 con 0x7fac28005160 2024-04-17T19:47:22.893 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.901+0000 7f3633200640 1 -- 172.21.15.44:0/1557677077 wait complete. 2024-04-17T19:47:22.894 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.901+0000 7f748be00640 1 -- 172.21.15.44:0/2184447815 shutdown_connections 2024-04-17T19:47:22.894 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.901+0000 7f748be00640 1 --2- 172.21.15.44:0/2184447815 >> v2:172.21.15.62:3300/0 conn(0x7f748c157f30 0x7f748c158340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:22.894 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.901+0000 7f748be00640 1 --2- 172.21.15.44:0/2184447815 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f748c06fec0 0x7f748c0702d0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:22.894 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.901+0000 7f748be00640 1 --2- 172.21.15.44:0/2184447815 >> v2:172.21.15.44:3300/0 conn(0x7f748c0c8cf0 0x7f748c151a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:22.894 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.901+0000 7f748be00640 1 -- 172.21.15.44:0/2184447815 >> 172.21.15.44:0/2184447815 conn(0x7f748c0ccf60 msgr2=0x7f748c06bd80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:47:22.894 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.901+0000 7f748be00640 1 -- 172.21.15.44:0/2184447815 shutdown_connections 2024-04-17T19:47:22.895 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.901+0000 7f900cc00640 1 Processor -- start 2024-04-17T19:47:22.895 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.901+0000 7fac41600640 1 -- 172.21.15.44:0/1970616076 <== mon.2 v2:172.21.15.62:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fac30005070 con 0x7fac28005160 2024-04-17T19:47:22.895 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.901+0000 7fac41600640 1 -- 172.21.15.44:0/1970616076 <== mon.2 v2:172.21.15.62:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac30005480 con 0x7fac28005160 2024-04-17T19:47:22.895 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.901+0000 7f900cc00640 1 -- start start 2024-04-17T19:47:22.895 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.901+0000 7f12a2600640 1 Processor -- start 2024-04-17T19:47:22.896 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.901+0000 7f748be00640 1 -- 172.21.15.44:0/2184447815 wait complete. 2024-04-17T19:47:22.896 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.901+0000 7fac49a00640 1 -- 172.21.15.44:0/1970616076 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fac28005160 msgr2=0x7fac2800b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:22.896 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.901+0000 7fac49a00640 1 --2- 172.21.15.44:0/1970616076 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fac28005160 0x7fac2800b9d0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fac3c00c040 tx=0x7fac3001c320 comp rx=0 tx=0).stop 2024-04-17T19:47:22.896 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.901+0000 7fac49a00640 1 -- 172.21.15.44:0/1970616076 shutdown_connections 2024-04-17T19:47:22.896 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.901+0000 7fac49a00640 1 --2- 172.21.15.44:0/1970616076 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fac28005160 0x7fac2800b9d0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:22.896 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.901+0000 7fac49a00640 1 -- 172.21.15.44:0/1970616076 >> 172.21.15.44:0/1970616076 conn(0x7fac3c0503c0 msgr2=0x7fac3c0507d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:47:22.897 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.901+0000 7f12a2600640 1 -- start start 2024-04-17T19:47:22.897 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.905+0000 7f3633200640 1 Processor -- start 2024-04-17T19:47:22.897 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.905+0000 7f900cc00640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f90080724d0 0x7f90080728e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:22.897 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.905+0000 7f3633200640 1 -- start start 2024-04-17T19:47:22.898 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.905+0000 7f900cc00640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9008158500 con 0x7f9008152560 2024-04-17T19:47:22.898 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.905+0000 7f900cc00640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f90080c43a0 con 0x7f90080731c0 2024-04-17T19:47:22.898 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.905+0000 7f900cc00640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 -- 0x7f90081590f0 con 0x7f90080724d0 2024-04-17T19:47:22.898 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.905+0000 7f0dfa000640 1 --2- 172.21.15.44:0/1761354411 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0df4045360 0x7f0df4046070 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f0df400dcd0 tx=0x7f0de8024ea0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7d39162be8dab569 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:47:22.899 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.905+0000 7f41ef800640 1 Processor -- start 2024-04-17T19:47:22.899 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.905+0000 7f3633200640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3634070400 0x7f3634146150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:22.899 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.901+0000 7fac49a00640 1 -- 172.21.15.44:0/1970616076 shutdown_connections 2024-04-17T19:47:22.899 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.901+0000 7fac49a00640 1 -- 172.21.15.44:0/1970616076 wait complete. 2024-04-17T19:47:22.900 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.905+0000 7f0df9600640 1 -- 172.21.15.44:0/1761354411 <== mon.1 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0de80ba070 con 0x7f0df4045360 2024-04-17T19:47:22.900 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.905+0000 7f0df9600640 1 -- 172.21.15.44:0/1761354411 <== mon.1 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0de80ade00 con 0x7f0df4045360 2024-04-17T19:47:22.900 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.905+0000 7f0df9600640 1 -- 172.21.15.44:0/1761354411 <== mon.1 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0de80b5660 con 0x7f0df4045360 2024-04-17T19:47:22.900 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.905+0000 7f0dfbe00640 1 -- 172.21.15.44:0/1761354411 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0df4045360 msgr2=0x7f0df4046070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:22.900 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.905+0000 7f0dfbe00640 1 --2- 172.21.15.44:0/1761354411 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0df4045360 0x7f0df4046070 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f0df400dcd0 tx=0x7f0de8024ea0 comp rx=0 tx=0).stop 2024-04-17T19:47:22.900 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.905+0000 7f9006a00640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f90080724d0 0x7f90080728e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:22.900 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.905+0000 7f9006a00640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f90080724d0 0x7f90080728e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.44:49162/0 (socket says 172.21.15.44:49162) 2024-04-17T19:47:22.900 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.905+0000 7f9006a00640 1 -- 172.21.15.44:0/4240141699 learned_addr learned my addr 172.21.15.44:0/4240141699 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-04-17T19:47:22.900 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.905+0000 7f9007e00640 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f90080731c0 0x7f90080735d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.44:60858/0 (socket says 172.21.15.44:60858) 2024-04-17T19:47:22.901 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.905+0000 7f12a2600640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f129c06f650 0x7f129c06fa60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:22.901 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.905+0000 7f12a2600640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f129c06bfb0 con 0x7f129c0c2ee0 2024-04-17T19:47:22.901 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.905+0000 7f12a2600640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f129c06c270 con 0x7f129c0703b0 2024-04-17T19:47:22.901 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.905+0000 7f12a2600640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 -- 0x7f129c06bd80 con 0x7f129c06f650 2024-04-17T19:47:22.901 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.905+0000 7f129b400640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f129c0c2ee0 0x7f129c159db0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:50414/0 (socket says 172.21.15.44:50414) 2024-04-17T19:47:22.901 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.905+0000 7f129b400640 1 -- 172.21.15.44:0/705209937 learned_addr learned my addr 172.21.15.44:0/705209937 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-04-17T19:47:22.901 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.905+0000 7f129a000640 1 -- 172.21.15.44:0/705209937 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 617207306 0 0) 0x7f129c06bfb0 con 0x7f129c0c2ee0 2024-04-17T19:47:22.901 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.905+0000 7f129a000640 1 -- 172.21.15.44:0/705209937 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1280003530 con 0x7f129c0c2ee0 2024-04-17T19:47:22.901 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.905+0000 7f129be00640 1 --2- 172.21.15.44:0/705209937 >> v2:172.21.15.44:3300/0 conn(0x7f129c06f650 0x7f129c06fa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:22.902 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.905+0000 7fa760e00640 1 Processor -- start 2024-04-17T19:47:22.902 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.905+0000 7f3633200640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f36340724d0 0x7f3634146690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:22.902 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.905+0000 7f9006000640 1 -- 172.21.15.44:0/4240141699 <== mon.1 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3787364513 0 0) 0x7f90080c43a0 con 0x7f90080731c0 2024-04-17T19:47:22.902 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.905+0000 7f9006000640 1 -- 172.21.15.44:0/4240141699 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8fec003530 con 0x7f90080731c0 2024-04-17T19:47:22.903 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.909+0000 7f3633200640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3634151c30 0x7f36341f41c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:22.903 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.905+0000 7f129a000640 1 -- 172.21.15.44:0/705209937 <== mon.1 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2704128075 0 0) 0x7f129c06c270 con 0x7f129c0703b0 2024-04-17T19:47:22.903 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.909+0000 7f3633200640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f36340c74e0 con 0x7f3634070400 2024-04-17T19:47:22.904 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.909+0000 7f748be00640 1 Processor -- start 2024-04-17T19:47:22.904 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.909+0000 7f3633200640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f36340c7360 con 0x7f3634151c30 2024-04-17T19:47:22.904 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.905+0000 7f129a000640 1 -- 172.21.15.44:0/705209937 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f129c06bfb0 con 0x7f129c0703b0 2024-04-17T19:47:22.904 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.909+0000 7f0dfbe00640 1 -- 172.21.15.44:0/1761354411 shutdown_connections 2024-04-17T19:47:22.905 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.909+0000 7f0dfbe00640 1 --2- 172.21.15.44:0/1761354411 >> v2:172.21.15.44:3300/0 conn(0x7f0df40465b0 0x7f0df40e6150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:22.905 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.909+0000 7f0dfbe00640 1 --2- 172.21.15.44:0/1761354411 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0df4045360 0x7f0df4046070 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:22.905 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.909+0000 7f0dfbe00640 1 -- 172.21.15.44:0/1761354411 >> 172.21.15.44:0/1761354411 conn(0x7f0df40503c0 msgr2=0x7f0df40507d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:47:22.905 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.905+0000 7f41ef800640 1 -- start start 2024-04-17T19:47:22.905 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.909+0000 7f41ef800640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f41e80703b0 0x7f41e80c8d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:22.905 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.909+0000 7f41ef800640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f41e806bfb0 con 0x7f41e80c92a0 2024-04-17T19:47:22.905 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.909+0000 7f41ef800640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f41e806c270 con 0x7f41e80c2ee0 2024-04-17T19:47:22.905 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.909+0000 7f41ef800640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 -- 0x7f41e806bd80 con 0x7f41e80703b0 2024-04-17T19:47:22.906 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.909+0000 7f3633200640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7f36340c8710 con 0x7f36340724d0 2024-04-17T19:47:22.906 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.909+0000 7f9006a00640 1 -- 172.21.15.44:0/4240141699 >> v1:172.21.15.62:6789/0 conn(0x7f90080731c0 legacy=0x7f90080735d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:22.906 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.909+0000 7f3631400640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f36340724d0 0x7f3634146690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:22.906 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.909+0000 7f3631400640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f36340724d0 0x7f3634146690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3301/0 says I am v2:172.21.15.44:43266/0 (socket says 172.21.15.44:43266) 2024-04-17T19:47:22.906 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.909+0000 7f3631400640 1 -- 172.21.15.44:0/4073667765 learned_addr learned my addr 172.21.15.44:0/4073667765 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-04-17T19:47:22.907 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.909+0000 7f748be00640 1 -- start start 2024-04-17T19:47:22.907 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.909+0000 7f129a000640 1 -- 172.21.15.44:0/705209937 <== mon.0 v1:172.21.15.44:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2927505447 0 0) 0x7f1280003530 con 0x7f129c0c2ee0 2024-04-17T19:47:22.907 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.909+0000 7f129a000640 1 -- 172.21.15.44:0/705209937 >> v2:172.21.15.44:3300/0 conn(0x7f129c06f650 msgr2=0x7f129c06fa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T19:47:22.907 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.909+0000 7f129a000640 1 --2- 172.21.15.44:0/705209937 >> v2:172.21.15.44:3300/0 conn(0x7f129c06f650 0x7f129c06fa60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:22.907 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.909+0000 7f129a000640 1 -- 172.21.15.44:0/705209937 >> v1:172.21.15.62:6789/0 conn(0x7f129c0703b0 legacy=0x7f129c0c8d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:22.907 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.909+0000 7f129a000640 1 -- 172.21.15.44:0/705209937 --> v1:172.21.15.44:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f129c06c550 con 0x7f129c0c2ee0 2024-04-17T19:47:22.908 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.909+0000 7f129a000640 1 -- 172.21.15.44:0/705209937 <== mon.0 v1:172.21.15.44:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1863569991 0 0) 0x7f128c001a00 con 0x7f129c0c2ee0 2024-04-17T19:47:22.908 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.909+0000 7f129a000640 1 -- 172.21.15.44:0/705209937 >> v1:172.21.15.44:6789/0 conn(0x7f129c0c2ee0 legacy=0x7f129c159db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:22.908 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.909+0000 7f129a000640 1 --2- 172.21.15.44:0/705209937 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f1280003b50 0x7f1280003fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:22.908 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.909+0000 7f129a000640 1 --2- 172.21.15.44:0/705209937 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1280004810 0x7f1280004c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:22.908 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.909+0000 7f129a000640 1 --2- 172.21.15.44:0/705209937 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1280005270 0x7f128000b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:22.908 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.909+0000 7f3631e00640 1 --2- 172.21.15.44:0/4073667765 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3634070400 0x7f3634146150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:22.908 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.909+0000 7f3632800640 1 --2- 172.21.15.44:0/4073667765 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3634151c30 0x7f36341f41c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:22.908 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.909+0000 7f9006a00640 1 -- 172.21.15.44:0/4240141699 >> v1:172.21.15.44:6789/0 conn(0x7f9008152560 legacy=0x7f90080c6790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:22.909 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.909+0000 7f41e7e00640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f41e80703b0 0x7f41e80c8d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:22.909 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.909+0000 7f9006a00640 1 -- 172.21.15.44:0/4240141699 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f90081587c0 con 0x7f90080724d0 2024-04-17T19:47:22.909 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.909+0000 7f41e7e00640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f41e80703b0 0x7f41e80c8d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:42714/0 (socket says 172.21.15.44:42714) 2024-04-17T19:47:22.909 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.909+0000 7f41e7e00640 1 -- 172.21.15.44:0/1144736812 learned_addr learned my addr 172.21.15.44:0/1144736812 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-04-17T19:47:22.910 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.909+0000 7f129b400640 1 --2- 172.21.15.44:0/705209937 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f1280003b50 0x7f1280003fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:22.910 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.905+0000 7fa760e00640 1 -- start start 2024-04-17T19:47:22.910 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.909+0000 7f129aa00640 1 --2- 172.21.15.44:0/705209937 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1280004810 0x7f1280004c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:22.911 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.909+0000 7f0dfbe00640 1 -- 172.21.15.44:0/1761354411 shutdown_connections 2024-04-17T19:47:22.911 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.909+0000 7f129a000640 1 -- 172.21.15.44:0/705209937 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f128000c1a0 con 0x7f1280004810 2024-04-17T19:47:22.911 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.909+0000 7f129a000640 1 -- 172.21.15.44:0/705209937 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f128000c350 con 0x7f1280005270 2024-04-17T19:47:22.911 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.909+0000 7f129be00640 1 --2- 172.21.15.44:0/705209937 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1280005270 0x7f128000b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:22.911 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.909+0000 7fa760e00640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fa75c15b8a0 0x7fa75c15bcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:22.912 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.909+0000 7f3631400640 1 -- 172.21.15.44:0/4073667765 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3634151c30 msgr2=0x7f36341f41c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:22.912 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.909+0000 7f3631400640 1 --2- 172.21.15.44:0/4073667765 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3634151c30 0x7f36341f41c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:22.912 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.909+0000 7f3631400640 1 -- 172.21.15.44:0/4073667765 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3634070400 msgr2=0x7f3634146150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:22.912 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.909+0000 7f3631400640 1 --2- 172.21.15.44:0/4073667765 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3634070400 0x7f3634146150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:22.912 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.909+0000 7f3631400640 1 -- 172.21.15.44:0/4073667765 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f36341446f0 con 0x7f36340724d0 2024-04-17T19:47:22.912 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.909+0000 7fac49a00640 1 Processor -- start 2024-04-17T19:47:22.913 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.909+0000 7fa760e00640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fa75c160660 0x7fa75c162a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:22.913 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.909+0000 7fa760e00640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa75c1413c0 con 0x7fa75c06d190 2024-04-17T19:47:22.913 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.909+0000 7fa760e00640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 -- 0x7fa75c158c80 con 0x7fa75c160660 2024-04-17T19:47:22.913 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.909+0000 7fa760e00640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7fa75c15c1f0 con 0x7fa75c15b8a0 2024-04-17T19:47:22.913 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.909+0000 7f3631400640 1 --2- 172.21.15.44:0/4073667765 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f36340724d0 0x7f3634146690 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f362000c410 tx=0x7f362000c8d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:47:22.914 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.909+0000 7f129a000640 1 -- 172.21.15.44:0/705209937 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7f128000c550 con 0x7f1280003b50 2024-04-17T19:47:22.914 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.909+0000 7fa75aa00640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fa75c15b8a0 0x7fa75c15bcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:22.914 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.909+0000 7fa75aa00640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fa75c15b8a0 0x7fa75c15bcb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3301/0 says I am v2:172.21.15.44:43280/0 (socket says 172.21.15.44:43280) 2024-04-17T19:47:22.914 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.909+0000 7fa75aa00640 1 -- 172.21.15.44:0/2988691244 learned_addr learned my addr 172.21.15.44:0/2988691244 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-04-17T19:47:22.914 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.909+0000 7fac49a00640 1 -- start start 2024-04-17T19:47:22.915 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.909+0000 7f41e7e00640 1 -- 172.21.15.44:0/1144736812 >> v1:172.21.15.62:6789/0 conn(0x7f41e80c2ee0 legacy=0x7f41e8159db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:22.915 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.909+0000 7f41e7e00640 1 -- 172.21.15.44:0/1144736812 >> v1:172.21.15.44:6789/0 conn(0x7f41e80c92a0 legacy=0x7f41e806f650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:22.915 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.909+0000 7fa75a000640 1 -- 172.21.15.44:0/2988691244 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 773978751 0 0) 0x7fa7540014a0 con 0x7fa75c06d190 2024-04-17T19:47:22.915 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.909+0000 7fa75a000640 1 -- 172.21.15.44:0/2988691244 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa740007940 con 0x7fa75c06d190 2024-04-17T19:47:22.915 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.909+0000 7fa75aa00640 1 -- 172.21.15.44:0/2988691244 >> v2:172.21.15.62:3300/0 conn(0x7fa75c160660 msgr2=0x7fa75c162a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T19:47:22.915 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.909+0000 7fa75be00640 1 --2- 172.21.15.44:0/2988691244 >> v2:172.21.15.62:3300/0 conn(0x7fa75c160660 0x7fa75c162a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:22.916 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.909+0000 7f41e7e00640 1 -- 172.21.15.44:0/1144736812 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f41e806c550 con 0x7f41e80703b0 2024-04-17T19:47:22.916 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.909+0000 7f362a000640 1 -- 172.21.15.44:0/4073667765 <== mon.2 v2:172.21.15.62:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3620017070 con 0x7f36340724d0 2024-04-17T19:47:22.916 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.909+0000 7f362a000640 1 -- 172.21.15.44:0/4073667765 <== mon.2 v2:172.21.15.62:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3620005cf0 con 0x7f36340724d0 2024-04-17T19:47:22.916 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.909+0000 7f362a000640 1 -- 172.21.15.44:0/4073667765 <== mon.2 v2:172.21.15.62:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36200072d0 con 0x7f36340724d0 2024-04-17T19:47:22.916 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.909+0000 7f3633200640 1 -- 172.21.15.44:0/4073667765 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3634156a00 con 0x7f36340724d0 2024-04-17T19:47:22.916 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.913+0000 7f3633200640 1 -- 172.21.15.44:0/4073667765 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f36341574e0 con 0x7f36340724d0 2024-04-17T19:47:22.917 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.909+0000 7f748be00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f748c06fec0 0x7f748c1f9830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:22.917 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.913+0000 7f748aa00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f748c06fec0 0x7f748c1f9830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:22.917 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.913+0000 7f748aa00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f748c06fec0 0x7f748c1f9830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:42730/0 (socket says 172.21.15.44:42730) 2024-04-17T19:47:22.917 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.913+0000 7f748aa00640 1 -- 172.21.15.44:0/1679491311 learned_addr learned my addr 172.21.15.44:0/1679491311 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-04-17T19:47:22.917 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.913+0000 7fac49a00640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fac28005160 0x7fac3c1893c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:22.917 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.913+0000 7fac49a00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fac3c185940 0x7fac3c0da6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:22.918 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.909+0000 7fa75aa00640 1 --2- 172.21.15.44:0/2988691244 >> v2:172.21.15.62:3300/0 conn(0x7fa75c160660 0x7fa75c162a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:22.918 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.909+0000 7fa75aa00640 1 -- 172.21.15.44:0/2988691244 >> v1:172.21.15.44:6789/0 conn(0x7fa75c06d190 legacy=0x7fa75c072d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:22.918 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.909+0000 7fa75aa00640 1 -- 172.21.15.44:0/2988691244 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa75c158100 con 0x7fa75c15b8a0 2024-04-17T19:47:22.918 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.913+0000 7fa75be00640 1 --2- 172.21.15.44:0/2988691244 >> v2:172.21.15.62:3300/0 conn(0x7fa75c160660 0x7fa75c162a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-17T19:47:22.918 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.913+0000 7fac49a00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fac3c17f0e0 0x7fac3c17f4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:22.918 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.913+0000 7fac49a00640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fac3c0341b0 con 0x7fac3c17f0e0 2024-04-17T19:47:22.918 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.913+0000 7fac49a00640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7fac3c046020 con 0x7fac3c185940 2024-04-17T19:47:22.919 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.913+0000 7f748be00640 1 --2- 172.21.15.44:0/1679491311 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f748c0c8cf0 0x7f748c1463b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:22.919 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.913+0000 7fac49a00640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7fac3c034490 con 0x7fac28005160 2024-04-17T19:47:22.919 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.909+0000 7f129be00640 1 -- 172.21.15.44:0/705209937 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f1280003b50 msgr2=0x7f1280003fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T19:47:22.919 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.909+0000 7f129be00640 1 --2- 172.21.15.44:0/705209937 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f1280003b50 0x7f1280003fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:22.919 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.909+0000 7f129be00640 1 -- 172.21.15.44:0/705209937 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1280004810 msgr2=0x7f1280004c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T19:47:22.919 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.909+0000 7f129be00640 1 --2- 172.21.15.44:0/705209937 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1280004810 0x7f1280004c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:22.919 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.909+0000 7f129be00640 1 -- 172.21.15.44:0/705209937 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f129c06c550 con 0x7f1280005270 2024-04-17T19:47:22.920 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.913+0000 7f129b400640 1 --2- 172.21.15.44:0/705209937 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f1280003b50 0x7f1280003fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-17T19:47:22.920 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.913+0000 7f748be00640 1 --2- 172.21.15.44:0/1679491311 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f748c157f30 0x7f748c144010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:22.920 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.913+0000 7fac42000640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fac3c185940 0x7fac3c0da6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:22.920 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.913+0000 7fac42000640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fac3c185940 0x7fac3c0da6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.44:49202/0 (socket says 172.21.15.44:49202) 2024-04-17T19:47:22.920 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.913+0000 7fac42000640 1 -- 172.21.15.44:0/1014984244 learned_addr learned my addr 172.21.15.44:0/1014984244 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-04-17T19:47:22.921 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.913+0000 7f361f400640 1 -- 172.21.15.44:0/4073667765 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f360c001040 con 0x7f36340724d0 2024-04-17T19:47:22.921 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.913+0000 7f748a000640 1 --2- 172.21.15.44:0/1679491311 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f748c0c8cf0 0x7f748c1463b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:22.921 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.913+0000 7f748be00640 1 -- 172.21.15.44:0/1679491311 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f748c0c3e60 con 0x7f748c06fec0 2024-04-17T19:47:22.921 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.913+0000 7f748b400640 1 --2- 172.21.15.44:0/1679491311 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f748c157f30 0x7f748c144010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:22.921 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.913+0000 7f748be00640 1 -- 172.21.15.44:0/1679491311 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f748c151fa0 con 0x7f748c157f30 2024-04-17T19:47:22.921 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.913+0000 7f748be00640 1 -- 172.21.15.44:0/1679491311 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7f748c1fa180 con 0x7f748c0c8cf0 2024-04-17T19:47:22.922 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.913+0000 7fac43400640 1 --2- 172.21.15.44:0/1014984244 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fac3c17f0e0 0x7fac3c17f4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:22.922 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.913+0000 7fac42000640 1 -- 172.21.15.44:0/1014984244 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fac28005160 msgr2=0x7fac3c1893c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:22.922 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.913+0000 7fac42000640 1 --2- 172.21.15.44:0/1014984244 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fac28005160 0x7fac3c1893c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:22.922 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.913+0000 7fac42000640 1 -- 172.21.15.44:0/1014984244 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fac3c17f0e0 msgr2=0x7fac3c17f4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:22.922 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.913+0000 7f0dfbe00640 1 -- 172.21.15.44:0/1761354411 wait complete. 2024-04-17T19:47:22.923 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.913+0000 7fac42000640 1 --2- 172.21.15.44:0/1014984244 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fac3c17f0e0 0x7fac3c17f4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:22.923 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.913+0000 7fac42000640 1 -- 172.21.15.44:0/1014984244 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fac3c185440 con 0x7fac3c185940 2024-04-17T19:47:22.923 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.913+0000 7fac43400640 1 --2- 172.21.15.44:0/1014984244 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fac3c17f0e0 0x7fac3c17f4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-17T19:47:22.923 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.913+0000 7fac42000640 1 --2- 172.21.15.44:0/1014984244 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fac3c185940 0x7fac3c0da6c0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fac3400d800 tx=0x7fac3400dcc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:47:22.923 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.913+0000 7f9006a00640 1 --2- 172.21.15.44:0/4240141699 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f90080724d0 0x7f90080728e0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f8ff8009870 tx=0x7f8ff801ed50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=938b02e2c8ab6181 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:47:22.924 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.913+0000 7f748a000640 1 -- 172.21.15.44:0/1679491311 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f748c157f30 msgr2=0x7f748c144010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:22.924 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.913+0000 7f748a000640 1 --2- 172.21.15.44:0/1679491311 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f748c157f30 0x7f748c144010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:22.924 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.913+0000 7f748a000640 1 -- 172.21.15.44:0/1679491311 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f748c06fec0 msgr2=0x7f748c1f9830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:22.924 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.913+0000 7f748a000640 1 --2- 172.21.15.44:0/1679491311 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f748c06fec0 0x7f748c1f9830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:22.924 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.913+0000 7f748a000640 1 -- 172.21.15.44:0/1679491311 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f748c0cabc0 con 0x7f748c0c8cf0 2024-04-17T19:47:22.924 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.913+0000 7f748aa00640 1 --2- 172.21.15.44:0/1679491311 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f748c06fec0 0x7f748c1f9830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-17T19:47:22.925 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.917+0000 7f0dfbe00640 1 Processor -- start 2024-04-17T19:47:22.925 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.917+0000 7f9006000640 1 -- 172.21.15.44:0/4240141699 <== mon.1 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ff80b5070 con 0x7f90080724d0 2024-04-17T19:47:22.925 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.917+0000 7f748a000640 1 --2- 172.21.15.44:0/1679491311 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f748c0c8cf0 0x7f748c1463b0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f748c06c730 tx=0x7f747c01ba50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:47:22.925 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.917+0000 7f0dfbe00640 1 -- start start 2024-04-17T19:47:22.926 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.917+0000 7f9006000640 1 -- 172.21.15.44:0/4240141699 <== mon.1 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8ff80a8a50 con 0x7f90080724d0 2024-04-17T19:47:22.926 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.917+0000 7f9006000640 1 -- 172.21.15.44:0/4240141699 <== mon.1 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ff80a8e20 con 0x7f90080724d0 2024-04-17T19:47:22.926 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.917+0000 7fac3aa00640 1 -- 172.21.15.44:0/1014984244 <== mon.1 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac34018020 con 0x7fac3c185940 2024-04-17T19:47:22.926 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.917+0000 7fac3aa00640 1 -- 172.21.15.44:0/1014984244 <== mon.1 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fac340096c0 con 0x7fac3c185940 2024-04-17T19:47:22.927 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.917+0000 7fac3aa00640 1 -- 172.21.15.44:0/1014984244 <== mon.1 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac34009a90 con 0x7fac3c185940 2024-04-17T19:47:22.927 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.917+0000 7fac49a00640 1 -- 172.21.15.44:0/1014984244 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fac3c0077d0 con 0x7fac3c185940 2024-04-17T19:47:22.927 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.917+0000 7fac49a00640 1 -- 172.21.15.44:0/1014984244 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fac3c006af0 con 0x7fac3c185940 2024-04-17T19:47:22.927 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.917+0000 7fa75aa00640 1 --2- 172.21.15.44:0/2988691244 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fa75c15b8a0 0x7fa75c15bcb0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fa748008120 tx=0x7fa74801c5c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=743ab602241d620b server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:47:22.927 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.917+0000 7f362a000640 1 -- 172.21.15.44:0/4073667765 <== mon.2 v2:172.21.15.62:3301/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f362001a070 con 0x7f36340724d0 2024-04-17T19:47:22.928 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.917+0000 7f7482a00640 1 -- 172.21.15.44:0/1679491311 <== mon.2 v2:172.21.15.62:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f747c0bf070 con 0x7f748c0c8cf0 2024-04-17T19:47:22.928 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.917+0000 7f129be00640 1 -- 172.21.15.44:0/705209937 reap_dead start 2024-04-17T19:47:22.928 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.917+0000 7fa75a000640 1 -- 172.21.15.44:0/2988691244 <== mon.2 v2:172.21.15.62:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa74800b040 con 0x7fa75c15b8a0 2024-04-17T19:47:22.928 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.917+0000 7f900cc00640 1 -- 172.21.15.44:0/4240141699 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f90080724d0 msgr2=0x7f90080728e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:22.928 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.917+0000 7f900cc00640 1 --2- 172.21.15.44:0/4240141699 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f90080724d0 0x7f90080728e0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f8ff8009870 tx=0x7f8ff801ed50 comp rx=0 tx=0).stop 2024-04-17T19:47:22.929 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.917+0000 7f129be00640 1 --2- 172.21.15.44:0/705209937 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1280005270 0x7f128000b9d0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f1294009ae0 tx=0x7f129401cad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=86cf7e5da5a6b55a server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:47:22.929 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.917+0000 7f900cc00640 1 -- 172.21.15.44:0/4240141699 shutdown_connections 2024-04-17T19:47:22.929 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.917+0000 7f900cc00640 1 --2- 172.21.15.44:0/4240141699 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f90080724d0 0x7f90080728e0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:22.929 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.917+0000 7f900cc00640 1 -- 172.21.15.44:0/4240141699 >> 172.21.15.44:0/4240141699 conn(0x7f90080ccf60 msgr2=0x7f900806bd80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:47:22.929 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.917+0000 7fa75a000640 1 -- 172.21.15.44:0/2988691244 <== mon.2 v2:172.21.15.62:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa748004230 con 0x7fa75c15b8a0 2024-04-17T19:47:22.930 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.917+0000 7fa75a000640 1 -- 172.21.15.44:0/2988691244 <== mon.2 v2:172.21.15.62:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa748003620 con 0x7fa75c15b8a0 2024-04-17T19:47:22.930 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.917+0000 7f900cc00640 1 -- 172.21.15.44:0/4240141699 shutdown_connections 2024-04-17T19:47:22.930 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.917+0000 7f41e7e00640 1 --2- 172.21.15.44:0/1144736812 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f41e80703b0 0x7f41e80c8d60 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f41d4009870 tx=0x7f41d401c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b3e915dac792280a server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:47:22.930 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.917+0000 7f362a000640 1 --2- 172.21.15.44:0/4073667765 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f3614068450 0x7f361406a960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:22.931 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.917+0000 7f362a000640 1 -- 172.21.15.44:0/4073667765 <== mon.2 v2:172.21.15.62:3301/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f36200866f0 con 0x7f36340724d0 2024-04-17T19:47:22.931 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.917+0000 7f362a000640 1 --2- 172.21.15.44:0/4073667765 >> [v2:172.21.15.44:6800/1018735925,v1:172.21.15.44:6801/1018735925] conn(0x7f3614071c10 0x7f36140740a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:22.931 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.917+0000 7f362a000640 1 -- 172.21.15.44:0/4073667765 --> [v2:172.21.15.44:6800/1018735925,v1:172.21.15.44:6801/1018735925] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f3614074770 con 0x7f3614071c10 2024-04-17T19:47:22.931 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.917+0000 7f362a000640 1 -- 172.21.15.44:0/4073667765 <== mon.2 v2:172.21.15.62:3301/0 6 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f3620086ae0 con 0x7f36340724d0 2024-04-17T19:47:22.931 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.917+0000 7f3631e00640 1 --2- 172.21.15.44:0/4073667765 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f3614068450 0x7f361406a960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:22.931 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.917+0000 7f3632800640 1 --2- 172.21.15.44:0/4073667765 >> [v2:172.21.15.44:6800/1018735925,v1:172.21.15.44:6801/1018735925] conn(0x7f3614071c10 0x7f36140740a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:22.931 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.917+0000 7f7482a00640 1 -- 172.21.15.44:0/1679491311 <== mon.2 v2:172.21.15.62:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f747c0b0660 con 0x7f748c0c8cf0 2024-04-17T19:47:22.931 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.917+0000 7f7482a00640 1 -- 172.21.15.44:0/1679491311 <== mon.2 v2:172.21.15.62:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f747c0b5040 con 0x7f748c0c8cf0 2024-04-17T19:47:22.931 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.917+0000 7f748be00640 1 -- 172.21.15.44:0/1679491311 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f748c0caea0 con 0x7f748c0c8cf0 2024-04-17T19:47:22.932 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.917+0000 7f0dfbe00640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f0df4036040 0x7f0df40499b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:22.932 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.917+0000 7f900cc00640 1 -- 172.21.15.44:0/4240141699 wait complete. 2024-04-17T19:47:22.932 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.917+0000 7f129a000640 1 -- 172.21.15.44:0/705209937 <== mon.1 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12940096b0 con 0x7f1280005270 2024-04-17T19:47:22.932 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.917+0000 7fa760e00640 1 -- 172.21.15.44:0/2988691244 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fa75c15b8a0 msgr2=0x7fa75c15bcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:22.932 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.917+0000 7fa760e00640 1 --2- 172.21.15.44:0/2988691244 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fa75c15b8a0 0x7fa75c15bcb0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fa748008120 tx=0x7fa74801c5c0 comp rx=0 tx=0).stop 2024-04-17T19:47:22.933 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.917+0000 7fac49a00640 1 -- 172.21.15.44:0/1014984244 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fac1c001040 con 0x7fac3c185940 2024-04-17T19:47:22.933 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.917+0000 7f129a000640 1 -- 172.21.15.44:0/705209937 <== mon.1 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1294004020 con 0x7f1280005270 2024-04-17T19:47:22.933 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.917+0000 7f129a000640 1 -- 172.21.15.44:0/705209937 <== mon.1 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1294004410 con 0x7f1280005270 2024-04-17T19:47:22.933 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.917+0000 7fa760e00640 1 -- 172.21.15.44:0/2988691244 shutdown_connections 2024-04-17T19:47:22.933 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.917+0000 7fa760e00640 1 --2- 172.21.15.44:0/2988691244 >> v2:172.21.15.62:3300/0 conn(0x7fa75c160660 0x7fa75c162a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:22.934 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.917+0000 7fa760e00640 1 --2- 172.21.15.44:0/2988691244 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fa75c15b8a0 0x7fa75c15bcb0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:22.934 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.917+0000 7fa760e00640 1 -- 172.21.15.44:0/2988691244 >> 172.21.15.44:0/2988691244 conn(0x7fa75c0cdec0 msgr2=0x7fa75c0c9e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:47:22.934 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.917+0000 7f0dfaa00640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f0df4036040 0x7f0df40499b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:22.934 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.917+0000 7f0dfaa00640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f0df4036040 0x7f0df40499b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3301/0 says I am v2:172.21.15.44:43306/0 (socket says 172.21.15.44:43306) 2024-04-17T19:47:22.934 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.917+0000 7f0dfbe00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0df4045360 0x7f0df40cb4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:22.934 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.917+0000 7f0dfaa00640 1 -- 172.21.15.44:0/3580380850 learned_addr learned my addr 172.21.15.44:0/3580380850 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-04-17T19:47:22.934 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.921+0000 7f0dfbe00640 1 --2- 172.21.15.44:0/3580380850 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0df40465b0 0x7f0df40d9810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:22.934 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.921+0000 7f0dfbe00640 1 -- 172.21.15.44:0/3580380850 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f0df40469c0 con 0x7f0df40465b0 2024-04-17T19:47:22.934 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.921+0000 7f0dfbe00640 1 -- 172.21.15.44:0/3580380850 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f0df40dc460 con 0x7f0df4045360 2024-04-17T19:47:22.934 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.921+0000 7f0dfbe00640 1 -- 172.21.15.44:0/3580380850 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7f0df4007090 con 0x7f0df4036040 2024-04-17T19:47:22.935 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.917+0000 7f41e7400640 1 -- 172.21.15.44:0/1144736812 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41d40b0070 con 0x7f41e80703b0 2024-04-17T19:47:22.935 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.917+0000 7fa760e00640 1 -- 172.21.15.44:0/2988691244 shutdown_connections 2024-04-17T19:47:22.935 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.921+0000 7f0dfa000640 1 --2- 172.21.15.44:0/3580380850 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0df4045360 0x7f0df40cb4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:22.935 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.921+0000 7f748be00640 1 -- 172.21.15.44:0/1679491311 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f748c1414a0 con 0x7f748c0c8cf0 2024-04-17T19:47:22.936 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.921+0000 7f0dfb400640 1 --2- 172.21.15.44:0/3580380850 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0df40465b0 0x7f0df40d9810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:22.936 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.921+0000 7f12a2600640 1 -- 172.21.15.44:0/705209937 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1280005270 msgr2=0x7f128000b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:22.936 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.921+0000 7f12a2600640 1 --2- 172.21.15.44:0/705209937 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1280005270 0x7f128000b9d0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f1294009ae0 tx=0x7f129401cad0 comp rx=0 tx=0).stop 2024-04-17T19:47:22.936 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.921+0000 7fa760e00640 1 -- 172.21.15.44:0/2988691244 wait complete. 2024-04-17T19:47:22.937 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.921+0000 7f0dfa000640 1 -- 172.21.15.44:0/3580380850 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f0df4036040 msgr2=0x7f0df40499b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:22.937 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.921+0000 7f0dfa000640 1 --2- 172.21.15.44:0/3580380850 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f0df4036040 0x7f0df40499b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:22.937 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.921+0000 7f0dfa000640 1 -- 172.21.15.44:0/3580380850 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0df40465b0 msgr2=0x7f0df40d9810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:22.937 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.921+0000 7f0dfa000640 1 --2- 172.21.15.44:0/3580380850 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0df40465b0 0x7f0df40d9810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:22.937 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.921+0000 7f7477e00640 1 -- 172.21.15.44:0/1679491311 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f7460001040 con 0x7f748c0c8cf0 2024-04-17T19:47:22.937 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.921+0000 7f0dfa000640 1 -- 172.21.15.44:0/3580380850 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0df40da650 con 0x7f0df4045360 2024-04-17T19:47:22.938 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.921+0000 7f12a2600640 1 -- 172.21.15.44:0/705209937 shutdown_connections 2024-04-17T19:47:22.938 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.921+0000 7f3632800640 1 --2- 172.21.15.44:0/4073667765 >> [v2:172.21.15.44:6800/1018735925,v1:172.21.15.44:6801/1018735925] conn(0x7f3614071c10 0x7f36140740a0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:47:22.938 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.921+0000 7f362a000640 1 -- 172.21.15.44:0/4073667765 <== osd.0 v2:172.21.15.44:6800/1018735925 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f3614074770 con 0x7f3614071c10 2024-04-17T19:47:22.938 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.921+0000 7f3631e00640 1 --2- 172.21.15.44:0/4073667765 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f3614068450 0x7f361406a960 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f3624006fd0 tx=0x7f3624008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:47:22.938 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.921+0000 7f0dfa000640 1 --2- 172.21.15.44:0/3580380850 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0df4045360 0x7f0df40cb4f0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f0de80b4000 tx=0x7f0de800b3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:47:22.939 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.921+0000 7f12a2600640 1 --2- 172.21.15.44:0/705209937 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1280005270 0x7f128000b9d0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:22.939 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.921+0000 7f12a2600640 1 -- 172.21.15.44:0/705209937 >> 172.21.15.44:0/705209937 conn(0x7f129c06ce90 msgr2=0x7f129c06d2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:47:22.939 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.921+0000 7f41e7400640 1 -- 172.21.15.44:0/1144736812 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f41d40ab600 con 0x7f41e80703b0 2024-04-17T19:47:22.939 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.921+0000 7f41e7400640 1 -- 172.21.15.44:0/1144736812 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41d40ab9d0 con 0x7f41e80703b0 2024-04-17T19:47:22.940 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.921+0000 7f0df2a00640 1 -- 172.21.15.44:0/3580380850 <== mon.1 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0de80c5070 con 0x7f0df4045360 2024-04-17T19:47:22.940 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.921+0000 7f900cc00640 1 Processor -- start 2024-04-17T19:47:22.940 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.921+0000 7f0dfbe00640 1 -- 172.21.15.44:0/3580380850 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0df4049ef0 con 0x7f0df4045360 2024-04-17T19:47:22.940 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.921+0000 7f0dfbe00640 1 -- 172.21.15.44:0/3580380850 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0df40cc880 con 0x7f0df4045360 2024-04-17T19:47:22.940 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.921+0000 7f0df2a00640 1 -- 172.21.15.44:0/3580380850 <== mon.1 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0de80bb040 con 0x7f0df4045360 2024-04-17T19:47:22.941 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.921+0000 7f0df2a00640 1 -- 172.21.15.44:0/3580380850 <== mon.1 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0de80c5070 con 0x7f0df4045360 2024-04-17T19:47:22.941 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.921+0000 7f12a2600640 1 -- 172.21.15.44:0/705209937 shutdown_connections 2024-04-17T19:47:22.941 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.921+0000 7fac3aa00640 1 -- 172.21.15.44:0/1014984244 <== mon.1 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fac3401b020 con 0x7fac3c185940 2024-04-17T19:47:22.941 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.925+0000 7fac3aa00640 1 --2- 172.21.15.44:0/1014984244 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7fac24068400 0x7fac2406a910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:22.941 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.921+0000 7f41ef800640 1 -- 172.21.15.44:0/1144736812 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f41e80703b0 msgr2=0x7f41e80c8d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:22.942 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.921+0000 7f41ef800640 1 --2- 172.21.15.44:0/1144736812 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f41e80703b0 0x7f41e80c8d60 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f41d4009870 tx=0x7f41d401c4d0 comp rx=0 tx=0).stop 2024-04-17T19:47:22.942 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.925+0000 7fa760e00640 1 Processor -- start 2024-04-17T19:47:22.942 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.925+0000 7f12a2600640 1 -- 172.21.15.44:0/705209937 wait complete. 2024-04-17T19:47:22.942 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.925+0000 7f7482a00640 1 -- 172.21.15.44:0/1679491311 <== mon.2 v2:172.21.15.62:3301/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f747c0c2070 con 0x7f748c0c8cf0 2024-04-17T19:47:22.943 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.925+0000 7f0dfbe00640 1 -- 172.21.15.44:0/3580380850 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f0dd4001040 con 0x7f0df4045360 2024-04-17T19:47:22.943 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.925+0000 7fac42a00640 1 --2- 172.21.15.44:0/1014984244 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7fac24068400 0x7fac2406a910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:22.943 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.921+0000 7f900cc00640 1 -- start start 2024-04-17T19:47:22.943 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.925+0000 7f900cc00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f90080724d0 0x7f9008152df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:22.943 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.925+0000 7f900cc00640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f90080731c0 0x7f90080ca930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:22.944 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.925+0000 7f900cc00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9008152560 0x7f90081547e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:22.944 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.925+0000 7f900cc00640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f9008158d80 con 0x7f90080724d0 2024-04-17T19:47:22.944 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.925+0000 7f900cc00640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f90080c6ea0 con 0x7f9008152560 2024-04-17T19:47:22.944 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.925+0000 7f900cc00640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7f9008152970 con 0x7f90080731c0 2024-04-17T19:47:22.944 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.925+0000 7fac42a00640 1 --2- 172.21.15.44:0/1014984244 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7fac24068400 0x7fac2406a910 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fac4406b6b0 tx=0x7fac44074650 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:47:22.944 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.925+0000 7fac3aa00640 1 -- 172.21.15.44:0/1014984244 <== mon.1 v2:172.21.15.62:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fac34054e40 con 0x7fac3c185940 2024-04-17T19:47:22.944 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.925+0000 7fac3aa00640 1 --2- 172.21.15.44:0/1014984244 >> [v2:172.21.15.44:6816/1160071918,v1:172.21.15.44:6818/1160071918] conn(0x7fac24072740 0x7fac24074c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:22.944 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.925+0000 7f7482a00640 1 --2- 172.21.15.44:0/1679491311 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f746c068450 0x7f746c06a960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:22.945 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.925+0000 7fac3aa00640 1 -- 172.21.15.44:0/1014984244 --> [v2:172.21.15.44:6816/1160071918,v1:172.21.15.44:6818/1160071918] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fac24075300 con 0x7fac24072740 2024-04-17T19:47:22.945 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.925+0000 7fac3aa00640 1 -- 172.21.15.44:0/1014984244 <== mon.1 v2:172.21.15.62:3300/0 6 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fac340537d0 con 0x7fac3c185940 2024-04-17T19:47:22.945 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.925+0000 7f9006a00640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f90080731c0 0x7f90080ca930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:22.945 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.925+0000 7f748aa00640 1 --2- 172.21.15.44:0/1679491311 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f746c068450 0x7f746c06a960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:22.946 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.925+0000 7f9006a00640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f90080731c0 0x7f90080ca930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3301/0 says I am v2:172.21.15.44:43314/0 (socket says 172.21.15.44:43314) 2024-04-17T19:47:22.946 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.925+0000 7f9007400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f90080724d0 0x7f9008152df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:22.946 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.925+0000 7fa760e00640 1 -- start start 2024-04-17T19:47:22.946 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.925+0000 7fa760e00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa75c06d190 0x7fa75c162000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:22.946 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.925+0000 7fa760e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa75c15b8a0 0x7fa75c1564a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:22.946 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.925+0000 7fa760e00640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fa75c160660 0x7fa75c150be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:22.947 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.925+0000 7fa760e00640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fa75c157d50 con 0x7fa75c15b8a0 2024-04-17T19:47:22.947 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.925+0000 7f9007400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f90080724d0 0x7f9008152df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:42758/0 (socket says 172.21.15.44:42758) 2024-04-17T19:47:22.947 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.925+0000 7fa760e00640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7fa75c15b380 con 0x7fa75c06d190 2024-04-17T19:47:22.947 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.925+0000 7fa760e00640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7fa75c0cb9a0 con 0x7fa75c160660 2024-04-17T19:47:22.948 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.925+0000 7f9007e00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9008152560 0x7f90081547e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:22.948 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.925+0000 7f9007400640 1 -- 172.21.15.44:0/2917731553 learned_addr learned my addr 172.21.15.44:0/2917731553 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-04-17T19:47:22.948 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.925+0000 7f12a2600640 1 Processor -- start 2024-04-17T19:47:22.948 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.925+0000 7fac43400640 1 --2- 172.21.15.44:0/1014984244 >> [v2:172.21.15.44:6816/1160071918,v1:172.21.15.44:6818/1160071918] conn(0x7fac24072740 0x7fac24074c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:22.948 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.925+0000 7f41ef800640 1 -- 172.21.15.44:0/1144736812 shutdown_connections 2024-04-17T19:47:22.948 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.925+0000 7f41ef800640 1 --2- 172.21.15.44:0/1144736812 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f41e80703b0 0x7f41e80c8d60 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:22.949 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.925+0000 7f41ef800640 1 -- 172.21.15.44:0/1144736812 >> 172.21.15.44:0/1144736812 conn(0x7f41e806ce90 msgr2=0x7f41e806d2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:47:22.949 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.929+0000 7f12a2600640 1 -- start start 2024-04-17T19:47:22.949 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.929+0000 7fa75b400640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa75c06d190 0x7fa75c162000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:22.949 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.929+0000 7fa75b400640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa75c06d190 0x7fa75c162000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.44:49216/0 (socket says 172.21.15.44:49216) 2024-04-17T19:47:22.949 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.929+0000 7fa75b400640 1 -- 172.21.15.44:0/208904426 learned_addr learned my addr 172.21.15.44:0/208904426 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-04-17T19:47:22.949 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.929+0000 7f7482a00640 1 -- 172.21.15.44:0/1679491311 <== mon.2 v2:172.21.15.62:3301/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f747c123680 con 0x7f748c0c8cf0 2024-04-17T19:47:22.950 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.929+0000 7f748aa00640 1 --2- 172.21.15.44:0/1679491311 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f746c068450 0x7f746c06a960 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f7484007690 tx=0x7f748400b8f0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:47:22.950 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.929+0000 7f9007400640 1 -- 172.21.15.44:0/2917731553 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f90080731c0 msgr2=0x7f90080ca930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:22.950 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.929+0000 7f9007400640 1 --2- 172.21.15.44:0/2917731553 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f90080731c0 0x7f90080ca930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:22.950 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.929+0000 7f9007400640 1 -- 172.21.15.44:0/2917731553 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9008152560 msgr2=0x7f90081547e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:22.950 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.929+0000 7f9007400640 1 --2- 172.21.15.44:0/2917731553 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9008152560 0x7f90081547e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:22.950 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.929+0000 7f9007400640 1 -- 172.21.15.44:0/2917731553 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f900815c970 con 0x7f90080724d0 2024-04-17T19:47:22.950 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.929+0000 7fa75aa00640 1 --2- 172.21.15.44:0/208904426 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa75c15b8a0 0x7fa75c1564a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:22.951 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.929+0000 7fac43400640 1 --2- 172.21.15.44:0/1014984244 >> [v2:172.21.15.44:6816/1160071918,v1:172.21.15.44:6818/1160071918] conn(0x7fac24072740 0x7fac24074c30 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:47:22.951 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.929+0000 7fa75b400640 1 -- 172.21.15.44:0/208904426 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fa75c160660 msgr2=0x7fa75c150be0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-04-17T19:47:22.951 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.929+0000 7fa75b400640 1 --2- 172.21.15.44:0/208904426 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fa75c160660 0x7fa75c150be0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:22.951 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.929+0000 7fa75b400640 1 -- 172.21.15.44:0/208904426 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa75c15b8a0 msgr2=0x7fa75c1564a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:22.951 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.929+0000 7fa75b400640 1 --2- 172.21.15.44:0/208904426 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa75c15b8a0 0x7fa75c1564a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:22.951 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.929+0000 7fa75b400640 1 -- 172.21.15.44:0/208904426 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa75c162540 con 0x7fa75c06d190 2024-04-17T19:47:22.951 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.929+0000 7fa75aa00640 1 --2- 172.21.15.44:0/208904426 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa75c15b8a0 0x7fa75c1564a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-17T19:47:22.952 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.929+0000 7f9007400640 1 --2- 172.21.15.44:0/2917731553 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f90080724d0 0x7f9008152df0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f8ff000c3c0 tx=0x7f8ff000c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:47:22.952 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.929+0000 7f41ef800640 1 -- 172.21.15.44:0/1144736812 shutdown_connections 2024-04-17T19:47:22.952 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.929+0000 7f0df2a00640 1 -- 172.21.15.44:0/3580380850 <== mon.1 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f0de80adcc0 con 0x7f0df4045360 2024-04-17T19:47:22.952 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.929+0000 7fa75b400640 1 --2- 172.21.15.44:0/208904426 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa75c06d190 0x7fa75c162000 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fa75400c7a0 tx=0x7fa75400cc60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:47:22.952 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.929+0000 7fa753400640 1 -- 172.21.15.44:0/208904426 <== mon.1 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa754016020 con 0x7fa75c06d190 2024-04-17T19:47:22.953 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.929+0000 7f12a2600640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f1280005270 0x7f129c0c62a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:22.953 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.929+0000 7fa753400640 1 -- 172.21.15.44:0/208904426 <== mon.1 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa75400aa10 con 0x7fa75c06d190 2024-04-17T19:47:22.953 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.929+0000 7fa753400640 1 -- 172.21.15.44:0/208904426 <== mon.1 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa75400ae00 con 0x7fa75c06d190 2024-04-17T19:47:22.954 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.929+0000 7f12a2600640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f129c15dc50 0x7f129c1546b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:22.954 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.929+0000 7f129b400640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f1280005270 0x7f129c0c62a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:22.954 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.929+0000 7f129b400640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f1280005270 0x7f129c0c62a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3301/0 says I am v2:172.21.15.44:43344/0 (socket says 172.21.15.44:43344) 2024-04-17T19:47:22.954 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.929+0000 7f7482a00640 1 --2- 172.21.15.44:0/1679491311 >> [v2:172.21.15.44:6817/1452577434,v1:172.21.15.44:6820/1452577434] conn(0x7f746c071c10 0x7f746c0740a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:22.954 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.929+0000 7f7482a00640 1 -- 172.21.15.44:0/1679491311 --> [v2:172.21.15.44:6817/1452577434,v1:172.21.15.44:6820/1452577434] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f747c0c1e50 con 0x7f746c071c10 2024-04-17T19:47:22.954 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.929+0000 7f7482a00640 1 -- 172.21.15.44:0/1679491311 <== mon.2 v2:172.21.15.62:3301/0 6 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f747c123a70 con 0x7f748c0c8cf0 2024-04-17T19:47:22.955 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.929+0000 7f129b400640 1 -- 172.21.15.44:0/2326905000 learned_addr learned my addr 172.21.15.44:0/2326905000 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-04-17T19:47:22.955 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.929+0000 7f12a2600640 1 --2- 172.21.15.44:0/2326905000 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f129c0cce50 0x7f129c155480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:22.955 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.929+0000 7f129aa00640 1 --2- 172.21.15.44:0/2326905000 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f129c15dc50 0x7f129c1546b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:22.955 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.929+0000 7fac3aa00640 1 -- 172.21.15.44:0/1014984244 <== osd.2 v2:172.21.15.44:6816/1160071918 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fac24075300 con 0x7fac24072740 2024-04-17T19:47:22.956 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.929+0000 7f12a2600640 1 -- 172.21.15.44:0/2326905000 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f129c06fdf0 con 0x7f129c0cce50 2024-04-17T19:47:22.956 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.929+0000 7f12a2600640 1 -- 172.21.15.44:0/2326905000 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f129c06fc70 con 0x7f129c15dc50 2024-04-17T19:47:22.956 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.929+0000 7f12a2600640 1 -- 172.21.15.44:0/2326905000 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7f129c0c9d20 con 0x7f1280005270 2024-04-17T19:47:22.956 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.933+0000 7f129be00640 1 --2- 172.21.15.44:0/2326905000 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f129c0cce50 0x7f129c155480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:22.956 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.933+0000 7f129aa00640 1 -- 172.21.15.44:0/2326905000 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f1280005270 msgr2=0x7f129c0c62a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:22.956 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.933+0000 7f129aa00640 1 --2- 172.21.15.44:0/2326905000 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f1280005270 0x7f129c0c62a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:22.956 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.933+0000 7f129aa00640 1 -- 172.21.15.44:0/2326905000 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f129c0cce50 msgr2=0x7f129c155480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:22.956 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.933+0000 7f129aa00640 1 --2- 172.21.15.44:0/2326905000 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f129c0cce50 0x7f129c155480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:22.956 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.933+0000 7f129aa00640 1 -- 172.21.15.44:0/2326905000 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f129c154bf0 con 0x7f129c15dc50 2024-04-17T19:47:22.957 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.933+0000 7f129be00640 1 --2- 172.21.15.44:0/2326905000 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f129c0cce50 0x7f129c155480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-17T19:47:22.957 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.929+0000 7f0df2a00640 1 --2- 172.21.15.44:0/3580380850 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f0ddc068580 0x7f0ddc06aa90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:22.957 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.929+0000 7f0df2a00640 1 -- 172.21.15.44:0/3580380850 <== mon.1 v2:172.21.15.62:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f0de8128f60 con 0x7f0df4045360 2024-04-17T19:47:22.957 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.933+0000 7f0df2a00640 1 --2- 172.21.15.44:0/3580380850 >> [v2:172.21.15.44:6808/4236454921,v1:172.21.15.44:6809/4236454921] conn(0x7f0ddc071c40 0x7f0ddc0740d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:22.957 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.929+0000 7f41ef800640 1 -- 172.21.15.44:0/1144736812 wait complete. 2024-04-17T19:47:22.958 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.933+0000 7f0df2a00640 1 -- 172.21.15.44:0/3580380850 --> [v2:172.21.15.44:6808/4236454921,v1:172.21.15.44:6809/4236454921] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f0de800ae80 con 0x7f0ddc071c40 2024-04-17T19:47:22.958 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.933+0000 7f0df2a00640 1 -- 172.21.15.44:0/3580380850 <== mon.1 v2:172.21.15.62:3300/0 6 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f0de80f4c60 con 0x7f0df4045360 2024-04-17T19:47:22.958 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.933+0000 7f0dfb400640 1 --2- 172.21.15.44:0/3580380850 >> [v2:172.21.15.44:6808/4236454921,v1:172.21.15.44:6809/4236454921] conn(0x7f0ddc071c40 0x7f0ddc0740d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:22.958 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.933+0000 7f8fff400640 1 -- 172.21.15.44:0/2917731553 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ff0017070 con 0x7f90080724d0 2024-04-17T19:47:22.958 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.933+0000 7f8fff400640 1 -- 172.21.15.44:0/2917731553 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8ff00052d0 con 0x7f90080724d0 2024-04-17T19:47:22.958 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.933+0000 7f8fff400640 1 -- 172.21.15.44:0/2917731553 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ff0003840 con 0x7f90080724d0 2024-04-17T19:47:22.958 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.933+0000 7f129aa00640 1 --2- 172.21.15.44:0/2326905000 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f129c15dc50 0x7f129c1546b0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f128800e550 tx=0x7f128800ea10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:47:22.959 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.933+0000 7f900cc00640 1 -- 172.21.15.44:0/2917731553 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9008153b90 con 0x7f90080724d0 2024-04-17T19:47:22.959 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.933+0000 7f900cc00640 1 -- 172.21.15.44:0/2917731553 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f90080c85e0 con 0x7f90080724d0 2024-04-17T19:47:22.959 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.933+0000 7f1293400640 1 -- 172.21.15.44:0/2326905000 <== mon.1 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12880052e0 con 0x7f129c15dc50 2024-04-17T19:47:22.960 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.933+0000 7f0dfaa00640 1 --2- 172.21.15.44:0/3580380850 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f0ddc068580 0x7f0ddc06aa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:22.960 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.933+0000 7f1293400640 1 -- 172.21.15.44:0/2326905000 <== mon.1 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1288018070 con 0x7f129c15dc50 2024-04-17T19:47:22.960 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.933+0000 7f748b400640 1 --2- 172.21.15.44:0/1679491311 >> [v2:172.21.15.44:6817/1452577434,v1:172.21.15.44:6820/1452577434] conn(0x7f746c071c10 0x7f746c0740a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:22.960 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.933+0000 7f41ef800640 1 Processor -- start 2024-04-17T19:47:22.961 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.933+0000 7f1293400640 1 -- 172.21.15.44:0/2326905000 <== mon.1 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1288003840 con 0x7f129c15dc50 2024-04-17T19:47:22.961 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.933+0000 7f12a2600640 1 -- 172.21.15.44:0/2326905000 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f129c0c4d00 con 0x7f129c15dc50 2024-04-17T19:47:22.961 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.933+0000 7f12a2600640 1 -- 172.21.15.44:0/2326905000 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f129c0c4a20 con 0x7f129c15dc50 2024-04-17T19:47:22.961 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.933+0000 7f12a2600640 1 -- 172.21.15.44:0/2326905000 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f1274001040 con 0x7f129c15dc50 2024-04-17T19:47:22.962 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.933+0000 7f41ef800640 1 -- start start 2024-04-17T19:47:22.962 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.933+0000 7fa760e00640 1 -- 172.21.15.44:0/208904426 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa75c161560 con 0x7fa75c06d190 2024-04-17T19:47:22.962 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.933+0000 7fa760e00640 1 -- 172.21.15.44:0/208904426 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa75c161800 con 0x7fa75c06d190 2024-04-17T19:47:22.962 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.933+0000 7f0dfaa00640 1 --2- 172.21.15.44:0/3580380850 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f0ddc068580 0x7f0ddc06aa90 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f0dfc0762e0 tx=0x7f0dfc06e040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:47:22.963 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.937+0000 7f900cc00640 1 -- 172.21.15.44:0/2917731553 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f9008154070 con 0x7f90080724d0 2024-04-17T19:47:22.963 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.937+0000 7fa760e00640 1 -- 172.21.15.44:0/208904426 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fa75c152d10 con 0x7fa75c06d190 2024-04-17T19:47:22.963 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.937+0000 7f0dfb400640 1 --2- 172.21.15.44:0/3580380850 >> [v2:172.21.15.44:6808/4236454921,v1:172.21.15.44:6809/4236454921] conn(0x7f0ddc071c40 0x7f0ddc0740d0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:47:22.964 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.937+0000 7f41ef800640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f41e80703b0 0x7f41e80ccc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:22.964 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.937+0000 7f41ef800640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f41e80c2ee0 0x7f41e80cd1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:22.964 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.937+0000 7f41ef800640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f41e80c92a0 0x7f41e80c65c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:22.964 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.937+0000 7f41ef800640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f41e80ca2e0 con 0x7f41e80c92a0 2024-04-17T19:47:22.964 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.937+0000 7f41ef800640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f41e80c9d20 con 0x7f41e80c2ee0 2024-04-17T19:47:22.964 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.937+0000 7f41ef800640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7f41e80ca770 con 0x7f41e80703b0 2024-04-17T19:47:22.964 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.937+0000 7f41e7e00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f41e80c2ee0 0x7f41e80cd1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:22.964 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.937+0000 7f41e7e00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f41e80c2ee0 0x7f41e80cd1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.44:49222/0 (socket says 172.21.15.44:49222) 2024-04-17T19:47:22.964 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.937+0000 7f41e7e00640 1 -- 172.21.15.44:0/2991357133 learned_addr learned my addr 172.21.15.44:0/2991357133 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-04-17T19:47:22.965 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.937+0000 7f41ece00640 1 --2- 172.21.15.44:0/2991357133 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f41e80703b0 0x7f41e80ccc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:22.965 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.937+0000 7f748b400640 1 --2- 172.21.15.44:0/1679491311 >> [v2:172.21.15.44:6817/1452577434,v1:172.21.15.44:6820/1452577434] conn(0x7f746c071c10 0x7f746c0740a0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:47:22.965 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.937+0000 7f41ed800640 1 --2- 172.21.15.44:0/2991357133 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f41e80c92a0 0x7f41e80c65c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:22.965 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.937+0000 7f8fff400640 1 -- 172.21.15.44:0/2917731553 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f8ff001a070 con 0x7f90080724d0 2024-04-17T19:47:22.966 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.937+0000 7f41ece00640 1 -- 172.21.15.44:0/2991357133 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f41e80c2ee0 msgr2=0x7f41e80cd1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:22.966 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.937+0000 7f41ece00640 1 --2- 172.21.15.44:0/2991357133 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f41e80c2ee0 0x7f41e80cd1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:22.966 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.937+0000 7f41ece00640 1 -- 172.21.15.44:0/2991357133 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f41e80c92a0 msgr2=0x7f41e80c65c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:22.966 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.937+0000 7f41ece00640 1 --2- 172.21.15.44:0/2991357133 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f41e80c92a0 0x7f41e80c65c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:22.966 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.937+0000 7f41ece00640 1 -- 172.21.15.44:0/2991357133 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f41e81f3ed0 con 0x7f41e80703b0 2024-04-17T19:47:22.966 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.937+0000 7f41ed800640 1 --2- 172.21.15.44:0/2991357133 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f41e80c92a0 0x7f41e80c65c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-17T19:47:22.966 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.937+0000 7f41e7e00640 1 --2- 172.21.15.44:0/2991357133 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f41e80c2ee0 0x7f41e80cd1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-17T19:47:22.967 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.937+0000 7f1293400640 1 -- 172.21.15.44:0/2326905000 <== mon.1 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f12880039e0 con 0x7f129c15dc50 2024-04-17T19:47:22.967 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.937+0000 7f41ece00640 1 --2- 172.21.15.44:0/2991357133 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f41e80703b0 0x7f41e80ccc80 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f41dc00c390 tx=0x7f41dc00c850 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:47:22.967 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.937+0000 7f8fff400640 1 --2- 172.21.15.44:0/2917731553 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f8fe4068450 0x7f8fe406a960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:22.967 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.937+0000 7f41e4c00640 1 -- 172.21.15.44:0/2991357133 <== mon.2 v2:172.21.15.62:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41dc005220 con 0x7f41e80703b0 2024-04-17T19:47:22.968 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.937+0000 7f41e4c00640 1 -- 172.21.15.44:0/2991357133 <== mon.2 v2:172.21.15.62:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f41dc0053c0 con 0x7f41e80703b0 2024-04-17T19:47:22.968 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.937+0000 7f41e4c00640 1 -- 172.21.15.44:0/2991357133 <== mon.2 v2:172.21.15.62:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41dc007250 con 0x7f41e80703b0 2024-04-17T19:47:22.968 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.937+0000 7f8fff400640 1 -- 172.21.15.44:0/2917731553 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f8ff0085fe0 con 0x7f90080724d0 2024-04-17T19:47:22.968 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.941+0000 7f0df2a00640 1 -- 172.21.15.44:0/3580380850 <== osd.3 v2:172.21.15.44:6808/4236454921 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f0de800ae80 con 0x7f0ddc071c40 2024-04-17T19:47:22.969 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.941+0000 7fa753400640 1 -- 172.21.15.44:0/208904426 <== mon.1 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fa754019020 con 0x7fa75c06d190 2024-04-17T19:47:22.969 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.937+0000 7f1293400640 1 --2- 172.21.15.44:0/2326905000 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f127c068480 0x7f127c06a990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:22.969 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.937+0000 7f1293400640 1 -- 172.21.15.44:0/2326905000 <== mon.1 v2:172.21.15.62:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f1288087420 con 0x7f129c15dc50 2024-04-17T19:47:22.969 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.941+0000 7f1293400640 1 --2- 172.21.15.44:0/2326905000 >> [v2:172.21.15.62:6824/2602310256,v1:172.21.15.62:6825/2602310256] conn(0x7f127c071c40 0x7f127c0740d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:22.969 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.941+0000 7f1293400640 1 -- 172.21.15.44:0/2326905000 --> [v2:172.21.15.62:6824/2602310256,v1:172.21.15.62:6825/2602310256] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f128800fe50 con 0x7f127c071c40 2024-04-17T19:47:22.969 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.941+0000 7f1293400640 1 -- 172.21.15.44:0/2326905000 <== mon.1 v2:172.21.15.62:3300/0 6 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f1288087810 con 0x7f129c15dc50 2024-04-17T19:47:22.970 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.941+0000 7f7482a00640 1 -- 172.21.15.44:0/1679491311 <== osd.1 v2:172.21.15.44:6817/1452577434 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f747c0c1e50 con 0x7f746c071c10 2024-04-17T19:47:22.970 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.941+0000 7f41ef800640 1 -- 172.21.15.44:0/2991357133 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f41e81f41b0 con 0x7f41e80703b0 2024-04-17T19:47:22.970 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.941+0000 7f41ef800640 1 -- 172.21.15.44:0/2991357133 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f41e81f4770 con 0x7f41e80703b0 2024-04-17T19:47:22.970 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.941+0000 7f8fff400640 1 --2- 172.21.15.44:0/2917731553 >> [v2:172.21.15.62:6800/2293251376,v1:172.21.15.62:6801/2293251376] conn(0x7f8fe4071b90 0x7f8fe4074020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:22.970 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.941+0000 7f8fff400640 1 -- 172.21.15.44:0/2917731553 --> [v2:172.21.15.62:6800/2293251376,v1:172.21.15.62:6801/2293251376] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f8fe40746f0 con 0x7f8fe4071b90 2024-04-17T19:47:22.970 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.941+0000 7f8fff400640 1 -- 172.21.15.44:0/2917731553 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f8ff0051e90 con 0x7f90080724d0 2024-04-17T19:47:22.970 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.941+0000 7f9006a00640 1 --2- 172.21.15.44:0/2917731553 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f8fe4068450 0x7f8fe406a960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:22.970 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.941+0000 7f9007e00640 1 --2- 172.21.15.44:0/2917731553 >> [v2:172.21.15.62:6800/2293251376,v1:172.21.15.62:6801/2293251376] conn(0x7f8fe4071b90 0x7f8fe4074020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:22.971 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.941+0000 7f41ef800640 1 -- 172.21.15.44:0/2991357133 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f41e804ff10 con 0x7f41e80703b0 2024-04-17T19:47:22.971 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.941+0000 7f129b400640 1 --2- 172.21.15.44:0/2326905000 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f127c068480 0x7f127c06a990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:22.971 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.941+0000 7f129be00640 1 --2- 172.21.15.44:0/2326905000 >> [v2:172.21.15.62:6824/2602310256,v1:172.21.15.62:6825/2602310256] conn(0x7f127c071c40 0x7f127c0740d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:22.972 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.941+0000 7fa753400640 1 --2- 172.21.15.44:0/208904426 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7fa73c068380 0x7fa73c06a890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:22.972 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.941+0000 7fa753400640 1 -- 172.21.15.44:0/208904426 <== mon.1 v2:172.21.15.62:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fa754087890 con 0x7fa75c06d190 2024-04-17T19:47:22.972 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.941+0000 7fa753400640 1 --2- 172.21.15.44:0/208904426 >> [v2:172.21.15.62:6816/2912738359,v1:172.21.15.62:6817/2912738359] conn(0x7fa73c071ac0 0x7fa73c073f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:22.972 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.941+0000 7fa753400640 1 -- 172.21.15.44:0/208904426 --> [v2:172.21.15.62:6816/2912738359,v1:172.21.15.62:6817/2912738359] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fa754005830 con 0x7fa73c071ac0 2024-04-17T19:47:22.972 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.941+0000 7fa753400640 1 -- 172.21.15.44:0/208904426 <== mon.1 v2:172.21.15.62:3300/0 6 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fa754087c80 con 0x7fa75c06d190 2024-04-17T19:47:22.972 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.941+0000 7fa75aa00640 1 --2- 172.21.15.44:0/208904426 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7fa73c068380 0x7fa73c06a890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:22.972 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.941+0000 7f129be00640 1 --2- 172.21.15.44:0/2326905000 >> [v2:172.21.15.62:6824/2602310256,v1:172.21.15.62:6825/2602310256] conn(0x7f127c071c40 0x7f127c0740d0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:47:22.972 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.941+0000 7fa75be00640 1 --2- 172.21.15.44:0/208904426 >> [v2:172.21.15.62:6816/2912738359,v1:172.21.15.62:6817/2912738359] conn(0x7fa73c071ac0 0x7fa73c073f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:22.973 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.941+0000 7f9007e00640 1 --2- 172.21.15.44:0/2917731553 >> [v2:172.21.15.62:6800/2293251376,v1:172.21.15.62:6801/2293251376] conn(0x7f8fe4071b90 0x7f8fe4074020 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:47:22.973 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.941+0000 7f129b400640 1 --2- 172.21.15.44:0/2326905000 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f127c068480 0x7f127c06a990 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f128c001360 tx=0x7f128c009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:47:22.973 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.941+0000 7f9006a00640 1 --2- 172.21.15.44:0/2917731553 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f8fe4068450 0x7f8fe406a960 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f8ff80b2000 tx=0x7f8ff8009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:47:22.974 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.941+0000 7fa75be00640 1 --2- 172.21.15.44:0/208904426 >> [v2:172.21.15.62:6816/2912738359,v1:172.21.15.62:6817/2912738359] conn(0x7fa73c071ac0 0x7fa73c073f50 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:47:22.974 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.945+0000 7f1293400640 1 -- 172.21.15.44:0/2326905000 <== osd.6 v2:172.21.15.62:6824/2602310256 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f128800fe50 con 0x7f127c071c40 2024-04-17T19:47:22.974 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.945+0000 7fa753400640 1 -- 172.21.15.44:0/208904426 <== osd.7 v2:172.21.15.62:6816/2912738359 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fa754005830 con 0x7fa73c071ac0 2024-04-17T19:47:22.974 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.945+0000 7f41e4c00640 1 -- 172.21.15.44:0/2991357133 <== mon.2 v2:172.21.15.62:3301/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f41dc019020 con 0x7f41e80703b0 2024-04-17T19:47:22.975 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.945+0000 7f8fff400640 1 -- 172.21.15.44:0/2917731553 <== osd.4 v2:172.21.15.62:6800/2293251376 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f8fe40746f0 con 0x7f8fe4071b90 2024-04-17T19:47:22.975 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.945+0000 7fa75aa00640 1 --2- 172.21.15.44:0/208904426 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7fa73c068380 0x7fa73c06a890 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fa7480ad000 tx=0x7fa7480a7000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:47:22.976 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.949+0000 7f41e4c00640 1 --2- 172.21.15.44:0/2991357133 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f41c80683d0 0x7f41c806a8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:22.976 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.949+0000 7f41e4c00640 1 -- 172.21.15.44:0/2991357133 <== mon.2 v2:172.21.15.62:3301/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f41dc0863b0 con 0x7f41e80703b0 2024-04-17T19:47:22.976 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.949+0000 7f41e4c00640 1 --2- 172.21.15.44:0/2991357133 >> [v2:172.21.15.62:6808/1551020300,v1:172.21.15.62:6809/1551020300] conn(0x7f41c8071b90 0x7f41c8074020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:22.976 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.949+0000 7f41e4c00640 1 -- 172.21.15.44:0/2991357133 --> [v2:172.21.15.62:6808/1551020300,v1:172.21.15.62:6809/1551020300] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f41dc00ae50 con 0x7f41c8071b90 2024-04-17T19:47:22.976 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.949+0000 7f41e4c00640 1 -- 172.21.15.44:0/2991357133 <== mon.2 v2:172.21.15.62:3301/0 6 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f41dc086760 con 0x7f41e80703b0 2024-04-17T19:47:22.976 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.949+0000 7f41e7e00640 1 --2- 172.21.15.44:0/2991357133 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f41c80683d0 0x7f41c806a8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:22.976 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.949+0000 7f41ed800640 1 --2- 172.21.15.44:0/2991357133 >> [v2:172.21.15.62:6808/1551020300,v1:172.21.15.62:6809/1551020300] conn(0x7f41c8071b90 0x7f41c8074020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:22.976 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.949+0000 7f41e7e00640 1 --2- 172.21.15.44:0/2991357133 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f41c80683d0 0x7f41c806a8e0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f41d4009870 tx=0x7f41d4008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:47:22.976 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.949+0000 7f361f400640 1 -- 172.21.15.44:0/4073667765 --> [v2:172.21.15.44:6800/1018735925,v1:172.21.15.44:6801/1018735925] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f360c002de0 con 0x7f3614071c10 2024-04-17T19:47:22.977 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.949+0000 7f41ed800640 1 --2- 172.21.15.44:0/2991357133 >> [v2:172.21.15.62:6808/1551020300,v1:172.21.15.62:6809/1551020300] conn(0x7f41c8071b90 0x7f41c8074020 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:47:22.977 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.949+0000 7f362a000640 1 -- 172.21.15.44:0/4073667765 <== osd.0 v2:172.21.15.44:6800/1018735925 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f360c002de0 con 0x7f3614071c10 2024-04-17T19:47:22.978 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.953+0000 7f361f400640 1 -- 172.21.15.44:0/4073667765 >> [v2:172.21.15.44:6800/1018735925,v1:172.21.15.44:6801/1018735925] conn(0x7f3614071c10 msgr2=0x7f36140740a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:22.978 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.953+0000 7f361f400640 1 --2- 172.21.15.44:0/4073667765 >> [v2:172.21.15.44:6800/1018735925,v1:172.21.15.44:6801/1018735925] conn(0x7f3614071c10 0x7f36140740a0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:22.978 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.953+0000 7f361f400640 1 -- 172.21.15.44:0/4073667765 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f3614068450 msgr2=0x7f361406a960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:22.978 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.953+0000 7f361f400640 1 --2- 172.21.15.44:0/4073667765 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f3614068450 0x7f361406a960 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f3624006fd0 tx=0x7f3624008040 comp rx=0 tx=0).stop 2024-04-17T19:47:22.978 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.953+0000 7f361f400640 1 -- 172.21.15.44:0/4073667765 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f36340724d0 msgr2=0x7f3634146690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:22.978 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.953+0000 7f361f400640 1 --2- 172.21.15.44:0/4073667765 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f36340724d0 0x7f3634146690 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f362000c410 tx=0x7f362000c8d0 comp rx=0 tx=0).stop 2024-04-17T19:47:22.978 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.953+0000 7f41e4c00640 1 -- 172.21.15.44:0/2991357133 <== osd.5 v2:172.21.15.62:6808/1551020300 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f41dc00ae50 con 0x7f41c8071b90 2024-04-17T19:47:22.979 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.957+0000 7f3632800640 1 -- 172.21.15.44:0/4073667765 reap_dead start 2024-04-17T19:47:22.979 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.957+0000 7f361f400640 1 -- 172.21.15.44:0/4073667765 shutdown_connections 2024-04-17T19:47:22.979 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.957+0000 7f361f400640 1 -- 172.21.15.44:0/4073667765 >> 172.21.15.44:0/4073667765 conn(0x7f36340ccf60 msgr2=0x7f3634150f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:47:22.979 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.957+0000 7f361f400640 1 -- 172.21.15.44:0/4073667765 shutdown_connections 2024-04-17T19:47:22.979 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.957+0000 7f361f400640 1 -- 172.21.15.44:0/4073667765 wait complete. 2024-04-17T19:47:22.980 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.961+0000 7f7477e00640 1 -- 172.21.15.44:0/1679491311 --> [v2:172.21.15.44:6817/1452577434,v1:172.21.15.44:6820/1452577434] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f7460002de0 con 0x7f746c071c10 2024-04-17T19:47:22.980 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.965+0000 7fac49a00640 1 -- 172.21.15.44:0/1014984244 --> [v2:172.21.15.44:6816/1160071918,v1:172.21.15.44:6818/1160071918] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fac1c002de0 con 0x7fac24072740 2024-04-17T19:47:22.980 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.965+0000 7f7482a00640 1 -- 172.21.15.44:0/1679491311 <== osd.1 v2:172.21.15.44:6817/1452577434 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f7460002de0 con 0x7f746c071c10 2024-04-17T19:47:22.981 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.965+0000 7f7477e00640 1 -- 172.21.15.44:0/1679491311 >> [v2:172.21.15.44:6817/1452577434,v1:172.21.15.44:6820/1452577434] conn(0x7f746c071c10 msgr2=0x7f746c0740a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:22.981 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.965+0000 7f7477e00640 1 --2- 172.21.15.44:0/1679491311 >> [v2:172.21.15.44:6817/1452577434,v1:172.21.15.44:6820/1452577434] conn(0x7f746c071c10 0x7f746c0740a0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:22.981 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.965+0000 7fac3aa00640 1 -- 172.21.15.44:0/1014984244 <== osd.2 v2:172.21.15.44:6816/1160071918 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fac1c002de0 con 0x7fac24072740 2024-04-17T19:47:22.981 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.969+0000 7f7477e00640 1 -- 172.21.15.44:0/1679491311 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f746c068450 msgr2=0x7f746c06a960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:22.982 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.969+0000 7fac49a00640 1 -- 172.21.15.44:0/1014984244 >> [v2:172.21.15.44:6816/1160071918,v1:172.21.15.44:6818/1160071918] conn(0x7fac24072740 msgr2=0x7fac24074c30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:22.982 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.969+0000 7fac49a00640 1 --2- 172.21.15.44:0/1014984244 >> [v2:172.21.15.44:6816/1160071918,v1:172.21.15.44:6818/1160071918] conn(0x7fac24072740 0x7fac24074c30 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:22.982 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.969+0000 7fac49a00640 1 -- 172.21.15.44:0/1014984244 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7fac24068400 msgr2=0x7fac2406a910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:22.982 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.969+0000 7fac49a00640 1 --2- 172.21.15.44:0/1014984244 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7fac24068400 0x7fac2406a910 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fac4406b6b0 tx=0x7fac44074650 comp rx=0 tx=0).stop 2024-04-17T19:47:22.982 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.969+0000 7fac49a00640 1 -- 172.21.15.44:0/1014984244 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fac3c185940 msgr2=0x7fac3c0da6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:22.982 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.969+0000 7fac49a00640 1 --2- 172.21.15.44:0/1014984244 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fac3c185940 0x7fac3c0da6c0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fac3400d800 tx=0x7fac3400dcc0 comp rx=0 tx=0).stop 2024-04-17T19:47:22.982 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.969+0000 7fac43400640 1 -- 172.21.15.44:0/1014984244 reap_dead start 2024-04-17T19:47:22.982 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.969+0000 7fac49a00640 1 -- 172.21.15.44:0/1014984244 shutdown_connections 2024-04-17T19:47:22.982 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.969+0000 7fac49a00640 1 -- 172.21.15.44:0/1014984244 >> 172.21.15.44:0/1014984244 conn(0x7fac3c0503c0 msgr2=0x7fac3c0df9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:47:22.982 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.969+0000 7fac49a00640 1 -- 172.21.15.44:0/1014984244 shutdown_connections 2024-04-17T19:47:22.983 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.969+0000 7f7477e00640 1 --2- 172.21.15.44:0/1679491311 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f746c068450 0x7f746c06a960 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f7484007690 tx=0x7f748400b8f0 comp rx=0 tx=0).stop 2024-04-17T19:47:22.983 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.969+0000 7fac49a00640 1 -- 172.21.15.44:0/1014984244 wait complete. 2024-04-17T19:47:22.983 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.969+0000 7f7477e00640 1 -- 172.21.15.44:0/1679491311 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f748c0c8cf0 msgr2=0x7f748c1463b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:22.984 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.969+0000 7f7477e00640 1 --2- 172.21.15.44:0/1679491311 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f748c0c8cf0 0x7f748c1463b0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f748c06c730 tx=0x7f747c01ba50 comp rx=0 tx=0).stop 2024-04-17T19:47:22.984 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.969+0000 7f748b400640 1 -- 172.21.15.44:0/1679491311 reap_dead start 2024-04-17T19:47:22.984 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.969+0000 7f12a2600640 1 -- 172.21.15.44:0/2326905000 --> [v2:172.21.15.62:6824/2602310256,v1:172.21.15.62:6825/2602310256] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f1274002de0 con 0x7f127c071c40 2024-04-17T19:47:22.984 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.969+0000 7f7477e00640 1 -- 172.21.15.44:0/1679491311 shutdown_connections 2024-04-17T19:47:22.984 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.969+0000 7f7477e00640 1 -- 172.21.15.44:0/1679491311 >> 172.21.15.44:0/1679491311 conn(0x7f748c0ccf60 msgr2=0x7f748c14fc40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:47:22.984 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.969+0000 7f1293400640 1 -- 172.21.15.44:0/2326905000 <== osd.6 v2:172.21.15.62:6824/2602310256 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f1274002de0 con 0x7f127c071c40 2024-04-17T19:47:22.985 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.969+0000 7f7477e00640 1 -- 172.21.15.44:0/1679491311 shutdown_connections 2024-04-17T19:47:22.985 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.969+0000 7f7477e00640 1 -- 172.21.15.44:0/1679491311 wait complete. 2024-04-17T19:47:22.985 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.973+0000 7f0dfbe00640 1 -- 172.21.15.44:0/3580380850 --> [v2:172.21.15.44:6808/4236454921,v1:172.21.15.44:6809/4236454921] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f0dd4002de0 con 0x7f0ddc071c40 2024-04-17T19:47:22.985 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.973+0000 7f0df2a00640 1 -- 172.21.15.44:0/3580380850 <== osd.3 v2:172.21.15.44:6808/4236454921 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f0dd4002de0 con 0x7f0ddc071c40 2024-04-17T19:47:22.986 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.973+0000 7f0dfbe00640 1 -- 172.21.15.44:0/3580380850 >> [v2:172.21.15.44:6808/4236454921,v1:172.21.15.44:6809/4236454921] conn(0x7f0ddc071c40 msgr2=0x7f0ddc0740d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:22.986 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.973+0000 7f12a2600640 1 -- 172.21.15.44:0/2326905000 >> [v2:172.21.15.62:6824/2602310256,v1:172.21.15.62:6825/2602310256] conn(0x7f127c071c40 msgr2=0x7f127c0740d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:22.986 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.973+0000 7f12a2600640 1 --2- 172.21.15.44:0/2326905000 >> [v2:172.21.15.62:6824/2602310256,v1:172.21.15.62:6825/2602310256] conn(0x7f127c071c40 0x7f127c0740d0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:22.986 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.973+0000 7f0dfbe00640 1 --2- 172.21.15.44:0/3580380850 >> [v2:172.21.15.44:6808/4236454921,v1:172.21.15.44:6809/4236454921] conn(0x7f0ddc071c40 0x7f0ddc0740d0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:22.987 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.973+0000 7f12a2600640 1 -- 172.21.15.44:0/2326905000 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f127c068480 msgr2=0x7f127c06a990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:22.987 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.973+0000 7f12a2600640 1 --2- 172.21.15.44:0/2326905000 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f127c068480 0x7f127c06a990 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f128c001360 tx=0x7f128c009040 comp rx=0 tx=0).stop 2024-04-17T19:47:22.987 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.973+0000 7f12a2600640 1 -- 172.21.15.44:0/2326905000 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f129c15dc50 msgr2=0x7f129c1546b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:22.987 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.973+0000 7f12a2600640 1 --2- 172.21.15.44:0/2326905000 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f129c15dc50 0x7f129c1546b0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f128800e550 tx=0x7f128800ea10 comp rx=0 tx=0).stop 2024-04-17T19:47:22.987 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.973+0000 7f129be00640 1 -- 172.21.15.44:0/2326905000 reap_dead start 2024-04-17T19:47:22.988 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.973+0000 7f12a2600640 1 -- 172.21.15.44:0/2326905000 shutdown_connections 2024-04-17T19:47:22.988 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.973+0000 7f12a2600640 1 -- 172.21.15.44:0/2326905000 >> 172.21.15.44:0/2326905000 conn(0x7f129c06ce90 msgr2=0x7f129c15f530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:47:22.988 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.977+0000 7f12a2600640 1 -- 172.21.15.44:0/2326905000 shutdown_connections 2024-04-17T19:47:22.988 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.977+0000 7f12a2600640 1 -- 172.21.15.44:0/2326905000 wait complete. 2024-04-17T19:47:22.988 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.977+0000 7f0dfbe00640 1 -- 172.21.15.44:0/3580380850 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f0ddc068580 msgr2=0x7f0ddc06aa90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:22.988 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.977+0000 7fa760e00640 1 -- 172.21.15.44:0/208904426 --> [v2:172.21.15.62:6816/2912738359,v1:172.21.15.62:6817/2912738359] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fa75c0cbb20 con 0x7fa73c071ac0 2024-04-17T19:47:22.989 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.977+0000 7f0dfbe00640 1 --2- 172.21.15.44:0/3580380850 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f0ddc068580 0x7f0ddc06aa90 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f0dfc0762e0 tx=0x7f0dfc06e040 comp rx=0 tx=0).stop 2024-04-17T19:47:22.989 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.977+0000 7f0dfbe00640 1 -- 172.21.15.44:0/3580380850 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0df4045360 msgr2=0x7f0df40cb4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:22.989 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.977+0000 7f0dfbe00640 1 --2- 172.21.15.44:0/3580380850 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0df4045360 0x7f0df40cb4f0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f0de80b4000 tx=0x7f0de800b3a0 comp rx=0 tx=0).stop 2024-04-17T19:47:22.989 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.977+0000 7f0dfb400640 1 -- 172.21.15.44:0/3580380850 reap_dead start 2024-04-17T19:47:22.989 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.977+0000 7fa753400640 1 -- 172.21.15.44:0/208904426 <== osd.7 v2:172.21.15.62:6816/2912738359 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fa75c0cbb20 con 0x7fa73c071ac0 2024-04-17T19:47:22.990 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.977+0000 7f0dfbe00640 1 -- 172.21.15.44:0/3580380850 shutdown_connections 2024-04-17T19:47:22.990 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.977+0000 7f0dfbe00640 1 -- 172.21.15.44:0/3580380850 >> 172.21.15.44:0/3580380850 conn(0x7f0df40503c0 msgr2=0x7f0df4006980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:47:22.990 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.977+0000 7f0dfbe00640 1 -- 172.21.15.44:0/3580380850 shutdown_connections 2024-04-17T19:47:22.990 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.977+0000 7f0dfbe00640 1 -- 172.21.15.44:0/3580380850 wait complete. 2024-04-17T19:47:22.991 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.977+0000 7fa760e00640 1 -- 172.21.15.44:0/208904426 >> [v2:172.21.15.62:6816/2912738359,v1:172.21.15.62:6817/2912738359] conn(0x7fa73c071ac0 msgr2=0x7fa73c073f50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:22.991 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.977+0000 7fa760e00640 1 --2- 172.21.15.44:0/208904426 >> [v2:172.21.15.62:6816/2912738359,v1:172.21.15.62:6817/2912738359] conn(0x7fa73c071ac0 0x7fa73c073f50 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:22.991 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.977+0000 7fa760e00640 1 -- 172.21.15.44:0/208904426 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7fa73c068380 msgr2=0x7fa73c06a890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:22.991 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.977+0000 7fa760e00640 1 --2- 172.21.15.44:0/208904426 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7fa73c068380 0x7fa73c06a890 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fa7480ad000 tx=0x7fa7480a7000 comp rx=0 tx=0).stop 2024-04-17T19:47:22.991 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.977+0000 7fa760e00640 1 -- 172.21.15.44:0/208904426 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa75c06d190 msgr2=0x7fa75c162000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:22.991 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.977+0000 7fa760e00640 1 --2- 172.21.15.44:0/208904426 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa75c06d190 0x7fa75c162000 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fa75400c7a0 tx=0x7fa75400cc60 comp rx=0 tx=0).stop 2024-04-17T19:47:22.991 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.977+0000 7fa75be00640 1 -- 172.21.15.44:0/208904426 reap_dead start 2024-04-17T19:47:22.991 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.977+0000 7fa760e00640 1 -- 172.21.15.44:0/208904426 shutdown_connections 2024-04-17T19:47:22.991 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.977+0000 7fa760e00640 1 -- 172.21.15.44:0/208904426 >> 172.21.15.44:0/208904426 conn(0x7fa75c0cdec0 msgr2=0x7fa75c136620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:47:22.991 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.977+0000 7fa760e00640 1 -- 172.21.15.44:0/208904426 shutdown_connections 2024-04-17T19:47:22.991 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.977+0000 7fa760e00640 1 -- 172.21.15.44:0/208904426 wait complete. 2024-04-17T19:47:22.992 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.981+0000 7f900cc00640 1 -- 172.21.15.44:0/2917731553 --> [v2:172.21.15.62:6800/2293251376,v1:172.21.15.62:6801/2293251376] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f900815c2b0 con 0x7f8fe4071b90 2024-04-17T19:47:22.992 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.981+0000 7f8fff400640 1 -- 172.21.15.44:0/2917731553 <== osd.4 v2:172.21.15.62:6800/2293251376 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f900815c2b0 con 0x7f8fe4071b90 2024-04-17T19:47:22.992 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.981+0000 7f8ffcc00640 1 -- 172.21.15.44:0/2917731553 >> [v2:172.21.15.62:6800/2293251376,v1:172.21.15.62:6801/2293251376] conn(0x7f8fe4071b90 msgr2=0x7f8fe4074020 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:22.992 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.981+0000 7f8ffcc00640 1 --2- 172.21.15.44:0/2917731553 >> [v2:172.21.15.62:6800/2293251376,v1:172.21.15.62:6801/2293251376] conn(0x7f8fe4071b90 0x7f8fe4074020 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:22.993 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.981+0000 7f8ffcc00640 1 -- 172.21.15.44:0/2917731553 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f8fe4068450 msgr2=0x7f8fe406a960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:22.993 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.981+0000 7f8ffcc00640 1 --2- 172.21.15.44:0/2917731553 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f8fe4068450 0x7f8fe406a960 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f8ff80b2000 tx=0x7f8ff8009040 comp rx=0 tx=0).stop 2024-04-17T19:47:22.993 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.981+0000 7f8ffcc00640 1 -- 172.21.15.44:0/2917731553 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f90080724d0 msgr2=0x7f9008152df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:22.993 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.981+0000 7f8ffcc00640 1 --2- 172.21.15.44:0/2917731553 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f90080724d0 0x7f9008152df0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f8ff000c3c0 tx=0x7f8ff000c880 comp rx=0 tx=0).stop 2024-04-17T19:47:22.993 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.981+0000 7f9007e00640 1 -- 172.21.15.44:0/2917731553 reap_dead start 2024-04-17T19:47:22.993 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.981+0000 7f41ef800640 1 -- 172.21.15.44:0/2991357133 --> [v2:172.21.15.62:6808/1551020300,v1:172.21.15.62:6809/1551020300] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f41e80c74f0 con 0x7f41c8071b90 2024-04-17T19:47:22.993 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.985+0000 7f8ffcc00640 1 -- 172.21.15.44:0/2917731553 shutdown_connections 2024-04-17T19:47:22.994 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.985+0000 7f8ffcc00640 1 -- 172.21.15.44:0/2917731553 >> 172.21.15.44:0/2917731553 conn(0x7f90080ccf60 msgr2=0x7f9008073d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:47:22.994 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.985+0000 7f8ffcc00640 1 -- 172.21.15.44:0/2917731553 shutdown_connections 2024-04-17T19:47:22.994 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.985+0000 7f8ffcc00640 1 -- 172.21.15.44:0/2917731553 wait complete. 2024-04-17T19:47:22.994 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.985+0000 7f41e4c00640 1 -- 172.21.15.44:0/2991357133 <== osd.5 v2:172.21.15.62:6808/1551020300 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f41e80c74f0 con 0x7f41c8071b90 2024-04-17T19:47:22.995 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.985+0000 7f41ef800640 1 -- 172.21.15.44:0/2991357133 >> [v2:172.21.15.62:6808/1551020300,v1:172.21.15.62:6809/1551020300] conn(0x7f41c8071b90 msgr2=0x7f41c8074020 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:22.995 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.985+0000 7f41ef800640 1 --2- 172.21.15.44:0/2991357133 >> [v2:172.21.15.62:6808/1551020300,v1:172.21.15.62:6809/1551020300] conn(0x7f41c8071b90 0x7f41c8074020 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:22.995 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.985+0000 7f41ef800640 1 -- 172.21.15.44:0/2991357133 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f41c80683d0 msgr2=0x7f41c806a8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:22.995 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.985+0000 7f41ef800640 1 --2- 172.21.15.44:0/2991357133 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f41c80683d0 0x7f41c806a8e0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f41d4009870 tx=0x7f41d4008040 comp rx=0 tx=0).stop 2024-04-17T19:47:22.995 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.985+0000 7f41ef800640 1 -- 172.21.15.44:0/2991357133 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f41e80703b0 msgr2=0x7f41e80ccc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:22.995 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.985+0000 7f41ef800640 1 --2- 172.21.15.44:0/2991357133 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f41e80703b0 0x7f41e80ccc80 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f41dc00c390 tx=0x7f41dc00c850 comp rx=0 tx=0).stop 2024-04-17T19:47:22.995 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.985+0000 7f41ed800640 1 -- 172.21.15.44:0/2991357133 reap_dead start 2024-04-17T19:47:22.995 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.985+0000 7f41ef800640 1 -- 172.21.15.44:0/2991357133 shutdown_connections 2024-04-17T19:47:22.995 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.985+0000 7f41ef800640 1 -- 172.21.15.44:0/2991357133 >> 172.21.15.44:0/2991357133 conn(0x7f41e806ce90 msgr2=0x7f41e80c79b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:47:22.995 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.985+0000 7f41ef800640 1 -- 172.21.15.44:0/2991357133 shutdown_connections 2024-04-17T19:47:22.995 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:22.985+0000 7f41ef800640 1 -- 172.21.15.44:0/2991357133 wait complete. 2024-04-17T19:47:22.996 INFO:teuthology.orchestra.run.smithi044.stdout:64424509450 2024-04-17T19:47:22.996 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-04-17T19:47:23.005 INFO:teuthology.orchestra.run.smithi044.stdout:64424509452 2024-04-17T19:47:23.005 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-04-17T19:47:23.007 INFO:teuthology.orchestra.run.smithi044.stdout:64424509452 2024-04-17T19:47:23.007 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-04-17T19:47:23.009 INFO:teuthology.orchestra.run.smithi044.stdout:64424509452 2024-04-17T19:47:23.010 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-04-17T19:47:23.013 INFO:teuthology.orchestra.run.smithi044.stdout:64424509451 2024-04-17T19:47:23.013 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-04-17T19:47:23.019 INFO:teuthology.orchestra.run.smithi044.stdout:64424509451 2024-04-17T19:47:23.020 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-04-17T19:47:23.021 INFO:teuthology.orchestra.run.smithi044.stdout:55834574859 2024-04-17T19:47:23.022 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-04-17T19:47:23.022 INFO:teuthology.orchestra.run.smithi044.stdout:55834574859 2024-04-17T19:47:23.023 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-04-17T19:47:23.272 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:23.281+0000 7f96f4800640 1 Processor -- start 2024-04-17T19:47:23.272 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:23.281+0000 7f96f4800640 1 -- start start 2024-04-17T19:47:23.273 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:23.281+0000 7f44d1c00640 1 Processor -- start 2024-04-17T19:47:23.273 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:23.281+0000 7f44d1c00640 1 -- start start 2024-04-17T19:47:23.275 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:23.285+0000 7f96f4800640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f96e80d7330 0x7f96e800a070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:23.276 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:23.285+0000 7f96f4800640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f96e80dd2e0 con 0x7f96e80e0b10 2024-04-17T19:47:23.276 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:23.285+0000 7f96f4800640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f96e80dd5c0 con 0x7f96e800a5b0 2024-04-17T19:47:23.276 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:23.285+0000 7f96f4800640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 -- 0x7f96e80de140 con 0x7f96e80d7330 2024-04-17T19:47:23.277 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:23.285+0000 7f96f2800640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f96e80e0b10 0x7f96e80e0f20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:50442/0 (socket says 172.21.15.44:50442) 2024-04-17T19:47:23.277 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:23.285+0000 7f96f2800640 1 -- 172.21.15.44:0/3001034749 learned_addr learned my addr 172.21.15.44:0/3001034749 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-04-17T19:47:23.277 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:23.285+0000 7f44d1c00640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f44c404d170 0x7f44c404c3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:23.277 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:23.285+0000 7f44d1c00640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f44c40dc300 con 0x7f44c404c930 2024-04-17T19:47:23.278 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:23.285+0000 7f44d1c00640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f44c40dc5e0 con 0x7f44c40082d0 2024-04-17T19:47:23.278 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:23.285+0000 7f44d1c00640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7f44c404d580 con 0x7f44c404d170 2024-04-17T19:47:23.278 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:23.285+0000 7f44caa00640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f44c404d170 0x7f44c404c3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:23.278 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:23.285+0000 7f44cb400640 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f44c40082d0 0x7f44c40e6080 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.44:60896/0 (socket says 172.21.15.44:60896) 2024-04-17T19:47:23.279 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:23.285+0000 7f44cb400640 1 -- 172.21.15.44:0/1554926358 learned_addr learned my addr 172.21.15.44:0/1554926358 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-04-17T19:47:23.279 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:23.289+0000 7f96f0a00640 1 -- 172.21.15.44:0/3001034749 <== mon.1 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 32964593 0 0) 0x7f96e80dd5c0 con 0x7f96e800a5b0 2024-04-17T19:47:23.279 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:23.289+0000 7f96f0a00640 1 -- 172.21.15.44:0/3001034749 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f96d4003530 con 0x7f96e800a5b0 2024-04-17T19:47:23.279 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:23.289+0000 7f96f0a00640 1 -- 172.21.15.44:0/3001034749 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1705825541 0 0) 0x7f96e80dd2e0 con 0x7f96e80e0b10 2024-04-17T19:47:23.279 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:23.289+0000 7f96f0a00640 1 -- 172.21.15.44:0/3001034749 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f96e80dd5c0 con 0x7f96e80e0b10 2024-04-17T19:47:23.280 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:23.289+0000 7f44c9600640 1 -- 172.21.15.44:0/1554926358 <== mon.1 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3890929678 0 0) 0x7f44c40dc5e0 con 0x7f44c40082d0 2024-04-17T19:47:23.280 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:23.289+0000 7f44c9600640 1 -- 172.21.15.44:0/1554926358 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f44b0004640 con 0x7f44c40082d0 2024-04-17T19:47:23.280 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:23.289+0000 7f44caa00640 1 -- 172.21.15.44:0/1554926358 >> v1:172.21.15.62:6789/0 conn(0x7f44c40082d0 legacy=0x7f44c40e6080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:23.280 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:23.289+0000 7f44caa00640 1 -- 172.21.15.44:0/1554926358 >> v1:172.21.15.44:6789/0 conn(0x7f44c404c930 legacy=0x7f44c4007bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:23.280 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:23.289+0000 7f44caa00640 1 -- 172.21.15.44:0/1554926358 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f44c4006e00 con 0x7f44c404d170 2024-04-17T19:47:23.280 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:23.289+0000 7f96f0a00640 1 -- 172.21.15.44:0/3001034749 <== mon.0 v1:172.21.15.44:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1408010035 0 0) 0x7f96e80dd5c0 con 0x7f96e80e0b10 2024-04-17T19:47:23.280 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:23.289+0000 7f96f0a00640 1 -- 172.21.15.44:0/3001034749 >> v2:172.21.15.44:3300/0 conn(0x7f96e80d7330 msgr2=0x7f96e800a070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T19:47:23.281 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:23.289+0000 7f96f0a00640 1 --2- 172.21.15.44:0/3001034749 >> v2:172.21.15.44:3300/0 conn(0x7f96e80d7330 0x7f96e800a070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:23.281 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:23.289+0000 7f96f0a00640 1 -- 172.21.15.44:0/3001034749 >> v1:172.21.15.62:6789/0 conn(0x7f96e800a5b0 legacy=0x7f96e804d320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:23.281 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:23.289+0000 7f96f0a00640 1 -- 172.21.15.44:0/3001034749 --> v1:172.21.15.44:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f96e80dd8a0 con 0x7f96e80e0b10 2024-04-17T19:47:23.281 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:23.289+0000 7f96f0a00640 1 -- 172.21.15.44:0/3001034749 <== mon.0 v1:172.21.15.44:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1863569991 0 0) 0x7f96ec0775a0 con 0x7f96e80e0b10 2024-04-17T19:47:23.281 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:23.289+0000 7f96f0a00640 1 -- 172.21.15.44:0/3001034749 >> v1:172.21.15.44:6789/0 conn(0x7f96e80e0b10 legacy=0x7f96e80e0f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:23.281 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:23.289+0000 7f96f0a00640 1 --2- 172.21.15.44:0/3001034749 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f96d4004be0 0x7f96d4005010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:23.281 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:23.289+0000 7f96f0a00640 1 --2- 172.21.15.44:0/3001034749 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f96d40037b0 0x7f96d4003bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:23.281 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:23.289+0000 7f96f0a00640 1 --2- 172.21.15.44:0/3001034749 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f96d4004100 0x7f96d40145d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:23.281 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:23.289+0000 7f96f0a00640 1 -- 172.21.15.44:0/3001034749 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f96e80de140 con 0x7f96d40037b0 2024-04-17T19:47:23.281 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:23.289+0000 7f96f0a00640 1 -- 172.21.15.44:0/3001034749 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f96d4009c10 con 0x7f96d4004be0 2024-04-17T19:47:23.281 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:23.289+0000 7f96f0a00640 1 -- 172.21.15.44:0/3001034749 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7f96d4014b40 con 0x7f96d4004100 2024-04-17T19:47:23.281 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:23.289+0000 7f96f2800640 1 --2- 172.21.15.44:0/3001034749 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f96d4004100 0x7f96d40145d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:23.282 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:23.289+0000 7f96f1400640 1 --2- 172.21.15.44:0/3001034749 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f96d40037b0 0x7f96d4003bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:23.282 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:23.289+0000 7f96f2800640 1 -- 172.21.15.44:0/3001034749 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f96d4004be0 msgr2=0x7f96d4005010 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-04-17T19:47:23.282 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:23.289+0000 7f96f2800640 1 --2- 172.21.15.44:0/3001034749 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f96d4004be0 0x7f96d4005010 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:23.282 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:23.289+0000 7f96f2800640 1 -- 172.21.15.44:0/3001034749 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f96d40037b0 msgr2=0x7f96d4003bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T19:47:23.282 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:23.289+0000 7f96f2800640 1 --2- 172.21.15.44:0/3001034749 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f96d40037b0 0x7f96d4003bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:23.282 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:23.289+0000 7f96f2800640 1 -- 172.21.15.44:0/3001034749 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f96e80dd8a0 con 0x7f96d4004100 2024-04-17T19:47:23.283 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:23.293+0000 7fbf26400640 1 Processor -- start 2024-04-17T19:47:23.284 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:23.293+0000 7f44caa00640 1 --2- 172.21.15.44:0/1554926358 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f44c404d170 0x7f44c404c3f0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f44cc0518f0 tx=0x7f44cc09bb70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4db4644e457a3ed9 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:47:23.284 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:23.293+0000 7fbf26400640 1 -- start start 2024-04-17T19:47:23.285 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:23.293+0000 7f44c9600640 1 -- 172.21.15.44:0/1554926358 <== mon.2 v2:172.21.15.62:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44cc1257d0 con 0x7f44c404d170 2024-04-17T19:47:23.285 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:23.293+0000 7f44c9600640 1 -- 172.21.15.44:0/1554926358 <== mon.2 v2:172.21.15.62:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f44cc125970 con 0x7f44c404d170 2024-04-17T19:47:23.285 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:23.293+0000 7ff175c00640 1 Processor -- start 2024-04-17T19:47:23.285 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:23.293+0000 7f96f2800640 1 -- 172.21.15.44:0/3001034749 reap_dead start 2024-04-17T19:47:23.286 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:23.293+0000 7f44c9600640 1 -- 172.21.15.44:0/1554926358 <== mon.2 v2:172.21.15.62:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44cc1257d0 con 0x7f44c404d170 2024-04-17T19:47:23.286 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:23.293+0000 7ff175c00640 1 -- start start 2024-04-17T19:47:23.286 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:23.293+0000 7f96f2800640 1 --2- 172.21.15.44:0/3001034749 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f96d4004100 0x7f96d40145d0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f96ec0518f0 tx=0x7f96ec099750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2bdda3d298e6c2a4 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:47:23.286 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:23.293+0000 7f44d1c00640 1 -- 172.21.15.44:0/1554926358 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f44c404d170 msgr2=0x7f44c404c3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:23.287 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:23.293+0000 7f96f0a00640 1 -- 172.21.15.44:0/3001034749 <== mon.2 v2:172.21.15.62:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96ec04fea0 con 0x7f96d4004100 2024-04-17T19:47:23.287 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:23.293+0000 7f44d1c00640 1 --2- 172.21.15.44:0/1554926358 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f44c404d170 0x7f44c404c3f0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f44cc0518f0 tx=0x7f44cc09bb70 comp rx=0 tx=0).stop 2024-04-17T19:47:23.287 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:23.293+0000 7f96f0a00640 1 -- 172.21.15.44:0/3001034749 <== mon.2 v2:172.21.15.62:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f96ec126740 con 0x7f96d4004100 2024-04-17T19:47:23.288 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:23.293+0000 7f96f0a00640 1 -- 172.21.15.44:0/3001034749 <== mon.2 v2:172.21.15.62:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96ec126b30 con 0x7f96d4004100 2024-04-17T19:47:23.288 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:23.297+0000 7f44d1c00640 1 -- 172.21.15.44:0/1554926358 shutdown_connections 2024-04-17T19:47:23.288 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:23.297+0000 7f44d1c00640 1 --2- 172.21.15.44:0/1554926358 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f44c404d170 0x7f44c404c3f0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:23.288 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:23.297+0000 7f44d1c00640 1 -- 172.21.15.44:0/1554926358 >> 172.21.15.44:0/1554926358 conn(0x7f44c4050c80 msgr2=0x7f44c4051090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:47:23.288 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:23.297+0000 7fbf26400640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fbf1804bb30 0x7fbf1804bf40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:23.289 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:23.297+0000 7f96f4800640 1 -- 172.21.15.44:0/3001034749 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f96d4004100 msgr2=0x7f96d40145d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:23.289 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:23.297+0000 7f96f4800640 1 --2- 172.21.15.44:0/3001034749 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f96d4004100 0x7f96d40145d0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f96ec0518f0 tx=0x7f96ec099750 comp rx=0 tx=0).stop 2024-04-17T19:47:23.289 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:23.297+0000 7fbf26400640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fbf180e3c20 0x7fbf180e6040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:23.289 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:23.297+0000 7fbf1fe00640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fbf1804bb30 0x7fbf1804bf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:23.289 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:23.297+0000 7fbf25000640 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7fbf180db2b0 0x7fbf180060f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.44:60912/0 (socket says 172.21.15.44:60912) 2024-04-17T19:47:23.290 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:23.297+0000 7fbf25000640 1 -- 172.21.15.44:0/998891504 learned_addr learned my addr 172.21.15.44:0/998891504 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-04-17T19:47:23.290 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:23.297+0000 7f96f4800640 1 -- 172.21.15.44:0/3001034749 shutdown_connections 2024-04-17T19:47:23.290 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:23.297+0000 7f96f4800640 1 --2- 172.21.15.44:0/3001034749 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f96d4004100 0x7f96d40145d0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:23.290 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:23.297+0000 7f96f4800640 1 -- 172.21.15.44:0/3001034749 >> 172.21.15.44:0/3001034749 conn(0x7f96e80527b0 msgr2=0x7f96e8052bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:47:23.290 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:23.297+0000 7f96f4800640 1 -- 172.21.15.44:0/3001034749 shutdown_connections 2024-04-17T19:47:23.291 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:23.297+0000 7fbf26400640 1 -- 172.21.15.44:0/998891504 --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbf18047540 con 0x7fbf180db2b0 2024-04-17T19:47:23.291 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:23.297+0000 7ff175c00640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7ff170155cf0 0x7ff1700c5a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:23.291 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:23.297+0000 7f96f4800640 1 -- 172.21.15.44:0/3001034749 wait complete. 2024-04-17T19:47:23.292 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:23.297+0000 7fbf25a00640 1 --2- 172.21.15.44:0/998891504 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fbf180e3c20 0x7fbf180e6040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:23.292 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:23.297+0000 7ff175c00640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7ff170072db0 0x7ff170166320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:23.292 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:23.297+0000 7ff175c00640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff1700c62c0 con 0x7ff1700729a0 2024-04-17T19:47:23.292 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:23.297+0000 7ff175c00640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 -- 0x7ff1700c93c0 con 0x7ff170155cf0 2024-04-17T19:47:23.292 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:23.297+0000 7ff175c00640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7ff1700c9610 con 0x7ff170072db0 2024-04-17T19:47:23.293 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:23.297+0000 7fbf26400640 1 -- 172.21.15.44:0/998891504 --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 -- 0x7fbf180461c0 con 0x7fbf1804bb30 2024-04-17T19:47:23.293 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:23.297+0000 7fbf26400640 1 -- 172.21.15.44:0/998891504 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7fbf180464a0 con 0x7fbf180e3c20 2024-04-17T19:47:23.294 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:23.297+0000 7ff16fe00640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7ff170155cf0 0x7ff1700c5a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:23.294 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:23.297+0000 7ff175200640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7ff170072db0 0x7ff170166320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:23.294 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:23.297+0000 7ff175200640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7ff170072db0 0x7ff170166320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3301/0 says I am v2:172.21.15.44:43392/0 (socket says 172.21.15.44:43392) 2024-04-17T19:47:23.294 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:23.297+0000 7ff175200640 1 -- 172.21.15.44:0/3938022138 learned_addr learned my addr 172.21.15.44:0/3938022138 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-04-17T19:47:23.294 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:23.297+0000 7fbf1f400640 1 -- 172.21.15.44:0/998891504 <== mon.1 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1704340167 0 0) 0x7fbf18047540 con 0x7fbf180db2b0 2024-04-17T19:47:23.294 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:23.297+0000 7fbf1f400640 1 -- 172.21.15.44:0/998891504 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbf08003530 con 0x7fbf180db2b0 2024-04-17T19:47:23.295 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:23.301+0000 7ff175200640 1 -- 172.21.15.44:0/3938022138 >> v2:172.21.15.44:3300/0 conn(0x7ff170155cf0 msgr2=0x7ff1700c5a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T19:47:23.295 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:23.301+0000 7ff175200640 1 --2- 172.21.15.44:0/3938022138 >> v2:172.21.15.44:3300/0 conn(0x7ff170155cf0 0x7ff1700c5a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:23.295 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:23.301+0000 7ff175200640 1 -- 172.21.15.44:0/3938022138 >> v1:172.21.15.44:6789/0 conn(0x7ff1700729a0 legacy=0x7ff1700c8660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T19:47:23.295 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:23.301+0000 7ff175200640 1 -- 172.21.15.44:0/3938022138 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff1700c98f0 con 0x7ff170072db0 2024-04-17T19:47:23.296 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:23.301+0000 7fbf25a00640 1 -- 172.21.15.44:0/998891504 >> v2:172.21.15.62:3300/0 conn(0x7fbf1804bb30 msgr2=0x7fbf1804bf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T19:47:23.296 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:23.301+0000 7fbf25a00640 1 --2- 172.21.15.44:0/998891504 >> v2:172.21.15.62:3300/0 conn(0x7fbf1804bb30 0x7fbf1804bf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:23.296 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:23.301+0000 7ff16fe00640 1 --2- 172.21.15.44:0/3938022138 >> v2:172.21.15.44:3300/0 conn(0x7ff170155cf0 0x7ff1700c5a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-17T19:47:23.296 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:23.297+0000 7f44d1c00640 1 -- 172.21.15.44:0/1554926358 shutdown_connections 2024-04-17T19:47:23.296 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:23.297+0000 7f44d1c00640 1 -- 172.21.15.44:0/1554926358 wait complete. 2024-04-17T19:47:23.297 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:23.301+0000 7fbf25a00640 1 -- 172.21.15.44:0/998891504 >> v1:172.21.15.62:6789/0 conn(0x7fbf180db2b0 legacy=0x7fbf180060f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:23.297 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:23.301+0000 7fbf25a00640 1 -- 172.21.15.44:0/998891504 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbf18046780 con 0x7fbf180e3c20 2024-04-17T19:47:23.297 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:23.301+0000 7f44d1c00640 1 Processor -- start 2024-04-17T19:47:23.298 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:23.301+0000 7f44d1c00640 1 -- start start 2024-04-17T19:47:23.298 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:23.301+0000 7f96f4800640 1 Processor -- start 2024-04-17T19:47:23.298 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:23.301+0000 7f2276a00640 1 Processor -- start 2024-04-17T19:47:23.298 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:23.301+0000 7f2276a00640 1 -- start start 2024-04-17T19:47:23.299 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:23.301+0000 7f1e7b600640 1 Processor -- start 2024-04-17T19:47:23.299 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:23.301+0000 7f96f4800640 1 -- start start 2024-04-17T19:47:23.299 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:23.301+0000 7f1e7b600640 1 -- start start 2024-04-17T19:47:23.300 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:23.305+0000 7f0acce00640 1 Processor -- start 2024-04-17T19:47:23.300 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:23.305+0000 7f44d1c00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f44c40082d0 0x7f44c40d50b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:23.300 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:23.305+0000 7f96f4800640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f96d4004100 0x7f96e8050ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:23.301 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:23.305+0000 7ff175200640 1 --2- 172.21.15.44:0/3938022138 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7ff170072db0 0x7ff170166320 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7ff17006c930 tx=0x7ff16801f1a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4cd4cdf91aeb4a62 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:47:23.301 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:23.305+0000 7f96f4800640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f96e80d08f0 0x7f96e80c8e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:23.302 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:23.305+0000 7f44d1c00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f44c404c930 0x7f44c404a620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:23.302 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:23.305+0000 7f44caa00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f44c40082d0 0x7f44c40d50b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:23.302 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:23.305+0000 7ff16ea00640 1 -- 172.21.15.44:0/3938022138 <== mon.2 v2:172.21.15.62:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1680b4070 con 0x7ff170072db0 2024-04-17T19:47:23.302 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:23.305+0000 7f2276a00640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f22700ca050 0x7f2270159040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:23.302 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:23.305+0000 7f2276a00640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f22700c3df0 0x7f22700739a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:23.303 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:23.305+0000 7ff16ea00640 1 -- 172.21.15.44:0/3938022138 <== mon.2 v2:172.21.15.62:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff1680af400 con 0x7ff170072db0 2024-04-17T19:47:23.303 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:23.305+0000 7ff16ea00640 1 -- 172.21.15.44:0/3938022138 <== mon.2 v2:172.21.15.62:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1680af7d0 con 0x7ff170072db0 2024-04-17T19:47:23.303 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:23.305+0000 7f96f4800640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f96e80c5d40 0x7f96e80c6150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:23.303 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:23.305+0000 7f96f4800640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f96e80dde60 con 0x7f96e80c5d40 2024-04-17T19:47:23.303 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:23.305+0000 7f96f4800640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f96e80dd140 con 0x7f96d4004100 2024-04-17T19:47:23.303 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:23.305+0000 7f96f4800640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7f96e80e0f20 con 0x7f96e80d08f0 2024-04-17T19:47:23.303 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:23.305+0000 7f96f1e00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f96d4004100 0x7f96e8050ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:23.303 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:23.305+0000 7f96f1e00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f96d4004100 0x7f96e8050ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.44:49238/0 (socket says 172.21.15.44:49238) 2024-04-17T19:47:23.304 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:23.305+0000 7f96f1e00640 1 -- 172.21.15.44:0/2512168697 learned_addr learned my addr 172.21.15.44:0/2512168697 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-04-17T19:47:23.304 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:23.305+0000 7f96f2800640 1 --2- 172.21.15.44:0/2512168697 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f96e80c5d40 0x7f96e80c6150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:23.304 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:23.305+0000 7f44d1c00640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f44c404d170 0x7f44c4167b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:23.304 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:23.305+0000 7f44d1c00640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f44c40076a0 con 0x7f44c404c930 2024-04-17T19:47:23.304 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:23.305+0000 7f44d1c00640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f44c40073c0 con 0x7f44c40082d0 2024-04-17T19:47:23.304 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:23.305+0000 7f44d1c00640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7f44c40d2790 con 0x7f44c404d170 2024-04-17T19:47:23.304 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:23.305+0000 7f2276a00640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f22700c9a30 con 0x7f2270073590 2024-04-17T19:47:23.304 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:23.305+0000 7f2276a00640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 -- 0x7f2270159580 con 0x7f22700c3df0 2024-04-17T19:47:23.305 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:23.305+0000 7f2276a00640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7f22700c85f0 con 0x7f22700ca050 2024-04-17T19:47:23.305 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:23.305+0000 7f226f400640 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f2270073590 0x7f22700c36e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.44:60918/0 (socket says 172.21.15.44:60918) 2024-04-17T19:47:23.305 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:23.305+0000 7f226f400640 1 -- 172.21.15.44:0/755840630 learned_addr learned my addr 172.21.15.44:0/755840630 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-04-17T19:47:23.305 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:23.305+0000 7f226fe00640 1 --2- 172.21.15.44:0/755840630 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f22700ca050 0x7f2270159040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:23.305 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:23.305+0000 7f2274a00640 1 --2- 172.21.15.44:0/755840630 >> v2:172.21.15.62:3300/0 conn(0x7f22700c3df0 0x7f22700739a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:23.305 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:23.305+0000 7fbf25a00640 1 --2- 172.21.15.44:0/998891504 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fbf180e3c20 0x7fbf180e6040 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fbf140071d0 tx=0x7fbf1401fb40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=487e3a640c5f5ddd server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:47:23.305 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:23.305+0000 7f44caa00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f44c40082d0 0x7f44c40d50b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.44:49236/0 (socket says 172.21.15.44:49236) 2024-04-17T19:47:23.305 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:23.305+0000 7f44caa00640 1 -- 172.21.15.44:0/4231690101 learned_addr learned my addr 172.21.15.44:0/4231690101 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-04-17T19:47:23.306 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:23.305+0000 7f1e7b600640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f1e740ca670 0x7f1e740caa80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:23.306 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:23.305+0000 7f1e7b600640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f1e74160700 0x7f1e74160b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:23.306 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:23.305+0000 7f1e7b600640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1e74163910 con 0x7f1e740c98f0 2024-04-17T19:47:23.306 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:23.305+0000 7f1e7b600640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 -- 0x7f1e741636e0 con 0x7f1e740ca670 2024-04-17T19:47:23.306 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:23.305+0000 7f1e7b600640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7f1e74160270 con 0x7f1e74160700 2024-04-17T19:47:23.307 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:23.305+0000 7f44ca000640 1 --2- 172.21.15.44:0/4231690101 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f44c404c930 0x7f44c404a620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:23.307 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:23.305+0000 7f44cb400640 1 --2- 172.21.15.44:0/4231690101 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f44c404d170 0x7f44c4167b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:23.307 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:23.305+0000 7f96f2800640 1 -- 172.21.15.44:0/2512168697 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f96e80d08f0 msgr2=0x7f96e80c8e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:23.307 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:23.305+0000 7f226ea00640 1 -- 172.21.15.44:0/755840630 <== mon.1 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1913105620 0 0) 0x7f22700c9a30 con 0x7f2270073590 2024-04-17T19:47:23.307 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:23.305+0000 7f226ea00640 1 -- 172.21.15.44:0/755840630 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2254003530 con 0x7f2270073590 2024-04-17T19:47:23.308 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:23.305+0000 7f96f2800640 1 --2- 172.21.15.44:0/2512168697 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f96e80d08f0 0x7f96e80c8e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:23.308 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:23.305+0000 7f96f2800640 1 -- 172.21.15.44:0/2512168697 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f96d4004100 msgr2=0x7f96e8050ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:23.308 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:23.305+0000 7f96f2800640 1 --2- 172.21.15.44:0/2512168697 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f96d4004100 0x7f96e8050ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:23.308 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:23.305+0000 7f96f2800640 1 -- 172.21.15.44:0/2512168697 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f96e8051020 con 0x7f96e80c5d40 2024-04-17T19:47:23.308 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:23.305+0000 7f226fe00640 1 -- 172.21.15.44:0/755840630 >> v2:172.21.15.62:3300/0 conn(0x7f22700c3df0 msgr2=0x7f22700739a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T19:47:23.308 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:23.305+0000 7f226fe00640 1 --2- 172.21.15.44:0/755840630 >> v2:172.21.15.62:3300/0 conn(0x7f22700c3df0 0x7f22700739a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:23.308 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:23.305+0000 7f226fe00640 1 -- 172.21.15.44:0/755840630 >> v1:172.21.15.62:6789/0 conn(0x7f2270073590 legacy=0x7f22700c36e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:23.308 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:23.305+0000 7f226fe00640 1 -- 172.21.15.44:0/755840630 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f22700c9cd0 con 0x7f22700ca050 2024-04-17T19:47:23.309 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:23.309+0000 7f44caa00640 1 -- 172.21.15.44:0/4231690101 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f44c404d170 msgr2=0x7f44c4167b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:23.309 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:23.309+0000 7f44caa00640 1 --2- 172.21.15.44:0/4231690101 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f44c404d170 0x7f44c4167b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:23.309 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:23.309+0000 7f44caa00640 1 -- 172.21.15.44:0/4231690101 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f44c404c930 msgr2=0x7f44c404a620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:23.309 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:23.309+0000 7f44caa00640 1 --2- 172.21.15.44:0/4231690101 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f44c404c930 0x7f44c404a620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:23.309 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:23.309+0000 7f44caa00640 1 -- 172.21.15.44:0/4231690101 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f44c41686c0 con 0x7f44c40082d0 2024-04-17T19:47:23.309 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:23.305+0000 7f1e73e00640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f1e740c98f0 0x7f1e740c9d00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:50458/0 (socket says 172.21.15.44:50458) 2024-04-17T19:47:23.309 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:23.305+0000 7f1e73e00640 1 -- 172.21.15.44:0/4128293249 learned_addr learned my addr 172.21.15.44:0/4128293249 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-04-17T19:47:23.309 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:23.309+0000 7f1e78c00640 1 --2- 172.21.15.44:0/4128293249 >> v2:172.21.15.62:3300/0 conn(0x7f1e740ca670 0x7f1e740caa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:23.310 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:23.309+0000 7f1e79600640 1 --2- 172.21.15.44:0/4128293249 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f1e74160700 0x7f1e74160b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:23.310 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:23.309+0000 7f96f2800640 1 --2- 172.21.15.44:0/2512168697 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f96e80c5d40 0x7f96e80c6150 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f96ec063960 tx=0x7f96d4005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:47:23.310 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:23.309+0000 7ff175c00640 1 -- 172.21.15.44:0/3938022138 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7ff170072db0 msgr2=0x7ff170166320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:23.310 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:23.309+0000 7ff175c00640 1 --2- 172.21.15.44:0/3938022138 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7ff170072db0 0x7ff170166320 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7ff17006c930 tx=0x7ff16801f1a0 comp rx=0 tx=0).stop 2024-04-17T19:47:23.311 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:23.305+0000 7f0acce00640 1 -- start start 2024-04-17T19:47:23.311 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:23.309+0000 7ff175c00640 1 -- 172.21.15.44:0/3938022138 shutdown_connections 2024-04-17T19:47:23.311 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:23.309+0000 7ff175c00640 1 --2- 172.21.15.44:0/3938022138 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7ff170072db0 0x7ff170166320 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:23.311 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:23.309+0000 7ff175c00640 1 --2- 172.21.15.44:0/3938022138 >> v2:172.21.15.44:3300/0 conn(0x7ff170155cf0 0x7ff1700c5a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:23.311 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:23.309+0000 7ff175c00640 1 -- 172.21.15.44:0/3938022138 >> 172.21.15.44:0/3938022138 conn(0x7ff17006c380 msgr2=0x7ff17006ffb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:47:23.312 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:23.309+0000 7ff175c00640 1 -- 172.21.15.44:0/3938022138 shutdown_connections 2024-04-17T19:47:23.312 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:23.309+0000 7ff175c00640 1 -- 172.21.15.44:0/3938022138 wait complete. 2024-04-17T19:47:23.312 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:23.309+0000 7f44caa00640 1 --2- 172.21.15.44:0/4231690101 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f44c40082d0 0x7f44c40d50b0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f44cc051840 tx=0x7f44cc09a400 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:47:23.312 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:23.309+0000 7fbf1f400640 1 -- 172.21.15.44:0/998891504 <== mon.2 v2:172.21.15.62:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf200775a0 con 0x7fbf180e3c20 2024-04-17T19:47:23.312 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:23.309+0000 7fbf1f400640 1 -- 172.21.15.44:0/998891504 <== mon.2 v2:172.21.15.62:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbf140089e0 con 0x7fbf180e3c20 2024-04-17T19:47:23.312 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:23.309+0000 7fbf1f400640 1 -- 172.21.15.44:0/998891504 <== mon.2 v2:172.21.15.62:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf14008db0 con 0x7fbf180e3c20 2024-04-17T19:47:23.313 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:23.309+0000 7f96e6000640 1 -- 172.21.15.44:0/2512168697 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96ec04fea0 con 0x7f96e80c5d40 2024-04-17T19:47:23.313 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:23.309+0000 7f96e6000640 1 -- 172.21.15.44:0/2512168697 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f96ec050410 con 0x7f96e80c5d40 2024-04-17T19:47:23.313 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:23.309+0000 7f96e6000640 1 -- 172.21.15.44:0/2512168697 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96ec0775a0 con 0x7f96e80c5d40 2024-04-17T19:47:23.313 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:23.309+0000 7f0acce00640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f0ac815b980 0x7f0ac8151570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:23.314 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:23.309+0000 7f0acce00640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f0ac8151ab0 0x7f0ac8157cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:23.314 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:23.309+0000 7f1e73400640 1 -- 172.21.15.44:0/4128293249 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2689606584 0 0) 0x7f1e74163910 con 0x7f1e740c98f0 2024-04-17T19:47:23.314 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:23.309+0000 7f1e73400640 1 -- 172.21.15.44:0/4128293249 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1e58003530 con 0x7f1e740c98f0 2024-04-17T19:47:23.314 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:23.309+0000 7f1e73400640 1 -- 172.21.15.44:0/4128293249 <== mon.0 v1:172.21.15.44:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2930826403 0 0) 0x7f1e58003530 con 0x7f1e740c98f0 2024-04-17T19:47:23.314 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:23.309+0000 7f1e73400640 1 -- 172.21.15.44:0/4128293249 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f1e74160700 msgr2=0x7f1e74160b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T19:47:23.314 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:23.309+0000 7f1e73400640 1 --2- 172.21.15.44:0/4128293249 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f1e74160700 0x7f1e74160b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:23.314 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:23.309+0000 7f1e73400640 1 -- 172.21.15.44:0/4128293249 >> v2:172.21.15.62:3300/0 conn(0x7f1e740ca670 msgr2=0x7f1e740caa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T19:47:23.314 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:23.309+0000 7f1e73400640 1 --2- 172.21.15.44:0/4128293249 >> v2:172.21.15.62:3300/0 conn(0x7f1e740ca670 0x7f1e740caa80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:23.315 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:23.309+0000 7f1e73400640 1 -- 172.21.15.44:0/4128293249 --> v1:172.21.15.44:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1e74163bf0 con 0x7f1e740c98f0 2024-04-17T19:47:23.315 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:23.309+0000 7f96f4800640 1 -- 172.21.15.44:0/2512168697 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f96e8175190 con 0x7f96e80c5d40 2024-04-17T19:47:23.315 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:23.309+0000 7f0acce00640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0ac815bd90 con 0x7f0ac8158210 2024-04-17T19:47:23.315 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:23.309+0000 7f0acce00640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 -- 0x7f0ac8151ec0 con 0x7f0ac8151ab0 2024-04-17T19:47:23.315 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:23.309+0000 7f0acce00640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7f0ac80c9050 con 0x7f0ac815b980 2024-04-17T19:47:23.315 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:23.309+0000 7f0ac7400640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f0ac815b980 0x7f0ac8151570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:23.316 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:23.309+0000 7f1e73400640 1 -- 172.21.15.44:0/4128293249 <== mon.0 v1:172.21.15.44:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1863569991 0 0) 0x7f1e60001680 con 0x7f1e740c98f0 2024-04-17T19:47:23.316 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:23.309+0000 7f1e73400640 1 -- 172.21.15.44:0/4128293249 >> v1:172.21.15.44:6789/0 conn(0x7f1e740c98f0 legacy=0x7f1e740c9d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:23.316 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:23.309+0000 7f1e73400640 1 --2- 172.21.15.44:0/4128293249 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1e580039c0 0x7f1e58003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:23.316 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:23.309+0000 7f1e73400640 1 --2- 172.21.15.44:0/4128293249 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f1e58004810 0x7f1e58004c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:23.316 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:23.309+0000 7f1e73400640 1 --2- 172.21.15.44:0/4128293249 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1e58005160 0x7f1e5800b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:23.316 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:23.309+0000 7f1e73400640 1 -- 172.21.15.44:0/4128293249 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f1e74160270 con 0x7f1e580039c0 2024-04-17T19:47:23.316 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:23.309+0000 7f1e73400640 1 -- 172.21.15.44:0/4128293249 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f1e5800bfc0 con 0x7f1e58005160 2024-04-17T19:47:23.316 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:23.309+0000 7f1e73400640 1 -- 172.21.15.44:0/4128293249 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7f1e5800c1c0 con 0x7f1e58004810 2024-04-17T19:47:23.317 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:23.309+0000 7f96f4800640 1 -- 172.21.15.44:0/2512168697 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f96e8175750 con 0x7f96e80c5d40 2024-04-17T19:47:23.317 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:23.309+0000 7f0ac7400640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f0ac815b980 0x7f0ac8151570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3301/0 says I am v2:172.21.15.44:43434/0 (socket says 172.21.15.44:43434) 2024-04-17T19:47:23.317 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:23.309+0000 7f0ac7400640 1 -- 172.21.15.44:0/765577825 learned_addr learned my addr 172.21.15.44:0/765577825 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-04-17T19:47:23.317 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:23.309+0000 7f0ac6a00640 1 --2- 172.21.15.44:0/765577825 >> v2:172.21.15.62:3300/0 conn(0x7f0ac8151ab0 0x7f0ac8157cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:23.317 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:23.309+0000 7f1e73e00640 1 --2- 172.21.15.44:0/4128293249 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f1e58004810 0x7f1e58004c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:23.318 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:23.309+0000 7f44c2a00640 1 -- 172.21.15.44:0/4231690101 <== mon.1 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44cc12d440 con 0x7f44c40082d0 2024-04-17T19:47:23.318 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:23.309+0000 7f44c2a00640 1 -- 172.21.15.44:0/4231690101 <== mon.1 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f44cc12d5e0 con 0x7f44c40082d0 2024-04-17T19:47:23.318 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:23.309+0000 7f44c2a00640 1 -- 172.21.15.44:0/4231690101 <== mon.1 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44cc12d790 con 0x7f44c40082d0 2024-04-17T19:47:23.318 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:23.309+0000 7fbf26400640 1 -- 172.21.15.44:0/998891504 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fbf180e3c20 msgr2=0x7fbf180e6040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:23.318 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:23.309+0000 7fbf26400640 1 --2- 172.21.15.44:0/998891504 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fbf180e3c20 0x7fbf180e6040 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fbf140071d0 tx=0x7fbf1401fb40 comp rx=0 tx=0).stop 2024-04-17T19:47:23.319 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:23.309+0000 7f0ac7400640 1 -- 172.21.15.44:0/765577825 >> v2:172.21.15.62:3300/0 conn(0x7f0ac8151ab0 msgr2=0x7f0ac8157cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T19:47:23.319 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:23.309+0000 7f0ac7400640 1 --2- 172.21.15.44:0/765577825 >> v2:172.21.15.62:3300/0 conn(0x7f0ac8151ab0 0x7f0ac8157cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:23.319 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:23.309+0000 7f44d1c00640 1 -- 172.21.15.44:0/4231690101 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f44c4174e10 con 0x7f44c40082d0 2024-04-17T19:47:23.319 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:23.309+0000 7f44d1c00640 1 -- 172.21.15.44:0/4231690101 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f44c41753d0 con 0x7f44c40082d0 2024-04-17T19:47:23.320 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:23.309+0000 7f1e79600640 1 --2- 172.21.15.44:0/4128293249 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1e58005160 0x7f1e5800b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:23.320 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:23.309+0000 7f1e73e00640 1 -- 172.21.15.44:0/4128293249 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1e58005160 msgr2=0x7f1e5800b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T19:47:23.320 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:23.309+0000 7f1e73e00640 1 --2- 172.21.15.44:0/4128293249 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1e58005160 0x7f1e5800b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:23.320 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:23.309+0000 7f1e73e00640 1 -- 172.21.15.44:0/4128293249 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1e580039c0 msgr2=0x7f1e58003e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T19:47:23.320 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:23.309+0000 7f1e78c00640 1 --2- 172.21.15.44:0/4128293249 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1e580039c0 0x7f1e58003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:23.320 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:23.309+0000 7f96f4800640 1 -- 172.21.15.44:0/2512168697 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f96e8005900 con 0x7f96e80c5d40 2024-04-17T19:47:23.320 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:23.313+0000 7f96e6000640 1 -- 172.21.15.44:0/2512168697 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f96ec138030 con 0x7f96e80c5d40 2024-04-17T19:47:23.321 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:23.309+0000 7f0ac7400640 1 -- 172.21.15.44:0/765577825 >> v1:172.21.15.44:6789/0 conn(0x7f0ac8158210 legacy=0x7f0ac80c9490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T19:47:23.321 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:23.309+0000 7f0ac7400640 1 -- 172.21.15.44:0/765577825 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0ac80c8a90 con 0x7f0ac815b980 2024-04-17T19:47:23.321 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:23.309+0000 7fbf26400640 1 -- 172.21.15.44:0/998891504 shutdown_connections 2024-04-17T19:47:23.321 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:23.309+0000 7fbf26400640 1 --2- 172.21.15.44:0/998891504 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fbf180e3c20 0x7fbf180e6040 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:23.321 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:23.309+0000 7fbf26400640 1 --2- 172.21.15.44:0/998891504 >> v2:172.21.15.62:3300/0 conn(0x7fbf1804bb30 0x7fbf1804bf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:23.321 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:23.309+0000 7fbf26400640 1 -- 172.21.15.44:0/998891504 >> 172.21.15.44:0/998891504 conn(0x7fbf180503c0 msgr2=0x7fbf180507d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:47:23.321 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:23.313+0000 7fbf26400640 1 -- 172.21.15.44:0/998891504 shutdown_connections 2024-04-17T19:47:23.321 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:23.313+0000 7fbf26400640 1 -- 172.21.15.44:0/998891504 wait complete. 2024-04-17T19:47:23.322 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:23.313+0000 7f44b7e00640 1 -- 172.21.15.44:0/4231690101 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f44a00052a0 con 0x7f44c40082d0 2024-04-17T19:47:23.322 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:23.313+0000 7f96e6000640 1 --2- 172.21.15.44:0/2512168697 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f96d0068380 0x7f96d006a890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:23.322 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:23.313+0000 7f96e6000640 1 -- 172.21.15.44:0/2512168697 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f96ec19cb10 con 0x7f96e80c5d40 2024-04-17T19:47:23.323 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:23.313+0000 7f44c2a00640 1 -- 172.21.15.44:0/4231690101 <== mon.1 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f44cc13c030 con 0x7f44c40082d0 2024-04-17T19:47:23.323 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:23.313+0000 7f1e73e00640 1 --2- 172.21.15.44:0/4128293249 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1e580039c0 0x7f1e58003e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:23.323 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:23.313+0000 7f96f1e00640 1 --2- 172.21.15.44:0/2512168697 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f96d0068380 0x7f96d006a890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:23.323 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:23.313+0000 7f1e73e00640 1 -- 172.21.15.44:0/4128293249 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1e74163bf0 con 0x7f1e58004810 2024-04-17T19:47:23.324 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:23.313+0000 7ff175c00640 1 Processor -- start 2024-04-17T19:47:23.324 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:23.317+0000 7ff175c00640 1 -- start start 2024-04-17T19:47:23.324 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:23.317+0000 7f1e78c00640 1 --2- 172.21.15.44:0/4128293249 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1e580039c0 0x7f1e58003e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-17T19:47:23.324 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:23.317+0000 7fbf26400640 1 Processor -- start 2024-04-17T19:47:23.325 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:23.317+0000 7f78a6200640 1 Processor -- start 2024-04-17T19:47:23.325 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:23.317+0000 7fbf26400640 1 -- start start 2024-04-17T19:47:23.325 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:23.317+0000 7f78a6200640 1 -- start start 2024-04-17T19:47:23.325 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:23.317+0000 7f0ac7400640 1 --2- 172.21.15.44:0/765577825 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f0ac815b980 0x7f0ac8151570 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f0ac8071d90 tx=0x7f0ab801c4b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=63ee774169f66a89 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:47:23.326 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:23.317+0000 7f96f1e00640 1 --2- 172.21.15.44:0/2512168697 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f96d0068380 0x7f96d006a890 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f96e00099d0 tx=0x7f96e0009190 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:47:23.326 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:23.317+0000 7f44c2a00640 1 --2- 172.21.15.44:0/4231690101 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f44ac0683d0 0x7f44ac06a8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:23.326 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:23.317+0000 7f44c2a00640 1 -- 172.21.15.44:0/4231690101 <== mon.1 v2:172.21.15.62:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f44cc1a0400 con 0x7f44c40082d0 2024-04-17T19:47:23.326 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:23.317+0000 7f44ca000640 1 --2- 172.21.15.44:0/4231690101 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f44ac0683d0 0x7f44ac06a8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:23.327 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:23.317+0000 7ff175c00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff1700729a0 0x7ff17015d7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:23.327 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:23.317+0000 7ff175c00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff170072db0 0x7ff17015e670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:23.327 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:23.317+0000 7ff175c00640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7ff170155cf0 0x7ff17015ebb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:23.327 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:23.317+0000 7ff175c00640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7ff170072480 con 0x7ff170072db0 2024-04-17T19:47:23.327 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:23.317+0000 7ff175c00640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7ff1700c9eb0 con 0x7ff1700729a0 2024-04-17T19:47:23.327 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:23.317+0000 7ff175c00640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7ff1700c5f80 con 0x7ff170155cf0 2024-04-17T19:47:23.327 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:23.313+0000 7f226fe00640 1 --2- 172.21.15.44:0/755840630 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f22700ca050 0x7f2270159040 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f225c0097f0 tx=0x7f225c01ec90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=47901e836f476c84 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:47:23.327 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:23.317+0000 7f226ea00640 1 -- 172.21.15.44:0/755840630 <== mon.2 v2:172.21.15.62:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f225c0b5070 con 0x7f22700ca050 2024-04-17T19:47:23.328 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:23.317+0000 7f226ea00640 1 -- 172.21.15.44:0/755840630 <== mon.2 v2:172.21.15.62:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f225c0a8990 con 0x7f22700ca050 2024-04-17T19:47:23.328 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:23.317+0000 7f226ea00640 1 -- 172.21.15.44:0/755840630 <== mon.2 v2:172.21.15.62:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f225c0b5070 con 0x7f22700ca050 2024-04-17T19:47:23.328 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:23.317+0000 7f2276a00640 1 -- 172.21.15.44:0/755840630 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f22700ca050 msgr2=0x7f2270159040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:23.328 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:23.317+0000 7f2276a00640 1 --2- 172.21.15.44:0/755840630 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f22700ca050 0x7f2270159040 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f225c0097f0 tx=0x7f225c01ec90 comp rx=0 tx=0).stop 2024-04-17T19:47:23.328 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:23.317+0000 7f0ac6000640 1 -- 172.21.15.44:0/765577825 <== mon.2 v2:172.21.15.62:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ab80a7070 con 0x7f0ac815b980 2024-04-17T19:47:23.328 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:23.317+0000 7f0ac6000640 1 -- 172.21.15.44:0/765577825 <== mon.2 v2:172.21.15.62:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0ab80b0070 con 0x7f0ac815b980 2024-04-17T19:47:23.328 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:23.317+0000 7f0ac6000640 1 -- 172.21.15.44:0/765577825 <== mon.2 v2:172.21.15.62:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ab80a7070 con 0x7f0ac815b980 2024-04-17T19:47:23.328 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:23.317+0000 7f0acce00640 1 -- 172.21.15.44:0/765577825 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f0ac815b980 msgr2=0x7f0ac8151570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:23.328 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:23.317+0000 7f0acce00640 1 --2- 172.21.15.44:0/765577825 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f0ac815b980 0x7f0ac8151570 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f0ac8071d90 tx=0x7f0ab801c4b0 comp rx=0 tx=0).stop 2024-04-17T19:47:23.329 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:23.317+0000 7fbf26400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbf1804bb30 0x7fbf18175a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:23.329 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:23.317+0000 7fbf26400640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbf180db2b0 0x7fbf180c44c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:23.329 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:23.317+0000 7f0acce00640 1 -- 172.21.15.44:0/765577825 shutdown_connections 2024-04-17T19:47:23.330 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:23.317+0000 7fbf26400640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fbf180e3c20 0x7fbf180c81c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:23.330 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:23.317+0000 7fbf26400640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fbf18047020 con 0x7fbf1804bb30 2024-04-17T19:47:23.330 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:23.317+0000 7f44ca000640 1 --2- 172.21.15.44:0/4231690101 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f44ac0683d0 0x7f44ac06a8e0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f44c404b4d0 tx=0x7f44b8009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:47:23.330 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:23.317+0000 7ff16fe00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff1700729a0 0x7ff17015d7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:23.330 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:23.317+0000 7ff16f400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff170072db0 0x7ff17015e670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:23.331 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:23.317+0000 7ff16fe00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff1700729a0 0x7ff17015d7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.44:49274/0 (socket says 172.21.15.44:49274) 2024-04-17T19:47:23.331 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:23.317+0000 7ff16fe00640 1 -- 172.21.15.44:0/3878244707 learned_addr learned my addr 172.21.15.44:0/3878244707 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-04-17T19:47:23.331 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:23.317+0000 7f0acce00640 1 --2- 172.21.15.44:0/765577825 >> v2:172.21.15.62:3300/0 conn(0x7f0ac8151ab0 0x7f0ac8157cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:23.331 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:23.317+0000 7fbf26400640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7fbf18046d40 con 0x7fbf180db2b0 2024-04-17T19:47:23.331 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:23.317+0000 7fbf26400640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7fbf180341b0 con 0x7fbf180e3c20 2024-04-17T19:47:23.332 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:23.317+0000 7fbf1fe00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbf180db2b0 0x7fbf180c44c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:23.332 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:23.317+0000 7fbf1fe00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbf180db2b0 0x7fbf180c44c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.44:49280/0 (socket says 172.21.15.44:49280) 2024-04-17T19:47:23.332 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:23.317+0000 7fbf1fe00640 1 -- 172.21.15.44:0/4069335776 learned_addr learned my addr 172.21.15.44:0/4069335776 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-04-17T19:47:23.332 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:23.317+0000 7f0acce00640 1 --2- 172.21.15.44:0/765577825 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f0ac815b980 0x7f0ac8151570 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:23.332 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:23.317+0000 7f0acce00640 1 -- 172.21.15.44:0/765577825 >> 172.21.15.44:0/765577825 conn(0x7f0ac806c380 msgr2=0x7f0ac806ffb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:47:23.333 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:23.317+0000 7fbf25a00640 1 --2- 172.21.15.44:0/4069335776 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fbf180e3c20 0x7fbf180c81c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:23.333 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:23.317+0000 7f0acce00640 1 -- 172.21.15.44:0/765577825 shutdown_connections 2024-04-17T19:47:23.333 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:23.317+0000 7f0acce00640 1 -- 172.21.15.44:0/765577825 wait complete. 2024-04-17T19:47:23.333 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:23.317+0000 7ff175200640 1 --2- 172.21.15.44:0/3878244707 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7ff170155cf0 0x7ff17015ebb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:23.333 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:23.321+0000 7ff16f400640 1 -- 172.21.15.44:0/3878244707 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7ff170155cf0 msgr2=0x7ff17015ebb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:23.333 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:23.321+0000 7ff16f400640 1 --2- 172.21.15.44:0/3878244707 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7ff170155cf0 0x7ff17015ebb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:23.334 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:23.321+0000 7ff16f400640 1 -- 172.21.15.44:0/3878244707 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff1700729a0 msgr2=0x7ff17015d7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:23.334 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:23.321+0000 7ff16f400640 1 --2- 172.21.15.44:0/3878244707 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff1700729a0 0x7ff17015d7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:23.334 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:23.321+0000 7f2276a00640 1 -- 172.21.15.44:0/755840630 shutdown_connections 2024-04-17T19:47:23.334 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:23.321+0000 7f2276a00640 1 --2- 172.21.15.44:0/755840630 >> v2:172.21.15.62:3300/0 conn(0x7f22700c3df0 0x7f22700739a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:23.334 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:23.321+0000 7f2276a00640 1 --2- 172.21.15.44:0/755840630 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f22700ca050 0x7f2270159040 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:23.334 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:23.321+0000 7f2276a00640 1 -- 172.21.15.44:0/755840630 >> 172.21.15.44:0/755840630 conn(0x7f227006d490 msgr2=0x7f22700cdbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:47:23.335 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:23.321+0000 7f78a6200640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f78a00c81c0 0x7f78a0151da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:23.335 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:23.321+0000 7f78a6200640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f78a00c3ed0 0x7f78a00c42e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:23.335 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:23.321+0000 7f78a6200640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f78a0157d20 con 0x7f78a00cbc60 2024-04-17T19:47:23.335 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:23.321+0000 7f78a6200640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 -- 0x7f78a00c8a70 con 0x7f78a00c81c0 2024-04-17T19:47:23.335 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:23.321+0000 7f78a6200640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7f78a01522e0 con 0x7f78a00c3ed0 2024-04-17T19:47:23.335 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:23.321+0000 7fbf25000640 1 --2- 172.21.15.44:0/4069335776 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbf1804bb30 0x7fbf18175a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:23.335 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:23.321+0000 7fbf1fe00640 1 -- 172.21.15.44:0/4069335776 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fbf180e3c20 msgr2=0x7fbf180c81c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:23.336 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:23.321+0000 7fbf1fe00640 1 --2- 172.21.15.44:0/4069335776 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fbf180e3c20 0x7fbf180c81c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:23.336 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:23.321+0000 7fbf1fe00640 1 -- 172.21.15.44:0/4069335776 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbf1804bb30 msgr2=0x7fbf18175a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:23.336 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:23.321+0000 7fbf1fe00640 1 --2- 172.21.15.44:0/4069335776 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbf1804bb30 0x7fbf18175a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:23.336 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:23.321+0000 7f789f400640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f78a00c81c0 0x7f78a0151da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:23.336 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:23.321+0000 7ff16f400640 1 -- 172.21.15.44:0/3878244707 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff1701e4dd0 con 0x7ff170072db0 2024-04-17T19:47:23.336 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:23.321+0000 7f2276a00640 1 -- 172.21.15.44:0/755840630 shutdown_connections 2024-04-17T19:47:23.337 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:23.321+0000 7f789f400640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f78a00c81c0 0x7f78a0151da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.44:49282/0 (socket says 172.21.15.44:49282) 2024-04-17T19:47:23.337 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:23.321+0000 7f789f400640 1 -- 172.21.15.44:0/1259690706 learned_addr learned my addr 172.21.15.44:0/1259690706 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-04-17T19:47:23.337 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:23.321+0000 7fbf1fe00640 1 -- 172.21.15.44:0/4069335776 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbf18175f50 con 0x7fbf180db2b0 2024-04-17T19:47:23.337 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:23.321+0000 7f2276a00640 1 -- 172.21.15.44:0/755840630 wait complete. 2024-04-17T19:47:23.338 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:23.321+0000 7fbf25000640 1 --2- 172.21.15.44:0/4069335776 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbf1804bb30 0x7fbf18175a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-17T19:47:23.338 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:23.321+0000 7f7897e00640 1 --2- 172.21.15.44:0/1259690706 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f78a00c3ed0 0x7f78a00c42e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:23.338 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:23.321+0000 7f789f400640 1 -- 172.21.15.44:0/1259690706 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f78a00c3ed0 msgr2=0x7f78a00c42e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T19:47:23.338 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:23.321+0000 7f789f400640 1 --2- 172.21.15.44:0/1259690706 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f78a00c3ed0 0x7f78a00c42e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:23.338 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:23.321+0000 7f789f400640 1 -- 172.21.15.44:0/1259690706 >> v1:172.21.15.62:6789/0 conn(0x7f78a00cbc60 legacy=0x7f78a00cac50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T19:47:23.339 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:23.321+0000 7ff16f400640 1 --2- 172.21.15.44:0/3878244707 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff170072db0 0x7ff17015e670 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7ff16000b440 tx=0x7ff16000b900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:47:23.339 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:23.321+0000 7f789f400640 1 -- 172.21.15.44:0/1259690706 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f78a0157fc0 con 0x7f78a00c81c0 2024-04-17T19:47:23.339 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:23.321+0000 7fbf1fe00640 1 --2- 172.21.15.44:0/4069335776 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbf180db2b0 0x7fbf180c44c0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fbf0c00e870 tx=0x7fbf0c00ec70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:47:23.340 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:23.321+0000 7f1e73e00640 1 --2- 172.21.15.44:0/4128293249 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f1e58004810 0x7f1e58004c20 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f1e6000c2c0 tx=0x7f1e6001cce0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=271409950cb2af74 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:47:23.340 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:23.321+0000 7f1e73400640 1 -- 172.21.15.44:0/4128293249 <== mon.2 v2:172.21.15.62:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e60007d70 con 0x7f1e58004810 2024-04-17T19:47:23.340 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:23.321+0000 7f1e73400640 1 -- 172.21.15.44:0/4128293249 <== mon.2 v2:172.21.15.62:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1e600a9020 con 0x7f1e58004810 2024-04-17T19:47:23.340 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:23.321+0000 7f1e73400640 1 -- 172.21.15.44:0/4128293249 <== mon.2 v2:172.21.15.62:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e60005b00 con 0x7f1e58004810 2024-04-17T19:47:23.340 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:23.321+0000 7f0acce00640 1 Processor -- start 2024-04-17T19:47:23.341 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:23.321+0000 7f1e7b600640 1 -- 172.21.15.44:0/4128293249 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f1e58004810 msgr2=0x7f1e58004c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:23.341 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:23.321+0000 7f1e7b600640 1 --2- 172.21.15.44:0/4128293249 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f1e58004810 0x7f1e58004c20 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f1e6000c2c0 tx=0x7f1e6001cce0 comp rx=0 tx=0).stop 2024-04-17T19:47:23.341 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:23.321+0000 7f1e79600640 1 -- 172.21.15.44:0/4128293249 reap_dead start 2024-04-17T19:47:23.341 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:23.325+0000 7f1e7b600640 1 -- 172.21.15.44:0/4128293249 shutdown_connections 2024-04-17T19:47:23.341 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:23.325+0000 7f1e7b600640 1 -- 172.21.15.44:0/4128293249 >> 172.21.15.44:0/4128293249 conn(0x7f1e74070a00 msgr2=0x7f1e74067ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:47:23.341 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:23.325+0000 7f1e7b600640 1 -- 172.21.15.44:0/4128293249 shutdown_connections 2024-04-17T19:47:23.341 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:23.325+0000 7f1e7b600640 1 -- 172.21.15.44:0/4128293249 wait complete. 2024-04-17T19:47:23.341 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:23.325+0000 7f0acce00640 1 -- start start 2024-04-17T19:47:23.342 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:23.325+0000 7f2276a00640 1 Processor -- start 2024-04-17T19:47:23.342 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:23.325+0000 7ff167e00640 1 -- 172.21.15.44:0/3878244707 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff160011830 con 0x7ff170072db0 2024-04-17T19:47:23.342 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:23.325+0000 7ff167e00640 1 -- 172.21.15.44:0/3878244707 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff160016070 con 0x7ff170072db0 2024-04-17T19:47:23.342 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:23.325+0000 7ff167e00640 1 -- 172.21.15.44:0/3878244707 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff160011c10 con 0x7ff170072db0 2024-04-17T19:47:23.342 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:23.325+0000 7ff175c00640 1 -- 172.21.15.44:0/3878244707 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff1701e7700 con 0x7ff170072db0 2024-04-17T19:47:23.342 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:23.325+0000 7ff175c00640 1 -- 172.21.15.44:0/3878244707 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff17015cfd0 con 0x7ff170072db0 2024-04-17T19:47:23.343 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:23.325+0000 7f0acce00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0ac8151ab0 0x7f0ac8152650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:23.343 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:23.325+0000 7f0acce00640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f0ac8158210 0x7f0ac80ccdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:23.343 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:23.325+0000 7f96e6000640 1 -- 172.21.15.44:0/2512168697 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f96ec13f020 con 0x7f96e80c5d40 2024-04-17T19:47:23.343 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:23.325+0000 7f0ac7400640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0ac8151ab0 0x7f0ac8152650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:23.344 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:23.325+0000 7f0ac7400640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0ac8151ab0 0x7f0ac8152650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.44:49288/0 (socket says 172.21.15.44:49288) 2024-04-17T19:47:23.344 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:23.325+0000 7f2276a00640 1 -- start start 2024-04-17T19:47:23.344 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:23.325+0000 7f0ac7400640 1 -- 172.21.15.44:0/3893042583 learned_addr learned my addr 172.21.15.44:0/3893042583 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-04-17T19:47:23.344 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:23.325+0000 7f0ac6a00640 1 --2- 172.21.15.44:0/3893042583 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f0ac8158210 0x7f0ac80ccdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:23.345 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:23.325+0000 7f0acce00640 1 --2- 172.21.15.44:0/3893042583 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0ac815b980 0x7f0ac814e220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:23.345 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:23.325+0000 7f0acce00640 1 -- 172.21.15.44:0/3893042583 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f0ac8158620 con 0x7f0ac815b980 2024-04-17T19:47:23.345 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:23.325+0000 7f0acce00640 1 -- 172.21.15.44:0/3893042583 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f0ac80c4490 con 0x7f0ac8151ab0 2024-04-17T19:47:23.345 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:23.325+0000 7f0acce00640 1 -- 172.21.15.44:0/3893042583 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7f0ac80c4800 con 0x7f0ac8158210 2024-04-17T19:47:23.345 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:23.325+0000 7f1e7b600640 1 Processor -- start 2024-04-17T19:47:23.345 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:23.325+0000 7ff175c00640 1 -- 172.21.15.44:0/3878244707 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff1480052a0 con 0x7ff170072db0 2024-04-17T19:47:23.346 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:23.325+0000 7f0ac7e00640 1 --2- 172.21.15.44:0/3893042583 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0ac815b980 0x7f0ac814e220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:23.346 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:23.325+0000 7f789f400640 1 --2- 172.21.15.44:0/1259690706 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f78a00c81c0 0x7f78a0151da0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f78a0070d80 tx=0x7f789001ecf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d898df78568eb0ff server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:47:23.346 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:23.329+0000 7f0ac7400640 1 -- 172.21.15.44:0/3893042583 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f0ac8158210 msgr2=0x7f0ac80ccdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:23.346 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:23.329+0000 7f0ac7400640 1 --2- 172.21.15.44:0/3893042583 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f0ac8158210 0x7f0ac80ccdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:23.347 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:23.329+0000 7f0ac7400640 1 -- 172.21.15.44:0/3893042583 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0ac815b980 msgr2=0x7f0ac814e220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:23.347 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:23.329+0000 7f0ac7400640 1 --2- 172.21.15.44:0/3893042583 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0ac815b980 0x7f0ac814e220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:23.347 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:23.329+0000 7f2276a00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2270073590 0x7f22701f66d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:23.347 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:23.329+0000 7f2276a00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f22700c3df0 0x7f22701fa000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:23.347 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:23.329+0000 7f2276a00640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f22700ca050 0x7f22701e2940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:23.347 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:23.329+0000 7f44c2a00640 1 -- 172.21.15.44:0/4231690101 <== mon.1 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f44cc143020 con 0x7f44c40082d0 2024-04-17T19:47:23.348 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:23.329+0000 7f0ac7400640 1 -- 172.21.15.44:0/3893042583 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0ac814d9f0 con 0x7f0ac8151ab0 2024-04-17T19:47:23.348 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:23.329+0000 7f2276a00640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f22700c2ee0 con 0x7f22700c3df0 2024-04-17T19:47:23.348 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:23.329+0000 7f2276a00640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f22700c8b20 con 0x7f2270073590 2024-04-17T19:47:23.348 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:23.329+0000 7f2276a00640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7f22700c31c0 con 0x7f22700ca050 2024-04-17T19:47:23.348 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:23.329+0000 7f2274a00640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f22700ca050 0x7f22701e2940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:23.349 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:23.325+0000 7fbf1cc00640 1 -- 172.21.15.44:0/4069335776 <== mon.1 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf0c017070 con 0x7fbf180db2b0 2024-04-17T19:47:23.349 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:23.325+0000 7fbf1cc00640 1 -- 172.21.15.44:0/4069335776 <== mon.1 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbf0c00c940 con 0x7fbf180db2b0 2024-04-17T19:47:23.349 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:23.329+0000 7fbf1cc00640 1 -- 172.21.15.44:0/4069335776 <== mon.1 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf0c00ccf0 con 0x7fbf180db2b0 2024-04-17T19:47:23.349 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:23.329+0000 7f2274a00640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f22700ca050 0x7f22701e2940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3301/0 says I am v2:172.21.15.44:43476/0 (socket says 172.21.15.44:43476) 2024-04-17T19:47:23.349 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:23.329+0000 7f2274a00640 1 -- 172.21.15.44:0/4102192483 learned_addr learned my addr 172.21.15.44:0/4102192483 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-04-17T19:47:23.349 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:23.329+0000 7f226f400640 1 --2- 172.21.15.44:0/4102192483 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f22700c3df0 0x7f22701fa000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:23.349 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:23.329+0000 7fbf26400640 1 -- 172.21.15.44:0/4069335776 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbf180c5010 con 0x7fbf180db2b0 2024-04-17T19:47:23.350 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:23.329+0000 7f0ac7400640 1 --2- 172.21.15.44:0/3893042583 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0ac8151ab0 0x7f0ac8152650 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f0ab80ad040 tx=0x7f0ab8019250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:47:23.350 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:23.329+0000 7fbf26400640 1 -- 172.21.15.44:0/4069335776 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbf180c55c0 con 0x7fbf180db2b0 2024-04-17T19:47:23.350 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:23.329+0000 7f0abf400640 1 -- 172.21.15.44:0/3893042583 <== mon.1 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ab8003bb0 con 0x7f0ac8151ab0 2024-04-17T19:47:23.351 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:23.325+0000 7f1e7b600640 1 -- start start 2024-04-17T19:47:23.351 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:23.329+0000 7f1e7b600640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1e58004810 0x7f1e741fc840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:23.351 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:23.329+0000 7f1e7b600640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1e741527b0 0x7f1e7406dc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:23.351 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:23.329+0000 7f1e7b600640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f1e741531b0 0x7f1e74150820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:23.351 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:23.329+0000 7f1e7b600640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f1e7415a7d0 con 0x7f1e741527b0 2024-04-17T19:47:23.351 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:23.329+0000 7f1e7b600640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f1e740cb370 con 0x7f1e58004810 2024-04-17T19:47:23.351 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:23.329+0000 7f1e7b600640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7f1e741fce10 con 0x7f1e741531b0 2024-04-17T19:47:23.351 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:23.329+0000 7f0abf400640 1 -- 172.21.15.44:0/3893042583 <== mon.1 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0ab8003d50 con 0x7f0ac8151ab0 2024-04-17T19:47:23.351 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:23.329+0000 7f0abf400640 1 -- 172.21.15.44:0/3893042583 <== mon.1 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ab80ab670 con 0x7f0ac8151ab0 2024-04-17T19:47:23.352 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:23.329+0000 7f226f400640 1 -- 172.21.15.44:0/4102192483 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f22700ca050 msgr2=0x7f22701e2940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:23.352 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:23.329+0000 7f226f400640 1 --2- 172.21.15.44:0/4102192483 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f22700ca050 0x7f22701e2940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:23.352 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:23.329+0000 7f226f400640 1 -- 172.21.15.44:0/4102192483 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2270073590 msgr2=0x7f22701f66d0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-04-17T19:47:23.352 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:23.329+0000 7f226f400640 1 --2- 172.21.15.44:0/4102192483 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2270073590 0x7f22701f66d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:23.352 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:23.329+0000 7f226f400640 1 -- 172.21.15.44:0/4102192483 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f22701f6c10 con 0x7f22700c3df0 2024-04-17T19:47:23.352 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:23.329+0000 7f789ea00640 1 -- 172.21.15.44:0/1259690706 <== mon.1 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78900b5070 con 0x7f78a00c81c0 2024-04-17T19:47:23.352 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:23.329+0000 7f789ea00640 1 -- 172.21.15.44:0/1259690706 <== mon.1 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f78900a89b0 con 0x7f78a00c81c0 2024-04-17T19:47:23.353 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:23.329+0000 7f789ea00640 1 -- 172.21.15.44:0/1259690706 <== mon.1 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78900a8d80 con 0x7f78a00c81c0 2024-04-17T19:47:23.353 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:23.329+0000 7f78a6200640 1 -- 172.21.15.44:0/1259690706 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f78a00c81c0 msgr2=0x7f78a0151da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:23.353 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:23.329+0000 7f78a6200640 1 --2- 172.21.15.44:0/1259690706 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f78a00c81c0 0x7f78a0151da0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f78a0070d80 tx=0x7f789001ecf0 comp rx=0 tx=0).stop 2024-04-17T19:47:23.353 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:23.329+0000 7f78a6200640 1 -- 172.21.15.44:0/1259690706 shutdown_connections 2024-04-17T19:47:23.353 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:23.329+0000 7f78a6200640 1 --2- 172.21.15.44:0/1259690706 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f78a00c3ed0 0x7f78a00c42e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:23.353 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:23.329+0000 7f78a6200640 1 --2- 172.21.15.44:0/1259690706 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f78a00c81c0 0x7f78a0151da0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:23.353 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:23.329+0000 7f78a6200640 1 -- 172.21.15.44:0/1259690706 >> 172.21.15.44:0/1259690706 conn(0x7f78a006c380 msgr2=0x7f78a0070080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:47:23.353 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:23.329+0000 7f1e73e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1e741527b0 0x7f1e7406dc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:23.353 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:23.329+0000 7f1e79600640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f1e741531b0 0x7f1e74150820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:23.353 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:23.329+0000 7f78a6200640 1 -- 172.21.15.44:0/1259690706 shutdown_connections 2024-04-17T19:47:23.354 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:23.329+0000 7f1e78c00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1e58004810 0x7f1e741fc840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:23.354 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:23.329+0000 7f1e78c00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1e58004810 0x7f1e741fc840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.44:49310/0 (socket says 172.21.15.44:49310) 2024-04-17T19:47:23.354 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:23.329+0000 7f1e73e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1e741527b0 0x7f1e7406dc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:42876/0 (socket says 172.21.15.44:42876) 2024-04-17T19:47:23.354 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:23.329+0000 7f1e73e00640 1 -- 172.21.15.44:0/1081911383 learned_addr learned my addr 172.21.15.44:0/1081911383 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-04-17T19:47:23.354 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:23.329+0000 7f1e73e00640 1 -- 172.21.15.44:0/1081911383 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f1e741531b0 msgr2=0x7f1e74150820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:23.354 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:23.333+0000 7f1e73e00640 1 --2- 172.21.15.44:0/1081911383 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f1e741531b0 0x7f1e74150820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:23.355 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:23.329+0000 7f0acce00640 1 -- 172.21.15.44:0/3893042583 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0ac8152b90 con 0x7f0ac8151ab0 2024-04-17T19:47:23.355 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:23.329+0000 7f0acce00640 1 -- 172.21.15.44:0/3893042583 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0ac814d150 con 0x7f0ac8151ab0 2024-04-17T19:47:23.355 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:23.329+0000 7f78a6200640 1 -- 172.21.15.44:0/1259690706 wait complete. 2024-04-17T19:47:23.356 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:23.333+0000 7f1e73e00640 1 -- 172.21.15.44:0/1081911383 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1e58004810 msgr2=0x7f1e741fc840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:23.356 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:23.333+0000 7f1e73e00640 1 --2- 172.21.15.44:0/1081911383 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1e58004810 0x7f1e741fc840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:23.356 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:23.333+0000 7f1e73e00640 1 -- 172.21.15.44:0/1081911383 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1e74151d40 con 0x7f1e741527b0 2024-04-17T19:47:23.356 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:23.333+0000 7f1e79600640 1 --2- 172.21.15.44:0/1081911383 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f1e741531b0 0x7f1e74150820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-17T19:47:23.356 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:23.333+0000 7f1e73e00640 1 --2- 172.21.15.44:0/1081911383 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1e741527b0 0x7f1e7406dc00 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f1e6000c2c0 tx=0x7f1e58005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:47:23.357 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:23.329+0000 7fbf12000640 1 -- 172.21.15.44:0/4069335776 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbf180054b0 con 0x7fbf180db2b0 2024-04-17T19:47:23.357 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:23.333+0000 7fbf1cc00640 1 -- 172.21.15.44:0/4069335776 <== mon.1 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fbf0c01a070 con 0x7fbf180db2b0 2024-04-17T19:47:23.357 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:23.329+0000 7ff167e00640 1 -- 172.21.15.44:0/3878244707 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7ff16001b460 con 0x7ff170072db0 2024-04-17T19:47:23.357 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:23.333+0000 7ff167e00640 1 --2- 172.21.15.44:0/3878244707 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7ff150068480 0x7ff15006a990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:23.357 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:23.333+0000 7ff167e00640 1 -- 172.21.15.44:0/3878244707 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7ff1600866e0 con 0x7ff170072db0 2024-04-17T19:47:23.357 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:23.333+0000 7ff16fe00640 1 --2- 172.21.15.44:0/3878244707 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7ff150068480 0x7ff15006a990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:23.358 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:23.333+0000 7f226f400640 1 --2- 172.21.15.44:0/4102192483 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f22700c3df0 0x7f22701fa000 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f2270072f70 tx=0x7f2260001900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:47:23.358 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:23.333+0000 7ff16fe00640 1 --2- 172.21.15.44:0/3878244707 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7ff150068480 0x7ff15006a990 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7ff15c00bb70 tx=0x7ff15c008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:47:23.358 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:23.333+0000 7fbf1cc00640 1 --2- 172.21.15.44:0/4069335776 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7fbf000683b0 0x7fbf0006a8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:23.358 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:23.333+0000 7fbf1cc00640 1 -- 172.21.15.44:0/4069335776 <== mon.1 v2:172.21.15.62:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fbf0c086bb0 con 0x7fbf180db2b0 2024-04-17T19:47:23.359 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:23.333+0000 7fbf25000640 1 --2- 172.21.15.44:0/4069335776 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7fbf000683b0 0x7fbf0006a8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:23.359 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:23.333+0000 7f78a6200640 1 Processor -- start 2024-04-17T19:47:23.359 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:23.333+0000 7f78a6200640 1 -- start start 2024-04-17T19:47:23.359 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:23.337+0000 7f1e70c00640 1 -- 172.21.15.44:0/1081911383 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e600049f0 con 0x7f1e741527b0 2024-04-17T19:47:23.359 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:23.337+0000 7f1e7b600640 1 -- 172.21.15.44:0/1081911383 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1e74163450 con 0x7f1e741527b0 2024-04-17T19:47:23.359 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:23.337+0000 7f1e7b600640 1 -- 172.21.15.44:0/1081911383 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1e74152290 con 0x7f1e741527b0 2024-04-17T19:47:23.360 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:23.337+0000 7fbf25000640 1 --2- 172.21.15.44:0/4069335776 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7fbf000683b0 0x7fbf0006a8c0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fbf20051840 tx=0x7fbf2006e040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:47:23.360 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:23.337+0000 7f1e7b600640 1 -- 172.21.15.44:0/1081911383 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1e74162700 con 0x7f1e741527b0 2024-04-17T19:47:23.360 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:23.337+0000 7f0acce00640 1 -- 172.21.15.44:0/3893042583 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0aa00052a0 con 0x7f0ac8151ab0 2024-04-17T19:47:23.360 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:23.337+0000 7f78a6200640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f78a00c3ed0 0x7f78a0143530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:23.360 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:23.337+0000 7f78a6200640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f78a00c81c0 0x7f78a0152fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:23.361 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:23.337+0000 7f78a6200640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f78a00cbc60 0x7f78a013b100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:23.361 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:23.337+0000 7f78a6200640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f78a0158860 con 0x7f78a00c3ed0 2024-04-17T19:47:23.361 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:23.337+0000 7f78a6200640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f78a0158580 con 0x7f78a00cbc60 2024-04-17T19:47:23.361 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:23.337+0000 7f78a6200640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7f78a00cb360 con 0x7f78a00c81c0 2024-04-17T19:47:23.361 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:23.337+0000 7f789f400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f78a00c3ed0 0x7f78a0143530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:23.361 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:23.337+0000 7f7897e00640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f78a00c81c0 0x7f78a0152fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:23.361 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:23.337+0000 7f789f400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f78a00c3ed0 0x7f78a0143530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:42886/0 (socket says 172.21.15.44:42886) 2024-04-17T19:47:23.361 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:23.337+0000 7f7897e00640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f78a00c81c0 0x7f78a0152fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3301/0 says I am v2:172.21.15.44:43490/0 (socket says 172.21.15.44:43490) 2024-04-17T19:47:23.361 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:23.337+0000 7f789f400640 1 -- 172.21.15.44:0/2710142046 learned_addr learned my addr 172.21.15.44:0/2710142046 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-04-17T19:47:23.361 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:23.337+0000 7f789fe00640 1 --2- 172.21.15.44:0/2710142046 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f78a00cbc60 0x7f78a013b100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:23.361 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:23.337+0000 7f0abf400640 1 -- 172.21.15.44:0/3893042583 <== mon.1 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f0ab80ab810 con 0x7f0ac8151ab0 2024-04-17T19:47:23.362 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:23.337+0000 7f789f400640 1 -- 172.21.15.44:0/2710142046 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f78a00c81c0 msgr2=0x7f78a0152fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:23.362 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:23.337+0000 7f789f400640 1 --2- 172.21.15.44:0/2710142046 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f78a00c81c0 0x7f78a0152fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:23.362 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:23.337+0000 7f789f400640 1 -- 172.21.15.44:0/2710142046 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f78a00cbc60 msgr2=0x7f78a013b100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:23.362 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:23.337+0000 7f789f400640 1 --2- 172.21.15.44:0/2710142046 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f78a00cbc60 0x7f78a013b100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:23.362 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:23.337+0000 7f789f400640 1 -- 172.21.15.44:0/2710142046 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f78a00ca400 con 0x7f78a00c3ed0 2024-04-17T19:47:23.362 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:23.337+0000 7f789f400640 1 --2- 172.21.15.44:0/2710142046 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f78a00c3ed0 0x7f78a0143530 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f789001d3a0 tx=0x7f789001ba90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:47:23.363 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:23.341+0000 7f0abf400640 1 --2- 172.21.15.44:0/3893042583 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f0aa8068450 0x7f0aa806a960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:23.363 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:23.341+0000 7f0abf400640 1 -- 172.21.15.44:0/3893042583 <== mon.1 v2:172.21.15.62:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f0ab81210e0 con 0x7f0ac8151ab0 2024-04-17T19:47:23.363 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:23.341+0000 7f0ac6a00640 1 --2- 172.21.15.44:0/3893042583 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f0aa8068450 0x7f0aa806a960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:23.363 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:23.341+0000 7f0ac6a00640 1 --2- 172.21.15.44:0/3893042583 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f0aa8068450 0x7f0aa806a960 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f0ac80735e0 tx=0x7f0ab4009190 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:47:23.363 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:23.341+0000 7f1e70c00640 1 -- 172.21.15.44:0/1081911383 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1e600a9020 con 0x7f1e741527b0 2024-04-17T19:47:23.363 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:23.341+0000 7f1e70c00640 1 -- 172.21.15.44:0/1081911383 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e60004d90 con 0x7f1e741527b0 2024-04-17T19:47:23.364 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:23.341+0000 7f2267e00640 1 -- 172.21.15.44:0/4102192483 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2260018070 con 0x7f22700c3df0 2024-04-17T19:47:23.364 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:23.341+0000 7f2276a00640 1 -- 172.21.15.44:0/4102192483 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f22700cca50 con 0x7f22700c3df0 2024-04-17T19:47:23.364 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:23.341+0000 7f2276a00640 1 -- 172.21.15.44:0/4102192483 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f22701fa540 con 0x7f22700c3df0 2024-04-17T19:47:23.364 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:23.341+0000 7f7897400640 1 -- 172.21.15.44:0/2710142046 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78900be070 con 0x7f78a00c3ed0 2024-04-17T19:47:23.364 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:23.341+0000 7ff167e00640 1 -- 172.21.15.44:0/3878244707 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7ff1600569d0 con 0x7ff170072db0 2024-04-17T19:47:23.365 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:23.341+0000 7f2267e00640 1 -- 172.21.15.44:0/4102192483 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2260007380 con 0x7f22700c3df0 2024-04-17T19:47:23.365 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:23.341+0000 7f2267e00640 1 -- 172.21.15.44:0/4102192483 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22600047f0 con 0x7f22700c3df0 2024-04-17T19:47:23.365 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:23.341+0000 7f78a6200640 1 -- 172.21.15.44:0/2710142046 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f78a0151330 con 0x7f78a00c3ed0 2024-04-17T19:47:23.365 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:23.341+0000 7f78a6200640 1 -- 172.21.15.44:0/2710142046 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f78a01571f0 con 0x7f78a00c3ed0 2024-04-17T19:47:23.365 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:23.345+0000 7f78a6200640 1 -- 172.21.15.44:0/2710142046 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f78a004ff10 con 0x7f78a00c3ed0 2024-04-17T19:47:23.365 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:23.345+0000 7f2276a00640 1 -- 172.21.15.44:0/4102192483 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f22480052a0 con 0x7f22700c3df0 2024-04-17T19:47:23.366 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:23.345+0000 7f7897400640 1 -- 172.21.15.44:0/2710142046 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7890000e50 con 0x7f78a00c3ed0 2024-04-17T19:47:23.366 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:23.345+0000 7f7897400640 1 -- 172.21.15.44:0/2710142046 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78900c7060 con 0x7f78a00c3ed0 2024-04-17T19:47:23.366 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:23.345+0000 7fbf1cc00640 1 -- 172.21.15.44:0/4069335776 <== mon.1 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fbf0c0566b0 con 0x7fbf180db2b0 2024-04-17T19:47:23.367 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:23.345+0000 7f1e70c00640 1 -- 172.21.15.44:0/1081911383 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f1e600a57c0 con 0x7f1e741527b0 2024-04-17T19:47:23.367 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:23.345+0000 7f1e70c00640 1 --2- 172.21.15.44:0/1081911383 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f1e540683b0 0x7f1e5406a8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:23.367 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:23.345+0000 7f1e70c00640 1 -- 172.21.15.44:0/1081911383 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f1e60120930 con 0x7f1e741527b0 2024-04-17T19:47:23.367 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:23.349+0000 7f1e78c00640 1 --2- 172.21.15.44:0/1081911383 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f1e540683b0 0x7f1e5406a8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:23.367 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:23.349+0000 7f1e78c00640 1 --2- 172.21.15.44:0/1081911383 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f1e540683b0 0x7f1e5406a8c0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f1e6c009fd0 tx=0x7f1e6c00b040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:47:23.367 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:23.349+0000 7f1e70c00640 1 -- 172.21.15.44:0/1081911383 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f1e600169f0 con 0x7f1e741527b0 2024-04-17T19:47:23.368 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:23.349+0000 7f2267e00640 1 -- 172.21.15.44:0/4102192483 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f226001b070 con 0x7f22700c3df0 2024-04-17T19:47:23.368 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:23.353+0000 7f2267e00640 1 --2- 172.21.15.44:0/4102192483 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f2250068380 0x7f225006a890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:23.368 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:23.353+0000 7f2267e00640 1 -- 172.21.15.44:0/4102192483 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f2260086430 con 0x7f22700c3df0 2024-04-17T19:47:23.368 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:23.353+0000 7f7897400640 1 -- 172.21.15.44:0/2710142046 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f78900b0840 con 0x7f78a00c3ed0 2024-04-17T19:47:23.368 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:23.353+0000 7f226fe00640 1 --2- 172.21.15.44:0/4102192483 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f2250068380 0x7f225006a890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:23.369 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:23.353+0000 7f0abf400640 1 -- 172.21.15.44:0/3893042583 <== mon.1 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f0ac814d9f0 con 0x7f0ac8151ab0 2024-04-17T19:47:23.369 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:23.353+0000 7f7897400640 1 --2- 172.21.15.44:0/2710142046 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f787c0683b0 0x7f787c06a8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:23.369 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:23.353+0000 7f7897400640 1 -- 172.21.15.44:0/2710142046 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f78901239f0 con 0x7f78a00c3ed0 2024-04-17T19:47:23.369 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:23.353+0000 7f7897e00640 1 --2- 172.21.15.44:0/2710142046 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f787c0683b0 0x7f787c06a8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:23.369 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:23.357+0000 7f226fe00640 1 --2- 172.21.15.44:0/4102192483 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f2250068380 0x7f225006a890 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f225c0b2000 tx=0x7f225c0aa070 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:47:23.370 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:23.357+0000 7f7897e00640 1 --2- 172.21.15.44:0/2710142046 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f787c0683b0 0x7f787c06a8c0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f78a00c62d0 tx=0x7f7888009190 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:47:23.370 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:23.361+0000 7f2267e00640 1 -- 172.21.15.44:0/4102192483 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f2260055fb0 con 0x7f22700c3df0 2024-04-17T19:47:23.370 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:23.365+0000 7f7897400640 1 -- 172.21.15.44:0/2710142046 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f7890018850 con 0x7f78a00c3ed0 2024-04-17T19:47:23.666 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:23.673+0000 7f96f4800640 1 -- 172.21.15.44:0/2512168697 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7f96e80cee40 con 0x7f96e80c5d40 2024-04-17T19:47:23.667 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:23.677+0000 7f96e6000640 1 -- 172.21.15.44:0/2512168697 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f96dc007e20 con 0x7f96e80c5d40 2024-04-17T19:47:23.667 INFO:teuthology.orchestra.run.smithi044.stdout:64424509450 2024-04-17T19:47:23.670 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:23.677+0000 7f96f4800640 1 -- 172.21.15.44:0/2512168697 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f96d0068380 msgr2=0x7f96d006a890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:23.671 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:23.677+0000 7f96f4800640 1 --2- 172.21.15.44:0/2512168697 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f96d0068380 0x7f96d006a890 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f96e00099d0 tx=0x7f96e0009190 comp rx=0 tx=0).stop 2024-04-17T19:47:23.671 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:23.677+0000 7f96f4800640 1 -- 172.21.15.44:0/2512168697 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f96e80c5d40 msgr2=0x7f96e80c6150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:23.671 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:23.677+0000 7f96f4800640 1 --2- 172.21.15.44:0/2512168697 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f96e80c5d40 0x7f96e80c6150 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f96ec063960 tx=0x7f96d4005840 comp rx=0 tx=0).stop 2024-04-17T19:47:23.671 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:23.681+0000 7f96f4800640 1 -- 172.21.15.44:0/2512168697 shutdown_connections 2024-04-17T19:47:23.671 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:23.681+0000 7f96f4800640 1 --2- 172.21.15.44:0/2512168697 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f96d0068380 0x7f96d006a890 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:23.672 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:23.681+0000 7f96f4800640 1 --2- 172.21.15.44:0/2512168697 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f96e80d08f0 0x7f96e80c8e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:23.672 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:23.681+0000 7f96f4800640 1 --2- 172.21.15.44:0/2512168697 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f96e80c5d40 0x7f96e80c6150 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:23.672 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:23.681+0000 7f96f4800640 1 --2- 172.21.15.44:0/2512168697 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f96d4004100 0x7f96e8050ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:23.672 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:23.681+0000 7f96f4800640 1 -- 172.21.15.44:0/2512168697 >> 172.21.15.44:0/2512168697 conn(0x7f96e80527b0 msgr2=0x7f96e80cb5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:47:23.672 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:23.681+0000 7f96f4800640 1 -- 172.21.15.44:0/2512168697 shutdown_connections 2024-04-17T19:47:23.672 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:23.681+0000 7f96f4800640 1 -- 172.21.15.44:0/2512168697 wait complete. 2024-04-17T19:47:23.672 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:23.681+0000 7f44b7e00640 1 -- 172.21.15.44:0/4231690101 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7f44a0005860 con 0x7f44c40082d0 2024-04-17T19:47:23.673 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:23.681+0000 7f44c2a00640 1 -- 172.21.15.44:0/4231690101 <== mon.1 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f44cc095750 con 0x7f44c40082d0 2024-04-17T19:47:23.673 INFO:teuthology.orchestra.run.smithi044.stdout:64424509449 2024-04-17T19:47:23.678 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:23.685+0000 7f44b7e00640 1 -- 172.21.15.44:0/4231690101 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f44ac0683d0 msgr2=0x7f44ac06a8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:23.678 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:23.685+0000 7f44b7e00640 1 --2- 172.21.15.44:0/4231690101 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f44ac0683d0 0x7f44ac06a8e0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f44c404b4d0 tx=0x7f44b8009040 comp rx=0 tx=0).stop 2024-04-17T19:47:23.678 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:23.685+0000 7f44b7e00640 1 -- 172.21.15.44:0/4231690101 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f44c40082d0 msgr2=0x7f44c40d50b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:23.678 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:23.685+0000 7f44b7e00640 1 --2- 172.21.15.44:0/4231690101 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f44c40082d0 0x7f44c40d50b0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f44cc051840 tx=0x7f44cc09a400 comp rx=0 tx=0).stop 2024-04-17T19:47:23.678 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:23.685+0000 7f44b7e00640 1 -- 172.21.15.44:0/4231690101 shutdown_connections 2024-04-17T19:47:23.678 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:23.685+0000 7f44b7e00640 1 --2- 172.21.15.44:0/4231690101 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f44ac0683d0 0x7f44ac06a8e0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:23.678 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:23.685+0000 7f44b7e00640 1 --2- 172.21.15.44:0/4231690101 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f44c404d170 0x7f44c4167b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:23.678 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:23.685+0000 7f44b7e00640 1 --2- 172.21.15.44:0/4231690101 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f44c404c930 0x7f44c404a620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:23.679 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:23.685+0000 7f44b7e00640 1 --2- 172.21.15.44:0/4231690101 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f44c40082d0 0x7f44c40d50b0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:23.679 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:23.685+0000 7f44b7e00640 1 -- 172.21.15.44:0/4231690101 >> 172.21.15.44:0/4231690101 conn(0x7f44c4050c80 msgr2=0x7f44c40352b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:47:23.679 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:23.685+0000 7ff175c00640 1 -- 172.21.15.44:0/3878244707 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7ff148005590 con 0x7ff170072db0 2024-04-17T19:47:23.679 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:23.689+0000 7f44b7e00640 1 -- 172.21.15.44:0/4231690101 shutdown_connections 2024-04-17T19:47:23.679 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:23.689+0000 7f44b7e00640 1 -- 172.21.15.44:0/4231690101 wait complete. 2024-04-17T19:47:23.682 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:23.693+0000 7ff167e00640 1 -- 172.21.15.44:0/3878244707 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7ff1600562d0 con 0x7ff170072db0 2024-04-17T19:47:23.685 INFO:teuthology.orchestra.run.smithi044.stdout:64424509450 2024-04-17T19:47:23.688 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:23.697+0000 7ff175c00640 1 -- 172.21.15.44:0/3878244707 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7ff150068480 msgr2=0x7ff15006a990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:23.688 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:23.697+0000 7ff175c00640 1 --2- 172.21.15.44:0/3878244707 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7ff150068480 0x7ff15006a990 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7ff15c00bb70 tx=0x7ff15c008040 comp rx=0 tx=0).stop 2024-04-17T19:47:23.688 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:23.697+0000 7ff175c00640 1 -- 172.21.15.44:0/3878244707 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff170072db0 msgr2=0x7ff17015e670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:23.688 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:23.697+0000 7ff175c00640 1 --2- 172.21.15.44:0/3878244707 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff170072db0 0x7ff17015e670 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7ff16000b440 tx=0x7ff16000b900 comp rx=0 tx=0).stop 2024-04-17T19:47:23.688 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:23.697+0000 7ff175c00640 1 -- 172.21.15.44:0/3878244707 shutdown_connections 2024-04-17T19:47:23.688 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:23.697+0000 7ff175c00640 1 --2- 172.21.15.44:0/3878244707 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7ff150068480 0x7ff15006a990 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:23.688 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:23.697+0000 7ff175c00640 1 --2- 172.21.15.44:0/3878244707 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7ff170155cf0 0x7ff17015ebb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:23.688 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:23.697+0000 7ff175c00640 1 --2- 172.21.15.44:0/3878244707 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff170072db0 0x7ff17015e670 secure :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7ff16000b440 tx=0x7ff16000b900 comp rx=0 tx=0).stop 2024-04-17T19:47:23.688 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:23.697+0000 7ff175c00640 1 --2- 172.21.15.44:0/3878244707 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff1700729a0 0x7ff17015d7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:23.688 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:23.697+0000 7ff175c00640 1 -- 172.21.15.44:0/3878244707 >> 172.21.15.44:0/3878244707 conn(0x7ff17006c380 msgr2=0x7ff1700c80e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:47:23.689 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:23.697+0000 7ff175c00640 1 -- 172.21.15.44:0/3878244707 shutdown_connections 2024-04-17T19:47:23.689 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:23.697+0000 7ff175c00640 1 -- 172.21.15.44:0/3878244707 wait complete. 2024-04-17T19:47:23.696 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:23.705+0000 7fbf12000640 1 -- 172.21.15.44:0/4069335776 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) -- 0x7fbf180d5040 con 0x7fbf180db2b0 2024-04-17T19:47:23.697 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:23.705+0000 7fbf1cc00640 1 -- 172.21.15.44:0/4069335776 <== mon.1 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fbf0c05a9b0 con 0x7fbf180db2b0 2024-04-17T19:47:23.697 INFO:teuthology.orchestra.run.smithi044.stdout:64424509450 2024-04-17T19:47:23.701 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:23.709+0000 7fbf12000640 1 -- 172.21.15.44:0/4069335776 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7fbf000683b0 msgr2=0x7fbf0006a8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:23.702 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:23.709+0000 7fbf12000640 1 --2- 172.21.15.44:0/4069335776 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7fbf000683b0 0x7fbf0006a8c0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fbf20051840 tx=0x7fbf2006e040 comp rx=0 tx=0).stop 2024-04-17T19:47:23.702 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:23.709+0000 7fbf12000640 1 -- 172.21.15.44:0/4069335776 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbf180db2b0 msgr2=0x7fbf180c44c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:23.702 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:23.709+0000 7fbf12000640 1 --2- 172.21.15.44:0/4069335776 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbf180db2b0 0x7fbf180c44c0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fbf0c00e870 tx=0x7fbf0c00ec70 comp rx=0 tx=0).stop 2024-04-17T19:47:23.702 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:23.709+0000 7fbf12000640 1 -- 172.21.15.44:0/4069335776 shutdown_connections 2024-04-17T19:47:23.702 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:23.709+0000 7fbf12000640 1 --2- 172.21.15.44:0/4069335776 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7fbf000683b0 0x7fbf0006a8c0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:23.703 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:23.709+0000 7fbf12000640 1 --2- 172.21.15.44:0/4069335776 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fbf180e3c20 0x7fbf180c81c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:23.703 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:23.713+0000 7f0acce00640 1 -- 172.21.15.44:0/3893042583 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7f0aa0005590 con 0x7f0ac8151ab0 2024-04-17T19:47:23.703 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:23.713+0000 7fbf12000640 1 --2- 172.21.15.44:0/4069335776 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbf180db2b0 0x7fbf180c44c0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:23.703 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:23.713+0000 7fbf12000640 1 --2- 172.21.15.44:0/4069335776 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbf1804bb30 0x7fbf18175a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:23.704 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:23.713+0000 7fbf12000640 1 -- 172.21.15.44:0/4069335776 >> 172.21.15.44:0/4069335776 conn(0x7fbf180503c0 msgr2=0x7fbf18035580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:47:23.704 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:23.713+0000 7f0abf400640 1 -- 172.21.15.44:0/3893042583 <== mon.1 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f0ab80160d0 con 0x7f0ac8151ab0 2024-04-17T19:47:23.704 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:23.713+0000 7f1e7b600640 1 -- 172.21.15.44:0/1081911383 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) -- 0x7f1e7404ff10 con 0x7f1e741527b0 2024-04-17T19:47:23.704 INFO:teuthology.orchestra.run.smithi044.stdout:55834574858 2024-04-17T19:47:23.705 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:23.713+0000 7fbf12000640 1 -- 172.21.15.44:0/4069335776 shutdown_connections 2024-04-17T19:47:23.705 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:23.713+0000 7f1e70c00640 1 -- 172.21.15.44:0/1081911383 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f1e600f0540 con 0x7f1e741527b0 2024-04-17T19:47:23.705 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:23.713+0000 7fbf12000640 1 -- 172.21.15.44:0/4069335776 wait complete. 2024-04-17T19:47:23.705 INFO:teuthology.orchestra.run.smithi044.stdout:64424509449 2024-04-17T19:47:23.706 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:23.713+0000 7f0acce00640 1 -- 172.21.15.44:0/3893042583 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f0aa8068450 msgr2=0x7f0aa806a960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:23.706 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:23.713+0000 7f0acce00640 1 --2- 172.21.15.44:0/3893042583 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f0aa8068450 0x7f0aa806a960 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f0ac80735e0 tx=0x7f0ab4009190 comp rx=0 tx=0).stop 2024-04-17T19:47:23.707 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:23.713+0000 7f0acce00640 1 -- 172.21.15.44:0/3893042583 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0ac8151ab0 msgr2=0x7f0ac8152650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:23.707 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:23.713+0000 7f0acce00640 1 --2- 172.21.15.44:0/3893042583 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0ac8151ab0 0x7f0ac8152650 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f0ab80ad040 tx=0x7f0ab8019250 comp rx=0 tx=0).stop 2024-04-17T19:47:23.707 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:23.713+0000 7f0acce00640 1 -- 172.21.15.44:0/3893042583 shutdown_connections 2024-04-17T19:47:23.707 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:23.713+0000 7f0acce00640 1 --2- 172.21.15.44:0/3893042583 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f0aa8068450 0x7f0aa806a960 secure :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f0ac80735e0 tx=0x7f0ab4009190 comp rx=0 tx=0).stop 2024-04-17T19:47:23.707 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:23.713+0000 7f0acce00640 1 --2- 172.21.15.44:0/3893042583 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f0ac8158210 0x7f0ac80ccdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:23.707 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:23.713+0000 7f0acce00640 1 --2- 172.21.15.44:0/3893042583 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0ac815b980 0x7f0ac814e220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:23.707 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:23.713+0000 7f0acce00640 1 --2- 172.21.15.44:0/3893042583 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0ac8151ab0 0x7f0ac8152650 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:23.707 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:23.713+0000 7f0acce00640 1 -- 172.21.15.44:0/3893042583 >> 172.21.15.44:0/3893042583 conn(0x7f0ac806c380 msgr2=0x7f0ac8073610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:47:23.708 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:23.717+0000 7f0acce00640 1 -- 172.21.15.44:0/3893042583 shutdown_connections 2024-04-17T19:47:23.708 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:23.717+0000 7f0acce00640 1 -- 172.21.15.44:0/3893042583 wait complete. 2024-04-17T19:47:23.709 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:23.717+0000 7f2276a00640 1 -- 172.21.15.44:0/4102192483 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7f2248005860 con 0x7f22700c3df0 2024-04-17T19:47:23.709 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:23.717+0000 7f2267e00640 1 -- 172.21.15.44:0/4102192483 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f226005a2b0 con 0x7f22700c3df0 2024-04-17T19:47:23.710 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509452 got 64424509450 for osd.2 2024-04-17T19:47:23.710 INFO:teuthology.orchestra.run.smithi044.stdout:64424509449 2024-04-17T19:47:23.710 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:23.717+0000 7f1e7b600640 1 -- 172.21.15.44:0/1081911383 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f1e540683b0 msgr2=0x7f1e5406a8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:23.710 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:23.717+0000 7f1e7b600640 1 --2- 172.21.15.44:0/1081911383 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f1e540683b0 0x7f1e5406a8c0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f1e6c009fd0 tx=0x7f1e6c00b040 comp rx=0 tx=0).stop 2024-04-17T19:47:23.710 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:23.717+0000 7f1e7b600640 1 -- 172.21.15.44:0/1081911383 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1e741527b0 msgr2=0x7f1e7406dc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:23.711 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:23.717+0000 7f1e7b600640 1 --2- 172.21.15.44:0/1081911383 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1e741527b0 0x7f1e7406dc00 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f1e6000c2c0 tx=0x7f1e58005840 comp rx=0 tx=0).stop 2024-04-17T19:47:23.711 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:23.721+0000 7f1e7b600640 1 -- 172.21.15.44:0/1081911383 shutdown_connections 2024-04-17T19:47:23.711 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:23.721+0000 7f1e7b600640 1 --2- 172.21.15.44:0/1081911383 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f1e540683b0 0x7f1e5406a8c0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:23.711 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:23.721+0000 7f1e7b600640 1 --2- 172.21.15.44:0/1081911383 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f1e741531b0 0x7f1e74150820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:23.711 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:23.721+0000 7f1e7b600640 1 --2- 172.21.15.44:0/1081911383 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1e741527b0 0x7f1e7406dc00 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:23.711 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:23.721+0000 7f1e7b600640 1 --2- 172.21.15.44:0/1081911383 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1e58004810 0x7f1e741fc840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:23.711 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:23.721+0000 7f1e7b600640 1 -- 172.21.15.44:0/1081911383 >> 172.21.15.44:0/1081911383 conn(0x7f1e74070a00 msgr2=0x7f1e74158960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:47:23.711 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:23.721+0000 7f1e7b600640 1 -- 172.21.15.44:0/1081911383 shutdown_connections 2024-04-17T19:47:23.712 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:23.721+0000 7f1e7b600640 1 -- 172.21.15.44:0/1081911383 wait complete. 2024-04-17T19:47:23.712 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:23.721+0000 7f2276a00640 1 -- 172.21.15.44:0/4102192483 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f2250068380 msgr2=0x7f225006a890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:23.712 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:23.721+0000 7f2276a00640 1 --2- 172.21.15.44:0/4102192483 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f2250068380 0x7f225006a890 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f225c0b2000 tx=0x7f225c0aa070 comp rx=0 tx=0).stop 2024-04-17T19:47:23.713 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:23.721+0000 7f2276a00640 1 -- 172.21.15.44:0/4102192483 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f22700c3df0 msgr2=0x7f22701fa000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:23.713 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:23.721+0000 7f2276a00640 1 --2- 172.21.15.44:0/4102192483 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f22700c3df0 0x7f22701fa000 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f2270072f70 tx=0x7f2260001900 comp rx=0 tx=0).stop 2024-04-17T19:47:23.713 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:23.721+0000 7f2276a00640 1 -- 172.21.15.44:0/4102192483 shutdown_connections 2024-04-17T19:47:23.713 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:23.721+0000 7f2276a00640 1 --2- 172.21.15.44:0/4102192483 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f2250068380 0x7f225006a890 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:23.713 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:23.721+0000 7f2276a00640 1 --2- 172.21.15.44:0/4102192483 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f22700ca050 0x7f22701e2940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:23.713 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:23.721+0000 7f2276a00640 1 --2- 172.21.15.44:0/4102192483 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f22700c3df0 0x7f22701fa000 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:23.713 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:23.721+0000 7f2276a00640 1 --2- 172.21.15.44:0/4102192483 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2270073590 0x7f22701f66d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:23.713 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:23.721+0000 7f2276a00640 1 -- 172.21.15.44:0/4102192483 >> 172.21.15.44:0/4102192483 conn(0x7f227006d490 msgr2=0x7f2270071220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:47:23.713 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:23.721+0000 7f2276a00640 1 -- 172.21.15.44:0/4102192483 shutdown_connections 2024-04-17T19:47:23.713 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:23.721+0000 7f2276a00640 1 -- 172.21.15.44:0/4102192483 wait complete. 2024-04-17T19:47:23.714 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:23.721+0000 7f78a6200640 1 -- 172.21.15.44:0/2710142046 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7f78a0074160 con 0x7f78a00c3ed0 2024-04-17T19:47:23.714 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:23.721+0000 7f7897400640 1 -- 172.21.15.44:0/2710142046 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f78900f3550 con 0x7f78a00c3ed0 2024-04-17T19:47:23.714 INFO:teuthology.orchestra.run.smithi044.stdout:55834574858 2024-04-17T19:47:23.718 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509450 got 64424509449 for osd.0 2024-04-17T19:47:23.718 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:23.725+0000 7f78a6200640 1 -- 172.21.15.44:0/2710142046 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f787c0683b0 msgr2=0x7f787c06a8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:23.718 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:23.725+0000 7f78a6200640 1 --2- 172.21.15.44:0/2710142046 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f787c0683b0 0x7f787c06a8c0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f78a00c62d0 tx=0x7f7888009190 comp rx=0 tx=0).stop 2024-04-17T19:47:23.718 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:23.725+0000 7f78a6200640 1 -- 172.21.15.44:0/2710142046 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f78a00c3ed0 msgr2=0x7f78a0143530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:23.719 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:23.725+0000 7f78a6200640 1 --2- 172.21.15.44:0/2710142046 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f78a00c3ed0 0x7f78a0143530 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f789001d3a0 tx=0x7f789001ba90 comp rx=0 tx=0).stop 2024-04-17T19:47:23.719 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:23.725+0000 7f78a6200640 1 -- 172.21.15.44:0/2710142046 shutdown_connections 2024-04-17T19:47:23.719 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:23.725+0000 7f78a6200640 1 --2- 172.21.15.44:0/2710142046 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f787c0683b0 0x7f787c06a8c0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:23.719 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:23.725+0000 7f78a6200640 1 --2- 172.21.15.44:0/2710142046 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f78a00c81c0 0x7f78a0152fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:23.719 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:23.725+0000 7f78a6200640 1 --2- 172.21.15.44:0/2710142046 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f78a00cbc60 0x7f78a013b100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:23.719 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:23.725+0000 7f78a6200640 1 --2- 172.21.15.44:0/2710142046 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f78a00c3ed0 0x7f78a0143530 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:23.719 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:23.725+0000 7f78a6200640 1 -- 172.21.15.44:0/2710142046 >> 172.21.15.44:0/2710142046 conn(0x7f78a006c380 msgr2=0x7f78a006fe70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:47:23.719 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:23.729+0000 7f78a6200640 1 -- 172.21.15.44:0/2710142046 shutdown_connections 2024-04-17T19:47:23.719 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:23.729+0000 7f78a6200640 1 -- 172.21.15.44:0/2710142046 wait complete. 2024-04-17T19:47:23.725 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509452 got 64424509450 for osd.3 2024-04-17T19:47:23.740 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574859 got 55834574858 for osd.5 2024-04-17T19:47:23.745 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509452 got 64424509450 for osd.6 2024-04-17T19:47:23.754 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509451 got 64424509449 for osd.7 2024-04-17T19:47:23.754 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574859 got 55834574858 for osd.4 2024-04-17T19:47:23.755 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509451 got 64424509449 for osd.1 2024-04-17T19:47:23.757 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T19:47:23.801 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T19:47:24.711 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-04-17T19:47:24.719 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-04-17T19:47:24.726 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-04-17T19:47:24.741 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-04-17T19:47:24.746 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-04-17T19:47:24.755 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-04-17T19:47:24.755 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-04-17T19:47:24.756 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-04-17T19:47:24.956 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:24.965+0000 7f4d9b800640 1 Processor -- start 2024-04-17T19:47:24.959 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:24.965+0000 7f4d9b800640 1 -- start start 2024-04-17T19:47:24.959 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:24.969+0000 7f4d9b800640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f4d94158380 0x7f4d9415aeb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:24.960 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:24.969+0000 7f4d9b800640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f4d940c3440 0x7f4d941517c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:24.961 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:24.969+0000 7f4d99800640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f4d940c3850 0x7f4d940c7360 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:50472/0 (socket says 172.21.15.44:50472) 2024-04-17T19:47:24.961 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:24.969+0000 7f4d99800640 1 -- 172.21.15.44:0/4099778604 learned_addr learned my addr 172.21.15.44:0/4099778604 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-04-17T19:47:24.962 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:24.969+0000 7f4d9b800640 1 -- 172.21.15.44:0/4099778604 --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4d940735a0 con 0x7f4d940c3850 2024-04-17T19:47:24.963 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:24.973+0000 7f4d98e00640 1 --2- 172.21.15.44:0/4099778604 >> v2:172.21.15.44:3300/0 conn(0x7f4d94158380 0x7f4d9415aeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:24.963 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:24.973+0000 7f4d9b800640 1 -- 172.21.15.44:0/4099778604 --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 -- 0x7f4d94072730 con 0x7f4d94158380 2024-04-17T19:47:24.964 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:24.973+0000 7f4d93e00640 1 --2- 172.21.15.44:0/4099778604 >> v2:172.21.15.62:3300/0 conn(0x7f4d940c3440 0x7f4d941517c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:24.964 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:24.973+0000 7f4d9b800640 1 -- 172.21.15.44:0/4099778604 --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 -- 0x7f4d940c41c0 con 0x7f4d940c3440 2024-04-17T19:47:24.964 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:24.973+0000 7f4d93400640 1 -- 172.21.15.44:0/4099778604 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3749531924 0 0) 0x7f4d84001120 con 0x7f4d940c3850 2024-04-17T19:47:24.964 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:24.973+0000 7f4d93400640 1 -- 172.21.15.44:0/4099778604 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4d78003430 con 0x7f4d940c3850 2024-04-17T19:47:24.964 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:24.973+0000 7f4d93400640 1 -- 172.21.15.44:0/4099778604 <== mon.0 v1:172.21.15.44:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3576061902 0 0) 0x7f4d78003430 con 0x7f4d940c3850 2024-04-17T19:47:24.964 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:24.973+0000 7f4d98e00640 1 -- 172.21.15.44:0/4099778604 >> v2:172.21.15.62:3300/0 conn(0x7f4d940c3440 msgr2=0x7f4d941517c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T19:47:24.969 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:24.973+0000 7f4d98e00640 1 --2- 172.21.15.44:0/4099778604 >> v2:172.21.15.62:3300/0 conn(0x7f4d940c3440 0x7f4d941517c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:24.969 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:24.973+0000 7f4d98e00640 1 -- 172.21.15.44:0/4099778604 >> v1:172.21.15.44:6789/0 conn(0x7f4d940c3850 legacy=0x7f4d940c7360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:24.969 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:24.973+0000 7f4d98e00640 1 -- 172.21.15.44:0/4099778604 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4d94072fe0 con 0x7f4d94158380 2024-04-17T19:47:24.970 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:24.977+0000 7f4d98e00640 1 --2- 172.21.15.44:0/4099778604 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4d94158380 0x7f4d9415aeb0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f4d9406cde0 tx=0x7f4d8001c300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=395f1642bde17684 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:47:24.970 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:24.981+0000 7f4d93400640 1 -- 172.21.15.44:0/4099778604 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d800b0070 con 0x7f4d94158380 2024-04-17T19:47:24.971 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:24.981+0000 7f4d93400640 1 -- 172.21.15.44:0/4099778604 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4d800ab400 con 0x7f4d94158380 2024-04-17T19:47:24.971 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:24.981+0000 7f4d93400640 1 -- 172.21.15.44:0/4099778604 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d84001850 con 0x7f4d94158380 2024-04-17T19:47:24.972 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:24.981+0000 7f4d9b800640 1 -- 172.21.15.44:0/4099778604 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4d94158380 msgr2=0x7f4d9415aeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:24.972 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:24.981+0000 7f4d9b800640 1 --2- 172.21.15.44:0/4099778604 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4d94158380 0x7f4d9415aeb0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f4d9406cde0 tx=0x7f4d8001c300 comp rx=0 tx=0).stop 2024-04-17T19:47:24.973 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:24.981+0000 7f4d9b800640 1 -- 172.21.15.44:0/4099778604 shutdown_connections 2024-04-17T19:47:24.973 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:24.981+0000 7f4d9b800640 1 --2- 172.21.15.44:0/4099778604 >> v2:172.21.15.62:3300/0 conn(0x7f4d940c3440 0x7f4d941517c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:24.973 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:24.981+0000 7f4d9b800640 1 --2- 172.21.15.44:0/4099778604 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4d94158380 0x7f4d9415aeb0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:24.973 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:24.981+0000 7f4d9b800640 1 -- 172.21.15.44:0/4099778604 >> 172.21.15.44:0/4099778604 conn(0x7f4d940704e0 msgr2=0x7f4d94070920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:47:24.974 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:24.981+0000 7f4d9b800640 1 -- 172.21.15.44:0/4099778604 shutdown_connections 2024-04-17T19:47:24.974 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:24.981+0000 7f4d9b800640 1 -- 172.21.15.44:0/4099778604 wait complete. 2024-04-17T19:47:24.977 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:24.985+0000 7f4d9b800640 1 Processor -- start 2024-04-17T19:47:24.978 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:24.985+0000 7f4d9b800640 1 -- start start 2024-04-17T19:47:24.981 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:24.989+0000 7f4d9b800640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f4d940c3440 0x7f4d9414f300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:24.982 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:24.989+0000 7f4d9b800640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4d940c3850 0x7f4d94159d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:24.982 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:24.989+0000 7f4d9b800640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4d94158380 0x7f4d94158d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:24.982 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:24.989+0000 7f4d9b800640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f4d94158790 con 0x7f4d940c3850 2024-04-17T19:47:24.982 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:24.989+0000 7f4d9b800640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f4d940c3e60 con 0x7f4d94158380 2024-04-17T19:47:24.982 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:24.989+0000 7f4d9b800640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7f4d9415b3f0 con 0x7f4d940c3440 2024-04-17T19:47:24.982 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:24.989+0000 7f4d99800640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4d94158380 0x7f4d94158d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:24.982 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:24.989+0000 7f4d99800640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4d94158380 0x7f4d94158d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.44:49338/0 (socket says 172.21.15.44:49338) 2024-04-17T19:47:24.983 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:24.989+0000 7f4d99800640 1 -- 172.21.15.44:0/1438048915 learned_addr learned my addr 172.21.15.44:0/1438048915 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-04-17T19:47:24.983 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:24.989+0000 7f4d93e00640 1 --2- 172.21.15.44:0/1438048915 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4d940c3850 0x7f4d94159d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:24.983 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:24.993+0000 7f4d93e00640 1 -- 172.21.15.44:0/1438048915 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f4d940c3440 msgr2=0x7f4d9414f300 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-04-17T19:47:24.983 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:24.993+0000 7f4d93e00640 1 --2- 172.21.15.44:0/1438048915 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f4d940c3440 0x7f4d9414f300 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:24.983 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:24.993+0000 7f4d93e00640 1 -- 172.21.15.44:0/1438048915 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4d94158380 msgr2=0x7f4d94158d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:24.983 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:24.993+0000 7f4d93e00640 1 --2- 172.21.15.44:0/1438048915 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4d94158380 0x7f4d94158d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:24.983 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:24.993+0000 7f4d93e00640 1 -- 172.21.15.44:0/1438048915 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4d9414f840 con 0x7f4d940c3850 2024-04-17T19:47:24.984 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:24.993+0000 7f4d93e00640 1 --2- 172.21.15.44:0/1438048915 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4d940c3850 0x7f4d94159d50 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f4d8c00aa90 tx=0x7f4d8c00d490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:47:24.985 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:24.993+0000 7f4d90c00640 1 -- 172.21.15.44:0/1438048915 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d8c0039a0 con 0x7f4d940c3850 2024-04-17T19:47:24.987 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:24.993+0000 7f4d90c00640 1 -- 172.21.15.44:0/1438048915 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4d8c018070 con 0x7f4d940c3850 2024-04-17T19:47:24.987 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:24.993+0000 7f4d90c00640 1 -- 172.21.15.44:0/1438048915 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d8c003da0 con 0x7f4d940c3850 2024-04-17T19:47:24.987 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:24.997+0000 7f4d9b800640 1 -- 172.21.15.44:0/1438048915 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4d94156e40 con 0x7f4d940c3850 2024-04-17T19:47:24.988 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:24.997+0000 7f4d9b800640 1 -- 172.21.15.44:0/1438048915 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4d9415ad30 con 0x7f4d940c3850 2024-04-17T19:47:24.993 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:25.001+0000 7f4d90c00640 1 -- 172.21.15.44:0/1438048915 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f4d8c012070 con 0x7f4d940c3850 2024-04-17T19:47:24.995 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:25.005+0000 7f4d8a000640 1 -- 172.21.15.44:0/1438048915 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4d9404fea0 con 0x7f4d940c3850 2024-04-17T19:47:24.995 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:25.005+0000 7f4d90c00640 1 --2- 172.21.15.44:0/1438048915 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f4d740683d0 0x7f4d7406a8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:25.003 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:25.005+0000 7f4d98e00640 1 --2- 172.21.15.44:0/1438048915 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f4d740683d0 0x7f4d7406a8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:25.003 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:25.005+0000 7f4d98e00640 1 --2- 172.21.15.44:0/1438048915 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f4d740683d0 0x7f4d7406a8e0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f4d800ad000 tx=0x7f4d80008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:47:25.003 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:25.013+0000 7f4d90c00640 1 -- 172.21.15.44:0/1438048915 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f4d8c054c90 con 0x7f4d940c3850 2024-04-17T19:47:25.006 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:25.017+0000 7f4d90c00640 1 -- 172.21.15.44:0/1438048915 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f4d8c0572f0 con 0x7f4d940c3850 2024-04-17T19:47:25.052 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:25.061+0000 7f4b64a00640 1 Processor -- start 2024-04-17T19:47:25.052 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:25.061+0000 7ffb22800640 1 Processor -- start 2024-04-17T19:47:25.052 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:25.061+0000 7f4b64a00640 1 -- start start 2024-04-17T19:47:25.053 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:25.061+0000 7ffb22800640 1 -- start start 2024-04-17T19:47:25.053 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:25.061+0000 7f04a6c00640 1 Processor -- start 2024-04-17T19:47:25.053 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:25.061+0000 7fbd32200640 1 Processor -- start 2024-04-17T19:47:25.054 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:25.061+0000 7f04a6c00640 1 -- start start 2024-04-17T19:47:25.054 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:25.061+0000 7fbd32200640 1 -- start start 2024-04-17T19:47:25.055 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:25.065+0000 7f4b64a00640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f4b60155c70 0x7f4b60072a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:25.055 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:25.065+0000 7ffb22800640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7ffb1c153a00 0x7ffb1c0cb9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:25.055 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:25.065+0000 7ffb22800640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7ffb1c0cbef0 0x7ffb1c164060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:25.056 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:25.065+0000 7f4b64a00640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4b600c6c90 con 0x7f4b60072f90 2024-04-17T19:47:25.056 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:25.065+0000 7ffb22800640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ffb1c0ca3e0 con 0x7ffb1c0c41b0 2024-04-17T19:47:25.056 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:25.065+0000 7f4b64a00640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4b600c5640 con 0x7f4b600c6630 2024-04-17T19:47:25.057 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:25.065+0000 7f4b64a00640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 -- 0x7f4b600c5380 con 0x7f4b60155c70 2024-04-17T19:47:25.057 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:25.065+0000 7f04a6c00640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f04a015a4b0 0x7f04a0073410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:25.057 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:25.065+0000 7f4b5de00640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f4b60155c70 0x7f4b60072a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:25.057 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:25.065+0000 7f4b5de00640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f4b60155c70 0x7f4b60072a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.44:49350/0 (socket says 172.21.15.44:49350) 2024-04-17T19:47:25.057 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:25.065+0000 7f4b5de00640 1 -- 172.21.15.44:0/386396179 learned_addr learned my addr 172.21.15.44:0/386396179 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-04-17T19:47:25.058 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:25.065+0000 7ffb22800640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 -- 0x7ffb1c153e10 con 0x7ffb1c0cbef0 2024-04-17T19:47:25.058 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:25.065+0000 7ffb22800640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7ffb1c0ca650 con 0x7ffb1c153a00 2024-04-17T19:47:25.058 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:25.065+0000 7ffb21400640 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7ffb1c0c41b0 0x7ffb1c159f30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.44:60950/0 (socket says 172.21.15.44:60950) 2024-04-17T19:47:25.058 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:25.065+0000 7ffb21400640 1 -- 172.21.15.44:0/2181828221 learned_addr learned my addr 172.21.15.44:0/2181828221 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-04-17T19:47:25.058 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:25.065+0000 7f04a6c00640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f04a00c5790 0x7f04a00c5ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:25.059 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:25.065+0000 7ffb20a00640 1 --2- 172.21.15.44:0/2181828221 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7ffb1c153a00 0x7ffb1c0cb9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:25.059 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:25.065+0000 7ffb21e00640 1 --2- 172.21.15.44:0/2181828221 >> v2:172.21.15.44:3300/0 conn(0x7ffb1c0cbef0 0x7ffb1c164060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:25.059 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:25.065+0000 7f04a6c00640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f04a0073950 con 0x7f04a00c60e0 2024-04-17T19:47:25.059 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:25.065+0000 7f04a6c00640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 -- 0x7f04a015ff50 con 0x7f04a015a4b0 2024-04-17T19:47:25.059 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:25.065+0000 7f04a6c00640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7f04a0072650 con 0x7f04a00c5790 2024-04-17T19:47:25.059 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:25.065+0000 7ffb20a00640 1 -- 172.21.15.44:0/2181828221 >> v2:172.21.15.44:3300/0 conn(0x7ffb1c0cbef0 msgr2=0x7ffb1c164060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T19:47:25.060 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:25.065+0000 7f4b5de00640 1 -- 172.21.15.44:0/386396179 >> v1:172.21.15.62:6789/0 conn(0x7f4b600c6630 legacy=0x7f4b6006fec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:25.060 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:25.065+0000 7f4b5de00640 1 -- 172.21.15.44:0/386396179 >> v1:172.21.15.44:6789/0 conn(0x7f4b60072f90 legacy=0x7f4b601662d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:25.060 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:25.065+0000 7f4b5de00640 1 -- 172.21.15.44:0/386396179 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4b600c5900 con 0x7f4b60155c70 2024-04-17T19:47:25.061 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:25.065+0000 7ffb1be00640 1 -- 172.21.15.44:0/2181828221 <== mon.1 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 830031376 0 0) 0x7ffb1c0ca3e0 con 0x7ffb1c0c41b0 2024-04-17T19:47:25.061 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:25.065+0000 7f0497e00640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f04a00c5790 0x7f04a00c5ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:25.061 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:25.065+0000 7f0497e00640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f04a00c5790 0x7f04a00c5ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3301/0 says I am v2:172.21.15.44:43500/0 (socket says 172.21.15.44:43500) 2024-04-17T19:47:25.061 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:25.065+0000 7f0497e00640 1 -- 172.21.15.44:0/71285192 learned_addr learned my addr 172.21.15.44:0/71285192 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-04-17T19:47:25.062 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:25.065+0000 7ffb20a00640 1 --2- 172.21.15.44:0/2181828221 >> v2:172.21.15.44:3300/0 conn(0x7ffb1c0cbef0 0x7ffb1c164060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:25.062 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:25.065+0000 7ffb20a00640 1 -- 172.21.15.44:0/2181828221 >> v1:172.21.15.62:6789/0 conn(0x7ffb1c0c41b0 legacy=0x7ffb1c159f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:25.062 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:25.065+0000 7ffb20a00640 1 -- 172.21.15.44:0/2181828221 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffb1c15a640 con 0x7ffb1c153a00 2024-04-17T19:47:25.062 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:25.065+0000 7ffb21e00640 1 --2- 172.21.15.44:0/2181828221 >> v2:172.21.15.44:3300/0 conn(0x7ffb1c0cbef0 0x7ffb1c164060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-17T19:47:25.062 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:25.065+0000 7f049fe00640 1 --2- 172.21.15.44:0/71285192 >> v2:172.21.15.44:3300/0 conn(0x7f04a015a4b0 0x7f04a0073410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:25.063 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:25.065+0000 7fbd32200640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fbd240dda20 0x7fbd240457e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:25.063 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:25.065+0000 7fbd32200640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbd240e7960 con 0x7fbd24006500 2024-04-17T19:47:25.063 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:25.069+0000 7fbd32200640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbd240e4620 con 0x7fbd240060f0 2024-04-17T19:47:25.063 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:25.069+0000 7fbd32200640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 -- 0x7fbd240dde30 con 0x7fbd240dda20 2024-04-17T19:47:25.063 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:25.069+0000 7fbd2be00640 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7fbd240060f0 0x7fbd2404b690 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.44:60952/0 (socket says 172.21.15.44:60952) 2024-04-17T19:47:25.063 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:25.069+0000 7fbd2be00640 1 -- 172.21.15.44:0/884035141 learned_addr learned my addr 172.21.15.44:0/884035141 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-04-17T19:47:25.063 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:25.069+0000 7fbd30e00640 1 --2- 172.21.15.44:0/884035141 >> v2:172.21.15.44:3300/0 conn(0x7fbd240dda20 0x7fbd240457e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:25.063 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:25.069+0000 7f0497e00640 1 -- 172.21.15.44:0/71285192 >> v2:172.21.15.44:3300/0 conn(0x7f04a015a4b0 msgr2=0x7f04a0073410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T19:47:25.064 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:25.069+0000 7f0497e00640 1 --2- 172.21.15.44:0/71285192 >> v2:172.21.15.44:3300/0 conn(0x7f04a015a4b0 0x7f04a0073410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:25.064 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:25.069+0000 7f0497e00640 1 -- 172.21.15.44:0/71285192 >> v1:172.21.15.44:6789/0 conn(0x7f04a00c60e0 legacy=0x7f04a01634c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T19:47:25.064 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:25.069+0000 7fbd2b400640 1 -- 172.21.15.44:0/884035141 <== mon.1 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1555398994 0 0) 0x7fbd240e4620 con 0x7fbd240060f0 2024-04-17T19:47:25.064 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:25.069+0000 7fbd2b400640 1 -- 172.21.15.44:0/884035141 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbd14003530 con 0x7fbd240060f0 2024-04-17T19:47:25.064 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:25.069+0000 7fbd30e00640 1 -- 172.21.15.44:0/884035141 >> v1:172.21.15.62:6789/0 conn(0x7fbd240060f0 legacy=0x7fbd2404b690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:25.065 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:25.069+0000 7fbd30e00640 1 -- 172.21.15.44:0/884035141 >> v1:172.21.15.44:6789/0 conn(0x7fbd24006500 legacy=0x7fbd240ee040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T19:47:25.065 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:25.069+0000 7fbd30e00640 1 -- 172.21.15.44:0/884035141 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbd240e3860 con 0x7fbd240dda20 2024-04-17T19:47:25.065 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:25.069+0000 7f0497e00640 1 -- 172.21.15.44:0/71285192 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f04a0072930 con 0x7f04a00c5790 2024-04-17T19:47:25.065 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:25.069+0000 7f4b5de00640 1 --2- 172.21.15.44:0/386396179 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4b60155c70 0x7f4b60072a50 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f4b50009870 tx=0x7f4b5001ed50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b81ca0445e4c2b58 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:47:25.066 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:25.069+0000 7f6253c00640 1 Processor -- start 2024-04-17T19:47:25.066 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:25.069+0000 7f6253c00640 1 -- start start 2024-04-17T19:47:25.066 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:25.073+0000 7f4b5d400640 1 -- 172.21.15.44:0/386396179 <== mon.1 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b500b5070 con 0x7f4b60155c70 2024-04-17T19:47:25.066 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:25.073+0000 7f4b5d400640 1 -- 172.21.15.44:0/386396179 <== mon.1 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4b500a8a50 con 0x7f4b60155c70 2024-04-17T19:47:25.066 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:25.073+0000 7f4b5d400640 1 -- 172.21.15.44:0/386396179 <== mon.1 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b500a8e20 con 0x7f4b60155c70 2024-04-17T19:47:25.067 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:25.073+0000 7f4b64a00640 1 -- 172.21.15.44:0/386396179 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4b60155c70 msgr2=0x7f4b60072a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:25.067 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:25.073+0000 7f4b64a00640 1 --2- 172.21.15.44:0/386396179 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4b60155c70 0x7f4b60072a50 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f4b50009870 tx=0x7f4b5001ed50 comp rx=0 tx=0).stop 2024-04-17T19:47:25.067 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:25.073+0000 7ffb20a00640 1 --2- 172.21.15.44:0/2181828221 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7ffb1c153a00 0x7ffb1c0cb9b0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7ffb100097c0 tx=0x7ffb1001ec90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8875be72327fba78 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:47:25.067 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:25.073+0000 7f56d6e00640 1 Processor -- start 2024-04-17T19:47:25.067 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:25.073+0000 7f4b64a00640 1 -- 172.21.15.44:0/386396179 shutdown_connections 2024-04-17T19:47:25.068 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:25.073+0000 7f4b64a00640 1 --2- 172.21.15.44:0/386396179 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4b60155c70 0x7f4b60072a50 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:25.068 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:25.073+0000 7f4b64a00640 1 -- 172.21.15.44:0/386396179 >> 172.21.15.44:0/386396179 conn(0x7f4b600ccf60 msgr2=0x7f4b6006bd80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:47:25.068 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:25.073+0000 7fbd30e00640 1 --2- 172.21.15.44:0/884035141 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbd240dda20 0x7fbd240457e0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fbd200097a0 tx=0x7fbd2001c440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6e56152371b5002f server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:47:25.068 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:25.073+0000 7f4b64a00640 1 -- 172.21.15.44:0/386396179 shutdown_connections 2024-04-17T19:47:25.068 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:25.073+0000 7f4b64a00640 1 -- 172.21.15.44:0/386396179 wait complete. 2024-04-17T19:47:25.069 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:25.073+0000 7f0497e00640 1 --2- 172.21.15.44:0/71285192 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f04a00c5790 0x7f04a00c5ba0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f0488009870 tx=0x7f048801c400 comp rx=0 tx=0).ready entity=mon.2 client_cookie=23f1df7b294732b9 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:47:25.069 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:25.073+0000 7f56d6e00640 1 -- start start 2024-04-17T19:47:25.069 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:25.073+0000 7f049f400640 1 -- 172.21.15.44:0/71285192 <== mon.2 v2:172.21.15.62:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04880b0070 con 0x7f04a00c5790 2024-04-17T19:47:25.069 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:25.073+0000 7f049f400640 1 -- 172.21.15.44:0/71285192 <== mon.2 v2:172.21.15.62:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f04880ab600 con 0x7f04a00c5790 2024-04-17T19:47:25.070 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:25.073+0000 7ffb1be00640 1 -- 172.21.15.44:0/2181828221 <== mon.2 v2:172.21.15.62:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb100b5070 con 0x7ffb1c153a00 2024-04-17T19:47:25.070 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:25.073+0000 7ffb1be00640 1 -- 172.21.15.44:0/2181828221 <== mon.2 v2:172.21.15.62:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffb100a8990 con 0x7ffb1c153a00 2024-04-17T19:47:25.070 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:25.073+0000 7fbd2b400640 1 -- 172.21.15.44:0/884035141 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd200b0070 con 0x7fbd240dda20 2024-04-17T19:47:25.071 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:25.073+0000 7ffb1be00640 1 -- 172.21.15.44:0/2181828221 <== mon.2 v2:172.21.15.62:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb100a8d60 con 0x7ffb1c153a00 2024-04-17T19:47:25.071 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:25.073+0000 7fbd2b400640 1 -- 172.21.15.44:0/884035141 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbd200ab600 con 0x7fbd240dda20 2024-04-17T19:47:25.071 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:25.073+0000 7fbd2b400640 1 -- 172.21.15.44:0/884035141 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd200ab9d0 con 0x7fbd240dda20 2024-04-17T19:47:25.071 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:25.073+0000 7f6253c00640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f624c15a4b0 0x7f624c073410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:25.072 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:25.077+0000 7f6253c00640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f624c0c5790 0x7f624c0c5ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:25.072 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:25.077+0000 7f6253c00640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f624c073950 con 0x7f624c0c60e0 2024-04-17T19:47:25.072 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:25.077+0000 7f6253c00640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 -- 0x7f624c15ff50 con 0x7f624c0c5790 2024-04-17T19:47:25.072 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:25.077+0000 7f6253c00640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 -- 0x7f624c072650 con 0x7f624c15a4b0 2024-04-17T19:47:25.072 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:25.077+0000 7ffb22800640 1 -- 172.21.15.44:0/2181828221 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7ffb1c153a00 msgr2=0x7ffb1c0cb9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:25.072 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:25.077+0000 7ffb22800640 1 --2- 172.21.15.44:0/2181828221 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7ffb1c153a00 0x7ffb1c0cb9b0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7ffb100097c0 tx=0x7ffb1001ec90 comp rx=0 tx=0).stop 2024-04-17T19:47:25.072 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:25.077+0000 7f04a6c00640 1 -- 172.21.15.44:0/71285192 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f04a00c5790 msgr2=0x7f04a00c5ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:25.073 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:25.077+0000 7f04a6c00640 1 --2- 172.21.15.44:0/71285192 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f04a00c5790 0x7f04a00c5ba0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f0488009870 tx=0x7f048801c400 comp rx=0 tx=0).stop 2024-04-17T19:47:25.073 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:25.077+0000 7f04a6c00640 1 -- 172.21.15.44:0/71285192 shutdown_connections 2024-04-17T19:47:25.073 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:25.077+0000 7f04a6c00640 1 --2- 172.21.15.44:0/71285192 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f04a00c5790 0x7f04a00c5ba0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:25.073 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:25.077+0000 7f04a6c00640 1 --2- 172.21.15.44:0/71285192 >> v2:172.21.15.44:3300/0 conn(0x7f04a015a4b0 0x7f04a0073410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:25.073 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:25.077+0000 7f04a6c00640 1 -- 172.21.15.44:0/71285192 >> 172.21.15.44:0/71285192 conn(0x7f04a006c380 msgr2=0x7f04a0070080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:47:25.073 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:25.077+0000 7fbd32200640 1 -- 172.21.15.44:0/884035141 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbd240dda20 msgr2=0x7fbd240457e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:25.073 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:25.077+0000 7fbd32200640 1 --2- 172.21.15.44:0/884035141 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbd240dda20 0x7fbd240457e0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fbd200097a0 tx=0x7fbd2001c440 comp rx=0 tx=0).stop 2024-04-17T19:47:25.074 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:25.077+0000 7f624be00640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f624c0c5790 0x7f624c0c5ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:25.074 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:25.077+0000 7f6251c00640 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f624c0c60e0 0x7f624c1634c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.44:60964/0 (socket says 172.21.15.44:60964) 2024-04-17T19:47:25.074 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:25.077+0000 7f624be00640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f624c0c5790 0x7f624c0c5ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:42932/0 (socket says 172.21.15.44:42932) 2024-04-17T19:47:25.074 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:25.077+0000 7f6251c00640 1 -- 172.21.15.44:0/3709119294 learned_addr learned my addr 172.21.15.44:0/3709119294 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-04-17T19:47:25.074 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:25.077+0000 7f56d6e00640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f56d00ce160 0x7f56d00cec70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:25.074 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:25.077+0000 7f56d6e00640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f56d015f820 0x7f56d00d1180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:25.074 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:25.077+0000 7f56d6e00640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f56d00ce570 con 0x7f56d00d0d70 2024-04-17T19:47:25.074 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:25.077+0000 7f56d6e00640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 -- 0x7f56d015b980 con 0x7f56d00ce160 2024-04-17T19:47:25.074 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:25.077+0000 7f56d6e00640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7f56d015bc40 con 0x7f56d015f820 2024-04-17T19:47:25.075 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:25.077+0000 7f6251200640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f624c15a4b0 0x7f624c073410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:25.075 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:25.077+0000 7ffb22800640 1 -- 172.21.15.44:0/2181828221 shutdown_connections 2024-04-17T19:47:25.075 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:25.077+0000 7f56cfe00640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f56d00ce160 0x7f56d00cec70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:25.075 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:25.077+0000 7f56cfe00640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f56d00ce160 0x7f56d00cec70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.44:49364/0 (socket says 172.21.15.44:49364) 2024-04-17T19:47:25.076 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:25.077+0000 7f56cfe00640 1 -- 172.21.15.44:0/945068993 learned_addr learned my addr 172.21.15.44:0/945068993 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-04-17T19:47:25.076 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:25.077+0000 7fbd32200640 1 -- 172.21.15.44:0/884035141 shutdown_connections 2024-04-17T19:47:25.076 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:25.077+0000 7fbd32200640 1 --2- 172.21.15.44:0/884035141 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbd240dda20 0x7fbd240457e0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:25.076 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:25.077+0000 7f671ca00640 1 Processor -- start 2024-04-17T19:47:25.077 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:25.077+0000 7fbd32200640 1 -- 172.21.15.44:0/884035141 >> 172.21.15.44:0/884035141 conn(0x7fbd240503c0 msgr2=0x7fbd240507d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:47:25.077 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:25.077+0000 7f56d4e00640 1 --2- 172.21.15.44:0/945068993 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f56d015f820 0x7f56d00d1180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:25.077 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:25.077+0000 7ffb22800640 1 --2- 172.21.15.44:0/2181828221 >> v2:172.21.15.44:3300/0 conn(0x7ffb1c0cbef0 0x7ffb1c164060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:25.077 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:25.077+0000 7f04a6c00640 1 -- 172.21.15.44:0/71285192 shutdown_connections 2024-04-17T19:47:25.077 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:25.077+0000 7f04a6c00640 1 -- 172.21.15.44:0/71285192 wait complete. 2024-04-17T19:47:25.078 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:25.077+0000 7fbd32200640 1 -- 172.21.15.44:0/884035141 shutdown_connections 2024-04-17T19:47:25.078 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:25.077+0000 7f624be00640 1 -- 172.21.15.44:0/3709119294 >> v2:172.21.15.62:3300/0 conn(0x7f624c15a4b0 msgr2=0x7f624c073410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T19:47:25.079 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:25.077+0000 7ffb22800640 1 --2- 172.21.15.44:0/2181828221 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7ffb1c153a00 0x7ffb1c0cb9b0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:25.079 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:25.077+0000 7ffb22800640 1 -- 172.21.15.44:0/2181828221 >> 172.21.15.44:0/2181828221 conn(0x7ffb1c072320 msgr2=0x7ffb1c072730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:47:25.079 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:25.077+0000 7f4b64a00640 1 Processor -- start 2024-04-17T19:47:25.079 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:25.077+0000 7f671ca00640 1 -- start start 2024-04-17T19:47:25.079 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:25.077+0000 7f624b400640 1 -- 172.21.15.44:0/3709119294 <== mon.1 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2130212958 0 0) 0x7f624c073950 con 0x7f624c0c60e0 2024-04-17T19:47:25.080 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:25.077+0000 7f624be00640 1 --2- 172.21.15.44:0/3709119294 >> v2:172.21.15.62:3300/0 conn(0x7f624c15a4b0 0x7f624c073410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:25.080 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:25.077+0000 7f624be00640 1 -- 172.21.15.44:0/3709119294 >> v1:172.21.15.62:6789/0 conn(0x7f624c0c60e0 legacy=0x7f624c1634c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:25.080 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:25.077+0000 7f624be00640 1 -- 172.21.15.44:0/3709119294 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f624c072930 con 0x7f624c0c5790 2024-04-17T19:47:25.080 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:25.077+0000 7f6251200640 1 --2- 172.21.15.44:0/3709119294 >> v2:172.21.15.62:3300/0 conn(0x7f624c15a4b0 0x7f624c073410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-17T19:47:25.080 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:25.077+0000 7f4b64a00640 1 -- start start 2024-04-17T19:47:25.080 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:25.077+0000 7ffb22800640 1 -- 172.21.15.44:0/2181828221 shutdown_connections 2024-04-17T19:47:25.081 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:25.077+0000 7ffb22800640 1 -- 172.21.15.44:0/2181828221 wait complete. 2024-04-17T19:47:25.081 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:25.077+0000 7f56cfe00640 1 -- 172.21.15.44:0/945068993 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f56d015f820 msgr2=0x7f56d00d1180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T19:47:25.081 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:25.077+0000 7f56cfe00640 1 --2- 172.21.15.44:0/945068993 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f56d015f820 0x7f56d00d1180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:25.081 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:25.077+0000 7f56cfe00640 1 -- 172.21.15.44:0/945068993 >> v1:172.21.15.62:6789/0 conn(0x7f56d00d0d70 legacy=0x7f56d015f110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:25.081 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:25.077+0000 7f56cfe00640 1 -- 172.21.15.44:0/945068993 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f56d015bf20 con 0x7f56d00ce160 2024-04-17T19:47:25.081 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:25.077+0000 7fbd32200640 1 -- 172.21.15.44:0/884035141 wait complete. 2024-04-17T19:47:25.082 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:25.081+0000 7f4b64a00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4b60072f90 0x7f4b601f6270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:25.082 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:25.081+0000 7f4b64a00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4b600c6630 0x7f4b60157ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:25.082 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:25.081+0000 7f4b64a00640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f4b60155c70 0x7f4b60142e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:25.082 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:25.081+0000 7f4b64a00640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f4b600c5ec0 con 0x7f4b600c6630 2024-04-17T19:47:25.082 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:25.081+0000 7f4b64a00640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f4b600c6a40 con 0x7f4b60072f90 2024-04-17T19:47:25.082 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:25.081+0000 7f4b64a00640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7f4b600733a0 con 0x7f4b60155c70 2024-04-17T19:47:25.082 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:25.081+0000 7f4b5de00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4b600c6630 0x7f4b60157ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:25.083 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:25.081+0000 7f671ca00640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f67180c5790 0x7f67180c5ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:25.083 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:25.081+0000 7f671ca00640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f67180c60e0 0x7f671816a850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:25.083 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:25.081+0000 7f4b5e800640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4b60072f90 0x7f4b601f6270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:25.083 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:25.081+0000 7f4b5e800640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4b60072f90 0x7f4b601f6270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.44:49376/0 (socket says 172.21.15.44:49376) 2024-04-17T19:47:25.083 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:25.081+0000 7f4b5e800640 1 -- 172.21.15.44:0/2791043274 learned_addr learned my addr 172.21.15.44:0/2791043274 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-04-17T19:47:25.084 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:25.081+0000 7f671ca00640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f671815ff50 con 0x7f671815a4b0 2024-04-17T19:47:25.084 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:25.081+0000 7f671ca00640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 -- 0x7f6718072650 con 0x7f67180c60e0 2024-04-17T19:47:25.084 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:25.081+0000 7f671ca00640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7f6718072930 con 0x7f67180c5790 2024-04-17T19:47:25.084 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:25.081+0000 7f4b5f200640 1 --2- 172.21.15.44:0/2791043274 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f4b60155c70 0x7f4b60142e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:25.084 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:25.081+0000 7f6715e00640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f671815a4b0 0x7f6718073410 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:50502/0 (socket says 172.21.15.44:50502) 2024-04-17T19:47:25.085 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:25.081+0000 7f6715e00640 1 -- 172.21.15.44:0/835616708 learned_addr learned my addr 172.21.15.44:0/835616708 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-04-17T19:47:25.085 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:25.081+0000 7f4b5f200640 1 -- 172.21.15.44:0/2791043274 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4b60072f90 msgr2=0x7f4b601f6270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:25.085 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:25.081+0000 7f4b5f200640 1 --2- 172.21.15.44:0/2791043274 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4b60072f90 0x7f4b601f6270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:25.085 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:25.081+0000 7f4b5f200640 1 -- 172.21.15.44:0/2791043274 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4b600c6630 msgr2=0x7f4b60157ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:25.085 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:25.081+0000 7f4b5f200640 1 --2- 172.21.15.44:0/2791043274 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4b600c6630 0x7f4b60157ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:25.085 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:25.081+0000 7f4b5f200640 1 -- 172.21.15.44:0/2791043274 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4b60159320 con 0x7f4b60155c70 2024-04-17T19:47:25.085 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:25.081+0000 7f6716800640 1 --2- 172.21.15.44:0/835616708 >> v2:172.21.15.44:3300/0 conn(0x7f67180c60e0 0x7f671816a850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:25.086 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:25.081+0000 7f4b5f200640 1 --2- 172.21.15.44:0/2791043274 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f4b60155c70 0x7f4b60142e80 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f4b4c00c390 tx=0x7f4b4c00c850 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:47:25.086 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:25.081+0000 7f6715400640 1 --2- 172.21.15.44:0/835616708 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f67180c5790 0x7f67180c5ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:25.086 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:25.081+0000 7f624be00640 1 --2- 172.21.15.44:0/3709119294 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f624c0c5790 0x7f624c0c5ba0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f624c0ca100 tx=0x7f623c01c360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5a2baea06afdfefc server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:47:25.087 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:25.081+0000 7f04a6c00640 1 Processor -- start 2024-04-17T19:47:25.087 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:25.081+0000 7f56cfe00640 1 --2- 172.21.15.44:0/945068993 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f56d00ce160 0x7f56d00cec70 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f56c0009870 tx=0x7f56c001c3f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=dc36e3c0be6d0b2a server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:47:25.087 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:25.085+0000 7fbd32200640 1 Processor -- start 2024-04-17T19:47:25.088 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:25.085+0000 7f4b56a00640 1 -- 172.21.15.44:0/2791043274 <== mon.2 v2:172.21.15.62:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b4c017070 con 0x7f4b60155c70 2024-04-17T19:47:25.088 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:25.085+0000 7f4b56a00640 1 -- 172.21.15.44:0/2791043274 <== mon.2 v2:172.21.15.62:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4b4c0052d0 con 0x7f4b60155c70 2024-04-17T19:47:25.088 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:25.085+0000 7f4b56a00640 1 -- 172.21.15.44:0/2791043274 <== mon.2 v2:172.21.15.62:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b4c003840 con 0x7f4b60155c70 2024-04-17T19:47:25.088 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:25.085+0000 7f04a6c00640 1 -- start start 2024-04-17T19:47:25.088 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:25.085+0000 7f6716800640 1 -- 172.21.15.44:0/835616708 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f67180c5790 msgr2=0x7f67180c5ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T19:47:25.089 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:25.085+0000 7f6716800640 1 --2- 172.21.15.44:0/835616708 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f67180c5790 0x7f67180c5ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:25.089 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:25.085+0000 7f6716800640 1 -- 172.21.15.44:0/835616708 >> v1:172.21.15.44:6789/0 conn(0x7f671815a4b0 legacy=0x7f6718073410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:25.089 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:25.085+0000 7f6716800640 1 -- 172.21.15.44:0/835616708 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6718072c10 con 0x7f67180c60e0 2024-04-17T19:47:25.089 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:25.085+0000 7ffb22800640 1 Processor -- start 2024-04-17T19:47:25.089 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:25.085+0000 7ffb22800640 1 -- start start 2024-04-17T19:47:25.090 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:25.085+0000 7f624b400640 1 -- 172.21.15.44:0/3709119294 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f623c0b0070 con 0x7f624c0c5790 2024-04-17T19:47:25.090 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:25.085+0000 7f624b400640 1 -- 172.21.15.44:0/3709119294 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f623c0ab600 con 0x7f624c0c5790 2024-04-17T19:47:25.090 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:25.085+0000 7f624b400640 1 -- 172.21.15.44:0/3709119294 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f623c0ab9d0 con 0x7f624c0c5790 2024-04-17T19:47:25.090 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:25.085+0000 7f4b64a00640 1 -- 172.21.15.44:0/2791043274 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4b601562e0 con 0x7f4b60155c70 2024-04-17T19:47:25.090 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:25.085+0000 7f4b64a00640 1 -- 172.21.15.44:0/2791043274 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f4b6015b670 con 0x7f4b60155c70 2024-04-17T19:47:25.091 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:25.085+0000 7f56cea00640 1 -- 172.21.15.44:0/945068993 <== mon.1 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56c00b0070 con 0x7f56d00ce160 2024-04-17T19:47:25.091 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:25.085+0000 7f56cea00640 1 -- 172.21.15.44:0/945068993 <== mon.1 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f56c00ab600 con 0x7f56d00ce160 2024-04-17T19:47:25.091 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:25.085+0000 7f56cea00640 1 -- 172.21.15.44:0/945068993 <== mon.1 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56c00ab9d0 con 0x7f56d00ce160 2024-04-17T19:47:25.091 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:25.085+0000 7f6253c00640 1 -- 172.21.15.44:0/3709119294 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f624c0c5790 msgr2=0x7f624c0c5ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:25.091 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:25.085+0000 7f6253c00640 1 --2- 172.21.15.44:0/3709119294 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f624c0c5790 0x7f624c0c5ba0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f624c0ca100 tx=0x7f623c01c360 comp rx=0 tx=0).stop 2024-04-17T19:47:25.091 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:25.085+0000 7f04a6c00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f04a00c5790 0x7f04a0159790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:25.092 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:25.085+0000 7f04a6c00640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f04a00c60e0 0x7f04a01621b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:25.092 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:25.085+0000 7fbd32200640 1 -- start start 2024-04-17T19:47:25.092 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:25.085+0000 7fbd32200640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fbd240060f0 0x7fbd240cc5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:25.092 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:25.085+0000 7fbd32200640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbd24006500 0x7fbd240ccb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:25.092 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:25.085+0000 7fbd32200640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbd240dda20 0x7fbd240cd940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:25.092 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:25.085+0000 7fbd32200640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fbd240e7670 con 0x7fbd24006500 2024-04-17T19:47:25.092 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:25.085+0000 7fbd32200640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7fbd240e7c20 con 0x7fbd240dda20 2024-04-17T19:47:25.092 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:25.085+0000 7fbd32200640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7fbd2404ca60 con 0x7fbd240060f0 2024-04-17T19:47:25.093 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:25.085+0000 7f049fe00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f04a00c5790 0x7f04a0159790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:25.093 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:25.085+0000 7f04a6c00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f04a015a4b0 0x7f04a0143b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:25.093 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:25.085+0000 7f04a6c00640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f04a00741d0 con 0x7f04a015a4b0 2024-04-17T19:47:25.093 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:25.085+0000 7f04a6c00640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f04a0160210 con 0x7f04a00c5790 2024-04-17T19:47:25.093 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:25.085+0000 7f04a6c00640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7f04a0074350 con 0x7f04a00c60e0 2024-04-17T19:47:25.093 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:25.085+0000 7f56d6e00640 1 -- 172.21.15.44:0/945068993 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f56d00ce160 msgr2=0x7f56d00cec70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:25.094 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:25.085+0000 7f56d6e00640 1 --2- 172.21.15.44:0/945068993 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f56d00ce160 0x7f56d00cec70 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f56c0009870 tx=0x7f56c001c3f0 comp rx=0 tx=0).stop 2024-04-17T19:47:25.094 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:25.085+0000 7f6253c00640 1 -- 172.21.15.44:0/3709119294 shutdown_connections 2024-04-17T19:47:25.094 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:25.085+0000 7f6253c00640 1 --2- 172.21.15.44:0/3709119294 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f624c0c5790 0x7f624c0c5ba0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:25.094 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:25.085+0000 7f6253c00640 1 --2- 172.21.15.44:0/3709119294 >> v2:172.21.15.62:3300/0 conn(0x7f624c15a4b0 0x7f624c073410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:25.094 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:25.085+0000 7f6253c00640 1 -- 172.21.15.44:0/3709119294 >> 172.21.15.44:0/3709119294 conn(0x7f624c06c380 msgr2=0x7f624c070080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:47:25.094 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:25.085+0000 7ffb22800640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ffb1c0c41b0 0x7ffb1c0cd580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:25.095 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:25.085+0000 7f049fe00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f04a00c5790 0x7f04a0159790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.44:49382/0 (socket says 172.21.15.44:49382) 2024-04-17T19:47:25.095 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:25.085+0000 7f049fe00640 1 -- 172.21.15.44:0/3582962453 learned_addr learned my addr 172.21.15.44:0/3582962453 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-04-17T19:47:25.095 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:25.085+0000 7f6253c00640 1 -- 172.21.15.44:0/3709119294 shutdown_connections 2024-04-17T19:47:25.095 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:25.085+0000 7f0497e00640 1 --2- 172.21.15.44:0/3582962453 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f04a00c60e0 0x7f04a01621b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:25.096 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:25.089+0000 7fbd30e00640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fbd240060f0 0x7fbd240cc5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:25.096 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:25.089+0000 7f4b64a00640 1 -- 172.21.15.44:0/2791043274 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4b6004fea0 con 0x7f4b60155c70 2024-04-17T19:47:25.096 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:25.089+0000 7ffb22800640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ffb1c0cbef0 0x7ffb1c152750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:25.096 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:25.089+0000 7ffb22800640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7ffb1c153a00 0x7ffb1c145e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:25.096 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:25.089+0000 7ffb22800640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7ffb1c15dbb0 con 0x7ffb1c0cbef0 2024-04-17T19:47:25.096 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:25.089+0000 7ffb22800640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7ffb1c159a10 con 0x7ffb1c0c41b0 2024-04-17T19:47:25.096 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:25.089+0000 7ffb22800640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7ffb1c1596e0 con 0x7ffb1c153a00 2024-04-17T19:47:25.097 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:25.089+0000 7f04a4c00640 1 --2- 172.21.15.44:0/3582962453 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f04a015a4b0 0x7f04a0143b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:25.097 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:25.089+0000 7fbd30e00640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fbd240060f0 0x7fbd240cc5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3301/0 says I am v2:172.21.15.44:43534/0 (socket says 172.21.15.44:43534) 2024-04-17T19:47:25.097 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:25.089+0000 7fbd31800640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbd240dda20 0x7fbd240cd940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:25.097 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:25.089+0000 7fbd30e00640 1 -- 172.21.15.44:0/2224419368 learned_addr learned my addr 172.21.15.44:0/2224419368 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-04-17T19:47:25.097 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:25.089+0000 7f56d6e00640 1 -- 172.21.15.44:0/945068993 shutdown_connections 2024-04-17T19:47:25.098 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:25.089+0000 7f0497e00640 1 -- 172.21.15.44:0/3582962453 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f04a00c5790 msgr2=0x7f04a0159790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:25.098 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:25.089+0000 7ffb21400640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ffb1c0c41b0 0x7ffb1c0cd580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:25.098 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:25.089+0000 7ffb20a00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ffb1c0cbef0 0x7ffb1c152750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:25.098 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:25.089+0000 7ffb21400640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ffb1c0c41b0 0x7ffb1c0cd580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.44:49388/0 (socket says 172.21.15.44:49388) 2024-04-17T19:47:25.098 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:25.089+0000 7ffb21400640 1 -- 172.21.15.44:0/2988675590 learned_addr learned my addr 172.21.15.44:0/2988675590 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-04-17T19:47:25.099 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:25.089+0000 7f0497e00640 1 --2- 172.21.15.44:0/3582962453 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f04a00c5790 0x7f04a0159790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:25.099 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:25.089+0000 7f0497e00640 1 -- 172.21.15.44:0/3582962453 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f04a015a4b0 msgr2=0x7f04a0143b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:25.099 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:25.089+0000 7f0497e00640 1 --2- 172.21.15.44:0/3582962453 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f04a015a4b0 0x7f04a0143b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:25.099 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:25.089+0000 7f0497e00640 1 -- 172.21.15.44:0/3582962453 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f04a01626f0 con 0x7f04a00c60e0 2024-04-17T19:47:25.099 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:25.089+0000 7fbd31800640 1 -- 172.21.15.44:0/2224419368 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fbd240060f0 msgr2=0x7fbd240cc5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:25.099 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:25.089+0000 7fbd31800640 1 --2- 172.21.15.44:0/2224419368 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fbd240060f0 0x7fbd240cc5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:25.099 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:25.089+0000 7fbd31800640 1 -- 172.21.15.44:0/2224419368 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbd24006500 msgr2=0x7fbd240ccb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:25.099 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:25.089+0000 7f56d6e00640 1 --2- 172.21.15.44:0/945068993 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f56d015f820 0x7f56d00d1180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:25.100 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:25.089+0000 7f56d6e00640 1 --2- 172.21.15.44:0/945068993 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f56d00ce160 0x7f56d00cec70 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:25.100 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:25.089+0000 7f56d6e00640 1 -- 172.21.15.44:0/945068993 >> 172.21.15.44:0/945068993 conn(0x7f56d0067ce0 msgr2=0x7f56d00680f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:47:25.100 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:25.089+0000 7fbd31800640 1 --2- 172.21.15.44:0/2224419368 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbd24006500 0x7fbd240ccb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:25.100 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:25.089+0000 7ffb21e00640 1 --2- 172.21.15.44:0/2988675590 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7ffb1c153a00 0x7ffb1c145e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:25.100 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:25.089+0000 7fbd31800640 1 -- 172.21.15.44:0/2224419368 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbd24000f30 con 0x7fbd240dda20 2024-04-17T19:47:25.101 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:25.085+0000 7f6253c00640 1 -- 172.21.15.44:0/3709119294 wait complete. 2024-04-17T19:47:25.101 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:25.089+0000 7f0497e00640 1 --2- 172.21.15.44:0/3582962453 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f04a00c60e0 0x7f04a01621b0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f04a00727d0 tx=0x7f04880191a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:47:25.101 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:25.089+0000 7f4b56a00640 1 -- 172.21.15.44:0/2791043274 <== mon.2 v2:172.21.15.62:3301/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f4b4c01a070 con 0x7f4b60155c70 2024-04-17T19:47:25.102 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:25.089+0000 7f56d6e00640 1 -- 172.21.15.44:0/945068993 shutdown_connections 2024-04-17T19:47:25.102 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:25.089+0000 7f56d6e00640 1 -- 172.21.15.44:0/945068993 wait complete. 2024-04-17T19:47:25.102 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:25.089+0000 7f049cc00640 1 -- 172.21.15.44:0/3582962453 <== mon.2 v2:172.21.15.62:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04880b0050 con 0x7f04a00c60e0 2024-04-17T19:47:25.102 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:25.089+0000 7f049cc00640 1 -- 172.21.15.44:0/3582962453 <== mon.2 v2:172.21.15.62:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f04880ba070 con 0x7f04a00c60e0 2024-04-17T19:47:25.102 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:25.089+0000 7f049cc00640 1 -- 172.21.15.44:0/3582962453 <== mon.2 v2:172.21.15.62:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04880b5440 con 0x7f04a00c60e0 2024-04-17T19:47:25.102 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:25.089+0000 7fbd31800640 1 --2- 172.21.15.44:0/2224419368 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbd240dda20 0x7fbd240cd940 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fbd2c06af40 tx=0x7fbd2c0714b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:47:25.103 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:25.089+0000 7f04a6c00640 1 -- 172.21.15.44:0/3582962453 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f04a014dc80 con 0x7f04a00c60e0 2024-04-17T19:47:25.103 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:25.089+0000 7f04a6c00640 1 -- 172.21.15.44:0/3582962453 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f04a01619b0 con 0x7f04a00c60e0 2024-04-17T19:47:25.103 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:25.089+0000 7ffb21400640 1 -- 172.21.15.44:0/2988675590 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7ffb1c153a00 msgr2=0x7ffb1c145e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:25.103 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:25.089+0000 7ffb21400640 1 --2- 172.21.15.44:0/2988675590 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7ffb1c153a00 0x7ffb1c145e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:25.103 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:25.089+0000 7ffb21400640 1 -- 172.21.15.44:0/2988675590 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ffb1c0cbef0 msgr2=0x7ffb1c152750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:25.103 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:25.089+0000 7ffb21400640 1 --2- 172.21.15.44:0/2988675590 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ffb1c0cbef0 0x7ffb1c152750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:25.104 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:25.089+0000 7f4b56a00640 1 --2- 172.21.15.44:0/2791043274 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f4b40068380 0x7f4b4006a890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:25.104 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:25.089+0000 7ffb21400640 1 -- 172.21.15.44:0/2988675590 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffb1c152c90 con 0x7ffb1c0c41b0 2024-04-17T19:47:25.104 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:25.089+0000 7fbd28c00640 1 -- 172.21.15.44:0/2224419368 <== mon.1 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd2c074260 con 0x7fbd240dda20 2024-04-17T19:47:25.104 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:25.089+0000 7fbd28c00640 1 -- 172.21.15.44:0/2224419368 <== mon.1 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbd2c074400 con 0x7fbd240dda20 2024-04-17T19:47:25.104 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:25.089+0000 7fbd28c00640 1 -- 172.21.15.44:0/2224419368 <== mon.1 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd2c071d30 con 0x7fbd240dda20 2024-04-17T19:47:25.104 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:25.089+0000 7f6253c00640 1 Processor -- start 2024-04-17T19:47:25.105 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:25.089+0000 7f4b56a00640 1 -- 172.21.15.44:0/2791043274 <== mon.2 v2:172.21.15.62:3301/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f4b4c085e00 con 0x7f4b60155c70 2024-04-17T19:47:25.105 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:25.093+0000 7f4b5e800640 1 --2- 172.21.15.44:0/2791043274 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f4b40068380 0x7f4b4006a890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:25.105 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:25.093+0000 7ffb21400640 1 --2- 172.21.15.44:0/2988675590 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ffb1c0c41b0 0x7ffb1c0cd580 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7ffb0800c440 tx=0x7ffb0800c900 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:47:25.105 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:25.093+0000 7f6253c00640 1 -- start start 2024-04-17T19:47:25.106 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:25.093+0000 7fbd32200640 1 -- 172.21.15.44:0/2224419368 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbd2404f690 con 0x7fbd240dda20 2024-04-17T19:47:25.106 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:25.093+0000 7f6716800640 1 --2- 172.21.15.44:0/835616708 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f67180c60e0 0x7f671816a850 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f67040097c0 tx=0x7f670401c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e8233c592214bcfa server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:47:25.106 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:25.093+0000 7ffb19600640 1 -- 172.21.15.44:0/2988675590 <== mon.1 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb080074e0 con 0x7ffb1c0c41b0 2024-04-17T19:47:25.106 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:25.093+0000 7ffb22800640 1 -- 172.21.15.44:0/2988675590 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffb1c1fab10 con 0x7ffb1c0c41b0 2024-04-17T19:47:25.106 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:25.093+0000 7ffb22800640 1 -- 172.21.15.44:0/2988675590 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffb1c1fa550 con 0x7ffb1c0c41b0 2024-04-17T19:47:25.106 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:25.093+0000 7ffb19600640 1 -- 172.21.15.44:0/2988675590 <== mon.1 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffb080047f0 con 0x7ffb1c0c41b0 2024-04-17T19:47:25.107 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:25.093+0000 7fbd32200640 1 -- 172.21.15.44:0/2224419368 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbd2404fe90 con 0x7fbd240dda20 2024-04-17T19:47:25.107 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:25.093+0000 7f56d6e00640 1 Processor -- start 2024-04-17T19:47:25.107 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:25.093+0000 7f04a6c00640 1 -- 172.21.15.44:0/3582962453 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f04a014d9e0 con 0x7f04a00c60e0 2024-04-17T19:47:25.107 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:25.093+0000 7ffb19600640 1 -- 172.21.15.44:0/2988675590 <== mon.1 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb080074e0 con 0x7ffb1c0c41b0 2024-04-17T19:47:25.108 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:25.093+0000 7f6714a00640 1 -- 172.21.15.44:0/835616708 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67040b0070 con 0x7f67180c60e0 2024-04-17T19:47:25.108 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:25.093+0000 7f6714a00640 1 -- 172.21.15.44:0/835616708 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f67040ab600 con 0x7f67180c60e0 2024-04-17T19:47:25.108 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:25.093+0000 7f4b5e800640 1 --2- 172.21.15.44:0/2791043274 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f4b40068380 0x7f4b4006a890 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f4b58007fd0 tx=0x7f4b58009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:47:25.108 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:25.093+0000 7fbd32200640 1 -- 172.21.15.44:0/2224419368 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbd2404efd0 con 0x7fbd240dda20 2024-04-17T19:47:25.109 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:25.093+0000 7f6714a00640 1 -- 172.21.15.44:0/835616708 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67040ab9d0 con 0x7f67180c60e0 2024-04-17T19:47:25.109 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:25.093+0000 7f56d6e00640 1 -- start start 2024-04-17T19:47:25.109 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:25.093+0000 7f56d6e00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f56d00ce160 0x7f56d01e5860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:25.109 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:25.093+0000 7ffb22800640 1 -- 172.21.15.44:0/2988675590 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffaf80052a0 con 0x7ffb1c0c41b0 2024-04-17T19:47:25.110 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:25.093+0000 7f56d6e00640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f56d00d0d70 0x7f56d00b24d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:25.110 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:25.093+0000 7f56d6e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f56d015f820 0x7f56d015dc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:25.110 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:25.093+0000 7f56d6e00640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f56d00d0900 con 0x7f56d015f820 2024-04-17T19:47:25.110 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:25.093+0000 7f56d6e00640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f56d015c4e0 con 0x7f56d00ce160 2024-04-17T19:47:25.110 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:25.093+0000 7f56d6e00640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7f56d00d0a80 con 0x7f56d00d0d70 2024-04-17T19:47:25.110 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:25.093+0000 7f56cfe00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f56d00ce160 0x7f56d01e5860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:25.110 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:25.093+0000 7f671ca00640 1 -- 172.21.15.44:0/835616708 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f67180c60e0 msgr2=0x7f671816a850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:25.110 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:25.093+0000 7f671ca00640 1 --2- 172.21.15.44:0/835616708 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f67180c60e0 0x7f671816a850 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f67040097c0 tx=0x7f670401c3a0 comp rx=0 tx=0).stop 2024-04-17T19:47:25.111 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:25.093+0000 7f6253c00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f624c0c5790 0x7f624c151210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:25.111 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:25.093+0000 7f56cfe00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f56d00ce160 0x7f56d01e5860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.44:49402/0 (socket says 172.21.15.44:49402) 2024-04-17T19:47:25.111 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:25.093+0000 7f56cfe00640 1 -- 172.21.15.44:0/947233483 learned_addr learned my addr 172.21.15.44:0/947233483 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-04-17T19:47:25.111 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:25.093+0000 7f671ca00640 1 -- 172.21.15.44:0/835616708 shutdown_connections 2024-04-17T19:47:25.111 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:25.093+0000 7f671ca00640 1 --2- 172.21.15.44:0/835616708 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f67180c60e0 0x7f671816a850 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:25.111 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:25.093+0000 7f671ca00640 1 --2- 172.21.15.44:0/835616708 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f67180c5790 0x7f67180c5ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:25.111 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:25.093+0000 7f671ca00640 1 -- 172.21.15.44:0/835616708 >> 172.21.15.44:0/835616708 conn(0x7f671806c380 msgr2=0x7f6718070080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:47:25.112 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:25.097+0000 7fbd28c00640 1 -- 172.21.15.44:0/2224419368 <== mon.1 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fbd2c095400 con 0x7fbd240dda20 2024-04-17T19:47:25.112 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:25.097+0000 7f671ca00640 1 -- 172.21.15.44:0/835616708 shutdown_connections 2024-04-17T19:47:25.112 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:25.093+0000 7f6253c00640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f624c0c60e0 0x7f624c148a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:25.112 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:25.093+0000 7f6253c00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f624c15a4b0 0x7f624c148f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:25.112 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:25.093+0000 7f6253c00640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f624c0741d0 con 0x7f624c0c5790 2024-04-17T19:47:25.112 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:25.093+0000 7f6253c00640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f624c160210 con 0x7f624c15a4b0 2024-04-17T19:47:25.112 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:25.093+0000 7f6253c00640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7f624c074350 con 0x7f624c0c60e0 2024-04-17T19:47:25.113 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:25.097+0000 7f6251200640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f624c0c5790 0x7f624c151210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:25.113 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:25.097+0000 7f6251200640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f624c0c5790 0x7f624c151210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:42992/0 (socket says 172.21.15.44:42992) 2024-04-17T19:47:25.113 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:25.097+0000 7f6251200640 1 -- 172.21.15.44:0/2009761682 learned_addr learned my addr 172.21.15.44:0/2009761682 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-04-17T19:47:25.113 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:25.097+0000 7f6251c00640 1 --2- 172.21.15.44:0/2009761682 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f624c15a4b0 0x7f624c148f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:25.113 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:25.093+0000 7f56cf400640 1 --2- 172.21.15.44:0/947233483 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f56d00d0d70 0x7f56d00b24d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:25.113 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:25.093+0000 7f56d4e00640 1 --2- 172.21.15.44:0/947233483 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f56d015f820 0x7f56d015dc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:25.113 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:25.097+0000 7f56cfe00640 1 -- 172.21.15.44:0/947233483 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f56d00d0d70 msgr2=0x7f56d00b24d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:25.113 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:25.097+0000 7f56cfe00640 1 --2- 172.21.15.44:0/947233483 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f56d00d0d70 0x7f56d00b24d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:25.113 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:25.097+0000 7f56cfe00640 1 -- 172.21.15.44:0/947233483 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f56d015f820 msgr2=0x7f56d015dc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:25.113 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:25.097+0000 7f56cfe00640 1 --2- 172.21.15.44:0/947233483 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f56d015f820 0x7f56d015dc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:25.114 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:25.097+0000 7f56cfe00640 1 -- 172.21.15.44:0/947233483 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f56d01e5da0 con 0x7f56d00ce160 2024-04-17T19:47:25.114 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:25.097+0000 7f56cfe00640 1 --2- 172.21.15.44:0/947233483 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f56d00ce160 0x7f56d01e5860 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f56c001a020 tx=0x7f56c0019190 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:47:25.114 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:25.097+0000 7f6251200640 1 -- 172.21.15.44:0/2009761682 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f624c0c60e0 msgr2=0x7f624c148a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:25.114 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:25.097+0000 7f624be00640 1 --2- 172.21.15.44:0/2009761682 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f624c0c60e0 0x7f624c148a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:25.114 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:25.097+0000 7f671ca00640 1 -- 172.21.15.44:0/835616708 wait complete. 2024-04-17T19:47:25.115 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:25.097+0000 7f6251200640 1 --2- 172.21.15.44:0/2009761682 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f624c0c60e0 0x7f624c148a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:25.115 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:25.097+0000 7f6251200640 1 -- 172.21.15.44:0/2009761682 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f624c15a4b0 msgr2=0x7f624c148f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:25.115 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:25.097+0000 7f6251200640 1 --2- 172.21.15.44:0/2009761682 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f624c15a4b0 0x7f624c148f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:25.115 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:25.097+0000 7f6251200640 1 -- 172.21.15.44:0/2009761682 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f624c150770 con 0x7f624c0c5790 2024-04-17T19:47:25.115 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:25.097+0000 7f624be00640 1 --2- 172.21.15.44:0/2009761682 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f624c0c60e0 0x7f624c148a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-17T19:47:25.115 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:25.097+0000 7f6251c00640 1 --2- 172.21.15.44:0/2009761682 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f624c15a4b0 0x7f624c148f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-17T19:47:25.115 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:25.097+0000 7ffb19600640 1 -- 172.21.15.44:0/2988675590 <== mon.1 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7ffb08011070 con 0x7ffb1c0c41b0 2024-04-17T19:47:25.116 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:25.097+0000 7fbd28c00640 1 --2- 172.21.15.44:0/2224419368 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7fbd0c068380 0x7fbd0c06a890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:25.116 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:25.097+0000 7fbd28c00640 1 -- 172.21.15.44:0/2224419368 <== mon.1 v2:172.21.15.62:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fbd2c1033a0 con 0x7fbd240dda20 2024-04-17T19:47:25.116 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:25.097+0000 7f6251200640 1 --2- 172.21.15.44:0/2009761682 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f624c0c5790 0x7f624c151210 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f6244009ec0 tx=0x7f624400c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:47:25.116 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:25.097+0000 7fbd30e00640 1 --2- 172.21.15.44:0/2224419368 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7fbd0c068380 0x7fbd0c06a890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:25.117 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:25.097+0000 7f6248c00640 1 -- 172.21.15.44:0/2009761682 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6244018020 con 0x7f624c0c5790 2024-04-17T19:47:25.117 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:25.097+0000 7f6248c00640 1 -- 172.21.15.44:0/2009761682 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6244014680 con 0x7f624c0c5790 2024-04-17T19:47:25.117 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:25.097+0000 7f6248c00640 1 -- 172.21.15.44:0/2009761682 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6244014a50 con 0x7f624c0c5790 2024-04-17T19:47:25.117 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:25.097+0000 7f6253c00640 1 -- 172.21.15.44:0/2009761682 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f624c1fa2f0 con 0x7f624c0c5790 2024-04-17T19:47:25.117 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:25.097+0000 7f6253c00640 1 -- 172.21.15.44:0/2009761682 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f624c1494d0 con 0x7f624c0c5790 2024-04-17T19:47:25.118 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:25.097+0000 7ffb19600640 1 --2- 172.21.15.44:0/2988675590 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7ffafc068580 0x7ffafc06aa90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:25.118 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:25.097+0000 7ffb19600640 1 -- 172.21.15.44:0/2988675590 <== mon.1 v2:172.21.15.62:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7ffb08086400 con 0x7ffb1c0c41b0 2024-04-17T19:47:25.118 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:25.097+0000 7ffb20a00640 1 --2- 172.21.15.44:0/2988675590 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7ffafc068580 0x7ffafc06aa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:25.118 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:25.097+0000 7fbd30e00640 1 --2- 172.21.15.44:0/2224419368 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7fbd0c068380 0x7fbd0c06a890 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fbd200097a0 tx=0x7fbd200a6000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:47:25.118 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:25.097+0000 7f6253c00640 1 -- 172.21.15.44:0/2009761682 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f624c04ff10 con 0x7f624c0c5790 2024-04-17T19:47:25.119 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:25.101+0000 7ffb20a00640 1 --2- 172.21.15.44:0/2988675590 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7ffafc068580 0x7ffafc06aa90 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7ffb100b2000 tx=0x7ffb10008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:47:25.119 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:25.097+0000 7f671ca00640 1 Processor -- start 2024-04-17T19:47:25.119 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:25.101+0000 7f671ca00640 1 -- start start 2024-04-17T19:47:25.119 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:25.101+0000 7f6248c00640 1 -- 172.21.15.44:0/2009761682 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f624401b020 con 0x7f624c0c5790 2024-04-17T19:47:25.120 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:25.101+0000 7f671ca00640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f67180c5790 0x7f67180cb370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:25.120 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:25.101+0000 7f671ca00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f67180c60e0 0x7f671815e190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:25.120 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:25.101+0000 7f671ca00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f671815a4b0 0x7f6718151490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:25.120 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:25.101+0000 7f671ca00640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f6718074350 con 0x7f67180c60e0 2024-04-17T19:47:25.120 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:25.101+0000 7f671ca00640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f67180741d0 con 0x7f671815a4b0 2024-04-17T19:47:25.120 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:25.101+0000 7f671ca00640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7f6718073c30 con 0x7f67180c5790 2024-04-17T19:47:25.120 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:25.101+0000 7f6715400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f67180c60e0 0x7f671815e190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:25.121 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:25.101+0000 7f6715e00640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f67180c5790 0x7f67180cb370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:25.121 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:25.101+0000 7f6715400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f67180c60e0 0x7f671815e190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:43008/0 (socket says 172.21.15.44:43008) 2024-04-17T19:47:25.121 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:25.101+0000 7f6715400640 1 -- 172.21.15.44:0/2891073628 learned_addr learned my addr 172.21.15.44:0/2891073628 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-04-17T19:47:25.121 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:25.101+0000 7f6716800640 1 --2- 172.21.15.44:0/2891073628 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f671815a4b0 0x7f6718151490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:25.121 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:25.101+0000 7f6715400640 1 -- 172.21.15.44:0/2891073628 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f67180c5790 msgr2=0x7f67180cb370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:25.121 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:25.101+0000 7f6715400640 1 --2- 172.21.15.44:0/2891073628 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f67180c5790 0x7f67180cb370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:25.121 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:25.101+0000 7f6715400640 1 -- 172.21.15.44:0/2891073628 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f671815a4b0 msgr2=0x7f6718151490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:25.121 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:25.101+0000 7f6715400640 1 --2- 172.21.15.44:0/2891073628 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f671815a4b0 0x7f6718151490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:25.121 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:25.101+0000 7f6715400640 1 -- 172.21.15.44:0/2891073628 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f67180cb8b0 con 0x7f67180c60e0 2024-04-17T19:47:25.121 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:25.101+0000 7f6248c00640 1 --2- 172.21.15.44:0/2009761682 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f62280683d0 0x7f622806a8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:25.121 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:25.101+0000 7f6248c00640 1 -- 172.21.15.44:0/2009761682 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f6244088170 con 0x7f624c0c5790 2024-04-17T19:47:25.122 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:25.101+0000 7f6715400640 1 --2- 172.21.15.44:0/2891073628 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f67180c60e0 0x7f671815e190 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f6710009d10 tx=0x7f671000c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:47:25.122 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:25.101+0000 7f624be00640 1 --2- 172.21.15.44:0/2009761682 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f62280683d0 0x7f622806a8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:25.122 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:25.105+0000 7f624be00640 1 --2- 172.21.15.44:0/2009761682 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f62280683d0 0x7f622806a8e0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f623c0ad000 tx=0x7f623c0a6000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:47:25.123 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:25.105+0000 7f670e000640 1 -- 172.21.15.44:0/2891073628 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6710018020 con 0x7f67180c60e0 2024-04-17T19:47:25.123 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:25.105+0000 7f670e000640 1 -- 172.21.15.44:0/2891073628 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6710014480 con 0x7f67180c60e0 2024-04-17T19:47:25.123 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:25.105+0000 7f671ca00640 1 -- 172.21.15.44:0/2891073628 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f671814cca0 con 0x7f67180c60e0 2024-04-17T19:47:25.123 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:25.105+0000 7f670e000640 1 -- 172.21.15.44:0/2891073628 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6710014830 con 0x7f67180c60e0 2024-04-17T19:47:25.123 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:25.105+0000 7f671ca00640 1 -- 172.21.15.44:0/2891073628 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f671814d260 con 0x7f67180c60e0 2024-04-17T19:47:25.123 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:25.105+0000 7f6248c00640 1 -- 172.21.15.44:0/2009761682 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f6244022030 con 0x7f624c0c5790 2024-04-17T19:47:25.124 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:25.109+0000 7f671ca00640 1 -- 172.21.15.44:0/2891073628 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6718148ba0 con 0x7f67180c60e0 2024-04-17T19:47:25.124 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:25.109+0000 7f670e000640 1 -- 172.21.15.44:0/2891073628 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f671001b020 con 0x7f67180c60e0 2024-04-17T19:47:25.124 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:25.109+0000 7f670e000640 1 --2- 172.21.15.44:0/2891073628 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f66f8068380 0x7f66f806a890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:25.124 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:25.109+0000 7f670e000640 1 -- 172.21.15.44:0/2891073628 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f6710087a60 con 0x7f67180c60e0 2024-04-17T19:47:25.124 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:25.109+0000 7f6715e00640 1 --2- 172.21.15.44:0/2891073628 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f66f8068380 0x7f66f806a890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:25.124 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:25.109+0000 7f6715e00640 1 --2- 172.21.15.44:0/2891073628 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f66f8068380 0x7f66f806a890 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f6708000f70 tx=0x7f6708007e90 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:47:25.125 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:25.117+0000 7f4b56a00640 1 -- 172.21.15.44:0/2791043274 <== mon.2 v2:172.21.15.62:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f4b4c005480 con 0x7f4b60155c70 2024-04-17T19:47:25.125 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:25.117+0000 7f670e000640 1 -- 172.21.15.44:0/2891073628 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f6718148ba0 con 0x7f67180c60e0 2024-04-17T19:47:25.125 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:25.121+0000 7f049cc00640 1 -- 172.21.15.44:0/3582962453 <== mon.2 v2:172.21.15.62:3301/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f04880ab600 con 0x7f04a00c60e0 2024-04-17T19:47:25.126 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:25.121+0000 7f56c7e00640 1 -- 172.21.15.44:0/947233483 <== mon.1 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56c00ba070 con 0x7f56d00ce160 2024-04-17T19:47:25.126 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:25.121+0000 7f56d6e00640 1 -- 172.21.15.44:0/947233483 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f56d00b2a10 con 0x7f56d00ce160 2024-04-17T19:47:25.126 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:25.121+0000 7f56d6e00640 1 -- 172.21.15.44:0/947233483 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f56d00b3270 con 0x7f56d00ce160 2024-04-17T19:47:25.126 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:25.121+0000 7fbd28c00640 1 -- 172.21.15.44:0/2224419368 <== mon.1 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fbd2c0a4080 con 0x7fbd240dda20 2024-04-17T19:47:25.127 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:25.125+0000 7f049cc00640 1 --2- 172.21.15.44:0/3582962453 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f047c068400 0x7f047c06a910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:25.127 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:25.125+0000 7f049cc00640 1 -- 172.21.15.44:0/3582962453 <== mon.2 v2:172.21.15.62:3301/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f0488121ce0 con 0x7f04a00c60e0 2024-04-17T19:47:25.127 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:25.125+0000 7f049fe00640 1 --2- 172.21.15.44:0/3582962453 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f047c068400 0x7f047c06a910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:25.127 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:25.125+0000 7f56d6e00640 1 -- 172.21.15.44:0/947233483 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f56d004ff10 con 0x7f56d00ce160 2024-04-17T19:47:25.128 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:25.125+0000 7f049fe00640 1 --2- 172.21.15.44:0/3582962453 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f047c068400 0x7f047c06a910 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f049000ba50 tx=0x7f0490008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:47:25.136 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:25.145+0000 7f049cc00640 1 -- 172.21.15.44:0/3582962453 <== mon.2 v2:172.21.15.62:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f04a014d9e0 con 0x7f04a00c60e0 2024-04-17T19:47:25.137 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:25.145+0000 7f56c7e00640 1 -- 172.21.15.44:0/947233483 <== mon.1 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f56c0000e50 con 0x7f56d00ce160 2024-04-17T19:47:25.137 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:25.145+0000 7f56c7e00640 1 -- 172.21.15.44:0/947233483 <== mon.1 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56c00c3060 con 0x7f56d00ce160 2024-04-17T19:47:25.140 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:25.149+0000 7ffb19600640 1 -- 172.21.15.44:0/2988675590 <== mon.1 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7ffb080565e0 con 0x7ffb1c0c41b0 2024-04-17T19:47:25.141 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:25.149+0000 7f56c7e00640 1 -- 172.21.15.44:0/947233483 <== mon.1 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f56c00aab80 con 0x7f56d00ce160 2024-04-17T19:47:25.143 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:25.149+0000 7f56c7e00640 1 --2- 172.21.15.44:0/947233483 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f56b00683b0 0x7f56b006a8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:25.143 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:25.149+0000 7f56c7e00640 1 -- 172.21.15.44:0/947233483 <== mon.1 v2:172.21.15.62:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f56c0120a10 con 0x7f56d00ce160 2024-04-17T19:47:25.143 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:25.153+0000 7f56cf400640 1 --2- 172.21.15.44:0/947233483 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f56b00683b0 0x7f56b006a8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:25.144 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:25.153+0000 7f56cf400640 1 --2- 172.21.15.44:0/947233483 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f56b00683b0 0x7f56b006a8c0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f56d01e6b80 tx=0x7f56bc00b040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:47:25.151 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:25.161+0000 7f56c7e00640 1 -- 172.21.15.44:0/947233483 <== mon.1 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f56c0016070 con 0x7f56d00ce160 2024-04-17T19:47:25.321 INFO:tasks.ceph.mds.b.smithi062.stderr:2024-04-17T19:47:25.333+0000 7f319ee9e640 -1 mds.pinger is_rank_lagging: rank=1 was never sent ping request. 2024-04-17T19:47:25.323 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:25.333+0000 7f4d8a000640 1 -- 172.21.15.44:0/1438048915 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7f4d940c9550 con 0x7f4d940c3850 2024-04-17T19:47:25.324 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:25.333+0000 7f4d90c00640 1 -- 172.21.15.44:0/1438048915 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f4d8c0572f0 con 0x7f4d940c3850 2024-04-17T19:47:25.324 INFO:teuthology.orchestra.run.smithi044.stdout:64424509452 2024-04-17T19:47:25.327 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:25.337+0000 7f4d8a000640 1 -- 172.21.15.44:0/1438048915 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f4d740683d0 msgr2=0x7f4d7406a8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:25.327 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:25.337+0000 7f4d8a000640 1 --2- 172.21.15.44:0/1438048915 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f4d740683d0 0x7f4d7406a8e0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f4d800ad000 tx=0x7f4d80008040 comp rx=0 tx=0).stop 2024-04-17T19:47:25.327 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:25.337+0000 7f4d8a000640 1 -- 172.21.15.44:0/1438048915 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4d940c3850 msgr2=0x7f4d94159d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:25.327 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:25.337+0000 7f4d8a000640 1 --2- 172.21.15.44:0/1438048915 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4d940c3850 0x7f4d94159d50 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f4d8c00aa90 tx=0x7f4d8c00d490 comp rx=0 tx=0).stop 2024-04-17T19:47:25.328 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:25.337+0000 7f4d8a000640 1 -- 172.21.15.44:0/1438048915 shutdown_connections 2024-04-17T19:47:25.328 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:25.337+0000 7f4d8a000640 1 --2- 172.21.15.44:0/1438048915 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f4d740683d0 0x7f4d7406a8e0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:25.328 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:25.337+0000 7f4d8a000640 1 --2- 172.21.15.44:0/1438048915 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4d94158380 0x7f4d94158d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:25.328 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:25.337+0000 7f4d8a000640 1 --2- 172.21.15.44:0/1438048915 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4d940c3850 0x7f4d94159d50 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:25.328 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:25.337+0000 7f4d8a000640 1 --2- 172.21.15.44:0/1438048915 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f4d940c3440 0x7f4d9414f300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:25.328 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:25.337+0000 7f4d8a000640 1 -- 172.21.15.44:0/1438048915 >> 172.21.15.44:0/1438048915 conn(0x7f4d940704e0 msgr2=0x7f4d94075110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:47:25.328 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:25.337+0000 7f4d8a000640 1 -- 172.21.15.44:0/1438048915 shutdown_connections 2024-04-17T19:47:25.329 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:25.337+0000 7f4d8a000640 1 -- 172.21.15.44:0/1438048915 wait complete. 2024-04-17T19:47:25.360 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509452 got 64424509452 for osd.2 2024-04-17T19:47:25.360 DEBUG:teuthology.parallel:result is None 2024-04-17T19:47:25.414 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:25.421+0000 7f6253c00640 1 -- 172.21.15.44:0/2009761682 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7f624c16b640 con 0x7f624c0c5790 2024-04-17T19:47:25.415 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:25.425+0000 7f6248c00640 1 -- 172.21.15.44:0/2009761682 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f6244010040 con 0x7f624c0c5790 2024-04-17T19:47:25.415 INFO:teuthology.orchestra.run.smithi044.stdout:55834574859 2024-04-17T19:47:25.418 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:25.425+0000 7f6253c00640 1 -- 172.21.15.44:0/2009761682 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f62280683d0 msgr2=0x7f622806a8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:25.418 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:25.425+0000 7f6253c00640 1 --2- 172.21.15.44:0/2009761682 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f62280683d0 0x7f622806a8e0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f623c0ad000 tx=0x7f623c0a6000 comp rx=0 tx=0).stop 2024-04-17T19:47:25.418 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:25.425+0000 7f6253c00640 1 -- 172.21.15.44:0/2009761682 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f624c0c5790 msgr2=0x7f624c151210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:25.418 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:25.425+0000 7f6253c00640 1 --2- 172.21.15.44:0/2009761682 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f624c0c5790 0x7f624c151210 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f6244009ec0 tx=0x7f624400c490 comp rx=0 tx=0).stop 2024-04-17T19:47:25.419 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:25.429+0000 7f6253c00640 1 -- 172.21.15.44:0/2009761682 shutdown_connections 2024-04-17T19:47:25.419 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:25.429+0000 7f6253c00640 1 --2- 172.21.15.44:0/2009761682 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f62280683d0 0x7f622806a8e0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:25.420 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:25.429+0000 7f6253c00640 1 --2- 172.21.15.44:0/2009761682 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f624c0c60e0 0x7f624c148a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:25.420 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:25.429+0000 7f6253c00640 1 --2- 172.21.15.44:0/2009761682 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f624c15a4b0 0x7f624c148f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:25.420 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:25.429+0000 7f6253c00640 1 --2- 172.21.15.44:0/2009761682 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f624c0c5790 0x7f624c151210 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:25.420 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:25.429+0000 7f6253c00640 1 -- 172.21.15.44:0/2009761682 >> 172.21.15.44:0/2009761682 conn(0x7f624c06c380 msgr2=0x7f624c160420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:47:25.420 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:25.429+0000 7f6253c00640 1 -- 172.21.15.44:0/2009761682 shutdown_connections 2024-04-17T19:47:25.420 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:25.429+0000 7f6253c00640 1 -- 172.21.15.44:0/2009761682 wait complete. 2024-04-17T19:47:25.420 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:25.429+0000 7f04a6c00640 1 -- 172.21.15.44:0/3582962453 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7f04a004ff10 con 0x7f04a00c60e0 2024-04-17T19:47:25.422 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:25.433+0000 7f049cc00640 1 -- 172.21.15.44:0/3582962453 <== mon.2 v2:172.21.15.62:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f0488016110 con 0x7f04a00c60e0 2024-04-17T19:47:25.423 INFO:teuthology.orchestra.run.smithi044.stdout:55834574859 2024-04-17T19:47:25.425 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:25.433+0000 7f04a6c00640 1 -- 172.21.15.44:0/3582962453 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f047c068400 msgr2=0x7f047c06a910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:25.425 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:25.433+0000 7f04a6c00640 1 --2- 172.21.15.44:0/3582962453 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f047c068400 0x7f047c06a910 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f049000ba50 tx=0x7f0490008040 comp rx=0 tx=0).stop 2024-04-17T19:47:25.425 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:25.433+0000 7f04a6c00640 1 -- 172.21.15.44:0/3582962453 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f04a00c60e0 msgr2=0x7f04a01621b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:25.425 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:25.433+0000 7f04a6c00640 1 --2- 172.21.15.44:0/3582962453 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f04a00c60e0 0x7f04a01621b0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f04a00727d0 tx=0x7f04880191a0 comp rx=0 tx=0).stop 2024-04-17T19:47:25.425 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:25.433+0000 7f04a6c00640 1 -- 172.21.15.44:0/3582962453 shutdown_connections 2024-04-17T19:47:25.426 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:25.433+0000 7f04a6c00640 1 --2- 172.21.15.44:0/3582962453 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f047c068400 0x7f047c06a910 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:25.426 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:25.433+0000 7f04a6c00640 1 --2- 172.21.15.44:0/3582962453 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f04a00c60e0 0x7f04a01621b0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:25.426 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:25.433+0000 7f04a6c00640 1 --2- 172.21.15.44:0/3582962453 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f04a015a4b0 0x7f04a0143b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:25.426 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:25.433+0000 7f04a6c00640 1 --2- 172.21.15.44:0/3582962453 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f04a00c5790 0x7f04a0159790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:25.426 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:25.433+0000 7f04a6c00640 1 -- 172.21.15.44:0/3582962453 >> 172.21.15.44:0/3582962453 conn(0x7f04a006c380 msgr2=0x7f04a00c7f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:47:25.426 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:25.433+0000 7f04a6c00640 1 -- 172.21.15.44:0/3582962453 shutdown_connections 2024-04-17T19:47:25.426 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:25.433+0000 7f04a6c00640 1 -- 172.21.15.44:0/3582962453 wait complete. 2024-04-17T19:47:25.448 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574859 got 55834574859 for osd.5 2024-04-17T19:47:25.448 DEBUG:teuthology.parallel:result is None 2024-04-17T19:47:25.451 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:25.461+0000 7fbd32200640 1 -- 172.21.15.44:0/2224419368 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) -- 0x7fbd240054b0 con 0x7fbd240dda20 2024-04-17T19:47:25.452 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:25.461+0000 7fbd28c00640 1 -- 172.21.15.44:0/2224419368 <== mon.1 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fbd24000f30 con 0x7fbd240dda20 2024-04-17T19:47:25.452 INFO:teuthology.orchestra.run.smithi044.stdout:64424509452 2024-04-17T19:47:25.455 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:25.465+0000 7fbd32200640 1 -- 172.21.15.44:0/2224419368 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7fbd0c068380 msgr2=0x7fbd0c06a890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:25.456 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:25.465+0000 7fbd32200640 1 --2- 172.21.15.44:0/2224419368 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7fbd0c068380 0x7fbd0c06a890 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fbd200097a0 tx=0x7fbd200a6000 comp rx=0 tx=0).stop 2024-04-17T19:47:25.456 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:25.465+0000 7fbd32200640 1 -- 172.21.15.44:0/2224419368 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbd240dda20 msgr2=0x7fbd240cd940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:25.456 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:25.465+0000 7fbd32200640 1 --2- 172.21.15.44:0/2224419368 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbd240dda20 0x7fbd240cd940 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fbd2c06af40 tx=0x7fbd2c0714b0 comp rx=0 tx=0).stop 2024-04-17T19:47:25.457 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574859 got 55834574859 for osd.4 2024-04-17T19:47:25.457 DEBUG:teuthology.parallel:result is None 2024-04-17T19:47:25.457 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:25.465+0000 7fbd32200640 1 -- 172.21.15.44:0/2224419368 shutdown_connections 2024-04-17T19:47:25.457 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:25.465+0000 7fbd32200640 1 --2- 172.21.15.44:0/2224419368 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7fbd0c068380 0x7fbd0c06a890 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:25.457 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:25.465+0000 7fbd32200640 1 --2- 172.21.15.44:0/2224419368 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbd240dda20 0x7fbd240cd940 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:25.457 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:25.465+0000 7fbd32200640 1 --2- 172.21.15.44:0/2224419368 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbd24006500 0x7fbd240ccb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:25.457 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:25.465+0000 7fbd32200640 1 --2- 172.21.15.44:0/2224419368 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fbd240060f0 0x7fbd240cc5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:25.457 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:25.465+0000 7fbd32200640 1 -- 172.21.15.44:0/2224419368 >> 172.21.15.44:0/2224419368 conn(0x7fbd240503c0 msgr2=0x7fbd240db2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:47:25.458 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:25.465+0000 7fbd32200640 1 -- 172.21.15.44:0/2224419368 shutdown_connections 2024-04-17T19:47:25.458 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:25.465+0000 7fbd32200640 1 -- 172.21.15.44:0/2224419368 wait complete. 2024-04-17T19:47:25.463 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:25.473+0000 7f4b64a00640 1 -- 172.21.15.44:0/2791043274 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7f4b600c6e60 con 0x7f4b60155c70 2024-04-17T19:47:25.464 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:25.473+0000 7f671ca00640 1 -- 172.21.15.44:0/2891073628 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) -- 0x7f671804ff10 con 0x7f67180c60e0 2024-04-17T19:47:25.464 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:25.473+0000 7f4b56a00640 1 -- 172.21.15.44:0/2791043274 <== mon.2 v2:172.21.15.62:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f4b4c055a30 con 0x7f4b60155c70 2024-04-17T19:47:25.464 INFO:teuthology.orchestra.run.smithi044.stdout:64424509451 2024-04-17T19:47:25.464 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:25.473+0000 7f670e000640 1 -- 172.21.15.44:0/2891073628 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f6710022030 con 0x7f67180c60e0 2024-04-17T19:47:25.465 INFO:teuthology.orchestra.run.smithi044.stdout:64424509451 2024-04-17T19:47:25.466 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:25.473+0000 7f671ca00640 1 -- 172.21.15.44:0/2891073628 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f66f8068380 msgr2=0x7f66f806a890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:25.466 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:25.473+0000 7f671ca00640 1 --2- 172.21.15.44:0/2891073628 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f66f8068380 0x7f66f806a890 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f6708000f70 tx=0x7f6708007e90 comp rx=0 tx=0).stop 2024-04-17T19:47:25.466 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:25.473+0000 7f671ca00640 1 -- 172.21.15.44:0/2891073628 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f67180c60e0 msgr2=0x7f671815e190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:25.466 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:25.473+0000 7f671ca00640 1 --2- 172.21.15.44:0/2891073628 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f67180c60e0 0x7f671815e190 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f6710009d10 tx=0x7f671000c490 comp rx=0 tx=0).stop 2024-04-17T19:47:25.467 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:25.477+0000 7f671ca00640 1 -- 172.21.15.44:0/2891073628 shutdown_connections 2024-04-17T19:47:25.467 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:25.477+0000 7f671ca00640 1 --2- 172.21.15.44:0/2891073628 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f66f8068380 0x7f66f806a890 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:25.467 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:25.477+0000 7f671ca00640 1 --2- 172.21.15.44:0/2891073628 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f671815a4b0 0x7f6718151490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:25.467 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:25.477+0000 7f671ca00640 1 --2- 172.21.15.44:0/2891073628 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f67180c60e0 0x7f671815e190 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:25.468 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:25.477+0000 7f671ca00640 1 --2- 172.21.15.44:0/2891073628 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f67180c5790 0x7f67180cb370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:25.468 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:25.477+0000 7f671ca00640 1 -- 172.21.15.44:0/2891073628 >> 172.21.15.44:0/2891073628 conn(0x7f671806c380 msgr2=0x7f671806fe70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:47:25.468 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:25.477+0000 7f671ca00640 1 -- 172.21.15.44:0/2891073628 shutdown_connections 2024-04-17T19:47:25.468 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:25.477+0000 7f671ca00640 1 -- 172.21.15.44:0/2891073628 wait complete. 2024-04-17T19:47:25.469 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:25.477+0000 7f4b64a00640 1 -- 172.21.15.44:0/2791043274 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f4b40068380 msgr2=0x7f4b4006a890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:25.469 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:25.477+0000 7f4b64a00640 1 --2- 172.21.15.44:0/2791043274 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f4b40068380 0x7f4b4006a890 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f4b58007fd0 tx=0x7f4b58009040 comp rx=0 tx=0).stop 2024-04-17T19:47:25.469 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:25.477+0000 7f4b64a00640 1 -- 172.21.15.44:0/2791043274 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f4b60155c70 msgr2=0x7f4b60142e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:25.469 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:25.477+0000 7f4b64a00640 1 --2- 172.21.15.44:0/2791043274 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f4b60155c70 0x7f4b60142e80 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f4b4c00c390 tx=0x7f4b4c00c850 comp rx=0 tx=0).stop 2024-04-17T19:47:25.469 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:25.477+0000 7f4b64a00640 1 -- 172.21.15.44:0/2791043274 shutdown_connections 2024-04-17T19:47:25.469 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:25.477+0000 7f4b64a00640 1 --2- 172.21.15.44:0/2791043274 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f4b40068380 0x7f4b4006a890 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:25.469 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:25.477+0000 7f4b64a00640 1 --2- 172.21.15.44:0/2791043274 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f4b60155c70 0x7f4b60142e80 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:25.469 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:25.477+0000 7f4b64a00640 1 --2- 172.21.15.44:0/2791043274 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4b600c6630 0x7f4b60157ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:25.469 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:25.477+0000 7f4b64a00640 1 --2- 172.21.15.44:0/2791043274 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4b60072f90 0x7f4b601f6270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:25.469 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:25.477+0000 7f4b64a00640 1 -- 172.21.15.44:0/2791043274 >> 172.21.15.44:0/2791043274 conn(0x7f4b600ccf60 msgr2=0x7f4b600c7200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:47:25.469 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:25.477+0000 7f4b64a00640 1 -- 172.21.15.44:0/2791043274 shutdown_connections 2024-04-17T19:47:25.469 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:25.477+0000 7f4b64a00640 1 -- 172.21.15.44:0/2791043274 wait complete. 2024-04-17T19:47:25.489 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:25.497+0000 7f56d6e00640 1 -- 172.21.15.44:0/947233483 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7f56d01534d0 con 0x7f56d00ce160 2024-04-17T19:47:25.490 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:25.497+0000 7f56c7e00640 1 -- 172.21.15.44:0/947233483 <== mon.1 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f56c00f0630 con 0x7f56d00ce160 2024-04-17T19:47:25.491 INFO:teuthology.orchestra.run.smithi044.stdout:64424509451 2024-04-17T19:47:25.491 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509452 got 64424509452 for osd.6 2024-04-17T19:47:25.492 DEBUG:teuthology.parallel:result is None 2024-04-17T19:47:25.492 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509451 got 64424509451 for osd.7 2024-04-17T19:47:25.493 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:25.501+0000 7ffb22800640 1 -- 172.21.15.44:0/2988675590 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7ffaf8005590 con 0x7ffb1c0c41b0 2024-04-17T19:47:25.493 DEBUG:teuthology.parallel:result is None 2024-04-17T19:47:25.493 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:25.501+0000 7f56d6e00640 1 -- 172.21.15.44:0/947233483 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f56b00683b0 msgr2=0x7f56b006a8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:25.494 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:25.501+0000 7f56d6e00640 1 --2- 172.21.15.44:0/947233483 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f56b00683b0 0x7f56b006a8c0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f56d01e6b80 tx=0x7f56bc00b040 comp rx=0 tx=0).stop 2024-04-17T19:47:25.494 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:25.501+0000 7f56d6e00640 1 -- 172.21.15.44:0/947233483 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f56d00ce160 msgr2=0x7f56d01e5860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:25.494 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:25.501+0000 7f56d6e00640 1 --2- 172.21.15.44:0/947233483 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f56d00ce160 0x7f56d01e5860 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f56c001a020 tx=0x7f56c0019190 comp rx=0 tx=0).stop 2024-04-17T19:47:25.494 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:25.501+0000 7f56d6e00640 1 -- 172.21.15.44:0/947233483 shutdown_connections 2024-04-17T19:47:25.494 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:25.501+0000 7f56d6e00640 1 --2- 172.21.15.44:0/947233483 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f56b00683b0 0x7f56b006a8c0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:25.494 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:25.501+0000 7f56d6e00640 1 --2- 172.21.15.44:0/947233483 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f56d00d0d70 0x7f56d00b24d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:25.494 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:25.501+0000 7f56d6e00640 1 --2- 172.21.15.44:0/947233483 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f56d015f820 0x7f56d015dc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:25.494 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:25.501+0000 7f56d6e00640 1 --2- 172.21.15.44:0/947233483 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f56d00ce160 0x7f56d01e5860 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:25.494 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:25.501+0000 7f56d6e00640 1 -- 172.21.15.44:0/947233483 >> 172.21.15.44:0/947233483 conn(0x7f56d0067ce0 msgr2=0x7f56d00cf3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:47:25.494 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:25.501+0000 7ffb19600640 1 -- 172.21.15.44:0/2988675590 <== mon.1 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7ffb08055ee0 con 0x7ffb1c0c41b0 2024-04-17T19:47:25.495 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:25.501+0000 7f56d6e00640 1 -- 172.21.15.44:0/947233483 shutdown_connections 2024-04-17T19:47:25.495 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:25.501+0000 7f56d6e00640 1 -- 172.21.15.44:0/947233483 wait complete. 2024-04-17T19:47:25.495 INFO:teuthology.orchestra.run.smithi044.stdout:64424509452 2024-04-17T19:47:25.496 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:25.505+0000 7ffb22800640 1 -- 172.21.15.44:0/2988675590 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7ffafc068580 msgr2=0x7ffafc06aa90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:25.496 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:25.505+0000 7ffb22800640 1 --2- 172.21.15.44:0/2988675590 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7ffafc068580 0x7ffafc06aa90 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7ffb100b2000 tx=0x7ffb10008040 comp rx=0 tx=0).stop 2024-04-17T19:47:25.496 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:25.505+0000 7ffb22800640 1 -- 172.21.15.44:0/2988675590 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ffb1c0c41b0 msgr2=0x7ffb1c0cd580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:25.496 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:25.505+0000 7ffb22800640 1 --2- 172.21.15.44:0/2988675590 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ffb1c0c41b0 0x7ffb1c0cd580 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7ffb0800c440 tx=0x7ffb0800c900 comp rx=0 tx=0).stop 2024-04-17T19:47:25.496 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:25.505+0000 7ffb22800640 1 -- 172.21.15.44:0/2988675590 shutdown_connections 2024-04-17T19:47:25.496 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:25.505+0000 7ffb22800640 1 --2- 172.21.15.44:0/2988675590 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7ffafc068580 0x7ffafc06aa90 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:25.496 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:25.505+0000 7ffb22800640 1 --2- 172.21.15.44:0/2988675590 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7ffb1c153a00 0x7ffb1c145e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:25.496 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:25.505+0000 7ffb22800640 1 --2- 172.21.15.44:0/2988675590 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ffb1c0cbef0 0x7ffb1c152750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:25.496 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:25.505+0000 7ffb22800640 1 --2- 172.21.15.44:0/2988675590 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ffb1c0c41b0 0x7ffb1c0cd580 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:25.496 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:25.505+0000 7ffb22800640 1 -- 172.21.15.44:0/2988675590 >> 172.21.15.44:0/2988675590 conn(0x7ffb1c072320 msgr2=0x7ffb1c15cce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:47:25.497 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:25.505+0000 7ffb22800640 1 -- 172.21.15.44:0/2988675590 shutdown_connections 2024-04-17T19:47:25.497 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:25.505+0000 7ffb22800640 1 -- 172.21.15.44:0/2988675590 wait complete. 2024-04-17T19:47:25.499 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509450 got 64424509451 for osd.0 2024-04-17T19:47:25.499 DEBUG:teuthology.parallel:result is None 2024-04-17T19:47:25.515 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509451 got 64424509451 for osd.1 2024-04-17T19:47:25.515 DEBUG:teuthology.parallel:result is None 2024-04-17T19:47:25.517 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509452 got 64424509452 for osd.3 2024-04-17T19:47:25.517 DEBUG:teuthology.parallel:result is None 2024-04-17T19:47:25.517 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-04-17T19:47:25.518 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-17T19:47:25.712 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:25.721+0000 7f754be00640 1 Processor -- start 2024-04-17T19:47:25.712 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:25.721+0000 7f754be00640 1 -- start start 2024-04-17T19:47:25.715 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:25.721+0000 7f754be00640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f7544152a60 0x7f75440c6920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:25.715 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:25.721+0000 7f754be00640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f7544158eb0 0x7f75441592c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:25.715 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:25.721+0000 7f754be00640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7544152e70 con 0x7f75440c47c0 2024-04-17T19:47:25.715 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:25.721+0000 7f754be00640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 -- 0x7f75440c52c0 con 0x7f7544152a60 2024-04-17T19:47:25.715 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:25.721+0000 7f754be00640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 -- 0x7f75440c8840 con 0x7f7544158eb0 2024-04-17T19:47:25.715 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:25.721+0000 7f7549400640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f7544152a60 0x7f75440c6920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:25.715 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:25.721+0000 7f7549400640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f7544152a60 0x7f75440c6920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:53030/0 (socket says 172.21.15.44:53030) 2024-04-17T19:47:25.715 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:25.721+0000 7f7549400640 1 -- 172.21.15.44:0/118579386 learned_addr learned my addr 172.21.15.44:0/118579386 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-04-17T19:47:25.715 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:25.721+0000 7f7548a00640 1 --2- 172.21.15.44:0/118579386 >> v2:172.21.15.62:3300/0 conn(0x7f7544158eb0 0x7f75441592c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:25.715 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:25.725+0000 7f7549400640 1 -- 172.21.15.44:0/118579386 >> v2:172.21.15.62:3300/0 conn(0x7f7544158eb0 msgr2=0x7f75441592c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T19:47:25.715 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:25.725+0000 7f7549400640 1 --2- 172.21.15.44:0/118579386 >> v2:172.21.15.62:3300/0 conn(0x7f7544158eb0 0x7f75441592c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:25.715 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:25.725+0000 7f7549400640 1 -- 172.21.15.44:0/118579386 >> v1:172.21.15.62:6789/0 conn(0x7f75440c47c0 legacy=0x7f754415bd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:25.715 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:25.725+0000 7f7549400640 1 -- 172.21.15.44:0/118579386 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f75440c8b20 con 0x7f7544152a60 2024-04-17T19:47:25.715 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:25.725+0000 7f7548a00640 1 --2- 172.21.15.44:0/118579386 >> v2:172.21.15.62:3300/0 conn(0x7f7544158eb0 0x7f75441592c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-17T19:47:25.717 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:25.725+0000 7f7549400640 1 --2- 172.21.15.44:0/118579386 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7544152a60 0x7f75440c6920 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f75440ca920 tx=0x7f753801ed10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a4c1e10f56387186 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:47:25.718 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:25.725+0000 7f7543e00640 1 -- 172.21.15.44:0/118579386 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75380b5070 con 0x7f7544152a60 2024-04-17T19:47:25.718 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:25.725+0000 7f7543e00640 1 -- 172.21.15.44:0/118579386 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f75380a8a10 con 0x7f7544152a60 2024-04-17T19:47:25.718 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:25.725+0000 7f7543e00640 1 -- 172.21.15.44:0/118579386 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75380a8de0 con 0x7f7544152a60 2024-04-17T19:47:25.719 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:25.725+0000 7f754be00640 1 -- 172.21.15.44:0/118579386 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7544152a60 msgr2=0x7f75440c6920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:25.719 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:25.725+0000 7f754be00640 1 --2- 172.21.15.44:0/118579386 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7544152a60 0x7f75440c6920 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f75440ca920 tx=0x7f753801ed10 comp rx=0 tx=0).stop 2024-04-17T19:47:25.719 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:25.729+0000 7f754be00640 1 -- 172.21.15.44:0/118579386 shutdown_connections 2024-04-17T19:47:25.719 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:25.729+0000 7f754be00640 1 --2- 172.21.15.44:0/118579386 >> v2:172.21.15.62:3300/0 conn(0x7f7544158eb0 0x7f75441592c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:25.719 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:25.729+0000 7f754be00640 1 --2- 172.21.15.44:0/118579386 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7544152a60 0x7f75440c6920 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:25.719 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:25.729+0000 7f754be00640 1 -- 172.21.15.44:0/118579386 >> 172.21.15.44:0/118579386 conn(0x7f754406c380 msgr2=0x7f7544070080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:47:25.719 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:25.729+0000 7f754be00640 1 -- 172.21.15.44:0/118579386 shutdown_connections 2024-04-17T19:47:25.719 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:25.729+0000 7f754be00640 1 -- 172.21.15.44:0/118579386 wait complete. 2024-04-17T19:47:25.720 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:25.729+0000 7f754be00640 1 Processor -- start 2024-04-17T19:47:25.721 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:25.729+0000 7f754be00640 1 -- start start 2024-04-17T19:47:25.723 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:25.729+0000 7f754be00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f75440c47c0 0x7f7544148af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:25.723 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:25.729+0000 7f754be00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7544152a60 0x7f75441f1d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:25.723 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:25.729+0000 7f754be00640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f7544158eb0 0x7f754414b1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:25.723 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:25.729+0000 7f754be00640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f7544158990 con 0x7f75440c47c0 2024-04-17T19:47:25.723 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:25.729+0000 7f754be00640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f75440c90e0 con 0x7f7544152a60 2024-04-17T19:47:25.723 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:25.729+0000 7f754be00640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7f75440c6e60 con 0x7f7544158eb0 2024-04-17T19:47:25.723 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:25.729+0000 7f7549400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f75440c47c0 0x7f7544148af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:25.724 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:25.729+0000 7f7549400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f75440c47c0 0x7f7544148af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:53046/0 (socket says 172.21.15.44:53046) 2024-04-17T19:47:25.724 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:25.733+0000 7f7549400640 1 -- 172.21.15.44:0/2651870107 learned_addr learned my addr 172.21.15.44:0/2651870107 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-04-17T19:47:25.724 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:25.733+0000 7f7549e00640 1 --2- 172.21.15.44:0/2651870107 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f7544158eb0 0x7f754414b1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:25.724 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:25.733+0000 7f7548a00640 1 --2- 172.21.15.44:0/2651870107 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7544152a60 0x7f75441f1d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:25.724 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:25.733+0000 7f7549400640 1 -- 172.21.15.44:0/2651870107 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f7544158eb0 msgr2=0x7f754414b1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:25.724 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:25.733+0000 7f7549400640 1 --2- 172.21.15.44:0/2651870107 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f7544158eb0 0x7f754414b1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:25.724 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:25.733+0000 7f7549400640 1 -- 172.21.15.44:0/2651870107 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7544152a60 msgr2=0x7f75441f1d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:25.724 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:25.733+0000 7f7549400640 1 --2- 172.21.15.44:0/2651870107 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7544152a60 0x7f75441f1d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:25.724 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:25.733+0000 7f7549400640 1 -- 172.21.15.44:0/2651870107 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f75441f6290 con 0x7f75440c47c0 2024-04-17T19:47:25.724 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:25.733+0000 7f7549400640 1 --2- 172.21.15.44:0/2651870107 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f75440c47c0 0x7f7544148af0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f75380b3040 tx=0x7f753801bab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:47:25.725 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:25.733+0000 7f7541600640 1 -- 172.21.15.44:0/2651870107 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75380b5070 con 0x7f75440c47c0 2024-04-17T19:47:25.725 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:25.733+0000 7f7541600640 1 -- 172.21.15.44:0/2651870107 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f75380b0b30 con 0x7f75440c47c0 2024-04-17T19:47:25.725 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:25.733+0000 7f754be00640 1 -- 172.21.15.44:0/2651870107 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7544149030 con 0x7f75440c47c0 2024-04-17T19:47:25.725 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:25.733+0000 7f7541600640 1 -- 172.21.15.44:0/2651870107 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75380bb410 con 0x7f75440c47c0 2024-04-17T19:47:25.725 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:25.733+0000 7f754be00640 1 -- 172.21.15.44:0/2651870107 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f75441f57b0 con 0x7f75440c47c0 2024-04-17T19:47:25.726 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:25.733+0000 7f754be00640 1 -- 172.21.15.44:0/2651870107 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f754404ff10 con 0x7f75440c47c0 2024-04-17T19:47:25.726 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:25.733+0000 7f7541600640 1 -- 172.21.15.44:0/2651870107 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f75380c2060 con 0x7f75440c47c0 2024-04-17T19:47:25.726 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:25.733+0000 7f7541600640 1 --2- 172.21.15.44:0/2651870107 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f7524068380 0x7f752406a890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:25.726 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:25.737+0000 7f7541600640 1 -- 172.21.15.44:0/2651870107 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f7538123cb0 con 0x7f75440c47c0 2024-04-17T19:47:25.727 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:25.737+0000 7f7548a00640 1 --2- 172.21.15.44:0/2651870107 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f7524068380 0x7f752406a890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:25.727 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:25.737+0000 7f7548a00640 1 --2- 172.21.15.44:0/2651870107 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f7524068380 0x7f752406a890 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f7544158960 tx=0x7f7530008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:47:25.731 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:25.741+0000 7f7541600640 1 -- 172.21.15.44:0/2651870107 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f7538018870 con 0x7f75440c47c0 2024-04-17T19:47:25.893 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:25.901+0000 7f754be00640 1 -- 172.21.15.44:0/2651870107 --> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f754414bfb0 con 0x7f7524068380 2024-04-17T19:47:25.918 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:25.925+0000 7f7541600640 1 -- 172.21.15.44:0/2651870107 <== mgr.4102 v2:172.21.15.62:6832/1020159798 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+332651 (secure 0 0 0) 0x7f754414bfb0 con 0x7f7524068380 2024-04-17T19:47:25.921 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-04-17T19:47:25.924 INFO:teuthology.orchestra.run.smithi044.stderr:dumped all 2024-04-17T19:47:25.925 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:25.929+0000 7f754be00640 1 -- 172.21.15.44:0/2651870107 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f7524068380 msgr2=0x7f752406a890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:25.925 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:25.929+0000 7f754be00640 1 --2- 172.21.15.44:0/2651870107 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f7524068380 0x7f752406a890 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f7544158960 tx=0x7f7530008040 comp rx=0 tx=0).stop 2024-04-17T19:47:25.925 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:25.929+0000 7f754be00640 1 -- 172.21.15.44:0/2651870107 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f75440c47c0 msgr2=0x7f7544148af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:25.925 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:25.929+0000 7f754be00640 1 --2- 172.21.15.44:0/2651870107 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f75440c47c0 0x7f7544148af0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f75380b3040 tx=0x7f753801bab0 comp rx=0 tx=0).stop 2024-04-17T19:47:25.925 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:25.929+0000 7f754be00640 1 -- 172.21.15.44:0/2651870107 shutdown_connections 2024-04-17T19:47:25.925 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:25.929+0000 7f754be00640 1 --2- 172.21.15.44:0/2651870107 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f7524068380 0x7f752406a890 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:25.925 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:25.929+0000 7f754be00640 1 --2- 172.21.15.44:0/2651870107 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f7544158eb0 0x7f754414b1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:25.925 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:25.929+0000 7f754be00640 1 --2- 172.21.15.44:0/2651870107 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7544152a60 0x7f75441f1d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:25.925 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:25.929+0000 7f754be00640 1 --2- 172.21.15.44:0/2651870107 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f75440c47c0 0x7f7544148af0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:25.925 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:25.929+0000 7f754be00640 1 -- 172.21.15.44:0/2651870107 >> 172.21.15.44:0/2651870107 conn(0x7f754406c380 msgr2=0x7f7544155380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:47:25.925 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:25.929+0000 7f754be00640 1 -- 172.21.15.44:0/2651870107 shutdown_connections 2024-04-17T19:47:25.925 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:25.933+0000 7f754be00640 1 -- 172.21.15.44:0/2651870107 wait complete. 2024-04-17T19:47:25.942 INFO:teuthology.orchestra.run.smithi044.stdout:{"pg_ready":true,"pg_map":{"version":41,"stamp":"2024-04-17T19:47:25.907107+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":596414,"num_objects":42,"num_object_clones":0,"num_object_copies":84,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":42,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":246,"num_write_kb":2446,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":26,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":193,"ondisk_log_size":193,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":218384,"kb_used_data":2240,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754756336,"statfs":{"total":773094113280,"available":772870488064,"internally_reserved":0,"allocated":2293760,"data_stored":2006900,"data_compressed":66496,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":12751,"internal_metadata":221236785},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1547,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":40,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.006465"},"pg_stats":[{"pgid":"2.1f","version":"24'4","reported_seq":26,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T19:47:01.718542+0000","last_change":"2024-04-17T19:46:55.688623+0000","last_active":"2024-04-17T19:47:01.718542+0000","last_peered":"2024-04-17T19:47:01.718542+0000","last_clean":"2024-04-17T19:47:01.718542+0000","last_became_active":"2024-04-17T19:46:55.687455+0000","last_became_peered":"2024-04-17T19:46:55.687455+0000","last_unstale":"2024-04-17T19:47:01.718542+0000","last_undegraded":"2024-04-17T19:47:01.718542+0000","last_fullsized":"2024-04-17T19:47:01.718542+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:54.640133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:54.640133+0000","last_clean_scrub_stamp":"2024-04-17T19:46:54.640133+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:02:52.057635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T19:47:01.719008+0000","last_change":"2024-04-17T19:46:56.683770+0000","last_active":"2024-04-17T19:47:01.719008+0000","last_peered":"2024-04-17T19:47:01.719008+0000","last_clean":"2024-04-17T19:47:01.719008+0000","last_became_active":"2024-04-17T19:46:56.683111+0000","last_became_peered":"2024-04-17T19:46:56.683111+0000","last_unstale":"2024-04-17T19:47:01.719008+0000","last_undegraded":"2024-04-17T19:47:01.719008+0000","last_fullsized":"2024-04-17T19:47:01.719008+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_clean_scrub_stamp":"2024-04-17T19:46:55.648649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T22:25:59.135091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T19:47:02.881985+0000","last_change":"2024-04-17T19:47:00.788461+0000","last_active":"2024-04-17T19:47:02.881985+0000","last_peered":"2024-04-17T19:47:02.881985+0000","last_clean":"2024-04-17T19:47:02.881985+0000","last_became_active":"2024-04-17T19:47:00.787654+0000","last_became_peered":"2024-04-17T19:47:00.787654+0000","last_unstale":"2024-04-17T19:47:02.881985+0000","last_undegraded":"2024-04-17T19:47:02.881985+0000","last_fullsized":"2024-04-17T19:47:02.881985+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_clean_scrub_stamp":"2024-04-17T19:46:59.695482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T07:28:34.234670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4,1],"acting":[7,6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1e","version":"24'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T19:47:01.719064+0000","last_change":"2024-04-17T19:46:55.703749+0000","last_active":"2024-04-17T19:47:01.719064+0000","last_peered":"2024-04-17T19:47:01.719064+0000","last_clean":"2024-04-17T19:47:01.719064+0000","last_became_active":"2024-04-17T19:46:55.695191+0000","last_became_peered":"2024-04-17T19:46:55.695191+0000","last_unstale":"2024-04-17T19:47:01.719064+0000","last_undegraded":"2024-04-17T19:47:01.719064+0000","last_fullsized":"2024-04-17T19:47:01.719064+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:54.640133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:54.640133+0000","last_clean_scrub_stamp":"2024-04-17T19:46:54.640133+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:24:42.573542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T19:47:01.717983+0000","last_change":"2024-04-17T19:46:56.684814+0000","last_active":"2024-04-17T19:47:01.717983+0000","last_peered":"2024-04-17T19:47:01.717983+0000","last_clean":"2024-04-17T19:47:01.717983+0000","last_became_active":"2024-04-17T19:46:56.684475+0000","last_became_peered":"2024-04-17T19:46:56.684475+0000","last_unstale":"2024-04-17T19:47:01.717983+0000","last_undegraded":"2024-04-17T19:47:01.717983+0000","last_fullsized":"2024-04-17T19:47:01.717983+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_clean_scrub_stamp":"2024-04-17T19:46:55.648649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T05:38:55.394025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T19:47:01.869722+0000","last_change":"2024-04-17T19:47:00.769813+0000","last_active":"2024-04-17T19:47:01.869722+0000","last_peered":"2024-04-17T19:47:01.869722+0000","last_clean":"2024-04-17T19:47:01.869722+0000","last_became_active":"2024-04-17T19:47:00.769370+0000","last_became_peered":"2024-04-17T19:47:00.769370+0000","last_unstale":"2024-04-17T19:47:01.869722+0000","last_undegraded":"2024-04-17T19:47:01.869722+0000","last_fullsized":"2024-04-17T19:47:01.869722+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_clean_scrub_stamp":"2024-04-17T19:46:59.695482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:23:20.430751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,4,6],"acting":[2,7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1d","version":"24'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T19:47:02.723599+0000","last_change":"2024-04-17T19:46:55.695159+0000","last_active":"2024-04-17T19:47:02.723599+0000","last_peered":"2024-04-17T19:47:02.723599+0000","last_clean":"2024-04-17T19:47:02.723599+0000","last_became_active":"2024-04-17T19:46:55.694285+0000","last_became_peered":"2024-04-17T19:46:55.694285+0000","last_unstale":"2024-04-17T19:47:02.723599+0000","last_undegraded":"2024-04-17T19:47:02.723599+0000","last_fullsized":"2024-04-17T19:47:02.723599+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:54.640133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:54.640133+0000","last_clean_scrub_stamp":"2024-04-17T19:46:54.640133+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T04:52:16.008572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T19:47:02.880050+0000","last_change":"2024-04-17T19:46:56.700734+0000","last_active":"2024-04-17T19:47:02.880050+0000","last_peered":"2024-04-17T19:47:02.880050+0000","last_clean":"2024-04-17T19:47:02.880050+0000","last_became_active":"2024-04-17T19:46:56.700413+0000","last_became_peered":"2024-04-17T19:46:56.700413+0000","last_unstale":"2024-04-17T19:47:02.880050+0000","last_undegraded":"2024-04-17T19:47:02.880050+0000","last_fullsized":"2024-04-17T19:47:02.880050+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_clean_scrub_stamp":"2024-04-17T19:46:55.648649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:57:40.700986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T19:47:01.869999+0000","last_change":"2024-04-17T19:47:00.772341+0000","last_active":"2024-04-17T19:47:01.869999+0000","last_peered":"2024-04-17T19:47:01.869999+0000","last_clean":"2024-04-17T19:47:01.869999+0000","last_became_active":"2024-04-17T19:47:00.771578+0000","last_became_peered":"2024-04-17T19:47:00.771578+0000","last_unstale":"2024-04-17T19:47:01.869999+0000","last_undegraded":"2024-04-17T19:47:01.869999+0000","last_fullsized":"2024-04-17T19:47:01.869999+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_clean_scrub_stamp":"2024-04-17T19:46:59.695482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:51:07.602172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,3,6],"acting":[2,5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1c","version":"24'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T19:47:02.723800+0000","last_change":"2024-04-17T19:46:55.687607+0000","last_active":"2024-04-17T19:47:02.723800+0000","last_peered":"2024-04-17T19:47:02.723800+0000","last_clean":"2024-04-17T19:47:02.723800+0000","last_became_active":"2024-04-17T19:46:55.687282+0000","last_became_peered":"2024-04-17T19:46:55.687282+0000","last_unstale":"2024-04-17T19:47:02.723800+0000","last_undegraded":"2024-04-17T19:47:02.723800+0000","last_fullsized":"2024-04-17T19:47:02.723800+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:54.640133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:54.640133+0000","last_clean_scrub_stamp":"2024-04-17T19:46:54.640133+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T05:52:32.550876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T19:47:01.714880+0000","last_change":"2024-04-17T19:46:56.690268+0000","last_active":"2024-04-17T19:47:01.714880+0000","last_peered":"2024-04-17T19:47:01.714880+0000","last_clean":"2024-04-17T19:47:01.714880+0000","last_became_active":"2024-04-17T19:46:56.689988+0000","last_became_peered":"2024-04-17T19:46:56.689988+0000","last_unstale":"2024-04-17T19:47:01.714880+0000","last_undegraded":"2024-04-17T19:47:01.714880+0000","last_fullsized":"2024-04-17T19:47:01.714880+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_clean_scrub_stamp":"2024-04-17T19:46:55.648649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T01:29:59.423734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T19:47:01.869747+0000","last_change":"2024-04-17T19:47:00.759608+0000","last_active":"2024-04-17T19:47:01.869747+0000","last_peered":"2024-04-17T19:47:01.869747+0000","last_clean":"2024-04-17T19:47:01.869747+0000","last_became_active":"2024-04-17T19:47:00.759059+0000","last_became_peered":"2024-04-17T19:47:00.759059+0000","last_unstale":"2024-04-17T19:47:01.869747+0000","last_undegraded":"2024-04-17T19:47:01.869747+0000","last_fullsized":"2024-04-17T19:47:01.869747+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_clean_scrub_stamp":"2024-04-17T19:46:59.695482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:22:37.460235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,5,7],"acting":[2,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T19:47:01.714081+0000","last_change":"2024-04-17T19:46:56.688273+0000","last_active":"2024-04-17T19:47:01.714081+0000","last_peered":"2024-04-17T19:47:01.714081+0000","last_clean":"2024-04-17T19:47:01.714081+0000","last_became_active":"2024-04-17T19:46:56.687662+0000","last_became_peered":"2024-04-17T19:46:56.687662+0000","last_unstale":"2024-04-17T19:47:01.714081+0000","last_undegraded":"2024-04-17T19:47:01.714081+0000","last_fullsized":"2024-04-17T19:47:01.714081+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_clean_scrub_stamp":"2024-04-17T19:46:55.648649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:51:46.684685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"25'4","reported_seq":26,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T19:47:22.814261+0000","last_change":"2024-04-17T19:46:55.692833+0000","last_active":"2024-04-17T19:47:22.814261+0000","last_peered":"2024-04-17T19:47:22.814261+0000","last_clean":"2024-04-17T19:47:22.814261+0000","last_became_active":"2024-04-17T19:46:55.689006+0000","last_became_peered":"2024-04-17T19:46:55.689006+0000","last_unstale":"2024-04-17T19:47:22.814261+0000","last_undegraded":"2024-04-17T19:47:22.814261+0000","last_fullsized":"2024-04-17T19:47:22.814261+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:54.640133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:54.640133+0000","last_clean_scrub_stamp":"2024-04-17T19:46:54.640133+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:57:39.692470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T19:47:01.714813+0000","last_change":"2024-04-17T19:47:00.757063+0000","last_active":"2024-04-17T19:47:01.714813+0000","last_peered":"2024-04-17T19:47:01.714813+0000","last_clean":"2024-04-17T19:47:01.714813+0000","last_became_active":"2024-04-17T19:47:00.756456+0000","last_became_peered":"2024-04-17T19:47:00.756456+0000","last_unstale":"2024-04-17T19:47:01.714813+0000","last_undegraded":"2024-04-17T19:47:01.714813+0000","last_fullsized":"2024-04-17T19:47:01.714813+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_clean_scrub_stamp":"2024-04-17T19:46:59.695482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T02:52:51.655611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,5],"acting":[3,1,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T19:47:02.884821+0000","last_change":"2024-04-17T19:46:56.691544+0000","last_active":"2024-04-17T19:47:02.884821+0000","last_peered":"2024-04-17T19:47:02.884821+0000","last_clean":"2024-04-17T19:47:02.884821+0000","last_became_active":"2024-04-17T19:46:56.690828+0000","last_became_peered":"2024-04-17T19:46:56.690828+0000","last_unstale":"2024-04-17T19:47:02.884821+0000","last_undegraded":"2024-04-17T19:47:02.884821+0000","last_fullsized":"2024-04-17T19:47:02.884821+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_clean_scrub_stamp":"2024-04-17T19:46:55.648649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:11:01.745657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T19:47:02.881826+0000","last_change":"2024-04-17T19:46:55.715857+0000","last_active":"2024-04-17T19:47:02.881826+0000","last_peered":"2024-04-17T19:47:02.881826+0000","last_clean":"2024-04-17T19:47:02.881826+0000","last_became_active":"2024-04-17T19:46:55.715197+0000","last_became_peered":"2024-04-17T19:46:55.715197+0000","last_unstale":"2024-04-17T19:47:02.881826+0000","last_undegraded":"2024-04-17T19:47:02.881826+0000","last_fullsized":"2024-04-17T19:47:02.881826+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:54.640133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:54.640133+0000","last_clean_scrub_stamp":"2024-04-17T19:46:54.640133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:25:07.379181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T19:47:02.723301+0000","last_change":"2024-04-17T19:47:00.773528+0000","last_active":"2024-04-17T19:47:02.723301+0000","last_peered":"2024-04-17T19:47:02.723301+0000","last_clean":"2024-04-17T19:47:02.723301+0000","last_became_active":"2024-04-17T19:47:00.773077+0000","last_became_peered":"2024-04-17T19:47:00.773077+0000","last_unstale":"2024-04-17T19:47:02.723301+0000","last_undegraded":"2024-04-17T19:47:02.723301+0000","last_fullsized":"2024-04-17T19:47:02.723301+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_clean_scrub_stamp":"2024-04-17T19:46:59.695482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T02:53:18.654740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,6,1],"acting":[0,4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T19:47:01.715767+0000","last_change":"2024-04-17T19:46:56.695617+0000","last_active":"2024-04-17T19:47:01.715767+0000","last_peered":"2024-04-17T19:47:01.715767+0000","last_clean":"2024-04-17T19:47:01.715767+0000","last_became_active":"2024-04-17T19:46:56.695205+0000","last_became_peered":"2024-04-17T19:46:56.695205+0000","last_unstale":"2024-04-17T19:47:01.715767+0000","last_undegraded":"2024-04-17T19:47:01.715767+0000","last_fullsized":"2024-04-17T19:47:01.715767+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_clean_scrub_stamp":"2024-04-17T19:46:55.648649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T05:05:36.718886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"25'3","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T19:47:22.801427+0000","last_change":"2024-04-17T19:46:55.686220+0000","last_active":"2024-04-17T19:47:22.801427+0000","last_peered":"2024-04-17T19:47:22.801427+0000","last_clean":"2024-04-17T19:47:22.801427+0000","last_became_active":"2024-04-17T19:46:55.684782+0000","last_became_peered":"2024-04-17T19:46:55.684782+0000","last_unstale":"2024-04-17T19:47:22.801427+0000","last_undegraded":"2024-04-17T19:47:22.801427+0000","last_fullsized":"2024-04-17T19:47:22.801427+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:54.640133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:54.640133+0000","last_clean_scrub_stamp":"2024-04-17T19:46:54.640133+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:57:31.750325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T19:47:02.884208+0000","last_change":"2024-04-17T19:47:00.774664+0000","last_active":"2024-04-17T19:47:02.884208+0000","last_peered":"2024-04-17T19:47:02.884208+0000","last_clean":"2024-04-17T19:47:02.884208+0000","last_became_active":"2024-04-17T19:47:00.774008+0000","last_became_peered":"2024-04-17T19:47:00.774008+0000","last_unstale":"2024-04-17T19:47:02.884208+0000","last_undegraded":"2024-04-17T19:47:02.884208+0000","last_fullsized":"2024-04-17T19:47:02.884208+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_clean_scrub_stamp":"2024-04-17T19:46:59.695482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T04:04:16.650657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,2,3],"acting":[7,4,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T19:47:01.713826+0000","last_change":"2024-04-17T19:46:56.700069+0000","last_active":"2024-04-17T19:47:01.713826+0000","last_peered":"2024-04-17T19:47:01.713826+0000","last_clean":"2024-04-17T19:47:01.713826+0000","last_became_active":"2024-04-17T19:46:56.699525+0000","last_became_peered":"2024-04-17T19:46:56.699525+0000","last_unstale":"2024-04-17T19:47:01.713826+0000","last_undegraded":"2024-04-17T19:47:01.713826+0000","last_fullsized":"2024-04-17T19:47:01.713826+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_clean_scrub_stamp":"2024-04-17T19:46:55.648649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T00:28:36.944531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.8","version":"25'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T19:47:22.813771+0000","last_change":"2024-04-17T19:46:55.684594+0000","last_active":"2024-04-17T19:47:22.813771+0000","last_peered":"2024-04-17T19:47:22.813771+0000","last_clean":"2024-04-17T19:47:22.813771+0000","last_became_active":"2024-04-17T19:46:55.683145+0000","last_became_peered":"2024-04-17T19:46:55.683145+0000","last_unstale":"2024-04-17T19:47:22.813771+0000","last_undegraded":"2024-04-17T19:47:22.813771+0000","last_fullsized":"2024-04-17T19:47:22.813771+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:54.640133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:54.640133+0000","last_clean_scrub_stamp":"2024-04-17T19:46:54.640133+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T02:39:08.241534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T19:47:01.870328+0000","last_change":"2024-04-17T19:47:00.768781+0000","last_active":"2024-04-17T19:47:01.870328+0000","last_peered":"2024-04-17T19:47:01.870328+0000","last_clean":"2024-04-17T19:47:01.870328+0000","last_became_active":"2024-04-17T19:47:00.768277+0000","last_became_peered":"2024-04-17T19:47:00.768277+0000","last_unstale":"2024-04-17T19:47:01.870328+0000","last_undegraded":"2024-04-17T19:47:01.870328+0000","last_fullsized":"2024-04-17T19:47:01.870328+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_clean_scrub_stamp":"2024-04-17T19:46:59.695482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:07:00.936098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,7],"acting":[2,1,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T19:47:01.717916+0000","last_change":"2024-04-17T19:46:56.695528+0000","last_active":"2024-04-17T19:47:01.717916+0000","last_peered":"2024-04-17T19:47:01.717916+0000","last_clean":"2024-04-17T19:47:01.717916+0000","last_became_active":"2024-04-17T19:46:56.694993+0000","last_became_peered":"2024-04-17T19:46:56.694993+0000","last_unstale":"2024-04-17T19:47:01.717916+0000","last_undegraded":"2024-04-17T19:47:01.717916+0000","last_fullsized":"2024-04-17T19:47:01.717916+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_clean_scrub_stamp":"2024-04-17T19:46:55.648649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:08:14.848448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"25'4","reported_seq":26,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T19:47:22.803509+0000","last_change":"2024-04-17T19:46:55.688859+0000","last_active":"2024-04-17T19:47:22.803509+0000","last_peered":"2024-04-17T19:47:22.803509+0000","last_clean":"2024-04-17T19:47:22.803509+0000","last_became_active":"2024-04-17T19:46:55.688507+0000","last_became_peered":"2024-04-17T19:46:55.688507+0000","last_unstale":"2024-04-17T19:47:22.803509+0000","last_undegraded":"2024-04-17T19:47:22.803509+0000","last_fullsized":"2024-04-17T19:47:22.803509+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:54.640133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:54.640133+0000","last_clean_scrub_stamp":"2024-04-17T19:46:54.640133+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T01:53:38.377482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T19:47:01.869773+0000","last_change":"2024-04-17T19:47:00.781482+0000","last_active":"2024-04-17T19:47:01.869773+0000","last_peered":"2024-04-17T19:47:01.869773+0000","last_clean":"2024-04-17T19:47:01.869773+0000","last_became_active":"2024-04-17T19:47:00.780994+0000","last_became_peered":"2024-04-17T19:47:00.780994+0000","last_unstale":"2024-04-17T19:47:01.869773+0000","last_undegraded":"2024-04-17T19:47:01.869773+0000","last_fullsized":"2024-04-17T19:47:01.869773+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_clean_scrub_stamp":"2024-04-17T19:46:59.695482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T01:46:40.550031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,3,1],"acting":[2,6,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T19:47:01.718456+0000","last_change":"2024-04-17T19:46:56.695874+0000","last_active":"2024-04-17T19:47:01.718456+0000","last_peered":"2024-04-17T19:47:01.718456+0000","last_clean":"2024-04-17T19:47:01.718456+0000","last_became_active":"2024-04-17T19:46:56.694650+0000","last_became_peered":"2024-04-17T19:46:56.694650+0000","last_unstale":"2024-04-17T19:47:01.718456+0000","last_undegraded":"2024-04-17T19:47:01.718456+0000","last_fullsized":"2024-04-17T19:47:01.718456+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_clean_scrub_stamp":"2024-04-17T19:46:55.648649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:44:38.787541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"25'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T19:47:01.718214+0000","last_change":"2024-04-17T19:46:55.684490+0000","last_active":"2024-04-17T19:47:01.718214+0000","last_peered":"2024-04-17T19:47:01.718214+0000","last_clean":"2024-04-17T19:47:01.718214+0000","last_became_active":"2024-04-17T19:46:55.680100+0000","last_became_peered":"2024-04-17T19:46:55.680100+0000","last_unstale":"2024-04-17T19:47:01.718214+0000","last_undegraded":"2024-04-17T19:47:01.718214+0000","last_fullsized":"2024-04-17T19:47:01.718214+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:54.640133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:54.640133+0000","last_clean_scrub_stamp":"2024-04-17T19:46:54.640133+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:27:38.256174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T19:47:01.715596+0000","last_change":"2024-04-17T19:47:00.777588+0000","last_active":"2024-04-17T19:47:01.715596+0000","last_peered":"2024-04-17T19:47:01.715596+0000","last_clean":"2024-04-17T19:47:01.715596+0000","last_became_active":"2024-04-17T19:47:00.776873+0000","last_became_peered":"2024-04-17T19:47:00.776873+0000","last_unstale":"2024-04-17T19:47:01.715596+0000","last_undegraded":"2024-04-17T19:47:01.715596+0000","last_fullsized":"2024-04-17T19:47:01.715596+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_clean_scrub_stamp":"2024-04-17T19:46:59.695482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T02:52:42.471996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,6,3],"acting":[4,1,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T19:47:02.884485+0000","last_change":"2024-04-17T19:46:56.681681+0000","last_active":"2024-04-17T19:47:02.884485+0000","last_peered":"2024-04-17T19:47:02.884485+0000","last_clean":"2024-04-17T19:47:02.884485+0000","last_became_active":"2024-04-17T19:46:56.681316+0000","last_became_peered":"2024-04-17T19:46:56.681316+0000","last_unstale":"2024-04-17T19:47:02.884485+0000","last_undegraded":"2024-04-17T19:47:02.884485+0000","last_fullsized":"2024-04-17T19:47:02.884485+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_clean_scrub_stamp":"2024-04-17T19:46:55.648649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T07:28:30.187837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"25'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T19:47:01.715217+0000","last_change":"2024-04-17T19:46:55.692826+0000","last_active":"2024-04-17T19:47:01.715217+0000","last_peered":"2024-04-17T19:47:01.715217+0000","last_clean":"2024-04-17T19:47:01.715217+0000","last_became_active":"2024-04-17T19:46:55.691031+0000","last_became_peered":"2024-04-17T19:46:55.691031+0000","last_unstale":"2024-04-17T19:47:01.715217+0000","last_undegraded":"2024-04-17T19:47:01.715217+0000","last_fullsized":"2024-04-17T19:47:01.715217+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:54.640133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:54.640133+0000","last_clean_scrub_stamp":"2024-04-17T19:46:54.640133+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T05:52:32.550876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T19:47:02.882070+0000","last_change":"2024-04-17T19:47:00.777416+0000","last_active":"2024-04-17T19:47:02.882070+0000","last_peered":"2024-04-17T19:47:02.882070+0000","last_clean":"2024-04-17T19:47:02.882070+0000","last_became_active":"2024-04-17T19:47:00.771531+0000","last_became_peered":"2024-04-17T19:47:00.771531+0000","last_unstale":"2024-04-17T19:47:02.882070+0000","last_undegraded":"2024-04-17T19:47:02.882070+0000","last_fullsized":"2024-04-17T19:47:02.882070+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_clean_scrub_stamp":"2024-04-17T19:46:59.695482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:30:31.288100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,2,7],"acting":[6,0,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T19:47:01.870267+0000","last_change":"2024-04-17T19:46:56.692250+0000","last_active":"2024-04-17T19:47:01.870267+0000","last_peered":"2024-04-17T19:47:01.870267+0000","last_clean":"2024-04-17T19:47:01.870267+0000","last_became_active":"2024-04-17T19:46:56.691801+0000","last_became_peered":"2024-04-17T19:46:56.691801+0000","last_unstale":"2024-04-17T19:47:01.870267+0000","last_undegraded":"2024-04-17T19:47:01.870267+0000","last_fullsized":"2024-04-17T19:47:01.870267+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_clean_scrub_stamp":"2024-04-17T19:46:55.648649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T01:53:39.385998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T19:47:01.716158+0000","last_change":"2024-04-17T19:46:55.713556+0000","last_active":"2024-04-17T19:47:01.716158+0000","last_peered":"2024-04-17T19:47:01.716158+0000","last_clean":"2024-04-17T19:47:01.716158+0000","last_became_active":"2024-04-17T19:46:55.712908+0000","last_became_peered":"2024-04-17T19:46:55.712908+0000","last_unstale":"2024-04-17T19:47:01.716158+0000","last_undegraded":"2024-04-17T19:47:01.716158+0000","last_fullsized":"2024-04-17T19:47:01.716158+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:54.640133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:54.640133+0000","last_clean_scrub_stamp":"2024-04-17T19:46:54.640133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:57:31.750325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T19:47:02.881295+0000","last_change":"2024-04-17T19:47:00.776868+0000","last_active":"2024-04-17T19:47:02.881295+0000","last_peered":"2024-04-17T19:47:02.881295+0000","last_clean":"2024-04-17T19:47:02.881295+0000","last_became_active":"2024-04-17T19:47:00.771385+0000","last_became_peered":"2024-04-17T19:47:00.771385+0000","last_unstale":"2024-04-17T19:47:02.881295+0000","last_undegraded":"2024-04-17T19:47:02.881295+0000","last_fullsized":"2024-04-17T19:47:02.881295+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_clean_scrub_stamp":"2024-04-17T19:46:59.695482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T01:46:40.550031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5,7],"acting":[6,3,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T19:47:02.723383+0000","last_change":"2024-04-17T19:46:56.709288+0000","last_active":"2024-04-17T19:47:02.723383+0000","last_peered":"2024-04-17T19:47:02.723383+0000","last_clean":"2024-04-17T19:47:02.723383+0000","last_became_active":"2024-04-17T19:46:56.708572+0000","last_became_peered":"2024-04-17T19:46:56.708572+0000","last_unstale":"2024-04-17T19:47:02.723383+0000","last_undegraded":"2024-04-17T19:47:02.723383+0000","last_fullsized":"2024-04-17T19:47:02.723383+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_clean_scrub_stamp":"2024-04-17T19:46:55.648649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:51:03.555339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T19:47:01.714531+0000","last_change":"2024-04-17T19:46:55.708506+0000","last_active":"2024-04-17T19:47:01.714531+0000","last_peered":"2024-04-17T19:47:01.714531+0000","last_clean":"2024-04-17T19:47:01.714531+0000","last_became_active":"2024-04-17T19:46:55.708175+0000","last_became_peered":"2024-04-17T19:46:55.708175+0000","last_unstale":"2024-04-17T19:47:01.714531+0000","last_undegraded":"2024-04-17T19:47:01.714531+0000","last_fullsized":"2024-04-17T19:47:01.714531+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:54.640133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:54.640133+0000","last_clean_scrub_stamp":"2024-04-17T19:46:54.640133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T22:25:04.163982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T19:47:02.885589+0000","last_change":"2024-04-17T19:47:00.786657+0000","last_active":"2024-04-17T19:47:02.885589+0000","last_peered":"2024-04-17T19:47:02.885589+0000","last_clean":"2024-04-17T19:47:02.885589+0000","last_became_active":"2024-04-17T19:47:00.780743+0000","last_became_peered":"2024-04-17T19:47:00.780743+0000","last_unstale":"2024-04-17T19:47:02.885589+0000","last_undegraded":"2024-04-17T19:47:02.885589+0000","last_fullsized":"2024-04-17T19:47:02.885589+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_clean_scrub_stamp":"2024-04-17T19:46:59.695482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:07:00.936098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0,3],"acting":[6,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T19:47:01.715163+0000","last_change":"2024-04-17T19:46:56.679752+0000","last_active":"2024-04-17T19:47:01.715163+0000","last_peered":"2024-04-17T19:47:01.715163+0000","last_clean":"2024-04-17T19:47:01.715163+0000","last_became_active":"2024-04-17T19:46:56.679230+0000","last_became_peered":"2024-04-17T19:46:56.679230+0000","last_unstale":"2024-04-17T19:47:01.715163+0000","last_undegraded":"2024-04-17T19:47:01.715163+0000","last_fullsized":"2024-04-17T19:47:01.715163+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_clean_scrub_stamp":"2024-04-17T19:46:55.648649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:08:14.848448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"25'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T19:47:02.882287+0000","last_change":"2024-04-17T19:46:55.715967+0000","last_active":"2024-04-17T19:47:02.882287+0000","last_peered":"2024-04-17T19:47:02.882287+0000","last_clean":"2024-04-17T19:47:02.882287+0000","last_became_active":"2024-04-17T19:46:55.715247+0000","last_became_peered":"2024-04-17T19:46:55.715247+0000","last_unstale":"2024-04-17T19:47:02.882287+0000","last_undegraded":"2024-04-17T19:47:02.882287+0000","last_fullsized":"2024-04-17T19:47:02.882287+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:54.640133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:54.640133+0000","last_clean_scrub_stamp":"2024-04-17T19:46:54.640133+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T00:40:58.757373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T19:47:02.884271+0000","last_change":"2024-04-17T19:47:00.769901+0000","last_active":"2024-04-17T19:47:02.884271+0000","last_peered":"2024-04-17T19:47:02.884271+0000","last_clean":"2024-04-17T19:47:02.884271+0000","last_became_active":"2024-04-17T19:47:00.768634+0000","last_became_peered":"2024-04-17T19:47:00.768634+0000","last_unstale":"2024-04-17T19:47:02.884271+0000","last_undegraded":"2024-04-17T19:47:02.884271+0000","last_fullsized":"2024-04-17T19:47:02.884271+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_clean_scrub_stamp":"2024-04-17T19:46:59.695482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T04:48:47.816818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,7],"acting":[6,0,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T19:47:02.880908+0000","last_change":"2024-04-17T19:46:56.703467+0000","last_active":"2024-04-17T19:47:02.880908+0000","last_peered":"2024-04-17T19:47:02.880908+0000","last_clean":"2024-04-17T19:47:02.880908+0000","last_became_active":"2024-04-17T19:46:56.703148+0000","last_became_peered":"2024-04-17T19:46:56.703148+0000","last_unstale":"2024-04-17T19:47:02.880908+0000","last_undegraded":"2024-04-17T19:47:02.880908+0000","last_fullsized":"2024-04-17T19:47:02.880908+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_clean_scrub_stamp":"2024-04-17T19:46:55.648649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T22:01:49.863892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"25'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T19:47:01.714087+0000","last_change":"2024-04-17T19:46:55.715941+0000","last_active":"2024-04-17T19:47:01.714087+0000","last_peered":"2024-04-17T19:47:01.714087+0000","last_clean":"2024-04-17T19:47:01.714087+0000","last_became_active":"2024-04-17T19:46:55.715527+0000","last_became_peered":"2024-04-17T19:46:55.715527+0000","last_unstale":"2024-04-17T19:47:01.714087+0000","last_undegraded":"2024-04-17T19:47:01.714087+0000","last_fullsized":"2024-04-17T19:47:01.714087+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:54.640133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:54.640133+0000","last_clean_scrub_stamp":"2024-04-17T19:46:54.640133+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:11:00.737141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T19:47:01.718674+0000","last_change":"2024-04-17T19:47:00.784031+0000","last_active":"2024-04-17T19:47:01.718674+0000","last_peered":"2024-04-17T19:47:01.718674+0000","last_clean":"2024-04-17T19:47:01.718674+0000","last_became_active":"2024-04-17T19:47:00.783386+0000","last_became_peered":"2024-04-17T19:47:00.783386+0000","last_unstale":"2024-04-17T19:47:01.718674+0000","last_undegraded":"2024-04-17T19:47:01.718674+0000","last_fullsized":"2024-04-17T19:47:01.718674+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_clean_scrub_stamp":"2024-04-17T19:46:59.695482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:00:44.689926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6,1],"acting":[5,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T19:47:01.717334+0000","last_change":"2024-04-17T19:46:56.692287+0000","last_active":"2024-04-17T19:47:01.717334+0000","last_peered":"2024-04-17T19:47:01.717334+0000","last_clean":"2024-04-17T19:47:01.717334+0000","last_became_active":"2024-04-17T19:46:56.691917+0000","last_became_peered":"2024-04-17T19:46:56.691917+0000","last_unstale":"2024-04-17T19:47:01.717334+0000","last_undegraded":"2024-04-17T19:47:01.717334+0000","last_fullsized":"2024-04-17T19:47:01.717334+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_clean_scrub_stamp":"2024-04-17T19:46:55.648649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T07:37:05.790432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.3","version":"25'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T19:47:22.814735+0000","last_change":"2024-04-17T19:46:55.686031+0000","last_active":"2024-04-17T19:47:22.814735+0000","last_peered":"2024-04-17T19:47:22.814735+0000","last_clean":"2024-04-17T19:47:22.814735+0000","last_became_active":"2024-04-17T19:46:55.685599+0000","last_became_peered":"2024-04-17T19:46:55.685599+0000","last_unstale":"2024-04-17T19:47:22.814735+0000","last_undegraded":"2024-04-17T19:47:22.814735+0000","last_fullsized":"2024-04-17T19:47:22.814735+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:54.640133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:54.640133+0000","last_clean_scrub_stamp":"2024-04-17T19:46:54.640133+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T01:39:32.586696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":178,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T19:47:02.879822+0000","last_change":"2024-04-17T19:46:43.000943+0000","last_active":"2024-04-17T19:47:02.879822+0000","last_peered":"2024-04-17T19:47:02.879822+0000","last_clean":"2024-04-17T19:47:02.879822+0000","last_became_active":"2024-04-17T19:46:43.000652+0000","last_became_peered":"2024-04-17T19:46:43.000652+0000","last_unstale":"2024-04-17T19:47:02.879822+0000","last_undegraded":"2024-04-17T19:47:02.879822+0000","last_fullsized":"2024-04-17T19:47:02.879822+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:41.988197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:41.988197+0000","last_clean_scrub_stamp":"2024-04-17T19:46:41.988197+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T19:53:52.845547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T19:47:01.715109+0000","last_change":"2024-04-17T19:47:00.731680+0000","last_active":"2024-04-17T19:47:01.715109+0000","last_peered":"2024-04-17T19:47:01.715109+0000","last_clean":"2024-04-17T19:47:01.715109+0000","last_became_active":"2024-04-17T19:47:00.731093+0000","last_became_peered":"2024-04-17T19:47:00.731093+0000","last_unstale":"2024-04-17T19:47:01.715109+0000","last_undegraded":"2024-04-17T19:47:01.715109+0000","last_fullsized":"2024-04-17T19:47:01.715109+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_clean_scrub_stamp":"2024-04-17T19:46:59.695482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T04:59:23.336626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T19:47:01.714967+0000","last_change":"2024-04-17T19:46:56.692443+0000","last_active":"2024-04-17T19:47:01.714967+0000","last_peered":"2024-04-17T19:47:01.714967+0000","last_clean":"2024-04-17T19:47:01.714967+0000","last_became_active":"2024-04-17T19:46:56.692106+0000","last_became_peered":"2024-04-17T19:46:56.692106+0000","last_unstale":"2024-04-17T19:47:01.714967+0000","last_undegraded":"2024-04-17T19:47:01.714967+0000","last_fullsized":"2024-04-17T19:47:01.714967+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_clean_scrub_stamp":"2024-04-17T19:46:55.648649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T04:07:54.102221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T19:47:02.884978+0000","last_change":"2024-04-17T19:46:55.689884+0000","last_active":"2024-04-17T19:47:02.884978+0000","last_peered":"2024-04-17T19:47:02.884978+0000","last_clean":"2024-04-17T19:47:02.884978+0000","last_became_active":"2024-04-17T19:46:55.689059+0000","last_became_peered":"2024-04-17T19:46:55.689059+0000","last_unstale":"2024-04-17T19:47:02.884978+0000","last_undegraded":"2024-04-17T19:47:02.884978+0000","last_fullsized":"2024-04-17T19:47:02.884978+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:54.640133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:54.640133+0000","last_clean_scrub_stamp":"2024-04-17T19:46:54.640133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T04:52:16.008572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T19:47:01.869956+0000","last_change":"2024-04-17T19:47:00.760432+0000","last_active":"2024-04-17T19:47:01.869956+0000","last_peered":"2024-04-17T19:47:01.869956+0000","last_clean":"2024-04-17T19:47:01.869956+0000","last_became_active":"2024-04-17T19:47:00.759946+0000","last_became_peered":"2024-04-17T19:47:00.759946+0000","last_unstale":"2024-04-17T19:47:01.869956+0000","last_undegraded":"2024-04-17T19:47:01.869956+0000","last_fullsized":"2024-04-17T19:47:01.869956+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_clean_scrub_stamp":"2024-04-17T19:46:59.695482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:30:31.288100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,7,4],"acting":[2,3,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T19:47:02.723729+0000","last_change":"2024-04-17T19:46:56.695109+0000","last_active":"2024-04-17T19:47:02.723729+0000","last_peered":"2024-04-17T19:47:02.723729+0000","last_clean":"2024-04-17T19:47:02.723729+0000","last_became_active":"2024-04-17T19:46:56.694764+0000","last_became_peered":"2024-04-17T19:46:56.694764+0000","last_unstale":"2024-04-17T19:47:02.723729+0000","last_undegraded":"2024-04-17T19:47:02.723729+0000","last_fullsized":"2024-04-17T19:47:02.723729+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_clean_scrub_stamp":"2024-04-17T19:46:55.648649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T00:28:36.944531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"24'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T19:47:01.717531+0000","last_change":"2024-04-17T19:46:55.704346+0000","last_active":"2024-04-17T19:47:01.717531+0000","last_peered":"2024-04-17T19:47:01.717531+0000","last_clean":"2024-04-17T19:47:01.717531+0000","last_became_active":"2024-04-17T19:46:55.703334+0000","last_became_peered":"2024-04-17T19:46:55.703334+0000","last_unstale":"2024-04-17T19:47:01.717531+0000","last_undegraded":"2024-04-17T19:47:01.717531+0000","last_fullsized":"2024-04-17T19:47:01.717531+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:54.640133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:54.640133+0000","last_clean_scrub_stamp":"2024-04-17T19:46:54.640133+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:01:11.327106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T19:47:01.716304+0000","last_change":"2024-04-17T19:47:00.745450+0000","last_active":"2024-04-17T19:47:01.716304+0000","last_peered":"2024-04-17T19:47:01.716304+0000","last_clean":"2024-04-17T19:47:01.716304+0000","last_became_active":"2024-04-17T19:47:00.744227+0000","last_became_peered":"2024-04-17T19:47:00.744227+0000","last_unstale":"2024-04-17T19:47:01.716304+0000","last_undegraded":"2024-04-17T19:47:01.716304+0000","last_fullsized":"2024-04-17T19:47:01.716304+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_clean_scrub_stamp":"2024-04-17T19:46:59.695482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:52:15.523817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1,3],"acting":[5,4,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T19:47:02.723996+0000","last_change":"2024-04-17T19:46:56.687926+0000","last_active":"2024-04-17T19:47:02.723996+0000","last_peered":"2024-04-17T19:47:02.723996+0000","last_clean":"2024-04-17T19:47:02.723996+0000","last_became_active":"2024-04-17T19:46:56.687352+0000","last_became_peered":"2024-04-17T19:46:56.687352+0000","last_unstale":"2024-04-17T19:47:02.723996+0000","last_undegraded":"2024-04-17T19:47:02.723996+0000","last_fullsized":"2024-04-17T19:47:02.723996+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_clean_scrub_stamp":"2024-04-17T19:46:55.648649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T01:32:52.608291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.e","version":"24'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T19:47:01.717920+0000","last_change":"2024-04-17T19:46:55.716397+0000","last_active":"2024-04-17T19:47:01.717920+0000","last_peered":"2024-04-17T19:47:01.717920+0000","last_clean":"2024-04-17T19:47:01.717920+0000","last_became_active":"2024-04-17T19:46:55.715196+0000","last_became_peered":"2024-04-17T19:46:55.715196+0000","last_unstale":"2024-04-17T19:47:01.717920+0000","last_undegraded":"2024-04-17T19:47:01.717920+0000","last_fullsized":"2024-04-17T19:47:01.717920+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:54.640133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:54.640133+0000","last_clean_scrub_stamp":"2024-04-17T19:46:54.640133+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:24:42.573542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T19:47:01.713746+0000","last_change":"2024-04-17T19:47:00.735608+0000","last_active":"2024-04-17T19:47:01.713746+0000","last_peered":"2024-04-17T19:47:01.713746+0000","last_clean":"2024-04-17T19:47:01.713746+0000","last_became_active":"2024-04-17T19:47:00.735120+0000","last_became_peered":"2024-04-17T19:47:00.735120+0000","last_unstale":"2024-04-17T19:47:01.713746+0000","last_undegraded":"2024-04-17T19:47:01.713746+0000","last_fullsized":"2024-04-17T19:47:01.713746+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_clean_scrub_stamp":"2024-04-17T19:46:59.695482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T04:40:43.846198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T19:47:01.870376+0000","last_change":"2024-04-17T19:46:56.706026+0000","last_active":"2024-04-17T19:47:01.870376+0000","last_peered":"2024-04-17T19:47:01.870376+0000","last_clean":"2024-04-17T19:47:01.870376+0000","last_became_active":"2024-04-17T19:46:56.704786+0000","last_became_peered":"2024-04-17T19:46:56.704786+0000","last_unstale":"2024-04-17T19:47:01.870376+0000","last_undegraded":"2024-04-17T19:47:01.870376+0000","last_fullsized":"2024-04-17T19:47:01.870376+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_clean_scrub_stamp":"2024-04-17T19:46:55.648649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:59:17.441539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.f","version":"24'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T19:47:02.723994+0000","last_change":"2024-04-17T19:46:55.707082+0000","last_active":"2024-04-17T19:47:02.723994+0000","last_peered":"2024-04-17T19:47:02.723994+0000","last_clean":"2024-04-17T19:47:02.723994+0000","last_became_active":"2024-04-17T19:46:55.706729+0000","last_became_peered":"2024-04-17T19:46:55.706729+0000","last_unstale":"2024-04-17T19:47:02.723994+0000","last_undegraded":"2024-04-17T19:47:02.723994+0000","last_fullsized":"2024-04-17T19:47:02.723994+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:54.640133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:54.640133+0000","last_clean_scrub_stamp":"2024-04-17T19:46:54.640133+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:11:00.737141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T19:47:02.879853+0000","last_change":"2024-04-17T19:47:00.744054+0000","last_active":"2024-04-17T19:47:02.879853+0000","last_peered":"2024-04-17T19:47:02.879853+0000","last_clean":"2024-04-17T19:47:02.879853+0000","last_became_active":"2024-04-17T19:47:00.743582+0000","last_became_peered":"2024-04-17T19:47:00.743582+0000","last_unstale":"2024-04-17T19:47:02.879853+0000","last_undegraded":"2024-04-17T19:47:02.879853+0000","last_fullsized":"2024-04-17T19:47:02.879853+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_clean_scrub_stamp":"2024-04-17T19:46:59.695482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T22:25:09.219331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,2],"acting":[1,5,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T19:47:01.713775+0000","last_change":"2024-04-17T19:46:56.692435+0000","last_active":"2024-04-17T19:47:01.713775+0000","last_peered":"2024-04-17T19:47:01.713775+0000","last_clean":"2024-04-17T19:47:01.713775+0000","last_became_active":"2024-04-17T19:46:56.692038+0000","last_became_peered":"2024-04-17T19:46:56.692038+0000","last_unstale":"2024-04-17T19:47:01.713775+0000","last_undegraded":"2024-04-17T19:47:01.713775+0000","last_fullsized":"2024-04-17T19:47:01.713775+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_clean_scrub_stamp":"2024-04-17T19:46:55.648649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:06:56.889266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.10","version":"25'10","reported_seq":32,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T19:47:22.800243+0000","last_change":"2024-04-17T19:46:55.692188+0000","last_active":"2024-04-17T19:47:22.800243+0000","last_peered":"2024-04-17T19:47:22.800243+0000","last_clean":"2024-04-17T19:47:22.800243+0000","last_became_active":"2024-04-17T19:46:55.691286+0000","last_became_peered":"2024-04-17T19:46:55.691286+0000","last_unstale":"2024-04-17T19:47:22.800243+0000","last_undegraded":"2024-04-17T19:47:22.800243+0000","last_fullsized":"2024-04-17T19:47:22.800243+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:54.640133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:54.640133+0000","last_clean_scrub_stamp":"2024-04-17T19:46:54.640133+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:01:11.327106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T19:47:01.718903+0000","last_change":"2024-04-17T19:47:00.781167+0000","last_active":"2024-04-17T19:47:01.718903+0000","last_peered":"2024-04-17T19:47:01.718903+0000","last_clean":"2024-04-17T19:47:01.718903+0000","last_became_active":"2024-04-17T19:47:00.780167+0000","last_became_peered":"2024-04-17T19:47:00.780167+0000","last_unstale":"2024-04-17T19:47:01.718903+0000","last_undegraded":"2024-04-17T19:47:01.718903+0000","last_fullsized":"2024-04-17T19:47:01.718903+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_clean_scrub_stamp":"2024-04-17T19:46:59.695482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T00:07:51.831352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1,6],"acting":[5,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T19:47:02.879680+0000","last_change":"2024-04-17T19:46:56.676150+0000","last_active":"2024-04-17T19:47:02.879680+0000","last_peered":"2024-04-17T19:47:02.879680+0000","last_clean":"2024-04-17T19:47:02.879680+0000","last_became_active":"2024-04-17T19:46:56.675826+0000","last_became_peered":"2024-04-17T19:46:56.675826+0000","last_unstale":"2024-04-17T19:47:02.879680+0000","last_undegraded":"2024-04-17T19:47:02.879680+0000","last_fullsized":"2024-04-17T19:47:02.879680+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_clean_scrub_stamp":"2024-04-17T19:46:55.648649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T04:52:17.017088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T19:47:02.723099+0000","last_change":"2024-04-17T19:46:55.682001+0000","last_active":"2024-04-17T19:47:02.723099+0000","last_peered":"2024-04-17T19:47:02.723099+0000","last_clean":"2024-04-17T19:47:02.723099+0000","last_became_active":"2024-04-17T19:46:55.681607+0000","last_became_peered":"2024-04-17T19:46:55.681607+0000","last_unstale":"2024-04-17T19:47:02.723099+0000","last_undegraded":"2024-04-17T19:47:02.723099+0000","last_fullsized":"2024-04-17T19:47:02.723099+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:54.640133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:54.640133+0000","last_clean_scrub_stamp":"2024-04-17T19:46:54.640133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T04:43:37.994081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T19:47:01.717753+0000","last_change":"2024-04-17T19:47:00.756396+0000","last_active":"2024-04-17T19:47:01.717753+0000","last_peered":"2024-04-17T19:47:01.717753+0000","last_clean":"2024-04-17T19:47:01.717753+0000","last_became_active":"2024-04-17T19:47:00.755282+0000","last_became_peered":"2024-04-17T19:47:00.755282+0000","last_unstale":"2024-04-17T19:47:01.717753+0000","last_undegraded":"2024-04-17T19:47:01.717753+0000","last_fullsized":"2024-04-17T19:47:01.717753+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_clean_scrub_stamp":"2024-04-17T19:46:59.695482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:08:25.082826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6,4],"acting":[5,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T19:47:01.714233+0000","last_change":"2024-04-17T19:46:56.694764+0000","last_active":"2024-04-17T19:47:01.714233+0000","last_peered":"2024-04-17T19:47:01.714233+0000","last_clean":"2024-04-17T19:47:01.714233+0000","last_became_active":"2024-04-17T19:46:56.694449+0000","last_became_peered":"2024-04-17T19:46:56.694449+0000","last_unstale":"2024-04-17T19:47:01.714233+0000","last_undegraded":"2024-04-17T19:47:01.714233+0000","last_fullsized":"2024-04-17T19:47:01.714233+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_clean_scrub_stamp":"2024-04-17T19:46:55.648649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T02:53:14.607908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.12","version":"25'3","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T19:47:22.804537+0000","last_change":"2024-04-17T19:46:55.689900+0000","last_active":"2024-04-17T19:47:22.804537+0000","last_peered":"2024-04-17T19:47:22.804537+0000","last_clean":"2024-04-17T19:47:22.804537+0000","last_became_active":"2024-04-17T19:46:55.689607+0000","last_became_peered":"2024-04-17T19:46:55.689607+0000","last_unstale":"2024-04-17T19:47:22.804537+0000","last_undegraded":"2024-04-17T19:47:22.804537+0000","last_fullsized":"2024-04-17T19:47:22.804537+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:54.640133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:54.640133+0000","last_clean_scrub_stamp":"2024-04-17T19:46:54.640133+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:59:16.433023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T19:47:02.884022+0000","last_change":"2024-04-17T19:47:00.786434+0000","last_active":"2024-04-17T19:47:02.884022+0000","last_peered":"2024-04-17T19:47:02.884022+0000","last_clean":"2024-04-17T19:47:02.884022+0000","last_became_active":"2024-04-17T19:47:00.781025+0000","last_became_peered":"2024-04-17T19:47:00.781025+0000","last_unstale":"2024-04-17T19:47:02.884022+0000","last_undegraded":"2024-04-17T19:47:02.884022+0000","last_fullsized":"2024-04-17T19:47:02.884022+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_clean_scrub_stamp":"2024-04-17T19:46:59.695482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:51:07.602172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0,7],"acting":[6,4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T19:47:02.881470+0000","last_change":"2024-04-17T19:46:56.693555+0000","last_active":"2024-04-17T19:47:02.881470+0000","last_peered":"2024-04-17T19:47:02.881470+0000","last_clean":"2024-04-17T19:47:02.881470+0000","last_became_active":"2024-04-17T19:46:56.687385+0000","last_became_peered":"2024-04-17T19:46:56.687385+0000","last_unstale":"2024-04-17T19:47:02.881470+0000","last_undegraded":"2024-04-17T19:47:02.881470+0000","last_fullsized":"2024-04-17T19:47:02.881470+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_clean_scrub_stamp":"2024-04-17T19:46:55.648649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T05:52:33.559392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"25'4","reported_seq":26,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T19:47:22.801932+0000","last_change":"2024-04-17T19:46:55.700010+0000","last_active":"2024-04-17T19:47:22.801932+0000","last_peered":"2024-04-17T19:47:22.801932+0000","last_clean":"2024-04-17T19:47:22.801932+0000","last_became_active":"2024-04-17T19:46:55.698962+0000","last_became_peered":"2024-04-17T19:46:55.698962+0000","last_unstale":"2024-04-17T19:47:22.801932+0000","last_undegraded":"2024-04-17T19:47:22.801932+0000","last_fullsized":"2024-04-17T19:47:22.801932+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:54.640133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:54.640133+0000","last_clean_scrub_stamp":"2024-04-17T19:46:54.640133+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T01:25:12.780134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T19:47:01.714898+0000","last_change":"2024-04-17T19:47:00.760341+0000","last_active":"2024-04-17T19:47:01.714898+0000","last_peered":"2024-04-17T19:47:01.714898+0000","last_clean":"2024-04-17T19:47:01.714898+0000","last_became_active":"2024-04-17T19:47:00.759892+0000","last_became_peered":"2024-04-17T19:47:00.759892+0000","last_unstale":"2024-04-17T19:47:01.714898+0000","last_undegraded":"2024-04-17T19:47:01.714898+0000","last_fullsized":"2024-04-17T19:47:01.714898+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_clean_scrub_stamp":"2024-04-17T19:46:59.695482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T05:15:30.939022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5,6],"acting":[3,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T19:47:02.723476+0000","last_change":"2024-04-17T19:46:56.696716+0000","last_active":"2024-04-17T19:47:02.723476+0000","last_peered":"2024-04-17T19:47:02.723476+0000","last_clean":"2024-04-17T19:47:02.723476+0000","last_became_active":"2024-04-17T19:46:56.696355+0000","last_became_peered":"2024-04-17T19:46:56.696355+0000","last_unstale":"2024-04-17T19:47:02.723476+0000","last_undegraded":"2024-04-17T19:47:02.723476+0000","last_fullsized":"2024-04-17T19:47:02.723476+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_clean_scrub_stamp":"2024-04-17T19:46:55.648649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:06:56.889266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.14","version":"25'11","reported_seq":33,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T19:47:22.805405+0000","last_change":"2024-04-17T19:46:55.697242+0000","last_active":"2024-04-17T19:47:22.805405+0000","last_peered":"2024-04-17T19:47:22.805405+0000","last_clean":"2024-04-17T19:47:22.805405+0000","last_became_active":"2024-04-17T19:46:55.696876+0000","last_became_peered":"2024-04-17T19:46:55.696876+0000","last_unstale":"2024-04-17T19:47:22.805405+0000","last_undegraded":"2024-04-17T19:47:22.805405+0000","last_fullsized":"2024-04-17T19:47:22.805405+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:54.640133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:54.640133+0000","last_clean_scrub_stamp":"2024-04-17T19:46:54.640133+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:24:28.029324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3842,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T19:47:01.717017+0000","last_change":"2024-04-17T19:47:00.743810+0000","last_active":"2024-04-17T19:47:01.717017+0000","last_peered":"2024-04-17T19:47:01.717017+0000","last_clean":"2024-04-17T19:47:01.717017+0000","last_became_active":"2024-04-17T19:47:00.742290+0000","last_became_peered":"2024-04-17T19:47:00.742290+0000","last_unstale":"2024-04-17T19:47:01.717017+0000","last_undegraded":"2024-04-17T19:47:01.717017+0000","last_fullsized":"2024-04-17T19:47:01.717017+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_clean_scrub_stamp":"2024-04-17T19:46:59.695482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T04:20:00.039224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,5,0],"acting":[4,3,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T19:47:01.714061+0000","last_change":"2024-04-17T19:46:56.680527+0000","last_active":"2024-04-17T19:47:01.714061+0000","last_peered":"2024-04-17T19:47:01.714061+0000","last_clean":"2024-04-17T19:47:01.714061+0000","last_became_active":"2024-04-17T19:46:56.680171+0000","last_became_peered":"2024-04-17T19:46:56.680171+0000","last_unstale":"2024-04-17T19:47:01.714061+0000","last_undegraded":"2024-04-17T19:47:01.714061+0000","last_fullsized":"2024-04-17T19:47:01.714061+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_clean_scrub_stamp":"2024-04-17T19:46:55.648649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T07:11:10.748292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.15","version":"25'4","reported_seq":26,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T19:47:02.883994+0000","last_change":"2024-04-17T19:46:55.707717+0000","last_active":"2024-04-17T19:47:02.883994+0000","last_peered":"2024-04-17T19:47:02.883994+0000","last_clean":"2024-04-17T19:47:02.883994+0000","last_became_active":"2024-04-17T19:46:55.706967+0000","last_became_peered":"2024-04-17T19:46:55.706967+0000","last_unstale":"2024-04-17T19:47:02.883994+0000","last_undegraded":"2024-04-17T19:47:02.883994+0000","last_fullsized":"2024-04-17T19:47:02.883994+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:54.640133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:54.640133+0000","last_clean_scrub_stamp":"2024-04-17T19:46:54.640133+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T05:10:04.380307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T19:47:01.870166+0000","last_change":"2024-04-17T19:47:00.758723+0000","last_active":"2024-04-17T19:47:01.870166+0000","last_peered":"2024-04-17T19:47:01.870166+0000","last_clean":"2024-04-17T19:47:01.870166+0000","last_became_active":"2024-04-17T19:47:00.758209+0000","last_became_peered":"2024-04-17T19:47:00.758209+0000","last_unstale":"2024-04-17T19:47:01.870166+0000","last_undegraded":"2024-04-17T19:47:01.870166+0000","last_fullsized":"2024-04-17T19:47:01.870166+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_clean_scrub_stamp":"2024-04-17T19:46:59.695482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T04:48:47.816818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1,7],"acting":[2,3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T19:47:01.718073+0000","last_change":"2024-04-17T19:46:56.684067+0000","last_active":"2024-04-17T19:47:01.718073+0000","last_peered":"2024-04-17T19:47:01.718073+0000","last_clean":"2024-04-17T19:47:01.718073+0000","last_became_active":"2024-04-17T19:46:56.683685+0000","last_became_peered":"2024-04-17T19:46:56.683685+0000","last_unstale":"2024-04-17T19:47:01.718073+0000","last_undegraded":"2024-04-17T19:47:01.718073+0000","last_fullsized":"2024-04-17T19:47:01.718073+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_clean_scrub_stamp":"2024-04-17T19:46:55.648649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T02:52:38.425163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"25'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T19:47:22.807410+0000","last_change":"2024-04-17T19:46:55.687311+0000","last_active":"2024-04-17T19:47:22.807410+0000","last_peered":"2024-04-17T19:47:22.807410+0000","last_clean":"2024-04-17T19:47:22.807410+0000","last_became_active":"2024-04-17T19:46:55.687019+0000","last_became_peered":"2024-04-17T19:46:55.687019+0000","last_unstale":"2024-04-17T19:47:22.807410+0000","last_undegraded":"2024-04-17T19:47:22.807410+0000","last_fullsized":"2024-04-17T19:47:22.807410+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:54.640133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:54.640133+0000","last_clean_scrub_stamp":"2024-04-17T19:46:54.640133+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T01:53:38.377482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T19:47:02.881723+0000","last_change":"2024-04-17T19:47:00.780072+0000","last_active":"2024-04-17T19:47:02.881723+0000","last_peered":"2024-04-17T19:47:02.881723+0000","last_clean":"2024-04-17T19:47:02.881723+0000","last_became_active":"2024-04-17T19:47:00.777053+0000","last_became_peered":"2024-04-17T19:47:00.777053+0000","last_unstale":"2024-04-17T19:47:02.881723+0000","last_undegraded":"2024-04-17T19:47:02.881723+0000","last_fullsized":"2024-04-17T19:47:02.881723+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_clean_scrub_stamp":"2024-04-17T19:46:59.695482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T22:01:53.910725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,3,2],"acting":[7,1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T19:47:01.870331+0000","last_change":"2024-04-17T19:46:56.692985+0000","last_active":"2024-04-17T19:47:01.870331+0000","last_peered":"2024-04-17T19:47:01.870331+0000","last_clean":"2024-04-17T19:47:01.870331+0000","last_became_active":"2024-04-17T19:46:56.692287+0000","last_became_peered":"2024-04-17T19:46:56.692287+0000","last_unstale":"2024-04-17T19:47:01.870331+0000","last_undegraded":"2024-04-17T19:47:01.870331+0000","last_fullsized":"2024-04-17T19:47:01.870331+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_clean_scrub_stamp":"2024-04-17T19:46:55.648649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:20:50.341776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.17","version":"25'3","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T19:47:22.809845+0000","last_change":"2024-04-17T19:46:55.691681+0000","last_active":"2024-04-17T19:47:22.809845+0000","last_peered":"2024-04-17T19:47:22.809845+0000","last_clean":"2024-04-17T19:47:22.809845+0000","last_became_active":"2024-04-17T19:46:55.691354+0000","last_became_peered":"2024-04-17T19:46:55.691354+0000","last_unstale":"2024-04-17T19:47:22.809845+0000","last_undegraded":"2024-04-17T19:47:22.809845+0000","last_fullsized":"2024-04-17T19:47:22.809845+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:54.640133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:54.640133+0000","last_clean_scrub_stamp":"2024-04-17T19:46:54.640133+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T00:40:58.757373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T19:47:01.716521+0000","last_change":"2024-04-17T19:47:00.764854+0000","last_active":"2024-04-17T19:47:01.716521+0000","last_peered":"2024-04-17T19:47:01.716521+0000","last_clean":"2024-04-17T19:47:01.716521+0000","last_became_active":"2024-04-17T19:47:00.763550+0000","last_became_peered":"2024-04-17T19:47:00.763550+0000","last_unstale":"2024-04-17T19:47:01.716521+0000","last_undegraded":"2024-04-17T19:47:01.716521+0000","last_fullsized":"2024-04-17T19:47:01.716521+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_clean_scrub_stamp":"2024-04-17T19:46:59.695482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T04:26:38.527427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,3,7],"acting":[4,0,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T19:47:01.717807+0000","last_change":"2024-04-17T19:47:00.746028+0000","last_active":"2024-04-17T19:47:01.717807+0000","last_peered":"2024-04-17T19:47:01.717807+0000","last_clean":"2024-04-17T19:47:01.717807+0000","last_became_active":"2024-04-17T19:47:00.744828+0000","last_became_peered":"2024-04-17T19:47:00.744828+0000","last_unstale":"2024-04-17T19:47:01.717807+0000","last_undegraded":"2024-04-17T19:47:01.717807+0000","last_fullsized":"2024-04-17T19:47:01.717807+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_clean_scrub_stamp":"2024-04-17T19:46:59.695482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T22:37:58.836823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,5,3],"acting":[4,1,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T19:47:01.716479+0000","last_change":"2024-04-17T19:46:56.691650+0000","last_active":"2024-04-17T19:47:01.716479+0000","last_peered":"2024-04-17T19:47:01.716479+0000","last_clean":"2024-04-17T19:47:01.716479+0000","last_became_active":"2024-04-17T19:46:56.690810+0000","last_became_peered":"2024-04-17T19:46:56.690810+0000","last_unstale":"2024-04-17T19:47:01.716479+0000","last_undegraded":"2024-04-17T19:47:01.716479+0000","last_fullsized":"2024-04-17T19:47:01.716479+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_clean_scrub_stamp":"2024-04-17T19:46:55.648649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T04:25:07.123916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.18","version":"25'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T19:47:01.714071+0000","last_change":"2024-04-17T19:46:55.691871+0000","last_active":"2024-04-17T19:47:01.714071+0000","last_peered":"2024-04-17T19:47:01.714071+0000","last_clean":"2024-04-17T19:47:01.714071+0000","last_became_active":"2024-04-17T19:46:55.690539+0000","last_became_peered":"2024-04-17T19:46:55.690539+0000","last_unstale":"2024-04-17T19:47:01.714071+0000","last_undegraded":"2024-04-17T19:47:01.714071+0000","last_fullsized":"2024-04-17T19:47:01.714071+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:54.640133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:54.640133+0000","last_clean_scrub_stamp":"2024-04-17T19:46:54.640133+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T04:52:16.008572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T19:47:01.715456+0000","last_change":"2024-04-17T19:47:00.749616+0000","last_active":"2024-04-17T19:47:01.715456+0000","last_peered":"2024-04-17T19:47:01.715456+0000","last_clean":"2024-04-17T19:47:01.715456+0000","last_became_active":"2024-04-17T19:47:00.749061+0000","last_became_peered":"2024-04-17T19:47:00.749061+0000","last_unstale":"2024-04-17T19:47:01.715456+0000","last_undegraded":"2024-04-17T19:47:01.715456+0000","last_fullsized":"2024-04-17T19:47:01.715456+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_clean_scrub_stamp":"2024-04-17T19:46:59.695482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:33:36.676817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5,1],"acting":[3,2,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T19:47:01.715322+0000","last_change":"2024-04-17T19:46:56.692190+0000","last_active":"2024-04-17T19:47:01.715322+0000","last_peered":"2024-04-17T19:47:01.715322+0000","last_clean":"2024-04-17T19:47:01.715322+0000","last_became_active":"2024-04-17T19:46:56.691524+0000","last_became_peered":"2024-04-17T19:46:56.691524+0000","last_unstale":"2024-04-17T19:47:01.715322+0000","last_undegraded":"2024-04-17T19:47:01.715322+0000","last_fullsized":"2024-04-17T19:47:01.715322+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_clean_scrub_stamp":"2024-04-17T19:46:55.648649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:44:38.787541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T19:47:02.880985+0000","last_change":"2024-04-17T19:46:55.700265+0000","last_active":"2024-04-17T19:47:02.880985+0000","last_peered":"2024-04-17T19:47:02.880985+0000","last_clean":"2024-04-17T19:47:02.880985+0000","last_became_active":"2024-04-17T19:46:55.699166+0000","last_became_peered":"2024-04-17T19:46:55.699166+0000","last_unstale":"2024-04-17T19:47:02.880985+0000","last_undegraded":"2024-04-17T19:47:02.880985+0000","last_fullsized":"2024-04-17T19:47:02.880985+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:54.640133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:54.640133+0000","last_clean_scrub_stamp":"2024-04-17T19:46:54.640133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T02:39:08.241534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"24'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T19:47:01.714291+0000","last_change":"2024-04-17T19:46:55.687779+0000","last_active":"2024-04-17T19:47:01.714291+0000","last_peered":"2024-04-17T19:47:01.714291+0000","last_clean":"2024-04-17T19:47:01.714291+0000","last_became_active":"2024-04-17T19:46:55.687401+0000","last_became_peered":"2024-04-17T19:46:55.687401+0000","last_unstale":"2024-04-17T19:47:01.714291+0000","last_undegraded":"2024-04-17T19:47:01.714291+0000","last_fullsized":"2024-04-17T19:47:01.714291+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:54.640133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:54.640133+0000","last_clean_scrub_stamp":"2024-04-17T19:46:54.640133+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:20:49.333260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T19:47:01.716820+0000","last_change":"2024-04-17T19:46:56.691635+0000","last_active":"2024-04-17T19:47:01.716820+0000","last_peered":"2024-04-17T19:47:01.716820+0000","last_clean":"2024-04-17T19:47:01.716820+0000","last_became_active":"2024-04-17T19:46:56.691199+0000","last_became_peered":"2024-04-17T19:46:56.691199+0000","last_unstale":"2024-04-17T19:47:01.716820+0000","last_undegraded":"2024-04-17T19:47:01.716820+0000","last_fullsized":"2024-04-17T19:47:01.716820+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_clean_scrub_stamp":"2024-04-17T19:46:55.648649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:00:10.859769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T19:47:01.717329+0000","last_change":"2024-04-17T19:47:00.776142+0000","last_active":"2024-04-17T19:47:01.717329+0000","last_peered":"2024-04-17T19:47:01.717329+0000","last_clean":"2024-04-17T19:47:01.717329+0000","last_became_active":"2024-04-17T19:47:00.774592+0000","last_became_peered":"2024-04-17T19:47:00.774592+0000","last_unstale":"2024-04-17T19:47:01.717329+0000","last_undegraded":"2024-04-17T19:47:01.717329+0000","last_fullsized":"2024-04-17T19:47:01.717329+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_clean_scrub_stamp":"2024-04-17T19:46:59.695482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:04:03.656402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,7],"acting":[4,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"25'5","reported_seq":27,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T19:47:22.803028+0000","last_change":"2024-04-17T19:46:55.713656+0000","last_active":"2024-04-17T19:47:22.803028+0000","last_peered":"2024-04-17T19:47:22.803028+0000","last_clean":"2024-04-17T19:47:22.803028+0000","last_became_active":"2024-04-17T19:46:55.712982+0000","last_became_peered":"2024-04-17T19:46:55.712982+0000","last_unstale":"2024-04-17T19:47:22.803028+0000","last_undegraded":"2024-04-17T19:47:22.803028+0000","last_fullsized":"2024-04-17T19:47:22.803028+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:54.640133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:54.640133+0000","last_clean_scrub_stamp":"2024-04-17T19:46:54.640133+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:02:52.057635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T19:47:02.879756+0000","last_change":"2024-04-17T19:46:56.681984+0000","last_active":"2024-04-17T19:47:02.879756+0000","last_peered":"2024-04-17T19:47:02.879756+0000","last_clean":"2024-04-17T19:47:02.879756+0000","last_became_active":"2024-04-17T19:46:56.679830+0000","last_became_peered":"2024-04-17T19:46:56.679830+0000","last_unstale":"2024-04-17T19:47:02.879756+0000","last_undegraded":"2024-04-17T19:47:02.879756+0000","last_fullsized":"2024-04-17T19:47:02.879756+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_clean_scrub_stamp":"2024-04-17T19:46:55.648649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:11:01.745657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T19:47:02.883151+0000","last_change":"2024-04-17T19:47:00.777411+0000","last_active":"2024-04-17T19:47:02.883151+0000","last_peered":"2024-04-17T19:47:02.883151+0000","last_clean":"2024-04-17T19:47:02.883151+0000","last_became_active":"2024-04-17T19:47:00.776357+0000","last_became_peered":"2024-04-17T19:47:00.776357+0000","last_unstale":"2024-04-17T19:47:02.883151+0000","last_undegraded":"2024-04-17T19:47:02.883151+0000","last_fullsized":"2024-04-17T19:47:02.883151+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_clean_scrub_stamp":"2024-04-17T19:46:59.695482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:41:22.030097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,1,0],"acting":[7,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T19:47:01.869642+0000","last_change":"2024-04-17T19:46:56.706021+0000","last_active":"2024-04-17T19:47:01.869642+0000","last_peered":"2024-04-17T19:47:01.869642+0000","last_clean":"2024-04-17T19:47:01.869642+0000","last_became_active":"2024-04-17T19:46:56.702724+0000","last_became_peered":"2024-04-17T19:46:56.702724+0000","last_unstale":"2024-04-17T19:47:01.869642+0000","last_undegraded":"2024-04-17T19:47:01.869642+0000","last_fullsized":"2024-04-17T19:47:01.869642+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_clean_scrub_stamp":"2024-04-17T19:46:55.648649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:11:01.745657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T19:47:02.881763+0000","last_change":"2024-04-17T19:46:56.685239+0000","last_active":"2024-04-17T19:47:02.881763+0000","last_peered":"2024-04-17T19:47:02.881763+0000","last_clean":"2024-04-17T19:47:02.881763+0000","last_became_active":"2024-04-17T19:46:56.684771+0000","last_became_peered":"2024-04-17T19:46:56.684771+0000","last_unstale":"2024-04-17T19:47:02.881763+0000","last_undegraded":"2024-04-17T19:47:02.881763+0000","last_fullsized":"2024-04-17T19:47:02.881763+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_clean_scrub_stamp":"2024-04-17T19:46:55.648649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T04:52:17.017088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T19:47:01.713945+0000","last_change":"2024-04-17T19:46:56.686238+0000","last_active":"2024-04-17T19:47:01.713945+0000","last_peered":"2024-04-17T19:47:01.713945+0000","last_clean":"2024-04-17T19:47:01.713945+0000","last_became_active":"2024-04-17T19:46:56.685745+0000","last_became_peered":"2024-04-17T19:46:56.685745+0000","last_unstale":"2024-04-17T19:47:01.713945+0000","last_undegraded":"2024-04-17T19:47:01.713945+0000","last_fullsized":"2024-04-17T19:47:01.713945+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_clean_scrub_stamp":"2024-04-17T19:46:55.648649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:01:01.006486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T19:47:01.716621+0000","last_change":"2024-04-17T19:46:56.675844+0000","last_active":"2024-04-17T19:47:01.716621+0000","last_peered":"2024-04-17T19:47:01.716621+0000","last_clean":"2024-04-17T19:47:01.716621+0000","last_became_active":"2024-04-17T19:46:56.675519+0000","last_became_peered":"2024-04-17T19:46:56.675519+0000","last_unstale":"2024-04-17T19:47:01.716621+0000","last_undegraded":"2024-04-17T19:47:01.716621+0000","last_fullsized":"2024-04-17T19:47:01.716621+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_clean_scrub_stamp":"2024-04-17T19:46:55.648649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T00:46:07.348168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T19:47:02.884195+0000","last_change":"2024-04-17T19:46:56.699663+0000","last_active":"2024-04-17T19:47:02.884195+0000","last_peered":"2024-04-17T19:47:02.884195+0000","last_clean":"2024-04-17T19:47:02.884195+0000","last_became_active":"2024-04-17T19:46:56.699293+0000","last_became_peered":"2024-04-17T19:46:56.699293+0000","last_unstale":"2024-04-17T19:47:02.884195+0000","last_undegraded":"2024-04-17T19:47:02.884195+0000","last_fullsized":"2024-04-17T19:47:02.884195+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_clean_scrub_stamp":"2024-04-17T19:46:55.648649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T22:25:05.172498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T19:47:02.883978+0000","last_change":"2024-04-17T19:46:56.684368+0000","last_active":"2024-04-17T19:47:02.883978+0000","last_peered":"2024-04-17T19:47:02.883978+0000","last_clean":"2024-04-17T19:47:02.883978+0000","last_became_active":"2024-04-17T19:46:56.683963+0000","last_became_peered":"2024-04-17T19:46:56.683963+0000","last_unstale":"2024-04-17T19:47:02.883978+0000","last_undegraded":"2024-04-17T19:47:02.883978+0000","last_fullsized":"2024-04-17T19:47:02.883978+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_clean_scrub_stamp":"2024-04-17T19:46:55.648649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:41:17.983264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T19:47:01.870215+0000","last_change":"2024-04-17T19:46:56.704924+0000","last_active":"2024-04-17T19:47:01.870215+0000","last_peered":"2024-04-17T19:47:01.870215+0000","last_clean":"2024-04-17T19:47:01.870215+0000","last_became_active":"2024-04-17T19:46:56.692688+0000","last_became_peered":"2024-04-17T19:46:56.692688+0000","last_unstale":"2024-04-17T19:47:01.870215+0000","last_undegraded":"2024-04-17T19:47:01.870215+0000","last_fullsized":"2024-04-17T19:47:01.870215+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_clean_scrub_stamp":"2024-04-17T19:46:55.648649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T01:39:33.595213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T19:47:01.717583+0000","last_change":"2024-04-17T19:46:56.685081+0000","last_active":"2024-04-17T19:47:01.717583+0000","last_peered":"2024-04-17T19:47:01.717583+0000","last_clean":"2024-04-17T19:47:01.717583+0000","last_became_active":"2024-04-17T19:46:56.684714+0000","last_became_peered":"2024-04-17T19:46:56.684714+0000","last_unstale":"2024-04-17T19:47:01.717583+0000","last_undegraded":"2024-04-17T19:47:01.717583+0000","last_fullsized":"2024-04-17T19:47:01.717583+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_clean_scrub_stamp":"2024-04-17T19:46:55.648649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T04:26:34.480594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T19:47:01.713823+0000","last_change":"2024-04-17T19:46:56.681089+0000","last_active":"2024-04-17T19:47:01.713823+0000","last_peered":"2024-04-17T19:47:01.713823+0000","last_clean":"2024-04-17T19:47:01.713823+0000","last_became_active":"2024-04-17T19:46:56.679818+0000","last_became_peered":"2024-04-17T19:46:56.679818+0000","last_unstale":"2024-04-17T19:47:01.713823+0000","last_undegraded":"2024-04-17T19:47:01.713823+0000","last_fullsized":"2024-04-17T19:47:01.713823+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_clean_scrub_stamp":"2024-04-17T19:46:55.648649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T01:32:52.608291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T19:47:01.716037+0000","last_change":"2024-04-17T19:46:56.674556+0000","last_active":"2024-04-17T19:47:01.716037+0000","last_peered":"2024-04-17T19:47:01.716037+0000","last_clean":"2024-04-17T19:47:01.716037+0000","last_became_active":"2024-04-17T19:46:56.674164+0000","last_became_peered":"2024-04-17T19:46:56.674164+0000","last_unstale":"2024-04-17T19:47:01.716037+0000","last_undegraded":"2024-04-17T19:47:01.716037+0000","last_fullsized":"2024-04-17T19:47:01.716037+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_clean_scrub_stamp":"2024-04-17T19:46:55.648649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T22:53:45.664676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T19:47:02.879682+0000","last_change":"2024-04-17T19:46:56.697359+0000","last_active":"2024-04-17T19:47:02.879682+0000","last_peered":"2024-04-17T19:47:02.879682+0000","last_clean":"2024-04-17T19:47:02.879682+0000","last_became_active":"2024-04-17T19:46:56.695255+0000","last_became_peered":"2024-04-17T19:46:56.695255+0000","last_unstale":"2024-04-17T19:47:02.879682+0000","last_undegraded":"2024-04-17T19:47:02.879682+0000","last_fullsized":"2024-04-17T19:47:02.879682+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_clean_scrub_stamp":"2024-04-17T19:46:55.648649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T01:53:39.385998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T19:47:01.716676+0000","last_change":"2024-04-17T19:46:56.692366+0000","last_active":"2024-04-17T19:47:01.716676+0000","last_peered":"2024-04-17T19:47:01.716676+0000","last_clean":"2024-04-17T19:47:01.716676+0000","last_became_active":"2024-04-17T19:46:56.691942+0000","last_became_peered":"2024-04-17T19:46:56.691942+0000","last_unstale":"2024-04-17T19:47:01.716676+0000","last_undegraded":"2024-04-17T19:47:01.716676+0000","last_fullsized":"2024-04-17T19:47:01.716676+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_clean_scrub_stamp":"2024-04-17T19:46:55.648649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T02:34:05.358659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T19:47:02.723676+0000","last_change":"2024-04-17T19:46:56.693507+0000","last_active":"2024-04-17T19:47:02.723676+0000","last_peered":"2024-04-17T19:47:02.723676+0000","last_clean":"2024-04-17T19:47:02.723676+0000","last_became_active":"2024-04-17T19:46:56.691938+0000","last_became_peered":"2024-04-17T19:46:56.691938+0000","last_unstale":"2024-04-17T19:47:02.723676+0000","last_undegraded":"2024-04-17T19:47:02.723676+0000","last_fullsized":"2024-04-17T19:47:02.723676+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_clean_scrub_stamp":"2024-04-17T19:46:55.648649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T04:48:43.769985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T19:47:01.715076+0000","last_change":"2024-04-17T19:46:56.700707+0000","last_active":"2024-04-17T19:47:01.715076+0000","last_peered":"2024-04-17T19:47:01.715076+0000","last_clean":"2024-04-17T19:47:01.715076+0000","last_became_active":"2024-04-17T19:46:56.700346+0000","last_became_peered":"2024-04-17T19:46:56.700346+0000","last_unstale":"2024-04-17T19:47:01.715076+0000","last_undegraded":"2024-04-17T19:47:01.715076+0000","last_fullsized":"2024-04-17T19:47:01.715076+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_clean_scrub_stamp":"2024-04-17T19:46:55.648649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:58:35.976326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T19:47:02.883782+0000","last_change":"2024-04-17T19:46:56.705410+0000","last_active":"2024-04-17T19:47:02.883782+0000","last_peered":"2024-04-17T19:47:02.883782+0000","last_clean":"2024-04-17T19:47:02.883782+0000","last_became_active":"2024-04-17T19:46:56.705076+0000","last_became_peered":"2024-04-17T19:46:56.705076+0000","last_unstale":"2024-04-17T19:47:02.883782+0000","last_undegraded":"2024-04-17T19:47:02.883782+0000","last_fullsized":"2024-04-17T19:47:02.883782+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_clean_scrub_stamp":"2024-04-17T19:46:55.648649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T01:53:39.385998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T19:47:01.715553+0000","last_change":"2024-04-17T19:46:56.697436+0000","last_active":"2024-04-17T19:47:01.715553+0000","last_peered":"2024-04-17T19:47:01.715553+0000","last_clean":"2024-04-17T19:47:01.715553+0000","last_became_active":"2024-04-17T19:46:56.696667+0000","last_became_peered":"2024-04-17T19:46:56.696667+0000","last_unstale":"2024-04-17T19:47:01.715553+0000","last_undegraded":"2024-04-17T19:47:01.715553+0000","last_fullsized":"2024-04-17T19:47:01.715553+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_clean_scrub_stamp":"2024-04-17T19:46:55.648649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:54:05.520742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T19:47:01.713821+0000","last_change":"2024-04-17T19:46:56.680847+0000","last_active":"2024-04-17T19:47:01.713821+0000","last_peered":"2024-04-17T19:47:01.713821+0000","last_clean":"2024-04-17T19:47:01.713821+0000","last_became_active":"2024-04-17T19:46:56.680224+0000","last_became_peered":"2024-04-17T19:46:56.680224+0000","last_unstale":"2024-04-17T19:47:01.713821+0000","last_undegraded":"2024-04-17T19:47:01.713821+0000","last_fullsized":"2024-04-17T19:47:01.713821+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_clean_scrub_stamp":"2024-04-17T19:46:55.648649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T04:48:43.769985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T19:47:01.715770+0000","last_change":"2024-04-17T19:46:56.688647+0000","last_active":"2024-04-17T19:47:01.715770+0000","last_peered":"2024-04-17T19:47:01.715770+0000","last_clean":"2024-04-17T19:47:01.715770+0000","last_became_active":"2024-04-17T19:46:56.688294+0000","last_became_peered":"2024-04-17T19:46:56.688294+0000","last_unstale":"2024-04-17T19:47:01.715770+0000","last_undegraded":"2024-04-17T19:47:01.715770+0000","last_fullsized":"2024-04-17T19:47:01.715770+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_clean_scrub_stamp":"2024-04-17T19:46:55.648649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T02:34:05.358659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T19:47:02.881299+0000","last_change":"2024-04-17T19:46:56.686415+0000","last_active":"2024-04-17T19:47:02.881299+0000","last_peered":"2024-04-17T19:47:02.881299+0000","last_clean":"2024-04-17T19:47:02.881299+0000","last_became_active":"2024-04-17T19:46:56.684639+0000","last_became_peered":"2024-04-17T19:46:56.684639+0000","last_unstale":"2024-04-17T19:47:02.881299+0000","last_undegraded":"2024-04-17T19:47:02.881299+0000","last_fullsized":"2024-04-17T19:47:02.881299+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_clean_scrub_stamp":"2024-04-17T19:46:55.648649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:20:50.341776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T19:47:02.882440+0000","last_change":"2024-04-17T19:46:56.694678+0000","last_active":"2024-04-17T19:47:02.882440+0000","last_peered":"2024-04-17T19:47:02.882440+0000","last_clean":"2024-04-17T19:47:02.882440+0000","last_became_active":"2024-04-17T19:46:56.694213+0000","last_became_peered":"2024-04-17T19:46:56.694213+0000","last_unstale":"2024-04-17T19:47:02.882440+0000","last_undegraded":"2024-04-17T19:47:02.882440+0000","last_fullsized":"2024-04-17T19:47:02.882440+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_clean_scrub_stamp":"2024-04-17T19:46:55.648649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:59:17.441539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T19:47:02.723614+0000","last_change":"2024-04-17T19:46:56.693810+0000","last_active":"2024-04-17T19:47:02.723614+0000","last_peered":"2024-04-17T19:47:02.723614+0000","last_clean":"2024-04-17T19:47:02.723614+0000","last_became_active":"2024-04-17T19:46:56.692874+0000","last_became_peered":"2024-04-17T19:46:56.692874+0000","last_unstale":"2024-04-17T19:47:02.723614+0000","last_undegraded":"2024-04-17T19:47:02.723614+0000","last_fullsized":"2024-04-17T19:47:02.723614+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_clean_scrub_stamp":"2024-04-17T19:46:55.648649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:30:27.241267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T19:47:02.723470+0000","last_change":"2024-04-17T19:46:56.700330+0000","last_active":"2024-04-17T19:47:02.723470+0000","last_peered":"2024-04-17T19:47:02.723470+0000","last_clean":"2024-04-17T19:47:02.723470+0000","last_became_active":"2024-04-17T19:46:56.700013+0000","last_became_peered":"2024-04-17T19:46:56.700013+0000","last_unstale":"2024-04-17T19:47:02.723470+0000","last_undegraded":"2024-04-17T19:47:02.723470+0000","last_fullsized":"2024-04-17T19:47:02.723470+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_clean_scrub_stamp":"2024-04-17T19:46:55.648649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:23:16.383918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T19:47:02.723614+0000","last_change":"2024-04-17T19:46:56.709400+0000","last_active":"2024-04-17T19:47:02.723614+0000","last_peered":"2024-04-17T19:47:02.723614+0000","last_clean":"2024-04-17T19:47:02.723614+0000","last_became_active":"2024-04-17T19:46:56.708606+0000","last_became_peered":"2024-04-17T19:46:56.708606+0000","last_unstale":"2024-04-17T19:47:02.723614+0000","last_undegraded":"2024-04-17T19:47:02.723614+0000","last_fullsized":"2024-04-17T19:47:02.723614+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_clean_scrub_stamp":"2024-04-17T19:46:55.648649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T01:46:36.503198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T19:47:02.880442+0000","last_change":"2024-04-17T19:46:56.681267+0000","last_active":"2024-04-17T19:47:02.880442+0000","last_peered":"2024-04-17T19:47:02.880442+0000","last_clean":"2024-04-17T19:47:02.880442+0000","last_became_active":"2024-04-17T19:46:56.680919+0000","last_became_peered":"2024-04-17T19:46:56.680919+0000","last_unstale":"2024-04-17T19:47:02.880442+0000","last_undegraded":"2024-04-17T19:47:02.880442+0000","last_fullsized":"2024-04-17T19:47:02.880442+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_clean_scrub_stamp":"2024-04-17T19:46:55.648649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T01:39:33.595213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T19:47:01.714992+0000","last_change":"2024-04-17T19:46:56.688682+0000","last_active":"2024-04-17T19:47:01.714992+0000","last_peered":"2024-04-17T19:47:01.714992+0000","last_clean":"2024-04-17T19:47:01.714992+0000","last_became_active":"2024-04-17T19:46:56.688320+0000","last_became_peered":"2024-04-17T19:46:56.688320+0000","last_unstale":"2024-04-17T19:47:01.714992+0000","last_undegraded":"2024-04-17T19:47:01.714992+0000","last_fullsized":"2024-04-17T19:47:01.714992+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_clean_scrub_stamp":"2024-04-17T19:46:55.648649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:00:10.859769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T19:47:02.723099+0000","last_change":"2024-04-17T19:46:56.699129+0000","last_active":"2024-04-17T19:47:02.723099+0000","last_peered":"2024-04-17T19:47:02.723099+0000","last_clean":"2024-04-17T19:47:02.723099+0000","last_became_active":"2024-04-17T19:46:56.698840+0000","last_became_peered":"2024-04-17T19:46:56.698840+0000","last_unstale":"2024-04-17T19:47:02.723099+0000","last_undegraded":"2024-04-17T19:47:02.723099+0000","last_fullsized":"2024-04-17T19:47:02.723099+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_clean_scrub_stamp":"2024-04-17T19:46:55.648649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T05:35:47.746622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T19:47:01.870059+0000","last_change":"2024-04-17T19:46:56.705903+0000","last_active":"2024-04-17T19:47:01.870059+0000","last_peered":"2024-04-17T19:47:01.870059+0000","last_clean":"2024-04-17T19:47:01.870059+0000","last_became_active":"2024-04-17T19:46:56.705539+0000","last_became_peered":"2024-04-17T19:46:56.705539+0000","last_unstale":"2024-04-17T19:47:01.870059+0000","last_undegraded":"2024-04-17T19:47:01.870059+0000","last_fullsized":"2024-04-17T19:47:01.870059+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_clean_scrub_stamp":"2024-04-17T19:46:55.648649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:57:40.700986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T19:47:02.723301+0000","last_change":"2024-04-17T19:46:56.694456+0000","last_active":"2024-04-17T19:47:02.723301+0000","last_peered":"2024-04-17T19:47:02.723301+0000","last_clean":"2024-04-17T19:47:02.723301+0000","last_became_active":"2024-04-17T19:46:56.693954+0000","last_became_peered":"2024-04-17T19:46:56.693954+0000","last_unstale":"2024-04-17T19:47:02.723301+0000","last_undegraded":"2024-04-17T19:47:02.723301+0000","last_fullsized":"2024-04-17T19:47:02.723301+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_clean_scrub_stamp":"2024-04-17T19:46:55.648649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:22:33.413402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T19:47:01.869795+0000","last_change":"2024-04-17T19:46:56.706411+0000","last_active":"2024-04-17T19:47:01.869795+0000","last_peered":"2024-04-17T19:47:01.869795+0000","last_clean":"2024-04-17T19:47:01.869795+0000","last_became_active":"2024-04-17T19:46:56.706021+0000","last_became_peered":"2024-04-17T19:46:56.706021+0000","last_unstale":"2024-04-17T19:47:01.869795+0000","last_undegraded":"2024-04-17T19:47:01.869795+0000","last_fullsized":"2024-04-17T19:47:01.869795+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_clean_scrub_stamp":"2024-04-17T19:46:55.648649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T05:52:33.559392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T19:47:01.717212+0000","last_change":"2024-04-17T19:46:56.696930+0000","last_active":"2024-04-17T19:47:01.717212+0000","last_peered":"2024-04-17T19:47:01.717212+0000","last_clean":"2024-04-17T19:47:01.717212+0000","last_became_active":"2024-04-17T19:46:56.696492+0000","last_became_peered":"2024-04-17T19:46:56.696492+0000","last_unstale":"2024-04-17T19:47:01.717212+0000","last_undegraded":"2024-04-17T19:47:01.717212+0000","last_fullsized":"2024-04-17T19:47:01.717212+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_clean_scrub_stamp":"2024-04-17T19:46:55.648649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:43:54.268148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T19:47:01.718855+0000","last_change":"2024-04-17T19:46:56.683448+0000","last_active":"2024-04-17T19:47:01.718855+0000","last_peered":"2024-04-17T19:47:01.718855+0000","last_clean":"2024-04-17T19:47:01.718855+0000","last_became_active":"2024-04-17T19:46:56.682772+0000","last_became_peered":"2024-04-17T19:46:56.682772+0000","last_unstale":"2024-04-17T19:47:01.718855+0000","last_undegraded":"2024-04-17T19:47:01.718855+0000","last_fullsized":"2024-04-17T19:47:01.718855+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_clean_scrub_stamp":"2024-04-17T19:46:55.648649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T22:39:31.496708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T19:47:02.723937+0000","last_change":"2024-04-17T19:46:56.695275+0000","last_active":"2024-04-17T19:47:02.723937+0000","last_peered":"2024-04-17T19:47:02.723937+0000","last_clean":"2024-04-17T19:47:02.723937+0000","last_became_active":"2024-04-17T19:46:56.694743+0000","last_became_peered":"2024-04-17T19:46:56.694743+0000","last_unstale":"2024-04-17T19:47:02.723937+0000","last_undegraded":"2024-04-17T19:47:02.723937+0000","last_fullsized":"2024-04-17T19:47:02.723937+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_clean_scrub_stamp":"2024-04-17T19:46:55.648649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:01:01.006486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":6046,"num_objects":40,"num_object_clones":0,"num_object_copies":80,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":40,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":87,"num_write_kb":30,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":26,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":12092,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":76,"ondisk_log_size":76,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":66496,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509451,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27280,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344560,"statfs":{"total":96636764160,"available":96608829440,"internally_reserved":0,"allocated":266240,"data_stored":101981,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509452,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":266240,"data_stored":102479,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509452,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":256,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":262144,"data_stored":102439,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509452,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27280,"kb_used_data":264,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344560,"statfs":{"total":96636764160,"available":96608829440,"internally_reserved":0,"allocated":270336,"data_stored":105699,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509451,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27340,"kb_used_data":320,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344500,"statfs":{"total":96636764160,"available":96608768000,"internally_reserved":0,"allocated":327680,"data_stored":692295,"data_compressed":33248,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509451,"num_pgs":45,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27280,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344560,"statfs":{"total":96636764160,"available":96608829440,"internally_reserved":0,"allocated":266240,"data_stored":101913,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574860,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27348,"kb_used_data":332,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344492,"statfs":{"total":96636764160,"available":96608759808,"internally_reserved":0,"allocated":339968,"data_stored":692939,"data_compressed":33248,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574860,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27304,"kb_used_data":288,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344536,"statfs":{"total":96636764160,"available":96608804864,"internally_reserved":0,"allocated":294912,"data_stored":107155,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33248,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33248,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":146,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":5298,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":714,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":622,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":706,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-17T19:47:25.947 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-17T19:47:26.141 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:26.149+0000 7fb2e3000640 1 Processor -- start 2024-04-17T19:47:26.141 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:26.149+0000 7fb2e3000640 1 -- start start 2024-04-17T19:47:26.143 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:26.153+0000 7fb2e3000640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fb2dc152a60 0x7fb2dc0c6920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:26.143 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:26.153+0000 7fb2e3000640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fb2dc1592c0 0x7fb2dc163100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:26.144 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:26.153+0000 7fb2e3000640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb2dc152e70 con 0x7fb2dc158eb0 2024-04-17T19:47:26.144 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:26.153+0000 7fb2e3000640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 -- 0x7fb2dc0c52c0 con 0x7fb2dc152a60 2024-04-17T19:47:26.144 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:26.153+0000 7fb2e3000640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 -- 0x7fb2dc0c8840 con 0x7fb2dc1592c0 2024-04-17T19:47:26.144 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:26.153+0000 7fb2dbe00640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fb2dc152a60 0x7fb2dc0c6920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:26.144 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:26.153+0000 7fb2d3e00640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7fb2dc158eb0 0x7fb2dc0c47c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:44712/0 (socket says 172.21.15.44:44712) 2024-04-17T19:47:26.144 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:26.153+0000 7fb2d3e00640 1 -- 172.21.15.44:0/2020910287 learned_addr learned my addr 172.21.15.44:0/2020910287 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-04-17T19:47:26.144 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:26.153+0000 7fb2e1000640 1 --2- 172.21.15.44:0/2020910287 >> v2:172.21.15.62:3300/0 conn(0x7fb2dc1592c0 0x7fb2dc163100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:26.144 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:26.153+0000 7fb2dbe00640 1 -- 172.21.15.44:0/2020910287 >> v2:172.21.15.62:3300/0 conn(0x7fb2dc1592c0 msgr2=0x7fb2dc163100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T19:47:26.144 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:26.153+0000 7fb2dbe00640 1 --2- 172.21.15.44:0/2020910287 >> v2:172.21.15.62:3300/0 conn(0x7fb2dc1592c0 0x7fb2dc163100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:26.144 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:26.153+0000 7fb2dbe00640 1 -- 172.21.15.44:0/2020910287 >> v1:172.21.15.44:6789/0 conn(0x7fb2dc158eb0 legacy=0x7fb2dc0c47c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:26.144 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:26.153+0000 7fb2dbe00640 1 -- 172.21.15.44:0/2020910287 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb2dc0c8b20 con 0x7fb2dc152a60 2024-04-17T19:47:26.144 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:26.153+0000 7fb2db400640 1 -- 172.21.15.44:0/2020910287 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3951115390 0 0) 0x7fb2dc152e70 con 0x7fb2dc158eb0 2024-04-17T19:47:26.144 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:26.153+0000 7fb2e1000640 1 --2- 172.21.15.44:0/2020910287 >> v2:172.21.15.62:3300/0 conn(0x7fb2dc1592c0 0x7fb2dc163100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-17T19:47:26.146 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:26.157+0000 7fb2dbe00640 1 --2- 172.21.15.44:0/2020910287 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb2dc152a60 0x7fb2dc0c6920 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fb2dc06ccd0 tx=0x7fb2cc01ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=42b494e6b0664926 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:47:26.147 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:26.157+0000 7fb2db400640 1 -- 172.21.15.44:0/2020910287 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2cc0b5070 con 0x7fb2dc152a60 2024-04-17T19:47:26.147 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:26.157+0000 7fb2db400640 1 -- 172.21.15.44:0/2020910287 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb2cc0a8970 con 0x7fb2dc152a60 2024-04-17T19:47:26.147 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:26.157+0000 7fb2db400640 1 -- 172.21.15.44:0/2020910287 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2cc0a8d40 con 0x7fb2dc152a60 2024-04-17T19:47:26.147 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:26.157+0000 7fb2e3000640 1 -- 172.21.15.44:0/2020910287 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb2dc152a60 msgr2=0x7fb2dc0c6920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:26.148 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:26.157+0000 7fb2e3000640 1 --2- 172.21.15.44:0/2020910287 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb2dc152a60 0x7fb2dc0c6920 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fb2dc06ccd0 tx=0x7fb2cc01ec70 comp rx=0 tx=0).stop 2024-04-17T19:47:26.148 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:26.157+0000 7fb2e3000640 1 -- 172.21.15.44:0/2020910287 shutdown_connections 2024-04-17T19:47:26.148 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:26.157+0000 7fb2e3000640 1 --2- 172.21.15.44:0/2020910287 >> v2:172.21.15.62:3300/0 conn(0x7fb2dc1592c0 0x7fb2dc163100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:26.148 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:26.157+0000 7fb2e3000640 1 --2- 172.21.15.44:0/2020910287 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb2dc152a60 0x7fb2dc0c6920 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:26.148 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:26.157+0000 7fb2e3000640 1 -- 172.21.15.44:0/2020910287 >> 172.21.15.44:0/2020910287 conn(0x7fb2dc06c380 msgr2=0x7fb2dc070080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:47:26.148 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:26.157+0000 7fb2e3000640 1 -- 172.21.15.44:0/2020910287 shutdown_connections 2024-04-17T19:47:26.148 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:26.157+0000 7fb2e3000640 1 -- 172.21.15.44:0/2020910287 wait complete. 2024-04-17T19:47:26.149 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:26.157+0000 7fb2e3000640 1 Processor -- start 2024-04-17T19:47:26.150 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:26.157+0000 7fb2e3000640 1 -- start start 2024-04-17T19:47:26.152 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:26.161+0000 7fb2e3000640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb2dc152a60 0x7fb2dc15c830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:26.153 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:26.161+0000 7fb2e3000640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fb2dc158eb0 0x7fb2dc15bcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:26.153 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:26.161+0000 7fb2e3000640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb2dc1592c0 0x7fb2dc1575c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:26.153 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:26.161+0000 7fb2e3000640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fb2dc158990 con 0x7fb2dc1592c0 2024-04-17T19:47:26.153 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:26.161+0000 7fb2e3000640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7fb2dc0c90e0 con 0x7fb2dc152a60 2024-04-17T19:47:26.153 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:26.161+0000 7fb2e3000640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7fb2dc0c6e60 con 0x7fb2dc158eb0 2024-04-17T19:47:26.153 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:26.161+0000 7fb2e1000640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb2dc1592c0 0x7fb2dc1575c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:26.153 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:26.161+0000 7fb2e1000640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb2dc1592c0 0x7fb2dc1575c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:53068/0 (socket says 172.21.15.44:53068) 2024-04-17T19:47:26.153 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:26.161+0000 7fb2e1000640 1 -- 172.21.15.44:0/3870591086 learned_addr learned my addr 172.21.15.44:0/3870591086 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-04-17T19:47:26.153 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:26.161+0000 7fb2dbe00640 1 --2- 172.21.15.44:0/3870591086 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb2dc152a60 0x7fb2dc15c830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:26.153 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:26.161+0000 7fb2d3e00640 1 --2- 172.21.15.44:0/3870591086 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fb2dc158eb0 0x7fb2dc15bcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:26.153 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:26.161+0000 7fb2e1000640 1 -- 172.21.15.44:0/3870591086 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fb2dc158eb0 msgr2=0x7fb2dc15bcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:26.153 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:26.161+0000 7fb2e1000640 1 --2- 172.21.15.44:0/3870591086 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fb2dc158eb0 0x7fb2dc15bcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:26.153 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:26.161+0000 7fb2e1000640 1 -- 172.21.15.44:0/3870591086 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb2dc152a60 msgr2=0x7fb2dc15c830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:26.154 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:26.161+0000 7fb2e1000640 1 --2- 172.21.15.44:0/3870591086 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb2dc152a60 0x7fb2dc15c830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:26.154 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:26.161+0000 7fb2e1000640 1 -- 172.21.15.44:0/3870591086 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb2dc15ad70 con 0x7fb2dc1592c0 2024-04-17T19:47:26.154 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:26.161+0000 7fb2e1000640 1 --2- 172.21.15.44:0/3870591086 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb2dc1592c0 0x7fb2dc1575c0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fb2d4007dc0 tx=0x7fb2d400d4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:47:26.154 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:26.161+0000 7fb2d8c00640 1 -- 172.21.15.44:0/3870591086 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2d401a070 con 0x7fb2dc1592c0 2024-04-17T19:47:26.154 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:26.161+0000 7fb2d8c00640 1 -- 172.21.15.44:0/3870591086 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb2d40039a0 con 0x7fb2dc1592c0 2024-04-17T19:47:26.154 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:26.161+0000 7fb2d8c00640 1 -- 172.21.15.44:0/3870591086 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2d4003d90 con 0x7fb2dc1592c0 2024-04-17T19:47:26.154 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:26.161+0000 7fb2e3000640 1 -- 172.21.15.44:0/3870591086 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb2dc1efdb0 con 0x7fb2dc1592c0 2024-04-17T19:47:26.154 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:26.161+0000 7fb2e3000640 1 -- 172.21.15.44:0/3870591086 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb2dc1efa80 con 0x7fb2dc1592c0 2024-04-17T19:47:26.154 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:26.161+0000 7fb2e3000640 1 -- 172.21.15.44:0/3870591086 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb2dc04ff10 con 0x7fb2dc1592c0 2024-04-17T19:47:26.155 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:26.165+0000 7fb2d8c00640 1 -- 172.21.15.44:0/3870591086 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fb2d401d070 con 0x7fb2dc1592c0 2024-04-17T19:47:26.156 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:26.165+0000 7fb2d8c00640 1 --2- 172.21.15.44:0/3870591086 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7fb2b80683b0 0x7fb2b806a8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:26.156 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:26.165+0000 7fb2d8c00640 1 -- 172.21.15.44:0/3870591086 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fb2d4086ff0 con 0x7fb2dc1592c0 2024-04-17T19:47:26.156 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:26.165+0000 7fb2dbe00640 1 --2- 172.21.15.44:0/3870591086 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7fb2b80683b0 0x7fb2b806a8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:26.157 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:26.165+0000 7fb2dbe00640 1 --2- 172.21.15.44:0/3870591086 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7fb2b80683b0 0x7fb2b806a8c0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fb2cc0b2000 tx=0x7fb2cc008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:47:26.160 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:26.169+0000 7fb2d8c00640 1 -- 172.21.15.44:0/3870591086 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fb2d4010070 con 0x7fb2dc1592c0 2024-04-17T19:47:26.323 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:26.333+0000 7fb2e3000640 1 -- 172.21.15.44:0/3870591086 --> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fb2dc15c1f0 con 0x7fb2b80683b0 2024-04-17T19:47:26.347 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:26.357+0000 7fb2d8c00640 1 -- 172.21.15.44:0/3870591086 <== mgr.4102 v2:172.21.15.62:6832/1020159798 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+332651 (secure 0 0 0) 0x7fb2cc0a88f0 con 0x7fb2b80683b0 2024-04-17T19:47:26.350 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-04-17T19:47:26.352 INFO:teuthology.orchestra.run.smithi044.stderr:dumped all 2024-04-17T19:47:26.353 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:26.361+0000 7fb2e3000640 1 -- 172.21.15.44:0/3870591086 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7fb2b80683b0 msgr2=0x7fb2b806a8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:26.353 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:26.361+0000 7fb2e3000640 1 --2- 172.21.15.44:0/3870591086 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7fb2b80683b0 0x7fb2b806a8c0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fb2cc0b2000 tx=0x7fb2cc008040 comp rx=0 tx=0).stop 2024-04-17T19:47:26.353 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:26.361+0000 7fb2e3000640 1 -- 172.21.15.44:0/3870591086 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb2dc1592c0 msgr2=0x7fb2dc1575c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:26.353 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:26.361+0000 7fb2e3000640 1 --2- 172.21.15.44:0/3870591086 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb2dc1592c0 0x7fb2dc1575c0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fb2d4007dc0 tx=0x7fb2d400d4a0 comp rx=0 tx=0).stop 2024-04-17T19:47:26.353 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:26.361+0000 7fb2e3000640 1 -- 172.21.15.44:0/3870591086 shutdown_connections 2024-04-17T19:47:26.353 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:26.361+0000 7fb2e3000640 1 --2- 172.21.15.44:0/3870591086 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7fb2b80683b0 0x7fb2b806a8c0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:26.353 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:26.361+0000 7fb2e3000640 1 --2- 172.21.15.44:0/3870591086 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fb2dc158eb0 0x7fb2dc15bcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:26.353 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:26.361+0000 7fb2e3000640 1 --2- 172.21.15.44:0/3870591086 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb2dc1592c0 0x7fb2dc1575c0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:26.353 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:26.361+0000 7fb2e3000640 1 --2- 172.21.15.44:0/3870591086 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb2dc152a60 0x7fb2dc15c830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:26.353 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:26.361+0000 7fb2e3000640 1 -- 172.21.15.44:0/3870591086 >> 172.21.15.44:0/3870591086 conn(0x7fb2dc06c380 msgr2=0x7fb2dc072bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:47:26.353 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:26.361+0000 7fb2e3000640 1 -- 172.21.15.44:0/3870591086 shutdown_connections 2024-04-17T19:47:26.353 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:26.361+0000 7fb2e3000640 1 -- 172.21.15.44:0/3870591086 wait complete. 2024-04-17T19:47:26.371 INFO:teuthology.orchestra.run.smithi044.stdout:{"pg_ready":true,"pg_map":{"version":41,"stamp":"2024-04-17T19:47:25.907107+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":596414,"num_objects":42,"num_object_clones":0,"num_object_copies":84,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":42,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":246,"num_write_kb":2446,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":26,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":193,"ondisk_log_size":193,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":218384,"kb_used_data":2240,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754756336,"statfs":{"total":773094113280,"available":772870488064,"internally_reserved":0,"allocated":2293760,"data_stored":2006900,"data_compressed":66496,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":12751,"internal_metadata":221236785},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1547,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":40,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.006465"},"pg_stats":[{"pgid":"2.1f","version":"24'4","reported_seq":26,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T19:47:01.718542+0000","last_change":"2024-04-17T19:46:55.688623+0000","last_active":"2024-04-17T19:47:01.718542+0000","last_peered":"2024-04-17T19:47:01.718542+0000","last_clean":"2024-04-17T19:47:01.718542+0000","last_became_active":"2024-04-17T19:46:55.687455+0000","last_became_peered":"2024-04-17T19:46:55.687455+0000","last_unstale":"2024-04-17T19:47:01.718542+0000","last_undegraded":"2024-04-17T19:47:01.718542+0000","last_fullsized":"2024-04-17T19:47:01.718542+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:54.640133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:54.640133+0000","last_clean_scrub_stamp":"2024-04-17T19:46:54.640133+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:02:52.057635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T19:47:01.719008+0000","last_change":"2024-04-17T19:46:56.683770+0000","last_active":"2024-04-17T19:47:01.719008+0000","last_peered":"2024-04-17T19:47:01.719008+0000","last_clean":"2024-04-17T19:47:01.719008+0000","last_became_active":"2024-04-17T19:46:56.683111+0000","last_became_peered":"2024-04-17T19:46:56.683111+0000","last_unstale":"2024-04-17T19:47:01.719008+0000","last_undegraded":"2024-04-17T19:47:01.719008+0000","last_fullsized":"2024-04-17T19:47:01.719008+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_clean_scrub_stamp":"2024-04-17T19:46:55.648649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T22:25:59.135091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T19:47:02.881985+0000","last_change":"2024-04-17T19:47:00.788461+0000","last_active":"2024-04-17T19:47:02.881985+0000","last_peered":"2024-04-17T19:47:02.881985+0000","last_clean":"2024-04-17T19:47:02.881985+0000","last_became_active":"2024-04-17T19:47:00.787654+0000","last_became_peered":"2024-04-17T19:47:00.787654+0000","last_unstale":"2024-04-17T19:47:02.881985+0000","last_undegraded":"2024-04-17T19:47:02.881985+0000","last_fullsized":"2024-04-17T19:47:02.881985+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_clean_scrub_stamp":"2024-04-17T19:46:59.695482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T07:28:34.234670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4,1],"acting":[7,6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1e","version":"24'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T19:47:01.719064+0000","last_change":"2024-04-17T19:46:55.703749+0000","last_active":"2024-04-17T19:47:01.719064+0000","last_peered":"2024-04-17T19:47:01.719064+0000","last_clean":"2024-04-17T19:47:01.719064+0000","last_became_active":"2024-04-17T19:46:55.695191+0000","last_became_peered":"2024-04-17T19:46:55.695191+0000","last_unstale":"2024-04-17T19:47:01.719064+0000","last_undegraded":"2024-04-17T19:47:01.719064+0000","last_fullsized":"2024-04-17T19:47:01.719064+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:54.640133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:54.640133+0000","last_clean_scrub_stamp":"2024-04-17T19:46:54.640133+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:24:42.573542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T19:47:01.717983+0000","last_change":"2024-04-17T19:46:56.684814+0000","last_active":"2024-04-17T19:47:01.717983+0000","last_peered":"2024-04-17T19:47:01.717983+0000","last_clean":"2024-04-17T19:47:01.717983+0000","last_became_active":"2024-04-17T19:46:56.684475+0000","last_became_peered":"2024-04-17T19:46:56.684475+0000","last_unstale":"2024-04-17T19:47:01.717983+0000","last_undegraded":"2024-04-17T19:47:01.717983+0000","last_fullsized":"2024-04-17T19:47:01.717983+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_clean_scrub_stamp":"2024-04-17T19:46:55.648649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T05:38:55.394025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T19:47:01.869722+0000","last_change":"2024-04-17T19:47:00.769813+0000","last_active":"2024-04-17T19:47:01.869722+0000","last_peered":"2024-04-17T19:47:01.869722+0000","last_clean":"2024-04-17T19:47:01.869722+0000","last_became_active":"2024-04-17T19:47:00.769370+0000","last_became_peered":"2024-04-17T19:47:00.769370+0000","last_unstale":"2024-04-17T19:47:01.869722+0000","last_undegraded":"2024-04-17T19:47:01.869722+0000","last_fullsized":"2024-04-17T19:47:01.869722+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_clean_scrub_stamp":"2024-04-17T19:46:59.695482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:23:20.430751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,4,6],"acting":[2,7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1d","version":"24'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T19:47:02.723599+0000","last_change":"2024-04-17T19:46:55.695159+0000","last_active":"2024-04-17T19:47:02.723599+0000","last_peered":"2024-04-17T19:47:02.723599+0000","last_clean":"2024-04-17T19:47:02.723599+0000","last_became_active":"2024-04-17T19:46:55.694285+0000","last_became_peered":"2024-04-17T19:46:55.694285+0000","last_unstale":"2024-04-17T19:47:02.723599+0000","last_undegraded":"2024-04-17T19:47:02.723599+0000","last_fullsized":"2024-04-17T19:47:02.723599+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:54.640133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:54.640133+0000","last_clean_scrub_stamp":"2024-04-17T19:46:54.640133+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T04:52:16.008572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T19:47:02.880050+0000","last_change":"2024-04-17T19:46:56.700734+0000","last_active":"2024-04-17T19:47:02.880050+0000","last_peered":"2024-04-17T19:47:02.880050+0000","last_clean":"2024-04-17T19:47:02.880050+0000","last_became_active":"2024-04-17T19:46:56.700413+0000","last_became_peered":"2024-04-17T19:46:56.700413+0000","last_unstale":"2024-04-17T19:47:02.880050+0000","last_undegraded":"2024-04-17T19:47:02.880050+0000","last_fullsized":"2024-04-17T19:47:02.880050+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_clean_scrub_stamp":"2024-04-17T19:46:55.648649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:57:40.700986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T19:47:01.869999+0000","last_change":"2024-04-17T19:47:00.772341+0000","last_active":"2024-04-17T19:47:01.869999+0000","last_peered":"2024-04-17T19:47:01.869999+0000","last_clean":"2024-04-17T19:47:01.869999+0000","last_became_active":"2024-04-17T19:47:00.771578+0000","last_became_peered":"2024-04-17T19:47:00.771578+0000","last_unstale":"2024-04-17T19:47:01.869999+0000","last_undegraded":"2024-04-17T19:47:01.869999+0000","last_fullsized":"2024-04-17T19:47:01.869999+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_clean_scrub_stamp":"2024-04-17T19:46:59.695482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:51:07.602172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,3,6],"acting":[2,5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1c","version":"24'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T19:47:02.723800+0000","last_change":"2024-04-17T19:46:55.687607+0000","last_active":"2024-04-17T19:47:02.723800+0000","last_peered":"2024-04-17T19:47:02.723800+0000","last_clean":"2024-04-17T19:47:02.723800+0000","last_became_active":"2024-04-17T19:46:55.687282+0000","last_became_peered":"2024-04-17T19:46:55.687282+0000","last_unstale":"2024-04-17T19:47:02.723800+0000","last_undegraded":"2024-04-17T19:47:02.723800+0000","last_fullsized":"2024-04-17T19:47:02.723800+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:54.640133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:54.640133+0000","last_clean_scrub_stamp":"2024-04-17T19:46:54.640133+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T05:52:32.550876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T19:47:01.714880+0000","last_change":"2024-04-17T19:46:56.690268+0000","last_active":"2024-04-17T19:47:01.714880+0000","last_peered":"2024-04-17T19:47:01.714880+0000","last_clean":"2024-04-17T19:47:01.714880+0000","last_became_active":"2024-04-17T19:46:56.689988+0000","last_became_peered":"2024-04-17T19:46:56.689988+0000","last_unstale":"2024-04-17T19:47:01.714880+0000","last_undegraded":"2024-04-17T19:47:01.714880+0000","last_fullsized":"2024-04-17T19:47:01.714880+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_clean_scrub_stamp":"2024-04-17T19:46:55.648649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T01:29:59.423734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T19:47:01.869747+0000","last_change":"2024-04-17T19:47:00.759608+0000","last_active":"2024-04-17T19:47:01.869747+0000","last_peered":"2024-04-17T19:47:01.869747+0000","last_clean":"2024-04-17T19:47:01.869747+0000","last_became_active":"2024-04-17T19:47:00.759059+0000","last_became_peered":"2024-04-17T19:47:00.759059+0000","last_unstale":"2024-04-17T19:47:01.869747+0000","last_undegraded":"2024-04-17T19:47:01.869747+0000","last_fullsized":"2024-04-17T19:47:01.869747+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_clean_scrub_stamp":"2024-04-17T19:46:59.695482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:22:37.460235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,5,7],"acting":[2,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T19:47:01.714081+0000","last_change":"2024-04-17T19:46:56.688273+0000","last_active":"2024-04-17T19:47:01.714081+0000","last_peered":"2024-04-17T19:47:01.714081+0000","last_clean":"2024-04-17T19:47:01.714081+0000","last_became_active":"2024-04-17T19:46:56.687662+0000","last_became_peered":"2024-04-17T19:46:56.687662+0000","last_unstale":"2024-04-17T19:47:01.714081+0000","last_undegraded":"2024-04-17T19:47:01.714081+0000","last_fullsized":"2024-04-17T19:47:01.714081+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_clean_scrub_stamp":"2024-04-17T19:46:55.648649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:51:46.684685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"25'4","reported_seq":26,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T19:47:22.814261+0000","last_change":"2024-04-17T19:46:55.692833+0000","last_active":"2024-04-17T19:47:22.814261+0000","last_peered":"2024-04-17T19:47:22.814261+0000","last_clean":"2024-04-17T19:47:22.814261+0000","last_became_active":"2024-04-17T19:46:55.689006+0000","last_became_peered":"2024-04-17T19:46:55.689006+0000","last_unstale":"2024-04-17T19:47:22.814261+0000","last_undegraded":"2024-04-17T19:47:22.814261+0000","last_fullsized":"2024-04-17T19:47:22.814261+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:54.640133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:54.640133+0000","last_clean_scrub_stamp":"2024-04-17T19:46:54.640133+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:57:39.692470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T19:47:01.714813+0000","last_change":"2024-04-17T19:47:00.757063+0000","last_active":"2024-04-17T19:47:01.714813+0000","last_peered":"2024-04-17T19:47:01.714813+0000","last_clean":"2024-04-17T19:47:01.714813+0000","last_became_active":"2024-04-17T19:47:00.756456+0000","last_became_peered":"2024-04-17T19:47:00.756456+0000","last_unstale":"2024-04-17T19:47:01.714813+0000","last_undegraded":"2024-04-17T19:47:01.714813+0000","last_fullsized":"2024-04-17T19:47:01.714813+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_clean_scrub_stamp":"2024-04-17T19:46:59.695482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T02:52:51.655611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,5],"acting":[3,1,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T19:47:02.884821+0000","last_change":"2024-04-17T19:46:56.691544+0000","last_active":"2024-04-17T19:47:02.884821+0000","last_peered":"2024-04-17T19:47:02.884821+0000","last_clean":"2024-04-17T19:47:02.884821+0000","last_became_active":"2024-04-17T19:46:56.690828+0000","last_became_peered":"2024-04-17T19:46:56.690828+0000","last_unstale":"2024-04-17T19:47:02.884821+0000","last_undegraded":"2024-04-17T19:47:02.884821+0000","last_fullsized":"2024-04-17T19:47:02.884821+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_clean_scrub_stamp":"2024-04-17T19:46:55.648649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:11:01.745657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T19:47:02.881826+0000","last_change":"2024-04-17T19:46:55.715857+0000","last_active":"2024-04-17T19:47:02.881826+0000","last_peered":"2024-04-17T19:47:02.881826+0000","last_clean":"2024-04-17T19:47:02.881826+0000","last_became_active":"2024-04-17T19:46:55.715197+0000","last_became_peered":"2024-04-17T19:46:55.715197+0000","last_unstale":"2024-04-17T19:47:02.881826+0000","last_undegraded":"2024-04-17T19:47:02.881826+0000","last_fullsized":"2024-04-17T19:47:02.881826+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:54.640133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:54.640133+0000","last_clean_scrub_stamp":"2024-04-17T19:46:54.640133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:25:07.379181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T19:47:02.723301+0000","last_change":"2024-04-17T19:47:00.773528+0000","last_active":"2024-04-17T19:47:02.723301+0000","last_peered":"2024-04-17T19:47:02.723301+0000","last_clean":"2024-04-17T19:47:02.723301+0000","last_became_active":"2024-04-17T19:47:00.773077+0000","last_became_peered":"2024-04-17T19:47:00.773077+0000","last_unstale":"2024-04-17T19:47:02.723301+0000","last_undegraded":"2024-04-17T19:47:02.723301+0000","last_fullsized":"2024-04-17T19:47:02.723301+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_clean_scrub_stamp":"2024-04-17T19:46:59.695482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T02:53:18.654740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,6,1],"acting":[0,4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T19:47:01.715767+0000","last_change":"2024-04-17T19:46:56.695617+0000","last_active":"2024-04-17T19:47:01.715767+0000","last_peered":"2024-04-17T19:47:01.715767+0000","last_clean":"2024-04-17T19:47:01.715767+0000","last_became_active":"2024-04-17T19:46:56.695205+0000","last_became_peered":"2024-04-17T19:46:56.695205+0000","last_unstale":"2024-04-17T19:47:01.715767+0000","last_undegraded":"2024-04-17T19:47:01.715767+0000","last_fullsized":"2024-04-17T19:47:01.715767+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_clean_scrub_stamp":"2024-04-17T19:46:55.648649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T05:05:36.718886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"25'3","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T19:47:22.801427+0000","last_change":"2024-04-17T19:46:55.686220+0000","last_active":"2024-04-17T19:47:22.801427+0000","last_peered":"2024-04-17T19:47:22.801427+0000","last_clean":"2024-04-17T19:47:22.801427+0000","last_became_active":"2024-04-17T19:46:55.684782+0000","last_became_peered":"2024-04-17T19:46:55.684782+0000","last_unstale":"2024-04-17T19:47:22.801427+0000","last_undegraded":"2024-04-17T19:47:22.801427+0000","last_fullsized":"2024-04-17T19:47:22.801427+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:54.640133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:54.640133+0000","last_clean_scrub_stamp":"2024-04-17T19:46:54.640133+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:57:31.750325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T19:47:02.884208+0000","last_change":"2024-04-17T19:47:00.774664+0000","last_active":"2024-04-17T19:47:02.884208+0000","last_peered":"2024-04-17T19:47:02.884208+0000","last_clean":"2024-04-17T19:47:02.884208+0000","last_became_active":"2024-04-17T19:47:00.774008+0000","last_became_peered":"2024-04-17T19:47:00.774008+0000","last_unstale":"2024-04-17T19:47:02.884208+0000","last_undegraded":"2024-04-17T19:47:02.884208+0000","last_fullsized":"2024-04-17T19:47:02.884208+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_clean_scrub_stamp":"2024-04-17T19:46:59.695482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T04:04:16.650657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,2,3],"acting":[7,4,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T19:47:01.713826+0000","last_change":"2024-04-17T19:46:56.700069+0000","last_active":"2024-04-17T19:47:01.713826+0000","last_peered":"2024-04-17T19:47:01.713826+0000","last_clean":"2024-04-17T19:47:01.713826+0000","last_became_active":"2024-04-17T19:46:56.699525+0000","last_became_peered":"2024-04-17T19:46:56.699525+0000","last_unstale":"2024-04-17T19:47:01.713826+0000","last_undegraded":"2024-04-17T19:47:01.713826+0000","last_fullsized":"2024-04-17T19:47:01.713826+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_clean_scrub_stamp":"2024-04-17T19:46:55.648649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T00:28:36.944531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.8","version":"25'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T19:47:22.813771+0000","last_change":"2024-04-17T19:46:55.684594+0000","last_active":"2024-04-17T19:47:22.813771+0000","last_peered":"2024-04-17T19:47:22.813771+0000","last_clean":"2024-04-17T19:47:22.813771+0000","last_became_active":"2024-04-17T19:46:55.683145+0000","last_became_peered":"2024-04-17T19:46:55.683145+0000","last_unstale":"2024-04-17T19:47:22.813771+0000","last_undegraded":"2024-04-17T19:47:22.813771+0000","last_fullsized":"2024-04-17T19:47:22.813771+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:54.640133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:54.640133+0000","last_clean_scrub_stamp":"2024-04-17T19:46:54.640133+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T02:39:08.241534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T19:47:01.870328+0000","last_change":"2024-04-17T19:47:00.768781+0000","last_active":"2024-04-17T19:47:01.870328+0000","last_peered":"2024-04-17T19:47:01.870328+0000","last_clean":"2024-04-17T19:47:01.870328+0000","last_became_active":"2024-04-17T19:47:00.768277+0000","last_became_peered":"2024-04-17T19:47:00.768277+0000","last_unstale":"2024-04-17T19:47:01.870328+0000","last_undegraded":"2024-04-17T19:47:01.870328+0000","last_fullsized":"2024-04-17T19:47:01.870328+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_clean_scrub_stamp":"2024-04-17T19:46:59.695482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:07:00.936098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,7],"acting":[2,1,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T19:47:01.717916+0000","last_change":"2024-04-17T19:46:56.695528+0000","last_active":"2024-04-17T19:47:01.717916+0000","last_peered":"2024-04-17T19:47:01.717916+0000","last_clean":"2024-04-17T19:47:01.717916+0000","last_became_active":"2024-04-17T19:46:56.694993+0000","last_became_peered":"2024-04-17T19:46:56.694993+0000","last_unstale":"2024-04-17T19:47:01.717916+0000","last_undegraded":"2024-04-17T19:47:01.717916+0000","last_fullsized":"2024-04-17T19:47:01.717916+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_clean_scrub_stamp":"2024-04-17T19:46:55.648649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:08:14.848448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"25'4","reported_seq":26,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T19:47:22.803509+0000","last_change":"2024-04-17T19:46:55.688859+0000","last_active":"2024-04-17T19:47:22.803509+0000","last_peered":"2024-04-17T19:47:22.803509+0000","last_clean":"2024-04-17T19:47:22.803509+0000","last_became_active":"2024-04-17T19:46:55.688507+0000","last_became_peered":"2024-04-17T19:46:55.688507+0000","last_unstale":"2024-04-17T19:47:22.803509+0000","last_undegraded":"2024-04-17T19:47:22.803509+0000","last_fullsized":"2024-04-17T19:47:22.803509+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:54.640133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:54.640133+0000","last_clean_scrub_stamp":"2024-04-17T19:46:54.640133+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T01:53:38.377482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T19:47:01.869773+0000","last_change":"2024-04-17T19:47:00.781482+0000","last_active":"2024-04-17T19:47:01.869773+0000","last_peered":"2024-04-17T19:47:01.869773+0000","last_clean":"2024-04-17T19:47:01.869773+0000","last_became_active":"2024-04-17T19:47:00.780994+0000","last_became_peered":"2024-04-17T19:47:00.780994+0000","last_unstale":"2024-04-17T19:47:01.869773+0000","last_undegraded":"2024-04-17T19:47:01.869773+0000","last_fullsized":"2024-04-17T19:47:01.869773+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_clean_scrub_stamp":"2024-04-17T19:46:59.695482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T01:46:40.550031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,3,1],"acting":[2,6,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T19:47:01.718456+0000","last_change":"2024-04-17T19:46:56.695874+0000","last_active":"2024-04-17T19:47:01.718456+0000","last_peered":"2024-04-17T19:47:01.718456+0000","last_clean":"2024-04-17T19:47:01.718456+0000","last_became_active":"2024-04-17T19:46:56.694650+0000","last_became_peered":"2024-04-17T19:46:56.694650+0000","last_unstale":"2024-04-17T19:47:01.718456+0000","last_undegraded":"2024-04-17T19:47:01.718456+0000","last_fullsized":"2024-04-17T19:47:01.718456+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_clean_scrub_stamp":"2024-04-17T19:46:55.648649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:44:38.787541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"25'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T19:47:01.718214+0000","last_change":"2024-04-17T19:46:55.684490+0000","last_active":"2024-04-17T19:47:01.718214+0000","last_peered":"2024-04-17T19:47:01.718214+0000","last_clean":"2024-04-17T19:47:01.718214+0000","last_became_active":"2024-04-17T19:46:55.680100+0000","last_became_peered":"2024-04-17T19:46:55.680100+0000","last_unstale":"2024-04-17T19:47:01.718214+0000","last_undegraded":"2024-04-17T19:47:01.718214+0000","last_fullsized":"2024-04-17T19:47:01.718214+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:54.640133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:54.640133+0000","last_clean_scrub_stamp":"2024-04-17T19:46:54.640133+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:27:38.256174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T19:47:01.715596+0000","last_change":"2024-04-17T19:47:00.777588+0000","last_active":"2024-04-17T19:47:01.715596+0000","last_peered":"2024-04-17T19:47:01.715596+0000","last_clean":"2024-04-17T19:47:01.715596+0000","last_became_active":"2024-04-17T19:47:00.776873+0000","last_became_peered":"2024-04-17T19:47:00.776873+0000","last_unstale":"2024-04-17T19:47:01.715596+0000","last_undegraded":"2024-04-17T19:47:01.715596+0000","last_fullsized":"2024-04-17T19:47:01.715596+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_clean_scrub_stamp":"2024-04-17T19:46:59.695482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T02:52:42.471996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,6,3],"acting":[4,1,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T19:47:02.884485+0000","last_change":"2024-04-17T19:46:56.681681+0000","last_active":"2024-04-17T19:47:02.884485+0000","last_peered":"2024-04-17T19:47:02.884485+0000","last_clean":"2024-04-17T19:47:02.884485+0000","last_became_active":"2024-04-17T19:46:56.681316+0000","last_became_peered":"2024-04-17T19:46:56.681316+0000","last_unstale":"2024-04-17T19:47:02.884485+0000","last_undegraded":"2024-04-17T19:47:02.884485+0000","last_fullsized":"2024-04-17T19:47:02.884485+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_clean_scrub_stamp":"2024-04-17T19:46:55.648649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T07:28:30.187837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"25'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T19:47:01.715217+0000","last_change":"2024-04-17T19:46:55.692826+0000","last_active":"2024-04-17T19:47:01.715217+0000","last_peered":"2024-04-17T19:47:01.715217+0000","last_clean":"2024-04-17T19:47:01.715217+0000","last_became_active":"2024-04-17T19:46:55.691031+0000","last_became_peered":"2024-04-17T19:46:55.691031+0000","last_unstale":"2024-04-17T19:47:01.715217+0000","last_undegraded":"2024-04-17T19:47:01.715217+0000","last_fullsized":"2024-04-17T19:47:01.715217+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:54.640133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:54.640133+0000","last_clean_scrub_stamp":"2024-04-17T19:46:54.640133+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T05:52:32.550876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T19:47:02.882070+0000","last_change":"2024-04-17T19:47:00.777416+0000","last_active":"2024-04-17T19:47:02.882070+0000","last_peered":"2024-04-17T19:47:02.882070+0000","last_clean":"2024-04-17T19:47:02.882070+0000","last_became_active":"2024-04-17T19:47:00.771531+0000","last_became_peered":"2024-04-17T19:47:00.771531+0000","last_unstale":"2024-04-17T19:47:02.882070+0000","last_undegraded":"2024-04-17T19:47:02.882070+0000","last_fullsized":"2024-04-17T19:47:02.882070+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_clean_scrub_stamp":"2024-04-17T19:46:59.695482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:30:31.288100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,2,7],"acting":[6,0,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T19:47:01.870267+0000","last_change":"2024-04-17T19:46:56.692250+0000","last_active":"2024-04-17T19:47:01.870267+0000","last_peered":"2024-04-17T19:47:01.870267+0000","last_clean":"2024-04-17T19:47:01.870267+0000","last_became_active":"2024-04-17T19:46:56.691801+0000","last_became_peered":"2024-04-17T19:46:56.691801+0000","last_unstale":"2024-04-17T19:47:01.870267+0000","last_undegraded":"2024-04-17T19:47:01.870267+0000","last_fullsized":"2024-04-17T19:47:01.870267+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_clean_scrub_stamp":"2024-04-17T19:46:55.648649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T01:53:39.385998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T19:47:01.716158+0000","last_change":"2024-04-17T19:46:55.713556+0000","last_active":"2024-04-17T19:47:01.716158+0000","last_peered":"2024-04-17T19:47:01.716158+0000","last_clean":"2024-04-17T19:47:01.716158+0000","last_became_active":"2024-04-17T19:46:55.712908+0000","last_became_peered":"2024-04-17T19:46:55.712908+0000","last_unstale":"2024-04-17T19:47:01.716158+0000","last_undegraded":"2024-04-17T19:47:01.716158+0000","last_fullsized":"2024-04-17T19:47:01.716158+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:54.640133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:54.640133+0000","last_clean_scrub_stamp":"2024-04-17T19:46:54.640133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:57:31.750325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T19:47:02.881295+0000","last_change":"2024-04-17T19:47:00.776868+0000","last_active":"2024-04-17T19:47:02.881295+0000","last_peered":"2024-04-17T19:47:02.881295+0000","last_clean":"2024-04-17T19:47:02.881295+0000","last_became_active":"2024-04-17T19:47:00.771385+0000","last_became_peered":"2024-04-17T19:47:00.771385+0000","last_unstale":"2024-04-17T19:47:02.881295+0000","last_undegraded":"2024-04-17T19:47:02.881295+0000","last_fullsized":"2024-04-17T19:47:02.881295+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_clean_scrub_stamp":"2024-04-17T19:46:59.695482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T01:46:40.550031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5,7],"acting":[6,3,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T19:47:02.723383+0000","last_change":"2024-04-17T19:46:56.709288+0000","last_active":"2024-04-17T19:47:02.723383+0000","last_peered":"2024-04-17T19:47:02.723383+0000","last_clean":"2024-04-17T19:47:02.723383+0000","last_became_active":"2024-04-17T19:46:56.708572+0000","last_became_peered":"2024-04-17T19:46:56.708572+0000","last_unstale":"2024-04-17T19:47:02.723383+0000","last_undegraded":"2024-04-17T19:47:02.723383+0000","last_fullsized":"2024-04-17T19:47:02.723383+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_clean_scrub_stamp":"2024-04-17T19:46:55.648649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:51:03.555339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T19:47:01.714531+0000","last_change":"2024-04-17T19:46:55.708506+0000","last_active":"2024-04-17T19:47:01.714531+0000","last_peered":"2024-04-17T19:47:01.714531+0000","last_clean":"2024-04-17T19:47:01.714531+0000","last_became_active":"2024-04-17T19:46:55.708175+0000","last_became_peered":"2024-04-17T19:46:55.708175+0000","last_unstale":"2024-04-17T19:47:01.714531+0000","last_undegraded":"2024-04-17T19:47:01.714531+0000","last_fullsized":"2024-04-17T19:47:01.714531+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:54.640133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:54.640133+0000","last_clean_scrub_stamp":"2024-04-17T19:46:54.640133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T22:25:04.163982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T19:47:02.885589+0000","last_change":"2024-04-17T19:47:00.786657+0000","last_active":"2024-04-17T19:47:02.885589+0000","last_peered":"2024-04-17T19:47:02.885589+0000","last_clean":"2024-04-17T19:47:02.885589+0000","last_became_active":"2024-04-17T19:47:00.780743+0000","last_became_peered":"2024-04-17T19:47:00.780743+0000","last_unstale":"2024-04-17T19:47:02.885589+0000","last_undegraded":"2024-04-17T19:47:02.885589+0000","last_fullsized":"2024-04-17T19:47:02.885589+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_clean_scrub_stamp":"2024-04-17T19:46:59.695482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:07:00.936098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0,3],"acting":[6,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T19:47:01.715163+0000","last_change":"2024-04-17T19:46:56.679752+0000","last_active":"2024-04-17T19:47:01.715163+0000","last_peered":"2024-04-17T19:47:01.715163+0000","last_clean":"2024-04-17T19:47:01.715163+0000","last_became_active":"2024-04-17T19:46:56.679230+0000","last_became_peered":"2024-04-17T19:46:56.679230+0000","last_unstale":"2024-04-17T19:47:01.715163+0000","last_undegraded":"2024-04-17T19:47:01.715163+0000","last_fullsized":"2024-04-17T19:47:01.715163+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_clean_scrub_stamp":"2024-04-17T19:46:55.648649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:08:14.848448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"25'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T19:47:02.882287+0000","last_change":"2024-04-17T19:46:55.715967+0000","last_active":"2024-04-17T19:47:02.882287+0000","last_peered":"2024-04-17T19:47:02.882287+0000","last_clean":"2024-04-17T19:47:02.882287+0000","last_became_active":"2024-04-17T19:46:55.715247+0000","last_became_peered":"2024-04-17T19:46:55.715247+0000","last_unstale":"2024-04-17T19:47:02.882287+0000","last_undegraded":"2024-04-17T19:47:02.882287+0000","last_fullsized":"2024-04-17T19:47:02.882287+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:54.640133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:54.640133+0000","last_clean_scrub_stamp":"2024-04-17T19:46:54.640133+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T00:40:58.757373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T19:47:02.884271+0000","last_change":"2024-04-17T19:47:00.769901+0000","last_active":"2024-04-17T19:47:02.884271+0000","last_peered":"2024-04-17T19:47:02.884271+0000","last_clean":"2024-04-17T19:47:02.884271+0000","last_became_active":"2024-04-17T19:47:00.768634+0000","last_became_peered":"2024-04-17T19:47:00.768634+0000","last_unstale":"2024-04-17T19:47:02.884271+0000","last_undegraded":"2024-04-17T19:47:02.884271+0000","last_fullsized":"2024-04-17T19:47:02.884271+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_clean_scrub_stamp":"2024-04-17T19:46:59.695482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T04:48:47.816818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,7],"acting":[6,0,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T19:47:02.880908+0000","last_change":"2024-04-17T19:46:56.703467+0000","last_active":"2024-04-17T19:47:02.880908+0000","last_peered":"2024-04-17T19:47:02.880908+0000","last_clean":"2024-04-17T19:47:02.880908+0000","last_became_active":"2024-04-17T19:46:56.703148+0000","last_became_peered":"2024-04-17T19:46:56.703148+0000","last_unstale":"2024-04-17T19:47:02.880908+0000","last_undegraded":"2024-04-17T19:47:02.880908+0000","last_fullsized":"2024-04-17T19:47:02.880908+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_clean_scrub_stamp":"2024-04-17T19:46:55.648649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T22:01:49.863892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"25'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T19:47:01.714087+0000","last_change":"2024-04-17T19:46:55.715941+0000","last_active":"2024-04-17T19:47:01.714087+0000","last_peered":"2024-04-17T19:47:01.714087+0000","last_clean":"2024-04-17T19:47:01.714087+0000","last_became_active":"2024-04-17T19:46:55.715527+0000","last_became_peered":"2024-04-17T19:46:55.715527+0000","last_unstale":"2024-04-17T19:47:01.714087+0000","last_undegraded":"2024-04-17T19:47:01.714087+0000","last_fullsized":"2024-04-17T19:47:01.714087+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:54.640133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:54.640133+0000","last_clean_scrub_stamp":"2024-04-17T19:46:54.640133+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:11:00.737141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T19:47:01.718674+0000","last_change":"2024-04-17T19:47:00.784031+0000","last_active":"2024-04-17T19:47:01.718674+0000","last_peered":"2024-04-17T19:47:01.718674+0000","last_clean":"2024-04-17T19:47:01.718674+0000","last_became_active":"2024-04-17T19:47:00.783386+0000","last_became_peered":"2024-04-17T19:47:00.783386+0000","last_unstale":"2024-04-17T19:47:01.718674+0000","last_undegraded":"2024-04-17T19:47:01.718674+0000","last_fullsized":"2024-04-17T19:47:01.718674+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_clean_scrub_stamp":"2024-04-17T19:46:59.695482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:00:44.689926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6,1],"acting":[5,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T19:47:01.717334+0000","last_change":"2024-04-17T19:46:56.692287+0000","last_active":"2024-04-17T19:47:01.717334+0000","last_peered":"2024-04-17T19:47:01.717334+0000","last_clean":"2024-04-17T19:47:01.717334+0000","last_became_active":"2024-04-17T19:46:56.691917+0000","last_became_peered":"2024-04-17T19:46:56.691917+0000","last_unstale":"2024-04-17T19:47:01.717334+0000","last_undegraded":"2024-04-17T19:47:01.717334+0000","last_fullsized":"2024-04-17T19:47:01.717334+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_clean_scrub_stamp":"2024-04-17T19:46:55.648649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T07:37:05.790432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.3","version":"25'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T19:47:22.814735+0000","last_change":"2024-04-17T19:46:55.686031+0000","last_active":"2024-04-17T19:47:22.814735+0000","last_peered":"2024-04-17T19:47:22.814735+0000","last_clean":"2024-04-17T19:47:22.814735+0000","last_became_active":"2024-04-17T19:46:55.685599+0000","last_became_peered":"2024-04-17T19:46:55.685599+0000","last_unstale":"2024-04-17T19:47:22.814735+0000","last_undegraded":"2024-04-17T19:47:22.814735+0000","last_fullsized":"2024-04-17T19:47:22.814735+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:54.640133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:54.640133+0000","last_clean_scrub_stamp":"2024-04-17T19:46:54.640133+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T01:39:32.586696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":178,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T19:47:02.879822+0000","last_change":"2024-04-17T19:46:43.000943+0000","last_active":"2024-04-17T19:47:02.879822+0000","last_peered":"2024-04-17T19:47:02.879822+0000","last_clean":"2024-04-17T19:47:02.879822+0000","last_became_active":"2024-04-17T19:46:43.000652+0000","last_became_peered":"2024-04-17T19:46:43.000652+0000","last_unstale":"2024-04-17T19:47:02.879822+0000","last_undegraded":"2024-04-17T19:47:02.879822+0000","last_fullsized":"2024-04-17T19:47:02.879822+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:41.988197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:41.988197+0000","last_clean_scrub_stamp":"2024-04-17T19:46:41.988197+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T19:53:52.845547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T19:47:01.715109+0000","last_change":"2024-04-17T19:47:00.731680+0000","last_active":"2024-04-17T19:47:01.715109+0000","last_peered":"2024-04-17T19:47:01.715109+0000","last_clean":"2024-04-17T19:47:01.715109+0000","last_became_active":"2024-04-17T19:47:00.731093+0000","last_became_peered":"2024-04-17T19:47:00.731093+0000","last_unstale":"2024-04-17T19:47:01.715109+0000","last_undegraded":"2024-04-17T19:47:01.715109+0000","last_fullsized":"2024-04-17T19:47:01.715109+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_clean_scrub_stamp":"2024-04-17T19:46:59.695482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T04:59:23.336626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T19:47:01.714967+0000","last_change":"2024-04-17T19:46:56.692443+0000","last_active":"2024-04-17T19:47:01.714967+0000","last_peered":"2024-04-17T19:47:01.714967+0000","last_clean":"2024-04-17T19:47:01.714967+0000","last_became_active":"2024-04-17T19:46:56.692106+0000","last_became_peered":"2024-04-17T19:46:56.692106+0000","last_unstale":"2024-04-17T19:47:01.714967+0000","last_undegraded":"2024-04-17T19:47:01.714967+0000","last_fullsized":"2024-04-17T19:47:01.714967+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_clean_scrub_stamp":"2024-04-17T19:46:55.648649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T04:07:54.102221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T19:47:02.884978+0000","last_change":"2024-04-17T19:46:55.689884+0000","last_active":"2024-04-17T19:47:02.884978+0000","last_peered":"2024-04-17T19:47:02.884978+0000","last_clean":"2024-04-17T19:47:02.884978+0000","last_became_active":"2024-04-17T19:46:55.689059+0000","last_became_peered":"2024-04-17T19:46:55.689059+0000","last_unstale":"2024-04-17T19:47:02.884978+0000","last_undegraded":"2024-04-17T19:47:02.884978+0000","last_fullsized":"2024-04-17T19:47:02.884978+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:54.640133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:54.640133+0000","last_clean_scrub_stamp":"2024-04-17T19:46:54.640133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T04:52:16.008572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T19:47:01.869956+0000","last_change":"2024-04-17T19:47:00.760432+0000","last_active":"2024-04-17T19:47:01.869956+0000","last_peered":"2024-04-17T19:47:01.869956+0000","last_clean":"2024-04-17T19:47:01.869956+0000","last_became_active":"2024-04-17T19:47:00.759946+0000","last_became_peered":"2024-04-17T19:47:00.759946+0000","last_unstale":"2024-04-17T19:47:01.869956+0000","last_undegraded":"2024-04-17T19:47:01.869956+0000","last_fullsized":"2024-04-17T19:47:01.869956+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_clean_scrub_stamp":"2024-04-17T19:46:59.695482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:30:31.288100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,7,4],"acting":[2,3,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T19:47:02.723729+0000","last_change":"2024-04-17T19:46:56.695109+0000","last_active":"2024-04-17T19:47:02.723729+0000","last_peered":"2024-04-17T19:47:02.723729+0000","last_clean":"2024-04-17T19:47:02.723729+0000","last_became_active":"2024-04-17T19:46:56.694764+0000","last_became_peered":"2024-04-17T19:46:56.694764+0000","last_unstale":"2024-04-17T19:47:02.723729+0000","last_undegraded":"2024-04-17T19:47:02.723729+0000","last_fullsized":"2024-04-17T19:47:02.723729+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_clean_scrub_stamp":"2024-04-17T19:46:55.648649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T00:28:36.944531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"24'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T19:47:01.717531+0000","last_change":"2024-04-17T19:46:55.704346+0000","last_active":"2024-04-17T19:47:01.717531+0000","last_peered":"2024-04-17T19:47:01.717531+0000","last_clean":"2024-04-17T19:47:01.717531+0000","last_became_active":"2024-04-17T19:46:55.703334+0000","last_became_peered":"2024-04-17T19:46:55.703334+0000","last_unstale":"2024-04-17T19:47:01.717531+0000","last_undegraded":"2024-04-17T19:47:01.717531+0000","last_fullsized":"2024-04-17T19:47:01.717531+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:54.640133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:54.640133+0000","last_clean_scrub_stamp":"2024-04-17T19:46:54.640133+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:01:11.327106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T19:47:01.716304+0000","last_change":"2024-04-17T19:47:00.745450+0000","last_active":"2024-04-17T19:47:01.716304+0000","last_peered":"2024-04-17T19:47:01.716304+0000","last_clean":"2024-04-17T19:47:01.716304+0000","last_became_active":"2024-04-17T19:47:00.744227+0000","last_became_peered":"2024-04-17T19:47:00.744227+0000","last_unstale":"2024-04-17T19:47:01.716304+0000","last_undegraded":"2024-04-17T19:47:01.716304+0000","last_fullsized":"2024-04-17T19:47:01.716304+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_clean_scrub_stamp":"2024-04-17T19:46:59.695482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:52:15.523817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1,3],"acting":[5,4,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T19:47:02.723996+0000","last_change":"2024-04-17T19:46:56.687926+0000","last_active":"2024-04-17T19:47:02.723996+0000","last_peered":"2024-04-17T19:47:02.723996+0000","last_clean":"2024-04-17T19:47:02.723996+0000","last_became_active":"2024-04-17T19:46:56.687352+0000","last_became_peered":"2024-04-17T19:46:56.687352+0000","last_unstale":"2024-04-17T19:47:02.723996+0000","last_undegraded":"2024-04-17T19:47:02.723996+0000","last_fullsized":"2024-04-17T19:47:02.723996+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_clean_scrub_stamp":"2024-04-17T19:46:55.648649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T01:32:52.608291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.e","version":"24'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T19:47:01.717920+0000","last_change":"2024-04-17T19:46:55.716397+0000","last_active":"2024-04-17T19:47:01.717920+0000","last_peered":"2024-04-17T19:47:01.717920+0000","last_clean":"2024-04-17T19:47:01.717920+0000","last_became_active":"2024-04-17T19:46:55.715196+0000","last_became_peered":"2024-04-17T19:46:55.715196+0000","last_unstale":"2024-04-17T19:47:01.717920+0000","last_undegraded":"2024-04-17T19:47:01.717920+0000","last_fullsized":"2024-04-17T19:47:01.717920+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:54.640133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:54.640133+0000","last_clean_scrub_stamp":"2024-04-17T19:46:54.640133+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:24:42.573542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T19:47:01.713746+0000","last_change":"2024-04-17T19:47:00.735608+0000","last_active":"2024-04-17T19:47:01.713746+0000","last_peered":"2024-04-17T19:47:01.713746+0000","last_clean":"2024-04-17T19:47:01.713746+0000","last_became_active":"2024-04-17T19:47:00.735120+0000","last_became_peered":"2024-04-17T19:47:00.735120+0000","last_unstale":"2024-04-17T19:47:01.713746+0000","last_undegraded":"2024-04-17T19:47:01.713746+0000","last_fullsized":"2024-04-17T19:47:01.713746+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_clean_scrub_stamp":"2024-04-17T19:46:59.695482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T04:40:43.846198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T19:47:01.870376+0000","last_change":"2024-04-17T19:46:56.706026+0000","last_active":"2024-04-17T19:47:01.870376+0000","last_peered":"2024-04-17T19:47:01.870376+0000","last_clean":"2024-04-17T19:47:01.870376+0000","last_became_active":"2024-04-17T19:46:56.704786+0000","last_became_peered":"2024-04-17T19:46:56.704786+0000","last_unstale":"2024-04-17T19:47:01.870376+0000","last_undegraded":"2024-04-17T19:47:01.870376+0000","last_fullsized":"2024-04-17T19:47:01.870376+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_clean_scrub_stamp":"2024-04-17T19:46:55.648649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:59:17.441539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.f","version":"24'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T19:47:02.723994+0000","last_change":"2024-04-17T19:46:55.707082+0000","last_active":"2024-04-17T19:47:02.723994+0000","last_peered":"2024-04-17T19:47:02.723994+0000","last_clean":"2024-04-17T19:47:02.723994+0000","last_became_active":"2024-04-17T19:46:55.706729+0000","last_became_peered":"2024-04-17T19:46:55.706729+0000","last_unstale":"2024-04-17T19:47:02.723994+0000","last_undegraded":"2024-04-17T19:47:02.723994+0000","last_fullsized":"2024-04-17T19:47:02.723994+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:54.640133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:54.640133+0000","last_clean_scrub_stamp":"2024-04-17T19:46:54.640133+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:11:00.737141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T19:47:02.879853+0000","last_change":"2024-04-17T19:47:00.744054+0000","last_active":"2024-04-17T19:47:02.879853+0000","last_peered":"2024-04-17T19:47:02.879853+0000","last_clean":"2024-04-17T19:47:02.879853+0000","last_became_active":"2024-04-17T19:47:00.743582+0000","last_became_peered":"2024-04-17T19:47:00.743582+0000","last_unstale":"2024-04-17T19:47:02.879853+0000","last_undegraded":"2024-04-17T19:47:02.879853+0000","last_fullsized":"2024-04-17T19:47:02.879853+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_clean_scrub_stamp":"2024-04-17T19:46:59.695482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T22:25:09.219331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,2],"acting":[1,5,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T19:47:01.713775+0000","last_change":"2024-04-17T19:46:56.692435+0000","last_active":"2024-04-17T19:47:01.713775+0000","last_peered":"2024-04-17T19:47:01.713775+0000","last_clean":"2024-04-17T19:47:01.713775+0000","last_became_active":"2024-04-17T19:46:56.692038+0000","last_became_peered":"2024-04-17T19:46:56.692038+0000","last_unstale":"2024-04-17T19:47:01.713775+0000","last_undegraded":"2024-04-17T19:47:01.713775+0000","last_fullsized":"2024-04-17T19:47:01.713775+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_clean_scrub_stamp":"2024-04-17T19:46:55.648649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:06:56.889266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.10","version":"25'10","reported_seq":32,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T19:47:22.800243+0000","last_change":"2024-04-17T19:46:55.692188+0000","last_active":"2024-04-17T19:47:22.800243+0000","last_peered":"2024-04-17T19:47:22.800243+0000","last_clean":"2024-04-17T19:47:22.800243+0000","last_became_active":"2024-04-17T19:46:55.691286+0000","last_became_peered":"2024-04-17T19:46:55.691286+0000","last_unstale":"2024-04-17T19:47:22.800243+0000","last_undegraded":"2024-04-17T19:47:22.800243+0000","last_fullsized":"2024-04-17T19:47:22.800243+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:54.640133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:54.640133+0000","last_clean_scrub_stamp":"2024-04-17T19:46:54.640133+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:01:11.327106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T19:47:01.718903+0000","last_change":"2024-04-17T19:47:00.781167+0000","last_active":"2024-04-17T19:47:01.718903+0000","last_peered":"2024-04-17T19:47:01.718903+0000","last_clean":"2024-04-17T19:47:01.718903+0000","last_became_active":"2024-04-17T19:47:00.780167+0000","last_became_peered":"2024-04-17T19:47:00.780167+0000","last_unstale":"2024-04-17T19:47:01.718903+0000","last_undegraded":"2024-04-17T19:47:01.718903+0000","last_fullsized":"2024-04-17T19:47:01.718903+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_clean_scrub_stamp":"2024-04-17T19:46:59.695482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T00:07:51.831352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1,6],"acting":[5,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T19:47:02.879680+0000","last_change":"2024-04-17T19:46:56.676150+0000","last_active":"2024-04-17T19:47:02.879680+0000","last_peered":"2024-04-17T19:47:02.879680+0000","last_clean":"2024-04-17T19:47:02.879680+0000","last_became_active":"2024-04-17T19:46:56.675826+0000","last_became_peered":"2024-04-17T19:46:56.675826+0000","last_unstale":"2024-04-17T19:47:02.879680+0000","last_undegraded":"2024-04-17T19:47:02.879680+0000","last_fullsized":"2024-04-17T19:47:02.879680+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_clean_scrub_stamp":"2024-04-17T19:46:55.648649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T04:52:17.017088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T19:47:02.723099+0000","last_change":"2024-04-17T19:46:55.682001+0000","last_active":"2024-04-17T19:47:02.723099+0000","last_peered":"2024-04-17T19:47:02.723099+0000","last_clean":"2024-04-17T19:47:02.723099+0000","last_became_active":"2024-04-17T19:46:55.681607+0000","last_became_peered":"2024-04-17T19:46:55.681607+0000","last_unstale":"2024-04-17T19:47:02.723099+0000","last_undegraded":"2024-04-17T19:47:02.723099+0000","last_fullsized":"2024-04-17T19:47:02.723099+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:54.640133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:54.640133+0000","last_clean_scrub_stamp":"2024-04-17T19:46:54.640133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T04:43:37.994081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T19:47:01.717753+0000","last_change":"2024-04-17T19:47:00.756396+0000","last_active":"2024-04-17T19:47:01.717753+0000","last_peered":"2024-04-17T19:47:01.717753+0000","last_clean":"2024-04-17T19:47:01.717753+0000","last_became_active":"2024-04-17T19:47:00.755282+0000","last_became_peered":"2024-04-17T19:47:00.755282+0000","last_unstale":"2024-04-17T19:47:01.717753+0000","last_undegraded":"2024-04-17T19:47:01.717753+0000","last_fullsized":"2024-04-17T19:47:01.717753+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_clean_scrub_stamp":"2024-04-17T19:46:59.695482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:08:25.082826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6,4],"acting":[5,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T19:47:01.714233+0000","last_change":"2024-04-17T19:46:56.694764+0000","last_active":"2024-04-17T19:47:01.714233+0000","last_peered":"2024-04-17T19:47:01.714233+0000","last_clean":"2024-04-17T19:47:01.714233+0000","last_became_active":"2024-04-17T19:46:56.694449+0000","last_became_peered":"2024-04-17T19:46:56.694449+0000","last_unstale":"2024-04-17T19:47:01.714233+0000","last_undegraded":"2024-04-17T19:47:01.714233+0000","last_fullsized":"2024-04-17T19:47:01.714233+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_clean_scrub_stamp":"2024-04-17T19:46:55.648649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T02:53:14.607908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.12","version":"25'3","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T19:47:22.804537+0000","last_change":"2024-04-17T19:46:55.689900+0000","last_active":"2024-04-17T19:47:22.804537+0000","last_peered":"2024-04-17T19:47:22.804537+0000","last_clean":"2024-04-17T19:47:22.804537+0000","last_became_active":"2024-04-17T19:46:55.689607+0000","last_became_peered":"2024-04-17T19:46:55.689607+0000","last_unstale":"2024-04-17T19:47:22.804537+0000","last_undegraded":"2024-04-17T19:47:22.804537+0000","last_fullsized":"2024-04-17T19:47:22.804537+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:54.640133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:54.640133+0000","last_clean_scrub_stamp":"2024-04-17T19:46:54.640133+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:59:16.433023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T19:47:02.884022+0000","last_change":"2024-04-17T19:47:00.786434+0000","last_active":"2024-04-17T19:47:02.884022+0000","last_peered":"2024-04-17T19:47:02.884022+0000","last_clean":"2024-04-17T19:47:02.884022+0000","last_became_active":"2024-04-17T19:47:00.781025+0000","last_became_peered":"2024-04-17T19:47:00.781025+0000","last_unstale":"2024-04-17T19:47:02.884022+0000","last_undegraded":"2024-04-17T19:47:02.884022+0000","last_fullsized":"2024-04-17T19:47:02.884022+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_clean_scrub_stamp":"2024-04-17T19:46:59.695482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:51:07.602172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0,7],"acting":[6,4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T19:47:02.881470+0000","last_change":"2024-04-17T19:46:56.693555+0000","last_active":"2024-04-17T19:47:02.881470+0000","last_peered":"2024-04-17T19:47:02.881470+0000","last_clean":"2024-04-17T19:47:02.881470+0000","last_became_active":"2024-04-17T19:46:56.687385+0000","last_became_peered":"2024-04-17T19:46:56.687385+0000","last_unstale":"2024-04-17T19:47:02.881470+0000","last_undegraded":"2024-04-17T19:47:02.881470+0000","last_fullsized":"2024-04-17T19:47:02.881470+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_clean_scrub_stamp":"2024-04-17T19:46:55.648649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T05:52:33.559392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"25'4","reported_seq":26,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T19:47:22.801932+0000","last_change":"2024-04-17T19:46:55.700010+0000","last_active":"2024-04-17T19:47:22.801932+0000","last_peered":"2024-04-17T19:47:22.801932+0000","last_clean":"2024-04-17T19:47:22.801932+0000","last_became_active":"2024-04-17T19:46:55.698962+0000","last_became_peered":"2024-04-17T19:46:55.698962+0000","last_unstale":"2024-04-17T19:47:22.801932+0000","last_undegraded":"2024-04-17T19:47:22.801932+0000","last_fullsized":"2024-04-17T19:47:22.801932+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:54.640133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:54.640133+0000","last_clean_scrub_stamp":"2024-04-17T19:46:54.640133+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T01:25:12.780134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T19:47:01.714898+0000","last_change":"2024-04-17T19:47:00.760341+0000","last_active":"2024-04-17T19:47:01.714898+0000","last_peered":"2024-04-17T19:47:01.714898+0000","last_clean":"2024-04-17T19:47:01.714898+0000","last_became_active":"2024-04-17T19:47:00.759892+0000","last_became_peered":"2024-04-17T19:47:00.759892+0000","last_unstale":"2024-04-17T19:47:01.714898+0000","last_undegraded":"2024-04-17T19:47:01.714898+0000","last_fullsized":"2024-04-17T19:47:01.714898+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_clean_scrub_stamp":"2024-04-17T19:46:59.695482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T05:15:30.939022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5,6],"acting":[3,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T19:47:02.723476+0000","last_change":"2024-04-17T19:46:56.696716+0000","last_active":"2024-04-17T19:47:02.723476+0000","last_peered":"2024-04-17T19:47:02.723476+0000","last_clean":"2024-04-17T19:47:02.723476+0000","last_became_active":"2024-04-17T19:46:56.696355+0000","last_became_peered":"2024-04-17T19:46:56.696355+0000","last_unstale":"2024-04-17T19:47:02.723476+0000","last_undegraded":"2024-04-17T19:47:02.723476+0000","last_fullsized":"2024-04-17T19:47:02.723476+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_clean_scrub_stamp":"2024-04-17T19:46:55.648649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:06:56.889266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.14","version":"25'11","reported_seq":33,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T19:47:22.805405+0000","last_change":"2024-04-17T19:46:55.697242+0000","last_active":"2024-04-17T19:47:22.805405+0000","last_peered":"2024-04-17T19:47:22.805405+0000","last_clean":"2024-04-17T19:47:22.805405+0000","last_became_active":"2024-04-17T19:46:55.696876+0000","last_became_peered":"2024-04-17T19:46:55.696876+0000","last_unstale":"2024-04-17T19:47:22.805405+0000","last_undegraded":"2024-04-17T19:47:22.805405+0000","last_fullsized":"2024-04-17T19:47:22.805405+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:54.640133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:54.640133+0000","last_clean_scrub_stamp":"2024-04-17T19:46:54.640133+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:24:28.029324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3842,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T19:47:01.717017+0000","last_change":"2024-04-17T19:47:00.743810+0000","last_active":"2024-04-17T19:47:01.717017+0000","last_peered":"2024-04-17T19:47:01.717017+0000","last_clean":"2024-04-17T19:47:01.717017+0000","last_became_active":"2024-04-17T19:47:00.742290+0000","last_became_peered":"2024-04-17T19:47:00.742290+0000","last_unstale":"2024-04-17T19:47:01.717017+0000","last_undegraded":"2024-04-17T19:47:01.717017+0000","last_fullsized":"2024-04-17T19:47:01.717017+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_clean_scrub_stamp":"2024-04-17T19:46:59.695482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T04:20:00.039224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,5,0],"acting":[4,3,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T19:47:01.714061+0000","last_change":"2024-04-17T19:46:56.680527+0000","last_active":"2024-04-17T19:47:01.714061+0000","last_peered":"2024-04-17T19:47:01.714061+0000","last_clean":"2024-04-17T19:47:01.714061+0000","last_became_active":"2024-04-17T19:46:56.680171+0000","last_became_peered":"2024-04-17T19:46:56.680171+0000","last_unstale":"2024-04-17T19:47:01.714061+0000","last_undegraded":"2024-04-17T19:47:01.714061+0000","last_fullsized":"2024-04-17T19:47:01.714061+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_clean_scrub_stamp":"2024-04-17T19:46:55.648649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T07:11:10.748292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.15","version":"25'4","reported_seq":26,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T19:47:02.883994+0000","last_change":"2024-04-17T19:46:55.707717+0000","last_active":"2024-04-17T19:47:02.883994+0000","last_peered":"2024-04-17T19:47:02.883994+0000","last_clean":"2024-04-17T19:47:02.883994+0000","last_became_active":"2024-04-17T19:46:55.706967+0000","last_became_peered":"2024-04-17T19:46:55.706967+0000","last_unstale":"2024-04-17T19:47:02.883994+0000","last_undegraded":"2024-04-17T19:47:02.883994+0000","last_fullsized":"2024-04-17T19:47:02.883994+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:54.640133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:54.640133+0000","last_clean_scrub_stamp":"2024-04-17T19:46:54.640133+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T05:10:04.380307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T19:47:01.870166+0000","last_change":"2024-04-17T19:47:00.758723+0000","last_active":"2024-04-17T19:47:01.870166+0000","last_peered":"2024-04-17T19:47:01.870166+0000","last_clean":"2024-04-17T19:47:01.870166+0000","last_became_active":"2024-04-17T19:47:00.758209+0000","last_became_peered":"2024-04-17T19:47:00.758209+0000","last_unstale":"2024-04-17T19:47:01.870166+0000","last_undegraded":"2024-04-17T19:47:01.870166+0000","last_fullsized":"2024-04-17T19:47:01.870166+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_clean_scrub_stamp":"2024-04-17T19:46:59.695482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T04:48:47.816818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1,7],"acting":[2,3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T19:47:01.718073+0000","last_change":"2024-04-17T19:46:56.684067+0000","last_active":"2024-04-17T19:47:01.718073+0000","last_peered":"2024-04-17T19:47:01.718073+0000","last_clean":"2024-04-17T19:47:01.718073+0000","last_became_active":"2024-04-17T19:46:56.683685+0000","last_became_peered":"2024-04-17T19:46:56.683685+0000","last_unstale":"2024-04-17T19:47:01.718073+0000","last_undegraded":"2024-04-17T19:47:01.718073+0000","last_fullsized":"2024-04-17T19:47:01.718073+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_clean_scrub_stamp":"2024-04-17T19:46:55.648649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T02:52:38.425163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"25'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T19:47:22.807410+0000","last_change":"2024-04-17T19:46:55.687311+0000","last_active":"2024-04-17T19:47:22.807410+0000","last_peered":"2024-04-17T19:47:22.807410+0000","last_clean":"2024-04-17T19:47:22.807410+0000","last_became_active":"2024-04-17T19:46:55.687019+0000","last_became_peered":"2024-04-17T19:46:55.687019+0000","last_unstale":"2024-04-17T19:47:22.807410+0000","last_undegraded":"2024-04-17T19:47:22.807410+0000","last_fullsized":"2024-04-17T19:47:22.807410+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:54.640133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:54.640133+0000","last_clean_scrub_stamp":"2024-04-17T19:46:54.640133+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T01:53:38.377482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T19:47:02.881723+0000","last_change":"2024-04-17T19:47:00.780072+0000","last_active":"2024-04-17T19:47:02.881723+0000","last_peered":"2024-04-17T19:47:02.881723+0000","last_clean":"2024-04-17T19:47:02.881723+0000","last_became_active":"2024-04-17T19:47:00.777053+0000","last_became_peered":"2024-04-17T19:47:00.777053+0000","last_unstale":"2024-04-17T19:47:02.881723+0000","last_undegraded":"2024-04-17T19:47:02.881723+0000","last_fullsized":"2024-04-17T19:47:02.881723+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_clean_scrub_stamp":"2024-04-17T19:46:59.695482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T22:01:53.910725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,3,2],"acting":[7,1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T19:47:01.870331+0000","last_change":"2024-04-17T19:46:56.692985+0000","last_active":"2024-04-17T19:47:01.870331+0000","last_peered":"2024-04-17T19:47:01.870331+0000","last_clean":"2024-04-17T19:47:01.870331+0000","last_became_active":"2024-04-17T19:46:56.692287+0000","last_became_peered":"2024-04-17T19:46:56.692287+0000","last_unstale":"2024-04-17T19:47:01.870331+0000","last_undegraded":"2024-04-17T19:47:01.870331+0000","last_fullsized":"2024-04-17T19:47:01.870331+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_clean_scrub_stamp":"2024-04-17T19:46:55.648649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:20:50.341776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.17","version":"25'3","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T19:47:22.809845+0000","last_change":"2024-04-17T19:46:55.691681+0000","last_active":"2024-04-17T19:47:22.809845+0000","last_peered":"2024-04-17T19:47:22.809845+0000","last_clean":"2024-04-17T19:47:22.809845+0000","last_became_active":"2024-04-17T19:46:55.691354+0000","last_became_peered":"2024-04-17T19:46:55.691354+0000","last_unstale":"2024-04-17T19:47:22.809845+0000","last_undegraded":"2024-04-17T19:47:22.809845+0000","last_fullsized":"2024-04-17T19:47:22.809845+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:54.640133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:54.640133+0000","last_clean_scrub_stamp":"2024-04-17T19:46:54.640133+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T00:40:58.757373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T19:47:01.716521+0000","last_change":"2024-04-17T19:47:00.764854+0000","last_active":"2024-04-17T19:47:01.716521+0000","last_peered":"2024-04-17T19:47:01.716521+0000","last_clean":"2024-04-17T19:47:01.716521+0000","last_became_active":"2024-04-17T19:47:00.763550+0000","last_became_peered":"2024-04-17T19:47:00.763550+0000","last_unstale":"2024-04-17T19:47:01.716521+0000","last_undegraded":"2024-04-17T19:47:01.716521+0000","last_fullsized":"2024-04-17T19:47:01.716521+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_clean_scrub_stamp":"2024-04-17T19:46:59.695482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T04:26:38.527427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,3,7],"acting":[4,0,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T19:47:01.717807+0000","last_change":"2024-04-17T19:47:00.746028+0000","last_active":"2024-04-17T19:47:01.717807+0000","last_peered":"2024-04-17T19:47:01.717807+0000","last_clean":"2024-04-17T19:47:01.717807+0000","last_became_active":"2024-04-17T19:47:00.744828+0000","last_became_peered":"2024-04-17T19:47:00.744828+0000","last_unstale":"2024-04-17T19:47:01.717807+0000","last_undegraded":"2024-04-17T19:47:01.717807+0000","last_fullsized":"2024-04-17T19:47:01.717807+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_clean_scrub_stamp":"2024-04-17T19:46:59.695482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T22:37:58.836823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,5,3],"acting":[4,1,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T19:47:01.716479+0000","last_change":"2024-04-17T19:46:56.691650+0000","last_active":"2024-04-17T19:47:01.716479+0000","last_peered":"2024-04-17T19:47:01.716479+0000","last_clean":"2024-04-17T19:47:01.716479+0000","last_became_active":"2024-04-17T19:46:56.690810+0000","last_became_peered":"2024-04-17T19:46:56.690810+0000","last_unstale":"2024-04-17T19:47:01.716479+0000","last_undegraded":"2024-04-17T19:47:01.716479+0000","last_fullsized":"2024-04-17T19:47:01.716479+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_clean_scrub_stamp":"2024-04-17T19:46:55.648649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T04:25:07.123916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.18","version":"25'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T19:47:01.714071+0000","last_change":"2024-04-17T19:46:55.691871+0000","last_active":"2024-04-17T19:47:01.714071+0000","last_peered":"2024-04-17T19:47:01.714071+0000","last_clean":"2024-04-17T19:47:01.714071+0000","last_became_active":"2024-04-17T19:46:55.690539+0000","last_became_peered":"2024-04-17T19:46:55.690539+0000","last_unstale":"2024-04-17T19:47:01.714071+0000","last_undegraded":"2024-04-17T19:47:01.714071+0000","last_fullsized":"2024-04-17T19:47:01.714071+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:54.640133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:54.640133+0000","last_clean_scrub_stamp":"2024-04-17T19:46:54.640133+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T04:52:16.008572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T19:47:01.715456+0000","last_change":"2024-04-17T19:47:00.749616+0000","last_active":"2024-04-17T19:47:01.715456+0000","last_peered":"2024-04-17T19:47:01.715456+0000","last_clean":"2024-04-17T19:47:01.715456+0000","last_became_active":"2024-04-17T19:47:00.749061+0000","last_became_peered":"2024-04-17T19:47:00.749061+0000","last_unstale":"2024-04-17T19:47:01.715456+0000","last_undegraded":"2024-04-17T19:47:01.715456+0000","last_fullsized":"2024-04-17T19:47:01.715456+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_clean_scrub_stamp":"2024-04-17T19:46:59.695482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:33:36.676817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5,1],"acting":[3,2,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T19:47:01.715322+0000","last_change":"2024-04-17T19:46:56.692190+0000","last_active":"2024-04-17T19:47:01.715322+0000","last_peered":"2024-04-17T19:47:01.715322+0000","last_clean":"2024-04-17T19:47:01.715322+0000","last_became_active":"2024-04-17T19:46:56.691524+0000","last_became_peered":"2024-04-17T19:46:56.691524+0000","last_unstale":"2024-04-17T19:47:01.715322+0000","last_undegraded":"2024-04-17T19:47:01.715322+0000","last_fullsized":"2024-04-17T19:47:01.715322+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_clean_scrub_stamp":"2024-04-17T19:46:55.648649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:44:38.787541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T19:47:02.880985+0000","last_change":"2024-04-17T19:46:55.700265+0000","last_active":"2024-04-17T19:47:02.880985+0000","last_peered":"2024-04-17T19:47:02.880985+0000","last_clean":"2024-04-17T19:47:02.880985+0000","last_became_active":"2024-04-17T19:46:55.699166+0000","last_became_peered":"2024-04-17T19:46:55.699166+0000","last_unstale":"2024-04-17T19:47:02.880985+0000","last_undegraded":"2024-04-17T19:47:02.880985+0000","last_fullsized":"2024-04-17T19:47:02.880985+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:54.640133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:54.640133+0000","last_clean_scrub_stamp":"2024-04-17T19:46:54.640133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T02:39:08.241534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"24'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T19:47:01.714291+0000","last_change":"2024-04-17T19:46:55.687779+0000","last_active":"2024-04-17T19:47:01.714291+0000","last_peered":"2024-04-17T19:47:01.714291+0000","last_clean":"2024-04-17T19:47:01.714291+0000","last_became_active":"2024-04-17T19:46:55.687401+0000","last_became_peered":"2024-04-17T19:46:55.687401+0000","last_unstale":"2024-04-17T19:47:01.714291+0000","last_undegraded":"2024-04-17T19:47:01.714291+0000","last_fullsized":"2024-04-17T19:47:01.714291+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:54.640133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:54.640133+0000","last_clean_scrub_stamp":"2024-04-17T19:46:54.640133+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:20:49.333260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T19:47:01.716820+0000","last_change":"2024-04-17T19:46:56.691635+0000","last_active":"2024-04-17T19:47:01.716820+0000","last_peered":"2024-04-17T19:47:01.716820+0000","last_clean":"2024-04-17T19:47:01.716820+0000","last_became_active":"2024-04-17T19:46:56.691199+0000","last_became_peered":"2024-04-17T19:46:56.691199+0000","last_unstale":"2024-04-17T19:47:01.716820+0000","last_undegraded":"2024-04-17T19:47:01.716820+0000","last_fullsized":"2024-04-17T19:47:01.716820+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_clean_scrub_stamp":"2024-04-17T19:46:55.648649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:00:10.859769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T19:47:01.717329+0000","last_change":"2024-04-17T19:47:00.776142+0000","last_active":"2024-04-17T19:47:01.717329+0000","last_peered":"2024-04-17T19:47:01.717329+0000","last_clean":"2024-04-17T19:47:01.717329+0000","last_became_active":"2024-04-17T19:47:00.774592+0000","last_became_peered":"2024-04-17T19:47:00.774592+0000","last_unstale":"2024-04-17T19:47:01.717329+0000","last_undegraded":"2024-04-17T19:47:01.717329+0000","last_fullsized":"2024-04-17T19:47:01.717329+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_clean_scrub_stamp":"2024-04-17T19:46:59.695482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:04:03.656402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,7],"acting":[4,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"25'5","reported_seq":27,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T19:47:22.803028+0000","last_change":"2024-04-17T19:46:55.713656+0000","last_active":"2024-04-17T19:47:22.803028+0000","last_peered":"2024-04-17T19:47:22.803028+0000","last_clean":"2024-04-17T19:47:22.803028+0000","last_became_active":"2024-04-17T19:46:55.712982+0000","last_became_peered":"2024-04-17T19:46:55.712982+0000","last_unstale":"2024-04-17T19:47:22.803028+0000","last_undegraded":"2024-04-17T19:47:22.803028+0000","last_fullsized":"2024-04-17T19:47:22.803028+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:54.640133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:54.640133+0000","last_clean_scrub_stamp":"2024-04-17T19:46:54.640133+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:02:52.057635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T19:47:02.879756+0000","last_change":"2024-04-17T19:46:56.681984+0000","last_active":"2024-04-17T19:47:02.879756+0000","last_peered":"2024-04-17T19:47:02.879756+0000","last_clean":"2024-04-17T19:47:02.879756+0000","last_became_active":"2024-04-17T19:46:56.679830+0000","last_became_peered":"2024-04-17T19:46:56.679830+0000","last_unstale":"2024-04-17T19:47:02.879756+0000","last_undegraded":"2024-04-17T19:47:02.879756+0000","last_fullsized":"2024-04-17T19:47:02.879756+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_clean_scrub_stamp":"2024-04-17T19:46:55.648649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:11:01.745657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T19:47:02.883151+0000","last_change":"2024-04-17T19:47:00.777411+0000","last_active":"2024-04-17T19:47:02.883151+0000","last_peered":"2024-04-17T19:47:02.883151+0000","last_clean":"2024-04-17T19:47:02.883151+0000","last_became_active":"2024-04-17T19:47:00.776357+0000","last_became_peered":"2024-04-17T19:47:00.776357+0000","last_unstale":"2024-04-17T19:47:02.883151+0000","last_undegraded":"2024-04-17T19:47:02.883151+0000","last_fullsized":"2024-04-17T19:47:02.883151+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_clean_scrub_stamp":"2024-04-17T19:46:59.695482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:41:22.030097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,1,0],"acting":[7,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T19:47:01.869642+0000","last_change":"2024-04-17T19:46:56.706021+0000","last_active":"2024-04-17T19:47:01.869642+0000","last_peered":"2024-04-17T19:47:01.869642+0000","last_clean":"2024-04-17T19:47:01.869642+0000","last_became_active":"2024-04-17T19:46:56.702724+0000","last_became_peered":"2024-04-17T19:46:56.702724+0000","last_unstale":"2024-04-17T19:47:01.869642+0000","last_undegraded":"2024-04-17T19:47:01.869642+0000","last_fullsized":"2024-04-17T19:47:01.869642+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_clean_scrub_stamp":"2024-04-17T19:46:55.648649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:11:01.745657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T19:47:02.881763+0000","last_change":"2024-04-17T19:46:56.685239+0000","last_active":"2024-04-17T19:47:02.881763+0000","last_peered":"2024-04-17T19:47:02.881763+0000","last_clean":"2024-04-17T19:47:02.881763+0000","last_became_active":"2024-04-17T19:46:56.684771+0000","last_became_peered":"2024-04-17T19:46:56.684771+0000","last_unstale":"2024-04-17T19:47:02.881763+0000","last_undegraded":"2024-04-17T19:47:02.881763+0000","last_fullsized":"2024-04-17T19:47:02.881763+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_clean_scrub_stamp":"2024-04-17T19:46:55.648649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T04:52:17.017088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T19:47:01.713945+0000","last_change":"2024-04-17T19:46:56.686238+0000","last_active":"2024-04-17T19:47:01.713945+0000","last_peered":"2024-04-17T19:47:01.713945+0000","last_clean":"2024-04-17T19:47:01.713945+0000","last_became_active":"2024-04-17T19:46:56.685745+0000","last_became_peered":"2024-04-17T19:46:56.685745+0000","last_unstale":"2024-04-17T19:47:01.713945+0000","last_undegraded":"2024-04-17T19:47:01.713945+0000","last_fullsized":"2024-04-17T19:47:01.713945+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_clean_scrub_stamp":"2024-04-17T19:46:55.648649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:01:01.006486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T19:47:01.716621+0000","last_change":"2024-04-17T19:46:56.675844+0000","last_active":"2024-04-17T19:47:01.716621+0000","last_peered":"2024-04-17T19:47:01.716621+0000","last_clean":"2024-04-17T19:47:01.716621+0000","last_became_active":"2024-04-17T19:46:56.675519+0000","last_became_peered":"2024-04-17T19:46:56.675519+0000","last_unstale":"2024-04-17T19:47:01.716621+0000","last_undegraded":"2024-04-17T19:47:01.716621+0000","last_fullsized":"2024-04-17T19:47:01.716621+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_clean_scrub_stamp":"2024-04-17T19:46:55.648649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T00:46:07.348168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T19:47:02.884195+0000","last_change":"2024-04-17T19:46:56.699663+0000","last_active":"2024-04-17T19:47:02.884195+0000","last_peered":"2024-04-17T19:47:02.884195+0000","last_clean":"2024-04-17T19:47:02.884195+0000","last_became_active":"2024-04-17T19:46:56.699293+0000","last_became_peered":"2024-04-17T19:46:56.699293+0000","last_unstale":"2024-04-17T19:47:02.884195+0000","last_undegraded":"2024-04-17T19:47:02.884195+0000","last_fullsized":"2024-04-17T19:47:02.884195+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_clean_scrub_stamp":"2024-04-17T19:46:55.648649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T22:25:05.172498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T19:47:02.883978+0000","last_change":"2024-04-17T19:46:56.684368+0000","last_active":"2024-04-17T19:47:02.883978+0000","last_peered":"2024-04-17T19:47:02.883978+0000","last_clean":"2024-04-17T19:47:02.883978+0000","last_became_active":"2024-04-17T19:46:56.683963+0000","last_became_peered":"2024-04-17T19:46:56.683963+0000","last_unstale":"2024-04-17T19:47:02.883978+0000","last_undegraded":"2024-04-17T19:47:02.883978+0000","last_fullsized":"2024-04-17T19:47:02.883978+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_clean_scrub_stamp":"2024-04-17T19:46:55.648649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:41:17.983264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T19:47:01.870215+0000","last_change":"2024-04-17T19:46:56.704924+0000","last_active":"2024-04-17T19:47:01.870215+0000","last_peered":"2024-04-17T19:47:01.870215+0000","last_clean":"2024-04-17T19:47:01.870215+0000","last_became_active":"2024-04-17T19:46:56.692688+0000","last_became_peered":"2024-04-17T19:46:56.692688+0000","last_unstale":"2024-04-17T19:47:01.870215+0000","last_undegraded":"2024-04-17T19:47:01.870215+0000","last_fullsized":"2024-04-17T19:47:01.870215+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_clean_scrub_stamp":"2024-04-17T19:46:55.648649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T01:39:33.595213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T19:47:01.717583+0000","last_change":"2024-04-17T19:46:56.685081+0000","last_active":"2024-04-17T19:47:01.717583+0000","last_peered":"2024-04-17T19:47:01.717583+0000","last_clean":"2024-04-17T19:47:01.717583+0000","last_became_active":"2024-04-17T19:46:56.684714+0000","last_became_peered":"2024-04-17T19:46:56.684714+0000","last_unstale":"2024-04-17T19:47:01.717583+0000","last_undegraded":"2024-04-17T19:47:01.717583+0000","last_fullsized":"2024-04-17T19:47:01.717583+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_clean_scrub_stamp":"2024-04-17T19:46:55.648649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T04:26:34.480594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T19:47:01.713823+0000","last_change":"2024-04-17T19:46:56.681089+0000","last_active":"2024-04-17T19:47:01.713823+0000","last_peered":"2024-04-17T19:47:01.713823+0000","last_clean":"2024-04-17T19:47:01.713823+0000","last_became_active":"2024-04-17T19:46:56.679818+0000","last_became_peered":"2024-04-17T19:46:56.679818+0000","last_unstale":"2024-04-17T19:47:01.713823+0000","last_undegraded":"2024-04-17T19:47:01.713823+0000","last_fullsized":"2024-04-17T19:47:01.713823+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_clean_scrub_stamp":"2024-04-17T19:46:55.648649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T01:32:52.608291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T19:47:01.716037+0000","last_change":"2024-04-17T19:46:56.674556+0000","last_active":"2024-04-17T19:47:01.716037+0000","last_peered":"2024-04-17T19:47:01.716037+0000","last_clean":"2024-04-17T19:47:01.716037+0000","last_became_active":"2024-04-17T19:46:56.674164+0000","last_became_peered":"2024-04-17T19:46:56.674164+0000","last_unstale":"2024-04-17T19:47:01.716037+0000","last_undegraded":"2024-04-17T19:47:01.716037+0000","last_fullsized":"2024-04-17T19:47:01.716037+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_clean_scrub_stamp":"2024-04-17T19:46:55.648649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T22:53:45.664676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T19:47:02.879682+0000","last_change":"2024-04-17T19:46:56.697359+0000","last_active":"2024-04-17T19:47:02.879682+0000","last_peered":"2024-04-17T19:47:02.879682+0000","last_clean":"2024-04-17T19:47:02.879682+0000","last_became_active":"2024-04-17T19:46:56.695255+0000","last_became_peered":"2024-04-17T19:46:56.695255+0000","last_unstale":"2024-04-17T19:47:02.879682+0000","last_undegraded":"2024-04-17T19:47:02.879682+0000","last_fullsized":"2024-04-17T19:47:02.879682+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_clean_scrub_stamp":"2024-04-17T19:46:55.648649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T01:53:39.385998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T19:47:01.716676+0000","last_change":"2024-04-17T19:46:56.692366+0000","last_active":"2024-04-17T19:47:01.716676+0000","last_peered":"2024-04-17T19:47:01.716676+0000","last_clean":"2024-04-17T19:47:01.716676+0000","last_became_active":"2024-04-17T19:46:56.691942+0000","last_became_peered":"2024-04-17T19:46:56.691942+0000","last_unstale":"2024-04-17T19:47:01.716676+0000","last_undegraded":"2024-04-17T19:47:01.716676+0000","last_fullsized":"2024-04-17T19:47:01.716676+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_clean_scrub_stamp":"2024-04-17T19:46:55.648649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T02:34:05.358659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T19:47:02.723676+0000","last_change":"2024-04-17T19:46:56.693507+0000","last_active":"2024-04-17T19:47:02.723676+0000","last_peered":"2024-04-17T19:47:02.723676+0000","last_clean":"2024-04-17T19:47:02.723676+0000","last_became_active":"2024-04-17T19:46:56.691938+0000","last_became_peered":"2024-04-17T19:46:56.691938+0000","last_unstale":"2024-04-17T19:47:02.723676+0000","last_undegraded":"2024-04-17T19:47:02.723676+0000","last_fullsized":"2024-04-17T19:47:02.723676+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_clean_scrub_stamp":"2024-04-17T19:46:55.648649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T04:48:43.769985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T19:47:01.715076+0000","last_change":"2024-04-17T19:46:56.700707+0000","last_active":"2024-04-17T19:47:01.715076+0000","last_peered":"2024-04-17T19:47:01.715076+0000","last_clean":"2024-04-17T19:47:01.715076+0000","last_became_active":"2024-04-17T19:46:56.700346+0000","last_became_peered":"2024-04-17T19:46:56.700346+0000","last_unstale":"2024-04-17T19:47:01.715076+0000","last_undegraded":"2024-04-17T19:47:01.715076+0000","last_fullsized":"2024-04-17T19:47:01.715076+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_clean_scrub_stamp":"2024-04-17T19:46:55.648649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:58:35.976326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T19:47:02.883782+0000","last_change":"2024-04-17T19:46:56.705410+0000","last_active":"2024-04-17T19:47:02.883782+0000","last_peered":"2024-04-17T19:47:02.883782+0000","last_clean":"2024-04-17T19:47:02.883782+0000","last_became_active":"2024-04-17T19:46:56.705076+0000","last_became_peered":"2024-04-17T19:46:56.705076+0000","last_unstale":"2024-04-17T19:47:02.883782+0000","last_undegraded":"2024-04-17T19:47:02.883782+0000","last_fullsized":"2024-04-17T19:47:02.883782+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_clean_scrub_stamp":"2024-04-17T19:46:55.648649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T01:53:39.385998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T19:47:01.715553+0000","last_change":"2024-04-17T19:46:56.697436+0000","last_active":"2024-04-17T19:47:01.715553+0000","last_peered":"2024-04-17T19:47:01.715553+0000","last_clean":"2024-04-17T19:47:01.715553+0000","last_became_active":"2024-04-17T19:46:56.696667+0000","last_became_peered":"2024-04-17T19:46:56.696667+0000","last_unstale":"2024-04-17T19:47:01.715553+0000","last_undegraded":"2024-04-17T19:47:01.715553+0000","last_fullsized":"2024-04-17T19:47:01.715553+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_clean_scrub_stamp":"2024-04-17T19:46:55.648649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:54:05.520742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T19:47:01.713821+0000","last_change":"2024-04-17T19:46:56.680847+0000","last_active":"2024-04-17T19:47:01.713821+0000","last_peered":"2024-04-17T19:47:01.713821+0000","last_clean":"2024-04-17T19:47:01.713821+0000","last_became_active":"2024-04-17T19:46:56.680224+0000","last_became_peered":"2024-04-17T19:46:56.680224+0000","last_unstale":"2024-04-17T19:47:01.713821+0000","last_undegraded":"2024-04-17T19:47:01.713821+0000","last_fullsized":"2024-04-17T19:47:01.713821+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_clean_scrub_stamp":"2024-04-17T19:46:55.648649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T04:48:43.769985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T19:47:01.715770+0000","last_change":"2024-04-17T19:46:56.688647+0000","last_active":"2024-04-17T19:47:01.715770+0000","last_peered":"2024-04-17T19:47:01.715770+0000","last_clean":"2024-04-17T19:47:01.715770+0000","last_became_active":"2024-04-17T19:46:56.688294+0000","last_became_peered":"2024-04-17T19:46:56.688294+0000","last_unstale":"2024-04-17T19:47:01.715770+0000","last_undegraded":"2024-04-17T19:47:01.715770+0000","last_fullsized":"2024-04-17T19:47:01.715770+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_clean_scrub_stamp":"2024-04-17T19:46:55.648649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T02:34:05.358659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T19:47:02.881299+0000","last_change":"2024-04-17T19:46:56.686415+0000","last_active":"2024-04-17T19:47:02.881299+0000","last_peered":"2024-04-17T19:47:02.881299+0000","last_clean":"2024-04-17T19:47:02.881299+0000","last_became_active":"2024-04-17T19:46:56.684639+0000","last_became_peered":"2024-04-17T19:46:56.684639+0000","last_unstale":"2024-04-17T19:47:02.881299+0000","last_undegraded":"2024-04-17T19:47:02.881299+0000","last_fullsized":"2024-04-17T19:47:02.881299+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_clean_scrub_stamp":"2024-04-17T19:46:55.648649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:20:50.341776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T19:47:02.882440+0000","last_change":"2024-04-17T19:46:56.694678+0000","last_active":"2024-04-17T19:47:02.882440+0000","last_peered":"2024-04-17T19:47:02.882440+0000","last_clean":"2024-04-17T19:47:02.882440+0000","last_became_active":"2024-04-17T19:46:56.694213+0000","last_became_peered":"2024-04-17T19:46:56.694213+0000","last_unstale":"2024-04-17T19:47:02.882440+0000","last_undegraded":"2024-04-17T19:47:02.882440+0000","last_fullsized":"2024-04-17T19:47:02.882440+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_clean_scrub_stamp":"2024-04-17T19:46:55.648649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:59:17.441539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T19:47:02.723614+0000","last_change":"2024-04-17T19:46:56.693810+0000","last_active":"2024-04-17T19:47:02.723614+0000","last_peered":"2024-04-17T19:47:02.723614+0000","last_clean":"2024-04-17T19:47:02.723614+0000","last_became_active":"2024-04-17T19:46:56.692874+0000","last_became_peered":"2024-04-17T19:46:56.692874+0000","last_unstale":"2024-04-17T19:47:02.723614+0000","last_undegraded":"2024-04-17T19:47:02.723614+0000","last_fullsized":"2024-04-17T19:47:02.723614+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_clean_scrub_stamp":"2024-04-17T19:46:55.648649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:30:27.241267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T19:47:02.723470+0000","last_change":"2024-04-17T19:46:56.700330+0000","last_active":"2024-04-17T19:47:02.723470+0000","last_peered":"2024-04-17T19:47:02.723470+0000","last_clean":"2024-04-17T19:47:02.723470+0000","last_became_active":"2024-04-17T19:46:56.700013+0000","last_became_peered":"2024-04-17T19:46:56.700013+0000","last_unstale":"2024-04-17T19:47:02.723470+0000","last_undegraded":"2024-04-17T19:47:02.723470+0000","last_fullsized":"2024-04-17T19:47:02.723470+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_clean_scrub_stamp":"2024-04-17T19:46:55.648649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:23:16.383918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T19:47:02.723614+0000","last_change":"2024-04-17T19:46:56.709400+0000","last_active":"2024-04-17T19:47:02.723614+0000","last_peered":"2024-04-17T19:47:02.723614+0000","last_clean":"2024-04-17T19:47:02.723614+0000","last_became_active":"2024-04-17T19:46:56.708606+0000","last_became_peered":"2024-04-17T19:46:56.708606+0000","last_unstale":"2024-04-17T19:47:02.723614+0000","last_undegraded":"2024-04-17T19:47:02.723614+0000","last_fullsized":"2024-04-17T19:47:02.723614+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_clean_scrub_stamp":"2024-04-17T19:46:55.648649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T01:46:36.503198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T19:47:02.880442+0000","last_change":"2024-04-17T19:46:56.681267+0000","last_active":"2024-04-17T19:47:02.880442+0000","last_peered":"2024-04-17T19:47:02.880442+0000","last_clean":"2024-04-17T19:47:02.880442+0000","last_became_active":"2024-04-17T19:46:56.680919+0000","last_became_peered":"2024-04-17T19:46:56.680919+0000","last_unstale":"2024-04-17T19:47:02.880442+0000","last_undegraded":"2024-04-17T19:47:02.880442+0000","last_fullsized":"2024-04-17T19:47:02.880442+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_clean_scrub_stamp":"2024-04-17T19:46:55.648649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T01:39:33.595213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T19:47:01.714992+0000","last_change":"2024-04-17T19:46:56.688682+0000","last_active":"2024-04-17T19:47:01.714992+0000","last_peered":"2024-04-17T19:47:01.714992+0000","last_clean":"2024-04-17T19:47:01.714992+0000","last_became_active":"2024-04-17T19:46:56.688320+0000","last_became_peered":"2024-04-17T19:46:56.688320+0000","last_unstale":"2024-04-17T19:47:01.714992+0000","last_undegraded":"2024-04-17T19:47:01.714992+0000","last_fullsized":"2024-04-17T19:47:01.714992+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_clean_scrub_stamp":"2024-04-17T19:46:55.648649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:00:10.859769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T19:47:02.723099+0000","last_change":"2024-04-17T19:46:56.699129+0000","last_active":"2024-04-17T19:47:02.723099+0000","last_peered":"2024-04-17T19:47:02.723099+0000","last_clean":"2024-04-17T19:47:02.723099+0000","last_became_active":"2024-04-17T19:46:56.698840+0000","last_became_peered":"2024-04-17T19:46:56.698840+0000","last_unstale":"2024-04-17T19:47:02.723099+0000","last_undegraded":"2024-04-17T19:47:02.723099+0000","last_fullsized":"2024-04-17T19:47:02.723099+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_clean_scrub_stamp":"2024-04-17T19:46:55.648649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T05:35:47.746622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T19:47:01.870059+0000","last_change":"2024-04-17T19:46:56.705903+0000","last_active":"2024-04-17T19:47:01.870059+0000","last_peered":"2024-04-17T19:47:01.870059+0000","last_clean":"2024-04-17T19:47:01.870059+0000","last_became_active":"2024-04-17T19:46:56.705539+0000","last_became_peered":"2024-04-17T19:46:56.705539+0000","last_unstale":"2024-04-17T19:47:01.870059+0000","last_undegraded":"2024-04-17T19:47:01.870059+0000","last_fullsized":"2024-04-17T19:47:01.870059+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_clean_scrub_stamp":"2024-04-17T19:46:55.648649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:57:40.700986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T19:47:02.723301+0000","last_change":"2024-04-17T19:46:56.694456+0000","last_active":"2024-04-17T19:47:02.723301+0000","last_peered":"2024-04-17T19:47:02.723301+0000","last_clean":"2024-04-17T19:47:02.723301+0000","last_became_active":"2024-04-17T19:46:56.693954+0000","last_became_peered":"2024-04-17T19:46:56.693954+0000","last_unstale":"2024-04-17T19:47:02.723301+0000","last_undegraded":"2024-04-17T19:47:02.723301+0000","last_fullsized":"2024-04-17T19:47:02.723301+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_clean_scrub_stamp":"2024-04-17T19:46:55.648649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:22:33.413402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T19:47:01.869795+0000","last_change":"2024-04-17T19:46:56.706411+0000","last_active":"2024-04-17T19:47:01.869795+0000","last_peered":"2024-04-17T19:47:01.869795+0000","last_clean":"2024-04-17T19:47:01.869795+0000","last_became_active":"2024-04-17T19:46:56.706021+0000","last_became_peered":"2024-04-17T19:46:56.706021+0000","last_unstale":"2024-04-17T19:47:01.869795+0000","last_undegraded":"2024-04-17T19:47:01.869795+0000","last_fullsized":"2024-04-17T19:47:01.869795+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_clean_scrub_stamp":"2024-04-17T19:46:55.648649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T05:52:33.559392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T19:47:01.717212+0000","last_change":"2024-04-17T19:46:56.696930+0000","last_active":"2024-04-17T19:47:01.717212+0000","last_peered":"2024-04-17T19:47:01.717212+0000","last_clean":"2024-04-17T19:47:01.717212+0000","last_became_active":"2024-04-17T19:46:56.696492+0000","last_became_peered":"2024-04-17T19:46:56.696492+0000","last_unstale":"2024-04-17T19:47:01.717212+0000","last_undegraded":"2024-04-17T19:47:01.717212+0000","last_fullsized":"2024-04-17T19:47:01.717212+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_clean_scrub_stamp":"2024-04-17T19:46:55.648649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:43:54.268148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T19:47:01.718855+0000","last_change":"2024-04-17T19:46:56.683448+0000","last_active":"2024-04-17T19:47:01.718855+0000","last_peered":"2024-04-17T19:47:01.718855+0000","last_clean":"2024-04-17T19:47:01.718855+0000","last_became_active":"2024-04-17T19:46:56.682772+0000","last_became_peered":"2024-04-17T19:46:56.682772+0000","last_unstale":"2024-04-17T19:47:01.718855+0000","last_undegraded":"2024-04-17T19:47:01.718855+0000","last_fullsized":"2024-04-17T19:47:01.718855+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_clean_scrub_stamp":"2024-04-17T19:46:55.648649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T22:39:31.496708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T19:47:02.723937+0000","last_change":"2024-04-17T19:46:56.695275+0000","last_active":"2024-04-17T19:47:02.723937+0000","last_peered":"2024-04-17T19:47:02.723937+0000","last_clean":"2024-04-17T19:47:02.723937+0000","last_became_active":"2024-04-17T19:46:56.694743+0000","last_became_peered":"2024-04-17T19:46:56.694743+0000","last_unstale":"2024-04-17T19:47:02.723937+0000","last_undegraded":"2024-04-17T19:47:02.723937+0000","last_fullsized":"2024-04-17T19:47:02.723937+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_clean_scrub_stamp":"2024-04-17T19:46:55.648649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:01:01.006486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":6046,"num_objects":40,"num_object_clones":0,"num_object_copies":80,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":40,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":87,"num_write_kb":30,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":26,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":12092,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":76,"ondisk_log_size":76,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":66496,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509451,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27280,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344560,"statfs":{"total":96636764160,"available":96608829440,"internally_reserved":0,"allocated":266240,"data_stored":101981,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509452,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":266240,"data_stored":102479,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509452,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":256,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":262144,"data_stored":102439,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509452,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27280,"kb_used_data":264,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344560,"statfs":{"total":96636764160,"available":96608829440,"internally_reserved":0,"allocated":270336,"data_stored":105699,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509451,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27340,"kb_used_data":320,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344500,"statfs":{"total":96636764160,"available":96608768000,"internally_reserved":0,"allocated":327680,"data_stored":692295,"data_compressed":33248,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509451,"num_pgs":45,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27280,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344560,"statfs":{"total":96636764160,"available":96608829440,"internally_reserved":0,"allocated":266240,"data_stored":101913,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574860,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27348,"kb_used_data":332,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344492,"statfs":{"total":96636764160,"available":96608759808,"internally_reserved":0,"allocated":339968,"data_stored":692939,"data_compressed":33248,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574860,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27304,"kb_used_data":288,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344536,"statfs":{"total":96636764160,"available":96608804864,"internally_reserved":0,"allocated":294912,"data_stored":107155,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33248,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33248,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":146,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":5298,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":714,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":622,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":706,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-17T19:47:26.375 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-04-17T19:47:26.376 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-04-17T19:47:26.376 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2024-04-17T19:47:26.376 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-04-17T19:47:26.565 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:26.573+0000 7fb5ae200640 1 Processor -- start 2024-04-17T19:47:26.565 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:26.573+0000 7fb5ae200640 1 -- start start 2024-04-17T19:47:26.568 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:26.577+0000 7fb5ae200640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fb5a80ca550 0x7fb5a80ca960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:26.568 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:26.577+0000 7fb5ae200640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fb5a80c3b70 0x7fb5a80c3f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:26.568 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:26.577+0000 7fb5ae200640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb5a815f200 con 0x7fb5a815c6b0 2024-04-17T19:47:26.568 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:26.577+0000 7fb5ae200640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 -- 0x7fb5a80caea0 con 0x7fb5a80ca550 2024-04-17T19:47:26.568 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:26.577+0000 7fb5ae200640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7fb5a815fe10 con 0x7fb5a80c3b70 2024-04-17T19:47:26.568 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:26.577+0000 7fb5a7400640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7fb5a815c6b0 0x7fb5a80c8cb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:44726/0 (socket says 172.21.15.44:44726) 2024-04-17T19:47:26.568 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:26.577+0000 7fb5a7400640 1 -- 172.21.15.44:0/2424621520 learned_addr learned my addr 172.21.15.44:0/2424621520 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-04-17T19:47:26.569 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:26.577+0000 7fb5a7e00640 1 --2- 172.21.15.44:0/2424621520 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fb5a80c3b70 0x7fb5a80c3f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:26.569 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:26.577+0000 7fb59ea00640 1 --2- 172.21.15.44:0/2424621520 >> v2:172.21.15.62:3300/0 conn(0x7fb5a80ca550 0x7fb5a80ca960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:26.569 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:26.577+0000 7fb5a6a00640 1 -- 172.21.15.44:0/2424621520 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1838667965 0 0) 0x7fb5a815f200 con 0x7fb5a815c6b0 2024-04-17T19:47:26.569 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:26.577+0000 7fb5a6a00640 1 -- 172.21.15.44:0/2424621520 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb58c003530 con 0x7fb5a815c6b0 2024-04-17T19:47:26.569 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:26.577+0000 7fb59ea00640 1 -- 172.21.15.44:0/2424621520 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fb5a80c3b70 msgr2=0x7fb5a80c3f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T19:47:26.569 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:26.577+0000 7fb59ea00640 1 --2- 172.21.15.44:0/2424621520 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fb5a80c3b70 0x7fb5a80c3f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:26.569 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:26.577+0000 7fb59ea00640 1 -- 172.21.15.44:0/2424621520 >> v1:172.21.15.44:6789/0 conn(0x7fb5a815c6b0 legacy=0x7fb5a80c8cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:26.569 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:26.577+0000 7fb59ea00640 1 -- 172.21.15.44:0/2424621520 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb5a815f4e0 con 0x7fb5a80ca550 2024-04-17T19:47:26.571 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:26.581+0000 7fb59ea00640 1 --2- 172.21.15.44:0/2424621520 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb5a80ca550 0x7fb5a80ca960 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fb5900097c0 tx=0x7fb59001ec90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f02ef0e272d9517a server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:47:26.571 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:26.581+0000 7fb5a6a00640 1 -- 172.21.15.44:0/2424621520 <== mon.1 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5900b5070 con 0x7fb5a80ca550 2024-04-17T19:47:26.571 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:26.581+0000 7fb5a6a00640 1 -- 172.21.15.44:0/2424621520 <== mon.1 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb5900a8990 con 0x7fb5a80ca550 2024-04-17T19:47:26.571 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:26.581+0000 7fb5a6a00640 1 -- 172.21.15.44:0/2424621520 <== mon.1 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5900a8d60 con 0x7fb5a80ca550 2024-04-17T19:47:26.572 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:26.581+0000 7fb5ae200640 1 -- 172.21.15.44:0/2424621520 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb5a80ca550 msgr2=0x7fb5a80ca960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:26.572 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:26.581+0000 7fb5ae200640 1 --2- 172.21.15.44:0/2424621520 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb5a80ca550 0x7fb5a80ca960 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fb5900097c0 tx=0x7fb59001ec90 comp rx=0 tx=0).stop 2024-04-17T19:47:26.572 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:26.581+0000 7fb5ae200640 1 -- 172.21.15.44:0/2424621520 shutdown_connections 2024-04-17T19:47:26.572 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:26.581+0000 7fb5ae200640 1 --2- 172.21.15.44:0/2424621520 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fb5a80c3b70 0x7fb5a80c3f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:26.572 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:26.581+0000 7fb5ae200640 1 --2- 172.21.15.44:0/2424621520 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb5a80ca550 0x7fb5a80ca960 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:26.572 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:26.581+0000 7fb5ae200640 1 -- 172.21.15.44:0/2424621520 >> 172.21.15.44:0/2424621520 conn(0x7fb5a8073650 msgr2=0x7fb5a8073a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:47:26.572 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:26.581+0000 7fb5ae200640 1 -- 172.21.15.44:0/2424621520 shutdown_connections 2024-04-17T19:47:26.573 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:26.581+0000 7fb5ae200640 1 -- 172.21.15.44:0/2424621520 wait complete. 2024-04-17T19:47:26.574 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:26.581+0000 7fb5ae200640 1 Processor -- start 2024-04-17T19:47:26.574 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:26.581+0000 7fb5ae200640 1 -- start start 2024-04-17T19:47:26.577 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:26.585+0000 7fb5ae200640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb5a80c3b70 0x7fb5a81f5170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:26.577 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:26.585+0000 7fb5ae200640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb5a80ca550 0x7fb5a8158200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:26.577 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:26.585+0000 7fb5ae200640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fb5a815c6b0 0x7fb5a806f9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:26.577 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:26.585+0000 7fb5ae200640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fb5a80c44c0 con 0x7fb5a80c3b70 2024-04-17T19:47:26.577 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:26.585+0000 7fb5ae200640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7fb5a815faa0 con 0x7fb5a80ca550 2024-04-17T19:47:26.578 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:26.585+0000 7fb5ae200640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7fb5a80c93c0 con 0x7fb5a815c6b0 2024-04-17T19:47:26.578 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:26.585+0000 7fb5a7400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb5a80c3b70 0x7fb5a81f5170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:26.578 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:26.585+0000 7fb5a7400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb5a80c3b70 0x7fb5a81f5170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:53072/0 (socket says 172.21.15.44:53072) 2024-04-17T19:47:26.578 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:26.585+0000 7fb5a7400640 1 -- 172.21.15.44:0/664432643 learned_addr learned my addr 172.21.15.44:0/664432643 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-04-17T19:47:26.578 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:26.585+0000 7fb5a7e00640 1 --2- 172.21.15.44:0/664432643 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fb5a815c6b0 0x7fb5a806f9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:26.578 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:26.585+0000 7fb59ea00640 1 --2- 172.21.15.44:0/664432643 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb5a80ca550 0x7fb5a8158200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:26.578 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:26.585+0000 7fb5a7400640 1 -- 172.21.15.44:0/664432643 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fb5a815c6b0 msgr2=0x7fb5a806f9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:26.578 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:26.585+0000 7fb5a7400640 1 --2- 172.21.15.44:0/664432643 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fb5a815c6b0 0x7fb5a806f9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:26.578 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:26.585+0000 7fb5a7400640 1 -- 172.21.15.44:0/664432643 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb5a80ca550 msgr2=0x7fb5a8158200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:26.578 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:26.585+0000 7fb5a7400640 1 --2- 172.21.15.44:0/664432643 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb5a80ca550 0x7fb5a8158200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:26.578 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:26.585+0000 7fb5a7400640 1 -- 172.21.15.44:0/664432643 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb5a8158740 con 0x7fb5a80c3b70 2024-04-17T19:47:26.578 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:26.585+0000 7fb5a7e00640 1 --2- 172.21.15.44:0/664432643 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fb5a815c6b0 0x7fb5a806f9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-17T19:47:26.578 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:26.585+0000 7fb5a7400640 1 --2- 172.21.15.44:0/664432643 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb5a80c3b70 0x7fb5a81f5170 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fb598002240 tx=0x7fb59800cf70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:47:26.579 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:26.585+0000 7fb59fe00640 1 -- 172.21.15.44:0/664432643 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb598017070 con 0x7fb5a80c3b70 2024-04-17T19:47:26.579 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:26.585+0000 7fb59fe00640 1 -- 172.21.15.44:0/664432643 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb59800ac30 con 0x7fb5a80c3b70 2024-04-17T19:47:26.579 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:26.585+0000 7fb59fe00640 1 -- 172.21.15.44:0/664432643 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb598012400 con 0x7fb5a80c3b70 2024-04-17T19:47:26.579 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:26.585+0000 7fb5ae200640 1 -- 172.21.15.44:0/664432643 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb5a81f6080 con 0x7fb5a80c3b70 2024-04-17T19:47:26.579 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:26.585+0000 7fb5ae200640 1 -- 172.21.15.44:0/664432643 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb5a81f5da0 con 0x7fb5a80c3b70 2024-04-17T19:47:26.579 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:26.585+0000 7fb5ae200640 1 -- 172.21.15.44:0/664432643 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb5a804ff10 con 0x7fb5a80c3b70 2024-04-17T19:47:26.579 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:26.589+0000 7fb59fe00640 1 -- 172.21.15.44:0/664432643 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fb59801a070 con 0x7fb5a80c3b70 2024-04-17T19:47:26.580 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:26.589+0000 7fb59fe00640 1 --2- 172.21.15.44:0/664432643 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7fb584068380 0x7fb58406a890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:26.580 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:26.589+0000 7fb59fe00640 1 -- 172.21.15.44:0/664432643 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fb598086970 con 0x7fb5a80c3b70 2024-04-17T19:47:26.580 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:26.589+0000 7fb59ea00640 1 --2- 172.21.15.44:0/664432643 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7fb584068380 0x7fb58406a890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:26.581 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:26.589+0000 7fb59ea00640 1 --2- 172.21.15.44:0/664432643 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7fb584068380 0x7fb58406a890 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fb5900b2000 tx=0x7fb5900aa070 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:47:26.585 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:26.593+0000 7fb59fe00640 1 -- 172.21.15.44:0/664432643 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fb5980565a0 con 0x7fb5a80c3b70 2024-04-17T19:47:26.783 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:26.793+0000 7fb5ae200640 1 -- 172.21.15.44:0/664432643 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7fb5a80c97f0 con 0x7fb5a80c3b70 2024-04-17T19:47:26.783 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:26.793+0000 7fb59fe00640 1 -- 172.21.15.44:0/664432643 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+196 (secure 0 0 0) 0x7fb59805a8a0 con 0x7fb5a80c3b70 2024-04-17T19:47:26.784 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-04-17T19:47:26.784 INFO:teuthology.orchestra.run.smithi044.stdout:{"status":"HEALTH_WARN","checks":{"MDS_UP_LESS_THAN_MAX":{"severity":"HEALTH_WARN","summary":{"message":"1 filesystem is online with fewer MDS than max_mds","count":1},"muted":false}},"mutes":[]} 2024-04-17T19:47:26.786 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:26.793+0000 7fb5ae200640 1 -- 172.21.15.44:0/664432643 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7fb584068380 msgr2=0x7fb58406a890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:26.786 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:26.793+0000 7fb5ae200640 1 --2- 172.21.15.44:0/664432643 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7fb584068380 0x7fb58406a890 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fb5900b2000 tx=0x7fb5900aa070 comp rx=0 tx=0).stop 2024-04-17T19:47:26.786 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:26.793+0000 7fb5ae200640 1 -- 172.21.15.44:0/664432643 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb5a80c3b70 msgr2=0x7fb5a81f5170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:26.786 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:26.793+0000 7fb5ae200640 1 --2- 172.21.15.44:0/664432643 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb5a80c3b70 0x7fb5a81f5170 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fb598002240 tx=0x7fb59800cf70 comp rx=0 tx=0).stop 2024-04-17T19:47:26.786 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:26.793+0000 7fb5ae200640 1 -- 172.21.15.44:0/664432643 shutdown_connections 2024-04-17T19:47:26.786 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:26.793+0000 7fb5ae200640 1 --2- 172.21.15.44:0/664432643 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7fb584068380 0x7fb58406a890 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:26.786 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:26.793+0000 7fb5ae200640 1 --2- 172.21.15.44:0/664432643 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fb5a815c6b0 0x7fb5a806f9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:26.786 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:26.793+0000 7fb5ae200640 1 --2- 172.21.15.44:0/664432643 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb5a80ca550 0x7fb5a8158200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:26.786 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:26.793+0000 7fb5ae200640 1 --2- 172.21.15.44:0/664432643 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb5a80c3b70 0x7fb5a81f5170 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:26.786 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:26.793+0000 7fb5ae200640 1 -- 172.21.15.44:0/664432643 >> 172.21.15.44:0/664432643 conn(0x7fb5a8073650 msgr2=0x7fb5a806cfc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:47:26.787 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:26.793+0000 7fb5ae200640 1 -- 172.21.15.44:0/664432643 shutdown_connections 2024-04-17T19:47:26.787 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:26.793+0000 7fb5ae200640 1 -- 172.21.15.44:0/664432643 wait complete. 2024-04-17T19:47:29.806 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-04-17T19:47:29.972 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:29.981+0000 7f9ff7e00640 1 Processor -- start 2024-04-17T19:47:29.972 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:29.981+0000 7f9ff7e00640 1 -- start start 2024-04-17T19:47:29.974 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:29.981+0000 7f9ff7e00640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f9ff80c5a30 0x7f9ff80c5e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:29.974 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:29.981+0000 7f9ff7e00640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9ff81593b0 con 0x7f9ff8160e50 2024-04-17T19:47:29.974 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:29.981+0000 7f9ff7e00640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9ff80c9030 con 0x7f9ff80c5120 2024-04-17T19:47:29.974 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:29.981+0000 7f9ff7e00640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 -- 0x7f9ff80c6380 con 0x7f9ff80c5a30 2024-04-17T19:47:29.974 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:29.981+0000 7f9fefe00640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f9ff80c5a30 0x7f9ff80c5e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:29.974 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:29.981+0000 7f9ff6a00640 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f9ff80c5120 0x7f9ff815ba80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.44:46282/0 (socket says 172.21.15.44:46282) 2024-04-17T19:47:29.974 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:29.981+0000 7f9ff7400640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f9ff8160e50 0x7f9ff8163270 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:44738/0 (socket says 172.21.15.44:44738) 2024-04-17T19:47:29.974 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:29.981+0000 7f9ff6a00640 1 -- 172.21.15.44:0/3734194515 learned_addr learned my addr 172.21.15.44:0/3734194515 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-04-17T19:47:29.975 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:29.981+0000 7f9fefe00640 1 -- 172.21.15.44:0/3734194515 >> v1:172.21.15.62:6789/0 conn(0x7f9ff80c5120 legacy=0x7f9ff815ba80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:29.975 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:29.981+0000 7f9fefe00640 1 -- 172.21.15.44:0/3734194515 >> v1:172.21.15.44:6789/0 conn(0x7f9ff8160e50 legacy=0x7f9ff8163270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:29.975 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:29.981+0000 7f9ff6000640 1 -- 172.21.15.44:0/3734194515 <== mon.1 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3681236166 0 0) 0x7f9ff80c9030 con 0x7f9ff80c5120 2024-04-17T19:47:29.975 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:29.985+0000 7f9fefe00640 1 -- 172.21.15.44:0/3734194515 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9ff80c7de0 con 0x7f9ff80c5a30 2024-04-17T19:47:29.977 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:29.985+0000 7f9fefe00640 1 --2- 172.21.15.44:0/3734194515 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9ff80c5a30 0x7f9ff80c5e40 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f9fe00097c0 tx=0x7f9fe001c2a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9eeea7e290e81f30 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:47:29.978 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:29.985+0000 7f9ff6000640 1 -- 172.21.15.44:0/3734194515 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9fe00b0070 con 0x7f9ff80c5a30 2024-04-17T19:47:29.978 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:29.985+0000 7f9ff6000640 1 -- 172.21.15.44:0/3734194515 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9fe00ab600 con 0x7f9ff80c5a30 2024-04-17T19:47:29.978 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:29.985+0000 7f9ff6000640 1 -- 172.21.15.44:0/3734194515 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9fe00ab9d0 con 0x7f9ff80c5a30 2024-04-17T19:47:29.979 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:29.985+0000 7f9ff7e00640 1 -- 172.21.15.44:0/3734194515 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9ff80c5a30 msgr2=0x7f9ff80c5e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:29.979 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:29.985+0000 7f9ff7e00640 1 --2- 172.21.15.44:0/3734194515 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9ff80c5a30 0x7f9ff80c5e40 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f9fe00097c0 tx=0x7f9fe001c2a0 comp rx=0 tx=0).stop 2024-04-17T19:47:29.979 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:29.985+0000 7f9ff7e00640 1 -- 172.21.15.44:0/3734194515 shutdown_connections 2024-04-17T19:47:29.979 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:29.985+0000 7f9ff7e00640 1 --2- 172.21.15.44:0/3734194515 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9ff80c5a30 0x7f9ff80c5e40 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:29.979 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:29.985+0000 7f9ff7e00640 1 -- 172.21.15.44:0/3734194515 >> 172.21.15.44:0/3734194515 conn(0x7f9ff806f660 msgr2=0x7f9ff8070f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:47:29.979 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:29.989+0000 7f9ff7e00640 1 -- 172.21.15.44:0/3734194515 shutdown_connections 2024-04-17T19:47:29.979 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:29.989+0000 7f9ff7e00640 1 -- 172.21.15.44:0/3734194515 wait complete. 2024-04-17T19:47:29.981 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:29.989+0000 7f9ff7e00640 1 Processor -- start 2024-04-17T19:47:29.981 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:29.989+0000 7f9ff7e00640 1 -- start start 2024-04-17T19:47:29.983 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:29.989+0000 7f9ff7e00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9ff80c5120 0x7f9ff814bb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:29.983 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:29.989+0000 7f9ff7e00640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f9ff80c5a30 0x7f9ff81557a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:29.983 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:29.989+0000 7f9ff7e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9ff8160e50 0x7f9ff80c97e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:29.983 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:29.989+0000 7f9ff7e00640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f9ff815c190 con 0x7f9ff8160e50 2024-04-17T19:47:29.983 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:29.989+0000 7f9ff7e00640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f9ff80c80c0 con 0x7f9ff80c5120 2024-04-17T19:47:29.983 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:29.989+0000 7f9ff7e00640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7f9ff80c7a30 con 0x7f9ff80c5a30 2024-04-17T19:47:29.983 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:29.989+0000 7f9ff7400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9ff8160e50 0x7f9ff80c97e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:29.983 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:29.993+0000 7f9ff7400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9ff8160e50 0x7f9ff80c97e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:53102/0 (socket says 172.21.15.44:53102) 2024-04-17T19:47:29.984 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:29.993+0000 7f9ff7400640 1 -- 172.21.15.44:0/3389238101 learned_addr learned my addr 172.21.15.44:0/3389238101 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-04-17T19:47:29.984 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:29.993+0000 7f9ff6a00640 1 --2- 172.21.15.44:0/3389238101 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9ff80c5120 0x7f9ff814bb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:29.984 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:29.993+0000 7f9fefe00640 1 --2- 172.21.15.44:0/3389238101 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f9ff80c5a30 0x7f9ff81557a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:29.984 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:29.993+0000 7f9ff7400640 1 -- 172.21.15.44:0/3389238101 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f9ff80c5a30 msgr2=0x7f9ff81557a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:29.984 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:29.993+0000 7f9ff7400640 1 --2- 172.21.15.44:0/3389238101 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f9ff80c5a30 0x7f9ff81557a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:29.984 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:29.993+0000 7f9ff7400640 1 -- 172.21.15.44:0/3389238101 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9ff80c5120 msgr2=0x7f9ff814bb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:29.984 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:29.993+0000 7f9ff7400640 1 --2- 172.21.15.44:0/3389238101 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9ff80c5120 0x7f9ff814bb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:29.984 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:29.993+0000 7f9ff7400640 1 -- 172.21.15.44:0/3389238101 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9ff814c050 con 0x7f9ff8160e50 2024-04-17T19:47:29.984 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:29.993+0000 7f9ff7400640 1 --2- 172.21.15.44:0/3389238101 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9ff8160e50 0x7f9ff80c97e0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f9ff000c8c0 tx=0x7f9ff000cd80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:47:29.985 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:29.993+0000 7f9feea00640 1 -- 172.21.15.44:0/3389238101 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ff0018070 con 0x7f9ff8160e50 2024-04-17T19:47:29.985 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:29.993+0000 7f9feea00640 1 -- 172.21.15.44:0/3389238101 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9ff000a640 con 0x7f9ff8160e50 2024-04-17T19:47:29.985 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:29.993+0000 7f9feea00640 1 -- 172.21.15.44:0/3389238101 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ff000aa30 con 0x7f9ff8160e50 2024-04-17T19:47:29.985 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:29.993+0000 7f9ff7e00640 1 -- 172.21.15.44:0/3389238101 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9ff80cd330 con 0x7f9ff8160e50 2024-04-17T19:47:29.985 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:29.993+0000 7f9ff7e00640 1 -- 172.21.15.44:0/3389238101 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9ff814b5f0 con 0x7f9ff8160e50 2024-04-17T19:47:29.985 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:29.993+0000 7f9ff7e00640 1 -- 172.21.15.44:0/3389238101 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9ff804fea0 con 0x7f9ff8160e50 2024-04-17T19:47:29.986 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:29.993+0000 7f9feea00640 1 -- 172.21.15.44:0/3389238101 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f9ff000abd0 con 0x7f9ff8160e50 2024-04-17T19:47:29.986 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:29.997+0000 7f9feea00640 1 --2- 172.21.15.44:0/3389238101 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f9fd40683b0 0x7f9fd406a8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:29.987 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:29.997+0000 7f9feea00640 1 -- 172.21.15.44:0/3389238101 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f9ff0086360 con 0x7f9ff8160e50 2024-04-17T19:47:29.987 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:29.997+0000 7f9ff6a00640 1 --2- 172.21.15.44:0/3389238101 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f9fd40683b0 0x7f9fd406a8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:29.988 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:29.997+0000 7f9ff6a00640 1 --2- 172.21.15.44:0/3389238101 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f9fd40683b0 0x7f9fd406a8c0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f9fe8000f70 tx=0x7f9fe8007240 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:47:29.991 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:30.001+0000 7f9feea00640 1 -- 172.21.15.44:0/3389238101 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f9ff0055f80 con 0x7f9ff8160e50 2024-04-17T19:47:30.191 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:30.201+0000 7f9ff7e00640 1 -- 172.21.15.44:0/3389238101 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f9ff8156ab0 con 0x7f9ff8160e50 2024-04-17T19:47:30.191 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:30.201+0000 7f9feea00640 1 -- 172.21.15.44:0/3389238101 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+196 (secure 0 0 0) 0x7f9ff005a280 con 0x7f9ff8160e50 2024-04-17T19:47:30.192 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-04-17T19:47:30.192 INFO:teuthology.orchestra.run.smithi044.stdout:{"status":"HEALTH_WARN","checks":{"MDS_UP_LESS_THAN_MAX":{"severity":"HEALTH_WARN","summary":{"message":"1 filesystem is online with fewer MDS than max_mds","count":1},"muted":false}},"mutes":[]} 2024-04-17T19:47:30.194 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:30.201+0000 7f9ff7e00640 1 -- 172.21.15.44:0/3389238101 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f9fd40683b0 msgr2=0x7f9fd406a8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:30.194 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:30.201+0000 7f9ff7e00640 1 --2- 172.21.15.44:0/3389238101 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f9fd40683b0 0x7f9fd406a8c0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f9fe8000f70 tx=0x7f9fe8007240 comp rx=0 tx=0).stop 2024-04-17T19:47:30.194 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:30.201+0000 7f9ff7e00640 1 -- 172.21.15.44:0/3389238101 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9ff8160e50 msgr2=0x7f9ff80c97e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:30.194 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:30.201+0000 7f9ff7e00640 1 --2- 172.21.15.44:0/3389238101 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9ff8160e50 0x7f9ff80c97e0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f9ff000c8c0 tx=0x7f9ff000cd80 comp rx=0 tx=0).stop 2024-04-17T19:47:30.194 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:30.201+0000 7f9ff7e00640 1 -- 172.21.15.44:0/3389238101 shutdown_connections 2024-04-17T19:47:30.194 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:30.201+0000 7f9ff7e00640 1 --2- 172.21.15.44:0/3389238101 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f9fd40683b0 0x7f9fd406a8c0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:30.195 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:30.201+0000 7f9ff7e00640 1 --2- 172.21.15.44:0/3389238101 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f9ff80c5a30 0x7f9ff81557a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:30.195 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:30.201+0000 7f9ff7e00640 1 --2- 172.21.15.44:0/3389238101 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9ff8160e50 0x7f9ff80c97e0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:30.195 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:30.201+0000 7f9ff7e00640 1 --2- 172.21.15.44:0/3389238101 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9ff80c5120 0x7f9ff814bb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:30.195 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:30.201+0000 7f9ff7e00640 1 -- 172.21.15.44:0/3389238101 >> 172.21.15.44:0/3389238101 conn(0x7f9ff806f660 msgr2=0x7f9ff8075110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:47:30.195 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:30.201+0000 7f9ff7e00640 1 -- 172.21.15.44:0/3389238101 shutdown_connections 2024-04-17T19:47:30.195 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:30.201+0000 7f9ff7e00640 1 -- 172.21.15.44:0/3389238101 wait complete. 2024-04-17T19:47:30.321 INFO:tasks.ceph.mds.b.smithi062.stderr:2024-04-17T19:47:30.333+0000 7f319ee9e640 -1 mds.pinger is_rank_lagging: rank=2 was never sent ping request. 2024-04-17T19:47:33.215 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-04-17T19:47:33.380 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:33.389+0000 7f8979200640 1 Processor -- start 2024-04-17T19:47:33.380 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:33.389+0000 7f8979200640 1 -- start start 2024-04-17T19:47:33.383 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:33.389+0000 7f8979200640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f8974159060 0x7f8974152700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:33.383 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:33.389+0000 7f8979200640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f897415bc00 0x7f897415c010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:33.383 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:33.389+0000 7f8979200640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f89740c5830 0x7f89740c5c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:33.383 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:33.389+0000 7f8979200640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 -- 0x7f89740c8410 con 0x7f897415bc00 2024-04-17T19:47:33.383 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:33.389+0000 7f8979200640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 -- 0x7f89740c86f0 con 0x7f8974159060 2024-04-17T19:47:33.383 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:33.389+0000 7f8979200640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7f89740c6180 con 0x7f89740c5830 2024-04-17T19:47:33.383 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:33.389+0000 7f896be00640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f897415bc00 0x7f897415c010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:33.383 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:33.389+0000 7f896be00640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f897415bc00 0x7f897415c010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:53108/0 (socket says 172.21.15.44:53108) 2024-04-17T19:47:33.383 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:33.389+0000 7f896be00640 1 -- 172.21.15.44:0/232651437 learned_addr learned my addr 172.21.15.44:0/232651437 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-04-17T19:47:33.383 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:33.389+0000 7f8971e00640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f8974159060 0x7f8974152700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:33.383 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:33.389+0000 7f8972800640 1 --2- 172.21.15.44:0/232651437 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f89740c5830 0x7f89740c5c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:33.383 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:33.393+0000 7f896be00640 1 -- 172.21.15.44:0/232651437 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f89740c5830 msgr2=0x7f89740c5c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T19:47:33.383 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:33.393+0000 7f896be00640 1 --2- 172.21.15.44:0/232651437 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f89740c5830 0x7f89740c5c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:33.384 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:33.393+0000 7f896be00640 1 -- 172.21.15.44:0/232651437 >> v2:172.21.15.62:3300/0 conn(0x7f8974159060 msgr2=0x7f8974152700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T19:47:33.384 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:33.393+0000 7f896be00640 1 --2- 172.21.15.44:0/232651437 >> v2:172.21.15.62:3300/0 conn(0x7f8974159060 0x7f8974152700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:33.384 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:33.393+0000 7f896be00640 1 -- 172.21.15.44:0/232651437 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f89740c8b80 con 0x7f897415bc00 2024-04-17T19:47:33.384 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:33.393+0000 7f8972800640 1 --2- 172.21.15.44:0/232651437 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f89740c5830 0x7f89740c5c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-17T19:47:33.385 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:33.393+0000 7f896be00640 1 --2- 172.21.15.44:0/232651437 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f897415bc00 0x7f897415c010 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f897406dcc0 tx=0x7f895c01ed10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9fec0b99042d5675 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:47:33.386 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:33.393+0000 7f8971400640 1 -- 172.21.15.44:0/232651437 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f895c0b5070 con 0x7f897415bc00 2024-04-17T19:47:33.386 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:33.393+0000 7f8971400640 1 -- 172.21.15.44:0/232651437 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f895c0a89d0 con 0x7f897415bc00 2024-04-17T19:47:33.386 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:33.393+0000 7f8971400640 1 -- 172.21.15.44:0/232651437 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f895c0a8da0 con 0x7f897415bc00 2024-04-17T19:47:33.387 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:33.397+0000 7f8979200640 1 -- 172.21.15.44:0/232651437 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f897415bc00 msgr2=0x7f897415c010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:33.387 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:33.397+0000 7f8979200640 1 --2- 172.21.15.44:0/232651437 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f897415bc00 0x7f897415c010 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f897406dcc0 tx=0x7f895c01ed10 comp rx=0 tx=0).stop 2024-04-17T19:47:33.387 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:33.397+0000 7f8979200640 1 -- 172.21.15.44:0/232651437 shutdown_connections 2024-04-17T19:47:33.387 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:33.397+0000 7f8979200640 1 --2- 172.21.15.44:0/232651437 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f897415bc00 0x7f897415c010 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:33.387 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:33.397+0000 7f8979200640 1 --2- 172.21.15.44:0/232651437 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f89740c5830 0x7f89740c5c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:33.387 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:33.397+0000 7f8979200640 1 --2- 172.21.15.44:0/232651437 >> v2:172.21.15.62:3300/0 conn(0x7f8974159060 0x7f8974152700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:33.387 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:33.397+0000 7f8979200640 1 -- 172.21.15.44:0/232651437 >> 172.21.15.44:0/232651437 conn(0x7f8974073bb0 msgr2=0x7f897406ce90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:47:33.387 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:33.397+0000 7f8979200640 1 -- 172.21.15.44:0/232651437 shutdown_connections 2024-04-17T19:47:33.387 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:33.397+0000 7f8979200640 1 -- 172.21.15.44:0/232651437 wait complete. 2024-04-17T19:47:33.389 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:33.397+0000 7f8979200640 1 Processor -- start 2024-04-17T19:47:33.389 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:33.397+0000 7f8979200640 1 -- start start 2024-04-17T19:47:33.391 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:33.397+0000 7f8979200640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f89740c5830 0x7f8974146be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:33.391 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:33.397+0000 7f8979200640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f8974159060 0x7f8974145980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:33.391 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:33.397+0000 7f8979200640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f897415bc00 0x7f89741473e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:33.391 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:33.397+0000 7f8979200640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f89740c7aa0 con 0x7f89740c5830 2024-04-17T19:47:33.391 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:33.397+0000 7f8979200640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f89740c77c0 con 0x7f897415bc00 2024-04-17T19:47:33.392 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:33.397+0000 7f8979200640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7f89740c7d80 con 0x7f8974159060 2024-04-17T19:47:33.392 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:33.401+0000 7f8972800640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f897415bc00 0x7f89741473e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:33.392 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:33.401+0000 7f8971e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f89740c5830 0x7f8974146be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:33.392 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:33.401+0000 7f8972800640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f897415bc00 0x7f89741473e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.44:51130/0 (socket says 172.21.15.44:51130) 2024-04-17T19:47:33.392 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:33.401+0000 7f8972800640 1 -- 172.21.15.44:0/457574174 learned_addr learned my addr 172.21.15.44:0/457574174 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-04-17T19:47:33.392 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:33.401+0000 7f896be00640 1 --2- 172.21.15.44:0/457574174 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f8974159060 0x7f8974145980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:33.392 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:33.401+0000 7f8972800640 1 -- 172.21.15.44:0/457574174 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f8974159060 msgr2=0x7f8974145980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:33.392 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:33.401+0000 7f8972800640 1 --2- 172.21.15.44:0/457574174 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f8974159060 0x7f8974145980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:33.392 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:33.401+0000 7f8972800640 1 -- 172.21.15.44:0/457574174 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f89740c5830 msgr2=0x7f8974146be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:33.392 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:33.401+0000 7f8972800640 1 --2- 172.21.15.44:0/457574174 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f89740c5830 0x7f8974146be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:33.392 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:33.401+0000 7f8972800640 1 -- 172.21.15.44:0/457574174 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8974145ec0 con 0x7f897415bc00 2024-04-17T19:47:33.392 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:33.401+0000 7f8971e00640 1 --2- 172.21.15.44:0/457574174 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f89740c5830 0x7f8974146be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-17T19:47:33.392 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:33.401+0000 7f8972800640 1 --2- 172.21.15.44:0/457574174 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f897415bc00 0x7f89741473e0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f896c009c50 tx=0x7f896c00f4a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:47:33.393 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:33.401+0000 7f896a000640 1 -- 172.21.15.44:0/457574174 <== mon.1 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f896c01c070 con 0x7f897415bc00 2024-04-17T19:47:33.393 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:33.401+0000 7f896a000640 1 -- 172.21.15.44:0/457574174 <== mon.1 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f896c0039a0 con 0x7f897415bc00 2024-04-17T19:47:33.393 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:33.401+0000 7f8979200640 1 -- 172.21.15.44:0/457574174 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8974147ed0 con 0x7f897415bc00 2024-04-17T19:47:33.393 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:33.401+0000 7f896a000640 1 -- 172.21.15.44:0/457574174 <== mon.1 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f896c009e60 con 0x7f897415bc00 2024-04-17T19:47:33.393 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:33.401+0000 7f8979200640 1 -- 172.21.15.44:0/457574174 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f89741ee7e0 con 0x7f897415bc00 2024-04-17T19:47:33.393 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:33.401+0000 7f8979200640 1 -- 172.21.15.44:0/457574174 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f897404ff10 con 0x7f897415bc00 2024-04-17T19:47:33.394 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:33.401+0000 7f896a000640 1 -- 172.21.15.44:0/457574174 <== mon.1 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f896c01f070 con 0x7f897415bc00 2024-04-17T19:47:33.395 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:33.405+0000 7f896a000640 1 --2- 172.21.15.44:0/457574174 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f8950068380 0x7f895006a890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:33.395 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:33.405+0000 7f896a000640 1 -- 172.21.15.44:0/457574174 <== mon.1 v2:172.21.15.62:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f896c0892c0 con 0x7f897415bc00 2024-04-17T19:47:33.395 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:33.405+0000 7f8971e00640 1 --2- 172.21.15.44:0/457574174 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f8950068380 0x7f895006a890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:33.396 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:33.405+0000 7f8971e00640 1 --2- 172.21.15.44:0/457574174 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f8950068380 0x7f895006a890 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f89740727c0 tx=0x7f8964009190 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:47:33.408 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:33.417+0000 7f896a000640 1 -- 172.21.15.44:0/457574174 <== mon.1 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f896c012070 con 0x7f897415bc00 2024-04-17T19:47:33.609 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:33.617+0000 7f8979200640 1 -- 172.21.15.44:0/457574174 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f897414d3b0 con 0x7f897415bc00 2024-04-17T19:47:33.610 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:33.617+0000 7f896a000640 1 -- 172.21.15.44:0/457574174 <== mon.1 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+196 (secure 0 0 0) 0x7f896c058e50 con 0x7f897415bc00 2024-04-17T19:47:33.610 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-04-17T19:47:33.610 INFO:teuthology.orchestra.run.smithi044.stdout:{"status":"HEALTH_WARN","checks":{"MDS_UP_LESS_THAN_MAX":{"severity":"HEALTH_WARN","summary":{"message":"1 filesystem is online with fewer MDS than max_mds","count":1},"muted":false}},"mutes":[]} 2024-04-17T19:47:33.612 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:33.621+0000 7f8979200640 1 -- 172.21.15.44:0/457574174 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f8950068380 msgr2=0x7f895006a890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:33.612 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:33.621+0000 7f8979200640 1 --2- 172.21.15.44:0/457574174 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f8950068380 0x7f895006a890 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f89740727c0 tx=0x7f8964009190 comp rx=0 tx=0).stop 2024-04-17T19:47:33.612 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:33.621+0000 7f8979200640 1 -- 172.21.15.44:0/457574174 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f897415bc00 msgr2=0x7f89741473e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:33.612 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:33.621+0000 7f8979200640 1 --2- 172.21.15.44:0/457574174 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f897415bc00 0x7f89741473e0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f896c009c50 tx=0x7f896c00f4a0 comp rx=0 tx=0).stop 2024-04-17T19:47:33.612 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:33.621+0000 7f8979200640 1 -- 172.21.15.44:0/457574174 shutdown_connections 2024-04-17T19:47:33.612 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:33.621+0000 7f8979200640 1 --2- 172.21.15.44:0/457574174 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f8950068380 0x7f895006a890 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:33.613 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:33.621+0000 7f8979200640 1 --2- 172.21.15.44:0/457574174 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f8974159060 0x7f8974145980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:33.613 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:33.621+0000 7f8979200640 1 --2- 172.21.15.44:0/457574174 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f897415bc00 0x7f89741473e0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:33.613 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:33.621+0000 7f8979200640 1 --2- 172.21.15.44:0/457574174 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f89740c5830 0x7f8974146be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:33.613 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:33.621+0000 7f8979200640 1 -- 172.21.15.44:0/457574174 >> 172.21.15.44:0/457574174 conn(0x7f8974073bb0 msgr2=0x7f8974149ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:47:33.613 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:33.621+0000 7f8979200640 1 -- 172.21.15.44:0/457574174 shutdown_connections 2024-04-17T19:47:33.613 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:33.621+0000 7f8979200640 1 -- 172.21.15.44:0/457574174 wait complete. 2024-04-17T19:47:35.322 INFO:tasks.ceph.mds.b.smithi062.stderr:2024-04-17T19:47:35.333+0000 7f319ee9e640 -1 mds.pinger is_rank_lagging: rank=3 was never sent ping request. 2024-04-17T19:47:36.633 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-04-17T19:47:36.801 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:36.809+0000 7f1817c00640 1 Processor -- start 2024-04-17T19:47:36.801 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:36.809+0000 7f1817c00640 1 -- start start 2024-04-17T19:47:36.803 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:36.813+0000 7f1817c00640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f1810152a60 0x7f18100c6920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:36.803 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:36.813+0000 7f1817c00640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1810152e70 con 0x7f1810158eb0 2024-04-17T19:47:36.803 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:36.813+0000 7f1817c00640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f18100c52c0 con 0x7f18101592c0 2024-04-17T19:47:36.803 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:36.813+0000 7f1817c00640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 -- 0x7f18100c8840 con 0x7f1810152a60 2024-04-17T19:47:36.803 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:36.813+0000 7f180fe00640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f1810158eb0 0x7f18100c47c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:41796/0 (socket says 172.21.15.44:41796) 2024-04-17T19:47:36.803 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:36.813+0000 7f180fe00640 1 -- 172.21.15.44:0/2012894415 learned_addr learned my addr 172.21.15.44:0/2012894415 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-04-17T19:47:36.803 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:36.813+0000 7f1815200640 1 --2- 172.21.15.44:0/2012894415 >> v2:172.21.15.62:3300/0 conn(0x7f1810152a60 0x7f18100c6920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:36.804 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:36.813+0000 7f180f400640 1 -- 172.21.15.44:0/2012894415 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1377034458 0 0) 0x7f1810152e70 con 0x7f1810158eb0 2024-04-17T19:47:36.804 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:36.813+0000 7f180f400640 1 -- 172.21.15.44:0/2012894415 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f17f8003530 con 0x7f1810158eb0 2024-04-17T19:47:36.804 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:36.813+0000 7f1815200640 1 -- 172.21.15.44:0/2012894415 >> v1:172.21.15.62:6789/0 conn(0x7f18101592c0 legacy=0x7f1810163100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:36.804 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:36.813+0000 7f1815200640 1 -- 172.21.15.44:0/2012894415 >> v1:172.21.15.44:6789/0 conn(0x7f1810158eb0 legacy=0x7f18100c47c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:36.804 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:36.813+0000 7f1815200640 1 -- 172.21.15.44:0/2012894415 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f18100c8b20 con 0x7f1810152a60 2024-04-17T19:47:36.806 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:36.813+0000 7f1815200640 1 --2- 172.21.15.44:0/2012894415 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1810152a60 0x7f18100c6920 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f18040097c0 tx=0x7f180401ec90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1f405710f5273f9f server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:47:36.807 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:36.817+0000 7f180f400640 1 -- 172.21.15.44:0/2012894415 <== mon.1 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18040b5070 con 0x7f1810152a60 2024-04-17T19:47:36.807 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:36.817+0000 7f180f400640 1 -- 172.21.15.44:0/2012894415 <== mon.1 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f18040a8990 con 0x7f1810152a60 2024-04-17T19:47:36.807 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:36.817+0000 7f180f400640 1 -- 172.21.15.44:0/2012894415 <== mon.1 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18040a8d40 con 0x7f1810152a60 2024-04-17T19:47:36.808 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:36.817+0000 7f1817c00640 1 -- 172.21.15.44:0/2012894415 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1810152a60 msgr2=0x7f18100c6920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:36.808 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:36.817+0000 7f1817c00640 1 --2- 172.21.15.44:0/2012894415 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1810152a60 0x7f18100c6920 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f18040097c0 tx=0x7f180401ec90 comp rx=0 tx=0).stop 2024-04-17T19:47:36.808 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:36.817+0000 7f1817c00640 1 -- 172.21.15.44:0/2012894415 shutdown_connections 2024-04-17T19:47:36.808 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:36.817+0000 7f1817c00640 1 --2- 172.21.15.44:0/2012894415 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1810152a60 0x7f18100c6920 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:36.808 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:36.817+0000 7f1817c00640 1 -- 172.21.15.44:0/2012894415 >> 172.21.15.44:0/2012894415 conn(0x7f181006c380 msgr2=0x7f1810070080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:47:36.808 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:36.817+0000 7f1817c00640 1 -- 172.21.15.44:0/2012894415 shutdown_connections 2024-04-17T19:47:36.808 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:36.817+0000 7f1817c00640 1 -- 172.21.15.44:0/2012894415 wait complete. 2024-04-17T19:47:36.809 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:36.817+0000 7f1817c00640 1 Processor -- start 2024-04-17T19:47:36.810 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:36.817+0000 7f1817c00640 1 -- start start 2024-04-17T19:47:36.813 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:36.821+0000 7f1817c00640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f1810152a60 0x7f1810159f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:36.813 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:36.821+0000 7f1817c00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1810158eb0 0x7f18101514f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:36.813 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:36.821+0000 7f1817c00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f18101592c0 0x7f1810155590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:36.813 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:36.821+0000 7f1817c00640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f1810158990 con 0x7f18101592c0 2024-04-17T19:47:36.813 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:36.821+0000 7f1817c00640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f18100c90e0 con 0x7f1810158eb0 2024-04-17T19:47:36.813 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:36.821+0000 7f1817c00640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7f18100c6e60 con 0x7f1810152a60 2024-04-17T19:47:36.813 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:36.821+0000 7f1815c00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f18101592c0 0x7f1810155590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:36.813 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:36.821+0000 7f1815c00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f18101592c0 0x7f1810155590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:60618/0 (socket says 172.21.15.44:60618) 2024-04-17T19:47:36.813 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:36.821+0000 7f1815c00640 1 -- 172.21.15.44:0/1409990727 learned_addr learned my addr 172.21.15.44:0/1409990727 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-04-17T19:47:36.813 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:36.821+0000 7f180fe00640 1 --2- 172.21.15.44:0/1409990727 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1810158eb0 0x7f18101514f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:36.813 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:36.821+0000 7f1815200640 1 --2- 172.21.15.44:0/1409990727 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f1810152a60 0x7f1810159f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:36.814 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:36.821+0000 7f1815c00640 1 -- 172.21.15.44:0/1409990727 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f1810152a60 msgr2=0x7f1810159f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:36.814 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:36.821+0000 7f1815c00640 1 --2- 172.21.15.44:0/1409990727 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f1810152a60 0x7f1810159f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:36.814 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:36.821+0000 7f1815c00640 1 -- 172.21.15.44:0/1409990727 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1810158eb0 msgr2=0x7f18101514f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:36.814 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:36.821+0000 7f1815c00640 1 --2- 172.21.15.44:0/1409990727 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1810158eb0 0x7f18101514f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:36.814 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:36.821+0000 7f1815c00640 1 -- 172.21.15.44:0/1409990727 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1810157d50 con 0x7f18101592c0 2024-04-17T19:47:36.814 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:36.821+0000 7f1815200640 1 --2- 172.21.15.44:0/1409990727 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f1810152a60 0x7f1810159f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-17T19:47:36.814 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:36.821+0000 7f1815c00640 1 --2- 172.21.15.44:0/1409990727 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f18101592c0 0x7f1810155590 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f180800c760 tx=0x7f180800cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:47:36.814 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:36.821+0000 7f180cc00640 1 -- 172.21.15.44:0/1409990727 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1808003b80 con 0x7f18101592c0 2024-04-17T19:47:36.814 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:36.821+0000 7f180cc00640 1 -- 172.21.15.44:0/1409990727 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1808003d20 con 0x7f18101592c0 2024-04-17T19:47:36.814 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:36.821+0000 7f180cc00640 1 -- 172.21.15.44:0/1409990727 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f180800aa90 con 0x7f18101592c0 2024-04-17T19:47:36.814 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:36.821+0000 7f1817c00640 1 -- 172.21.15.44:0/1409990727 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f181015a490 con 0x7f18101592c0 2024-04-17T19:47:36.814 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:36.821+0000 7f1817c00640 1 -- 172.21.15.44:0/1409990727 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f18101574b0 con 0x7f18101592c0 2024-04-17T19:47:36.815 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:36.821+0000 7f1817c00640 1 -- 172.21.15.44:0/1409990727 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f181004ff10 con 0x7f18101592c0 2024-04-17T19:47:36.815 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:36.825+0000 7f180cc00640 1 -- 172.21.15.44:0/1409990727 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f180800ac30 con 0x7f18101592c0 2024-04-17T19:47:36.816 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:36.825+0000 7f180cc00640 1 --2- 172.21.15.44:0/1409990727 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f17f00683b0 0x7f17f006a8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:36.816 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:36.825+0000 7f180cc00640 1 -- 172.21.15.44:0/1409990727 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f1808086ac0 con 0x7f18101592c0 2024-04-17T19:47:36.816 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:36.825+0000 7f1815200640 1 --2- 172.21.15.44:0/1409990727 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f17f00683b0 0x7f17f006a8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:36.817 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:36.825+0000 7f1815200640 1 --2- 172.21.15.44:0/1409990727 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f17f00683b0 0x7f17f006a8c0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f18040b2000 tx=0x7f18040aa070 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:47:36.820 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:36.829+0000 7f180cc00640 1 -- 172.21.15.44:0/1409990727 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f1808056d30 con 0x7f18101592c0 2024-04-17T19:47:37.027 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:37.037+0000 7f1817c00640 1 -- 172.21.15.44:0/1409990727 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f1810157200 con 0x7f18101592c0 2024-04-17T19:47:37.028 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:37.037+0000 7f180cc00640 1 -- 172.21.15.44:0/1409990727 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+46 (secure 0 0 0) 0x7f1808056630 con 0x7f18101592c0 2024-04-17T19:47:37.028 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-04-17T19:47:37.028 INFO:teuthology.orchestra.run.smithi044.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-04-17T19:47:37.030 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:37.037+0000 7f1817c00640 1 -- 172.21.15.44:0/1409990727 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f17f00683b0 msgr2=0x7f17f006a8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:37.030 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:37.037+0000 7f1817c00640 1 --2- 172.21.15.44:0/1409990727 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f17f00683b0 0x7f17f006a8c0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f18040b2000 tx=0x7f18040aa070 comp rx=0 tx=0).stop 2024-04-17T19:47:37.030 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:37.037+0000 7f1817c00640 1 -- 172.21.15.44:0/1409990727 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f18101592c0 msgr2=0x7f1810155590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:37.030 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:37.037+0000 7f1817c00640 1 --2- 172.21.15.44:0/1409990727 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f18101592c0 0x7f1810155590 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f180800c760 tx=0x7f180800cc20 comp rx=0 tx=0).stop 2024-04-17T19:47:37.030 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:37.037+0000 7f1817c00640 1 -- 172.21.15.44:0/1409990727 shutdown_connections 2024-04-17T19:47:37.030 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:37.037+0000 7f1817c00640 1 --2- 172.21.15.44:0/1409990727 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f17f00683b0 0x7f17f006a8c0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:37.030 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:37.037+0000 7f1817c00640 1 --2- 172.21.15.44:0/1409990727 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f18101592c0 0x7f1810155590 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:37.030 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:37.037+0000 7f1817c00640 1 --2- 172.21.15.44:0/1409990727 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1810158eb0 0x7f18101514f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:37.030 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:37.037+0000 7f1817c00640 1 --2- 172.21.15.44:0/1409990727 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f1810152a60 0x7f1810159f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:37.030 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:37.037+0000 7f1817c00640 1 -- 172.21.15.44:0/1409990727 >> 172.21.15.44:0/1409990727 conn(0x7f181006c380 msgr2=0x7f18100c9f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:47:37.031 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:37.037+0000 7f1817c00640 1 -- 172.21.15.44:0/1409990727 shutdown_connections 2024-04-17T19:47:37.031 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:37.037+0000 7f1817c00640 1 -- 172.21.15.44:0/1409990727 wait complete. 2024-04-17T19:47:37.050 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2024-04-17T19:47:37.050 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-17T19:47:37.202 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:37.209+0000 7f9137c00640 1 Processor -- start 2024-04-17T19:47:37.202 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:37.209+0000 7f9137c00640 1 -- start start 2024-04-17T19:47:37.204 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:37.213+0000 7f9137c00640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f9130152a60 0x7f91300c6920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:37.204 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:37.213+0000 7f9137c00640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f9130158eb0 0x7f91301592c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:37.204 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:37.213+0000 7f9137c00640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f91300c47c0 0x7f91300c4bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:37.204 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:37.213+0000 7f9137c00640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 -- 0x7f9130152e70 con 0x7f9130152a60 2024-04-17T19:47:37.204 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:37.213+0000 7f9137c00640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 -- 0x7f91300c52c0 con 0x7f91300c47c0 2024-04-17T19:47:37.205 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:37.213+0000 7f9137c00640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7f91300c8840 con 0x7f9130158eb0 2024-04-17T19:47:37.205 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:37.213+0000 7f9135200640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f9130152a60 0x7f91300c6920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:37.205 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:37.213+0000 7f9135c00640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f91300c47c0 0x7f91300c4bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:37.205 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:37.213+0000 7f9135200640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f9130152a60 0x7f91300c6920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:60622/0 (socket says 172.21.15.44:60622) 2024-04-17T19:47:37.205 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:37.213+0000 7f9135200640 1 -- 172.21.15.44:0/3401994437 learned_addr learned my addr 172.21.15.44:0/3401994437 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-04-17T19:47:37.205 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:37.213+0000 7f912fe00640 1 --2- 172.21.15.44:0/3401994437 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f9130158eb0 0x7f91301592c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:37.206 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:37.213+0000 7f9135c00640 1 -- 172.21.15.44:0/3401994437 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f9130158eb0 msgr2=0x7f91301592c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T19:47:37.206 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:37.213+0000 7f9135c00640 1 --2- 172.21.15.44:0/3401994437 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f9130158eb0 0x7f91301592c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:37.206 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:37.213+0000 7f9135c00640 1 -- 172.21.15.44:0/3401994437 >> v2:172.21.15.44:3300/0 conn(0x7f9130152a60 msgr2=0x7f91300c6920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T19:47:37.206 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:37.213+0000 7f9135c00640 1 --2- 172.21.15.44:0/3401994437 >> v2:172.21.15.44:3300/0 conn(0x7f9130152a60 0x7f91300c6920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:37.206 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:37.213+0000 7f9135c00640 1 -- 172.21.15.44:0/3401994437 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f91300c8b20 con 0x7f91300c47c0 2024-04-17T19:47:37.206 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:37.213+0000 7f9135200640 1 --2- 172.21.15.44:0/3401994437 >> v2:172.21.15.44:3300/0 conn(0x7f9130152a60 0x7f91300c6920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-17T19:47:37.207 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:37.217+0000 7f9135c00640 1 --2- 172.21.15.44:0/3401994437 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f91300c47c0 0x7f91300c4bd0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f9130156370 tx=0x7f912801f110 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1395605d997e0944 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:47:37.208 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:37.217+0000 7f912f400640 1 -- 172.21.15.44:0/3401994437 <== mon.1 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91280b5070 con 0x7f91300c47c0 2024-04-17T19:47:37.208 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:37.217+0000 7f912f400640 1 -- 172.21.15.44:0/3401994437 <== mon.1 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f91280b0440 con 0x7f91300c47c0 2024-04-17T19:47:37.208 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:37.217+0000 7f912f400640 1 -- 172.21.15.44:0/3401994437 <== mon.1 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91280b0810 con 0x7f91300c47c0 2024-04-17T19:47:37.209 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:37.217+0000 7f9137c00640 1 -- 172.21.15.44:0/3401994437 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f91300c47c0 msgr2=0x7f91300c4bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:37.209 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:37.217+0000 7f9137c00640 1 --2- 172.21.15.44:0/3401994437 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f91300c47c0 0x7f91300c4bd0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f9130156370 tx=0x7f912801f110 comp rx=0 tx=0).stop 2024-04-17T19:47:37.209 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:37.217+0000 7f9137c00640 1 -- 172.21.15.44:0/3401994437 shutdown_connections 2024-04-17T19:47:37.209 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:37.217+0000 7f9137c00640 1 --2- 172.21.15.44:0/3401994437 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f91300c47c0 0x7f91300c4bd0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:37.209 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:37.217+0000 7f9137c00640 1 --2- 172.21.15.44:0/3401994437 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f9130158eb0 0x7f91301592c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:37.209 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:37.217+0000 7f9137c00640 1 --2- 172.21.15.44:0/3401994437 >> v2:172.21.15.44:3300/0 conn(0x7f9130152a60 0x7f91300c6920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:37.209 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:37.217+0000 7f9137c00640 1 -- 172.21.15.44:0/3401994437 >> 172.21.15.44:0/3401994437 conn(0x7f913006c380 msgr2=0x7f9130070080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:47:37.209 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:37.217+0000 7f9137c00640 1 -- 172.21.15.44:0/3401994437 shutdown_connections 2024-04-17T19:47:37.209 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:37.217+0000 7f9137c00640 1 -- 172.21.15.44:0/3401994437 wait complete. 2024-04-17T19:47:37.211 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:37.221+0000 7f9137c00640 1 Processor -- start 2024-04-17T19:47:37.211 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:37.221+0000 7f9137c00640 1 -- start start 2024-04-17T19:47:37.213 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:37.221+0000 7f9137c00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f91300c47c0 0x7f9130154d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:37.213 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:37.221+0000 7f9137c00640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f9130152a60 0x7f91301538d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:37.213 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:37.221+0000 7f9137c00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9130158eb0 0x7f91300c94f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:37.213 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:37.221+0000 7f9137c00640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f9130158990 con 0x7f9130158eb0 2024-04-17T19:47:37.213 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:37.221+0000 7f9137c00640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f91300c90e0 con 0x7f91300c47c0 2024-04-17T19:47:37.213 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:37.221+0000 7f9137c00640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7f91300c6e60 con 0x7f9130152a60 2024-04-17T19:47:37.213 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:37.221+0000 7f9135200640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f91300c47c0 0x7f9130154d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:37.213 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:37.221+0000 7f9135200640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f91300c47c0 0x7f9130154d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.44:48980/0 (socket says 172.21.15.44:48980) 2024-04-17T19:47:37.213 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:37.221+0000 7f9135200640 1 -- 172.21.15.44:0/2496851981 learned_addr learned my addr 172.21.15.44:0/2496851981 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-04-17T19:47:37.213 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:37.221+0000 7f9135c00640 1 --2- 172.21.15.44:0/2496851981 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9130158eb0 0x7f91300c94f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:37.215 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:37.221+0000 7f912fe00640 1 --2- 172.21.15.44:0/2496851981 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f9130152a60 0x7f91301538d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:37.215 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:37.221+0000 7f9135c00640 1 -- 172.21.15.44:0/2496851981 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f9130152a60 msgr2=0x7f91301538d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:37.215 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:37.221+0000 7f9135c00640 1 --2- 172.21.15.44:0/2496851981 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f9130152a60 0x7f91301538d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:37.215 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:37.221+0000 7f9135c00640 1 -- 172.21.15.44:0/2496851981 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f91300c47c0 msgr2=0x7f9130154d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:37.215 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:37.221+0000 7f9135c00640 1 --2- 172.21.15.44:0/2496851981 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f91300c47c0 0x7f9130154d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:37.215 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:37.221+0000 7f9135c00640 1 -- 172.21.15.44:0/2496851981 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f91301552b0 con 0x7f9130158eb0 2024-04-17T19:47:37.215 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:37.221+0000 7f9135c00640 1 --2- 172.21.15.44:0/2496851981 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9130158eb0 0x7f91300c94f0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f91280af000 tx=0x7f912801beb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:47:37.215 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:37.221+0000 7f912cc00640 1 -- 172.21.15.44:0/2496851981 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91280b5050 con 0x7f9130158eb0 2024-04-17T19:47:37.215 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:37.221+0000 7f912cc00640 1 -- 172.21.15.44:0/2496851981 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f91280c1070 con 0x7f9130158eb0 2024-04-17T19:47:37.215 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:37.221+0000 7f912cc00640 1 -- 172.21.15.44:0/2496851981 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9128009450 con 0x7f9130158eb0 2024-04-17T19:47:37.215 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:37.221+0000 7f9137c00640 1 -- 172.21.15.44:0/2496851981 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f91301545b0 con 0x7f9130158eb0 2024-04-17T19:47:37.215 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:37.221+0000 7f9137c00640 1 -- 172.21.15.44:0/2496851981 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f91300cb880 con 0x7f9130158eb0 2024-04-17T19:47:37.216 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:37.225+0000 7f9137c00640 1 -- 172.21.15.44:0/2496851981 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f913004ff10 con 0x7f9130158eb0 2024-04-17T19:47:37.216 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:37.225+0000 7f912cc00640 1 -- 172.21.15.44:0/2496851981 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f91280bc890 con 0x7f9130158eb0 2024-04-17T19:47:37.217 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:37.225+0000 7f912cc00640 1 --2- 172.21.15.44:0/2496851981 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f9110068380 0x7f911006a890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:37.218 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:37.225+0000 7f912cc00640 1 -- 172.21.15.44:0/2496851981 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6619+0+0 (secure 0 0 0) 0x7f91281258a0 con 0x7f9130158eb0 2024-04-17T19:47:37.218 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:37.225+0000 7f9135200640 1 --2- 172.21.15.44:0/2496851981 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f9110068380 0x7f911006a890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:37.219 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:37.229+0000 7f9135200640 1 --2- 172.21.15.44:0/2496851981 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f9110068380 0x7f911006a890 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f912400b8f0 tx=0x7f912400b450 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:47:37.222 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:37.229+0000 7f912cc00640 1 -- 172.21.15.44:0/2496851981 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f9128018c70 con 0x7f9130158eb0 2024-04-17T19:47:37.388 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:37.397+0000 7f9137c00640 1 -- 172.21.15.44:0/2496851981 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f91301563d0 con 0x7f9130158eb0 2024-04-17T19:47:37.390 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:37.397+0000 7f912cc00640 1 -- 172.21.15.44:0/2496851981 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) ==== 74+0+18623 (secure 0 0 0) 0x7f91280f5be0 con 0x7f9130158eb0 2024-04-17T19:47:37.390 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-04-17T19:47:37.390 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":26,"fsid":"703f77ca-79c6-4a66-b576-62c526cb1021","created":"2024-04-17T19:46:30.831994+0000","modified":"2024-04-17T19:47:36.933200+0000","last_up_change":"2024-04-17T19:46:41.988197+0000","last_in_change":"2024-04-17T19:46:33.407430+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-17T19:46:41.940380+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-17T19:46:54.222150+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-17T19:46:55.031694+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-17T19:46:58.707529+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"30520dc6-eea6-43d4-ab60-3ca9e92329dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6800","nonce":1018735925},{"type":"v1","addr":"172.21.15.44:6801","nonce":1018735925}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6802","nonce":1018735925},{"type":"v1","addr":"172.21.15.44:6803","nonce":1018735925}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6806","nonce":1018735925},{"type":"v1","addr":"172.21.15.44:6807","nonce":1018735925}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6804","nonce":1018735925},{"type":"v1","addr":"172.21.15.44:6805","nonce":1018735925}]},"public_addr":"172.21.15.44:6801/1018735925","cluster_addr":"172.21.15.44:6803/1018735925","heartbeat_back_addr":"172.21.15.44:6807/1018735925","heartbeat_front_addr":"172.21.15.44:6805/1018735925","state":["exists","up"]},{"osd":1,"uuid":"079bd511-b6ce-449b-8f11-17b311b12f7c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6817","nonce":1452577434},{"type":"v1","addr":"172.21.15.44:6820","nonce":1452577434}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6823","nonce":1452577434},{"type":"v1","addr":"172.21.15.44:6825","nonce":1452577434}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6830","nonce":1452577434},{"type":"v1","addr":"172.21.15.44:6831","nonce":1452577434}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6828","nonce":1452577434},{"type":"v1","addr":"172.21.15.44:6829","nonce":1452577434}]},"public_addr":"172.21.15.44:6820/1452577434","cluster_addr":"172.21.15.44:6825/1452577434","heartbeat_back_addr":"172.21.15.44:6831/1452577434","heartbeat_front_addr":"172.21.15.44:6829/1452577434","state":["exists","up"]},{"osd":2,"uuid":"34f0b9ab-b1d2-4ee9-841c-f15afbb6bec5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6816","nonce":1160071918},{"type":"v1","addr":"172.21.15.44:6818","nonce":1160071918}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6819","nonce":1160071918},{"type":"v1","addr":"172.21.15.44:6821","nonce":1160071918}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6826","nonce":1160071918},{"type":"v1","addr":"172.21.15.44:6827","nonce":1160071918}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6822","nonce":1160071918},{"type":"v1","addr":"172.21.15.44:6824","nonce":1160071918}]},"public_addr":"172.21.15.44:6818/1160071918","cluster_addr":"172.21.15.44:6821/1160071918","heartbeat_back_addr":"172.21.15.44:6827/1160071918","heartbeat_front_addr":"172.21.15.44:6824/1160071918","state":["exists","up"]},{"osd":3,"uuid":"4740032d-fe34-4b1b-bb85-f430896fc3c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6808","nonce":4236454921},{"type":"v1","addr":"172.21.15.44:6809","nonce":4236454921}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6810","nonce":4236454921},{"type":"v1","addr":"172.21.15.44:6811","nonce":4236454921}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6814","nonce":4236454921},{"type":"v1","addr":"172.21.15.44:6815","nonce":4236454921}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6812","nonce":4236454921},{"type":"v1","addr":"172.21.15.44:6813","nonce":4236454921}]},"public_addr":"172.21.15.44:6809/4236454921","cluster_addr":"172.21.15.44:6811/4236454921","heartbeat_back_addr":"172.21.15.44:6815/4236454921","heartbeat_front_addr":"172.21.15.44:6813/4236454921","state":["exists","up"]},{"osd":4,"uuid":"7dbedb00-302d-4d52-810c-e18839254da1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6800","nonce":2293251376},{"type":"v1","addr":"172.21.15.62:6801","nonce":2293251376}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6802","nonce":2293251376},{"type":"v1","addr":"172.21.15.62:6803","nonce":2293251376}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6806","nonce":2293251376},{"type":"v1","addr":"172.21.15.62:6807","nonce":2293251376}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6804","nonce":2293251376},{"type":"v1","addr":"172.21.15.62:6805","nonce":2293251376}]},"public_addr":"172.21.15.62:6801/2293251376","cluster_addr":"172.21.15.62:6803/2293251376","heartbeat_back_addr":"172.21.15.62:6807/2293251376","heartbeat_front_addr":"172.21.15.62:6805/2293251376","state":["exists","up"]},{"osd":5,"uuid":"38c1e8d9-393d-4f33-a97a-3295cf5c5b07","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6808","nonce":1551020300},{"type":"v1","addr":"172.21.15.62:6809","nonce":1551020300}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6810","nonce":1551020300},{"type":"v1","addr":"172.21.15.62:6811","nonce":1551020300}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6814","nonce":1551020300},{"type":"v1","addr":"172.21.15.62:6815","nonce":1551020300}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6812","nonce":1551020300},{"type":"v1","addr":"172.21.15.62:6813","nonce":1551020300}]},"public_addr":"172.21.15.62:6809/1551020300","cluster_addr":"172.21.15.62:6811/1551020300","heartbeat_back_addr":"172.21.15.62:6815/1551020300","heartbeat_front_addr":"172.21.15.62:6813/1551020300","state":["exists","up"]},{"osd":6,"uuid":"f6ff81c6-f14d-4477-88e3-9116cc5a2992","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6824","nonce":2602310256},{"type":"v1","addr":"172.21.15.62:6825","nonce":2602310256}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6826","nonce":2602310256},{"type":"v1","addr":"172.21.15.62:6827","nonce":2602310256}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6830","nonce":2602310256},{"type":"v1","addr":"172.21.15.62:6831","nonce":2602310256}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6828","nonce":2602310256},{"type":"v1","addr":"172.21.15.62:6829","nonce":2602310256}]},"public_addr":"172.21.15.62:6825/2602310256","cluster_addr":"172.21.15.62:6827/2602310256","heartbeat_back_addr":"172.21.15.62:6831/2602310256","heartbeat_front_addr":"172.21.15.62:6829/2602310256","state":["exists","up"]},{"osd":7,"uuid":"ce395bc3-bcb5-4b94-a523-5bb9df491eca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6816","nonce":2912738359},{"type":"v1","addr":"172.21.15.62:6817","nonce":2912738359}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6818","nonce":2912738359},{"type":"v1","addr":"172.21.15.62:6819","nonce":2912738359}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6822","nonce":2912738359},{"type":"v1","addr":"172.21.15.62:6823","nonce":2912738359}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6820","nonce":2912738359},{"type":"v1","addr":"172.21.15.62:6821","nonce":2912738359}]},"public_addr":"172.21.15.62:6817/2912738359","cluster_addr":"172.21.15.62:6819/2912738359","heartbeat_back_addr":"172.21.15.62:6823/2912738359","heartbeat_front_addr":"172.21.15.62:6821/2912738359","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T19:46:39.302883+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T19:46:39.177705+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T19:46:39.188894+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T19:46:39.313009+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T19:46:38.870508+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T19:46:38.790900+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T19:46:38.979163+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T19:46:38.992348+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.c","mappings":[{"from":0,"to":4}]},{"pgid":"3.15","mappings":[{"from":0,"to":7}]},{"pgid":"4.f","mappings":[{"from":7,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-17T19:47:37.392 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:37.401+0000 7f9137c00640 1 -- 172.21.15.44:0/2496851981 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f9110068380 msgr2=0x7f911006a890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:37.392 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:37.401+0000 7f9137c00640 1 --2- 172.21.15.44:0/2496851981 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f9110068380 0x7f911006a890 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f912400b8f0 tx=0x7f912400b450 comp rx=0 tx=0).stop 2024-04-17T19:47:37.392 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:37.401+0000 7f9137c00640 1 -- 172.21.15.44:0/2496851981 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9130158eb0 msgr2=0x7f91300c94f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:37.392 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:37.401+0000 7f9137c00640 1 --2- 172.21.15.44:0/2496851981 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9130158eb0 0x7f91300c94f0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f91280af000 tx=0x7f912801beb0 comp rx=0 tx=0).stop 2024-04-17T19:47:37.392 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:37.401+0000 7f9137c00640 1 -- 172.21.15.44:0/2496851981 shutdown_connections 2024-04-17T19:47:37.392 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:37.401+0000 7f9137c00640 1 --2- 172.21.15.44:0/2496851981 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f9110068380 0x7f911006a890 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:37.392 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:37.401+0000 7f9137c00640 1 --2- 172.21.15.44:0/2496851981 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f9130152a60 0x7f91301538d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:37.393 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:37.401+0000 7f9137c00640 1 --2- 172.21.15.44:0/2496851981 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9130158eb0 0x7f91300c94f0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:37.393 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:37.401+0000 7f9137c00640 1 --2- 172.21.15.44:0/2496851981 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f91300c47c0 0x7f9130154d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:37.393 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:37.401+0000 7f9137c00640 1 -- 172.21.15.44:0/2496851981 >> 172.21.15.44:0/2496851981 conn(0x7f913006c380 msgr2=0x7f9130075110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:47:37.393 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:37.401+0000 7f9137c00640 1 -- 172.21.15.44:0/2496851981 shutdown_connections 2024-04-17T19:47:37.393 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:37.401+0000 7f9137c00640 1 -- 172.21.15.44:0/2496851981 wait complete. 2024-04-17T19:47:37.412 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-17T19:46:41.940380+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-17T19:46:54.222150+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-17T19:46:55.031694+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-04-17T19:46:58.707529+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-04-17T19:47:37.413 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-17T19:47:37.567 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:37.577+0000 7fa632e00640 1 Processor -- start 2024-04-17T19:47:37.567 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:37.577+0000 7fa632e00640 1 -- start start 2024-04-17T19:47:37.569 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:37.577+0000 7fa632e00640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fa62c072700 0x7fa62c153a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:37.569 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:37.577+0000 7fa632e00640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa62c072d60 con 0x7fa62c0c60e0 2024-04-17T19:47:37.569 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:37.577+0000 7fa632e00640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa62c073810 con 0x7fa62c15a4f0 2024-04-17T19:47:37.569 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:37.577+0000 7fa632e00640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7fa62c072b10 con 0x7fa62c072700 2024-04-17T19:47:37.569 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:37.577+0000 7fa623e00640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7fa62c0c60e0 0x7fa62c159de0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:41812/0 (socket says 172.21.15.44:41812) 2024-04-17T19:47:37.569 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:37.577+0000 7fa623e00640 1 -- 172.21.15.44:0/571199337 learned_addr learned my addr 172.21.15.44:0/571199337 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-04-17T19:47:37.570 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:37.577+0000 7fa62be00640 1 --2- 172.21.15.44:0/571199337 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fa62c072700 0x7fa62c153a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:37.571 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:37.577+0000 7fa62b400640 1 -- 172.21.15.44:0/571199337 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 722809354 0 0) 0x7fa62c072d60 con 0x7fa62c0c60e0 2024-04-17T19:47:37.571 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:37.577+0000 7fa62b400640 1 -- 172.21.15.44:0/571199337 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa610003530 con 0x7fa62c0c60e0 2024-04-17T19:47:37.571 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:37.577+0000 7fa62b400640 1 -- 172.21.15.44:0/571199337 <== mon.1 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 220888965 0 0) 0x7fa62c073810 con 0x7fa62c15a4f0 2024-04-17T19:47:37.571 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:37.577+0000 7fa62b400640 1 -- 172.21.15.44:0/571199337 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa62c072d60 con 0x7fa62c15a4f0 2024-04-17T19:47:37.571 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:37.577+0000 7fa62be00640 1 -- 172.21.15.44:0/571199337 >> v1:172.21.15.62:6789/0 conn(0x7fa62c15a4f0 legacy=0x7fa62c164130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:37.571 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:37.577+0000 7fa62be00640 1 -- 172.21.15.44:0/571199337 >> v1:172.21.15.44:6789/0 conn(0x7fa62c0c60e0 legacy=0x7fa62c159de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:37.571 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:37.577+0000 7fa62b400640 1 -- 172.21.15.44:0/571199337 <== mon.0 v1:172.21.15.44:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2527427619 0 0) 0x7fa610003530 con 0x7fa62c0c60e0 2024-04-17T19:47:37.571 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:37.577+0000 7fa62be00640 1 -- 172.21.15.44:0/571199337 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa62c073af0 con 0x7fa62c072700 2024-04-17T19:47:37.573 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:37.581+0000 7fa62be00640 1 --2- 172.21.15.44:0/571199337 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fa62c072700 0x7fa62c153a00 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fa61c0097f0 tx=0x7fa61c01ebf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b7e1b640278479f4 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:47:37.573 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:37.581+0000 7fa62b400640 1 -- 172.21.15.44:0/571199337 <== mon.2 v2:172.21.15.62:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa61c0b5070 con 0x7fa62c072700 2024-04-17T19:47:37.573 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:37.581+0000 7fa62b400640 1 -- 172.21.15.44:0/571199337 <== mon.2 v2:172.21.15.62:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa61c0a8670 con 0x7fa62c072700 2024-04-17T19:47:37.573 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:37.581+0000 7fa62b400640 1 -- 172.21.15.44:0/571199337 <== mon.2 v2:172.21.15.62:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6140016a0 con 0x7fa62c072700 2024-04-17T19:47:37.574 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:37.581+0000 7fa632e00640 1 -- 172.21.15.44:0/571199337 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fa62c072700 msgr2=0x7fa62c153a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:37.575 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:37.581+0000 7fa632e00640 1 --2- 172.21.15.44:0/571199337 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fa62c072700 0x7fa62c153a00 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fa61c0097f0 tx=0x7fa61c01ebf0 comp rx=0 tx=0).stop 2024-04-17T19:47:37.575 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:37.581+0000 7fa632e00640 1 -- 172.21.15.44:0/571199337 shutdown_connections 2024-04-17T19:47:37.575 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:37.581+0000 7fa632e00640 1 --2- 172.21.15.44:0/571199337 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fa62c072700 0x7fa62c153a00 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:37.575 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:37.581+0000 7fa632e00640 1 -- 172.21.15.44:0/571199337 >> 172.21.15.44:0/571199337 conn(0x7fa62c06c380 msgr2=0x7fa62c070080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:47:37.575 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:37.581+0000 7fa632e00640 1 -- 172.21.15.44:0/571199337 shutdown_connections 2024-04-17T19:47:37.575 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:37.581+0000 7fa632e00640 1 -- 172.21.15.44:0/571199337 wait complete. 2024-04-17T19:47:37.576 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:37.585+0000 7fa632e00640 1 Processor -- start 2024-04-17T19:47:37.577 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:37.585+0000 7fa632e00640 1 -- start start 2024-04-17T19:47:37.579 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:37.585+0000 7fa632e00640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fa62c072700 0x7fa62c157b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:37.579 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:37.585+0000 7fa632e00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa62c0c60e0 0x7fa62c1e8970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:37.580 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:37.585+0000 7fa632e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa62c0ca850 0x7fa62c0cbf70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:37.580 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:37.585+0000 7fa632e00640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fa62c074390 con 0x7fa62c0ca850 2024-04-17T19:47:37.580 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:37.585+0000 7fa632e00640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7fa62c0740b0 con 0x7fa62c0c60e0 2024-04-17T19:47:37.580 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:37.585+0000 7fa632e00640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7fa62c1598c0 con 0x7fa62c072700 2024-04-17T19:47:37.580 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:37.585+0000 7fa630e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa62c0ca850 0x7fa62c0cbf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:37.580 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:37.589+0000 7fa630e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa62c0ca850 0x7fa62c0cbf70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:60648/0 (socket says 172.21.15.44:60648) 2024-04-17T19:47:37.580 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:37.589+0000 7fa630e00640 1 -- 172.21.15.44:0/582024909 learned_addr learned my addr 172.21.15.44:0/582024909 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-04-17T19:47:37.580 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:37.589+0000 7fa62be00640 1 --2- 172.21.15.44:0/582024909 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fa62c072700 0x7fa62c157b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:37.580 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:37.589+0000 7fa623e00640 1 --2- 172.21.15.44:0/582024909 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa62c0c60e0 0x7fa62c1e8970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:37.580 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:37.589+0000 7fa630e00640 1 -- 172.21.15.44:0/582024909 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fa62c072700 msgr2=0x7fa62c157b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:37.580 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:37.589+0000 7fa630e00640 1 --2- 172.21.15.44:0/582024909 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fa62c072700 0x7fa62c157b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:37.580 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:37.589+0000 7fa630e00640 1 -- 172.21.15.44:0/582024909 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa62c0c60e0 msgr2=0x7fa62c1e8970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:37.580 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:37.589+0000 7fa630e00640 1 --2- 172.21.15.44:0/582024909 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa62c0c60e0 0x7fa62c1e8970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:37.580 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:37.589+0000 7fa630e00640 1 -- 172.21.15.44:0/582024909 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa62c1580b0 con 0x7fa62c0ca850 2024-04-17T19:47:37.581 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:37.589+0000 7fa630e00640 1 --2- 172.21.15.44:0/582024909 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa62c0ca850 0x7fa62c0cbf70 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fa62400c760 tx=0x7fa62400cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:47:37.581 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:37.589+0000 7fa628c00640 1 -- 172.21.15.44:0/582024909 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa624003b80 con 0x7fa62c0ca850 2024-04-17T19:47:37.581 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:37.589+0000 7fa632e00640 1 -- 172.21.15.44:0/582024909 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa62c0cb000 con 0x7fa62c0ca850 2024-04-17T19:47:37.581 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:37.589+0000 7fa628c00640 1 -- 172.21.15.44:0/582024909 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa624003d20 con 0x7fa62c0ca850 2024-04-17T19:47:37.581 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:37.589+0000 7fa628c00640 1 -- 172.21.15.44:0/582024909 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa62400aa90 con 0x7fa62c0ca850 2024-04-17T19:47:37.581 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:37.589+0000 7fa632e00640 1 -- 172.21.15.44:0/582024909 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa62c0cb5c0 con 0x7fa62c0ca850 2024-04-17T19:47:37.581 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:37.589+0000 7fa632e00640 1 -- 172.21.15.44:0/582024909 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa62c04ff10 con 0x7fa62c0ca850 2024-04-17T19:47:37.581 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:37.589+0000 7fa628c00640 1 -- 172.21.15.44:0/582024909 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fa62400ac30 con 0x7fa62c0ca850 2024-04-17T19:47:37.583 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:37.593+0000 7fa628c00640 1 --2- 172.21.15.44:0/582024909 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7fa608068380 0x7fa60806a890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:37.583 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:37.593+0000 7fa628c00640 1 -- 172.21.15.44:0/582024909 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6619+0+0 (secure 0 0 0) 0x7fa624086c10 con 0x7fa62c0ca850 2024-04-17T19:47:37.583 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:37.593+0000 7fa62be00640 1 --2- 172.21.15.44:0/582024909 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7fa608068380 0x7fa60806a890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:37.584 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:37.593+0000 7fa62be00640 1 --2- 172.21.15.44:0/582024909 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7fa608068380 0x7fa60806a890 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fa61c0b2000 tx=0x7fa61c008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:47:37.587 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:37.597+0000 7fa628c00640 1 -- 172.21.15.44:0/582024909 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fa624056750 con 0x7fa62c0ca850 2024-04-17T19:47:37.753 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:37.761+0000 7fa632e00640 1 -- 172.21.15.44:0/582024909 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fa62c0c78b0 con 0x7fa62c0ca850 2024-04-17T19:47:37.754 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:37.761+0000 7fa628c00640 1 -- 172.21.15.44:0/582024909 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v26) ==== 93+0+10 (secure 0 0 0) 0x7fa62405aa50 con 0x7fa62c0ca850 2024-04-17T19:47:37.754 INFO:teuthology.orchestra.run.smithi044.stdout:pg_num: 1 2024-04-17T19:47:37.756 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:37.765+0000 7fa632e00640 1 -- 172.21.15.44:0/582024909 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7fa608068380 msgr2=0x7fa60806a890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:37.756 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:37.765+0000 7fa632e00640 1 --2- 172.21.15.44:0/582024909 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7fa608068380 0x7fa60806a890 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fa61c0b2000 tx=0x7fa61c008040 comp rx=0 tx=0).stop 2024-04-17T19:47:37.756 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:37.765+0000 7fa632e00640 1 -- 172.21.15.44:0/582024909 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa62c0ca850 msgr2=0x7fa62c0cbf70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:37.756 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:37.765+0000 7fa632e00640 1 --2- 172.21.15.44:0/582024909 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa62c0ca850 0x7fa62c0cbf70 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fa62400c760 tx=0x7fa62400cc20 comp rx=0 tx=0).stop 2024-04-17T19:47:37.757 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:37.765+0000 7fa632e00640 1 -- 172.21.15.44:0/582024909 shutdown_connections 2024-04-17T19:47:37.757 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:37.765+0000 7fa632e00640 1 --2- 172.21.15.44:0/582024909 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7fa608068380 0x7fa60806a890 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:37.757 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:37.765+0000 7fa632e00640 1 --2- 172.21.15.44:0/582024909 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa62c0ca850 0x7fa62c0cbf70 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:37.757 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:37.765+0000 7fa632e00640 1 --2- 172.21.15.44:0/582024909 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa62c0c60e0 0x7fa62c1e8970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:37.757 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:37.765+0000 7fa632e00640 1 --2- 172.21.15.44:0/582024909 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fa62c072700 0x7fa62c157b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:37.757 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:37.765+0000 7fa632e00640 1 -- 172.21.15.44:0/582024909 >> 172.21.15.44:0/582024909 conn(0x7fa62c06c380 msgr2=0x7fa62c0c8fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:47:37.757 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:37.765+0000 7fa632e00640 1 -- 172.21.15.44:0/582024909 shutdown_connections 2024-04-17T19:47:37.757 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:37.765+0000 7fa632e00640 1 -- 172.21.15.44:0/582024909 wait complete. 2024-04-17T19:47:37.776 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-17T19:47:37.930 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:37.937+0000 7f4d00a00640 1 Processor -- start 2024-04-17T19:47:37.930 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:37.941+0000 7f4d00a00640 1 -- start start 2024-04-17T19:47:37.933 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:37.941+0000 7f4d00a00640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f4cfc0b1ab0 0x7f4cfc0cb030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:37.934 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:37.941+0000 7f4d00a00640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f4cfc1537e0 0x7f4cfc072710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:37.934 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:37.941+0000 7f4d00a00640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4cfc15a230 con 0x7f4cfc072c50 2024-04-17T19:47:37.934 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:37.941+0000 7f4d00a00640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 -- 0x7f4cfc15cda0 con 0x7f4cfc1537e0 2024-04-17T19:47:37.934 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:37.941+0000 7f4d00a00640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 -- 0x7f4cfc15a510 con 0x7f4cfc0b1ab0 2024-04-17T19:47:37.934 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:37.941+0000 7f4cfa800640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f4cfc072c50 0x7f4cfc15d230 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:41824/0 (socket says 172.21.15.44:41824) 2024-04-17T19:47:37.934 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:37.941+0000 7f4cfa800640 1 -- 172.21.15.44:0/3231144065 learned_addr learned my addr 172.21.15.44:0/3231144065 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-04-17T19:47:37.934 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:37.941+0000 7f4cf9400640 1 --2- 172.21.15.44:0/3231144065 >> v2:172.21.15.44:3300/0 conn(0x7f4cfc1537e0 0x7f4cfc072710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:37.934 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:37.941+0000 7f4cf9e00640 1 --2- 172.21.15.44:0/3231144065 >> v2:172.21.15.62:3300/0 conn(0x7f4cfc0b1ab0 0x7f4cfc0cb030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:37.935 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:37.941+0000 7f4cf8a00640 1 -- 172.21.15.44:0/3231144065 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 636041421 0 0) 0x7f4cfc15a230 con 0x7f4cfc072c50 2024-04-17T19:47:37.935 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:37.941+0000 7f4cf8a00640 1 -- 172.21.15.44:0/3231144065 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4ce0003530 con 0x7f4cfc072c50 2024-04-17T19:47:37.935 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:37.941+0000 7f4cf9400640 1 -- 172.21.15.44:0/3231144065 >> v2:172.21.15.62:3300/0 conn(0x7f4cfc0b1ab0 msgr2=0x7f4cfc0cb030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T19:47:37.935 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:37.941+0000 7f4cf9400640 1 --2- 172.21.15.44:0/3231144065 >> v2:172.21.15.62:3300/0 conn(0x7f4cfc0b1ab0 0x7f4cfc0cb030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:37.935 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:37.941+0000 7f4cf9400640 1 -- 172.21.15.44:0/3231144065 >> v1:172.21.15.44:6789/0 conn(0x7f4cfc072c50 legacy=0x7f4cfc15d230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:37.935 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:37.941+0000 7f4cf9400640 1 -- 172.21.15.44:0/3231144065 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4cfc0ca3e0 con 0x7f4cfc1537e0 2024-04-17T19:47:37.937 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:37.945+0000 7f4cf9400640 1 --2- 172.21.15.44:0/3231144065 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4cfc1537e0 0x7f4cfc072710 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f4cfc0c9310 tx=0x7f4ce801ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5790123088f573ef server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:47:37.937 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:37.945+0000 7f4cf8a00640 1 -- 172.21.15.44:0/3231144065 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ce80b5070 con 0x7f4cfc1537e0 2024-04-17T19:47:37.937 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:37.945+0000 7f4cf8a00640 1 -- 172.21.15.44:0/3231144065 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4ce80a8970 con 0x7f4cfc1537e0 2024-04-17T19:47:37.937 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:37.945+0000 7f4cf8a00640 1 -- 172.21.15.44:0/3231144065 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ce80a8d20 con 0x7f4cfc1537e0 2024-04-17T19:47:37.938 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:37.945+0000 7f4d00a00640 1 -- 172.21.15.44:0/3231144065 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4cfc1537e0 msgr2=0x7f4cfc072710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:37.938 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:37.945+0000 7f4d00a00640 1 --2- 172.21.15.44:0/3231144065 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4cfc1537e0 0x7f4cfc072710 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f4cfc0c9310 tx=0x7f4ce801ec70 comp rx=0 tx=0).stop 2024-04-17T19:47:37.938 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:37.945+0000 7f4d00a00640 1 -- 172.21.15.44:0/3231144065 shutdown_connections 2024-04-17T19:47:37.939 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:37.945+0000 7f4d00a00640 1 --2- 172.21.15.44:0/3231144065 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4cfc1537e0 0x7f4cfc072710 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:37.939 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:37.945+0000 7f4d00a00640 1 --2- 172.21.15.44:0/3231144065 >> v2:172.21.15.62:3300/0 conn(0x7f4cfc0b1ab0 0x7f4cfc0cb030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:37.939 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:37.945+0000 7f4d00a00640 1 -- 172.21.15.44:0/3231144065 >> 172.21.15.44:0/3231144065 conn(0x7f4cfc067eb0 msgr2=0x7f4cfc0682c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:47:37.939 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:37.945+0000 7f4d00a00640 1 -- 172.21.15.44:0/3231144065 shutdown_connections 2024-04-17T19:47:37.939 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:37.945+0000 7f4d00a00640 1 -- 172.21.15.44:0/3231144065 wait complete. 2024-04-17T19:47:37.941 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:37.949+0000 7f4d00a00640 1 Processor -- start 2024-04-17T19:47:37.941 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:37.949+0000 7f4d00a00640 1 -- start start 2024-04-17T19:47:37.943 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:37.953+0000 7f4d00a00640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f4cfc072c50 0x7f4cfc15c7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:37.943 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:37.953+0000 7f4d00a00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4cfc0b1ab0 0x7f4cfc14b490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:37.944 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:37.953+0000 7f4d00a00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4cfc1537e0 0x7f4cfc14b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:37.944 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:37.953+0000 7f4d00a00640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f4cfc15d940 con 0x7f4cfc0b1ab0 2024-04-17T19:47:37.944 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:37.953+0000 7f4d00a00640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f4cfc153bf0 con 0x7f4cfc1537e0 2024-04-17T19:47:37.944 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:37.953+0000 7f4d00a00640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7f4cfc15dac0 con 0x7f4cfc072c50 2024-04-17T19:47:37.944 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:37.953+0000 7f4cf9400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4cfc0b1ab0 0x7f4cfc14b490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:37.944 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:37.953+0000 7f4cf9400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4cfc0b1ab0 0x7f4cfc14b490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:60660/0 (socket says 172.21.15.44:60660) 2024-04-17T19:47:37.944 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:37.953+0000 7f4cf9400640 1 -- 172.21.15.44:0/2107187923 learned_addr learned my addr 172.21.15.44:0/2107187923 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-04-17T19:47:37.944 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:37.953+0000 7f4cf9e00640 1 --2- 172.21.15.44:0/2107187923 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f4cfc072c50 0x7f4cfc15c7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:37.944 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:37.953+0000 7f4cfa800640 1 --2- 172.21.15.44:0/2107187923 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4cfc1537e0 0x7f4cfc14b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:37.944 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:37.953+0000 7f4cf9400640 1 -- 172.21.15.44:0/2107187923 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f4cfc072c50 msgr2=0x7f4cfc15c7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:37.944 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:37.953+0000 7f4cf9400640 1 --2- 172.21.15.44:0/2107187923 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f4cfc072c50 0x7f4cfc15c7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:37.944 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:37.953+0000 7f4cf9400640 1 -- 172.21.15.44:0/2107187923 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4cfc1537e0 msgr2=0x7f4cfc14b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:37.944 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:37.953+0000 7f4cf9400640 1 --2- 172.21.15.44:0/2107187923 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4cfc1537e0 0x7f4cfc14b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:37.945 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:37.953+0000 7f4cf9400640 1 -- 172.21.15.44:0/2107187923 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4cfc15b700 con 0x7f4cfc0b1ab0 2024-04-17T19:47:37.945 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:37.953+0000 7f4cf9400640 1 --2- 172.21.15.44:0/2107187923 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4cfc0b1ab0 0x7f4cfc14b490 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f4ce801c8a0 tx=0x7f4ce801ba10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:47:37.945 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:37.953+0000 7f4cf2000640 1 -- 172.21.15.44:0/2107187923 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ce80bf070 con 0x7f4cfc0b1ab0 2024-04-17T19:47:37.945 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:37.953+0000 7f4cf2000640 1 -- 172.21.15.44:0/2107187923 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4ce80b0640 con 0x7f4cfc0b1ab0 2024-04-17T19:47:37.946 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:37.953+0000 7f4cf2000640 1 -- 172.21.15.44:0/2107187923 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ce80b5040 con 0x7f4cfc0b1ab0 2024-04-17T19:47:37.946 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:37.953+0000 7f4d00a00640 1 -- 172.21.15.44:0/2107187923 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4cfc15b9e0 con 0x7f4cfc0b1ab0 2024-04-17T19:47:37.946 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:37.953+0000 7f4d00a00640 1 -- 172.21.15.44:0/2107187923 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4cfc15bfa0 con 0x7f4cfc0b1ab0 2024-04-17T19:47:37.947 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:37.957+0000 7f4d00a00640 1 -- 172.21.15.44:0/2107187923 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4cfc04ff10 con 0x7f4cfc0b1ab0 2024-04-17T19:47:37.948 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:37.957+0000 7f4cf2000640 1 -- 172.21.15.44:0/2107187923 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f4ce80b09f0 con 0x7f4cfc0b1ab0 2024-04-17T19:47:37.949 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:37.957+0000 7f4cf2000640 1 --2- 172.21.15.44:0/2107187923 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f4cdc068380 0x7f4cdc06a890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:37.949 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:37.957+0000 7f4cf2000640 1 -- 172.21.15.44:0/2107187923 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6619+0+0 (secure 0 0 0) 0x7f4ce81234f0 con 0x7f4cfc0b1ab0 2024-04-17T19:47:37.950 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:37.957+0000 7f4cf9e00640 1 --2- 172.21.15.44:0/2107187923 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f4cdc068380 0x7f4cdc06a890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:37.953 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:37.961+0000 7f4cf9e00640 1 --2- 172.21.15.44:0/2107187923 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f4cdc068380 0x7f4cdc06a890 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f4cec009ac0 tx=0x7f4cec009190 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:47:37.954 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:37.961+0000 7f4cf2000640 1 -- 172.21.15.44:0/2107187923 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f4ce80187d0 con 0x7f4cfc0b1ab0 2024-04-17T19:47:38.117 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:38.125+0000 7f4d00a00640 1 -- 172.21.15.44:0/2107187923 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f4cfc0cae10 con 0x7f4cfc0b1ab0 2024-04-17T19:47:38.118 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:38.125+0000 7f4cf2000640 1 -- 172.21.15.44:0/2107187923 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v27) ==== 104+0+11 (secure 0 0 0) 0x7f4ce80f3040 con 0x7f4cfc0b1ab0 2024-04-17T19:47:38.118 INFO:teuthology.orchestra.run.smithi044.stdout:pg_num: 32 2024-04-17T19:47:38.120 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:38.129+0000 7f4d00a00640 1 -- 172.21.15.44:0/2107187923 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f4cdc068380 msgr2=0x7f4cdc06a890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:38.120 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:38.129+0000 7f4d00a00640 1 --2- 172.21.15.44:0/2107187923 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f4cdc068380 0x7f4cdc06a890 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f4cec009ac0 tx=0x7f4cec009190 comp rx=0 tx=0).stop 2024-04-17T19:47:38.121 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:38.129+0000 7f4d00a00640 1 -- 172.21.15.44:0/2107187923 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4cfc0b1ab0 msgr2=0x7f4cfc14b490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:38.121 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:38.129+0000 7f4d00a00640 1 --2- 172.21.15.44:0/2107187923 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4cfc0b1ab0 0x7f4cfc14b490 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f4ce801c8a0 tx=0x7f4ce801ba10 comp rx=0 tx=0).stop 2024-04-17T19:47:38.121 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:38.129+0000 7f4d00a00640 1 -- 172.21.15.44:0/2107187923 shutdown_connections 2024-04-17T19:47:38.121 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:38.129+0000 7f4d00a00640 1 --2- 172.21.15.44:0/2107187923 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f4cdc068380 0x7f4cdc06a890 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:38.121 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:38.129+0000 7f4d00a00640 1 --2- 172.21.15.44:0/2107187923 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4cfc1537e0 0x7f4cfc14b9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:38.121 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:38.129+0000 7f4d00a00640 1 --2- 172.21.15.44:0/2107187923 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4cfc0b1ab0 0x7f4cfc14b490 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:38.121 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:38.129+0000 7f4d00a00640 1 --2- 172.21.15.44:0/2107187923 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f4cfc072c50 0x7f4cfc15c7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:38.121 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:38.129+0000 7f4d00a00640 1 -- 172.21.15.44:0/2107187923 >> 172.21.15.44:0/2107187923 conn(0x7f4cfc067eb0 msgr2=0x7f4cfc0b31f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:47:38.121 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:38.129+0000 7f4d00a00640 1 -- 172.21.15.44:0/2107187923 shutdown_connections 2024-04-17T19:47:38.121 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:38.129+0000 7f4d00a00640 1 -- 172.21.15.44:0/2107187923 wait complete. 2024-04-17T19:47:38.140 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-17T19:47:38.294 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:38.305+0000 7f63ba400640 1 Processor -- start 2024-04-17T19:47:38.295 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:38.305+0000 7f63ba400640 1 -- start start 2024-04-17T19:47:38.297 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:38.305+0000 7f63ba400640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f63b40c7cc0 0x7f63b4072e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:38.297 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:38.305+0000 7f63ba400640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f63b40c47c0 0x7f63b40733c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:38.297 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:38.305+0000 7f63ba400640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f63b4073f90 con 0x7f63b40c8740 2024-04-17T19:47:38.297 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:38.305+0000 7f63ba400640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 -- 0x7f63b4074270 con 0x7f63b40c47c0 2024-04-17T19:47:38.297 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:38.305+0000 7f63ba400640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 -- 0x7f63b40c94d0 con 0x7f63b40c7cc0 2024-04-17T19:47:38.297 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:38.305+0000 7f63abe00640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f63b40c47c0 0x7f63b40733c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:38.297 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:38.305+0000 7f63b3400640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f63b40c7cc0 0x7f63b4072e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:38.297 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:38.305+0000 7f63b3e00640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f63b40c8740 0x7f63b40c8b50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:41830/0 (socket says 172.21.15.44:41830) 2024-04-17T19:47:38.297 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:38.305+0000 7f63b3e00640 1 -- 172.21.15.44:0/222486011 learned_addr learned my addr 172.21.15.44:0/222486011 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-04-17T19:47:38.298 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:38.305+0000 7f63abe00640 1 -- 172.21.15.44:0/222486011 >> v2:172.21.15.62:3300/0 conn(0x7f63b40c7cc0 msgr2=0x7f63b4072e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T19:47:38.298 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:38.305+0000 7f63abe00640 1 --2- 172.21.15.44:0/222486011 >> v2:172.21.15.62:3300/0 conn(0x7f63b40c7cc0 0x7f63b4072e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:38.298 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:38.305+0000 7f63abe00640 1 -- 172.21.15.44:0/222486011 >> v1:172.21.15.44:6789/0 conn(0x7f63b40c8740 legacy=0x7f63b40c8b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:38.299 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:38.305+0000 7f63abe00640 1 -- 172.21.15.44:0/222486011 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f63b40c97b0 con 0x7f63b40c47c0 2024-04-17T19:47:38.299 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:38.305+0000 7f63b2a00640 1 -- 172.21.15.44:0/222486011 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1733715760 0 0) 0x7f63b4073f90 con 0x7f63b40c8740 2024-04-17T19:47:38.299 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:38.305+0000 7f63b3400640 1 --2- 172.21.15.44:0/222486011 >> v2:172.21.15.62:3300/0 conn(0x7f63b40c7cc0 0x7f63b4072e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-17T19:47:38.300 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:38.309+0000 7f63abe00640 1 --2- 172.21.15.44:0/222486011 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f63b40c47c0 0x7f63b40733c0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f63b4072650 tx=0x7f639c01c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=926f6b56d824ede6 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:47:38.300 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:38.309+0000 7f63b2a00640 1 -- 172.21.15.44:0/222486011 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f639c0b0070 con 0x7f63b40c47c0 2024-04-17T19:47:38.300 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:38.309+0000 7f63b2a00640 1 -- 172.21.15.44:0/222486011 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f639c0ab600 con 0x7f63b40c47c0 2024-04-17T19:47:38.300 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:38.309+0000 7f63b2a00640 1 -- 172.21.15.44:0/222486011 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f639c0ab9d0 con 0x7f63b40c47c0 2024-04-17T19:47:38.301 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:38.309+0000 7f63ba400640 1 -- 172.21.15.44:0/222486011 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f63b40c47c0 msgr2=0x7f63b40733c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:38.301 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:38.309+0000 7f63ba400640 1 --2- 172.21.15.44:0/222486011 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f63b40c47c0 0x7f63b40733c0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f63b4072650 tx=0x7f639c01c480 comp rx=0 tx=0).stop 2024-04-17T19:47:38.302 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:38.309+0000 7f63ba400640 1 -- 172.21.15.44:0/222486011 shutdown_connections 2024-04-17T19:47:38.302 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:38.309+0000 7f63ba400640 1 --2- 172.21.15.44:0/222486011 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f63b40c47c0 0x7f63b40733c0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:38.302 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:38.309+0000 7f63ba400640 1 --2- 172.21.15.44:0/222486011 >> v2:172.21.15.62:3300/0 conn(0x7f63b40c7cc0 0x7f63b4072e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:38.302 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:38.309+0000 7f63ba400640 1 -- 172.21.15.44:0/222486011 >> 172.21.15.44:0/222486011 conn(0x7f63b40c9dc0 msgr2=0x7f63b40ca1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:47:38.302 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:38.309+0000 7f63ba400640 1 -- 172.21.15.44:0/222486011 shutdown_connections 2024-04-17T19:47:38.302 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:38.309+0000 7f63ba400640 1 -- 172.21.15.44:0/222486011 wait complete. 2024-04-17T19:47:38.303 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:38.313+0000 7f63ba400640 1 Processor -- start 2024-04-17T19:47:38.303 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:38.313+0000 7f63ba400640 1 -- start start 2024-04-17T19:47:38.306 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:38.313+0000 7f63ba400640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f63b40c47c0 0x7f63b41f5d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:38.307 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:38.313+0000 7f63ba400640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f63b40c7cc0 0x7f63b4140d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:38.307 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:38.313+0000 7f63ba400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f63b40c8740 0x7f63b4147440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:38.307 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:38.313+0000 7f63ba400640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f63b4168ef0 con 0x7f63b40c8740 2024-04-17T19:47:38.307 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:38.313+0000 7f63ba400640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f63b4168d70 con 0x7f63b40c7cc0 2024-04-17T19:47:38.307 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:38.313+0000 7f63ba400640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7f63b4169070 con 0x7f63b40c47c0 2024-04-17T19:47:38.307 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:38.313+0000 7f63b3e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f63b40c8740 0x7f63b4147440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:38.307 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:38.313+0000 7f63abe00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f63b40c7cc0 0x7f63b4140d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:38.307 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:38.313+0000 7f63abe00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f63b40c7cc0 0x7f63b4140d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.44:49020/0 (socket says 172.21.15.44:49020) 2024-04-17T19:47:38.307 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:38.313+0000 7f63abe00640 1 -- 172.21.15.44:0/3632388873 learned_addr learned my addr 172.21.15.44:0/3632388873 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-04-17T19:47:38.307 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:38.313+0000 7f63b3400640 1 --2- 172.21.15.44:0/3632388873 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f63b40c47c0 0x7f63b41f5d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:38.307 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:38.313+0000 7f63b3e00640 1 -- 172.21.15.44:0/3632388873 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f63b40c47c0 msgr2=0x7f63b41f5d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:38.307 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:38.313+0000 7f63b3e00640 1 --2- 172.21.15.44:0/3632388873 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f63b40c47c0 0x7f63b41f5d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:38.307 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:38.313+0000 7f63b3e00640 1 -- 172.21.15.44:0/3632388873 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f63b40c7cc0 msgr2=0x7f63b4140d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:38.308 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:38.313+0000 7f63b3e00640 1 --2- 172.21.15.44:0/3632388873 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f63b40c7cc0 0x7f63b4140d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:38.308 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:38.313+0000 7f63b3e00640 1 -- 172.21.15.44:0/3632388873 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f63b41412c0 con 0x7f63b40c8740 2024-04-17T19:47:38.308 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:38.313+0000 7f63b3e00640 1 --2- 172.21.15.44:0/3632388873 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f63b40c8740 0x7f63b4147440 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f63b4072e30 tx=0x7f63ac00cbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:47:38.308 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:38.313+0000 7f63ab400640 1 -- 172.21.15.44:0/3632388873 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63ac018070 con 0x7f63b40c8740 2024-04-17T19:47:38.308 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:38.317+0000 7f63ab400640 1 -- 172.21.15.44:0/3632388873 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f63ac004d90 con 0x7f63b40c8740 2024-04-17T19:47:38.308 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:38.317+0000 7f63ab400640 1 -- 172.21.15.44:0/3632388873 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63ac00a880 con 0x7f63b40c8740 2024-04-17T19:47:38.308 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:38.317+0000 7f63ba400640 1 -- 172.21.15.44:0/3632388873 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f63b4158a80 con 0x7f63b40c8740 2024-04-17T19:47:38.308 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:38.317+0000 7f63ba400640 1 -- 172.21.15.44:0/3632388873 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f63b4159040 con 0x7f63b40c8740 2024-04-17T19:47:38.309 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:38.317+0000 7f63ba400640 1 -- 172.21.15.44:0/3632388873 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f63b404ff10 con 0x7f63b40c8740 2024-04-17T19:47:38.309 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:38.317+0000 7f63ab400640 1 -- 172.21.15.44:0/3632388873 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f63ac00aa20 con 0x7f63b40c8740 2024-04-17T19:47:38.309 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:38.317+0000 7f63ab400640 1 --2- 172.21.15.44:0/3632388873 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f63900683b0 0x7f639006a8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:38.310 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:38.317+0000 7f63ab400640 1 -- 172.21.15.44:0/3632388873 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6619+0+0 (secure 0 0 0) 0x7f63ac0860d0 con 0x7f63b40c8740 2024-04-17T19:47:38.310 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:38.317+0000 7f63b3400640 1 --2- 172.21.15.44:0/3632388873 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f63900683b0 0x7f639006a8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:38.310 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:38.317+0000 7f63b3400640 1 --2- 172.21.15.44:0/3632388873 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f63900683b0 0x7f639006a8c0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f63a4009580 tx=0x7f63a4009190 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:47:38.314 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:38.321+0000 7f63ab400640 1 -- 172.21.15.44:0/3632388873 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f63ac055ca0 con 0x7f63b40c8740 2024-04-17T19:47:38.481 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:38.489+0000 7f63ba400640 1 -- 172.21.15.44:0/3632388873 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f63b41587e0 con 0x7f63b40c8740 2024-04-17T19:47:38.481 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:38.489+0000 7f63ab400640 1 -- 172.21.15.44:0/3632388873 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v27) ==== 100+0+11 (secure 0 0 0) 0x7f63ac059fa0 con 0x7f63b40c8740 2024-04-17T19:47:38.481 INFO:teuthology.orchestra.run.smithi044.stdout:pg_num: 64 2024-04-17T19:47:38.483 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:38.493+0000 7f63ba400640 1 -- 172.21.15.44:0/3632388873 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f63900683b0 msgr2=0x7f639006a8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:38.483 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:38.493+0000 7f63ba400640 1 --2- 172.21.15.44:0/3632388873 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f63900683b0 0x7f639006a8c0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f63a4009580 tx=0x7f63a4009190 comp rx=0 tx=0).stop 2024-04-17T19:47:38.483 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:38.493+0000 7f63ba400640 1 -- 172.21.15.44:0/3632388873 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f63b40c8740 msgr2=0x7f63b4147440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:38.483 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:38.493+0000 7f63ba400640 1 --2- 172.21.15.44:0/3632388873 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f63b40c8740 0x7f63b4147440 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f63b4072e30 tx=0x7f63ac00cbe0 comp rx=0 tx=0).stop 2024-04-17T19:47:38.483 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:38.493+0000 7f63ba400640 1 -- 172.21.15.44:0/3632388873 shutdown_connections 2024-04-17T19:47:38.483 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:38.493+0000 7f63ba400640 1 --2- 172.21.15.44:0/3632388873 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f63900683b0 0x7f639006a8c0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:38.483 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:38.493+0000 7f63ba400640 1 --2- 172.21.15.44:0/3632388873 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f63b40c8740 0x7f63b4147440 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:38.483 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:38.493+0000 7f63ba400640 1 --2- 172.21.15.44:0/3632388873 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f63b40c7cc0 0x7f63b4140d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:38.483 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:38.493+0000 7f63ba400640 1 --2- 172.21.15.44:0/3632388873 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f63b40c47c0 0x7f63b41f5d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:38.484 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:38.493+0000 7f63ba400640 1 -- 172.21.15.44:0/3632388873 >> 172.21.15.44:0/3632388873 conn(0x7f63b40c9dc0 msgr2=0x7f63b4154f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:47:38.484 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:38.493+0000 7f63ba400640 1 -- 172.21.15.44:0/3632388873 shutdown_connections 2024-04-17T19:47:38.484 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:38.493+0000 7f63ba400640 1 -- 172.21.15.44:0/3632388873 wait complete. 2024-04-17T19:47:38.503 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-04-17T19:47:38.658 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:38.665+0000 7f65f1800640 1 Processor -- start 2024-04-17T19:47:38.658 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:38.669+0000 7f65f1800640 1 -- start start 2024-04-17T19:47:38.661 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:38.669+0000 7f65f1800640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f65ec152860 0x7f65ec0c68b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:38.661 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:38.669+0000 7f65f1800640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f65ec159140 0x7f65ec0c47e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:38.661 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:38.669+0000 7f65f1800640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f65ec0c4d20 0x7f65ec0c80a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:38.661 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:38.669+0000 7f65f1800640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 -- 0x7f65ec0c6eb0 con 0x7f65ec152860 2024-04-17T19:47:38.661 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:38.669+0000 7f65f1800640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 -- 0x7f65ec0c78e0 con 0x7f65ec0c4d20 2024-04-17T19:47:38.661 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:38.669+0000 7f65f1800640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7f65ec0c5130 con 0x7f65ec159140 2024-04-17T19:47:38.661 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:38.669+0000 7f65eaa00640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f65ec152860 0x7f65ec0c68b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:38.662 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:38.669+0000 7f65eaa00640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f65ec152860 0x7f65ec0c68b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:60690/0 (socket says 172.21.15.44:60690) 2024-04-17T19:47:38.662 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:38.669+0000 7f65eaa00640 1 -- 172.21.15.44:0/347105017 learned_addr learned my addr 172.21.15.44:0/347105017 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-04-17T19:47:38.662 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:38.669+0000 7f65e3e00640 1 --2- 172.21.15.44:0/347105017 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f65ec159140 0x7f65ec0c47e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:38.662 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:38.669+0000 7f65eb400640 1 --2- 172.21.15.44:0/347105017 >> v2:172.21.15.62:3300/0 conn(0x7f65ec0c4d20 0x7f65ec0c80a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:38.662 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:38.669+0000 7f65eaa00640 1 -- 172.21.15.44:0/347105017 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f65ec159140 msgr2=0x7f65ec0c47e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T19:47:38.662 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:38.669+0000 7f65eaa00640 1 --2- 172.21.15.44:0/347105017 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f65ec159140 0x7f65ec0c47e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:38.662 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:38.669+0000 7f65eaa00640 1 -- 172.21.15.44:0/347105017 >> v2:172.21.15.62:3300/0 conn(0x7f65ec0c4d20 msgr2=0x7f65ec0c80a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T19:47:38.662 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:38.669+0000 7f65eaa00640 1 --2- 172.21.15.44:0/347105017 >> v2:172.21.15.62:3300/0 conn(0x7f65ec0c4d20 0x7f65ec0c80a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:38.662 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:38.669+0000 7f65eaa00640 1 -- 172.21.15.44:0/347105017 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f65ec0c4000 con 0x7f65ec152860 2024-04-17T19:47:38.662 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:38.669+0000 7f65eb400640 1 --2- 172.21.15.44:0/347105017 >> v2:172.21.15.62:3300/0 conn(0x7f65ec0c4d20 0x7f65ec0c80a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-17T19:47:38.665 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:38.673+0000 7f65eaa00640 1 --2- 172.21.15.44:0/347105017 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f65ec152860 0x7f65ec0c68b0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f65ec152f80 tx=0x7f65dc01c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4ee25eb623e7da1f server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:47:38.665 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:38.673+0000 7f65ea000640 1 -- 172.21.15.44:0/347105017 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65dc0b0070 con 0x7f65ec152860 2024-04-17T19:47:38.665 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:38.673+0000 7f65ea000640 1 -- 172.21.15.44:0/347105017 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f65dc0ab600 con 0x7f65ec152860 2024-04-17T19:47:38.665 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:38.673+0000 7f65ea000640 1 -- 172.21.15.44:0/347105017 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65dc0ab9d0 con 0x7f65ec152860 2024-04-17T19:47:38.666 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:38.673+0000 7f65f1800640 1 -- 172.21.15.44:0/347105017 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f65ec152860 msgr2=0x7f65ec0c68b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:38.666 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:38.673+0000 7f65f1800640 1 --2- 172.21.15.44:0/347105017 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f65ec152860 0x7f65ec0c68b0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f65ec152f80 tx=0x7f65dc01c490 comp rx=0 tx=0).stop 2024-04-17T19:47:38.666 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:38.673+0000 7f65f1800640 1 -- 172.21.15.44:0/347105017 shutdown_connections 2024-04-17T19:47:38.667 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:38.673+0000 7f65f1800640 1 --2- 172.21.15.44:0/347105017 >> v2:172.21.15.62:3300/0 conn(0x7f65ec0c4d20 0x7f65ec0c80a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:38.667 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:38.673+0000 7f65f1800640 1 --2- 172.21.15.44:0/347105017 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f65ec159140 0x7f65ec0c47e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:38.667 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:38.673+0000 7f65f1800640 1 --2- 172.21.15.44:0/347105017 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f65ec152860 0x7f65ec0c68b0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:38.667 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:38.673+0000 7f65f1800640 1 -- 172.21.15.44:0/347105017 >> 172.21.15.44:0/347105017 conn(0x7f65ec06c380 msgr2=0x7f65ec070080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:47:38.667 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:38.673+0000 7f65f1800640 1 -- 172.21.15.44:0/347105017 shutdown_connections 2024-04-17T19:47:38.667 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:38.673+0000 7f65f1800640 1 -- 172.21.15.44:0/347105017 wait complete. 2024-04-17T19:47:38.668 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:38.677+0000 7f65f1800640 1 Processor -- start 2024-04-17T19:47:38.669 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:38.677+0000 7f65f1800640 1 -- start start 2024-04-17T19:47:38.670 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:38.677+0000 7f65f1800640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f65ec0c4d20 0x7f65ec1f3bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:38.671 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:38.677+0000 7f65f1800640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f65ec152860 0x7f65ec14cb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:38.671 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:38.677+0000 7f65f1800640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f65ec159140 0x7f65ec0cbba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:38.671 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:38.677+0000 7f65f1800640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f65ec15c4c0 con 0x7f65ec0c4d20 2024-04-17T19:47:38.671 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:38.677+0000 7f65f1800640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f65ec0c89f0 con 0x7f65ec159140 2024-04-17T19:47:38.671 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:38.677+0000 7f65f1800640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7f65ec15c640 con 0x7f65ec152860 2024-04-17T19:47:38.671 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:38.677+0000 7f65eaa00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f65ec0c4d20 0x7f65ec1f3bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:38.671 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:38.677+0000 7f65eaa00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f65ec0c4d20 0x7f65ec1f3bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:60700/0 (socket says 172.21.15.44:60700) 2024-04-17T19:47:38.671 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:38.677+0000 7f65eaa00640 1 -- 172.21.15.44:0/3589135948 learned_addr learned my addr 172.21.15.44:0/3589135948 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-04-17T19:47:38.671 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:38.677+0000 7f65e3e00640 1 --2- 172.21.15.44:0/3589135948 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f65ec152860 0x7f65ec14cb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:38.671 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:38.677+0000 7f65eb400640 1 --2- 172.21.15.44:0/3589135948 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f65ec159140 0x7f65ec0cbba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:38.671 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:38.681+0000 7f65eaa00640 1 -- 172.21.15.44:0/3589135948 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f65ec152860 msgr2=0x7f65ec14cb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:38.671 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:38.681+0000 7f65eaa00640 1 --2- 172.21.15.44:0/3589135948 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f65ec152860 0x7f65ec14cb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:38.671 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:38.681+0000 7f65eaa00640 1 -- 172.21.15.44:0/3589135948 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f65ec159140 msgr2=0x7f65ec0cbba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:38.671 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:38.681+0000 7f65eaa00640 1 --2- 172.21.15.44:0/3589135948 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f65ec159140 0x7f65ec0cbba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:38.671 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:38.681+0000 7f65eaa00640 1 -- 172.21.15.44:0/3589135948 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f65ec14d0a0 con 0x7f65ec0c4d20 2024-04-17T19:47:38.671 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:38.681+0000 7f65e3e00640 1 --2- 172.21.15.44:0/3589135948 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f65ec152860 0x7f65ec14cb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-17T19:47:38.672 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:38.681+0000 7f65eaa00640 1 --2- 172.21.15.44:0/3589135948 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f65ec0c4d20 0x7f65ec1f3bf0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f65dc01cd30 tx=0x7f65dc019230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:47:38.672 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:38.681+0000 7f65e2a00640 1 -- 172.21.15.44:0/3589135948 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65dc0b0040 con 0x7f65ec0c4d20 2024-04-17T19:47:38.672 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:38.681+0000 7f65e2a00640 1 -- 172.21.15.44:0/3589135948 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f65dc0b4640 con 0x7f65ec0c4d20 2024-04-17T19:47:38.672 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:38.681+0000 7f65f1800640 1 -- 172.21.15.44:0/3589135948 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f65ec144c20 con 0x7f65ec0c4d20 2024-04-17T19:47:38.672 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:38.681+0000 7f65e2a00640 1 -- 172.21.15.44:0/3589135948 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65dc0b4a30 con 0x7f65ec0c4d20 2024-04-17T19:47:38.673 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:38.681+0000 7f65f1800640 1 -- 172.21.15.44:0/3589135948 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f65ec14c080 con 0x7f65ec0c4d20 2024-04-17T19:47:38.673 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:38.681+0000 7f65f1800640 1 -- 172.21.15.44:0/3589135948 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f65ec04ff10 con 0x7f65ec0c4d20 2024-04-17T19:47:38.673 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:38.681+0000 7f65e2a00640 1 -- 172.21.15.44:0/3589135948 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f65dc0ab4c0 con 0x7f65ec0c4d20 2024-04-17T19:47:38.674 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:38.681+0000 7f65e2a00640 1 --2- 172.21.15.44:0/3589135948 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f65c80683b0 0x7f65c806a8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:38.674 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:38.681+0000 7f65e2a00640 1 -- 172.21.15.44:0/3589135948 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6619+0+0 (secure 0 0 0) 0x7f65dc120940 con 0x7f65ec0c4d20 2024-04-17T19:47:38.674 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:38.681+0000 7f65e3e00640 1 --2- 172.21.15.44:0/3589135948 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f65c80683b0 0x7f65c806a8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:38.675 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:38.685+0000 7f65e3e00640 1 --2- 172.21.15.44:0/3589135948 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f65c80683b0 0x7f65c806a8c0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f65ec0cda50 tx=0x7f65d4008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:47:38.678 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:38.685+0000 7f65e2a00640 1 -- 172.21.15.44:0/3589135948 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f65dc016110 con 0x7f65ec0c4d20 2024-04-17T19:47:38.844 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:38.853+0000 7f65f1800640 1 -- 172.21.15.44:0/3589135948 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) -- 0x7f65ec0c7e80 con 0x7f65ec0c4d20 2024-04-17T19:47:38.845 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:38.853+0000 7f65e2a00640 1 -- 172.21.15.44:0/3589135948 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v27) ==== 103+0+11 (secure 0 0 0) 0x7f65dc0f0bf0 con 0x7f65ec0c4d20 2024-04-17T19:47:38.845 INFO:teuthology.orchestra.run.smithi044.stdout:pg_num: 32 2024-04-17T19:47:38.847 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:38.857+0000 7f65f1800640 1 -- 172.21.15.44:0/3589135948 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f65c80683b0 msgr2=0x7f65c806a8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:38.847 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:38.857+0000 7f65f1800640 1 --2- 172.21.15.44:0/3589135948 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f65c80683b0 0x7f65c806a8c0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f65ec0cda50 tx=0x7f65d4008040 comp rx=0 tx=0).stop 2024-04-17T19:47:38.847 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:38.857+0000 7f65f1800640 1 -- 172.21.15.44:0/3589135948 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f65ec0c4d20 msgr2=0x7f65ec1f3bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:38.847 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:38.857+0000 7f65f1800640 1 --2- 172.21.15.44:0/3589135948 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f65ec0c4d20 0x7f65ec1f3bf0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f65dc01cd30 tx=0x7f65dc019230 comp rx=0 tx=0).stop 2024-04-17T19:47:38.847 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:38.857+0000 7f65f1800640 1 -- 172.21.15.44:0/3589135948 shutdown_connections 2024-04-17T19:47:38.847 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:38.857+0000 7f65f1800640 1 --2- 172.21.15.44:0/3589135948 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f65c80683b0 0x7f65c806a8c0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:38.847 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:38.857+0000 7f65f1800640 1 --2- 172.21.15.44:0/3589135948 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f65ec152860 0x7f65ec14cb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:38.847 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:38.857+0000 7f65f1800640 1 --2- 172.21.15.44:0/3589135948 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f65ec159140 0x7f65ec0cbba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:38.847 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:38.857+0000 7f65f1800640 1 --2- 172.21.15.44:0/3589135948 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f65ec0c4d20 0x7f65ec1f3bf0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:38.847 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:38.857+0000 7f65f1800640 1 -- 172.21.15.44:0/3589135948 >> 172.21.15.44:0/3589135948 conn(0x7f65ec06c380 msgr2=0x7f65ec0c9e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:47:38.848 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:38.857+0000 7f65f1800640 1 -- 172.21.15.44:0/3589135948 shutdown_connections 2024-04-17T19:47:38.848 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:38.857+0000 7f65f1800640 1 -- 172.21.15.44:0/3589135948 wait complete. 2024-04-17T19:47:38.866 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-17T19:47:39.018 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:39.025+0000 7f52bb600640 1 Processor -- start 2024-04-17T19:47:39.018 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:39.025+0000 7f52bb600640 1 -- start start 2024-04-17T19:47:39.020 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:39.029+0000 7f52bb600640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f52b4153db0 0x7f52b4073820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:39.020 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:39.029+0000 7f52bb600640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f52b4159ad0 con 0x7f52b4073d60 2024-04-17T19:47:39.020 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:39.029+0000 7f52bb600640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f52b4159db0 con 0x7f52b40c66d0 2024-04-17T19:47:39.020 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:39.029+0000 7f52bb600640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 -- 0x7f52b415a090 con 0x7f52b4153db0 2024-04-17T19:47:39.020 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:39.029+0000 7f52b3e00640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f52b4153db0 0x7f52b4073820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:39.020 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:39.029+0000 7f52b9600640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f52b4073d60 0x7f52b40725b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:41832/0 (socket says 172.21.15.44:41832) 2024-04-17T19:47:39.020 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:39.029+0000 7f52b9600640 1 -- 172.21.15.44:0/2719021838 learned_addr learned my addr 172.21.15.44:0/2719021838 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-04-17T19:47:39.021 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:39.029+0000 7f52b3e00640 1 -- 172.21.15.44:0/2719021838 >> v1:172.21.15.62:6789/0 conn(0x7f52b40c66d0 legacy=0x7f52b41536a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:39.021 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:39.029+0000 7f52b3e00640 1 -- 172.21.15.44:0/2719021838 >> v1:172.21.15.44:6789/0 conn(0x7f52b4073d60 legacy=0x7f52b40725b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:39.021 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:39.029+0000 7f52b3e00640 1 -- 172.21.15.44:0/2719021838 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f52b415a370 con 0x7f52b4153db0 2024-04-17T19:47:39.021 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:39.029+0000 7f52b3400640 1 -- 172.21.15.44:0/2719021838 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1236648120 0 0) 0x7f52b4159ad0 con 0x7f52b4073d60 2024-04-17T19:47:39.024 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:39.033+0000 7f52b3e00640 1 --2- 172.21.15.44:0/2719021838 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f52b4153db0 0x7f52b4073820 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f52a00097c0 tx=0x7f52a001c4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e5d5dfc1e1567052 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:47:39.024 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:39.033+0000 7f52b3400640 1 -- 172.21.15.44:0/2719021838 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52a00b0070 con 0x7f52b4153db0 2024-04-17T19:47:39.024 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:39.033+0000 7f52b3400640 1 -- 172.21.15.44:0/2719021838 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f52a00ab600 con 0x7f52b4153db0 2024-04-17T19:47:39.024 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:39.033+0000 7f52b3400640 1 -- 172.21.15.44:0/2719021838 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52a00ab9d0 con 0x7f52b4153db0 2024-04-17T19:47:39.024 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:39.033+0000 7f52bb600640 1 -- 172.21.15.44:0/2719021838 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f52b4153db0 msgr2=0x7f52b4073820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:39.025 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:39.033+0000 7f52bb600640 1 --2- 172.21.15.44:0/2719021838 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f52b4153db0 0x7f52b4073820 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f52a00097c0 tx=0x7f52a001c4a0 comp rx=0 tx=0).stop 2024-04-17T19:47:39.025 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:39.033+0000 7f52bb600640 1 -- 172.21.15.44:0/2719021838 shutdown_connections 2024-04-17T19:47:39.025 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:39.033+0000 7f52bb600640 1 --2- 172.21.15.44:0/2719021838 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f52b4153db0 0x7f52b4073820 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:39.025 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:39.033+0000 7f52bb600640 1 -- 172.21.15.44:0/2719021838 >> 172.21.15.44:0/2719021838 conn(0x7f52b406c380 msgr2=0x7f52b4070080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:47:39.025 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:39.033+0000 7f52bb600640 1 -- 172.21.15.44:0/2719021838 shutdown_connections 2024-04-17T19:47:39.025 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:39.033+0000 7f52bb600640 1 -- 172.21.15.44:0/2719021838 wait complete. 2024-04-17T19:47:39.026 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:39.037+0000 7f52bb600640 1 Processor -- start 2024-04-17T19:47:39.027 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:39.037+0000 7f52bb600640 1 -- start start 2024-04-17T19:47:39.028 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:39.037+0000 7f52bb600640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f52b4073d60 0x7f52b40c4640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:39.029 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:39.037+0000 7f52bb600640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f52b40c66d0 0x7f52b41437a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:39.029 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:39.037+0000 7f52bb600640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f52b4153db0 0x7f52b41f8850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:39.029 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:39.037+0000 7f52bb600640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f52b4167c10 con 0x7f52b4153db0 2024-04-17T19:47:39.029 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:39.037+0000 7f52bb600640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f52b4167a90 con 0x7f52b4073d60 2024-04-17T19:47:39.029 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:39.037+0000 7f52bb600640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7f52b4167d90 con 0x7f52b40c66d0 2024-04-17T19:47:39.029 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:39.037+0000 7f52b9600640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f52b4153db0 0x7f52b41f8850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:39.029 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:39.037+0000 7f52b9600640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f52b4153db0 0x7f52b41f8850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:60710/0 (socket says 172.21.15.44:60710) 2024-04-17T19:47:39.029 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:39.037+0000 7f52b3e00640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f52b40c66d0 0x7f52b41437a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:39.029 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:39.037+0000 7f52b9600640 1 -- 172.21.15.44:0/3630332866 learned_addr learned my addr 172.21.15.44:0/3630332866 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-04-17T19:47:39.029 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:39.037+0000 7f52b8c00640 1 --2- 172.21.15.44:0/3630332866 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f52b4073d60 0x7f52b40c4640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:39.030 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:39.037+0000 7f52b9600640 1 -- 172.21.15.44:0/3630332866 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f52b40c66d0 msgr2=0x7f52b41437a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:39.031 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:39.037+0000 7f52b9600640 1 --2- 172.21.15.44:0/3630332866 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f52b40c66d0 0x7f52b41437a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:39.031 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:39.037+0000 7f52b9600640 1 -- 172.21.15.44:0/3630332866 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f52b4073d60 msgr2=0x7f52b40c4640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:39.031 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:39.037+0000 7f52b9600640 1 --2- 172.21.15.44:0/3630332866 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f52b4073d60 0x7f52b40c4640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:39.031 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:39.037+0000 7f52b9600640 1 -- 172.21.15.44:0/3630332866 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f52b40c4b80 con 0x7f52b4153db0 2024-04-17T19:47:39.031 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:39.037+0000 7f52b9600640 1 --2- 172.21.15.44:0/3630332866 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f52b4153db0 0x7f52b41f8850 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f52ac00c6d0 tx=0x7f52ac00cb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:47:39.031 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:39.037+0000 7f52b0c00640 1 -- 172.21.15.44:0/3630332866 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52ac018070 con 0x7f52b4153db0 2024-04-17T19:47:39.031 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:39.037+0000 7f52b0c00640 1 -- 172.21.15.44:0/3630332866 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f52ac004d70 con 0x7f52b4153db0 2024-04-17T19:47:39.031 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:39.037+0000 7f52b0c00640 1 -- 172.21.15.44:0/3630332866 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52ac00a820 con 0x7f52b4153db0 2024-04-17T19:47:39.031 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:39.037+0000 7f52bb600640 1 -- 172.21.15.44:0/3630332866 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f52b40c5790 con 0x7f52b4153db0 2024-04-17T19:47:39.031 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:39.037+0000 7f52bb600640 1 -- 172.21.15.44:0/3630332866 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f52b40c5d50 con 0x7f52b4153db0 2024-04-17T19:47:39.031 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:39.041+0000 7f52bb600640 1 -- 172.21.15.44:0/3630332866 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f52b404ff10 con 0x7f52b4153db0 2024-04-17T19:47:39.032 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:39.041+0000 7f52b0c00640 1 -- 172.21.15.44:0/3630332866 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f52ac00abd0 con 0x7f52b4153db0 2024-04-17T19:47:39.033 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:39.041+0000 7f52b0c00640 1 --2- 172.21.15.44:0/3630332866 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f5294068380 0x7f529406a890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:39.033 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:39.041+0000 7f52b0c00640 1 -- 172.21.15.44:0/3630332866 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6619+0+0 (secure 0 0 0) 0x7f52ac086590 con 0x7f52b4153db0 2024-04-17T19:47:39.033 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:39.041+0000 7f52b8c00640 1 --2- 172.21.15.44:0/3630332866 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f5294068380 0x7f529406a890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:39.033 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:39.041+0000 7f52b8c00640 1 --2- 172.21.15.44:0/3630332866 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f5294068380 0x7f529406a890 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f52a8007fd0 tx=0x7f52a8009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:47:39.037 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:39.045+0000 7f52b0c00640 1 -- 172.21.15.44:0/3630332866 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f52ac056040 con 0x7f52b4153db0 2024-04-17T19:47:39.235 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:39.245+0000 7f52bb600640 1 -- 172.21.15.44:0/3630332866 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f52b4142270 con 0x7f52b4153db0 2024-04-17T19:47:39.236 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:39.245+0000 7f52b0c00640 1 -- 172.21.15.44:0/3630332866 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) ==== 94+0+6907 (secure 0 0 0) 0x7f52ac05a340 con 0x7f52b4153db0 2024-04-17T19:47:39.236 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-04-17T19:47:39.236 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":17,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4263,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.44:6835/1724891996","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6832","nonce":1724891996},{"type":"v1","addr":"172.21.15.44:6835","nonce":1724891996}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-17T19:46:56.083202+0000","modified":"2024-04-17T19:47:34.919929+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":4306,"mds_1":4294,"mds_2":4269,"mds_3":4268,"mds_4":4266},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4266":{"gid":4266,"name":"c","rank":4,"incarnation":17,"state":"up:creating","state_seq":1,"addr":"172.21.15.44:6836/2201911513","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6833","nonce":2201911513},{"type":"v1","addr":"172.21.15.44:6836","nonce":2201911513}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4268":{"gid":4268,"name":"f","rank":3,"incarnation":15,"state":"up:active","state_seq":13,"addr":"172.21.15.62:6837/3085335335","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6836","nonce":3085335335},{"type":"v1","addr":"172.21.15.62:6837","nonce":3085335335}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4269":{"gid":4269,"name":"e","rank":2,"incarnation":13,"state":"up:active","state_seq":11,"addr":"172.21.15.44:6837/4073536070","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6834","nonce":4073536070},{"type":"v1","addr":"172.21.15.44:6837","nonce":4073536070}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4294":{"gid":4294,"name":"d","rank":1,"incarnation":9,"state":"up:active","state_seq":10,"addr":"172.21.15.62:6835/2585862759","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6834","nonce":2585862759},{"type":"v1","addr":"172.21.15.62:6835","nonce":2585862759}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4306":{"gid":4306,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":5,"addr":"172.21.15.62:6839/1537667111","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6838","nonce":1537667111},{"type":"v1","addr":"172.21.15.62:6839","nonce":1537667111}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4306,"qdb_cluster":[4306,4269,4294,4268]},"id":1}]} 2024-04-17T19:47:39.236 INFO:teuthology.orchestra.run.smithi044.stderr:dumped fsmap epoch 17 2024-04-17T19:47:39.238 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:39.245+0000 7f52bb600640 1 -- 172.21.15.44:0/3630332866 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f5294068380 msgr2=0x7f529406a890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:39.238 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:39.245+0000 7f52bb600640 1 --2- 172.21.15.44:0/3630332866 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f5294068380 0x7f529406a890 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f52a8007fd0 tx=0x7f52a8009040 comp rx=0 tx=0).stop 2024-04-17T19:47:39.238 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:39.245+0000 7f52bb600640 1 -- 172.21.15.44:0/3630332866 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f52b4153db0 msgr2=0x7f52b41f8850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:39.238 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:39.245+0000 7f52bb600640 1 --2- 172.21.15.44:0/3630332866 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f52b4153db0 0x7f52b41f8850 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f52ac00c6d0 tx=0x7f52ac00cb90 comp rx=0 tx=0).stop 2024-04-17T19:47:39.238 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:39.245+0000 7f52bb600640 1 -- 172.21.15.44:0/3630332866 shutdown_connections 2024-04-17T19:47:39.238 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:39.245+0000 7f52bb600640 1 --2- 172.21.15.44:0/3630332866 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f5294068380 0x7f529406a890 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:39.238 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:39.245+0000 7f52bb600640 1 --2- 172.21.15.44:0/3630332866 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f52b40c66d0 0x7f52b41437a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:39.239 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:39.245+0000 7f52bb600640 1 --2- 172.21.15.44:0/3630332866 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f52b4153db0 0x7f52b41f8850 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:39.239 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:39.245+0000 7f52bb600640 1 --2- 172.21.15.44:0/3630332866 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f52b4073d60 0x7f52b40c4640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:39.239 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:39.245+0000 7f52bb600640 1 -- 172.21.15.44:0/3630332866 >> 172.21.15.44:0/3630332866 conn(0x7f52b406c380 msgr2=0x7f52b40cca00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:47:39.239 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:39.245+0000 7f52bb600640 1 -- 172.21.15.44:0/3630332866 shutdown_connections 2024-04-17T19:47:39.239 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:39.245+0000 7f52bb600640 1 -- 172.21.15.44:0/3630332866 wait complete. 2024-04-17T19:47:39.258 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-17T19:47:39.409 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:39.417+0000 7f9c6b400640 1 Processor -- start 2024-04-17T19:47:39.409 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:39.417+0000 7f9c6b400640 1 -- start start 2024-04-17T19:47:39.412 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:39.421+0000 7f9c6b400640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f9c64152a60 0x7f9c640c6920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:39.412 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:39.421+0000 7f9c6b400640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f9c64158eb0 0x7f9c641592c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:39.412 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:39.421+0000 7f9c6b400640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9c64152e70 con 0x7f9c640c47c0 2024-04-17T19:47:39.412 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:39.421+0000 7f9c6b400640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 -- 0x7f9c640c52c0 con 0x7f9c64158eb0 2024-04-17T19:47:39.412 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:39.421+0000 7f9c6b400640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 -- 0x7f9c640c8840 con 0x7f9c64152a60 2024-04-17T19:47:39.412 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:39.421+0000 7f9c63e00640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f9c64158eb0 0x7f9c641592c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:39.412 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:39.421+0000 7f9c68a00640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f9c64152a60 0x7f9c640c6920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:39.412 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:39.421+0000 7f9c69400640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f9c640c47c0 0x7f9c6415bd70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:41848/0 (socket says 172.21.15.44:41848) 2024-04-17T19:47:39.412 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:39.421+0000 7f9c69400640 1 -- 172.21.15.44:0/1701286746 learned_addr learned my addr 172.21.15.44:0/1701286746 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-04-17T19:47:39.412 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:39.421+0000 7f9c63e00640 1 -- 172.21.15.44:0/1701286746 >> v2:172.21.15.62:3300/0 conn(0x7f9c64152a60 msgr2=0x7f9c640c6920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T19:47:39.412 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:39.421+0000 7f9c63e00640 1 --2- 172.21.15.44:0/1701286746 >> v2:172.21.15.62:3300/0 conn(0x7f9c64152a60 0x7f9c640c6920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:39.412 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:39.421+0000 7f9c63e00640 1 -- 172.21.15.44:0/1701286746 >> v1:172.21.15.44:6789/0 conn(0x7f9c640c47c0 legacy=0x7f9c6415bd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:39.412 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:39.421+0000 7f9c63e00640 1 -- 172.21.15.44:0/1701286746 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9c640c8b20 con 0x7f9c64158eb0 2024-04-17T19:47:39.413 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:39.421+0000 7f9c63400640 1 -- 172.21.15.44:0/1701286746 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3965457405 0 0) 0x7f9c64152e70 con 0x7f9c640c47c0 2024-04-17T19:47:39.415 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:39.425+0000 7f9c63e00640 1 --2- 172.21.15.44:0/1701286746 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9c64158eb0 0x7f9c641592c0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f9c6406cc70 tx=0x7f9c5001ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4be70b76aba84835 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:47:39.415 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:39.425+0000 7f9c63400640 1 -- 172.21.15.44:0/1701286746 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c500b5070 con 0x7f9c64158eb0 2024-04-17T19:47:39.415 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:39.425+0000 7f9c63400640 1 -- 172.21.15.44:0/1701286746 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9c500a8970 con 0x7f9c64158eb0 2024-04-17T19:47:39.415 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:39.425+0000 7f9c63400640 1 -- 172.21.15.44:0/1701286746 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c500a8d40 con 0x7f9c64158eb0 2024-04-17T19:47:39.416 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:39.425+0000 7f9c6b400640 1 -- 172.21.15.44:0/1701286746 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9c64158eb0 msgr2=0x7f9c641592c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:39.416 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:39.425+0000 7f9c6b400640 1 --2- 172.21.15.44:0/1701286746 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9c64158eb0 0x7f9c641592c0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f9c6406cc70 tx=0x7f9c5001ec70 comp rx=0 tx=0).stop 2024-04-17T19:47:39.416 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:39.425+0000 7f9c6b400640 1 -- 172.21.15.44:0/1701286746 shutdown_connections 2024-04-17T19:47:39.416 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:39.425+0000 7f9c6b400640 1 --2- 172.21.15.44:0/1701286746 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9c64158eb0 0x7f9c641592c0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:39.416 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:39.425+0000 7f9c6b400640 1 --2- 172.21.15.44:0/1701286746 >> v2:172.21.15.62:3300/0 conn(0x7f9c64152a60 0x7f9c640c6920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:39.416 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:39.425+0000 7f9c6b400640 1 -- 172.21.15.44:0/1701286746 >> 172.21.15.44:0/1701286746 conn(0x7f9c6406c380 msgr2=0x7f9c64070080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:47:39.416 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:39.425+0000 7f9c6b400640 1 -- 172.21.15.44:0/1701286746 shutdown_connections 2024-04-17T19:47:39.416 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:39.425+0000 7f9c6b400640 1 -- 172.21.15.44:0/1701286746 wait complete. 2024-04-17T19:47:39.418 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:39.425+0000 7f9c6b400640 1 Processor -- start 2024-04-17T19:47:39.418 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:39.425+0000 7f9c6b400640 1 -- start start 2024-04-17T19:47:39.420 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:39.429+0000 7f9c6b400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9c640c47c0 0x7f9c6413d280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:39.420 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:39.429+0000 7f9c6b400640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9c64152a60 0x7f9c6413d7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:39.420 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:39.429+0000 7f9c6b400640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f9c64158eb0 0x7f9c64142560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:39.420 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:39.429+0000 7f9c6b400640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f9c64158990 con 0x7f9c640c47c0 2024-04-17T19:47:39.420 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:39.429+0000 7f9c6b400640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f9c640c90e0 con 0x7f9c64152a60 2024-04-17T19:47:39.420 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:39.429+0000 7f9c6b400640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7f9c640c6e60 con 0x7f9c64158eb0 2024-04-17T19:47:39.421 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:39.429+0000 7f9c68a00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9c640c47c0 0x7f9c6413d280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:39.421 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:39.429+0000 7f9c68a00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9c640c47c0 0x7f9c6413d280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:60726/0 (socket says 172.21.15.44:60726) 2024-04-17T19:47:39.421 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:39.429+0000 7f9c68a00640 1 -- 172.21.15.44:0/599137526 learned_addr learned my addr 172.21.15.44:0/599137526 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-04-17T19:47:39.421 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:39.429+0000 7f9c63e00640 1 --2- 172.21.15.44:0/599137526 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9c64152a60 0x7f9c6413d7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:39.421 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:39.429+0000 7f9c69400640 1 --2- 172.21.15.44:0/599137526 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f9c64158eb0 0x7f9c64142560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:39.421 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:39.429+0000 7f9c68a00640 1 -- 172.21.15.44:0/599137526 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f9c64158eb0 msgr2=0x7f9c64142560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:39.421 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:39.429+0000 7f9c68a00640 1 --2- 172.21.15.44:0/599137526 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f9c64158eb0 0x7f9c64142560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:39.421 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:39.429+0000 7f9c68a00640 1 -- 172.21.15.44:0/599137526 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9c64152a60 msgr2=0x7f9c6413d7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:39.421 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:39.429+0000 7f9c68a00640 1 --2- 172.21.15.44:0/599137526 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9c64152a60 0x7f9c6413d7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:39.421 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:39.429+0000 7f9c68a00640 1 -- 172.21.15.44:0/599137526 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9c64149500 con 0x7f9c640c47c0 2024-04-17T19:47:39.421 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:39.429+0000 7f9c63e00640 1 --2- 172.21.15.44:0/599137526 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9c64152a60 0x7f9c6413d7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-17T19:47:39.421 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:39.429+0000 7f9c68a00640 1 --2- 172.21.15.44:0/599137526 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9c640c47c0 0x7f9c6413d280 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f9c5800e8a0 tx=0x7f9c5800eca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:47:39.422 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:39.429+0000 7f9c60c00640 1 -- 172.21.15.44:0/599137526 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c58017070 con 0x7f9c640c47c0 2024-04-17T19:47:39.422 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:39.429+0000 7f9c60c00640 1 -- 172.21.15.44:0/599137526 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9c5800c940 con 0x7f9c640c47c0 2024-04-17T19:47:39.422 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:39.429+0000 7f9c60c00640 1 -- 172.21.15.44:0/599137526 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c5800ccf0 con 0x7f9c640c47c0 2024-04-17T19:47:39.422 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:39.429+0000 7f9c6b400640 1 -- 172.21.15.44:0/599137526 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9c641f3070 con 0x7f9c640c47c0 2024-04-17T19:47:39.422 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:39.429+0000 7f9c6b400640 1 -- 172.21.15.44:0/599137526 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9c641f2590 con 0x7f9c640c47c0 2024-04-17T19:47:39.422 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:39.429+0000 7f9c6b400640 1 -- 172.21.15.44:0/599137526 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9c6404ff10 con 0x7f9c640c47c0 2024-04-17T19:47:39.423 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:39.433+0000 7f9c60c00640 1 -- 172.21.15.44:0/599137526 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f9c5801a070 con 0x7f9c640c47c0 2024-04-17T19:47:39.423 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:39.433+0000 7f9c60c00640 1 --2- 172.21.15.44:0/599137526 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f9c440683b0 0x7f9c4406a8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:39.423 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:39.433+0000 7f9c60c00640 1 -- 172.21.15.44:0/599137526 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6619+0+0 (secure 0 0 0) 0x7f9c58086dc0 con 0x7f9c640c47c0 2024-04-17T19:47:39.424 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:39.433+0000 7f9c63e00640 1 --2- 172.21.15.44:0/599137526 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f9c440683b0 0x7f9c4406a8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:39.424 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:39.433+0000 7f9c63e00640 1 --2- 172.21.15.44:0/599137526 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f9c440683b0 0x7f9c4406a8c0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f9c500b2000 tx=0x7f9c500aa070 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:47:39.428 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:39.437+0000 7f9c60c00640 1 -- 172.21.15.44:0/599137526 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f9c58056ec0 con 0x7f9c640c47c0 2024-04-17T19:47:39.595 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:39.605+0000 7f9c6b400640 1 -- 172.21.15.44:0/599137526 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f9c640725b0 con 0x7f9c640c47c0 2024-04-17T19:47:39.596 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:39.605+0000 7f9c60c00640 1 -- 172.21.15.44:0/599137526 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) ==== 74+0+18623 (secure 0 0 0) 0x7f9c580567c0 con 0x7f9c640c47c0 2024-04-17T19:47:39.596 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-04-17T19:47:39.596 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":27,"fsid":"703f77ca-79c6-4a66-b576-62c526cb1021","created":"2024-04-17T19:46:30.831994+0000","modified":"2024-04-17T19:47:37.943331+0000","last_up_change":"2024-04-17T19:46:41.988197+0000","last_in_change":"2024-04-17T19:46:33.407430+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-17T19:46:41.940380+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-17T19:46:54.222150+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-17T19:46:55.031694+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-17T19:46:58.707529+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"30520dc6-eea6-43d4-ab60-3ca9e92329dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6800","nonce":1018735925},{"type":"v1","addr":"172.21.15.44:6801","nonce":1018735925}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6802","nonce":1018735925},{"type":"v1","addr":"172.21.15.44:6803","nonce":1018735925}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6806","nonce":1018735925},{"type":"v1","addr":"172.21.15.44:6807","nonce":1018735925}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6804","nonce":1018735925},{"type":"v1","addr":"172.21.15.44:6805","nonce":1018735925}]},"public_addr":"172.21.15.44:6801/1018735925","cluster_addr":"172.21.15.44:6803/1018735925","heartbeat_back_addr":"172.21.15.44:6807/1018735925","heartbeat_front_addr":"172.21.15.44:6805/1018735925","state":["exists","up"]},{"osd":1,"uuid":"079bd511-b6ce-449b-8f11-17b311b12f7c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6817","nonce":1452577434},{"type":"v1","addr":"172.21.15.44:6820","nonce":1452577434}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6823","nonce":1452577434},{"type":"v1","addr":"172.21.15.44:6825","nonce":1452577434}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6830","nonce":1452577434},{"type":"v1","addr":"172.21.15.44:6831","nonce":1452577434}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6828","nonce":1452577434},{"type":"v1","addr":"172.21.15.44:6829","nonce":1452577434}]},"public_addr":"172.21.15.44:6820/1452577434","cluster_addr":"172.21.15.44:6825/1452577434","heartbeat_back_addr":"172.21.15.44:6831/1452577434","heartbeat_front_addr":"172.21.15.44:6829/1452577434","state":["exists","up"]},{"osd":2,"uuid":"34f0b9ab-b1d2-4ee9-841c-f15afbb6bec5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6816","nonce":1160071918},{"type":"v1","addr":"172.21.15.44:6818","nonce":1160071918}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6819","nonce":1160071918},{"type":"v1","addr":"172.21.15.44:6821","nonce":1160071918}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6826","nonce":1160071918},{"type":"v1","addr":"172.21.15.44:6827","nonce":1160071918}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6822","nonce":1160071918},{"type":"v1","addr":"172.21.15.44:6824","nonce":1160071918}]},"public_addr":"172.21.15.44:6818/1160071918","cluster_addr":"172.21.15.44:6821/1160071918","heartbeat_back_addr":"172.21.15.44:6827/1160071918","heartbeat_front_addr":"172.21.15.44:6824/1160071918","state":["exists","up"]},{"osd":3,"uuid":"4740032d-fe34-4b1b-bb85-f430896fc3c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6808","nonce":4236454921},{"type":"v1","addr":"172.21.15.44:6809","nonce":4236454921}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6810","nonce":4236454921},{"type":"v1","addr":"172.21.15.44:6811","nonce":4236454921}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6814","nonce":4236454921},{"type":"v1","addr":"172.21.15.44:6815","nonce":4236454921}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6812","nonce":4236454921},{"type":"v1","addr":"172.21.15.44:6813","nonce":4236454921}]},"public_addr":"172.21.15.44:6809/4236454921","cluster_addr":"172.21.15.44:6811/4236454921","heartbeat_back_addr":"172.21.15.44:6815/4236454921","heartbeat_front_addr":"172.21.15.44:6813/4236454921","state":["exists","up"]},{"osd":4,"uuid":"7dbedb00-302d-4d52-810c-e18839254da1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6800","nonce":2293251376},{"type":"v1","addr":"172.21.15.62:6801","nonce":2293251376}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6802","nonce":2293251376},{"type":"v1","addr":"172.21.15.62:6803","nonce":2293251376}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6806","nonce":2293251376},{"type":"v1","addr":"172.21.15.62:6807","nonce":2293251376}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6804","nonce":2293251376},{"type":"v1","addr":"172.21.15.62:6805","nonce":2293251376}]},"public_addr":"172.21.15.62:6801/2293251376","cluster_addr":"172.21.15.62:6803/2293251376","heartbeat_back_addr":"172.21.15.62:6807/2293251376","heartbeat_front_addr":"172.21.15.62:6805/2293251376","state":["exists","up"]},{"osd":5,"uuid":"38c1e8d9-393d-4f33-a97a-3295cf5c5b07","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6808","nonce":1551020300},{"type":"v1","addr":"172.21.15.62:6809","nonce":1551020300}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6810","nonce":1551020300},{"type":"v1","addr":"172.21.15.62:6811","nonce":1551020300}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6814","nonce":1551020300},{"type":"v1","addr":"172.21.15.62:6815","nonce":1551020300}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6812","nonce":1551020300},{"type":"v1","addr":"172.21.15.62:6813","nonce":1551020300}]},"public_addr":"172.21.15.62:6809/1551020300","cluster_addr":"172.21.15.62:6811/1551020300","heartbeat_back_addr":"172.21.15.62:6815/1551020300","heartbeat_front_addr":"172.21.15.62:6813/1551020300","state":["exists","up"]},{"osd":6,"uuid":"f6ff81c6-f14d-4477-88e3-9116cc5a2992","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6824","nonce":2602310256},{"type":"v1","addr":"172.21.15.62:6825","nonce":2602310256}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6826","nonce":2602310256},{"type":"v1","addr":"172.21.15.62:6827","nonce":2602310256}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6830","nonce":2602310256},{"type":"v1","addr":"172.21.15.62:6831","nonce":2602310256}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6828","nonce":2602310256},{"type":"v1","addr":"172.21.15.62:6829","nonce":2602310256}]},"public_addr":"172.21.15.62:6825/2602310256","cluster_addr":"172.21.15.62:6827/2602310256","heartbeat_back_addr":"172.21.15.62:6831/2602310256","heartbeat_front_addr":"172.21.15.62:6829/2602310256","state":["exists","up"]},{"osd":7,"uuid":"ce395bc3-bcb5-4b94-a523-5bb9df491eca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6816","nonce":2912738359},{"type":"v1","addr":"172.21.15.62:6817","nonce":2912738359}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6818","nonce":2912738359},{"type":"v1","addr":"172.21.15.62:6819","nonce":2912738359}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6822","nonce":2912738359},{"type":"v1","addr":"172.21.15.62:6823","nonce":2912738359}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6820","nonce":2912738359},{"type":"v1","addr":"172.21.15.62:6821","nonce":2912738359}]},"public_addr":"172.21.15.62:6817/2912738359","cluster_addr":"172.21.15.62:6819/2912738359","heartbeat_back_addr":"172.21.15.62:6823/2912738359","heartbeat_front_addr":"172.21.15.62:6821/2912738359","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T19:46:39.302883+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T19:46:39.177705+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T19:46:39.188894+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T19:46:39.313009+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T19:46:38.870508+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T19:46:38.790900+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T19:46:38.979163+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T19:46:38.992348+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.c","mappings":[{"from":0,"to":4}]},{"pgid":"3.15","mappings":[{"from":0,"to":7}]},{"pgid":"4.f","mappings":[{"from":7,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-17T19:47:39.598 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:39.605+0000 7f9c6b400640 1 -- 172.21.15.44:0/599137526 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f9c440683b0 msgr2=0x7f9c4406a8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:39.598 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:39.605+0000 7f9c6b400640 1 --2- 172.21.15.44:0/599137526 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f9c440683b0 0x7f9c4406a8c0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f9c500b2000 tx=0x7f9c500aa070 comp rx=0 tx=0).stop 2024-04-17T19:47:39.599 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:39.605+0000 7f9c6b400640 1 -- 172.21.15.44:0/599137526 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9c640c47c0 msgr2=0x7f9c6413d280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:39.599 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:39.605+0000 7f9c6b400640 1 --2- 172.21.15.44:0/599137526 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9c640c47c0 0x7f9c6413d280 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f9c5800e8a0 tx=0x7f9c5800eca0 comp rx=0 tx=0).stop 2024-04-17T19:47:39.599 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:39.605+0000 7f9c6b400640 1 -- 172.21.15.44:0/599137526 shutdown_connections 2024-04-17T19:47:39.599 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:39.605+0000 7f9c6b400640 1 --2- 172.21.15.44:0/599137526 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f9c440683b0 0x7f9c4406a8c0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:39.599 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:39.605+0000 7f9c6b400640 1 --2- 172.21.15.44:0/599137526 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f9c64158eb0 0x7f9c64142560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:39.599 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:39.605+0000 7f9c6b400640 1 --2- 172.21.15.44:0/599137526 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9c64152a60 0x7f9c6413d7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:39.599 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:39.605+0000 7f9c6b400640 1 --2- 172.21.15.44:0/599137526 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9c640c47c0 0x7f9c6413d280 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:39.599 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:39.605+0000 7f9c6b400640 1 -- 172.21.15.44:0/599137526 >> 172.21.15.44:0/599137526 conn(0x7f9c6406c380 msgr2=0x7f9c64073280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:47:39.599 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:39.605+0000 7f9c6b400640 1 -- 172.21.15.44:0/599137526 shutdown_connections 2024-04-17T19:47:39.599 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:39.605+0000 7f9c6b400640 1 -- 172.21.15.44:0/599137526 wait complete. 2024-04-17T19:47:39.618 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-17T19:46:41.940380+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-17T19:46:54.222150+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-17T19:46:55.031694+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-04-17T19:46:58.707529+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-04-17T19:47:39.619 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-17T19:47:39.773 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:39.781+0000 7fb890a00640 1 Processor -- start 2024-04-17T19:47:39.773 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:39.781+0000 7fb890a00640 1 -- start start 2024-04-17T19:47:39.775 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:39.785+0000 7fb890a00640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fb88c06ce90 0x7fb88c152410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:39.776 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:39.785+0000 7fb890a00640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fb88c15b990 0x7fb88c15bda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:39.776 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:39.785+0000 7fb890a00640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb88c15ef80 con 0x7fb88c0ca090 2024-04-17T19:47:39.776 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:39.785+0000 7fb890a00640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 -- 0x7fb88c0ca540 con 0x7fb88c06ce90 2024-04-17T19:47:39.776 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:39.785+0000 7fb890a00640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7fb88c15f240 con 0x7fb88c15b990 2024-04-17T19:47:39.776 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:39.785+0000 7fb882a00640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fb88c06ce90 0x7fb88c152410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:39.776 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:39.785+0000 7fb882a00640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fb88c06ce90 0x7fb88c152410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:60738/0 (socket says 172.21.15.44:60738) 2024-04-17T19:47:39.776 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:39.785+0000 7fb882a00640 1 -- 172.21.15.44:0/54682708 learned_addr learned my addr 172.21.15.44:0/54682708 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-04-17T19:47:39.776 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:39.785+0000 7fb88be00640 1 --2- 172.21.15.44:0/54682708 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fb88c15b990 0x7fb88c15bda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:39.776 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:39.785+0000 7fb882a00640 1 -- 172.21.15.44:0/54682708 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fb88c15b990 msgr2=0x7fb88c15bda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T19:47:39.776 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:39.785+0000 7fb882a00640 1 --2- 172.21.15.44:0/54682708 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fb88c15b990 0x7fb88c15bda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:39.776 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:39.785+0000 7fb882a00640 1 -- 172.21.15.44:0/54682708 >> v1:172.21.15.62:6789/0 conn(0x7fb88c0ca090 legacy=0x7fb88c0cb940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:39.776 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:39.785+0000 7fb882a00640 1 -- 172.21.15.44:0/54682708 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb88c15f520 con 0x7fb88c06ce90 2024-04-17T19:47:39.779 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:39.789+0000 7fb882a00640 1 --2- 172.21.15.44:0/54682708 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb88c06ce90 0x7fb88c152410 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fb874009870 tx=0x7fb87401ed50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=38a8f11ed4394d61 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:47:39.779 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:39.789+0000 7fb88aa00640 1 -- 172.21.15.44:0/54682708 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8740b5070 con 0x7fb88c06ce90 2024-04-17T19:47:39.779 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:39.789+0000 7fb88aa00640 1 -- 172.21.15.44:0/54682708 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb8740a8a50 con 0x7fb88c06ce90 2024-04-17T19:47:39.779 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:39.789+0000 7fb88aa00640 1 -- 172.21.15.44:0/54682708 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8740a8e20 con 0x7fb88c06ce90 2024-04-17T19:47:39.779 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:39.789+0000 7fb890a00640 1 -- 172.21.15.44:0/54682708 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb88c06ce90 msgr2=0x7fb88c152410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:39.779 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:39.789+0000 7fb890a00640 1 --2- 172.21.15.44:0/54682708 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb88c06ce90 0x7fb88c152410 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fb874009870 tx=0x7fb87401ed50 comp rx=0 tx=0).stop 2024-04-17T19:47:39.780 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:39.789+0000 7fb890a00640 1 -- 172.21.15.44:0/54682708 shutdown_connections 2024-04-17T19:47:39.780 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:39.789+0000 7fb890a00640 1 --2- 172.21.15.44:0/54682708 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fb88c15b990 0x7fb88c15bda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:39.780 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:39.789+0000 7fb890a00640 1 --2- 172.21.15.44:0/54682708 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb88c06ce90 0x7fb88c152410 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:39.780 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:39.789+0000 7fb890a00640 1 -- 172.21.15.44:0/54682708 >> 172.21.15.44:0/54682708 conn(0x7fb88c072320 msgr2=0x7fb88c072730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:47:39.780 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:39.789+0000 7fb890a00640 1 -- 172.21.15.44:0/54682708 shutdown_connections 2024-04-17T19:47:39.780 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:39.789+0000 7fb890a00640 1 -- 172.21.15.44:0/54682708 wait complete. 2024-04-17T19:47:39.782 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:39.789+0000 7fb890a00640 1 Processor -- start 2024-04-17T19:47:39.782 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:39.789+0000 7fb890a00640 1 -- start start 2024-04-17T19:47:39.784 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:39.793+0000 7fb890a00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb88c06ce90 0x7fb88c0cf6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:39.784 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:39.793+0000 7fb890a00640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fb88c0ca090 0x7fb88c1f5e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:39.784 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:39.793+0000 7fb890a00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb88c15b990 0x7fb88c1f4f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:39.784 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:39.793+0000 7fb890a00640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fb88c15c2e0 con 0x7fb88c06ce90 2024-04-17T19:47:39.784 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:39.793+0000 7fb890a00640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7fb88c15fae0 con 0x7fb88c15b990 2024-04-17T19:47:39.784 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:39.793+0000 7fb890a00640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7fb88c0c9580 con 0x7fb88c0ca090 2024-04-17T19:47:39.784 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:39.793+0000 7fb88b400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb88c06ce90 0x7fb88c0cf6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:39.785 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:39.793+0000 7fb88b400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb88c06ce90 0x7fb88c0cf6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:60740/0 (socket says 172.21.15.44:60740) 2024-04-17T19:47:39.785 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:39.793+0000 7fb88b400640 1 -- 172.21.15.44:0/1376072529 learned_addr learned my addr 172.21.15.44:0/1376072529 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-04-17T19:47:39.785 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:39.793+0000 7fb88be00640 1 --2- 172.21.15.44:0/1376072529 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb88c15b990 0x7fb88c1f4f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:39.785 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:39.793+0000 7fb882a00640 1 --2- 172.21.15.44:0/1376072529 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fb88c0ca090 0x7fb88c1f5e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:39.785 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:39.793+0000 7fb88b400640 1 -- 172.21.15.44:0/1376072529 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fb88c0ca090 msgr2=0x7fb88c1f5e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:39.785 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:39.793+0000 7fb88b400640 1 --2- 172.21.15.44:0/1376072529 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fb88c0ca090 0x7fb88c1f5e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:39.785 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:39.793+0000 7fb88b400640 1 -- 172.21.15.44:0/1376072529 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb88c15b990 msgr2=0x7fb88c1f4f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:39.785 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:39.793+0000 7fb88b400640 1 --2- 172.21.15.44:0/1376072529 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb88c15b990 0x7fb88c1f4f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:39.785 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:39.793+0000 7fb88b400640 1 -- 172.21.15.44:0/1376072529 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb88c1f6370 con 0x7fb88c06ce90 2024-04-17T19:47:39.785 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:39.793+0000 7fb882a00640 1 --2- 172.21.15.44:0/1376072529 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fb88c0ca090 0x7fb88c1f5e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-17T19:47:39.785 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:39.793+0000 7fb88b400640 1 --2- 172.21.15.44:0/1376072529 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb88c06ce90 0x7fb88c0cf6f0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fb87c00c3c0 tx=0x7fb87c00c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:47:39.786 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:39.793+0000 7fb883e00640 1 -- 172.21.15.44:0/1376072529 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb87c017070 con 0x7fb88c06ce90 2024-04-17T19:47:39.786 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:39.793+0000 7fb883e00640 1 -- 172.21.15.44:0/1376072529 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb87c0052f0 con 0x7fb88c06ce90 2024-04-17T19:47:39.786 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:39.793+0000 7fb883e00640 1 -- 172.21.15.44:0/1376072529 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb87c003840 con 0x7fb88c06ce90 2024-04-17T19:47:39.786 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:39.793+0000 7fb890a00640 1 -- 172.21.15.44:0/1376072529 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb88c0c89c0 con 0x7fb88c06ce90 2024-04-17T19:47:39.786 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:39.793+0000 7fb890a00640 1 -- 172.21.15.44:0/1376072529 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb88c0c8f80 con 0x7fb88c06ce90 2024-04-17T19:47:39.786 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:39.793+0000 7fb890a00640 1 -- 172.21.15.44:0/1376072529 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb88c04fea0 con 0x7fb88c06ce90 2024-04-17T19:47:39.787 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:39.797+0000 7fb883e00640 1 -- 172.21.15.44:0/1376072529 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fb87c01a070 con 0x7fb88c06ce90 2024-04-17T19:47:39.788 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:39.797+0000 7fb883e00640 1 --2- 172.21.15.44:0/1376072529 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7fb8680683b0 0x7fb86806a8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:39.788 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:39.797+0000 7fb883e00640 1 -- 172.21.15.44:0/1376072529 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6619+0+0 (secure 0 0 0) 0x7fb87c085ee0 con 0x7fb88c06ce90 2024-04-17T19:47:39.788 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:39.797+0000 7fb882a00640 1 --2- 172.21.15.44:0/1376072529 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7fb8680683b0 0x7fb86806a8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:39.789 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:39.797+0000 7fb882a00640 1 --2- 172.21.15.44:0/1376072529 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7fb8680683b0 0x7fb86806a8c0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fb8740b2000 tx=0x7fb874008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:47:39.793 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:39.801+0000 7fb883e00640 1 -- 172.21.15.44:0/1376072529 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fb87c055ac0 con 0x7fb88c06ce90 2024-04-17T19:47:39.966 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:39.973+0000 7fb890a00640 1 -- 172.21.15.44:0/1376072529 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fb88c0cabd0 con 0x7fb88c06ce90 2024-04-17T19:47:39.967 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:39.977+0000 7fb883e00640 1 -- 172.21.15.44:0/1376072529 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v27) ==== 93+0+10 (secure 0 0 0) 0x7fb87c059dc0 con 0x7fb88c06ce90 2024-04-17T19:47:39.967 INFO:teuthology.orchestra.run.smithi044.stdout:pg_num: 1 2024-04-17T19:47:39.970 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:39.977+0000 7fb890a00640 1 -- 172.21.15.44:0/1376072529 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7fb8680683b0 msgr2=0x7fb86806a8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:39.970 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:39.977+0000 7fb890a00640 1 --2- 172.21.15.44:0/1376072529 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7fb8680683b0 0x7fb86806a8c0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fb8740b2000 tx=0x7fb874008040 comp rx=0 tx=0).stop 2024-04-17T19:47:39.970 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:39.977+0000 7fb890a00640 1 -- 172.21.15.44:0/1376072529 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb88c06ce90 msgr2=0x7fb88c0cf6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:39.970 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:39.977+0000 7fb890a00640 1 --2- 172.21.15.44:0/1376072529 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb88c06ce90 0x7fb88c0cf6f0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fb87c00c3c0 tx=0x7fb87c00c880 comp rx=0 tx=0).stop 2024-04-17T19:47:39.970 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:39.977+0000 7fb890a00640 1 -- 172.21.15.44:0/1376072529 shutdown_connections 2024-04-17T19:47:39.970 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:39.977+0000 7fb890a00640 1 --2- 172.21.15.44:0/1376072529 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7fb8680683b0 0x7fb86806a8c0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:39.971 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:39.977+0000 7fb890a00640 1 --2- 172.21.15.44:0/1376072529 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fb88c0ca090 0x7fb88c1f5e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:39.971 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:39.977+0000 7fb890a00640 1 --2- 172.21.15.44:0/1376072529 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb88c15b990 0x7fb88c1f4f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:39.971 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:39.977+0000 7fb890a00640 1 --2- 172.21.15.44:0/1376072529 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb88c06ce90 0x7fb88c0cf6f0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:39.971 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:39.977+0000 7fb890a00640 1 -- 172.21.15.44:0/1376072529 >> 172.21.15.44:0/1376072529 conn(0x7fb88c072320 msgr2=0x7fb88c075110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:47:39.971 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:39.977+0000 7fb890a00640 1 -- 172.21.15.44:0/1376072529 shutdown_connections 2024-04-17T19:47:39.971 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:39.977+0000 7fb890a00640 1 -- 172.21.15.44:0/1376072529 wait complete. 2024-04-17T19:47:39.989 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-17T19:47:40.143 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:40.153+0000 7f06ef400640 1 Processor -- start 2024-04-17T19:47:40.143 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:40.153+0000 7f06ef400640 1 -- start start 2024-04-17T19:47:40.145 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:40.153+0000 7f06ef400640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f06e80c45b0 0x7f06e80c9430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:40.145 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:40.153+0000 7f06ef400640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f06e8153c30 0x7f06e81641f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:40.145 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:40.153+0000 7f06ef400640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f06e806c330 con 0x7f06e80c36a0 2024-04-17T19:47:40.146 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:40.153+0000 7f06ef400640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 -- 0x7f06e806fb90 con 0x7f06e8153c30 2024-04-17T19:47:40.146 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:40.153+0000 7f06ef400640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7f06e806f5d0 con 0x7f06e80c45b0 2024-04-17T19:47:40.146 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:40.153+0000 7f06ed400640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f06e8153c30 0x7f06e81641f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:40.146 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:40.153+0000 7f06eca00640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f06e80c45b0 0x7f06e80c9430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:40.146 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:40.153+0000 7f06ed400640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f06e8153c30 0x7f06e81641f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:60752/0 (socket says 172.21.15.44:60752) 2024-04-17T19:47:40.146 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:40.153+0000 7f06ed400640 1 -- 172.21.15.44:0/599763124 learned_addr learned my addr 172.21.15.44:0/599763124 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-04-17T19:47:40.146 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:40.153+0000 7f06ed400640 1 -- 172.21.15.44:0/599763124 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f06e80c45b0 msgr2=0x7f06e80c9430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T19:47:40.146 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:40.153+0000 7f06ed400640 1 --2- 172.21.15.44:0/599763124 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f06e80c45b0 0x7f06e80c9430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:40.146 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:40.153+0000 7f06ed400640 1 -- 172.21.15.44:0/599763124 >> v1:172.21.15.62:6789/0 conn(0x7f06e80c36a0 legacy=0x7f06e80c7290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:40.146 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:40.153+0000 7f06ed400640 1 -- 172.21.15.44:0/599763124 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f06e806f8b0 con 0x7f06e8153c30 2024-04-17T19:47:40.148 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:40.157+0000 7f06ed400640 1 --2- 172.21.15.44:0/599763124 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f06e8153c30 0x7f06e81641f0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f06e0009e50 tx=0x7f06e001f210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d6af5c684afd9c69 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:47:40.148 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:40.157+0000 7f06e7400640 1 -- 172.21.15.44:0/599763124 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06e00b4070 con 0x7f06e8153c30 2024-04-17T19:47:40.149 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:40.157+0000 7f06e7400640 1 -- 172.21.15.44:0/599763124 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f06e00af400 con 0x7f06e8153c30 2024-04-17T19:47:40.149 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:40.157+0000 7f06e7400640 1 -- 172.21.15.44:0/599763124 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06e00af7d0 con 0x7f06e8153c30 2024-04-17T19:47:40.149 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:40.157+0000 7f06ef400640 1 -- 172.21.15.44:0/599763124 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f06e8153c30 msgr2=0x7f06e81641f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:40.149 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:40.157+0000 7f06ef400640 1 --2- 172.21.15.44:0/599763124 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f06e8153c30 0x7f06e81641f0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f06e0009e50 tx=0x7f06e001f210 comp rx=0 tx=0).stop 2024-04-17T19:47:40.149 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:40.157+0000 7f06ef400640 1 -- 172.21.15.44:0/599763124 shutdown_connections 2024-04-17T19:47:40.150 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:40.157+0000 7f06ef400640 1 --2- 172.21.15.44:0/599763124 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f06e8153c30 0x7f06e81641f0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:40.150 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:40.157+0000 7f06ef400640 1 --2- 172.21.15.44:0/599763124 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f06e80c45b0 0x7f06e80c9430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:40.150 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:40.157+0000 7f06ef400640 1 -- 172.21.15.44:0/599763124 >> 172.21.15.44:0/599763124 conn(0x7f06e8071900 msgr2=0x7f06e80cdb80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:47:40.150 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:40.157+0000 7f06ef400640 1 -- 172.21.15.44:0/599763124 shutdown_connections 2024-04-17T19:47:40.150 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:40.157+0000 7f06ef400640 1 -- 172.21.15.44:0/599763124 wait complete. 2024-04-17T19:47:40.151 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:40.161+0000 7f06ef400640 1 Processor -- start 2024-04-17T19:47:40.151 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:40.161+0000 7f06ef400640 1 -- start start 2024-04-17T19:47:40.154 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:40.161+0000 7f06ef400640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f06e80c36a0 0x7f06e81e0010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:40.154 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:40.161+0000 7f06ef400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f06e80c45b0 0x7f06e81f62c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:40.154 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:40.161+0000 7f06ef400640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f06e8153c30 0x7f06e81f2d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:40.155 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:40.161+0000 7f06ef400640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f06e8154040 con 0x7f06e80c45b0 2024-04-17T19:47:40.155 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:40.161+0000 7f06ef400640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f06e80c3ab0 con 0x7f06e80c36a0 2024-04-17T19:47:40.155 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:40.161+0000 7f06ef400640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7f06e806bf80 con 0x7f06e8153c30 2024-04-17T19:47:40.155 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:40.161+0000 7f06e7e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f06e80c45b0 0x7f06e81f62c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:40.155 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:40.161+0000 7f06e7e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f06e80c45b0 0x7f06e81f62c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:60754/0 (socket says 172.21.15.44:60754) 2024-04-17T19:47:40.155 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:40.161+0000 7f06e7e00640 1 -- 172.21.15.44:0/4283513581 learned_addr learned my addr 172.21.15.44:0/4283513581 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-04-17T19:47:40.155 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:40.161+0000 7f06eca00640 1 --2- 172.21.15.44:0/4283513581 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f06e80c36a0 0x7f06e81e0010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:40.155 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:40.161+0000 7f06ed400640 1 --2- 172.21.15.44:0/4283513581 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f06e8153c30 0x7f06e81f2d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:40.155 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:40.161+0000 7f06e7e00640 1 -- 172.21.15.44:0/4283513581 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f06e8153c30 msgr2=0x7f06e81f2d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:40.155 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:40.161+0000 7f06e7e00640 1 --2- 172.21.15.44:0/4283513581 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f06e8153c30 0x7f06e81f2d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:40.155 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:40.161+0000 7f06e7e00640 1 -- 172.21.15.44:0/4283513581 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f06e80c36a0 msgr2=0x7f06e81e0010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:40.155 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:40.161+0000 7f06e7e00640 1 --2- 172.21.15.44:0/4283513581 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f06e80c36a0 0x7f06e81e0010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:40.155 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:40.161+0000 7f06e7e00640 1 -- 172.21.15.44:0/4283513581 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f06e81f3290 con 0x7f06e80c45b0 2024-04-17T19:47:40.155 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:40.161+0000 7f06e7e00640 1 --2- 172.21.15.44:0/4283513581 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f06e80c45b0 0x7f06e81f62c0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f06d400c370 tx=0x7f06d400c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:47:40.155 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:40.161+0000 7f06e4c00640 1 -- 172.21.15.44:0/4283513581 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06d40052d0 con 0x7f06e80c45b0 2024-04-17T19:47:40.156 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:40.161+0000 7f06e4c00640 1 -- 172.21.15.44:0/4283513581 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f06d4005470 con 0x7f06e80c45b0 2024-04-17T19:47:40.156 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:40.161+0000 7f06e4c00640 1 -- 172.21.15.44:0/4283513581 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06d4007260 con 0x7f06e80c45b0 2024-04-17T19:47:40.156 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:40.161+0000 7f06ef400640 1 -- 172.21.15.44:0/4283513581 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f06e8150580 con 0x7f06e80c45b0 2024-04-17T19:47:40.156 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:40.165+0000 7f06ef400640 1 -- 172.21.15.44:0/4283513581 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f06e81f2550 con 0x7f06e80c45b0 2024-04-17T19:47:40.156 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:40.165+0000 7f06ef400640 1 -- 172.21.15.44:0/4283513581 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f06e8150aa0 con 0x7f06e80c45b0 2024-04-17T19:47:40.156 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:40.165+0000 7f06e4c00640 1 -- 172.21.15.44:0/4283513581 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f06d4007400 con 0x7f06e80c45b0 2024-04-17T19:47:40.158 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:40.165+0000 7f06e4c00640 1 --2- 172.21.15.44:0/4283513581 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f06c8068380 0x7f06c806a890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:40.158 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:40.165+0000 7f06e4c00640 1 -- 172.21.15.44:0/4283513581 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6619+0+0 (secure 0 0 0) 0x7f06d4086170 con 0x7f06e80c45b0 2024-04-17T19:47:40.158 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:40.165+0000 7f06eca00640 1 --2- 172.21.15.44:0/4283513581 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f06c8068380 0x7f06c806a890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:40.159 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:40.169+0000 7f06eca00640 1 --2- 172.21.15.44:0/4283513581 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f06c8068380 0x7f06c806a890 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f06dc009ac0 tx=0x7f06dc009190 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:47:40.162 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:40.169+0000 7f06e4c00640 1 -- 172.21.15.44:0/4283513581 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f06d4055cb0 con 0x7f06e80c45b0 2024-04-17T19:47:40.322 INFO:tasks.ceph.mds.b.smithi062.stderr:2024-04-17T19:47:40.333+0000 7f319ee9e640 -1 mds.pinger is_rank_lagging: rank=4 was never sent ping request. 2024-04-17T19:47:40.326 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:40.333+0000 7f06ef400640 1 -- 172.21.15.44:0/4283513581 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f06e81f2340 con 0x7f06e80c45b0 2024-04-17T19:47:40.327 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:40.337+0000 7f06e4c00640 1 -- 172.21.15.44:0/4283513581 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v27) ==== 104+0+11 (secure 0 0 0) 0x7f06d4059fb0 con 0x7f06e80c45b0 2024-04-17T19:47:40.327 INFO:teuthology.orchestra.run.smithi044.stdout:pg_num: 32 2024-04-17T19:47:40.329 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:40.337+0000 7f06ef400640 1 -- 172.21.15.44:0/4283513581 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f06c8068380 msgr2=0x7f06c806a890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:40.329 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:40.337+0000 7f06ef400640 1 --2- 172.21.15.44:0/4283513581 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f06c8068380 0x7f06c806a890 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f06dc009ac0 tx=0x7f06dc009190 comp rx=0 tx=0).stop 2024-04-17T19:47:40.329 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:40.337+0000 7f06ef400640 1 -- 172.21.15.44:0/4283513581 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f06e80c45b0 msgr2=0x7f06e81f62c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:40.329 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:40.337+0000 7f06ef400640 1 --2- 172.21.15.44:0/4283513581 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f06e80c45b0 0x7f06e81f62c0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f06d400c370 tx=0x7f06d400c830 comp rx=0 tx=0).stop 2024-04-17T19:47:40.329 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:40.337+0000 7f06ef400640 1 -- 172.21.15.44:0/4283513581 shutdown_connections 2024-04-17T19:47:40.329 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:40.337+0000 7f06ef400640 1 --2- 172.21.15.44:0/4283513581 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f06c8068380 0x7f06c806a890 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:40.329 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:40.337+0000 7f06ef400640 1 --2- 172.21.15.44:0/4283513581 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f06e8153c30 0x7f06e81f2d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:40.329 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:40.337+0000 7f06ef400640 1 --2- 172.21.15.44:0/4283513581 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f06e80c45b0 0x7f06e81f62c0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:40.330 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:40.337+0000 7f06ef400640 1 --2- 172.21.15.44:0/4283513581 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f06e80c36a0 0x7f06e81e0010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:40.330 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:40.337+0000 7f06ef400640 1 -- 172.21.15.44:0/4283513581 >> 172.21.15.44:0/4283513581 conn(0x7f06e8071900 msgr2=0x7f06e80cde90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:47:40.330 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:40.337+0000 7f06ef400640 1 -- 172.21.15.44:0/4283513581 shutdown_connections 2024-04-17T19:47:40.330 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:40.337+0000 7f06ef400640 1 -- 172.21.15.44:0/4283513581 wait complete. 2024-04-17T19:47:40.349 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-17T19:47:40.504 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:40.513+0000 7f97b2e00640 1 Processor -- start 2024-04-17T19:47:40.504 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:40.513+0000 7f97b2e00640 1 -- start start 2024-04-17T19:47:40.506 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:40.513+0000 7f97b2e00640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f97ac0c9720 0x7f97ac0c9b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:40.506 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:40.513+0000 7f97b2e00640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f97ac0709d0 0x7f97ac070de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:40.507 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:40.513+0000 7f97b2e00640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f97ac0c5170 con 0x7f97ac159850 2024-04-17T19:47:40.507 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:40.513+0000 7f97b2e00640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 -- 0x7f97ac070540 con 0x7f97ac0709d0 2024-04-17T19:47:40.507 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:40.513+0000 7f97b2e00640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 -- 0x7f97ac159d00 con 0x7f97ac0c9720 2024-04-17T19:47:40.507 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:40.513+0000 7f97abe00640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f97ac159850 0x7f97ac0ca4a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:41850/0 (socket says 172.21.15.44:41850) 2024-04-17T19:47:40.507 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:40.513+0000 7f97abe00640 1 -- 172.21.15.44:0/3880407677 learned_addr learned my addr 172.21.15.44:0/3880407677 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-04-17T19:47:40.507 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:40.513+0000 7f97b0e00640 1 --2- 172.21.15.44:0/3880407677 >> v2:172.21.15.44:3300/0 conn(0x7f97ac0709d0 0x7f97ac070de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:40.507 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:40.513+0000 7f97a3400640 1 --2- 172.21.15.44:0/3880407677 >> v2:172.21.15.62:3300/0 conn(0x7f97ac0c9720 0x7f97ac0c9b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:40.507 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:40.517+0000 7f97b0e00640 1 -- 172.21.15.44:0/3880407677 >> v2:172.21.15.62:3300/0 conn(0x7f97ac0c9720 msgr2=0x7f97ac0c9b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T19:47:40.507 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:40.517+0000 7f97b0e00640 1 --2- 172.21.15.44:0/3880407677 >> v2:172.21.15.62:3300/0 conn(0x7f97ac0c9720 0x7f97ac0c9b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:40.507 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:40.517+0000 7f97b0e00640 1 -- 172.21.15.44:0/3880407677 >> v1:172.21.15.44:6789/0 conn(0x7f97ac159850 legacy=0x7f97ac0ca4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:40.507 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:40.517+0000 7f97b0e00640 1 -- 172.21.15.44:0/3880407677 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f97ac159fe0 con 0x7f97ac0709d0 2024-04-17T19:47:40.509 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:40.517+0000 7f97b0e00640 1 --2- 172.21.15.44:0/3880407677 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f97ac0709d0 0x7f97ac070de0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f97ac0706c0 tx=0x7f97a401c930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7d0dd3e9b971c829 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:47:40.510 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:40.517+0000 7f97ab400640 1 -- 172.21.15.44:0/3880407677 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97a40b2070 con 0x7f97ac0709d0 2024-04-17T19:47:40.510 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:40.517+0000 7f97ab400640 1 -- 172.21.15.44:0/3880407677 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f97a40a57f0 con 0x7f97ac0709d0 2024-04-17T19:47:40.510 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:40.517+0000 7f97ab400640 1 -- 172.21.15.44:0/3880407677 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97a40a5bc0 con 0x7f97ac0709d0 2024-04-17T19:47:40.511 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:40.517+0000 7f97b2e00640 1 -- 172.21.15.44:0/3880407677 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f97ac0709d0 msgr2=0x7f97ac070de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:40.511 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:40.517+0000 7f97b2e00640 1 --2- 172.21.15.44:0/3880407677 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f97ac0709d0 0x7f97ac070de0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f97ac0706c0 tx=0x7f97a401c930 comp rx=0 tx=0).stop 2024-04-17T19:47:40.511 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:40.517+0000 7f97b2e00640 1 -- 172.21.15.44:0/3880407677 shutdown_connections 2024-04-17T19:47:40.511 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:40.517+0000 7f97b2e00640 1 --2- 172.21.15.44:0/3880407677 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f97ac0709d0 0x7f97ac070de0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:40.511 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:40.517+0000 7f97b2e00640 1 --2- 172.21.15.44:0/3880407677 >> v2:172.21.15.62:3300/0 conn(0x7f97ac0c9720 0x7f97ac0c9b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:40.511 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:40.517+0000 7f97b2e00640 1 -- 172.21.15.44:0/3880407677 >> 172.21.15.44:0/3880407677 conn(0x7f97ac0722e0 msgr2=0x7f97ac072720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:47:40.511 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:40.517+0000 7f97b2e00640 1 -- 172.21.15.44:0/3880407677 shutdown_connections 2024-04-17T19:47:40.511 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:40.521+0000 7f97b2e00640 1 -- 172.21.15.44:0/3880407677 wait complete. 2024-04-17T19:47:40.512 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:40.521+0000 7f97b2e00640 1 Processor -- start 2024-04-17T19:47:40.512 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:40.521+0000 7f97b2e00640 1 -- start start 2024-04-17T19:47:40.515 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:40.521+0000 7f97b2e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f97ac0709d0 0x7f97ac15d620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:40.515 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:40.521+0000 7f97b2e00640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f97ac0c9720 0x7f97ac14f620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:40.515 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:40.521+0000 7f97b2e00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f97ac159850 0x7f97ac1f5350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:40.515 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:40.521+0000 7f97b2e00640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f97ac166b70 con 0x7f97ac0709d0 2024-04-17T19:47:40.516 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:40.521+0000 7f97b2e00640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f97ac1669f0 con 0x7f97ac159850 2024-04-17T19:47:40.516 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:40.521+0000 7f97b2e00640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7f97ac166cf0 con 0x7f97ac0c9720 2024-04-17T19:47:40.516 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:40.521+0000 7f97abe00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f97ac0709d0 0x7f97ac15d620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:40.516 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:40.521+0000 7f97abe00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f97ac0709d0 0x7f97ac15d620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:60766/0 (socket says 172.21.15.44:60766) 2024-04-17T19:47:40.516 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:40.521+0000 7f97abe00640 1 -- 172.21.15.44:0/1537613080 learned_addr learned my addr 172.21.15.44:0/1537613080 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-04-17T19:47:40.516 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:40.525+0000 7f97b0e00640 1 --2- 172.21.15.44:0/1537613080 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f97ac159850 0x7f97ac1f5350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:40.516 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:40.525+0000 7f97a3400640 1 --2- 172.21.15.44:0/1537613080 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f97ac0c9720 0x7f97ac14f620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:40.516 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:40.525+0000 7f97abe00640 1 -- 172.21.15.44:0/1537613080 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f97ac0c9720 msgr2=0x7f97ac14f620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:40.516 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:40.525+0000 7f97abe00640 1 --2- 172.21.15.44:0/1537613080 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f97ac0c9720 0x7f97ac14f620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:40.516 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:40.525+0000 7f97abe00640 1 -- 172.21.15.44:0/1537613080 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f97ac159850 msgr2=0x7f97ac1f5350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:40.516 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:40.525+0000 7f97abe00640 1 --2- 172.21.15.44:0/1537613080 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f97ac159850 0x7f97ac1f5350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:40.516 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:40.525+0000 7f97abe00640 1 -- 172.21.15.44:0/1537613080 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f97ac0b4010 con 0x7f97ac0709d0 2024-04-17T19:47:40.516 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:40.525+0000 7f97b0e00640 1 --2- 172.21.15.44:0/1537613080 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f97ac159850 0x7f97ac1f5350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-17T19:47:40.516 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:40.525+0000 7f97abe00640 1 --2- 172.21.15.44:0/1537613080 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f97ac0709d0 0x7f97ac15d620 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f979c00c370 tx=0x7f979c00c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:47:40.517 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:40.525+0000 7f97a8c00640 1 -- 172.21.15.44:0/1537613080 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f979c017070 con 0x7f97ac0709d0 2024-04-17T19:47:40.517 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:40.525+0000 7f97a8c00640 1 -- 172.21.15.44:0/1537613080 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f979c005cf0 con 0x7f97ac0709d0 2024-04-17T19:47:40.517 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:40.525+0000 7f97a8c00640 1 -- 172.21.15.44:0/1537613080 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f979c0072f0 con 0x7f97ac0709d0 2024-04-17T19:47:40.517 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:40.525+0000 7f97b2e00640 1 -- 172.21.15.44:0/1537613080 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f97ac1f5890 con 0x7f97ac0709d0 2024-04-17T19:47:40.517 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:40.525+0000 7f97b2e00640 1 -- 172.21.15.44:0/1537613080 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f97ac1f8b80 con 0x7f97ac0709d0 2024-04-17T19:47:40.517 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:40.525+0000 7f97b2e00640 1 -- 172.21.15.44:0/1537613080 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f97ac1f50e0 con 0x7f97ac0709d0 2024-04-17T19:47:40.517 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:40.525+0000 7f97a8c00640 1 -- 172.21.15.44:0/1537613080 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f979c01a070 con 0x7f97ac0709d0 2024-04-17T19:47:40.518 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:40.525+0000 7f97a8c00640 1 --2- 172.21.15.44:0/1537613080 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f9788068380 0x7f978806a890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:40.518 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:40.525+0000 7f97a8c00640 1 -- 172.21.15.44:0/1537613080 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6619+0+0 (secure 0 0 0) 0x7f979c086030 con 0x7f97ac0709d0 2024-04-17T19:47:40.518 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:40.529+0000 7f97a3400640 1 --2- 172.21.15.44:0/1537613080 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f9788068380 0x7f978806a890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:40.519 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:40.529+0000 7f97a3400640 1 --2- 172.21.15.44:0/1537613080 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f9788068380 0x7f978806a890 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f97ac06ead0 tx=0x7f9794009190 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:47:40.523 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:40.533+0000 7f97a8c00640 1 -- 172.21.15.44:0/1537613080 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f97ac1f50e0 con 0x7f97ac0709d0 2024-04-17T19:47:40.687 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:40.697+0000 7f97b2e00640 1 -- 172.21.15.44:0/1537613080 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f97ac04ff10 con 0x7f97ac0709d0 2024-04-17T19:47:40.688 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:40.697+0000 7f97a8c00640 1 -- 172.21.15.44:0/1537613080 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v27) ==== 100+0+11 (secure 0 0 0) 0x7f979c055c10 con 0x7f97ac0709d0 2024-04-17T19:47:40.688 INFO:teuthology.orchestra.run.smithi044.stdout:pg_num: 64 2024-04-17T19:47:40.690 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:40.697+0000 7f97b2e00640 1 -- 172.21.15.44:0/1537613080 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f9788068380 msgr2=0x7f978806a890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:40.690 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:40.697+0000 7f97b2e00640 1 --2- 172.21.15.44:0/1537613080 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f9788068380 0x7f978806a890 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f97ac06ead0 tx=0x7f9794009190 comp rx=0 tx=0).stop 2024-04-17T19:47:40.690 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:40.697+0000 7f97b2e00640 1 -- 172.21.15.44:0/1537613080 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f97ac0709d0 msgr2=0x7f97ac15d620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:40.691 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:40.697+0000 7f97b2e00640 1 --2- 172.21.15.44:0/1537613080 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f97ac0709d0 0x7f97ac15d620 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f979c00c370 tx=0x7f979c00c830 comp rx=0 tx=0).stop 2024-04-17T19:47:40.691 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:40.697+0000 7f97b2e00640 1 -- 172.21.15.44:0/1537613080 shutdown_connections 2024-04-17T19:47:40.691 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:40.697+0000 7f97b2e00640 1 --2- 172.21.15.44:0/1537613080 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f9788068380 0x7f978806a890 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:40.691 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:40.697+0000 7f97b2e00640 1 --2- 172.21.15.44:0/1537613080 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f97ac0c9720 0x7f97ac14f620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:40.691 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:40.697+0000 7f97b2e00640 1 --2- 172.21.15.44:0/1537613080 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f97ac159850 0x7f97ac1f5350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:40.691 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:40.697+0000 7f97b2e00640 1 --2- 172.21.15.44:0/1537613080 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f97ac0709d0 0x7f97ac15d620 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:40.691 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:40.697+0000 7f97b2e00640 1 -- 172.21.15.44:0/1537613080 >> 172.21.15.44:0/1537613080 conn(0x7f97ac0722e0 msgr2=0x7f97ac163320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:47:40.691 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:40.697+0000 7f97b2e00640 1 -- 172.21.15.44:0/1537613080 shutdown_connections 2024-04-17T19:47:40.691 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:40.697+0000 7f97b2e00640 1 -- 172.21.15.44:0/1537613080 wait complete. 2024-04-17T19:47:40.711 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-04-17T19:47:40.869 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:40.877+0000 7f7735000640 1 Processor -- start 2024-04-17T19:47:40.869 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:40.877+0000 7f7735000640 1 -- start start 2024-04-17T19:47:40.871 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:40.881+0000 7f7735000640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f7730155d00 0x7f77300cf0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:40.871 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:40.881+0000 7f7735000640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f77300cf5e0 0x7f773006d450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:40.871 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:40.881+0000 7f7735000640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f77300c5f80 con 0x7f773015b980 2024-04-17T19:47:40.871 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:40.881+0000 7f7735000640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 -- 0x7f77300cf9f0 con 0x7f77300cf5e0 2024-04-17T19:47:40.871 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:40.881+0000 7f7735000640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7f77300c56e0 con 0x7f7730155d00 2024-04-17T19:47:40.872 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:40.881+0000 7f7727e00640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f7730155d00 0x7f77300cf0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:40.872 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:40.881+0000 7f772de00640 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f773015b980 0x7f773015f810 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.44:57962/0 (socket says 172.21.15.44:57962) 2024-04-17T19:47:40.872 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:40.881+0000 7f772de00640 1 -- 172.21.15.44:0/891476125 learned_addr learned my addr 172.21.15.44:0/891476125 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-04-17T19:47:40.872 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:40.881+0000 7f772e800640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f77300cf5e0 0x7f773006d450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:40.872 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:40.881+0000 7f7727e00640 1 -- 172.21.15.44:0/891476125 >> v2:172.21.15.62:3300/0 conn(0x7f77300cf5e0 msgr2=0x7f773006d450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T19:47:40.872 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:40.881+0000 7f7727e00640 1 --2- 172.21.15.44:0/891476125 >> v2:172.21.15.62:3300/0 conn(0x7f77300cf5e0 0x7f773006d450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:40.872 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:40.881+0000 7f7727e00640 1 -- 172.21.15.44:0/891476125 >> v1:172.21.15.62:6789/0 conn(0x7f773015b980 legacy=0x7f773015f810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:40.872 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:40.881+0000 7f7727e00640 1 -- 172.21.15.44:0/891476125 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f77300c59c0 con 0x7f7730155d00 2024-04-17T19:47:40.875 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:40.885+0000 7f7727e00640 1 --2- 172.21.15.44:0/891476125 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f7730155d00 0x7f77300cf0a0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f77180097c0 tx=0x7f771801ec90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5a9e10d794508857 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:47:40.875 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:40.885+0000 7f772d400640 1 -- 172.21.15.44:0/891476125 <== mon.2 v2:172.21.15.62:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77180b5070 con 0x7f7730155d00 2024-04-17T19:47:40.875 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:40.885+0000 7f772d400640 1 -- 172.21.15.44:0/891476125 <== mon.2 v2:172.21.15.62:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f77180a8990 con 0x7f7730155d00 2024-04-17T19:47:40.875 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:40.885+0000 7f772d400640 1 -- 172.21.15.44:0/891476125 <== mon.2 v2:172.21.15.62:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77180a8d60 con 0x7f7730155d00 2024-04-17T19:47:40.876 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:40.885+0000 7f7735000640 1 -- 172.21.15.44:0/891476125 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f7730155d00 msgr2=0x7f77300cf0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:40.876 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:40.885+0000 7f7735000640 1 --2- 172.21.15.44:0/891476125 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f7730155d00 0x7f77300cf0a0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f77180097c0 tx=0x7f771801ec90 comp rx=0 tx=0).stop 2024-04-17T19:47:40.876 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:40.885+0000 7f7735000640 1 -- 172.21.15.44:0/891476125 shutdown_connections 2024-04-17T19:47:40.876 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:40.885+0000 7f7735000640 1 --2- 172.21.15.44:0/891476125 >> v2:172.21.15.62:3300/0 conn(0x7f77300cf5e0 0x7f773006d450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:40.876 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:40.885+0000 7f7735000640 1 --2- 172.21.15.44:0/891476125 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f7730155d00 0x7f77300cf0a0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:40.876 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:40.885+0000 7f7735000640 1 -- 172.21.15.44:0/891476125 >> 172.21.15.44:0/891476125 conn(0x7f7730067eb0 msgr2=0x7f77300682c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:47:40.876 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:40.885+0000 7f7735000640 1 -- 172.21.15.44:0/891476125 shutdown_connections 2024-04-17T19:47:40.876 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:40.885+0000 7f7735000640 1 -- 172.21.15.44:0/891476125 wait complete. 2024-04-17T19:47:40.878 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:40.885+0000 7f7735000640 1 Processor -- start 2024-04-17T19:47:40.878 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:40.885+0000 7f7735000640 1 -- start start 2024-04-17T19:47:40.880 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:40.889+0000 7f7735000640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f77300cf5e0 0x7f77301e6c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:40.881 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:40.889+0000 7f7735000640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7730155d00 0x7f77300ccbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:40.881 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:40.889+0000 7f7735000640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f773015b980 0x7f77300cd110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:40.881 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:40.889+0000 7f7735000640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f773006d990 con 0x7f77300cf5e0 2024-04-17T19:47:40.881 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:40.889+0000 7f7735000640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f773015f010 con 0x7f7730155d00 2024-04-17T19:47:40.881 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:40.889+0000 7f7735000640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7f773006db10 con 0x7f773015b980 2024-04-17T19:47:40.881 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:40.889+0000 7f772de00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f77300cf5e0 0x7f77301e6c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:40.881 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:40.889+0000 7f772de00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f77300cf5e0 0x7f77301e6c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:60778/0 (socket says 172.21.15.44:60778) 2024-04-17T19:47:40.881 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:40.889+0000 7f772de00640 1 -- 172.21.15.44:0/2370288286 learned_addr learned my addr 172.21.15.44:0/2370288286 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-04-17T19:47:40.881 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:40.889+0000 7f772e800640 1 --2- 172.21.15.44:0/2370288286 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f773015b980 0x7f77300cd110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:40.881 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:40.889+0000 7f7727e00640 1 --2- 172.21.15.44:0/2370288286 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7730155d00 0x7f77300ccbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:40.881 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:40.889+0000 7f772de00640 1 -- 172.21.15.44:0/2370288286 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f773015b980 msgr2=0x7f77300cd110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:40.881 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:40.889+0000 7f772de00640 1 --2- 172.21.15.44:0/2370288286 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f773015b980 0x7f77300cd110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:40.881 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:40.889+0000 7f772de00640 1 -- 172.21.15.44:0/2370288286 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7730155d00 msgr2=0x7f77300ccbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:40.881 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:40.889+0000 7f772de00640 1 --2- 172.21.15.44:0/2370288286 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7730155d00 0x7f77300ccbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:40.882 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:40.889+0000 7f772de00640 1 -- 172.21.15.44:0/2370288286 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f77300ce170 con 0x7f77300cf5e0 2024-04-17T19:47:40.882 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:40.889+0000 7f772de00640 1 --2- 172.21.15.44:0/2370288286 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f77300cf5e0 0x7f77301e6c30 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f772000c3a0 tx=0x7f772000c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:47:40.882 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:40.889+0000 7f7726000640 1 -- 172.21.15.44:0/2370288286 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7720017070 con 0x7f77300cf5e0 2024-04-17T19:47:40.883 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:40.889+0000 7f7726000640 1 -- 172.21.15.44:0/2370288286 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7720005cf0 con 0x7f77300cf5e0 2024-04-17T19:47:40.883 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:40.889+0000 7f7726000640 1 -- 172.21.15.44:0/2370288286 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77200072f0 con 0x7f77300cf5e0 2024-04-17T19:47:40.883 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:40.889+0000 7f7735000640 1 -- 172.21.15.44:0/2370288286 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f77301e4f10 con 0x7f77300cf5e0 2024-04-17T19:47:40.883 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:40.889+0000 7f7735000640 1 -- 172.21.15.44:0/2370288286 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f773015ebe0 con 0x7f77300cf5e0 2024-04-17T19:47:40.883 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:40.889+0000 7f7735000640 1 -- 172.21.15.44:0/2370288286 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f773015ee20 con 0x7f77300cf5e0 2024-04-17T19:47:40.883 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:40.893+0000 7f7726000640 1 -- 172.21.15.44:0/2370288286 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f772001a070 con 0x7f77300cf5e0 2024-04-17T19:47:40.884 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:40.893+0000 7f7726000640 1 --2- 172.21.15.44:0/2370288286 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f770c0683b0 0x7f770c06a8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:40.884 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:40.893+0000 7f7726000640 1 -- 172.21.15.44:0/2370288286 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6619+0+0 (secure 0 0 0) 0x7f7720085fe0 con 0x7f77300cf5e0 2024-04-17T19:47:40.885 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:40.893+0000 7f7727e00640 1 --2- 172.21.15.44:0/2370288286 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f770c0683b0 0x7f770c06a8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:40.886 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:40.893+0000 7f7727e00640 1 --2- 172.21.15.44:0/2370288286 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f770c0683b0 0x7f770c06a8c0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f77180b2000 tx=0x7f7718008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:47:40.889 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:40.897+0000 7f7726000640 1 -- 172.21.15.44:0/2370288286 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f7720055b50 con 0x7f77300cf5e0 2024-04-17T19:47:41.053 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:41.061+0000 7f7735000640 1 -- 172.21.15.44:0/2370288286 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) -- 0x7f773004ff10 con 0x7f77300cf5e0 2024-04-17T19:47:41.053 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:41.061+0000 7f7726000640 1 -- 172.21.15.44:0/2370288286 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v27) ==== 103+0+11 (secure 0 0 0) 0x7f7720059e50 con 0x7f77300cf5e0 2024-04-17T19:47:41.054 INFO:teuthology.orchestra.run.smithi044.stdout:pg_num: 32 2024-04-17T19:47:41.056 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:41.065+0000 7f7735000640 1 -- 172.21.15.44:0/2370288286 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f770c0683b0 msgr2=0x7f770c06a8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:41.056 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:41.065+0000 7f7735000640 1 --2- 172.21.15.44:0/2370288286 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f770c0683b0 0x7f770c06a8c0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f77180b2000 tx=0x7f7718008040 comp rx=0 tx=0).stop 2024-04-17T19:47:41.056 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:41.065+0000 7f7735000640 1 -- 172.21.15.44:0/2370288286 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f77300cf5e0 msgr2=0x7f77301e6c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:41.056 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:41.065+0000 7f7735000640 1 --2- 172.21.15.44:0/2370288286 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f77300cf5e0 0x7f77301e6c30 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f772000c3a0 tx=0x7f772000c860 comp rx=0 tx=0).stop 2024-04-17T19:47:41.056 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:41.065+0000 7f7735000640 1 -- 172.21.15.44:0/2370288286 shutdown_connections 2024-04-17T19:47:41.056 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:41.065+0000 7f7735000640 1 --2- 172.21.15.44:0/2370288286 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f770c0683b0 0x7f770c06a8c0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:41.056 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:41.065+0000 7f7735000640 1 --2- 172.21.15.44:0/2370288286 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f773015b980 0x7f77300cd110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:41.056 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:41.065+0000 7f7735000640 1 --2- 172.21.15.44:0/2370288286 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7730155d00 0x7f77300ccbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:41.056 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:41.065+0000 7f7735000640 1 --2- 172.21.15.44:0/2370288286 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f77300cf5e0 0x7f77301e6c30 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:41.056 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:41.065+0000 7f7735000640 1 -- 172.21.15.44:0/2370288286 >> 172.21.15.44:0/2370288286 conn(0x7f7730067eb0 msgr2=0x7f77300682c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:47:41.056 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:41.065+0000 7f7735000640 1 -- 172.21.15.44:0/2370288286 shutdown_connections 2024-04-17T19:47:41.056 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:41.065+0000 7f7735000640 1 -- 172.21.15.44:0/2370288286 wait complete. 2024-04-17T19:47:41.076 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-17T19:47:41.226 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:41.233+0000 7f60f8000640 1 Processor -- start 2024-04-17T19:47:41.226 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:41.237+0000 7f60f8000640 1 -- start start 2024-04-17T19:47:41.228 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:41.237+0000 7f60f8000640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f60f0152a60 0x7f60f00c6920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:41.229 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:41.237+0000 7f60f8000640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f60f0158eb0 0x7f60f01592c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:41.229 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:41.237+0000 7f60f8000640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f60f00c47c0 0x7f60f00c4bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:41.229 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:41.237+0000 7f60f8000640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 -- 0x7f60f0152e70 con 0x7f60f00c47c0 2024-04-17T19:47:41.229 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:41.237+0000 7f60f8000640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 -- 0x7f60f00c52c0 con 0x7f60f0158eb0 2024-04-17T19:47:41.229 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:41.237+0000 7f60f8000640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7f60f00c8840 con 0x7f60f0152a60 2024-04-17T19:47:41.229 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:41.237+0000 7f60f6000640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f60f00c47c0 0x7f60f00c4bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:41.229 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:41.237+0000 7f60f5600640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f60f0152a60 0x7f60f00c6920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:41.229 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:41.237+0000 7f60f6000640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f60f00c47c0 0x7f60f00c4bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:60792/0 (socket says 172.21.15.44:60792) 2024-04-17T19:47:41.229 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:41.237+0000 7f60f6000640 1 -- 172.21.15.44:0/1498657791 learned_addr learned my addr 172.21.15.44:0/1498657791 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-04-17T19:47:41.229 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:41.237+0000 7f60f4c00640 1 --2- 172.21.15.44:0/1498657791 >> v2:172.21.15.62:3300/0 conn(0x7f60f0158eb0 0x7f60f01592c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:41.230 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:41.237+0000 7f60f5600640 1 -- 172.21.15.44:0/1498657791 >> v2:172.21.15.62:3300/0 conn(0x7f60f0158eb0 msgr2=0x7f60f01592c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T19:47:41.230 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:41.237+0000 7f60f5600640 1 --2- 172.21.15.44:0/1498657791 >> v2:172.21.15.62:3300/0 conn(0x7f60f0158eb0 0x7f60f01592c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:41.230 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:41.237+0000 7f60f5600640 1 -- 172.21.15.44:0/1498657791 >> v2:172.21.15.44:3300/0 conn(0x7f60f00c47c0 msgr2=0x7f60f00c4bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T19:47:41.230 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:41.237+0000 7f60f5600640 1 --2- 172.21.15.44:0/1498657791 >> v2:172.21.15.44:3300/0 conn(0x7f60f00c47c0 0x7f60f00c4bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:41.230 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:41.237+0000 7f60f5600640 1 -- 172.21.15.44:0/1498657791 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f60f00c8b20 con 0x7f60f0152a60 2024-04-17T19:47:41.230 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:41.237+0000 7f60f6000640 1 --2- 172.21.15.44:0/1498657791 >> v2:172.21.15.44:3300/0 conn(0x7f60f00c47c0 0x7f60f00c4bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-17T19:47:41.232 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:41.241+0000 7f60f5600640 1 --2- 172.21.15.44:0/1498657791 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f60f0152a60 0x7f60f00c6920 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f60f006cca0 tx=0x7f60e401ec70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=16b0db3e0f5072d9 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:47:41.233 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:41.241+0000 7f60efe00640 1 -- 172.21.15.44:0/1498657791 <== mon.2 v2:172.21.15.62:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60e40b5070 con 0x7f60f0152a60 2024-04-17T19:47:41.233 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:41.241+0000 7f60efe00640 1 -- 172.21.15.44:0/1498657791 <== mon.2 v2:172.21.15.62:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f60e40a8930 con 0x7f60f0152a60 2024-04-17T19:47:41.233 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:41.241+0000 7f60efe00640 1 -- 172.21.15.44:0/1498657791 <== mon.2 v2:172.21.15.62:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60e40a8d00 con 0x7f60f0152a60 2024-04-17T19:47:41.233 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:41.241+0000 7f60f8000640 1 -- 172.21.15.44:0/1498657791 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f60f0152a60 msgr2=0x7f60f00c6920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:41.234 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:41.241+0000 7f60f8000640 1 --2- 172.21.15.44:0/1498657791 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f60f0152a60 0x7f60f00c6920 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f60f006cca0 tx=0x7f60e401ec70 comp rx=0 tx=0).stop 2024-04-17T19:47:41.234 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:41.241+0000 7f60f8000640 1 -- 172.21.15.44:0/1498657791 shutdown_connections 2024-04-17T19:47:41.234 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:41.241+0000 7f60f8000640 1 --2- 172.21.15.44:0/1498657791 >> v2:172.21.15.44:3300/0 conn(0x7f60f00c47c0 0x7f60f00c4bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:41.234 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:41.241+0000 7f60f8000640 1 --2- 172.21.15.44:0/1498657791 >> v2:172.21.15.62:3300/0 conn(0x7f60f0158eb0 0x7f60f01592c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:41.234 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:41.241+0000 7f60f8000640 1 --2- 172.21.15.44:0/1498657791 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f60f0152a60 0x7f60f00c6920 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:41.234 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:41.241+0000 7f60f8000640 1 -- 172.21.15.44:0/1498657791 >> 172.21.15.44:0/1498657791 conn(0x7f60f006c380 msgr2=0x7f60f0070080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:47:41.234 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:41.241+0000 7f60f8000640 1 -- 172.21.15.44:0/1498657791 shutdown_connections 2024-04-17T19:47:41.234 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:41.241+0000 7f60f8000640 1 -- 172.21.15.44:0/1498657791 wait complete. 2024-04-17T19:47:41.235 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:41.245+0000 7f60f8000640 1 Processor -- start 2024-04-17T19:47:41.235 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:41.245+0000 7f60f8000640 1 -- start start 2024-04-17T19:47:41.238 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:41.245+0000 7f60f8000640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f60f00c47c0 0x7f60f01f5a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:41.238 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:41.245+0000 7f60f8000640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f60f0152a60 0x7f60f01e1f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:41.238 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:41.245+0000 7f60f8000640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f60f0158eb0 0x7f60f014d640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:41.238 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:41.245+0000 7f60f8000640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f60f0158990 con 0x7f60f00c47c0 2024-04-17T19:47:41.239 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:41.245+0000 7f60f8000640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f60f00c90e0 con 0x7f60f0152a60 2024-04-17T19:47:41.239 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:41.245+0000 7f60f8000640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7f60f00c6e60 con 0x7f60f0158eb0 2024-04-17T19:47:41.239 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:41.245+0000 7f60f5600640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f60f00c47c0 0x7f60f01f5a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:41.239 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:41.245+0000 7f60f5600640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f60f00c47c0 0x7f60f01f5a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:60808/0 (socket says 172.21.15.44:60808) 2024-04-17T19:47:41.239 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:41.245+0000 7f60f5600640 1 -- 172.21.15.44:0/1111196353 learned_addr learned my addr 172.21.15.44:0/1111196353 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-04-17T19:47:41.239 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:41.245+0000 7f60f4c00640 1 --2- 172.21.15.44:0/1111196353 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f60f0152a60 0x7f60f01e1f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:41.239 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:41.245+0000 7f60f6000640 1 --2- 172.21.15.44:0/1111196353 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f60f0158eb0 0x7f60f014d640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:41.239 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:41.245+0000 7f60f5600640 1 -- 172.21.15.44:0/1111196353 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f60f0158eb0 msgr2=0x7f60f014d640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:41.239 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:41.245+0000 7f60f5600640 1 --2- 172.21.15.44:0/1111196353 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f60f0158eb0 0x7f60f014d640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:41.239 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:41.245+0000 7f60f5600640 1 -- 172.21.15.44:0/1111196353 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f60f0152a60 msgr2=0x7f60f01e1f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:41.239 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:41.245+0000 7f60f5600640 1 --2- 172.21.15.44:0/1111196353 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f60f0152a60 0x7f60f01e1f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:41.239 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:41.245+0000 7f60f5600640 1 -- 172.21.15.44:0/1111196353 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f60f01f5f50 con 0x7f60f00c47c0 2024-04-17T19:47:41.239 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:41.245+0000 7f60f5600640 1 --2- 172.21.15.44:0/1111196353 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f60f00c47c0 0x7f60f01f5a10 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f60e40b3040 tx=0x7f60e401ba10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:47:41.239 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:41.245+0000 7f60ed600640 1 -- 172.21.15.44:0/1111196353 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60e40bf070 con 0x7f60f00c47c0 2024-04-17T19:47:41.239 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:41.245+0000 7f60ed600640 1 -- 172.21.15.44:0/1111196353 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f60e40b0660 con 0x7f60f00c47c0 2024-04-17T19:47:41.240 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:41.245+0000 7f60ed600640 1 -- 172.21.15.44:0/1111196353 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60e40b5040 con 0x7f60f00c47c0 2024-04-17T19:47:41.240 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:41.245+0000 7f60f8000640 1 -- 172.21.15.44:0/1111196353 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f60f01df4f0 con 0x7f60f00c47c0 2024-04-17T19:47:41.240 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:41.249+0000 7f60f8000640 1 -- 172.21.15.44:0/1111196353 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f60f0157750 con 0x7f60f00c47c0 2024-04-17T19:47:41.240 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:41.249+0000 7f60f8000640 1 -- 172.21.15.44:0/1111196353 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f60f004ff10 con 0x7f60f00c47c0 2024-04-17T19:47:41.240 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:41.249+0000 7f60ed600640 1 -- 172.21.15.44:0/1111196353 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f60e40c2070 con 0x7f60f00c47c0 2024-04-17T19:47:41.241 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:41.249+0000 7f60ed600640 1 --2- 172.21.15.44:0/1111196353 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f60d00683b0 0x7f60d006a8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:41.242 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:41.249+0000 7f60ed600640 1 -- 172.21.15.44:0/1111196353 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6619+0+0 (secure 0 0 0) 0x7f60e4123320 con 0x7f60f00c47c0 2024-04-17T19:47:41.242 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:41.249+0000 7f60f4c00640 1 --2- 172.21.15.44:0/1111196353 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f60d00683b0 0x7f60d006a8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:41.242 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:41.253+0000 7f60f4c00640 1 --2- 172.21.15.44:0/1111196353 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f60d00683b0 0x7f60d006a8c0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f60f00cb040 tx=0x7f60dc009190 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:47:41.245 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:41.253+0000 7f60ed600640 1 -- 172.21.15.44:0/1111196353 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f60e40187d0 con 0x7f60f00c47c0 2024-04-17T19:47:41.444 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:41.453+0000 7f60f8000640 1 -- 172.21.15.44:0/1111196353 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f60f00c7ea0 con 0x7f60f00c47c0 2024-04-17T19:47:41.445 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:41.453+0000 7f60ed600640 1 -- 172.21.15.44:0/1111196353 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 18 v18) ==== 94+0+6911 (secure 0 0 0) 0x7f60e41230e0 con 0x7f60f00c47c0 2024-04-17T19:47:41.445 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-04-17T19:47:41.445 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":18,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4263,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.44:6835/1724891996","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6832","nonce":1724891996},{"type":"v1","addr":"172.21.15.44:6835","nonce":1724891996}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":18,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-17T19:46:56.083202+0000","modified":"2024-04-17T19:47:39.954509+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":4306,"mds_1":4294,"mds_2":4269,"mds_3":4268,"mds_4":4266},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4266":{"gid":4266,"name":"c","rank":4,"incarnation":17,"state":"up:active","state_seq":14,"addr":"172.21.15.44:6836/2201911513","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6833","nonce":2201911513},{"type":"v1","addr":"172.21.15.44:6836","nonce":2201911513}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4268":{"gid":4268,"name":"f","rank":3,"incarnation":15,"state":"up:active","state_seq":13,"addr":"172.21.15.62:6837/3085335335","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6836","nonce":3085335335},{"type":"v1","addr":"172.21.15.62:6837","nonce":3085335335}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4269":{"gid":4269,"name":"e","rank":2,"incarnation":13,"state":"up:active","state_seq":11,"addr":"172.21.15.44:6837/4073536070","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6834","nonce":4073536070},{"type":"v1","addr":"172.21.15.44:6837","nonce":4073536070}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4294":{"gid":4294,"name":"d","rank":1,"incarnation":9,"state":"up:active","state_seq":10,"addr":"172.21.15.62:6835/2585862759","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6834","nonce":2585862759},{"type":"v1","addr":"172.21.15.62:6835","nonce":2585862759}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4306":{"gid":4306,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":5,"addr":"172.21.15.62:6839/1537667111","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6838","nonce":1537667111},{"type":"v1","addr":"172.21.15.62:6839","nonce":1537667111}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4306,"qdb_cluster":[4266,4268,4294,4269,4306]},"id":1}]} 2024-04-17T19:47:41.446 INFO:teuthology.orchestra.run.smithi044.stderr:dumped fsmap epoch 18 2024-04-17T19:47:41.447 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:41.457+0000 7f60f8000640 1 -- 172.21.15.44:0/1111196353 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f60d00683b0 msgr2=0x7f60d006a8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:41.447 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:41.457+0000 7f60f8000640 1 --2- 172.21.15.44:0/1111196353 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f60d00683b0 0x7f60d006a8c0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f60f00cb040 tx=0x7f60dc009190 comp rx=0 tx=0).stop 2024-04-17T19:47:41.447 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:41.457+0000 7f60f8000640 1 -- 172.21.15.44:0/1111196353 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f60f00c47c0 msgr2=0x7f60f01f5a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:41.447 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:41.457+0000 7f60f8000640 1 --2- 172.21.15.44:0/1111196353 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f60f00c47c0 0x7f60f01f5a10 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f60e40b3040 tx=0x7f60e401ba10 comp rx=0 tx=0).stop 2024-04-17T19:47:41.447 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:41.457+0000 7f60f8000640 1 -- 172.21.15.44:0/1111196353 shutdown_connections 2024-04-17T19:47:41.448 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:41.457+0000 7f60f8000640 1 --2- 172.21.15.44:0/1111196353 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f60d00683b0 0x7f60d006a8c0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:41.448 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:41.457+0000 7f60f8000640 1 --2- 172.21.15.44:0/1111196353 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f60f0158eb0 0x7f60f014d640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:41.448 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:41.457+0000 7f60f8000640 1 --2- 172.21.15.44:0/1111196353 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f60f0152a60 0x7f60f01e1f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:41.448 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:41.457+0000 7f60f8000640 1 --2- 172.21.15.44:0/1111196353 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f60f00c47c0 0x7f60f01f5a10 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:41.448 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:41.457+0000 7f60f8000640 1 -- 172.21.15.44:0/1111196353 >> 172.21.15.44:0/1111196353 conn(0x7f60f006c380 msgr2=0x7f60f0151380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:47:41.448 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:41.457+0000 7f60f8000640 1 -- 172.21.15.44:0/1111196353 shutdown_connections 2024-04-17T19:47:41.448 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:41.457+0000 7f60f8000640 1 -- 172.21.15.44:0/1111196353 wait complete. 2024-04-17T19:47:41.468 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-17T19:47:41.619 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:41.625+0000 7f7b76800640 1 Processor -- start 2024-04-17T19:47:41.619 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:41.629+0000 7f7b76800640 1 -- start start 2024-04-17T19:47:41.621 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:41.629+0000 7f7b76800640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f7b70158eb0 0x7f7b701592c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:41.621 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:41.629+0000 7f7b76800640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f7b700c47c0 0x7f7b700c4bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:41.621 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:41.629+0000 7f7b76800640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7b70152e70 con 0x7f7b70152a60 2024-04-17T19:47:41.621 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:41.629+0000 7f7b76800640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 -- 0x7f7b700c52c0 con 0x7f7b700c47c0 2024-04-17T19:47:41.621 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:41.629+0000 7f7b76800640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7f7b700c8840 con 0x7f7b70158eb0 2024-04-17T19:47:41.621 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:41.629+0000 7f7b6fe00640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f7b700c47c0 0x7f7b700c4bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:41.621 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:41.629+0000 7f7b6f400640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f7b70152a60 0x7f7b700c6920 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:41866/0 (socket says 172.21.15.44:41866) 2024-04-17T19:47:41.622 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:41.629+0000 7f7b6f400640 1 -- 172.21.15.44:0/3608903070 learned_addr learned my addr 172.21.15.44:0/3608903070 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-04-17T19:47:41.622 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:41.629+0000 7f7b6ea00640 1 --2- 172.21.15.44:0/3608903070 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f7b70158eb0 0x7f7b701592c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:41.622 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:41.629+0000 7f7b6fe00640 1 -- 172.21.15.44:0/3608903070 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f7b70158eb0 msgr2=0x7f7b701592c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T19:47:41.622 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:41.629+0000 7f7b6fe00640 1 --2- 172.21.15.44:0/3608903070 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f7b70158eb0 0x7f7b701592c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:41.622 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:41.629+0000 7f7b6fe00640 1 -- 172.21.15.44:0/3608903070 >> v1:172.21.15.44:6789/0 conn(0x7f7b70152a60 legacy=0x7f7b700c6920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:41.622 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:41.629+0000 7f7b6fe00640 1 -- 172.21.15.44:0/3608903070 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7b700c8b20 con 0x7f7b700c47c0 2024-04-17T19:47:41.622 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:41.629+0000 7f7b6ea00640 1 --2- 172.21.15.44:0/3608903070 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f7b70158eb0 0x7f7b701592c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-17T19:47:41.624 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:41.633+0000 7f7b6fe00640 1 --2- 172.21.15.44:0/3608903070 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7b700c47c0 0x7f7b700c4bd0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f7b70153040 tx=0x7f7b6801c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a35febdd4f6ef9a7 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:47:41.624 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:41.633+0000 7f7b6e000640 1 -- 172.21.15.44:0/3608903070 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b680b2070 con 0x7f7b700c47c0 2024-04-17T19:47:41.624 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:41.633+0000 7f7b6e000640 1 -- 172.21.15.44:0/3608903070 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7b680a5810 con 0x7f7b700c47c0 2024-04-17T19:47:41.624 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:41.633+0000 7f7b6e000640 1 -- 172.21.15.44:0/3608903070 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b680a5be0 con 0x7f7b700c47c0 2024-04-17T19:47:41.625 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:41.633+0000 7f7b76800640 1 -- 172.21.15.44:0/3608903070 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7b700c47c0 msgr2=0x7f7b700c4bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:41.625 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:41.633+0000 7f7b76800640 1 --2- 172.21.15.44:0/3608903070 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7b700c47c0 0x7f7b700c4bd0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f7b70153040 tx=0x7f7b6801c950 comp rx=0 tx=0).stop 2024-04-17T19:47:41.625 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:41.633+0000 7f7b76800640 1 -- 172.21.15.44:0/3608903070 shutdown_connections 2024-04-17T19:47:41.625 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:41.633+0000 7f7b76800640 1 --2- 172.21.15.44:0/3608903070 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7b700c47c0 0x7f7b700c4bd0 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:41.625 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:41.633+0000 7f7b76800640 1 --2- 172.21.15.44:0/3608903070 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f7b70158eb0 0x7f7b701592c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:41.626 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:41.633+0000 7f7b76800640 1 -- 172.21.15.44:0/3608903070 >> 172.21.15.44:0/3608903070 conn(0x7f7b7006c380 msgr2=0x7f7b70070080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:47:41.626 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:41.633+0000 7f7b76800640 1 -- 172.21.15.44:0/3608903070 shutdown_connections 2024-04-17T19:47:41.626 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:41.633+0000 7f7b76800640 1 -- 172.21.15.44:0/3608903070 wait complete. 2024-04-17T19:47:41.627 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:41.637+0000 7f7b76800640 1 Processor -- start 2024-04-17T19:47:41.627 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:41.637+0000 7f7b76800640 1 -- start start 2024-04-17T19:47:41.629 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:41.637+0000 7f7b76800640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7b700c47c0 0x7f7b7014e510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:41.629 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:41.637+0000 7f7b76800640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7b70152a60 0x7f7b7013f220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:41.629 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:41.637+0000 7f7b76800640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f7b70158eb0 0x7f7b7013f760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:41.630 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:41.637+0000 7f7b76800640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f7b70165aa0 con 0x7f7b70152a60 2024-04-17T19:47:41.630 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:41.637+0000 7f7b76800640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f7b70165920 con 0x7f7b700c47c0 2024-04-17T19:47:41.630 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:41.637+0000 7f7b76800640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7f7b70165c20 con 0x7f7b70158eb0 2024-04-17T19:47:41.630 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:41.637+0000 7f7b6ea00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7b70152a60 0x7f7b7013f220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:41.630 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:41.637+0000 7f7b6f400640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7b700c47c0 0x7f7b7014e510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:41.630 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:41.637+0000 7f7b6ea00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7b70152a60 0x7f7b7013f220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:60832/0 (socket says 172.21.15.44:60832) 2024-04-17T19:47:41.630 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:41.637+0000 7f7b6ea00640 1 -- 172.21.15.44:0/2789558729 learned_addr learned my addr 172.21.15.44:0/2789558729 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-04-17T19:47:41.630 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:41.637+0000 7f7b6fe00640 1 --2- 172.21.15.44:0/2789558729 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f7b70158eb0 0x7f7b7013f760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:41.631 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:41.637+0000 7f7b6ea00640 1 -- 172.21.15.44:0/2789558729 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f7b70158eb0 msgr2=0x7f7b7013f760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:41.631 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:41.637+0000 7f7b6ea00640 1 --2- 172.21.15.44:0/2789558729 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f7b70158eb0 0x7f7b7013f760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:41.631 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:41.637+0000 7f7b6ea00640 1 -- 172.21.15.44:0/2789558729 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7b700c47c0 msgr2=0x7f7b7014e510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:41.631 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:41.637+0000 7f7b6ea00640 1 --2- 172.21.15.44:0/2789558729 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7b700c47c0 0x7f7b7014e510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:41.631 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:41.637+0000 7f7b6ea00640 1 -- 172.21.15.44:0/2789558729 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7b7014ea50 con 0x7f7b70152a60 2024-04-17T19:47:41.631 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:41.637+0000 7f7b6ea00640 1 --2- 172.21.15.44:0/2789558729 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7b70152a60 0x7f7b7013f220 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f7b5c00e980 tx=0x7f7b5c00ee40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:47:41.631 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:41.637+0000 7f7b67400640 1 -- 172.21.15.44:0/2789558729 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b5c017070 con 0x7f7b70152a60 2024-04-17T19:47:41.631 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:41.637+0000 7f7b67400640 1 -- 172.21.15.44:0/2789558729 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7b5c00c9a0 con 0x7f7b70152a60 2024-04-17T19:47:41.632 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:41.637+0000 7f7b67400640 1 -- 172.21.15.44:0/2789558729 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b5c00cd70 con 0x7f7b70152a60 2024-04-17T19:47:41.632 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:41.637+0000 7f7b76800640 1 -- 172.21.15.44:0/2789558729 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7b7014cdf0 con 0x7f7b70152a60 2024-04-17T19:47:41.632 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:41.641+0000 7f7b76800640 1 -- 172.21.15.44:0/2789558729 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7b7014d390 con 0x7f7b70152a60 2024-04-17T19:47:41.632 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:41.641+0000 7f7b76800640 1 -- 172.21.15.44:0/2789558729 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7b7004ff10 con 0x7f7b70152a60 2024-04-17T19:47:41.632 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:41.641+0000 7f7b67400640 1 -- 172.21.15.44:0/2789558729 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f7b5c01a070 con 0x7f7b70152a60 2024-04-17T19:47:41.633 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:41.641+0000 7f7b67400640 1 --2- 172.21.15.44:0/2789558729 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f7b500683b0 0x7f7b5006a8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:41.633 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:41.641+0000 7f7b67400640 1 -- 172.21.15.44:0/2789558729 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6619+0+0 (secure 0 0 0) 0x7f7b5c086c80 con 0x7f7b70152a60 2024-04-17T19:47:41.634 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:41.641+0000 7f7b6f400640 1 --2- 172.21.15.44:0/2789558729 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f7b500683b0 0x7f7b5006a8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:41.635 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:41.645+0000 7f7b6f400640 1 --2- 172.21.15.44:0/2789558729 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f7b500683b0 0x7f7b5006a8c0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f7b60000f70 tx=0x7f7b60007e90 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:47:41.637 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:41.645+0000 7f7b67400640 1 -- 172.21.15.44:0/2789558729 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f7b5c056730 con 0x7f7b70152a60 2024-04-17T19:47:41.804 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:41.813+0000 7f7b76800640 1 -- 172.21.15.44:0/2789558729 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f7b700c7ea0 con 0x7f7b70152a60 2024-04-17T19:47:41.806 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:41.813+0000 7f7b67400640 1 -- 172.21.15.44:0/2789558729 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) ==== 74+0+18623 (secure 0 0 0) 0x7f7b5c05aa30 con 0x7f7b70152a60 2024-04-17T19:47:41.806 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-04-17T19:47:41.806 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":27,"fsid":"703f77ca-79c6-4a66-b576-62c526cb1021","created":"2024-04-17T19:46:30.831994+0000","modified":"2024-04-17T19:47:37.943331+0000","last_up_change":"2024-04-17T19:46:41.988197+0000","last_in_change":"2024-04-17T19:46:33.407430+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-17T19:46:41.940380+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-17T19:46:54.222150+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-17T19:46:55.031694+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-17T19:46:58.707529+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"30520dc6-eea6-43d4-ab60-3ca9e92329dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6800","nonce":1018735925},{"type":"v1","addr":"172.21.15.44:6801","nonce":1018735925}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6802","nonce":1018735925},{"type":"v1","addr":"172.21.15.44:6803","nonce":1018735925}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6806","nonce":1018735925},{"type":"v1","addr":"172.21.15.44:6807","nonce":1018735925}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6804","nonce":1018735925},{"type":"v1","addr":"172.21.15.44:6805","nonce":1018735925}]},"public_addr":"172.21.15.44:6801/1018735925","cluster_addr":"172.21.15.44:6803/1018735925","heartbeat_back_addr":"172.21.15.44:6807/1018735925","heartbeat_front_addr":"172.21.15.44:6805/1018735925","state":["exists","up"]},{"osd":1,"uuid":"079bd511-b6ce-449b-8f11-17b311b12f7c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6817","nonce":1452577434},{"type":"v1","addr":"172.21.15.44:6820","nonce":1452577434}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6823","nonce":1452577434},{"type":"v1","addr":"172.21.15.44:6825","nonce":1452577434}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6830","nonce":1452577434},{"type":"v1","addr":"172.21.15.44:6831","nonce":1452577434}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6828","nonce":1452577434},{"type":"v1","addr":"172.21.15.44:6829","nonce":1452577434}]},"public_addr":"172.21.15.44:6820/1452577434","cluster_addr":"172.21.15.44:6825/1452577434","heartbeat_back_addr":"172.21.15.44:6831/1452577434","heartbeat_front_addr":"172.21.15.44:6829/1452577434","state":["exists","up"]},{"osd":2,"uuid":"34f0b9ab-b1d2-4ee9-841c-f15afbb6bec5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6816","nonce":1160071918},{"type":"v1","addr":"172.21.15.44:6818","nonce":1160071918}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6819","nonce":1160071918},{"type":"v1","addr":"172.21.15.44:6821","nonce":1160071918}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6826","nonce":1160071918},{"type":"v1","addr":"172.21.15.44:6827","nonce":1160071918}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6822","nonce":1160071918},{"type":"v1","addr":"172.21.15.44:6824","nonce":1160071918}]},"public_addr":"172.21.15.44:6818/1160071918","cluster_addr":"172.21.15.44:6821/1160071918","heartbeat_back_addr":"172.21.15.44:6827/1160071918","heartbeat_front_addr":"172.21.15.44:6824/1160071918","state":["exists","up"]},{"osd":3,"uuid":"4740032d-fe34-4b1b-bb85-f430896fc3c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6808","nonce":4236454921},{"type":"v1","addr":"172.21.15.44:6809","nonce":4236454921}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6810","nonce":4236454921},{"type":"v1","addr":"172.21.15.44:6811","nonce":4236454921}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6814","nonce":4236454921},{"type":"v1","addr":"172.21.15.44:6815","nonce":4236454921}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6812","nonce":4236454921},{"type":"v1","addr":"172.21.15.44:6813","nonce":4236454921}]},"public_addr":"172.21.15.44:6809/4236454921","cluster_addr":"172.21.15.44:6811/4236454921","heartbeat_back_addr":"172.21.15.44:6815/4236454921","heartbeat_front_addr":"172.21.15.44:6813/4236454921","state":["exists","up"]},{"osd":4,"uuid":"7dbedb00-302d-4d52-810c-e18839254da1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6800","nonce":2293251376},{"type":"v1","addr":"172.21.15.62:6801","nonce":2293251376}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6802","nonce":2293251376},{"type":"v1","addr":"172.21.15.62:6803","nonce":2293251376}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6806","nonce":2293251376},{"type":"v1","addr":"172.21.15.62:6807","nonce":2293251376}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6804","nonce":2293251376},{"type":"v1","addr":"172.21.15.62:6805","nonce":2293251376}]},"public_addr":"172.21.15.62:6801/2293251376","cluster_addr":"172.21.15.62:6803/2293251376","heartbeat_back_addr":"172.21.15.62:6807/2293251376","heartbeat_front_addr":"172.21.15.62:6805/2293251376","state":["exists","up"]},{"osd":5,"uuid":"38c1e8d9-393d-4f33-a97a-3295cf5c5b07","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6808","nonce":1551020300},{"type":"v1","addr":"172.21.15.62:6809","nonce":1551020300}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6810","nonce":1551020300},{"type":"v1","addr":"172.21.15.62:6811","nonce":1551020300}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6814","nonce":1551020300},{"type":"v1","addr":"172.21.15.62:6815","nonce":1551020300}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6812","nonce":1551020300},{"type":"v1","addr":"172.21.15.62:6813","nonce":1551020300}]},"public_addr":"172.21.15.62:6809/1551020300","cluster_addr":"172.21.15.62:6811/1551020300","heartbeat_back_addr":"172.21.15.62:6815/1551020300","heartbeat_front_addr":"172.21.15.62:6813/1551020300","state":["exists","up"]},{"osd":6,"uuid":"f6ff81c6-f14d-4477-88e3-9116cc5a2992","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6824","nonce":2602310256},{"type":"v1","addr":"172.21.15.62:6825","nonce":2602310256}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6826","nonce":2602310256},{"type":"v1","addr":"172.21.15.62:6827","nonce":2602310256}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6830","nonce":2602310256},{"type":"v1","addr":"172.21.15.62:6831","nonce":2602310256}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6828","nonce":2602310256},{"type":"v1","addr":"172.21.15.62:6829","nonce":2602310256}]},"public_addr":"172.21.15.62:6825/2602310256","cluster_addr":"172.21.15.62:6827/2602310256","heartbeat_back_addr":"172.21.15.62:6831/2602310256","heartbeat_front_addr":"172.21.15.62:6829/2602310256","state":["exists","up"]},{"osd":7,"uuid":"ce395bc3-bcb5-4b94-a523-5bb9df491eca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6816","nonce":2912738359},{"type":"v1","addr":"172.21.15.62:6817","nonce":2912738359}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6818","nonce":2912738359},{"type":"v1","addr":"172.21.15.62:6819","nonce":2912738359}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6822","nonce":2912738359},{"type":"v1","addr":"172.21.15.62:6823","nonce":2912738359}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6820","nonce":2912738359},{"type":"v1","addr":"172.21.15.62:6821","nonce":2912738359}]},"public_addr":"172.21.15.62:6817/2912738359","cluster_addr":"172.21.15.62:6819/2912738359","heartbeat_back_addr":"172.21.15.62:6823/2912738359","heartbeat_front_addr":"172.21.15.62:6821/2912738359","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T19:46:39.302883+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T19:46:39.177705+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T19:46:39.188894+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T19:46:39.313009+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T19:46:38.870508+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T19:46:38.790900+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T19:46:38.979163+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T19:46:38.992348+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.c","mappings":[{"from":0,"to":4}]},{"pgid":"3.15","mappings":[{"from":0,"to":7}]},{"pgid":"4.f","mappings":[{"from":7,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-17T19:47:41.808 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:41.817+0000 7f7b76800640 1 -- 172.21.15.44:0/2789558729 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f7b500683b0 msgr2=0x7f7b5006a8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:41.808 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:41.817+0000 7f7b76800640 1 --2- 172.21.15.44:0/2789558729 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f7b500683b0 0x7f7b5006a8c0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f7b60000f70 tx=0x7f7b60007e90 comp rx=0 tx=0).stop 2024-04-17T19:47:41.808 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:41.817+0000 7f7b76800640 1 -- 172.21.15.44:0/2789558729 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7b70152a60 msgr2=0x7f7b7013f220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:41.808 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:41.817+0000 7f7b76800640 1 --2- 172.21.15.44:0/2789558729 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7b70152a60 0x7f7b7013f220 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f7b5c00e980 tx=0x7f7b5c00ee40 comp rx=0 tx=0).stop 2024-04-17T19:47:41.808 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:41.817+0000 7f7b76800640 1 -- 172.21.15.44:0/2789558729 shutdown_connections 2024-04-17T19:47:41.808 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:41.817+0000 7f7b76800640 1 --2- 172.21.15.44:0/2789558729 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f7b500683b0 0x7f7b5006a8c0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:41.808 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:41.817+0000 7f7b76800640 1 --2- 172.21.15.44:0/2789558729 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f7b70158eb0 0x7f7b7013f760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:41.809 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:41.817+0000 7f7b76800640 1 --2- 172.21.15.44:0/2789558729 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7b70152a60 0x7f7b7013f220 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:41.809 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:41.817+0000 7f7b76800640 1 --2- 172.21.15.44:0/2789558729 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7b700c47c0 0x7f7b7014e510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:41.809 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:41.817+0000 7f7b76800640 1 -- 172.21.15.44:0/2789558729 >> 172.21.15.44:0/2789558729 conn(0x7f7b7006c380 msgr2=0x7f7b700c9860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:47:41.809 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:41.817+0000 7f7b76800640 1 -- 172.21.15.44:0/2789558729 shutdown_connections 2024-04-17T19:47:41.809 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:41.817+0000 7f7b76800640 1 -- 172.21.15.44:0/2789558729 wait complete. 2024-04-17T19:47:41.828 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-17T19:47:41.980 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:41.989+0000 7fd07f600640 1 Processor -- start 2024-04-17T19:47:41.980 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:41.989+0000 7fd07f600640 1 -- start start 2024-04-17T19:47:41.982 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:41.989+0000 7fd07f600640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fd0780ca1c0 0x7fd0780cec70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:41.982 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:41.989+0000 7fd07f600640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fd0780cf1b0 0x7fd0781662f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:41.982 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:41.989+0000 7fd07f600640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd07815bb10 con 0x7fd0780c5a80 2024-04-17T19:47:41.982 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:41.989+0000 7fd07f600640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 -- 0x7fd0780ca7e0 con 0x7fd0780ca1c0 2024-04-17T19:47:41.982 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:41.989+0000 7fd07f600640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7fd07815bdf0 con 0x7fd0780cf1b0 2024-04-17T19:47:41.983 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:41.989+0000 7fd07d600640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fd0780cf1b0 0x7fd0781662f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:41.983 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:41.989+0000 7fd077e00640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fd0780ca1c0 0x7fd0780cec70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:41.983 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:41.989+0000 7fd07cc00640 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7fd0780c5a80 0x7fd0780cb9b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.44:57966/0 (socket says 172.21.15.44:57966) 2024-04-17T19:47:41.983 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:41.989+0000 7fd07cc00640 1 -- 172.21.15.44:0/2093667226 learned_addr learned my addr 172.21.15.44:0/2093667226 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-04-17T19:47:41.987 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:41.993+0000 7fd07d600640 1 -- 172.21.15.44:0/2093667226 >> v2:172.21.15.62:3300/0 conn(0x7fd0780ca1c0 msgr2=0x7fd0780cec70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T19:47:41.987 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:41.993+0000 7fd07d600640 1 --2- 172.21.15.44:0/2093667226 >> v2:172.21.15.62:3300/0 conn(0x7fd0780ca1c0 0x7fd0780cec70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:41.987 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:41.993+0000 7fd07d600640 1 -- 172.21.15.44:0/2093667226 >> v1:172.21.15.62:6789/0 conn(0x7fd0780c5a80 legacy=0x7fd0780cb9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:41.987 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:41.993+0000 7fd07d600640 1 -- 172.21.15.44:0/2093667226 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd07815c0d0 con 0x7fd0780cf1b0 2024-04-17T19:47:41.987 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:41.993+0000 7fd07d600640 1 --2- 172.21.15.44:0/2093667226 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fd0780cf1b0 0x7fd0781662f0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fd070009d90 tx=0x7fd07001c970 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9e9fa7a58cf2d63d server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:47:41.987 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:41.993+0000 7fd077400640 1 -- 172.21.15.44:0/2093667226 <== mon.2 v2:172.21.15.62:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0700b2070 con 0x7fd0780cf1b0 2024-04-17T19:47:41.987 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:41.993+0000 7fd077400640 1 -- 172.21.15.44:0/2093667226 <== mon.2 v2:172.21.15.62:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd0700a5940 con 0x7fd0780cf1b0 2024-04-17T19:47:41.987 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:41.993+0000 7fd077400640 1 -- 172.21.15.44:0/2093667226 <== mon.2 v2:172.21.15.62:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0700a5d10 con 0x7fd0780cf1b0 2024-04-17T19:47:41.987 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:41.997+0000 7fd07f600640 1 -- 172.21.15.44:0/2093667226 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fd0780cf1b0 msgr2=0x7fd0781662f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:41.988 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:41.997+0000 7fd07f600640 1 --2- 172.21.15.44:0/2093667226 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fd0780cf1b0 0x7fd0781662f0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fd070009d90 tx=0x7fd07001c970 comp rx=0 tx=0).stop 2024-04-17T19:47:41.988 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:41.997+0000 7fd07f600640 1 -- 172.21.15.44:0/2093667226 shutdown_connections 2024-04-17T19:47:41.988 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:41.997+0000 7fd07f600640 1 --2- 172.21.15.44:0/2093667226 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fd0780cf1b0 0x7fd0781662f0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:41.988 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:41.997+0000 7fd07f600640 1 --2- 172.21.15.44:0/2093667226 >> v2:172.21.15.62:3300/0 conn(0x7fd0780ca1c0 0x7fd0780cec70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:41.988 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:41.997+0000 7fd07f600640 1 -- 172.21.15.44:0/2093667226 >> 172.21.15.44:0/2093667226 conn(0x7fd078067eb0 msgr2=0x7fd0780682c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:47:41.988 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:41.997+0000 7fd07f600640 1 -- 172.21.15.44:0/2093667226 shutdown_connections 2024-04-17T19:47:41.988 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:41.997+0000 7fd07f600640 1 -- 172.21.15.44:0/2093667226 wait complete. 2024-04-17T19:47:41.989 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:41.997+0000 7fd07f600640 1 Processor -- start 2024-04-17T19:47:41.989 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:41.997+0000 7fd07f600640 1 -- start start 2024-04-17T19:47:41.991 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:41.997+0000 7fd07f600640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fd0780c5a80 0x7fd0781f6b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:41.991 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:41.997+0000 7fd07f600640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd0780ca1c0 0x7fd0781f83e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:41.991 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:41.997+0000 7fd07f600640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd0780cf1b0 0x7fd0781584d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:41.991 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:41.997+0000 7fd07f600640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fd0780cc0c0 con 0x7fd0780ca1c0 2024-04-17T19:47:41.991 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:41.997+0000 7fd07f600640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7fd0780caa10 con 0x7fd0780cf1b0 2024-04-17T19:47:41.992 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:41.997+0000 7fd07f600640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7fd0780cc240 con 0x7fd0780c5a80 2024-04-17T19:47:41.992 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:42.001+0000 7fd077e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd0780ca1c0 0x7fd0781f83e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:41.992 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:42.001+0000 7fd07cc00640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fd0780c5a80 0x7fd0781f6b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:41.992 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:42.001+0000 7fd07cc00640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fd0780c5a80 0x7fd0781f6b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3301/0 says I am v2:172.21.15.44:44642/0 (socket says 172.21.15.44:44642) 2024-04-17T19:47:41.992 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:42.001+0000 7fd07cc00640 1 -- 172.21.15.44:0/3444768818 learned_addr learned my addr 172.21.15.44:0/3444768818 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-04-17T19:47:41.992 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:42.001+0000 7fd07d600640 1 --2- 172.21.15.44:0/3444768818 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd0780cf1b0 0x7fd0781584d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:41.992 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:42.001+0000 7fd07cc00640 1 -- 172.21.15.44:0/3444768818 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd0780cf1b0 msgr2=0x7fd0781584d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:41.992 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:42.001+0000 7fd07cc00640 1 --2- 172.21.15.44:0/3444768818 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd0780cf1b0 0x7fd0781584d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:41.992 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:42.001+0000 7fd07cc00640 1 -- 172.21.15.44:0/3444768818 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd0780ca1c0 msgr2=0x7fd0781f83e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:41.992 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:42.001+0000 7fd07cc00640 1 --2- 172.21.15.44:0/3444768818 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd0780ca1c0 0x7fd0781f83e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:41.992 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:42.001+0000 7fd07cc00640 1 -- 172.21.15.44:0/3444768818 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd07815ae20 con 0x7fd0780c5a80 2024-04-17T19:47:41.992 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:42.001+0000 7fd07cc00640 1 --2- 172.21.15.44:0/3444768818 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fd0780c5a80 0x7fd0781f6b70 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fd06c00c430 tx=0x7fd06c00c8f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:47:41.993 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:42.001+0000 7fd074c00640 1 -- 172.21.15.44:0/3444768818 <== mon.2 v2:172.21.15.62:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd06c017070 con 0x7fd0780c5a80 2024-04-17T19:47:41.993 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:42.001+0000 7fd074c00640 1 -- 172.21.15.44:0/3444768818 <== mon.2 v2:172.21.15.62:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd06c005cf0 con 0x7fd0780c5a80 2024-04-17T19:47:41.993 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:42.001+0000 7fd074c00640 1 -- 172.21.15.44:0/3444768818 <== mon.2 v2:172.21.15.62:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd06c0072d0 con 0x7fd0780c5a80 2024-04-17T19:47:41.993 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:42.001+0000 7fd07f600640 1 -- 172.21.15.44:0/3444768818 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd0780c9200 con 0x7fd0780c5a80 2024-04-17T19:47:41.993 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:42.001+0000 7fd07f600640 1 -- 172.21.15.44:0/3444768818 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fd0780c8f20 con 0x7fd0780c5a80 2024-04-17T19:47:41.993 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:42.001+0000 7fd07f600640 1 -- 172.21.15.44:0/3444768818 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd07804ff10 con 0x7fd0780c5a80 2024-04-17T19:47:41.994 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:42.001+0000 7fd074c00640 1 -- 172.21.15.44:0/3444768818 <== mon.2 v2:172.21.15.62:3301/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fd06c01a070 con 0x7fd0780c5a80 2024-04-17T19:47:41.995 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:42.005+0000 7fd074c00640 1 --2- 172.21.15.44:0/3444768818 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7fd0580683b0 0x7fd05806a8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:41.995 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:42.005+0000 7fd074c00640 1 -- 172.21.15.44:0/3444768818 <== mon.2 v2:172.21.15.62:3301/0 5 ==== osd_map(27..27 src has 1..27) ==== 6619+0+0 (secure 0 0 0) 0x7fd06c086500 con 0x7fd0780c5a80 2024-04-17T19:47:41.995 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:42.005+0000 7fd077e00640 1 --2- 172.21.15.44:0/3444768818 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7fd0580683b0 0x7fd05806a8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:41.996 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:42.005+0000 7fd077e00640 1 --2- 172.21.15.44:0/3444768818 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7fd0580683b0 0x7fd05806a8c0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fd078152330 tx=0x7fd064009190 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:47:42.008 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:42.017+0000 7fd074c00640 1 -- 172.21.15.44:0/3444768818 <== mon.2 v2:172.21.15.62:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fd06c0560c0 con 0x7fd0780c5a80 2024-04-17T19:47:42.208 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:42.217+0000 7fd07f600640 1 -- 172.21.15.44:0/3444768818 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fd0780cad90 con 0x7fd0780c5a80 2024-04-17T19:47:42.210 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:42.217+0000 7fd074c00640 1 -- 172.21.15.44:0/3444768818 <== mon.2 v2:172.21.15.62:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 18 v18) ==== 94+0+6911 (secure 0 0 0) 0x7fd06c05a3c0 con 0x7fd0780c5a80 2024-04-17T19:47:42.210 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-04-17T19:47:42.210 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":18,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4263,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.44:6835/1724891996","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6832","nonce":1724891996},{"type":"v1","addr":"172.21.15.44:6835","nonce":1724891996}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":18,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-17T19:46:56.083202+0000","modified":"2024-04-17T19:47:39.954509+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":4306,"mds_1":4294,"mds_2":4269,"mds_3":4268,"mds_4":4266},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4266":{"gid":4266,"name":"c","rank":4,"incarnation":17,"state":"up:active","state_seq":14,"addr":"172.21.15.44:6836/2201911513","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6833","nonce":2201911513},{"type":"v1","addr":"172.21.15.44:6836","nonce":2201911513}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4268":{"gid":4268,"name":"f","rank":3,"incarnation":15,"state":"up:active","state_seq":13,"addr":"172.21.15.62:6837/3085335335","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6836","nonce":3085335335},{"type":"v1","addr":"172.21.15.62:6837","nonce":3085335335}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4269":{"gid":4269,"name":"e","rank":2,"incarnation":13,"state":"up:active","state_seq":11,"addr":"172.21.15.44:6837/4073536070","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6834","nonce":4073536070},{"type":"v1","addr":"172.21.15.44:6837","nonce":4073536070}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4294":{"gid":4294,"name":"d","rank":1,"incarnation":9,"state":"up:active","state_seq":10,"addr":"172.21.15.62:6835/2585862759","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6834","nonce":2585862759},{"type":"v1","addr":"172.21.15.62:6835","nonce":2585862759}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4306":{"gid":4306,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":5,"addr":"172.21.15.62:6839/1537667111","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6838","nonce":1537667111},{"type":"v1","addr":"172.21.15.62:6839","nonce":1537667111}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4306,"qdb_cluster":[4266,4268,4294,4269,4306]},"id":1}]} 2024-04-17T19:47:42.210 INFO:teuthology.orchestra.run.smithi044.stderr:dumped fsmap epoch 18 2024-04-17T19:47:42.212 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:42.221+0000 7fd07f600640 1 -- 172.21.15.44:0/3444768818 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7fd0580683b0 msgr2=0x7fd05806a8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:42.212 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:42.221+0000 7fd07f600640 1 --2- 172.21.15.44:0/3444768818 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7fd0580683b0 0x7fd05806a8c0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fd078152330 tx=0x7fd064009190 comp rx=0 tx=0).stop 2024-04-17T19:47:42.212 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:42.221+0000 7fd07f600640 1 -- 172.21.15.44:0/3444768818 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fd0780c5a80 msgr2=0x7fd0781f6b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:42.213 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:42.221+0000 7fd07f600640 1 --2- 172.21.15.44:0/3444768818 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fd0780c5a80 0x7fd0781f6b70 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fd06c00c430 tx=0x7fd06c00c8f0 comp rx=0 tx=0).stop 2024-04-17T19:47:42.213 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:42.221+0000 7fd07f600640 1 -- 172.21.15.44:0/3444768818 shutdown_connections 2024-04-17T19:47:42.213 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:42.221+0000 7fd07f600640 1 --2- 172.21.15.44:0/3444768818 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7fd0580683b0 0x7fd05806a8c0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:42.213 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:42.221+0000 7fd07f600640 1 --2- 172.21.15.44:0/3444768818 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd0780cf1b0 0x7fd0781584d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:42.213 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:42.221+0000 7fd07f600640 1 --2- 172.21.15.44:0/3444768818 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd0780ca1c0 0x7fd0781f83e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:42.213 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:42.221+0000 7fd07f600640 1 --2- 172.21.15.44:0/3444768818 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fd0780c5a80 0x7fd0781f6b70 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:42.213 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:42.221+0000 7fd07f600640 1 -- 172.21.15.44:0/3444768818 >> 172.21.15.44:0/3444768818 conn(0x7fd078067eb0 msgr2=0x7fd0781595d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:47:42.213 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:42.221+0000 7fd07f600640 1 -- 172.21.15.44:0/3444768818 shutdown_connections 2024-04-17T19:47:42.213 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:42.221+0000 7fd07f600640 1 -- 172.21.15.44:0/3444768818 wait complete. 2024-04-17T19:47:42.836 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 18, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-04-17T19:46:56.083202+0000', 'modified': '2024-04-17T19:47:39.954509+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 5, 'in': [0, 1, 2, 3, 4], 'up': {'mds_0': 4306, 'mds_1': 4294, 'mds_2': 4269, 'mds_3': 4268, 'mds_4': 4266}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4266': {'gid': 4266, 'name': 'c', 'rank': 4, 'incarnation': 17, 'state': 'up:active', 'state_seq': 14, 'addr': '172.21.15.44:6836/2201911513', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.44:6833', 'nonce': 2201911513}, {'type': 'v1', 'addr': '172.21.15.44:6836', 'nonce': 2201911513}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_4268': {'gid': 4268, 'name': 'f', 'rank': 3, 'incarnation': 15, 'state': 'up:active', 'state_seq': 13, 'addr': '172.21.15.62:6837/3085335335', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.62:6836', 'nonce': 3085335335}, {'type': 'v1', 'addr': '172.21.15.62:6837', 'nonce': 3085335335}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_4269': {'gid': 4269, 'name': 'e', 'rank': 2, 'incarnation': 13, 'state': 'up:active', 'state_seq': 11, 'addr': '172.21.15.44:6837/4073536070', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.44:6834', 'nonce': 4073536070}, {'type': 'v1', 'addr': '172.21.15.44:6837', 'nonce': 4073536070}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_4294': {'gid': 4294, 'name': 'd', 'rank': 1, 'incarnation': 9, 'state': 'up:active', 'state_seq': 10, 'addr': '172.21.15.62:6835/2585862759', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.62:6834', 'nonce': 2585862759}, {'type': 'v1', 'addr': '172.21.15.62:6835', 'nonce': 2585862759}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_4306': {'gid': 4306, 'name': 'b', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 5, 'addr': '172.21.15.62:6839/1537667111', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.62:6838', 'nonce': 1537667111}, {'type': 'v1', 'addr': '172.21.15.62:6839', 'nonce': 1537667111}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 4306, 'qdb_cluster': [4266, 4268, 4294, 4269, 4306]} 2024-04-17T19:47:42.837 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 5/5 2024-04-17T19:47:42.837 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2024-04-17T19:47:42.997 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:43.005+0000 7f9ff0c00640 1 Processor -- start 2024-04-17T19:47:42.997 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:43.005+0000 7f9ff0c00640 1 -- start start 2024-04-17T19:47:42.999 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:43.009+0000 7f9ff0c00640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f9fec0c7530 0x7f9fec0c7940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:42.999 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:43.009+0000 7f9ff0c00640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9fec157e50 con 0x7f9fec073f10 2024-04-17T19:47:43.000 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:43.009+0000 7f9ff0c00640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9fec0c4310 con 0x7f9fec152310 2024-04-17T19:47:43.000 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:43.009+0000 7f9ff0c00640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 -- 0x7f9fec0c7e80 con 0x7f9fec0c7530 2024-04-17T19:47:43.000 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:43.009+0000 7f9fe9e00640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f9fec073f10 0x7f9fec1588d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:41868/0 (socket says 172.21.15.44:41868) 2024-04-17T19:47:43.000 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:43.009+0000 7f9fe9e00640 1 -- 172.21.15.44:0/315375518 learned_addr learned my addr 172.21.15.44:0/315375518 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-04-17T19:47:43.000 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:43.009+0000 7f9fea800640 1 --2- 172.21.15.44:0/315375518 >> v2:172.21.15.62:3300/0 conn(0x7f9fec0c7530 0x7f9fec0c7940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:43.001 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:43.009+0000 7f9fe9400640 1 -- 172.21.15.44:0/315375518 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2235619823 0 0) 0x7f9fdc001120 con 0x7f9fec073f10 2024-04-17T19:47:43.001 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:43.009+0000 7f9fe9400640 1 -- 172.21.15.44:0/315375518 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9fd0003530 con 0x7f9fec073f10 2024-04-17T19:47:43.002 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:43.009+0000 7f9fe9400640 1 -- 172.21.15.44:0/315375518 <== mon.1 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 515120777 0 0) 0x7f9fec0c4310 con 0x7f9fec152310 2024-04-17T19:47:43.002 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:43.009+0000 7f9fe9400640 1 -- 172.21.15.44:0/315375518 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9fdc001120 con 0x7f9fec152310 2024-04-17T19:47:43.002 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:43.009+0000 7f9fe9400640 1 -- 172.21.15.44:0/315375518 <== mon.0 v1:172.21.15.44:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3699735198 0 0) 0x7f9fd0003530 con 0x7f9fec073f10 2024-04-17T19:47:43.002 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:43.009+0000 7f9fe9400640 1 -- 172.21.15.44:0/315375518 >> v2:172.21.15.62:3300/0 conn(0x7f9fec0c7530 msgr2=0x7f9fec0c7940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T19:47:43.002 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:43.009+0000 7f9fe9400640 1 --2- 172.21.15.44:0/315375518 >> v2:172.21.15.62:3300/0 conn(0x7f9fec0c7530 0x7f9fec0c7940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:43.002 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:43.009+0000 7f9fe9400640 1 -- 172.21.15.44:0/315375518 >> v1:172.21.15.62:6789/0 conn(0x7f9fec152310 legacy=0x7f9fec15be50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:43.002 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:43.009+0000 7f9fe9400640 1 -- 172.21.15.44:0/315375518 --> v1:172.21.15.44:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9fec0c45f0 con 0x7f9fec073f10 2024-04-17T19:47:43.002 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:43.009+0000 7f9fe9400640 1 -- 172.21.15.44:0/315375518 <== mon.0 v1:172.21.15.44:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1863569991 0 0) 0x7f9fdc001850 con 0x7f9fec073f10 2024-04-17T19:47:43.002 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:43.009+0000 7f9fe9400640 1 -- 172.21.15.44:0/315375518 >> v1:172.21.15.44:6789/0 conn(0x7f9fec073f10 legacy=0x7f9fec1588d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:43.002 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:43.009+0000 7f9fe9400640 1 --2- 172.21.15.44:0/315375518 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9fd0003b50 0x7f9fd0003fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:43.002 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:43.009+0000 7f9fe9400640 1 --2- 172.21.15.44:0/315375518 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f9fd0004810 0x7f9fd0004c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:43.002 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:43.009+0000 7f9fe9400640 1 --2- 172.21.15.44:0/315375518 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9fd00051b0 0x7f9fd000b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:43.002 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:43.009+0000 7f9fe9400640 1 -- 172.21.15.44:0/315375518 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f9fec0c7e80 con 0x7f9fd00051b0 2024-04-17T19:47:43.002 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:43.009+0000 7f9fe9400640 1 -- 172.21.15.44:0/315375518 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f9fd000c150 con 0x7f9fd0003b50 2024-04-17T19:47:43.002 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:43.009+0000 7f9fe9400640 1 -- 172.21.15.44:0/315375518 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7f9fd000c350 con 0x7f9fd0004810 2024-04-17T19:47:43.003 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:43.009+0000 7f9fea800640 1 --2- 172.21.15.44:0/315375518 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9fd00051b0 0x7f9fd000b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:43.003 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:43.009+0000 7f9fe9e00640 1 --2- 172.21.15.44:0/315375518 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9fd0003b50 0x7f9fd0003fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:43.003 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:43.009+0000 7f9fe3e00640 1 --2- 172.21.15.44:0/315375518 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f9fd0004810 0x7f9fd0004c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:43.003 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:43.009+0000 7f9fea800640 1 -- 172.21.15.44:0/315375518 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f9fd0004810 msgr2=0x7f9fd0004c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T19:47:43.003 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:43.009+0000 7f9fea800640 1 --2- 172.21.15.44:0/315375518 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f9fd0004810 0x7f9fd0004c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:43.003 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:43.009+0000 7f9fea800640 1 -- 172.21.15.44:0/315375518 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9fd0003b50 msgr2=0x7f9fd0003fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T19:47:43.003 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:43.009+0000 7f9fea800640 1 --2- 172.21.15.44:0/315375518 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9fd0003b50 0x7f9fd0003fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:43.003 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:43.009+0000 7f9fea800640 1 -- 172.21.15.44:0/315375518 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9fd0003530 con 0x7f9fd00051b0 2024-04-17T19:47:43.004 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:43.013+0000 7f9fea800640 1 -- 172.21.15.44:0/315375518 reap_dead start 2024-04-17T19:47:43.004 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:43.013+0000 7f9fea800640 1 --2- 172.21.15.44:0/315375518 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9fd00051b0 0x7f9fd000b9d0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f9fd00057f0 tx=0x7f9fe401cbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2f316b386e279b8a server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:47:43.004 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:43.013+0000 7f9fe9400640 1 -- 172.21.15.44:0/315375518 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9fe400ac20 con 0x7f9fd00051b0 2024-04-17T19:47:43.004 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:43.013+0000 7f9fe9400640 1 -- 172.21.15.44:0/315375518 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9fe40a9070 con 0x7f9fd00051b0 2024-04-17T19:47:43.004 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:43.013+0000 7f9fe9400640 1 -- 172.21.15.44:0/315375518 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9fe4003be0 con 0x7f9fd00051b0 2024-04-17T19:47:43.005 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:43.013+0000 7f9ff0c00640 1 -- 172.21.15.44:0/315375518 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9fd00051b0 msgr2=0x7f9fd000b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:43.005 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:43.013+0000 7f9ff0c00640 1 --2- 172.21.15.44:0/315375518 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9fd00051b0 0x7f9fd000b9d0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f9fd00057f0 tx=0x7f9fe401cbb0 comp rx=0 tx=0).stop 2024-04-17T19:47:43.005 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:43.013+0000 7f9ff0c00640 1 -- 172.21.15.44:0/315375518 shutdown_connections 2024-04-17T19:47:43.005 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:43.013+0000 7f9ff0c00640 1 --2- 172.21.15.44:0/315375518 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9fd00051b0 0x7f9fd000b9d0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:43.005 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:43.013+0000 7f9ff0c00640 1 -- 172.21.15.44:0/315375518 >> 172.21.15.44:0/315375518 conn(0x7f9fec06c380 msgr2=0x7f9fec070080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:47:43.005 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:43.013+0000 7f9ff0c00640 1 -- 172.21.15.44:0/315375518 shutdown_connections 2024-04-17T19:47:43.005 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:43.013+0000 7f9ff0c00640 1 -- 172.21.15.44:0/315375518 wait complete. 2024-04-17T19:47:43.007 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:43.017+0000 7f9ff0c00640 1 Processor -- start 2024-04-17T19:47:43.007 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:43.017+0000 7f9ff0c00640 1 -- start start 2024-04-17T19:47:43.009 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:43.017+0000 7f9ff0c00640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f9fd00051b0 0x7f9fec14c9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:43.009 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:43.017+0000 7f9ff0c00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9fec14a510 0x7f9fec0c86a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:43.009 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:43.017+0000 7f9ff0c00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9fec15bfa0 0x7f9fec1491b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:43.010 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:43.017+0000 7f9ff0c00640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f9fec1583b0 con 0x7f9fec15bfa0 2024-04-17T19:47:43.010 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:43.017+0000 7f9ff0c00640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f9fec1580d0 con 0x7f9fec14a510 2024-04-17T19:47:43.010 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:43.017+0000 7f9ff0c00640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7f9fec0c3ed0 con 0x7f9fd00051b0 2024-04-17T19:47:43.010 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:43.017+0000 7f9fea800640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9fec15bfa0 0x7f9fec1491b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:43.010 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:43.017+0000 7f9fea800640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9fec15bfa0 0x7f9fec1491b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:60860/0 (socket says 172.21.15.44:60860) 2024-04-17T19:47:43.010 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:43.017+0000 7f9fea800640 1 -- 172.21.15.44:0/3020988465 learned_addr learned my addr 172.21.15.44:0/3020988465 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-04-17T19:47:43.010 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:43.017+0000 7f9fe9e00640 1 --2- 172.21.15.44:0/3020988465 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f9fd00051b0 0x7f9fec14c9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:43.010 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:43.017+0000 7f9fe3e00640 1 --2- 172.21.15.44:0/3020988465 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9fec14a510 0x7f9fec0c86a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:43.010 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:43.017+0000 7f9fea800640 1 -- 172.21.15.44:0/3020988465 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f9fd00051b0 msgr2=0x7f9fec14c9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:43.010 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:43.017+0000 7f9fea800640 1 --2- 172.21.15.44:0/3020988465 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f9fd00051b0 0x7f9fec14c9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:43.010 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:43.017+0000 7f9fea800640 1 -- 172.21.15.44:0/3020988465 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9fec14a510 msgr2=0x7f9fec0c86a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:43.010 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:43.017+0000 7f9fea800640 1 --2- 172.21.15.44:0/3020988465 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9fec14a510 0x7f9fec0c86a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:43.010 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:43.017+0000 7f9fea800640 1 -- 172.21.15.44:0/3020988465 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9fec14d650 con 0x7f9fec15bfa0 2024-04-17T19:47:43.011 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:43.017+0000 7f9fea800640 1 --2- 172.21.15.44:0/3020988465 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9fec15bfa0 0x7f9fec1491b0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f9fe401c620 tx=0x7f9fe400a860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:47:43.011 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:43.017+0000 7f9fe2000640 1 -- 172.21.15.44:0/3020988465 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9fe400ac20 con 0x7f9fec15bfa0 2024-04-17T19:47:43.011 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:43.017+0000 7f9fe2000640 1 -- 172.21.15.44:0/3020988465 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9fe40a5ac0 con 0x7f9fec15bfa0 2024-04-17T19:47:43.011 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:43.017+0000 7f9fe2000640 1 -- 172.21.15.44:0/3020988465 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9fe4003e60 con 0x7f9fec15bfa0 2024-04-17T19:47:43.012 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:43.017+0000 7f9ff0c00640 1 -- 172.21.15.44:0/3020988465 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9fec14d370 con 0x7f9fec15bfa0 2024-04-17T19:47:43.012 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:43.017+0000 7f9ff0c00640 1 -- 172.21.15.44:0/3020988465 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9fec15a030 con 0x7f9fec15bfa0 2024-04-17T19:47:43.012 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:43.021+0000 7f9fe2000640 1 -- 172.21.15.44:0/3020988465 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f9fe40ab070 con 0x7f9fec15bfa0 2024-04-17T19:47:43.013 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:43.021+0000 7f9fe2000640 1 --2- 172.21.15.44:0/3020988465 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f9fc8068380 0x7f9fc806a890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:43.013 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:43.021+0000 7f9fe2000640 1 -- 172.21.15.44:0/3020988465 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6619+0+0 (secure 0 0 0) 0x7f9fe4120820 con 0x7f9fec15bfa0 2024-04-17T19:47:43.013 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:43.021+0000 7f9fe9e00640 1 --2- 172.21.15.44:0/3020988465 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f9fc8068380 0x7f9fc806a890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:43.014 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:43.021+0000 7f9ff822d000 1 Processor -- start 2024-04-17T19:47:43.014 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:43.021+0000 7f9ff822d000 1 -- start start 2024-04-17T19:47:43.014 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:43.025+0000 7f9fe9e00640 1 --2- 172.21.15.44:0/3020988465 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f9fc8068380 0x7f9fc806a890 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f9fdc007fd0 tx=0x7f9fdc014040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:47:43.017 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:43.025+0000 7f9ff822d000 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5633223a2c10 0x56332250c1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:43.017 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:43.025+0000 7f9ff822d000 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x56332239b930 0x56332250c6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:43.017 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:43.025+0000 7f9ff822d000 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x563321f9b280 0x56332250cc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:43.017 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:43.025+0000 7f9ff822d000 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x5633223194f0 con 0x563321f9b280 2024-04-17T19:47:43.017 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:43.025+0000 7f9ff822d000 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x5633222b3c10 con 0x5633223a2c10 2024-04-17T19:47:43.017 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:43.025+0000 7f9ff822d000 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x5633223154b0 con 0x56332239b930 2024-04-17T19:47:43.017 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:43.025+0000 7f9fea800640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x563321f9b280 0x56332250cc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:43.017 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:43.025+0000 7f9fea800640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x563321f9b280 0x56332250cc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:60866/0 (socket says 172.21.15.44:60866) 2024-04-17T19:47:43.017 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:43.025+0000 7f9fea800640 1 -- 172.21.15.44:0/76464557 learned_addr learned my addr 172.21.15.44:0/76464557 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-04-17T19:47:43.017 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:43.025+0000 7f9fe9e00640 1 --2- 172.21.15.44:0/76464557 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5633223a2c10 0x56332250c1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:43.017 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:43.025+0000 7f9fe3e00640 1 --2- 172.21.15.44:0/76464557 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x56332239b930 0x56332250c6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:43.017 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:43.025+0000 7f9fea800640 1 -- 172.21.15.44:0/76464557 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x56332239b930 msgr2=0x56332250c6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T19:47:43.017 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:43.025+0000 7f9fea800640 1 --2- 172.21.15.44:0/76464557 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x56332239b930 0x56332250c6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:43.017 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:43.025+0000 7f9fea800640 1 -- 172.21.15.44:0/76464557 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5633223a2c10 msgr2=0x56332250c1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T19:47:43.018 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:43.025+0000 7f9fea800640 1 --2- 172.21.15.44:0/76464557 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5633223a2c10 0x56332250c1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:43.018 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:43.025+0000 7f9fea800640 1 -- 172.21.15.44:0/76464557 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5633222b3e60 con 0x563321f9b280 2024-04-17T19:47:43.018 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:43.025+0000 7f9fe3e00640 1 --2- 172.21.15.44:0/76464557 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x56332239b930 0x56332250c6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-17T19:47:43.018 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:43.025+0000 7f9fea800640 1 --2- 172.21.15.44:0/76464557 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x563321f9b280 0x56332250cc30 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f9fe40ec7a0 tx=0x7f9fe40ec710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e541fbce88f1327d server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:47:43.018 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:43.025+0000 7f9fda600640 1 -- 172.21.15.44:0/76464557 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9fe40f46f0 con 0x563321f9b280 2024-04-17T19:47:43.018 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:43.025+0000 7f9fda600640 1 -- 172.21.15.44:0/76464557 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9fe40a9040 con 0x563321f9b280 2024-04-17T19:47:43.018 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:43.025+0000 7f9fda600640 1 -- 172.21.15.44:0/76464557 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9fe40f8f20 con 0x563321f9b280 2024-04-17T19:47:43.019 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:43.025+0000 7f9ff822d000 1 -- 172.21.15.44:0/76464557 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x563321f9b280 msgr2=0x56332250cc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:43.019 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:43.025+0000 7f9ff822d000 1 --2- 172.21.15.44:0/76464557 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x563321f9b280 0x56332250cc30 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f9fe40ec7a0 tx=0x7f9fe40ec710 comp rx=0 tx=0).stop 2024-04-17T19:47:43.019 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:43.025+0000 7f9ff822d000 1 -- 172.21.15.44:0/76464557 shutdown_connections 2024-04-17T19:47:43.019 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:43.025+0000 7f9ff822d000 1 --2- 172.21.15.44:0/76464557 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x56332239b930 0x56332250c6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:43.019 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:43.025+0000 7f9ff822d000 1 --2- 172.21.15.44:0/76464557 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x563321f9b280 0x56332250cc30 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:43.019 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:43.025+0000 7f9ff822d000 1 --2- 172.21.15.44:0/76464557 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5633223a2c10 0x56332250c1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:43.019 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:43.025+0000 7f9ff822d000 1 -- 172.21.15.44:0/76464557 >> 172.21.15.44:0/76464557 conn(0x5633223e4670 msgr2=0x563322509f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:47:43.019 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:43.025+0000 7f9ff822d000 1 -- 172.21.15.44:0/76464557 shutdown_connections 2024-04-17T19:47:43.019 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:43.025+0000 7f9ff822d000 1 -- 172.21.15.44:0/76464557 wait complete. 2024-04-17T19:47:43.019 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:43.029+0000 7f9ff822d000 1 -- start start 2024-04-17T19:47:43.020 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:43.029+0000 7f9ff822d000 1 Processor -- start 2024-04-17T19:47:43.023 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:43.029+0000 7f9ff822d000 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x563321f9b280 0x563322505f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:43.023 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:43.029+0000 7f9ff822d000 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56332239b930 0x563322506450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:43.023 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:43.029+0000 7f9ff822d000 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5633223a2c10 0x5633224cdbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:43.023 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:43.029+0000 7f9ff822d000 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x56332235a9e0 con 0x56332239b930 2024-04-17T19:47:43.023 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:43.029+0000 7f9ff822d000 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x5633222d6a80 con 0x5633223a2c10 2024-04-17T19:47:43.023 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:43.029+0000 7f9ff822d000 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x5633222d4d10 con 0x563321f9b280 2024-04-17T19:47:43.023 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:43.029+0000 7f9ff822d000 10 client.0 _ll_register_callbacks cb 0x5633224b6b20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-17T19:47:43.023 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:43.029+0000 7f9fe3e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56332239b930 0x563322506450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:43.023 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:43.029+0000 7f9fe3e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56332239b930 0x563322506450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:60882/0 (socket says 172.21.15.44:60882) 2024-04-17T19:47:43.023 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:43.029+0000 7f9fe3e00640 1 -- 172.21.15.44:0/558492015 learned_addr learned my addr 172.21.15.44:0/558492015 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-04-17T19:47:43.023 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:43.029+0000 7f9fea800640 1 --2- 172.21.15.44:0/558492015 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5633223a2c10 0x5633224cdbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:43.023 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:43.029+0000 7f9fe9e00640 1 --2- 172.21.15.44:0/558492015 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x563321f9b280 0x563322505f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:43.023 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:43.029+0000 7f9fe3e00640 1 -- 172.21.15.44:0/558492015 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x563321f9b280 msgr2=0x563322505f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T19:47:43.024 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:43.029+0000 7f9fe3e00640 1 --2- 172.21.15.44:0/558492015 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x563321f9b280 0x563322505f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:43.024 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:43.029+0000 7f9fe3e00640 1 -- 172.21.15.44:0/558492015 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5633223a2c10 msgr2=0x5633224cdbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T19:47:43.024 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:43.029+0000 7f9fe3e00640 1 --2- 172.21.15.44:0/558492015 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5633223a2c10 0x5633224cdbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:43.024 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:43.029+0000 7f9fe3e00640 1 -- 172.21.15.44:0/558492015 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5633222e4e20 con 0x56332239b930 2024-04-17T19:47:43.024 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:43.029+0000 7f9fea800640 1 --2- 172.21.15.44:0/558492015 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5633223a2c10 0x5633224cdbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-17T19:47:43.024 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:43.029+0000 7f9fe3e00640 1 --2- 172.21.15.44:0/558492015 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56332239b930 0x563322506450 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f9fd4003c50 tx=0x7f9fd40017b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b6753570b83d0e03 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:47:43.024 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:43.029+0000 7f9fcea00640 10 client.0 ms_handle_connect on v2:172.21.15.44:3300/0 2024-04-17T19:47:43.024 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:43.029+0000 7f9fcea00640 1 -- 172.21.15.44:0/558492015 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9fd401a020 con 0x56332239b930 2024-04-17T19:47:43.024 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:43.029+0000 7f9ff822d000 1 -- 172.21.15.44:0/558492015 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9fe40a9040 con 0x56332239b930 2024-04-17T19:47:43.024 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:43.029+0000 7f9fcea00640 1 -- 172.21.15.44:0/558492015 <== mon.0 v2:172.21.15.44:3300/0 2 ==== osd_map(27..27 src has 1..27) ==== 6619+0+0 (secure 0 0 0) 0x7f9fd4003e00 con 0x56332239b930 2024-04-17T19:47:43.024 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:43.029+0000 7f9fcea00640 1 -- 172.21.15.44:0/558492015 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_get_version_reply(handle=1 version=18) ==== 24+0+0 (secure 0 0 0) 0x7f9fd4024050 con 0x56332239b930 2024-04-17T19:47:43.024 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:43.029+0000 7f9ff822d000 10 client.4860 fetch_fsmap learned FSMap version 18 2024-04-17T19:47:43.024 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:43.029+0000 7f9ff822d000 1 -- 172.21.15.44:0/558492015 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,fsmap=18,monmap=2+}) -- 0x5633223e4a80 con 0x56332239b930 2024-04-17T19:47:43.024 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:43.029+0000 7f9fcea00640 1 -- 172.21.15.44:0/558492015 <== mon.0 v2:172.21.15.44:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9fe40a9040 con 0x56332239b930 2024-04-17T19:47:43.024 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:43.029+0000 7f9fcea00640 1 -- 172.21.15.44:0/558492015 <== mon.0 v2:172.21.15.44:3300/0 5 ==== fsmap(e 18) ==== 4792+0+0 (secure 0 0 0) 0x7f9fd4027020 con 0x56332239b930 2024-04-17T19:47:43.025 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:43.033+0000 7f9ff822d000 10 client.4860 fetch_fsmap finished waiting for FSMap version 18 2024-04-17T19:47:43.025 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:43.033+0000 7f9ff822d000 10 client.4860 resolve_mds: resolved name 'c' to daemon mds.c 2024-04-17T19:47:43.025 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:43.033+0000 7f9ff822d000 20 client.4860 populate_metadata read hostname 'smithi044' 2024-04-17T19:47:43.025 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:43.033+0000 7f9ff822d000 1 --2- 172.21.15.44:0/558492015 >> [v2:172.21.15.44:6833/2201911513,v1:172.21.15.44:6836/2201911513] conn(0x563321fbf7d0 0x5633224ce900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:43.025 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:43.033+0000 7f9ff822d000 4 client.4860 mds_command: new command op to 4266 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-17T19:47:43.025 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:43.033+0000 7f9ff822d000 1 -- 172.21.15.44:0/558492015 --> [v2:172.21.15.44:6833/2201911513,v1:172.21.15.44:6836/2201911513] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5633222b2be0 con 0x563321fbf7d0 2024-04-17T19:47:43.025 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:43.033+0000 7f9fe9e00640 1 --2- 172.21.15.44:0/558492015 >> [v2:172.21.15.44:6833/2201911513,v1:172.21.15.44:6836/2201911513] conn(0x563321fbf7d0 0x5633224ce900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:43.025 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:43.033+0000 7f9fe9e00640 1 --2- 172.21.15.44:0/558492015 >> [v2:172.21.15.44:6833/2201911513,v1:172.21.15.44:6836/2201911513] conn(0x563321fbf7d0 0x5633224ce900 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=41c687eb9af35ef server_cookie=9692cb34a46d00ab in_seq=0 out_seq=0 2024-04-17T19:47:43.025 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:43.033+0000 7f9fcea00640 10 client.4860 ms_handle_connect on v2:172.21.15.44:6833/2201911513 2024-04-17T19:47:44.945 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:44.953+0000 7f9fcea00640 1 -- 172.21.15.44:0/558492015 <== mds.4 v2:172.21.15.44:6833/2201911513 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x5633222b2be0 con 0x563321fbf7d0 2024-04-17T19:47:44.946 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:44.953+0000 7f9fcea00640 10 client.4860 handle_command_reply: tid=0 2024-04-17T19:47:44.946 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:44.953+0000 7f9ff822d000 1 client.4860 shutdown 2024-04-17T19:47:44.946 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:44.953+0000 7f9ff822d000 1 -- 172.21.15.44:0/558492015 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56332239b930 msgr2=0x563322506450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:44.946 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:44.953+0000 7f9ff822d000 1 --2- 172.21.15.44:0/558492015 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56332239b930 0x563322506450 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f9fd4003c50 tx=0x7f9fd40017b0 comp rx=0 tx=0).stop 2024-04-17T19:47:44.946 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:44.953+0000 7f9ff822d000 1 -- 172.21.15.44:0/558492015 shutdown_connections 2024-04-17T19:47:44.946 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:44.953+0000 7f9ff822d000 1 --2- 172.21.15.44:0/558492015 >> [v2:172.21.15.44:6833/2201911513,v1:172.21.15.44:6836/2201911513] conn(0x563321fbf7d0 0x5633224ce900 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:44.946 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:44.953+0000 7f9ff822d000 1 --2- 172.21.15.44:0/558492015 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5633223a2c10 0x5633224cdbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:44.946 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:44.953+0000 7f9ff822d000 1 --2- 172.21.15.44:0/558492015 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56332239b930 0x563322506450 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:44.946 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:44.953+0000 7f9ff822d000 1 --2- 172.21.15.44:0/558492015 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x563321f9b280 0x563322505f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:44.946 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:44.953+0000 7f9fcea00640 0 client.4860 ms_handle_reset on v2:172.21.15.44:6833/2201911513 2024-04-17T19:47:44.947 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:44.953+0000 7f9ff822d000 1 -- 172.21.15.44:0/558492015 >> 172.21.15.44:0/558492015 conn(0x5633223e4670 msgr2=0x563322507720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:47:44.947 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:44.953+0000 7f9ff822d000 1 -- 172.21.15.44:0/558492015 shutdown_connections 2024-04-17T19:47:44.947 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:44.953+0000 7f9ff822d000 1 -- 172.21.15.44:0/558492015 wait complete. 2024-04-17T19:47:44.947 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:44.953+0000 7f9ff822d000 20 client.4860 trim_cache size 0 max 16384 2024-04-17T19:47:44.967 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:44.977+0000 7f9ff822d000 1 Processor -- start 2024-04-17T19:47:44.967 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:44.977+0000 7f9ff822d000 1 -- start start 2024-04-17T19:47:44.969 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:44.977+0000 7f9ff822d000 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x563321f9b280 0x563322505220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:44.969 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:44.977+0000 7f9ff822d000 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56332239b930 0x563322504160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:44.969 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:44.977+0000 7f9ff822d000 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x5633223a2c10 0x5633225046a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:44.969 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:44.977+0000 7f9ff822d000 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f9fec200500 con 0x56332239b930 2024-04-17T19:47:44.970 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:44.977+0000 7f9ff822d000 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f9fec1fe620 con 0x563321f9b280 2024-04-17T19:47:44.970 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:44.977+0000 7f9ff822d000 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x563322318800 con 0x5633223a2c10 2024-04-17T19:47:44.970 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:44.977+0000 7f9fe3e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56332239b930 0x563322504160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:44.970 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:44.977+0000 7f9fe3e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56332239b930 0x563322504160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:60886/0 (socket says 172.21.15.44:60886) 2024-04-17T19:47:44.970 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:44.977+0000 7f9fe3e00640 1 -- 172.21.15.44:0/342312595 learned_addr learned my addr 172.21.15.44:0/342312595 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-04-17T19:47:44.970 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:44.977+0000 7f9fea800640 1 --2- 172.21.15.44:0/342312595 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x5633223a2c10 0x5633225046a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:44.970 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:44.977+0000 7f9fe9e00640 1 --2- 172.21.15.44:0/342312595 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x563321f9b280 0x563322505220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:44.971 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:44.977+0000 7f9fe3e00640 1 -- 172.21.15.44:0/342312595 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x5633223a2c10 msgr2=0x5633225046a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T19:47:44.971 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:44.977+0000 7f9fe3e00640 1 --2- 172.21.15.44:0/342312595 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x5633223a2c10 0x5633225046a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:44.971 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:44.977+0000 7f9fe3e00640 1 -- 172.21.15.44:0/342312595 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x563321f9b280 msgr2=0x563322505220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T19:47:44.971 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:44.977+0000 7f9fe3e00640 1 --2- 172.21.15.44:0/342312595 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x563321f9b280 0x563322505220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:44.971 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:44.977+0000 7f9fe3e00640 1 -- 172.21.15.44:0/342312595 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563322372e30 con 0x56332239b930 2024-04-17T19:47:44.971 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:44.977+0000 7f9fe9e00640 1 --2- 172.21.15.44:0/342312595 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x563321f9b280 0x563322505220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-17T19:47:44.971 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:44.977+0000 7f9fe3e00640 1 --2- 172.21.15.44:0/342312595 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56332239b930 0x563322504160 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f9fd4016a20 tx=0x7f9fd4011000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8fc8ce7051b19d0d server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:47:44.971 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:44.981+0000 7f9fd9c00640 1 -- 172.21.15.44:0/342312595 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9fd401a070 con 0x56332239b930 2024-04-17T19:47:44.972 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:44.981+0000 7f9fd9c00640 1 -- 172.21.15.44:0/342312595 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9fd402c070 con 0x56332239b930 2024-04-17T19:47:44.972 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:44.981+0000 7f9fd9c00640 1 -- 172.21.15.44:0/342312595 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9fd4001cb0 con 0x56332239b930 2024-04-17T19:47:44.972 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:44.981+0000 7f9ff822d000 1 -- 172.21.15.44:0/342312595 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56332239b930 msgr2=0x563322504160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:44.973 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:44.981+0000 7f9ff822d000 1 --2- 172.21.15.44:0/342312595 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56332239b930 0x563322504160 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f9fd4016a20 tx=0x7f9fd4011000 comp rx=0 tx=0).stop 2024-04-17T19:47:44.973 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:44.981+0000 7f9ff822d000 1 -- 172.21.15.44:0/342312595 shutdown_connections 2024-04-17T19:47:44.973 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:44.981+0000 7f9ff822d000 1 --2- 172.21.15.44:0/342312595 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x5633223a2c10 0x5633225046a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:44.973 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:44.981+0000 7f9ff822d000 1 --2- 172.21.15.44:0/342312595 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56332239b930 0x563322504160 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:44.973 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:44.981+0000 7f9ff822d000 1 --2- 172.21.15.44:0/342312595 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x563321f9b280 0x563322505220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:44.973 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:44.981+0000 7f9ff822d000 1 -- 172.21.15.44:0/342312595 >> 172.21.15.44:0/342312595 conn(0x5633223e4670 msgr2=0x563322527c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:47:44.973 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:44.981+0000 7f9ff822d000 1 -- 172.21.15.44:0/342312595 shutdown_connections 2024-04-17T19:47:44.973 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:44.981+0000 7f9ff822d000 1 -- 172.21.15.44:0/342312595 wait complete. 2024-04-17T19:47:44.973 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:44.981+0000 7f9ff822d000 1 -- start start 2024-04-17T19:47:44.973 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:44.981+0000 7f9ff822d000 1 Processor -- start 2024-04-17T19:47:44.975 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:44.985+0000 7f9ff822d000 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x563321f9b280 0x563322525290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:44.976 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:44.985+0000 7f9ff822d000 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x56332239b930 0x5633225257d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:44.976 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:44.985+0000 7f9ff822d000 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5633223a2c10 0x563322525d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:44.976 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:44.985+0000 7f9ff822d000 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x563322326700 con 0x563321f9b280 2024-04-17T19:47:44.976 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:44.985+0000 7f9ff822d000 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x56332231db20 con 0x5633223a2c10 2024-04-17T19:47:44.976 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:44.985+0000 7f9ff822d000 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x5633222af7d0 con 0x56332239b930 2024-04-17T19:47:44.976 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:44.985+0000 7f9ff822d000 10 client.0 _ll_register_callbacks cb 0x7f9fd4003830 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-17T19:47:44.976 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:44.985+0000 7f9fe9e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x563321f9b280 0x563322525290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:44.976 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:44.985+0000 7f9fe9e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x563321f9b280 0x563322525290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:60900/0 (socket says 172.21.15.44:60900) 2024-04-17T19:47:44.976 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:44.985+0000 7f9fe9e00640 1 -- 172.21.15.44:0/2320011845 learned_addr learned my addr 172.21.15.44:0/2320011845 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-04-17T19:47:44.976 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:44.985+0000 7f9fe3e00640 1 --2- 172.21.15.44:0/2320011845 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x56332239b930 0x5633225257d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:44.976 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:44.985+0000 7f9fea800640 1 --2- 172.21.15.44:0/2320011845 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5633223a2c10 0x563322525d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:44.976 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:44.985+0000 7f9fe9e00640 1 -- 172.21.15.44:0/2320011845 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x56332239b930 msgr2=0x5633225257d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T19:47:44.976 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:44.985+0000 7f9fe9e00640 1 --2- 172.21.15.44:0/2320011845 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x56332239b930 0x5633225257d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:44.977 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:44.985+0000 7f9fe9e00640 1 -- 172.21.15.44:0/2320011845 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5633223a2c10 msgr2=0x563322525d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T19:47:44.977 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:44.985+0000 7f9fe9e00640 1 --2- 172.21.15.44:0/2320011845 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5633223a2c10 0x563322525d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:44.977 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:44.985+0000 7f9fe9e00640 1 -- 172.21.15.44:0/2320011845 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5633222ab7e0 con 0x563321f9b280 2024-04-17T19:47:44.977 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:44.985+0000 7f9fea800640 1 --2- 172.21.15.44:0/2320011845 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5633223a2c10 0x563322525d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-17T19:47:44.977 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:44.985+0000 7f9fe9e00640 1 --2- 172.21.15.44:0/2320011845 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x563321f9b280 0x563322525290 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f9fdc012bb0 tx=0x7f9fdc001ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bf0e386a00fd5dce server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:47:44.977 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:44.985+0000 7f9fcea00640 10 client.0 ms_handle_connect on v2:172.21.15.44:3300/0 2024-04-17T19:47:44.979 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:44.985+0000 7f9fcea00640 1 -- 172.21.15.44:0/2320011845 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9fdc02d070 con 0x563321f9b280 2024-04-17T19:47:44.979 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:44.985+0000 7f9fcea00640 1 -- 172.21.15.44:0/2320011845 <== mon.0 v2:172.21.15.44:3300/0 2 ==== osd_map(27..27 src has 1..27) ==== 6619+0+0 (secure 0 0 0) 0x7f9fdc02d210 con 0x563321f9b280 2024-04-17T19:47:44.980 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:44.985+0000 7f9ff822d000 1 -- 172.21.15.44:0/2320011845 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9fd402c070 con 0x563321f9b280 2024-04-17T19:47:44.980 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:44.985+0000 7f9fcea00640 1 -- 172.21.15.44:0/2320011845 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_get_version_reply(handle=1 version=18) ==== 24+0+0 (secure 0 0 0) 0x7f9fdc03b050 con 0x563321f9b280 2024-04-17T19:47:44.980 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:44.985+0000 7f9ff822d000 10 client.4866 fetch_fsmap learned FSMap version 18 2024-04-17T19:47:44.980 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:44.985+0000 7f9ff822d000 1 -- 172.21.15.44:0/2320011845 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,fsmap=18,monmap=2+}) -- 0x5633222be670 con 0x563321f9b280 2024-04-17T19:47:44.980 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:44.985+0000 7f9fcea00640 1 -- 172.21.15.44:0/2320011845 <== mon.0 v2:172.21.15.44:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9fd402c070 con 0x563321f9b280 2024-04-17T19:47:44.980 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:44.985+0000 7f9fcea00640 1 -- 172.21.15.44:0/2320011845 <== mon.0 v2:172.21.15.44:3300/0 5 ==== fsmap(e 18) ==== 4792+0+0 (secure 0 0 0) 0x7f9fdc03e020 con 0x563321f9b280 2024-04-17T19:47:44.980 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:44.985+0000 7f9ff822d000 10 client.4866 fetch_fsmap finished waiting for FSMap version 18 2024-04-17T19:47:44.980 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:44.985+0000 7f9ff822d000 10 client.4866 resolve_mds: resolved name 'c' to daemon mds.c 2024-04-17T19:47:44.980 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:44.985+0000 7f9ff822d000 20 client.4866 populate_metadata read hostname 'smithi044' 2024-04-17T19:47:44.980 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:44.985+0000 7f9ff822d000 1 --2- 172.21.15.44:0/2320011845 >> [v2:172.21.15.44:6833/2201911513,v1:172.21.15.44:6836/2201911513] conn(0x563321fad830 0x563322526250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:44.980 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:44.985+0000 7f9ff822d000 4 client.4866 mds_command: new command op to 4266 tid=0 multi_id=0 [{"prefix": "status"}] 2024-04-17T19:47:44.980 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:44.985+0000 7f9ff822d000 1 -- 172.21.15.44:0/2320011845 --> [v2:172.21.15.44:6833/2201911513,v1:172.21.15.44:6836/2201911513] -- command(tid 0: {"prefix": "status"}) -- 0x563322326f10 con 0x563321fad830 2024-04-17T19:47:44.980 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:44.985+0000 7f9fe3e00640 1 --2- 172.21.15.44:0/2320011845 >> [v2:172.21.15.44:6833/2201911513,v1:172.21.15.44:6836/2201911513] conn(0x563321fad830 0x563322526250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:44.980 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:44.985+0000 7f9fe3e00640 1 --2- 172.21.15.44:0/2320011845 >> [v2:172.21.15.44:6833/2201911513,v1:172.21.15.44:6836/2201911513] conn(0x563321fad830 0x563322526250 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=d7dde6bcf33deb6 server_cookie=c7c1f284fd2d86d6 in_seq=0 out_seq=0 2024-04-17T19:47:44.980 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:44.985+0000 7f9fcea00640 10 client.4866 ms_handle_connect on v2:172.21.15.44:6833/2201911513 2024-04-17T19:47:44.981 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:44.985+0000 7f9fcea00640 1 -- 172.21.15.44:0/2320011845 <== mds.4 v2:172.21.15.44:6833/2201911513 1 ==== command_reply(tid 0: 0 ) ==== 8+0+325 (crc 0 0 0) 0x563322326f10 con 0x563321fad830 2024-04-17T19:47:44.981 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:44.985+0000 7f9fcea00640 10 client.4866 handle_command_reply: tid=0 2024-04-17T19:47:44.981 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:44.985+0000 7f9ff822d000 1 client.4866 shutdown 2024-04-17T19:47:44.981 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:44.989+0000 7f9ff822d000 1 -- 172.21.15.44:0/2320011845 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x563321f9b280 msgr2=0x563322525290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:44.981 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:44.989+0000 7f9ff822d000 1 --2- 172.21.15.44:0/2320011845 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x563321f9b280 0x563322525290 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f9fdc012bb0 tx=0x7f9fdc001ba0 comp rx=0 tx=0).stop 2024-04-17T19:47:44.981 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:44.989+0000 7f9ff822d000 1 -- 172.21.15.44:0/2320011845 shutdown_connections 2024-04-17T19:47:44.981 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:44.989+0000 7f9ff822d000 1 --2- 172.21.15.44:0/2320011845 >> [v2:172.21.15.44:6833/2201911513,v1:172.21.15.44:6836/2201911513] conn(0x563321fad830 0x563322526250 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:44.981 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:44.989+0000 7f9ff822d000 1 --2- 172.21.15.44:0/2320011845 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x56332239b930 0x5633225257d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:44.981 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:44.989+0000 7f9ff822d000 1 --2- 172.21.15.44:0/2320011845 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5633223a2c10 0x563322525d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:44.981 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:44.989+0000 7f9ff822d000 1 --2- 172.21.15.44:0/2320011845 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x563321f9b280 0x563322525290 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:44.981 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:44.989+0000 7f9ff822d000 1 -- 172.21.15.44:0/2320011845 >> 172.21.15.44:0/2320011845 conn(0x5633223e4670 msgr2=0x563322504160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:47:44.981 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:44.989+0000 7f9fcea00640 0 client.4866 ms_handle_reset on v2:172.21.15.44:6833/2201911513 2024-04-17T19:47:44.981 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:44.989+0000 7f9ff822d000 1 -- 172.21.15.44:0/2320011845 shutdown_connections 2024-04-17T19:47:44.981 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:44.989+0000 7f9ff822d000 1 -- 172.21.15.44:0/2320011845 wait complete. 2024-04-17T19:47:44.981 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:44.989+0000 7f9ff822d000 20 client.4866 trim_cache size 0 max 16384 2024-04-17T19:47:44.982 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2024-04-17T19:47:44.982 INFO:teuthology.orchestra.run.smithi044.stdout: "cluster_fsid": "703f77ca-79c6-4a66-b576-62c526cb1021", 2024-04-17T19:47:44.982 INFO:teuthology.orchestra.run.smithi044.stdout: "whoami": 4, 2024-04-17T19:47:44.982 INFO:teuthology.orchestra.run.smithi044.stdout: "id": 4266, 2024-04-17T19:47:44.982 INFO:teuthology.orchestra.run.smithi044.stdout: "want_state": "up:active", 2024-04-17T19:47:44.982 INFO:teuthology.orchestra.run.smithi044.stdout: "state": "up:active", 2024-04-17T19:47:44.982 INFO:teuthology.orchestra.run.smithi044.stdout: "fs_name": "cephfs", 2024-04-17T19:47:44.982 INFO:teuthology.orchestra.run.smithi044.stdout: "rank_uptime": 10.064044121, 2024-04-17T19:47:44.982 INFO:teuthology.orchestra.run.smithi044.stdout: "mdsmap_epoch": 18, 2024-04-17T19:47:44.982 INFO:teuthology.orchestra.run.smithi044.stdout: "osdmap_epoch": 27, 2024-04-17T19:47:44.982 INFO:teuthology.orchestra.run.smithi044.stdout: "osdmap_epoch_barrier": 27, 2024-04-17T19:47:44.983 INFO:teuthology.orchestra.run.smithi044.stdout: "uptime": 55.681489998000004 2024-04-17T19:47:44.983 INFO:teuthology.orchestra.run.smithi044.stdout:} 2024-04-17T19:47:44.983 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:44.989+0000 7f9ff0c00640 1 -- 172.21.15.44:0/3020988465 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f9fc8068380 msgr2=0x7f9fc806a890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:44.983 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:44.989+0000 7f9ff0c00640 1 --2- 172.21.15.44:0/3020988465 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f9fc8068380 0x7f9fc806a890 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f9fdc007fd0 tx=0x7f9fdc014040 comp rx=0 tx=0).stop 2024-04-17T19:47:44.983 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:44.989+0000 7f9ff0c00640 1 -- 172.21.15.44:0/3020988465 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9fec15bfa0 msgr2=0x7f9fec1491b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:44.984 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:44.989+0000 7f9ff0c00640 1 --2- 172.21.15.44:0/3020988465 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9fec15bfa0 0x7f9fec1491b0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f9fe401c620 tx=0x7f9fe400a860 comp rx=0 tx=0).stop 2024-04-17T19:47:44.984 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:44.989+0000 7f9ff0c00640 1 -- 172.21.15.44:0/3020988465 shutdown_connections 2024-04-17T19:47:44.984 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:44.989+0000 7f9ff0c00640 1 --2- 172.21.15.44:0/3020988465 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f9fc8068380 0x7f9fc806a890 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:44.984 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:44.989+0000 7f9ff0c00640 1 --2- 172.21.15.44:0/3020988465 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9fec15bfa0 0x7f9fec1491b0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:44.984 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:44.989+0000 7f9ff0c00640 1 --2- 172.21.15.44:0/3020988465 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9fec14a510 0x7f9fec0c86a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:44.984 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:44.989+0000 7f9ff0c00640 1 --2- 172.21.15.44:0/3020988465 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f9fd00051b0 0x7f9fec14c9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:44.984 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:44.989+0000 7f9ff0c00640 1 -- 172.21.15.44:0/3020988465 >> 172.21.15.44:0/3020988465 conn(0x7f9fec06c380 msgr2=0x7f9fec0cae60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:47:44.984 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:44.989+0000 7f9ff0c00640 1 -- 172.21.15.44:0/3020988465 shutdown_connections 2024-04-17T19:47:44.984 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:44.989+0000 7f9ff0c00640 1 -- 172.21.15.44:0/3020988465 wait complete. 2024-04-17T19:47:45.003 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.f status 2024-04-17T19:47:45.161 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.169+0000 7f2cd4000640 1 Processor -- start 2024-04-17T19:47:45.161 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.169+0000 7f2cd4000640 1 -- start start 2024-04-17T19:47:45.164 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.173+0000 7f2cd4000640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f2ccc152860 0x7f2ccc0c68b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:45.164 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.173+0000 7f2cd4000640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f2ccc159140 0x7f2ccc0c47e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:45.164 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.173+0000 7f2cd4000640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2ccc0c4000 con 0x7f2ccc0c4d20 2024-04-17T19:47:45.164 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.173+0000 7f2cd4000640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 -- 0x7f2ccc0c6eb0 con 0x7f2ccc159140 2024-04-17T19:47:45.164 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.173+0000 7f2cd4000640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7f2ccc0c78e0 con 0x7f2ccc152860 2024-04-17T19:47:45.164 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.173+0000 7f2cd2000640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f2ccc0c4d20 0x7f2ccc0c80a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:41880/0 (socket says 172.21.15.44:41880) 2024-04-17T19:47:45.164 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.173+0000 7f2cd2000640 1 -- 172.21.15.44:0/1407821792 learned_addr learned my addr 172.21.15.44:0/1407821792 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-04-17T19:47:45.164 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.173+0000 7f2cd0c00640 1 --2- 172.21.15.44:0/1407821792 >> v2:172.21.15.62:3300/0 conn(0x7f2ccc159140 0x7f2ccc0c47e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:45.164 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.173+0000 7f2cd1600640 1 --2- 172.21.15.44:0/1407821792 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f2ccc152860 0x7f2ccc0c68b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:45.166 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.173+0000 7f2ccbe00640 1 -- 172.21.15.44:0/1407821792 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3633526908 0 0) 0x7f2ccc0c4000 con 0x7f2ccc0c4d20 2024-04-17T19:47:45.166 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.173+0000 7f2ccbe00640 1 -- 172.21.15.44:0/1407821792 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2cb4003530 con 0x7f2ccc0c4d20 2024-04-17T19:47:45.166 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.173+0000 7f2ccbe00640 1 -- 172.21.15.44:0/1407821792 <== mon.0 v1:172.21.15.44:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1503372109 0 0) 0x7f2cb4003530 con 0x7f2ccc0c4d20 2024-04-17T19:47:45.166 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.173+0000 7f2ccbe00640 1 -- 172.21.15.44:0/1407821792 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f2ccc152860 msgr2=0x7f2ccc0c68b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T19:47:45.166 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.173+0000 7f2ccbe00640 1 --2- 172.21.15.44:0/1407821792 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f2ccc152860 0x7f2ccc0c68b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:45.167 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.173+0000 7f2ccbe00640 1 -- 172.21.15.44:0/1407821792 >> v2:172.21.15.62:3300/0 conn(0x7f2ccc159140 msgr2=0x7f2ccc0c47e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T19:47:45.167 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.173+0000 7f2ccbe00640 1 --2- 172.21.15.44:0/1407821792 >> v2:172.21.15.62:3300/0 conn(0x7f2ccc159140 0x7f2ccc0c47e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:45.167 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.173+0000 7f2ccbe00640 1 -- 172.21.15.44:0/1407821792 --> v1:172.21.15.44:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2ccc0c42e0 con 0x7f2ccc0c4d20 2024-04-17T19:47:45.167 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.173+0000 7f2ccbe00640 1 -- 172.21.15.44:0/1407821792 <== mon.0 v1:172.21.15.44:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1863569991 0 0) 0x7f2cc4001a00 con 0x7f2ccc0c4d20 2024-04-17T19:47:45.167 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.173+0000 7f2cd1600640 1 --2- 172.21.15.44:0/1407821792 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f2ccc152860 0x7f2ccc0c68b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-17T19:47:45.167 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.173+0000 7f2ccbe00640 1 -- 172.21.15.44:0/1407821792 >> v1:172.21.15.44:6789/0 conn(0x7f2ccc0c4d20 legacy=0x7f2ccc0c80a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:45.167 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.173+0000 7f2ccbe00640 1 --2- 172.21.15.44:0/1407821792 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2cb40039c0 0x7f2cb4003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:45.167 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.173+0000 7f2ccbe00640 1 --2- 172.21.15.44:0/1407821792 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2cb4004810 0x7f2cb4004c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:45.167 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.173+0000 7f2ccbe00640 1 --2- 172.21.15.44:0/1407821792 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f2ccc152860 0x7f2cb4005160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:45.167 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.173+0000 7f2ccbe00640 1 -- 172.21.15.44:0/1407821792 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f2ccc0c6eb0 con 0x7f2cb40039c0 2024-04-17T19:47:45.167 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.173+0000 7f2ccbe00640 1 -- 172.21.15.44:0/1407821792 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f2ccc0c78e0 con 0x7f2cb4004810 2024-04-17T19:47:45.167 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.173+0000 7f2ccbe00640 1 -- 172.21.15.44:0/1407821792 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7f2cb400ba80 con 0x7f2ccc152860 2024-04-17T19:47:45.167 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.173+0000 7f2cd1600640 1 --2- 172.21.15.44:0/1407821792 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2cb40039c0 0x7f2cb4003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:45.167 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.173+0000 7f2cd0c00640 1 --2- 172.21.15.44:0/1407821792 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2cb4004810 0x7f2cb4004c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:45.167 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.173+0000 7f2cd2000640 1 --2- 172.21.15.44:0/1407821792 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f2ccc152860 0x7f2cb4005160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:45.168 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.173+0000 7f2cd1600640 1 -- 172.21.15.44:0/1407821792 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f2ccc152860 msgr2=0x7f2cb4005160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T19:47:45.168 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.173+0000 7f2cd1600640 1 --2- 172.21.15.44:0/1407821792 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f2ccc152860 0x7f2cb4005160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:45.168 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.173+0000 7f2cd1600640 1 -- 172.21.15.44:0/1407821792 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2cb4004810 msgr2=0x7f2cb4004c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T19:47:45.168 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.173+0000 7f2cd1600640 1 --2- 172.21.15.44:0/1407821792 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2cb4004810 0x7f2cb4004c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:45.168 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.173+0000 7f2cd1600640 1 -- 172.21.15.44:0/1407821792 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2cb4003530 con 0x7f2cb40039c0 2024-04-17T19:47:45.168 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.177+0000 7f2cd1600640 1 --2- 172.21.15.44:0/1407821792 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2cb40039c0 0x7f2cb4003e30 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f2cc0009cb0 tx=0x7f2cc001cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9f7238db8a1f72b1 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:47:45.168 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.177+0000 7f2ccbe00640 1 -- 172.21.15.44:0/1407821792 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2cc00b2070 con 0x7f2cb40039c0 2024-04-17T19:47:45.169 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.177+0000 7f2ccbe00640 1 -- 172.21.15.44:0/1407821792 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2cc00a56d0 con 0x7f2cb40039c0 2024-04-17T19:47:45.169 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.177+0000 7f2ccbe00640 1 -- 172.21.15.44:0/1407821792 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2cc0009880 con 0x7f2cb40039c0 2024-04-17T19:47:45.169 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.177+0000 7f2cd4000640 1 -- 172.21.15.44:0/1407821792 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2cb40039c0 msgr2=0x7f2cb4003e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:45.170 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.177+0000 7f2cd4000640 1 --2- 172.21.15.44:0/1407821792 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2cb40039c0 0x7f2cb4003e30 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f2cc0009cb0 tx=0x7f2cc001cc30 comp rx=0 tx=0).stop 2024-04-17T19:47:45.170 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.177+0000 7f2cd2000640 1 -- 172.21.15.44:0/1407821792 reap_dead start 2024-04-17T19:47:45.170 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.177+0000 7f2cd4000640 1 -- 172.21.15.44:0/1407821792 shutdown_connections 2024-04-17T19:47:45.170 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.177+0000 7f2cd4000640 1 -- 172.21.15.44:0/1407821792 >> 172.21.15.44:0/1407821792 conn(0x7f2ccc06c380 msgr2=0x7f2ccc070080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:47:45.170 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.177+0000 7f2cd4000640 1 -- 172.21.15.44:0/1407821792 shutdown_connections 2024-04-17T19:47:45.170 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.177+0000 7f2cd4000640 1 -- 172.21.15.44:0/1407821792 wait complete. 2024-04-17T19:47:45.171 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.181+0000 7f2cd4000640 1 Processor -- start 2024-04-17T19:47:45.171 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.181+0000 7f2cd4000640 1 -- start start 2024-04-17T19:47:45.174 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.181+0000 7f2cd4000640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f2cb40039c0 0x7f2ccc156c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:45.174 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.181+0000 7f2cd4000640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2ccc14a710 0x7f2ccc0ccc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:45.174 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.181+0000 7f2cd4000640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2ccc0cb7b0 0x7f2ccc0cbbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:45.174 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.181+0000 7f2cd4000640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f2ccc0c5130 con 0x7f2ccc14a710 2024-04-17T19:47:45.174 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.181+0000 7f2cd4000640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f2ccc0c68b0 con 0x7f2ccc0cb7b0 2024-04-17T19:47:45.174 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.181+0000 7f2cd4000640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7f2ccc0c6a30 con 0x7f2cb40039c0 2024-04-17T19:47:45.175 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.181+0000 7f2cd0c00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2ccc14a710 0x7f2ccc0ccc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:45.175 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.181+0000 7f2cd0c00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2ccc14a710 0x7f2ccc0ccc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:60926/0 (socket says 172.21.15.44:60926) 2024-04-17T19:47:45.175 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.181+0000 7f2cd0c00640 1 -- 172.21.15.44:0/341180483 learned_addr learned my addr 172.21.15.44:0/341180483 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-04-17T19:47:45.175 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.181+0000 7f2cd1600640 1 --2- 172.21.15.44:0/341180483 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f2cb40039c0 0x7f2ccc156c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:45.175 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.181+0000 7f2cd2000640 1 --2- 172.21.15.44:0/341180483 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2ccc0cb7b0 0x7f2ccc0cbbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:45.175 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.181+0000 7f2cd0c00640 1 -- 172.21.15.44:0/341180483 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f2cb40039c0 msgr2=0x7f2ccc156c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:45.175 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.181+0000 7f2cd0c00640 1 --2- 172.21.15.44:0/341180483 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f2cb40039c0 0x7f2ccc156c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:45.175 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.181+0000 7f2cd0c00640 1 -- 172.21.15.44:0/341180483 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2ccc0cb7b0 msgr2=0x7f2ccc0cbbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:45.175 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.181+0000 7f2cd0c00640 1 --2- 172.21.15.44:0/341180483 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2ccc0cb7b0 0x7f2ccc0cbbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:45.175 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.181+0000 7f2cd0c00640 1 -- 172.21.15.44:0/341180483 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2ccc14ab20 con 0x7f2ccc14a710 2024-04-17T19:47:45.175 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.181+0000 7f2cd2000640 1 --2- 172.21.15.44:0/341180483 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2ccc0cb7b0 0x7f2ccc0cbbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-17T19:47:45.175 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.181+0000 7f2cd0c00640 1 --2- 172.21.15.44:0/341180483 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2ccc14a710 0x7f2ccc0ccc40 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f2cb8011560 tx=0x7f2cb8011a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:47:45.175 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.181+0000 7f2cc9600640 1 -- 172.21.15.44:0/341180483 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2cb8019070 con 0x7f2ccc14a710 2024-04-17T19:47:45.175 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.181+0000 7f2cc9600640 1 -- 172.21.15.44:0/341180483 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2cb8003620 con 0x7f2ccc14a710 2024-04-17T19:47:45.175 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.181+0000 7f2cd4000640 1 -- 172.21.15.44:0/341180483 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2ccc157290 con 0x7f2ccc14a710 2024-04-17T19:47:45.176 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.181+0000 7f2cc9600640 1 -- 172.21.15.44:0/341180483 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2cb80039f0 con 0x7f2ccc14a710 2024-04-17T19:47:45.176 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.181+0000 7f2cd4000640 1 -- 172.21.15.44:0/341180483 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2ccc157530 con 0x7f2ccc14a710 2024-04-17T19:47:45.176 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.185+0000 7f2cc9600640 1 -- 172.21.15.44:0/341180483 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f2cb801c070 con 0x7f2ccc14a710 2024-04-17T19:47:45.177 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.185+0000 7f2cc9600640 1 --2- 172.21.15.44:0/341180483 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f2cac0683b0 0x7f2cac06a8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:45.177 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.185+0000 7f2cc9600640 1 -- 172.21.15.44:0/341180483 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6619+0+0 (secure 0 0 0) 0x7f2cb8086c60 con 0x7f2ccc14a710 2024-04-17T19:47:45.178 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.185+0000 7f2cd1600640 1 --2- 172.21.15.44:0/341180483 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f2cac0683b0 0x7f2cac06a8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:45.178 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.185+0000 7f2cdb5b0000 1 Processor -- start 2024-04-17T19:47:45.178 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.185+0000 7f2cdb5b0000 1 -- start start 2024-04-17T19:47:45.179 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.189+0000 7f2cd1600640 1 --2- 172.21.15.44:0/341180483 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f2cac0683b0 0x7f2cac06a8c0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f2cc00af000 tx=0x7f2cc00046d0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:47:45.180 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.189+0000 7f2cdb5b0000 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x556708adac10 0x556708c441b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:45.180 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.189+0000 7f2cdb5b0000 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x556708ad3930 0x556708c446f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:45.180 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.189+0000 7f2cdb5b0000 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5567086d3280 0x556708c44c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:45.181 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.189+0000 7f2cdb5b0000 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x556708a514f0 con 0x5567086d3280 2024-04-17T19:47:45.181 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.189+0000 7f2cdb5b0000 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x5567089ebc10 con 0x556708adac10 2024-04-17T19:47:45.181 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.189+0000 7f2cdb5b0000 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x556708a4d4b0 con 0x556708ad3930 2024-04-17T19:47:45.181 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.189+0000 7f2cd2000640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5567086d3280 0x556708c44c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:45.181 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.189+0000 7f2cd2000640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5567086d3280 0x556708c44c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:60928/0 (socket says 172.21.15.44:60928) 2024-04-17T19:47:45.181 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.189+0000 7f2cd2000640 1 -- 172.21.15.44:0/2030530698 learned_addr learned my addr 172.21.15.44:0/2030530698 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-04-17T19:47:45.181 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.189+0000 7f2cd0c00640 1 --2- 172.21.15.44:0/2030530698 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x556708ad3930 0x556708c446f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:45.181 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.189+0000 7f2cd1600640 1 --2- 172.21.15.44:0/2030530698 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x556708adac10 0x556708c441b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:45.181 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.189+0000 7f2cd2000640 1 -- 172.21.15.44:0/2030530698 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x556708ad3930 msgr2=0x556708c446f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T19:47:45.181 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.189+0000 7f2cd2000640 1 --2- 172.21.15.44:0/2030530698 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x556708ad3930 0x556708c446f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:45.181 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.189+0000 7f2cd2000640 1 -- 172.21.15.44:0/2030530698 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x556708adac10 msgr2=0x556708c441b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T19:47:45.181 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.189+0000 7f2cd2000640 1 --2- 172.21.15.44:0/2030530698 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x556708adac10 0x556708c441b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:45.181 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.189+0000 7f2cd2000640 1 -- 172.21.15.44:0/2030530698 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5567089ebe60 con 0x5567086d3280 2024-04-17T19:47:45.181 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.189+0000 7f2cd2000640 1 --2- 172.21.15.44:0/2030530698 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5567086d3280 0x556708c44c30 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f2ccc1562b0 tx=0x7f2cc4007420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8a5ea6af6eaa56b5 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:47:45.183 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.189+0000 7f2cbdc00640 1 -- 172.21.15.44:0/2030530698 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2cc4014400 con 0x5567086d3280 2024-04-17T19:47:45.183 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.189+0000 7f2cbdc00640 1 -- 172.21.15.44:0/2030530698 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2cc40145a0 con 0x5567086d3280 2024-04-17T19:47:45.183 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.189+0000 7f2cbdc00640 1 -- 172.21.15.44:0/2030530698 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2cc4014950 con 0x5567086d3280 2024-04-17T19:47:45.183 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.189+0000 7f2cdb5b0000 1 -- 172.21.15.44:0/2030530698 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5567086d3280 msgr2=0x556708c44c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:45.183 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.189+0000 7f2cdb5b0000 1 --2- 172.21.15.44:0/2030530698 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5567086d3280 0x556708c44c30 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f2ccc1562b0 tx=0x7f2cc4007420 comp rx=0 tx=0).stop 2024-04-17T19:47:45.183 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.189+0000 7f2cdb5b0000 1 -- 172.21.15.44:0/2030530698 shutdown_connections 2024-04-17T19:47:45.183 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.189+0000 7f2cdb5b0000 1 --2- 172.21.15.44:0/2030530698 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x556708ad3930 0x556708c446f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:45.183 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.189+0000 7f2cdb5b0000 1 --2- 172.21.15.44:0/2030530698 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5567086d3280 0x556708c44c30 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:45.183 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.189+0000 7f2cdb5b0000 1 --2- 172.21.15.44:0/2030530698 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x556708adac10 0x556708c441b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:45.183 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.189+0000 7f2cdb5b0000 1 -- 172.21.15.44:0/2030530698 >> 172.21.15.44:0/2030530698 conn(0x556708b1c670 msgr2=0x556708c41f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:47:45.183 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.189+0000 7f2cdb5b0000 1 -- 172.21.15.44:0/2030530698 shutdown_connections 2024-04-17T19:47:45.183 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.189+0000 7f2cdb5b0000 1 -- 172.21.15.44:0/2030530698 wait complete. 2024-04-17T19:47:45.183 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.193+0000 7f2cdb5b0000 1 -- start start 2024-04-17T19:47:45.184 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.193+0000 7f2cdb5b0000 1 Processor -- start 2024-04-17T19:47:45.185 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.193+0000 7f2cdb5b0000 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5567086d3280 0x556708c3df10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:45.185 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.193+0000 7f2cdb5b0000 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x556708ad3930 0x556708c3e450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:45.185 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.193+0000 7f2cdb5b0000 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x556708adac10 0x556708c05bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:45.185 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.193+0000 7f2cdb5b0000 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x556708a929e0 con 0x5567086d3280 2024-04-17T19:47:45.185 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.193+0000 7f2cdb5b0000 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x556708a0ea80 con 0x556708ad3930 2024-04-17T19:47:45.185 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.193+0000 7f2cdb5b0000 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x556708a0cd10 con 0x556708adac10 2024-04-17T19:47:45.186 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.193+0000 7f2cdb5b0000 10 client.0 _ll_register_callbacks cb 0x556708beeb20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-17T19:47:45.186 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.193+0000 7f2cd1600640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5567086d3280 0x556708c3df10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:45.186 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.193+0000 7f2cd1600640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5567086d3280 0x556708c3df10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:60944/0 (socket says 172.21.15.44:60944) 2024-04-17T19:47:45.186 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.193+0000 7f2cd1600640 1 -- 172.21.15.44:0/4246728731 learned_addr learned my addr 172.21.15.44:0/4246728731 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-04-17T19:47:45.186 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.193+0000 7f2cd2000640 1 --2- 172.21.15.44:0/4246728731 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x556708adac10 0x556708c05bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:45.186 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.193+0000 7f2cd0c00640 1 --2- 172.21.15.44:0/4246728731 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x556708ad3930 0x556708c3e450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:45.186 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.193+0000 7f2cd1600640 1 -- 172.21.15.44:0/4246728731 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x556708adac10 msgr2=0x556708c05bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T19:47:45.186 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.193+0000 7f2cd1600640 1 --2- 172.21.15.44:0/4246728731 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x556708adac10 0x556708c05bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:45.186 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.193+0000 7f2cd1600640 1 -- 172.21.15.44:0/4246728731 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x556708ad3930 msgr2=0x556708c3e450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T19:47:45.186 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.193+0000 7f2cd1600640 1 --2- 172.21.15.44:0/4246728731 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x556708ad3930 0x556708c3e450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:45.186 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.193+0000 7f2cd1600640 1 -- 172.21.15.44:0/4246728731 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556708a1ce20 con 0x5567086d3280 2024-04-17T19:47:45.188 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.193+0000 7f2cd1600640 1 --2- 172.21.15.44:0/4246728731 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5567086d3280 0x556708c3df10 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f2cc00b0040 tx=0x7f2cc00199d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fb4a93d54d38d01d server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:47:45.188 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.193+0000 7f2cb2000640 10 client.0 ms_handle_connect on v2:172.21.15.44:3300/0 2024-04-17T19:47:45.188 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.193+0000 7f2cb2000640 1 -- 172.21.15.44:0/4246728731 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2cc00b2040 con 0x5567086d3280 2024-04-17T19:47:45.188 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.193+0000 7f2cdb5b0000 1 -- 172.21.15.44:0/4246728731 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2cc40145a0 con 0x5567086d3280 2024-04-17T19:47:45.188 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.193+0000 7f2cb2000640 1 -- 172.21.15.44:0/4246728731 <== mon.0 v2:172.21.15.44:3300/0 2 ==== osd_map(27..27 src has 1..27) ==== 6619+0+0 (secure 0 0 0) 0x7f2cc00a5cc0 con 0x5567086d3280 2024-04-17T19:47:45.188 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.193+0000 7f2cb2000640 1 -- 172.21.15.44:0/4246728731 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_get_version_reply(handle=1 version=18) ==== 24+0+0 (secure 0 0 0) 0x7f2cc00d2050 con 0x5567086d3280 2024-04-17T19:47:45.188 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.193+0000 7f2cdb5b0000 10 client.4878 fetch_fsmap learned FSMap version 18 2024-04-17T19:47:45.188 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.193+0000 7f2cdb5b0000 1 -- 172.21.15.44:0/4246728731 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,fsmap=18,monmap=2+}) -- 0x556708b1ca80 con 0x5567086d3280 2024-04-17T19:47:45.188 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.193+0000 7f2cb2000640 1 -- 172.21.15.44:0/4246728731 <== mon.0 v2:172.21.15.44:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2cc40145a0 con 0x5567086d3280 2024-04-17T19:47:45.188 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.197+0000 7f2cb2000640 1 -- 172.21.15.44:0/4246728731 <== mon.0 v2:172.21.15.44:3300/0 5 ==== fsmap(e 18) ==== 4792+0+0 (secure 0 0 0) 0x7f2cc00d5020 con 0x5567086d3280 2024-04-17T19:47:45.189 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.197+0000 7f2cdb5b0000 10 client.4878 fetch_fsmap finished waiting for FSMap version 18 2024-04-17T19:47:45.189 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.197+0000 7f2cdb5b0000 10 client.4878 resolve_mds: resolved name 'f' to daemon mds.f 2024-04-17T19:47:45.189 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.197+0000 7f2cdb5b0000 20 client.4878 populate_metadata read hostname 'smithi044' 2024-04-17T19:47:45.189 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.197+0000 7f2cdb5b0000 1 --2- 172.21.15.44:0/4246728731 >> [v2:172.21.15.62:6836/3085335335,v1:172.21.15.62:6837/3085335335] conn(0x5567086f77d0 0x556708c068f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:45.189 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.197+0000 7f2cdb5b0000 4 client.4878 mds_command: new command op to 4268 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-17T19:47:45.189 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.197+0000 7f2cdb5b0000 1 -- 172.21.15.44:0/4246728731 --> [v2:172.21.15.62:6836/3085335335,v1:172.21.15.62:6837/3085335335] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5567089eabe0 con 0x5567086f77d0 2024-04-17T19:47:45.189 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.197+0000 7f2cd0c00640 1 --2- 172.21.15.44:0/4246728731 >> [v2:172.21.15.62:6836/3085335335,v1:172.21.15.62:6837/3085335335] conn(0x5567086f77d0 0x556708c068f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:45.189 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.197+0000 7f2cd0c00640 1 --2- 172.21.15.44:0/4246728731 >> [v2:172.21.15.62:6836/3085335335,v1:172.21.15.62:6837/3085335335] conn(0x5567086f77d0 0x556708c068f0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=f132fb114f3a511b server_cookie=55d26dcc7d04c13e in_seq=0 out_seq=0 2024-04-17T19:47:45.189 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.197+0000 7f2cb2000640 10 client.4878 ms_handle_connect on v2:172.21.15.62:6836/3085335335 2024-04-17T19:47:45.190 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.197+0000 7f2cb2000640 1 -- 172.21.15.44:0/4246728731 <== mds.3 v2:172.21.15.62:6836/3085335335 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x5567089eabe0 con 0x5567086f77d0 2024-04-17T19:47:45.190 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.197+0000 7f2cb2000640 10 client.4878 handle_command_reply: tid=0 2024-04-17T19:47:45.190 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.197+0000 7f2cdb5b0000 1 client.4878 shutdown 2024-04-17T19:47:45.191 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.197+0000 7f2cdb5b0000 1 -- 172.21.15.44:0/4246728731 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5567086d3280 msgr2=0x556708c3df10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:45.191 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.197+0000 7f2cdb5b0000 1 --2- 172.21.15.44:0/4246728731 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5567086d3280 0x556708c3df10 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f2cc00b0040 tx=0x7f2cc00199d0 comp rx=0 tx=0).stop 2024-04-17T19:47:45.191 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.197+0000 7f2cdb5b0000 1 -- 172.21.15.44:0/4246728731 shutdown_connections 2024-04-17T19:47:45.191 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.197+0000 7f2cdb5b0000 1 --2- 172.21.15.44:0/4246728731 >> [v2:172.21.15.62:6836/3085335335,v1:172.21.15.62:6837/3085335335] conn(0x5567086f77d0 0x556708c068f0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:45.191 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.197+0000 7f2cdb5b0000 1 --2- 172.21.15.44:0/4246728731 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x556708adac10 0x556708c05bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:45.191 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.197+0000 7f2cdb5b0000 1 --2- 172.21.15.44:0/4246728731 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x556708ad3930 0x556708c3e450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:45.191 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.197+0000 7f2cdb5b0000 1 --2- 172.21.15.44:0/4246728731 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5567086d3280 0x556708c3df10 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:45.191 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.197+0000 7f2cb2000640 0 client.4878 ms_handle_reset on v2:172.21.15.62:6836/3085335335 2024-04-17T19:47:45.191 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.197+0000 7f2cdb5b0000 1 -- 172.21.15.44:0/4246728731 >> 172.21.15.44:0/4246728731 conn(0x556708b1c670 msgr2=0x556708c3f720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:47:45.191 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.197+0000 7f2cdb5b0000 1 -- 172.21.15.44:0/4246728731 shutdown_connections 2024-04-17T19:47:45.191 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.197+0000 7f2cdb5b0000 1 -- 172.21.15.44:0/4246728731 wait complete. 2024-04-17T19:47:45.191 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.197+0000 7f2cdb5b0000 20 client.4878 trim_cache size 0 max 16384 2024-04-17T19:47:45.209 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.217+0000 7f2cdb5b0000 1 Processor -- start 2024-04-17T19:47:45.209 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.217+0000 7f2cdb5b0000 1 -- start start 2024-04-17T19:47:45.211 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.217+0000 7f2cdb5b0000 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5567086d3280 0x556708c3d220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:45.212 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.217+0000 7f2cdb5b0000 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x556708ad3930 0x556708c3c160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:45.212 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.221+0000 7f2cdb5b0000 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x556708adac10 0x556708c3c6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:45.212 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.221+0000 7f2cdb5b0000 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f2ccc201740 con 0x5567086d3280 2024-04-17T19:47:45.212 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.221+0000 7f2cdb5b0000 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x556708a50800 con 0x556708adac10 2024-04-17T19:47:45.212 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.221+0000 7f2cdb5b0000 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x556708a55b20 con 0x556708ad3930 2024-04-17T19:47:45.212 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.221+0000 7f2cd1600640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5567086d3280 0x556708c3d220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:45.212 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.221+0000 7f2cd1600640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5567086d3280 0x556708c3d220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:60960/0 (socket says 172.21.15.44:60960) 2024-04-17T19:47:45.212 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.221+0000 7f2cd1600640 1 -- 172.21.15.44:0/2232821017 learned_addr learned my addr 172.21.15.44:0/2232821017 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-04-17T19:47:45.212 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.221+0000 7f2cd2000640 1 --2- 172.21.15.44:0/2232821017 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x556708adac10 0x556708c3c6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:45.212 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.221+0000 7f2cd0c00640 1 --2- 172.21.15.44:0/2232821017 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x556708ad3930 0x556708c3c160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:45.212 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.221+0000 7f2cd1600640 1 -- 172.21.15.44:0/2232821017 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x556708ad3930 msgr2=0x556708c3c160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T19:47:45.212 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.221+0000 7f2cd1600640 1 --2- 172.21.15.44:0/2232821017 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x556708ad3930 0x556708c3c160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:45.212 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.221+0000 7f2cd1600640 1 -- 172.21.15.44:0/2232821017 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x556708adac10 msgr2=0x556708c3c6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T19:47:45.213 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.221+0000 7f2cd1600640 1 --2- 172.21.15.44:0/2232821017 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x556708adac10 0x556708c3c6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:45.213 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.221+0000 7f2cd1600640 1 -- 172.21.15.44:0/2232821017 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556708aaae30 con 0x5567086d3280 2024-04-17T19:47:45.213 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.221+0000 7f2cd1600640 1 --2- 172.21.15.44:0/2232821017 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5567086d3280 0x556708c3d220 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f2cc001d4d0 tx=0x7f2cc00c1000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f653c66b92c42c61 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:47:45.213 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.221+0000 7f2cbd200640 1 -- 172.21.15.44:0/2232821017 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2cc00b2040 con 0x5567086d3280 2024-04-17T19:47:45.213 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.221+0000 7f2cbd200640 1 -- 172.21.15.44:0/2232821017 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2cc00ca070 con 0x5567086d3280 2024-04-17T19:47:45.213 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.221+0000 7f2cbd200640 1 -- 172.21.15.44:0/2232821017 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2cc00a59e0 con 0x5567086d3280 2024-04-17T19:47:45.214 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.221+0000 7f2cdb5b0000 1 -- 172.21.15.44:0/2232821017 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5567086d3280 msgr2=0x556708c3d220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:45.214 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.221+0000 7f2cdb5b0000 1 --2- 172.21.15.44:0/2232821017 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5567086d3280 0x556708c3d220 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f2cc001d4d0 tx=0x7f2cc00c1000 comp rx=0 tx=0).stop 2024-04-17T19:47:45.214 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.221+0000 7f2cdb5b0000 1 -- 172.21.15.44:0/2232821017 shutdown_connections 2024-04-17T19:47:45.214 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.221+0000 7f2cdb5b0000 1 --2- 172.21.15.44:0/2232821017 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x556708ad3930 0x556708c3c160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:45.214 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.221+0000 7f2cdb5b0000 1 --2- 172.21.15.44:0/2232821017 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x556708adac10 0x556708c3c6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:45.214 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.221+0000 7f2cdb5b0000 1 --2- 172.21.15.44:0/2232821017 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5567086d3280 0x556708c3d220 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:45.214 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.221+0000 7f2cdb5b0000 1 -- 172.21.15.44:0/2232821017 >> 172.21.15.44:0/2232821017 conn(0x556708b1c670 msgr2=0x556708c5fc40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:47:45.214 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.221+0000 7f2cdb5b0000 1 -- 172.21.15.44:0/2232821017 shutdown_connections 2024-04-17T19:47:45.214 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.221+0000 7f2cdb5b0000 1 -- 172.21.15.44:0/2232821017 wait complete. 2024-04-17T19:47:45.214 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.221+0000 7f2cdb5b0000 1 -- start start 2024-04-17T19:47:45.215 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.221+0000 7f2cdb5b0000 1 Processor -- start 2024-04-17T19:47:45.217 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.225+0000 7f2cdb5b0000 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5567086d3280 0x556708c5cdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:45.217 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.225+0000 7f2cdb5b0000 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x556708ad3930 0x556708c5d310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:45.217 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.225+0000 7f2cdb5b0000 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556708adac10 0x556708c5d850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:45.217 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.225+0000 7f2cdb5b0000 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x5567089e77d0 con 0x556708adac10 2024-04-17T19:47:45.217 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.225+0000 7f2cdb5b0000 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x556708a5e700 con 0x5567086d3280 2024-04-17T19:47:45.217 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.225+0000 7f2cdb5b0000 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x556708a0f570 con 0x556708ad3930 2024-04-17T19:47:45.217 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.225+0000 7f2cdb5b0000 10 client.0 _ll_register_callbacks cb 0x7f2cc0009060 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-17T19:47:45.217 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.225+0000 7f2cd2000640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556708adac10 0x556708c5d850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:45.217 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.225+0000 7f2cd2000640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556708adac10 0x556708c5d850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:60976/0 (socket says 172.21.15.44:60976) 2024-04-17T19:47:45.217 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.225+0000 7f2cd2000640 1 -- 172.21.15.44:0/1331540651 learned_addr learned my addr 172.21.15.44:0/1331540651 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-04-17T19:47:45.217 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.225+0000 7f2cd1600640 1 --2- 172.21.15.44:0/1331540651 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5567086d3280 0x556708c5cdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:45.217 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.225+0000 7f2cd0c00640 1 --2- 172.21.15.44:0/1331540651 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x556708ad3930 0x556708c5d310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:45.218 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.225+0000 7f2cd2000640 1 -- 172.21.15.44:0/1331540651 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x556708ad3930 msgr2=0x556708c5d310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T19:47:45.218 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.225+0000 7f2cd2000640 1 --2- 172.21.15.44:0/1331540651 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x556708ad3930 0x556708c5d310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:45.218 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.225+0000 7f2cd2000640 1 -- 172.21.15.44:0/1331540651 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5567086d3280 msgr2=0x556708c5cdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T19:47:45.218 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.225+0000 7f2cd2000640 1 --2- 172.21.15.44:0/1331540651 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5567086d3280 0x556708c5cdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:45.218 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.225+0000 7f2cd2000640 1 -- 172.21.15.44:0/1331540651 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5567089e37e0 con 0x556708adac10 2024-04-17T19:47:45.218 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.225+0000 7f2cd1600640 1 --2- 172.21.15.44:0/1331540651 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5567086d3280 0x556708c5cdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-17T19:47:45.218 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.225+0000 7f2cd0c00640 1 --2- 172.21.15.44:0/1331540651 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x556708ad3930 0x556708c5d310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-17T19:47:45.218 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.225+0000 7f2cd2000640 1 --2- 172.21.15.44:0/1331540651 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556708adac10 0x556708c5d850 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f2cc4000f90 tx=0x7f2cc4001e40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a69feb4cffa5235d server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:47:45.218 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.225+0000 7f2cb2000640 10 client.0 ms_handle_connect on v2:172.21.15.44:3300/0 2024-04-17T19:47:45.218 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.225+0000 7f2cb2000640 1 -- 172.21.15.44:0/1331540651 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2cc402d060 con 0x556708adac10 2024-04-17T19:47:45.218 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.225+0000 7f2cb2000640 1 -- 172.21.15.44:0/1331540651 <== mon.0 v2:172.21.15.44:3300/0 2 ==== osd_map(27..27 src has 1..27) ==== 6619+0+0 (secure 0 0 0) 0x7f2cc4010040 con 0x556708adac10 2024-04-17T19:47:45.218 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.225+0000 7f2cdb5b0000 1 -- 172.21.15.44:0/1331540651 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2cc00ca070 con 0x556708adac10 2024-04-17T19:47:45.218 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.225+0000 7f2cb2000640 1 -- 172.21.15.44:0/1331540651 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_get_version_reply(handle=1 version=18) ==== 24+0+0 (secure 0 0 0) 0x7f2cc4033050 con 0x556708adac10 2024-04-17T19:47:45.218 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.225+0000 7f2cdb5b0000 10 client.4884 fetch_fsmap learned FSMap version 18 2024-04-17T19:47:45.218 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.225+0000 7f2cdb5b0000 1 -- 172.21.15.44:0/1331540651 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,fsmap=18,monmap=2+}) -- 0x5567089f6670 con 0x556708adac10 2024-04-17T19:47:45.219 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.225+0000 7f2cb2000640 1 -- 172.21.15.44:0/1331540651 <== mon.0 v2:172.21.15.44:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2cc00ca070 con 0x556708adac10 2024-04-17T19:47:45.220 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.225+0000 7f2cb2000640 1 -- 172.21.15.44:0/1331540651 <== mon.0 v2:172.21.15.44:3300/0 5 ==== fsmap(e 18) ==== 4792+0+0 (secure 0 0 0) 0x7f2cc4036020 con 0x556708adac10 2024-04-17T19:47:45.220 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.225+0000 7f2cdb5b0000 10 client.4884 fetch_fsmap finished waiting for FSMap version 18 2024-04-17T19:47:45.220 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.225+0000 7f2cdb5b0000 10 client.4884 resolve_mds: resolved name 'f' to daemon mds.f 2024-04-17T19:47:45.220 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.225+0000 7f2cdb5b0000 20 client.4884 populate_metadata read hostname 'smithi044' 2024-04-17T19:47:45.221 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.225+0000 7f2cdb5b0000 1 --2- 172.21.15.44:0/1331540651 >> [v2:172.21.15.62:6836/3085335335,v1:172.21.15.62:6837/3085335335] conn(0x5567086e5830 0x556708c5dd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:45.221 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.225+0000 7f2cdb5b0000 4 client.4884 mds_command: new command op to 4268 tid=0 multi_id=0 [{"prefix": "status"}] 2024-04-17T19:47:45.221 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.225+0000 7f2cdb5b0000 1 -- 172.21.15.44:0/1331540651 --> [v2:172.21.15.62:6836/3085335335,v1:172.21.15.62:6837/3085335335] -- command(tid 0: {"prefix": "status"}) -- 0x556708a5ef10 con 0x5567086e5830 2024-04-17T19:47:45.221 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.225+0000 7f2cd1600640 1 --2- 172.21.15.44:0/1331540651 >> [v2:172.21.15.62:6836/3085335335,v1:172.21.15.62:6837/3085335335] conn(0x5567086e5830 0x556708c5dd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:45.221 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.229+0000 7f2cd1600640 1 --2- 172.21.15.44:0/1331540651 >> [v2:172.21.15.62:6836/3085335335,v1:172.21.15.62:6837/3085335335] conn(0x5567086e5830 0x556708c5dd90 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=cb3e6f00b2dcb89c server_cookie=d9a004abcaa84a3 in_seq=0 out_seq=0 2024-04-17T19:47:45.221 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.229+0000 7f2cb2000640 10 client.4884 ms_handle_connect on v2:172.21.15.62:6836/3085335335 2024-04-17T19:47:45.221 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.229+0000 7f2cb2000640 1 -- 172.21.15.44:0/1331540651 <== mds.3 v2:172.21.15.62:6836/3085335335 1 ==== command_reply(tid 0: 0 ) ==== 8+0+325 (crc 0 0 0) 0x556708a5ef10 con 0x5567086e5830 2024-04-17T19:47:45.221 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.229+0000 7f2cb2000640 10 client.4884 handle_command_reply: tid=0 2024-04-17T19:47:45.221 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.229+0000 7f2cdb5b0000 1 client.4884 shutdown 2024-04-17T19:47:45.221 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.229+0000 7f2cdb5b0000 1 -- 172.21.15.44:0/1331540651 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556708adac10 msgr2=0x556708c5d850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:45.221 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.229+0000 7f2cdb5b0000 1 --2- 172.21.15.44:0/1331540651 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556708adac10 0x556708c5d850 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f2cc4000f90 tx=0x7f2cc4001e40 comp rx=0 tx=0).stop 2024-04-17T19:47:45.221 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.229+0000 7f2cdb5b0000 1 -- 172.21.15.44:0/1331540651 shutdown_connections 2024-04-17T19:47:45.221 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.229+0000 7f2cdb5b0000 1 --2- 172.21.15.44:0/1331540651 >> [v2:172.21.15.62:6836/3085335335,v1:172.21.15.62:6837/3085335335] conn(0x5567086e5830 0x556708c5dd90 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:45.221 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.229+0000 7f2cdb5b0000 1 --2- 172.21.15.44:0/1331540651 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x556708ad3930 0x556708c5d310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:45.222 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.229+0000 7f2cdb5b0000 1 --2- 172.21.15.44:0/1331540651 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556708adac10 0x556708c5d850 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:45.222 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.229+0000 7f2cdb5b0000 1 --2- 172.21.15.44:0/1331540651 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5567086d3280 0x556708c5cdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:45.222 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.229+0000 7f2cdb5b0000 1 -- 172.21.15.44:0/1331540651 >> 172.21.15.44:0/1331540651 conn(0x556708b1c670 msgr2=0x556708c3c160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:47:45.222 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.229+0000 7f2cb2000640 0 client.4884 ms_handle_reset on v2:172.21.15.62:6836/3085335335 2024-04-17T19:47:45.222 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.229+0000 7f2cdb5b0000 1 -- 172.21.15.44:0/1331540651 shutdown_connections 2024-04-17T19:47:45.222 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.229+0000 7f2cdb5b0000 1 -- 172.21.15.44:0/1331540651 wait complete. 2024-04-17T19:47:45.222 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.229+0000 7f2cdb5b0000 20 client.4884 trim_cache size 0 max 16384 2024-04-17T19:47:45.222 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2024-04-17T19:47:45.222 INFO:teuthology.orchestra.run.smithi044.stdout: "cluster_fsid": "703f77ca-79c6-4a66-b576-62c526cb1021", 2024-04-17T19:47:45.222 INFO:teuthology.orchestra.run.smithi044.stdout: "whoami": 3, 2024-04-17T19:47:45.222 INFO:teuthology.orchestra.run.smithi044.stdout: "id": 4268, 2024-04-17T19:47:45.222 INFO:teuthology.orchestra.run.smithi044.stdout: "want_state": "up:active", 2024-04-17T19:47:45.223 INFO:teuthology.orchestra.run.smithi044.stdout: "state": "up:active", 2024-04-17T19:47:45.223 INFO:teuthology.orchestra.run.smithi044.stdout: "fs_name": "cephfs", 2024-04-17T19:47:45.223 INFO:teuthology.orchestra.run.smithi044.stdout: "rank_uptime": 16.344219826, 2024-04-17T19:47:45.223 INFO:teuthology.orchestra.run.smithi044.stdout: "mdsmap_epoch": 18, 2024-04-17T19:47:45.223 INFO:teuthology.orchestra.run.smithi044.stdout: "osdmap_epoch": 27, 2024-04-17T19:47:45.223 INFO:teuthology.orchestra.run.smithi044.stdout: "osdmap_epoch_barrier": 27, 2024-04-17T19:47:45.223 INFO:teuthology.orchestra.run.smithi044.stdout: "uptime": 55.831998331000001 2024-04-17T19:47:45.223 INFO:teuthology.orchestra.run.smithi044.stdout:} 2024-04-17T19:47:45.224 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.229+0000 7f2cd4000640 1 -- 172.21.15.44:0/341180483 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f2cac0683b0 msgr2=0x7f2cac06a8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:45.224 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.229+0000 7f2cd4000640 1 --2- 172.21.15.44:0/341180483 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f2cac0683b0 0x7f2cac06a8c0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f2cc00af000 tx=0x7f2cc00046d0 comp rx=0 tx=0).stop 2024-04-17T19:47:45.224 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.229+0000 7f2cd4000640 1 -- 172.21.15.44:0/341180483 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2ccc14a710 msgr2=0x7f2ccc0ccc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:45.224 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.229+0000 7f2cd4000640 1 --2- 172.21.15.44:0/341180483 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2ccc14a710 0x7f2ccc0ccc40 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f2cb8011560 tx=0x7f2cb8011a20 comp rx=0 tx=0).stop 2024-04-17T19:47:45.224 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.229+0000 7f2cd4000640 1 -- 172.21.15.44:0/341180483 shutdown_connections 2024-04-17T19:47:45.224 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.229+0000 7f2cd4000640 1 --2- 172.21.15.44:0/341180483 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f2cac0683b0 0x7f2cac06a8c0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:45.224 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.229+0000 7f2cd4000640 1 --2- 172.21.15.44:0/341180483 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2ccc0cb7b0 0x7f2ccc0cbbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:45.224 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.229+0000 7f2cd4000640 1 --2- 172.21.15.44:0/341180483 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2ccc14a710 0x7f2ccc0ccc40 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:45.224 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.229+0000 7f2cd4000640 1 --2- 172.21.15.44:0/341180483 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f2cb40039c0 0x7f2ccc156c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:45.224 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.229+0000 7f2cd4000640 1 -- 172.21.15.44:0/341180483 >> 172.21.15.44:0/341180483 conn(0x7f2ccc06c380 msgr2=0x7f2ccc162840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:47:45.224 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.229+0000 7f2cd4000640 1 -- 172.21.15.44:0/341180483 shutdown_connections 2024-04-17T19:47:45.224 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.229+0000 7f2cd4000640 1 -- 172.21.15.44:0/341180483 wait complete. 2024-04-17T19:47:45.240 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.e status 2024-04-17T19:47:45.391 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.401+0000 7f3404e00640 1 Processor -- start 2024-04-17T19:47:45.392 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.401+0000 7f3404e00640 1 -- start start 2024-04-17T19:47:45.394 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.401+0000 7f3404e00640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f3400152860 0x7f34000c68b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:45.394 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.401+0000 7f3404e00640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f3400159140 0x7f34000c47e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:45.394 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.401+0000 7f3404e00640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f34000c4000 con 0x7f34000c4d20 2024-04-17T19:47:45.394 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.401+0000 7f3404e00640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 -- 0x7f34000c6eb0 con 0x7f3400159140 2024-04-17T19:47:45.394 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.401+0000 7f3404e00640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7f34000c78e0 con 0x7f3400152860 2024-04-17T19:47:45.394 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.401+0000 7f33fde00640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f3400152860 0x7f34000c68b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:45.394 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.401+0000 7f33f5400640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f3400159140 0x7f34000c47e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:45.394 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.401+0000 7f33fe800640 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f34000c4d20 0x7f34000c80a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.44:60974/0 (socket says 172.21.15.44:60974) 2024-04-17T19:47:45.394 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.401+0000 7f33fe800640 1 -- 172.21.15.44:0/1076289689 learned_addr learned my addr 172.21.15.44:0/1076289689 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-04-17T19:47:45.395 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.405+0000 7f33fde00640 1 -- 172.21.15.44:0/1076289689 >> v2:172.21.15.62:3300/0 conn(0x7f3400159140 msgr2=0x7f34000c47e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T19:47:45.395 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.405+0000 7f33fde00640 1 --2- 172.21.15.44:0/1076289689 >> v2:172.21.15.62:3300/0 conn(0x7f3400159140 0x7f34000c47e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:45.395 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.405+0000 7f33fde00640 1 -- 172.21.15.44:0/1076289689 >> v1:172.21.15.62:6789/0 conn(0x7f34000c4d20 legacy=0x7f34000c80a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:45.395 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.405+0000 7f33fde00640 1 -- 172.21.15.44:0/1076289689 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f34000c42e0 con 0x7f3400152860 2024-04-17T19:47:45.395 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.405+0000 7f33f5400640 1 --2- 172.21.15.44:0/1076289689 >> v2:172.21.15.62:3300/0 conn(0x7f3400159140 0x7f34000c47e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-17T19:47:45.397 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.405+0000 7f33fde00640 1 --2- 172.21.15.44:0/1076289689 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f3400152860 0x7f34000c68b0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f33f00097c0 tx=0x7f33f001c410 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8020ec84628e3920 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:47:45.398 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.405+0000 7f33fd400640 1 -- 172.21.15.44:0/1076289689 <== mon.2 v2:172.21.15.62:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33f00b0070 con 0x7f3400152860 2024-04-17T19:47:45.398 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.405+0000 7f33fd400640 1 -- 172.21.15.44:0/1076289689 <== mon.2 v2:172.21.15.62:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f33f00ab600 con 0x7f3400152860 2024-04-17T19:47:45.398 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.405+0000 7f33fd400640 1 -- 172.21.15.44:0/1076289689 <== mon.2 v2:172.21.15.62:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33f00ab9d0 con 0x7f3400152860 2024-04-17T19:47:45.399 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.409+0000 7f3404e00640 1 -- 172.21.15.44:0/1076289689 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f3400152860 msgr2=0x7f34000c68b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:45.399 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.409+0000 7f3404e00640 1 --2- 172.21.15.44:0/1076289689 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f3400152860 0x7f34000c68b0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f33f00097c0 tx=0x7f33f001c410 comp rx=0 tx=0).stop 2024-04-17T19:47:45.399 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.409+0000 7f3404e00640 1 -- 172.21.15.44:0/1076289689 shutdown_connections 2024-04-17T19:47:45.399 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.409+0000 7f3404e00640 1 --2- 172.21.15.44:0/1076289689 >> v2:172.21.15.62:3300/0 conn(0x7f3400159140 0x7f34000c47e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:45.399 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.409+0000 7f3404e00640 1 --2- 172.21.15.44:0/1076289689 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f3400152860 0x7f34000c68b0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:45.399 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.409+0000 7f3404e00640 1 -- 172.21.15.44:0/1076289689 >> 172.21.15.44:0/1076289689 conn(0x7f340006c380 msgr2=0x7f3400070080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:47:45.399 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.409+0000 7f3404e00640 1 -- 172.21.15.44:0/1076289689 shutdown_connections 2024-04-17T19:47:45.399 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.409+0000 7f3404e00640 1 -- 172.21.15.44:0/1076289689 wait complete. 2024-04-17T19:47:45.401 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.409+0000 7f3404e00640 1 Processor -- start 2024-04-17T19:47:45.401 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.409+0000 7f3404e00640 1 -- start start 2024-04-17T19:47:45.403 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.413+0000 7f3404e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f34000c4d20 0x7f34000c1740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:45.403 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.413+0000 7f3404e00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3400152860 0x7f3400146480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:45.404 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.413+0000 7f3404e00640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f3400159140 0x7f340013c300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:45.404 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.413+0000 7f3404e00640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f34000c5130 con 0x7f34000c4d20 2024-04-17T19:47:45.404 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.413+0000 7f3404e00640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f34000c9510 con 0x7f3400152860 2024-04-17T19:47:45.404 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.413+0000 7f3404e00640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7f34000c9690 con 0x7f3400159140 2024-04-17T19:47:45.404 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.413+0000 7f33fde00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f34000c4d20 0x7f34000c1740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:45.404 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.413+0000 7f33fde00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f34000c4d20 0x7f34000c1740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:34196/0 (socket says 172.21.15.44:34196) 2024-04-17T19:47:45.404 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.413+0000 7f33fde00640 1 -- 172.21.15.44:0/3122463779 learned_addr learned my addr 172.21.15.44:0/3122463779 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-04-17T19:47:45.404 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.413+0000 7f33f5400640 1 --2- 172.21.15.44:0/3122463779 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3400152860 0x7f3400146480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:45.404 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.413+0000 7f33fe800640 1 --2- 172.21.15.44:0/3122463779 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f3400159140 0x7f340013c300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:45.404 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.413+0000 7f33fde00640 1 -- 172.21.15.44:0/3122463779 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f3400159140 msgr2=0x7f340013c300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:45.404 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.413+0000 7f33fde00640 1 --2- 172.21.15.44:0/3122463779 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f3400159140 0x7f340013c300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:45.404 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.413+0000 7f33fde00640 1 -- 172.21.15.44:0/3122463779 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3400152860 msgr2=0x7f3400146480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:45.404 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.413+0000 7f33fde00640 1 --2- 172.21.15.44:0/3122463779 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3400152860 0x7f3400146480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:45.404 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.413+0000 7f33fde00640 1 -- 172.21.15.44:0/3122463779 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3400142530 con 0x7f34000c4d20 2024-04-17T19:47:45.405 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.413+0000 7f33f5400640 1 --2- 172.21.15.44:0/3122463779 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3400152860 0x7f3400146480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-17T19:47:45.405 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.413+0000 7f33fde00640 1 --2- 172.21.15.44:0/3122463779 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f34000c4d20 0x7f34000c1740 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f33f001a040 tx=0x7f33f00191b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:47:45.405 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.413+0000 7f33f6a00640 1 -- 172.21.15.44:0/3122463779 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33f00b0040 con 0x7f34000c4d20 2024-04-17T19:47:45.405 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.413+0000 7f33f6a00640 1 -- 172.21.15.44:0/3122463779 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f33f00b9070 con 0x7f34000c4d20 2024-04-17T19:47:45.405 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.413+0000 7f3404e00640 1 -- 172.21.15.44:0/3122463779 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f34000c1c80 con 0x7f34000c4d20 2024-04-17T19:47:45.406 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.413+0000 7f33f6a00640 1 -- 172.21.15.44:0/3122463779 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33f0006e20 con 0x7f34000c4d20 2024-04-17T19:47:45.406 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.413+0000 7f3404e00640 1 -- 172.21.15.44:0/3122463779 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f34001413a0 con 0x7f34000c4d20 2024-04-17T19:47:45.406 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.413+0000 7f33f6a00640 1 -- 172.21.15.44:0/3122463779 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f33f00b4630 con 0x7f34000c4d20 2024-04-17T19:47:45.408 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.417+0000 7f33f6a00640 1 --2- 172.21.15.44:0/3122463779 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f33dc068380 0x7f33dc06a890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:45.408 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.417+0000 7f33f6a00640 1 -- 172.21.15.44:0/3122463779 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6619+0+0 (secure 0 0 0) 0x7f33f0120740 con 0x7f34000c4d20 2024-04-17T19:47:45.408 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.417+0000 7f33f5400640 1 --2- 172.21.15.44:0/3122463779 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f33dc068380 0x7f33dc06a890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:45.408 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.417+0000 7f340c438000 1 Processor -- start 2024-04-17T19:47:45.409 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.417+0000 7f340c438000 1 -- start start 2024-04-17T19:47:45.409 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.417+0000 7f33f5400640 1 --2- 172.21.15.44:0/3122463779 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f33dc068380 0x7f33dc06a890 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f3400156260 tx=0x7f33e800b040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:47:45.410 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.417+0000 7f340c438000 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x55a21616ac10 0x55a2162d41b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:45.411 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.417+0000 7f340c438000 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55a216163930 0x55a2162d46f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:45.411 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.417+0000 7f340c438000 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a215d63280 0x55a2162d4c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:45.411 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.417+0000 7f340c438000 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55a2160e14f0 con 0x55a215d63280 2024-04-17T19:47:45.411 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.417+0000 7f340c438000 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x55a21607bc10 con 0x55a216163930 2024-04-17T19:47:45.411 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.417+0000 7f340c438000 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x55a2160dd4b0 con 0x55a21616ac10 2024-04-17T19:47:45.411 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.417+0000 7f33fe800640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a215d63280 0x55a2162d4c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:45.411 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.417+0000 7f33fe800640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a215d63280 0x55a2162d4c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:34208/0 (socket says 172.21.15.44:34208) 2024-04-17T19:47:45.411 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.417+0000 7f33fe800640 1 -- 172.21.15.44:0/764693151 learned_addr learned my addr 172.21.15.44:0/764693151 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-04-17T19:47:45.411 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.417+0000 7f33f5400640 1 --2- 172.21.15.44:0/764693151 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55a216163930 0x55a2162d46f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:45.411 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.417+0000 7f33fde00640 1 --2- 172.21.15.44:0/764693151 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x55a21616ac10 0x55a2162d41b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:45.411 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.421+0000 7f33fe800640 1 -- 172.21.15.44:0/764693151 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x55a21616ac10 msgr2=0x55a2162d41b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T19:47:45.411 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.421+0000 7f33fe800640 1 --2- 172.21.15.44:0/764693151 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x55a21616ac10 0x55a2162d41b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:45.411 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.421+0000 7f33fe800640 1 -- 172.21.15.44:0/764693151 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55a216163930 msgr2=0x55a2162d46f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T19:47:45.411 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.421+0000 7f33fe800640 1 --2- 172.21.15.44:0/764693151 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55a216163930 0x55a2162d46f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:45.411 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.421+0000 7f33fe800640 1 -- 172.21.15.44:0/764693151 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a21607be60 con 0x55a215d63280 2024-04-17T19:47:45.412 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.421+0000 7f33fe800640 1 --2- 172.21.15.44:0/764693151 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a215d63280 0x55a2162d4c30 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f33f80014f0 tx=0x7f33f80019b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a3138cb724ab065d server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:47:45.413 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.421+0000 7f33eea00640 1 -- 172.21.15.44:0/764693151 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33f8019070 con 0x55a215d63280 2024-04-17T19:47:45.413 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.421+0000 7f33eea00640 1 -- 172.21.15.44:0/764693151 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f33f8005ad0 con 0x55a215d63280 2024-04-17T19:47:45.413 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.421+0000 7f33eea00640 1 -- 172.21.15.44:0/764693151 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33f80070d0 con 0x55a215d63280 2024-04-17T19:47:45.413 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.421+0000 7f340c438000 1 -- 172.21.15.44:0/764693151 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a215d63280 msgr2=0x55a2162d4c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:45.413 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.421+0000 7f340c438000 1 --2- 172.21.15.44:0/764693151 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a215d63280 0x55a2162d4c30 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f33f80014f0 tx=0x7f33f80019b0 comp rx=0 tx=0).stop 2024-04-17T19:47:45.413 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.421+0000 7f340c438000 1 -- 172.21.15.44:0/764693151 shutdown_connections 2024-04-17T19:47:45.413 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.421+0000 7f340c438000 1 --2- 172.21.15.44:0/764693151 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a215d63280 0x55a2162d4c30 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:45.413 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.421+0000 7f340c438000 1 --2- 172.21.15.44:0/764693151 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55a216163930 0x55a2162d46f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:45.413 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.421+0000 7f340c438000 1 --2- 172.21.15.44:0/764693151 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x55a21616ac10 0x55a2162d41b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:45.413 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.421+0000 7f340c438000 1 -- 172.21.15.44:0/764693151 >> 172.21.15.44:0/764693151 conn(0x55a2161ac670 msgr2=0x55a2162d1f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:47:45.413 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.421+0000 7f340c438000 1 -- 172.21.15.44:0/764693151 shutdown_connections 2024-04-17T19:47:45.413 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.421+0000 7f340c438000 1 -- 172.21.15.44:0/764693151 wait complete. 2024-04-17T19:47:45.414 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.421+0000 7f340c438000 1 -- start start 2024-04-17T19:47:45.414 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.421+0000 7f340c438000 1 Processor -- start 2024-04-17T19:47:45.415 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.425+0000 7f340c438000 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55a215d63280 0x55a2162cdf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:45.416 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.425+0000 7f340c438000 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a216163930 0x55a2162ce450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:45.416 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.425+0000 7f340c438000 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x55a21616ac10 0x55a216295bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:45.416 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.425+0000 7f340c438000 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55a2161229e0 con 0x55a216163930 2024-04-17T19:47:45.416 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.425+0000 7f340c438000 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x55a21609ea80 con 0x55a215d63280 2024-04-17T19:47:45.416 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.425+0000 7f340c438000 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x55a21609cd10 con 0x55a21616ac10 2024-04-17T19:47:45.416 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.425+0000 7f340c438000 10 client.0 _ll_register_callbacks cb 0x55a21627eb20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-17T19:47:45.416 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.425+0000 7f33f5400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a216163930 0x55a2162ce450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:45.416 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.425+0000 7f33f5400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a216163930 0x55a2162ce450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:34216/0 (socket says 172.21.15.44:34216) 2024-04-17T19:47:45.416 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.425+0000 7f33f5400640 1 -- 172.21.15.44:0/2069451802 learned_addr learned my addr 172.21.15.44:0/2069451802 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-04-17T19:47:45.416 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.425+0000 7f33fde00640 1 --2- 172.21.15.44:0/2069451802 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55a215d63280 0x55a2162cdf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:45.416 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.425+0000 7f33fe800640 1 --2- 172.21.15.44:0/2069451802 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x55a21616ac10 0x55a216295bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:45.416 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.425+0000 7f33f5400640 1 -- 172.21.15.44:0/2069451802 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x55a21616ac10 msgr2=0x55a216295bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T19:47:45.416 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.425+0000 7f33f5400640 1 --2- 172.21.15.44:0/2069451802 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x55a21616ac10 0x55a216295bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:45.417 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.425+0000 7f33f5400640 1 -- 172.21.15.44:0/2069451802 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55a215d63280 msgr2=0x55a2162cdf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T19:47:45.417 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.425+0000 7f33f5400640 1 --2- 172.21.15.44:0/2069451802 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55a215d63280 0x55a2162cdf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:45.417 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.425+0000 7f33f5400640 1 -- 172.21.15.44:0/2069451802 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a2160ace20 con 0x55a216163930 2024-04-17T19:47:45.417 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.425+0000 7f33fe800640 1 --2- 172.21.15.44:0/2069451802 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x55a21616ac10 0x55a216295bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-17T19:47:45.417 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.425+0000 7f33f5400640 1 --2- 172.21.15.44:0/2069451802 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a216163930 0x55a2162ce450 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f3400152f80 tx=0x7f33e8004ac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=25c21681bb9f6ff6 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:47:45.417 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.425+0000 7f33e3400640 10 client.0 ms_handle_connect on v2:172.21.15.44:3300/0 2024-04-17T19:47:45.419 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.425+0000 7f33e3400640 1 -- 172.21.15.44:0/2069451802 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33e801d070 con 0x55a216163930 2024-04-17T19:47:45.419 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.425+0000 7f33e3400640 1 -- 172.21.15.44:0/2069451802 <== mon.0 v2:172.21.15.44:3300/0 2 ==== osd_map(27..27 src has 1..27) ==== 6619+0+0 (secure 0 0 0) 0x7f33e8023420 con 0x55a216163930 2024-04-17T19:47:45.419 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.425+0000 7f340c438000 1 -- 172.21.15.44:0/2069451802 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f33f8005ad0 con 0x55a216163930 2024-04-17T19:47:45.419 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.425+0000 7f33e3400640 1 -- 172.21.15.44:0/2069451802 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_get_version_reply(handle=1 version=18) ==== 24+0+0 (secure 0 0 0) 0x7f33e8030050 con 0x55a216163930 2024-04-17T19:47:45.419 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.425+0000 7f340c438000 10 client.4893 fetch_fsmap learned FSMap version 18 2024-04-17T19:47:45.419 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.425+0000 7f340c438000 1 -- 172.21.15.44:0/2069451802 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,fsmap=18,monmap=2+}) -- 0x55a2161aca80 con 0x55a216163930 2024-04-17T19:47:45.419 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.425+0000 7f33e3400640 1 -- 172.21.15.44:0/2069451802 <== mon.0 v2:172.21.15.44:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f33f8005ad0 con 0x55a216163930 2024-04-17T19:47:45.420 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.425+0000 7f33e3400640 1 -- 172.21.15.44:0/2069451802 <== mon.0 v2:172.21.15.44:3300/0 5 ==== fsmap(e 18) ==== 4792+0+0 (secure 0 0 0) 0x7f33e8033020 con 0x55a216163930 2024-04-17T19:47:45.420 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.425+0000 7f340c438000 10 client.4893 fetch_fsmap finished waiting for FSMap version 18 2024-04-17T19:47:45.420 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.425+0000 7f340c438000 10 client.4893 resolve_mds: resolved name 'e' to daemon mds.e 2024-04-17T19:47:45.420 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.425+0000 7f340c438000 20 client.4893 populate_metadata read hostname 'smithi044' 2024-04-17T19:47:45.420 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.425+0000 7f340c438000 1 --2- 172.21.15.44:0/2069451802 >> [v2:172.21.15.44:6834/4073536070,v1:172.21.15.44:6837/4073536070] conn(0x55a215d877d0 0x55a216296900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:45.420 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.425+0000 7f340c438000 4 client.4893 mds_command: new command op to 4269 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-17T19:47:45.420 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.425+0000 7f340c438000 1 -- 172.21.15.44:0/2069451802 --> [v2:172.21.15.44:6834/4073536070,v1:172.21.15.44:6837/4073536070] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a21607abe0 con 0x55a215d877d0 2024-04-17T19:47:45.420 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.425+0000 7f33fde00640 1 --2- 172.21.15.44:0/2069451802 >> [v2:172.21.15.44:6834/4073536070,v1:172.21.15.44:6837/4073536070] conn(0x55a215d877d0 0x55a216296900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:45.420 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.425+0000 7f33fde00640 1 --2- 172.21.15.44:0/2069451802 >> [v2:172.21.15.44:6834/4073536070,v1:172.21.15.44:6837/4073536070] conn(0x55a215d877d0 0x55a216296900 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=14451d673a06ccdd server_cookie=4452b55692b4fb2f in_seq=0 out_seq=0 2024-04-17T19:47:45.420 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.425+0000 7f33e3400640 10 client.4893 ms_handle_connect on v2:172.21.15.44:6834/4073536070 2024-04-17T19:47:45.420 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.425+0000 7f33e3400640 1 -- 172.21.15.44:0/2069451802 <== mds.2 v2:172.21.15.44:6834/4073536070 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x55a21607abe0 con 0x55a215d877d0 2024-04-17T19:47:45.420 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.425+0000 7f33e3400640 10 client.4893 handle_command_reply: tid=0 2024-04-17T19:47:45.420 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.429+0000 7f340c438000 1 client.4893 shutdown 2024-04-17T19:47:45.420 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.429+0000 7f340c438000 1 -- 172.21.15.44:0/2069451802 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a216163930 msgr2=0x55a2162ce450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:45.421 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.429+0000 7f340c438000 1 --2- 172.21.15.44:0/2069451802 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a216163930 0x55a2162ce450 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f3400152f80 tx=0x7f33e8004ac0 comp rx=0 tx=0).stop 2024-04-17T19:47:45.421 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.429+0000 7f340c438000 1 -- 172.21.15.44:0/2069451802 shutdown_connections 2024-04-17T19:47:45.421 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.429+0000 7f340c438000 1 --2- 172.21.15.44:0/2069451802 >> [v2:172.21.15.44:6834/4073536070,v1:172.21.15.44:6837/4073536070] conn(0x55a215d877d0 0x55a216296900 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:45.421 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.429+0000 7f340c438000 1 --2- 172.21.15.44:0/2069451802 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x55a21616ac10 0x55a216295bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:45.421 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.429+0000 7f340c438000 1 --2- 172.21.15.44:0/2069451802 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a216163930 0x55a2162ce450 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:45.421 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.429+0000 7f340c438000 1 --2- 172.21.15.44:0/2069451802 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55a215d63280 0x55a2162cdf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:45.421 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.429+0000 7f33e3400640 0 client.4893 ms_handle_reset on v2:172.21.15.44:6834/4073536070 2024-04-17T19:47:45.421 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.429+0000 7f340c438000 1 -- 172.21.15.44:0/2069451802 >> 172.21.15.44:0/2069451802 conn(0x55a2161ac670 msgr2=0x55a2162cf720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:47:45.421 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.429+0000 7f340c438000 1 -- 172.21.15.44:0/2069451802 shutdown_connections 2024-04-17T19:47:45.421 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.429+0000 7f340c438000 1 -- 172.21.15.44:0/2069451802 wait complete. 2024-04-17T19:47:45.421 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.429+0000 7f340c438000 20 client.4893 trim_cache size 0 max 16384 2024-04-17T19:47:45.437 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.445+0000 7f340c438000 1 Processor -- start 2024-04-17T19:47:45.438 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.445+0000 7f340c438000 1 -- start start 2024-04-17T19:47:45.439 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.449+0000 7f340c438000 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x55a2161ac670 0x55a2162cd220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:45.439 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.449+0000 7f340c438000 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a215d63280 0x55a2162cc160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:45.440 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.449+0000 7f340c438000 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55a216163930 0x55a2162cc6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:45.440 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.449+0000 7f340c438000 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f3400207380 con 0x55a215d63280 2024-04-17T19:47:45.440 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.449+0000 7f340c438000 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f34001fd6d0 con 0x55a216163930 2024-04-17T19:47:45.440 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.449+0000 7f340c438000 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x55a2160e0800 con 0x55a2161ac670 2024-04-17T19:47:45.440 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.449+0000 7f33f5400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a215d63280 0x55a2162cc160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:45.440 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.449+0000 7f33f5400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a215d63280 0x55a2162cc160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:34226/0 (socket says 172.21.15.44:34226) 2024-04-17T19:47:45.440 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.449+0000 7f33f5400640 1 -- 172.21.15.44:0/2230865286 learned_addr learned my addr 172.21.15.44:0/2230865286 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-04-17T19:47:45.440 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.449+0000 7f33fde00640 1 --2- 172.21.15.44:0/2230865286 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x55a2161ac670 0x55a2162cd220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:45.440 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.449+0000 7f33fe800640 1 --2- 172.21.15.44:0/2230865286 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55a216163930 0x55a2162cc6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:45.440 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.449+0000 7f33f5400640 1 -- 172.21.15.44:0/2230865286 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x55a2161ac670 msgr2=0x55a2162cd220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T19:47:45.440 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.449+0000 7f33f5400640 1 --2- 172.21.15.44:0/2230865286 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x55a2161ac670 0x55a2162cd220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:45.440 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.449+0000 7f33f5400640 1 -- 172.21.15.44:0/2230865286 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55a216163930 msgr2=0x55a2162cc6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T19:47:45.440 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.449+0000 7f33f5400640 1 --2- 172.21.15.44:0/2230865286 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55a216163930 0x55a2162cc6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:45.440 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.449+0000 7f33f5400640 1 -- 172.21.15.44:0/2230865286 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a21613ae30 con 0x55a215d63280 2024-04-17T19:47:45.442 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.449+0000 7f33f5400640 1 --2- 172.21.15.44:0/2230865286 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a215d63280 0x55a2162cc160 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f33e8016fd0 tx=0x7f33e8018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1cbb6348b1f96d3a server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:47:45.442 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.449+0000 7f33ee000640 1 -- 172.21.15.44:0/2230865286 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33e8038070 con 0x55a215d63280 2024-04-17T19:47:45.442 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.449+0000 7f33ee000640 1 -- 172.21.15.44:0/2230865286 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f33e8028070 con 0x55a215d63280 2024-04-17T19:47:45.442 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.449+0000 7f33ee000640 1 -- 172.21.15.44:0/2230865286 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33e801d070 con 0x55a215d63280 2024-04-17T19:47:45.442 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.449+0000 7f340c438000 1 -- 172.21.15.44:0/2230865286 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a215d63280 msgr2=0x55a2162cc160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:45.442 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.449+0000 7f340c438000 1 --2- 172.21.15.44:0/2230865286 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a215d63280 0x55a2162cc160 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f33e8016fd0 tx=0x7f33e8018000 comp rx=0 tx=0).stop 2024-04-17T19:47:45.442 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.449+0000 7f340c438000 1 -- 172.21.15.44:0/2230865286 shutdown_connections 2024-04-17T19:47:45.442 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.449+0000 7f340c438000 1 --2- 172.21.15.44:0/2230865286 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55a216163930 0x55a2162cc6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:45.442 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.449+0000 7f340c438000 1 --2- 172.21.15.44:0/2230865286 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a215d63280 0x55a2162cc160 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:45.442 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.449+0000 7f340c438000 1 --2- 172.21.15.44:0/2230865286 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x55a2161ac670 0x55a2162cd220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:45.442 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.449+0000 7f340c438000 1 -- 172.21.15.44:0/2230865286 >> 172.21.15.44:0/2230865286 conn(0x55a216299640 msgr2=0x55a2162efc40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:47:45.443 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.449+0000 7f340c438000 1 -- 172.21.15.44:0/2230865286 shutdown_connections 2024-04-17T19:47:45.443 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.449+0000 7f340c438000 1 -- 172.21.15.44:0/2230865286 wait complete. 2024-04-17T19:47:45.443 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.449+0000 7f340c438000 1 -- start start 2024-04-17T19:47:45.443 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.449+0000 7f340c438000 1 Processor -- start 2024-04-17T19:47:45.445 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.453+0000 7f340c438000 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x55a215d63280 0x55a2162ef4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:45.445 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.453+0000 7f340c438000 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a216163930 0x55a2162ecdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:45.445 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.453+0000 7f340c438000 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55a2161ac670 0x55a2162ed310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:45.445 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.453+0000 7f340c438000 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55a2160ee700 con 0x55a216163930 2024-04-17T19:47:45.445 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.453+0000 7f340c438000 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x55a2160e5b20 con 0x55a2161ac670 2024-04-17T19:47:45.445 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.453+0000 7f340c438000 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x55a2160777d0 con 0x55a215d63280 2024-04-17T19:47:45.445 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.453+0000 7f340c438000 10 client.0 _ll_register_callbacks cb 0x7f33e8009d50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-17T19:47:45.445 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.453+0000 7f33f5400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a216163930 0x55a2162ecdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:45.446 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.453+0000 7f33f5400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a216163930 0x55a2162ecdd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:34240/0 (socket says 172.21.15.44:34240) 2024-04-17T19:47:45.446 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.453+0000 7f33f5400640 1 -- 172.21.15.44:0/3534096085 learned_addr learned my addr 172.21.15.44:0/3534096085 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-04-17T19:47:45.446 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.453+0000 7f33fde00640 1 --2- 172.21.15.44:0/3534096085 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x55a215d63280 0x55a2162ef4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:45.446 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.453+0000 7f33fe800640 1 --2- 172.21.15.44:0/3534096085 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55a2161ac670 0x55a2162ed310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:45.446 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.453+0000 7f33f5400640 1 -- 172.21.15.44:0/3534096085 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x55a215d63280 msgr2=0x55a2162ef4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T19:47:45.446 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.453+0000 7f33f5400640 1 --2- 172.21.15.44:0/3534096085 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x55a215d63280 0x55a2162ef4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:45.446 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.453+0000 7f33f5400640 1 -- 172.21.15.44:0/3534096085 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55a2161ac670 msgr2=0x55a2162ed310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T19:47:45.446 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.453+0000 7f33f5400640 1 --2- 172.21.15.44:0/3534096085 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55a2161ac670 0x55a2162ed310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:45.446 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.453+0000 7f33f5400640 1 -- 172.21.15.44:0/3534096085 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a2160737e0 con 0x55a216163930 2024-04-17T19:47:45.446 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.453+0000 7f33f5400640 1 --2- 172.21.15.44:0/3534096085 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a216163930 0x55a2162ecdd0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f33e8009fd0 tx=0x7f33e8004a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a8f5b00390196603 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:47:45.446 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.453+0000 7f33e3400640 10 client.0 ms_handle_connect on v2:172.21.15.44:3300/0 2024-04-17T19:47:45.446 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.453+0000 7f33e3400640 1 -- 172.21.15.44:0/3534096085 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33e8041070 con 0x55a216163930 2024-04-17T19:47:45.446 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.453+0000 7f33e3400640 1 -- 172.21.15.44:0/3534096085 <== mon.0 v2:172.21.15.44:3300/0 2 ==== osd_map(27..27 src has 1..27) ==== 6619+0+0 (secure 0 0 0) 0x7f33e802b350 con 0x55a216163930 2024-04-17T19:47:45.447 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.453+0000 7f340c438000 1 -- 172.21.15.44:0/3534096085 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f33e8028070 con 0x55a216163930 2024-04-17T19:47:45.447 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.453+0000 7f33e3400640 1 -- 172.21.15.44:0/3534096085 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_get_version_reply(handle=1 version=18) ==== 24+0+0 (secure 0 0 0) 0x7f33e804c050 con 0x55a216163930 2024-04-17T19:47:45.447 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.453+0000 7f340c438000 10 client.4899 fetch_fsmap learned FSMap version 18 2024-04-17T19:47:45.447 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.453+0000 7f340c438000 1 -- 172.21.15.44:0/3534096085 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,fsmap=18,monmap=2+}) -- 0x55a216086670 con 0x55a216163930 2024-04-17T19:47:45.448 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.453+0000 7f33e3400640 1 -- 172.21.15.44:0/3534096085 <== mon.0 v2:172.21.15.44:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f33e8028070 con 0x55a216163930 2024-04-17T19:47:45.449 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.453+0000 7f33e3400640 1 -- 172.21.15.44:0/3534096085 <== mon.0 v2:172.21.15.44:3300/0 5 ==== fsmap(e 18) ==== 4792+0+0 (secure 0 0 0) 0x7f33e804f020 con 0x55a216163930 2024-04-17T19:47:45.449 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.453+0000 7f340c438000 10 client.4899 fetch_fsmap finished waiting for FSMap version 18 2024-04-17T19:47:45.449 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.453+0000 7f340c438000 10 client.4899 resolve_mds: resolved name 'e' to daemon mds.e 2024-04-17T19:47:45.449 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.453+0000 7f340c438000 20 client.4899 populate_metadata read hostname 'smithi044' 2024-04-17T19:47:45.449 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.453+0000 7f340c438000 1 --2- 172.21.15.44:0/3534096085 >> [v2:172.21.15.44:6834/4073536070,v1:172.21.15.44:6837/4073536070] conn(0x55a215da0e80 0x55a2162edc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:45.449 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.453+0000 7f340c438000 4 client.4899 mds_command: new command op to 4269 tid=0 multi_id=0 [{"prefix": "status"}] 2024-04-17T19:47:45.449 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.453+0000 7f340c438000 1 -- 172.21.15.44:0/3534096085 --> [v2:172.21.15.44:6834/4073536070,v1:172.21.15.44:6837/4073536070] -- command(tid 0: {"prefix": "status"}) -- 0x55a2160eef10 con 0x55a215da0e80 2024-04-17T19:47:45.449 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.453+0000 7f33fde00640 1 --2- 172.21.15.44:0/3534096085 >> [v2:172.21.15.44:6834/4073536070,v1:172.21.15.44:6837/4073536070] conn(0x55a215da0e80 0x55a2162edc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:45.449 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.453+0000 7f33fde00640 1 --2- 172.21.15.44:0/3534096085 >> [v2:172.21.15.44:6834/4073536070,v1:172.21.15.44:6837/4073536070] conn(0x55a215da0e80 0x55a2162edc70 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=7300b9621d147a89 server_cookie=275171a50ab2f453 in_seq=0 out_seq=0 2024-04-17T19:47:45.449 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.453+0000 7f33e3400640 10 client.4899 ms_handle_connect on v2:172.21.15.44:6834/4073536070 2024-04-17T19:47:45.449 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.457+0000 7f33e3400640 1 -- 172.21.15.44:0/3534096085 <== mds.2 v2:172.21.15.44:6834/4073536070 1 ==== command_reply(tid 0: 0 ) ==== 8+0+325 (crc 0 0 0) 0x55a2160eef10 con 0x55a215da0e80 2024-04-17T19:47:45.449 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.457+0000 7f33e3400640 10 client.4899 handle_command_reply: tid=0 2024-04-17T19:47:45.449 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.457+0000 7f340c438000 1 client.4899 shutdown 2024-04-17T19:47:45.449 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.457+0000 7f340c438000 1 -- 172.21.15.44:0/3534096085 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a216163930 msgr2=0x55a2162ecdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:45.449 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.457+0000 7f340c438000 1 --2- 172.21.15.44:0/3534096085 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a216163930 0x55a2162ecdd0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f33e8009fd0 tx=0x7f33e8004a50 comp rx=0 tx=0).stop 2024-04-17T19:47:45.450 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.457+0000 7f340c438000 1 -- 172.21.15.44:0/3534096085 shutdown_connections 2024-04-17T19:47:45.450 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.457+0000 7f340c438000 1 --2- 172.21.15.44:0/3534096085 >> [v2:172.21.15.44:6834/4073536070,v1:172.21.15.44:6837/4073536070] conn(0x55a215da0e80 0x55a2162edc70 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:45.450 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.457+0000 7f340c438000 1 --2- 172.21.15.44:0/3534096085 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55a2161ac670 0x55a2162ed310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:45.450 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.457+0000 7f340c438000 1 --2- 172.21.15.44:0/3534096085 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a216163930 0x55a2162ecdd0 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:45.450 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.457+0000 7f340c438000 1 --2- 172.21.15.44:0/3534096085 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x55a215d63280 0x55a2162ef4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:45.450 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.457+0000 7f33e3400640 0 client.4899 ms_handle_reset on v2:172.21.15.44:6834/4073536070 2024-04-17T19:47:45.450 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.457+0000 7f340c438000 1 -- 172.21.15.44:0/3534096085 >> 172.21.15.44:0/3534096085 conn(0x55a216299640 msgr2=0x55a2162cc160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:47:45.450 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.457+0000 7f340c438000 1 -- 172.21.15.44:0/3534096085 shutdown_connections 2024-04-17T19:47:45.450 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.457+0000 7f340c438000 1 -- 172.21.15.44:0/3534096085 wait complete. 2024-04-17T19:47:45.450 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.457+0000 7f340c438000 20 client.4899 trim_cache size 0 max 16384 2024-04-17T19:47:45.450 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2024-04-17T19:47:45.451 INFO:teuthology.orchestra.run.smithi044.stdout: "cluster_fsid": "703f77ca-79c6-4a66-b576-62c526cb1021", 2024-04-17T19:47:45.451 INFO:teuthology.orchestra.run.smithi044.stdout: "whoami": 2, 2024-04-17T19:47:45.451 INFO:teuthology.orchestra.run.smithi044.stdout: "id": 4269, 2024-04-17T19:47:45.451 INFO:teuthology.orchestra.run.smithi044.stdout: "want_state": "up:active", 2024-04-17T19:47:45.451 INFO:teuthology.orchestra.run.smithi044.stdout: "state": "up:active", 2024-04-17T19:47:45.451 INFO:teuthology.orchestra.run.smithi044.stdout: "fs_name": "cephfs", 2024-04-17T19:47:45.451 INFO:teuthology.orchestra.run.smithi044.stdout: "rank_uptime": 22.599298329, 2024-04-17T19:47:45.451 INFO:teuthology.orchestra.run.smithi044.stdout: "mdsmap_epoch": 18, 2024-04-17T19:47:45.451 INFO:teuthology.orchestra.run.smithi044.stdout: "osdmap_epoch": 27, 2024-04-17T19:47:45.451 INFO:teuthology.orchestra.run.smithi044.stdout: "osdmap_epoch_barrier": 27, 2024-04-17T19:47:45.451 INFO:teuthology.orchestra.run.smithi044.stdout: "uptime": 56.149334576999998 2024-04-17T19:47:45.451 INFO:teuthology.orchestra.run.smithi044.stdout:} 2024-04-17T19:47:45.452 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.457+0000 7f3404e00640 1 -- 172.21.15.44:0/3122463779 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f33dc068380 msgr2=0x7f33dc06a890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:45.452 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.457+0000 7f3404e00640 1 --2- 172.21.15.44:0/3122463779 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f33dc068380 0x7f33dc06a890 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f3400156260 tx=0x7f33e800b040 comp rx=0 tx=0).stop 2024-04-17T19:47:45.452 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.457+0000 7f3404e00640 1 -- 172.21.15.44:0/3122463779 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f34000c4d20 msgr2=0x7f34000c1740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:45.452 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.457+0000 7f3404e00640 1 --2- 172.21.15.44:0/3122463779 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f34000c4d20 0x7f34000c1740 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f33f001a040 tx=0x7f33f00191b0 comp rx=0 tx=0).stop 2024-04-17T19:47:45.452 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.457+0000 7f3404e00640 1 -- 172.21.15.44:0/3122463779 shutdown_connections 2024-04-17T19:47:45.452 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.457+0000 7f3404e00640 1 --2- 172.21.15.44:0/3122463779 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f33dc068380 0x7f33dc06a890 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:45.452 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.457+0000 7f3404e00640 1 --2- 172.21.15.44:0/3122463779 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f3400159140 0x7f340013c300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:45.452 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.457+0000 7f3404e00640 1 --2- 172.21.15.44:0/3122463779 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3400152860 0x7f3400146480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:45.453 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.457+0000 7f3404e00640 1 --2- 172.21.15.44:0/3122463779 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f34000c4d20 0x7f34000c1740 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:45.453 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.457+0000 7f3404e00640 1 -- 172.21.15.44:0/3122463779 >> 172.21.15.44:0/3122463779 conn(0x7f340006c380 msgr2=0x7f34000725b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:47:45.453 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.457+0000 7f3404e00640 1 -- 172.21.15.44:0/3122463779 shutdown_connections 2024-04-17T19:47:45.453 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.457+0000 7f3404e00640 1 -- 172.21.15.44:0/3122463779 wait complete. 2024-04-17T19:47:45.467 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.d status 2024-04-17T19:47:45.619 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.629+0000 7f178b400640 1 Processor -- start 2024-04-17T19:47:45.619 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.629+0000 7f178b400640 1 -- start start 2024-04-17T19:47:45.621 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.629+0000 7f178b400640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f1784152860 0x7f17840c68b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:45.621 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.629+0000 7f178b400640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f17840c80a0 0x7f17840c84b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:45.621 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.629+0000 7f178b400640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f17840c89f0 con 0x7f1784159140 2024-04-17T19:47:45.621 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.629+0000 7f178b400640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 -- 0x7f17840c6eb0 con 0x7f17840c80a0 2024-04-17T19:47:45.621 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.629+0000 7f178b400640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 -- 0x7f17840c78e0 con 0x7f1784152860 2024-04-17T19:47:45.621 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.629+0000 7f1789400640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f17840c80a0 0x7f17840c84b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:45.621 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.629+0000 7f1783e00640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f1784159140 0x7f17840c47e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:46872/0 (socket says 172.21.15.44:46872) 2024-04-17T19:47:45.621 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.629+0000 7f1789400640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f17840c80a0 0x7f17840c84b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:34246/0 (socket says 172.21.15.44:34246) 2024-04-17T19:47:45.621 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.629+0000 7f1783e00640 1 -- 172.21.15.44:0/4273384435 learned_addr learned my addr 172.21.15.44:0/4273384435 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-04-17T19:47:45.621 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.629+0000 7f1788a00640 1 --2- 172.21.15.44:0/4273384435 >> v2:172.21.15.62:3300/0 conn(0x7f1784152860 0x7f17840c68b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:45.622 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.629+0000 7f1789400640 1 -- 172.21.15.44:0/4273384435 >> v2:172.21.15.62:3300/0 conn(0x7f1784152860 msgr2=0x7f17840c68b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T19:47:45.622 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.629+0000 7f1789400640 1 --2- 172.21.15.44:0/4273384435 >> v2:172.21.15.62:3300/0 conn(0x7f1784152860 0x7f17840c68b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:45.622 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.629+0000 7f1789400640 1 -- 172.21.15.44:0/4273384435 >> v1:172.21.15.44:6789/0 conn(0x7f1784159140 legacy=0x7f17840c47e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:45.622 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.629+0000 7f1789400640 1 -- 172.21.15.44:0/4273384435 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f17840c4000 con 0x7f17840c80a0 2024-04-17T19:47:45.624 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.633+0000 7f1789400640 1 --2- 172.21.15.44:0/4273384435 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f17840c80a0 0x7f17840c84b0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f178406cc70 tx=0x7f177c01c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8d4833dbc96aac69 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:47:45.624 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.633+0000 7f1783400640 1 -- 172.21.15.44:0/4273384435 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f177c0b2070 con 0x7f17840c80a0 2024-04-17T19:47:45.624 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.633+0000 7f1783400640 1 -- 172.21.15.44:0/4273384435 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f177c0a5760 con 0x7f17840c80a0 2024-04-17T19:47:45.625 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.633+0000 7f1783400640 1 -- 172.21.15.44:0/4273384435 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f177c0a5b30 con 0x7f17840c80a0 2024-04-17T19:47:45.625 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.633+0000 7f178b400640 1 -- 172.21.15.44:0/4273384435 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f17840c80a0 msgr2=0x7f17840c84b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:45.625 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.633+0000 7f178b400640 1 --2- 172.21.15.44:0/4273384435 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f17840c80a0 0x7f17840c84b0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f178406cc70 tx=0x7f177c01c8a0 comp rx=0 tx=0).stop 2024-04-17T19:47:45.625 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.633+0000 7f178b400640 1 -- 172.21.15.44:0/4273384435 shutdown_connections 2024-04-17T19:47:45.625 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.633+0000 7f178b400640 1 --2- 172.21.15.44:0/4273384435 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f17840c80a0 0x7f17840c84b0 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:45.625 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.633+0000 7f178b400640 1 --2- 172.21.15.44:0/4273384435 >> v2:172.21.15.62:3300/0 conn(0x7f1784152860 0x7f17840c68b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:45.626 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.633+0000 7f178b400640 1 -- 172.21.15.44:0/4273384435 >> 172.21.15.44:0/4273384435 conn(0x7f178406c380 msgr2=0x7f1784070080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:47:45.626 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.633+0000 7f178b400640 1 -- 172.21.15.44:0/4273384435 shutdown_connections 2024-04-17T19:47:45.626 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.633+0000 7f178b400640 1 -- 172.21.15.44:0/4273384435 wait complete. 2024-04-17T19:47:45.627 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.637+0000 7f178b400640 1 Processor -- start 2024-04-17T19:47:45.627 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.637+0000 7f178b400640 1 -- start start 2024-04-17T19:47:45.629 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.637+0000 7f178b400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f17840c80a0 0x7f17841f8ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:45.630 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.637+0000 7f178b400640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1784152860 0x7f17841f5880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:45.630 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.637+0000 7f178b400640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f1784159140 0x7f17841566e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:45.630 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.637+0000 7f178b400640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f17840c5070 con 0x7f17840c80a0 2024-04-17T19:47:45.630 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.637+0000 7f178b400640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f17840c4ef0 con 0x7f1784152860 2024-04-17T19:47:45.630 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.637+0000 7f178b400640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7f1784165860 con 0x7f1784159140 2024-04-17T19:47:45.630 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.637+0000 7f1788a00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f17840c80a0 0x7f17841f8ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:45.630 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.637+0000 7f1788a00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f17840c80a0 0x7f17841f8ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:34254/0 (socket says 172.21.15.44:34254) 2024-04-17T19:47:45.630 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.637+0000 7f1788a00640 1 -- 172.21.15.44:0/1250217258 learned_addr learned my addr 172.21.15.44:0/1250217258 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-04-17T19:47:45.630 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.637+0000 7f1783e00640 1 --2- 172.21.15.44:0/1250217258 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1784152860 0x7f17841f5880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:45.630 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.637+0000 7f1789400640 1 --2- 172.21.15.44:0/1250217258 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f1784159140 0x7f17841566e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:45.630 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.637+0000 7f1788a00640 1 -- 172.21.15.44:0/1250217258 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f1784159140 msgr2=0x7f17841566e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:45.630 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.637+0000 7f1788a00640 1 --2- 172.21.15.44:0/1250217258 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f1784159140 0x7f17841566e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:45.631 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.637+0000 7f1788a00640 1 -- 172.21.15.44:0/1250217258 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1784152860 msgr2=0x7f17841f5880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:45.631 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.637+0000 7f1788a00640 1 --2- 172.21.15.44:0/1250217258 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1784152860 0x7f17841f5880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:45.631 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.637+0000 7f1788a00640 1 -- 172.21.15.44:0/1250217258 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f178414d240 con 0x7f17840c80a0 2024-04-17T19:47:45.631 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.637+0000 7f1788a00640 1 --2- 172.21.15.44:0/1250217258 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f17840c80a0 0x7f17841f8ec0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f177800e870 tx=0x7f177800ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:47:45.631 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.637+0000 7f1780c00640 1 -- 172.21.15.44:0/1250217258 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1778017070 con 0x7f17840c80a0 2024-04-17T19:47:45.632 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.637+0000 7f1780c00640 1 -- 172.21.15.44:0/1250217258 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f177800c8e0 con 0x7f17840c80a0 2024-04-17T19:47:45.632 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.637+0000 7f178b400640 1 -- 172.21.15.44:0/1250217258 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f17841f9400 con 0x7f17840c80a0 2024-04-17T19:47:45.632 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.637+0000 7f1780c00640 1 -- 172.21.15.44:0/1250217258 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f177800cc90 con 0x7f17840c80a0 2024-04-17T19:47:45.632 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.637+0000 7f178b400640 1 -- 172.21.15.44:0/1250217258 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f17841f5dc0 con 0x7f17840c80a0 2024-04-17T19:47:45.632 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.641+0000 7f1780c00640 1 -- 172.21.15.44:0/1250217258 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f177801a070 con 0x7f17840c80a0 2024-04-17T19:47:45.633 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.641+0000 7f1780c00640 1 --2- 172.21.15.44:0/1250217258 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f17640683b0 0x7f176406a8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:45.633 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.641+0000 7f1780c00640 1 -- 172.21.15.44:0/1250217258 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6619+0+0 (secure 0 0 0) 0x7f1778086fe0 con 0x7f17840c80a0 2024-04-17T19:47:45.634 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.641+0000 7f1783e00640 1 --2- 172.21.15.44:0/1250217258 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f17640683b0 0x7f176406a8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:45.634 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.641+0000 7f1792af5000 1 Processor -- start 2024-04-17T19:47:45.634 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.641+0000 7f1792af5000 1 -- start start 2024-04-17T19:47:45.634 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.645+0000 7f1783e00640 1 --2- 172.21.15.44:0/1250217258 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f17640683b0 0x7f176406a8c0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f178414dc20 tx=0x7f1770009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:47:45.637 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.645+0000 7f1792af5000 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5558402ecc10 0x5558404561b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:45.637 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.645+0000 7f1792af5000 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5558402e5930 0x5558404566f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:45.637 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.645+0000 7f1792af5000 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x55583fee5280 0x555840456c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:45.637 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.645+0000 7f1792af5000 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x5558402634f0 con 0x5558402ecc10 2024-04-17T19:47:45.637 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.645+0000 7f1792af5000 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x5558401fdc10 con 0x5558402e5930 2024-04-17T19:47:45.637 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.645+0000 7f1792af5000 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x55584025f4b0 con 0x55583fee5280 2024-04-17T19:47:45.637 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.645+0000 7f1788a00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5558402ecc10 0x5558404561b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:45.637 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.645+0000 7f1788a00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5558402ecc10 0x5558404561b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:34262/0 (socket says 172.21.15.44:34262) 2024-04-17T19:47:45.637 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.645+0000 7f1788a00640 1 -- 172.21.15.44:0/3591978758 learned_addr learned my addr 172.21.15.44:0/3591978758 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-04-17T19:47:45.637 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.645+0000 7f1783e00640 1 --2- 172.21.15.44:0/3591978758 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5558402e5930 0x5558404566f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:45.637 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.645+0000 7f1789400640 1 --2- 172.21.15.44:0/3591978758 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x55583fee5280 0x555840456c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:45.637 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.645+0000 7f1788a00640 1 -- 172.21.15.44:0/3591978758 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x55583fee5280 msgr2=0x555840456c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T19:47:45.638 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.645+0000 7f1788a00640 1 --2- 172.21.15.44:0/3591978758 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x55583fee5280 0x555840456c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:45.638 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.645+0000 7f1788a00640 1 -- 172.21.15.44:0/3591978758 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5558402e5930 msgr2=0x5558404566f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T19:47:45.638 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.645+0000 7f1788a00640 1 --2- 172.21.15.44:0/3591978758 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5558402e5930 0x5558404566f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:45.638 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.645+0000 7f1788a00640 1 -- 172.21.15.44:0/3591978758 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5558401fde60 con 0x5558402ecc10 2024-04-17T19:47:45.638 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.645+0000 7f1788a00640 1 --2- 172.21.15.44:0/3591978758 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5558402ecc10 0x5558404561b0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f1778052ea0 tx=0x7f1778057140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7eb268a26b1f30ad server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:47:45.638 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.645+0000 7f1775200640 1 -- 172.21.15.44:0/3591978758 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f177806f020 con 0x5558402ecc10 2024-04-17T19:47:45.638 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.645+0000 7f1775200640 1 -- 172.21.15.44:0/3591978758 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f177805f6b0 con 0x5558402ecc10 2024-04-17T19:47:45.638 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.645+0000 7f1775200640 1 -- 172.21.15.44:0/3591978758 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1778021040 con 0x5558402ecc10 2024-04-17T19:47:45.639 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.645+0000 7f1792af5000 1 -- 172.21.15.44:0/3591978758 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5558402ecc10 msgr2=0x5558404561b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:45.639 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.645+0000 7f1792af5000 1 --2- 172.21.15.44:0/3591978758 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5558402ecc10 0x5558404561b0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f1778052ea0 tx=0x7f1778057140 comp rx=0 tx=0).stop 2024-04-17T19:47:45.639 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.645+0000 7f1792af5000 1 -- 172.21.15.44:0/3591978758 shutdown_connections 2024-04-17T19:47:45.639 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.645+0000 7f1792af5000 1 --2- 172.21.15.44:0/3591978758 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x55583fee5280 0x555840456c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:45.639 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.645+0000 7f1792af5000 1 --2- 172.21.15.44:0/3591978758 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5558402e5930 0x5558404566f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:45.639 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.645+0000 7f1792af5000 1 --2- 172.21.15.44:0/3591978758 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5558402ecc10 0x5558404561b0 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:45.639 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.645+0000 7f1792af5000 1 -- 172.21.15.44:0/3591978758 >> 172.21.15.44:0/3591978758 conn(0x55584032e670 msgr2=0x555840453f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:47:45.639 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.645+0000 7f1792af5000 1 -- 172.21.15.44:0/3591978758 shutdown_connections 2024-04-17T19:47:45.639 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.645+0000 7f1792af5000 1 -- 172.21.15.44:0/3591978758 wait complete. 2024-04-17T19:47:45.640 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.649+0000 7f1792af5000 1 -- start start 2024-04-17T19:47:45.640 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.649+0000 7f1792af5000 1 Processor -- start 2024-04-17T19:47:45.641 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.649+0000 7f1792af5000 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55583fee5280 0x55584044ff10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:45.641 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.649+0000 7f1792af5000 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x5558402e5930 0x555840450450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:45.641 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.649+0000 7f1792af5000 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5558402ecc10 0x555840417bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:45.641 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.649+0000 7f1792af5000 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x5558402a49e0 con 0x5558402ecc10 2024-04-17T19:47:45.642 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.649+0000 7f1792af5000 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x555840220a80 con 0x55583fee5280 2024-04-17T19:47:45.642 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.649+0000 7f1792af5000 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x55584021ed10 con 0x5558402e5930 2024-04-17T19:47:45.642 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.649+0000 7f1792af5000 10 client.0 _ll_register_callbacks cb 0x555840400b20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-17T19:47:45.642 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.649+0000 7f1789400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5558402ecc10 0x555840417bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:45.642 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.649+0000 7f1789400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5558402ecc10 0x555840417bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:34270/0 (socket says 172.21.15.44:34270) 2024-04-17T19:47:45.642 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.649+0000 7f1789400640 1 -- 172.21.15.44:0/891597327 learned_addr learned my addr 172.21.15.44:0/891597327 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-04-17T19:47:45.642 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.649+0000 7f1788a00640 1 --2- 172.21.15.44:0/891597327 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55583fee5280 0x55584044ff10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:45.642 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.649+0000 7f1783e00640 1 --2- 172.21.15.44:0/891597327 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x5558402e5930 0x555840450450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:45.642 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.649+0000 7f1789400640 1 -- 172.21.15.44:0/891597327 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x5558402e5930 msgr2=0x555840450450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T19:47:45.642 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.649+0000 7f1789400640 1 --2- 172.21.15.44:0/891597327 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x5558402e5930 0x555840450450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:45.642 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.649+0000 7f1789400640 1 -- 172.21.15.44:0/891597327 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55583fee5280 msgr2=0x55584044ff10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T19:47:45.642 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.649+0000 7f1789400640 1 --2- 172.21.15.44:0/891597327 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55583fee5280 0x55584044ff10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:45.642 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.649+0000 7f1789400640 1 -- 172.21.15.44:0/891597327 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55584022ee20 con 0x5558402ecc10 2024-04-17T19:47:45.642 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.649+0000 7f1783e00640 1 --2- 172.21.15.44:0/891597327 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x5558402e5930 0x555840450450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-17T19:47:45.643 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.649+0000 7f1789400640 1 --2- 172.21.15.44:0/891597327 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5558402ecc10 0x555840417bc0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f177c0b0040 tx=0x7f177c01b0e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=27da9f4f64b867a9 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:47:45.643 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.649+0000 7f1769600640 10 client.0 ms_handle_connect on v2:172.21.15.44:3300/0 2024-04-17T19:47:45.644 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.649+0000 7f1769600640 1 -- 172.21.15.44:0/891597327 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f177c0b2040 con 0x5558402ecc10 2024-04-17T19:47:45.644 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.649+0000 7f1792af5000 1 -- 172.21.15.44:0/891597327 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f177805f6b0 con 0x5558402ecc10 2024-04-17T19:47:45.644 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.649+0000 7f1769600640 1 -- 172.21.15.44:0/891597327 <== mon.0 v2:172.21.15.44:3300/0 2 ==== osd_map(27..27 src has 1..27) ==== 6619+0+0 (secure 0 0 0) 0x7f177c0a5c60 con 0x5558402ecc10 2024-04-17T19:47:45.644 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.649+0000 7f1769600640 1 -- 172.21.15.44:0/891597327 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_get_version_reply(handle=1 version=18) ==== 24+0+0 (secure 0 0 0) 0x7f177c0ca050 con 0x5558402ecc10 2024-04-17T19:47:45.644 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.649+0000 7f1792af5000 10 client.4914 fetch_fsmap learned FSMap version 18 2024-04-17T19:47:45.644 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.649+0000 7f1792af5000 1 -- 172.21.15.44:0/891597327 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,fsmap=18,monmap=2+}) -- 0x55584032ea80 con 0x5558402ecc10 2024-04-17T19:47:45.644 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.649+0000 7f1769600640 1 -- 172.21.15.44:0/891597327 <== mon.0 v2:172.21.15.44:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f177805f6b0 con 0x5558402ecc10 2024-04-17T19:47:45.644 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.653+0000 7f1769600640 1 -- 172.21.15.44:0/891597327 <== mon.0 v2:172.21.15.44:3300/0 5 ==== fsmap(e 18) ==== 4792+0+0 (secure 0 0 0) 0x7f177c0cd020 con 0x5558402ecc10 2024-04-17T19:47:45.644 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.653+0000 7f1792af5000 10 client.4914 fetch_fsmap finished waiting for FSMap version 18 2024-04-17T19:47:45.645 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.653+0000 7f1792af5000 10 client.4914 resolve_mds: resolved name 'd' to daemon mds.d 2024-04-17T19:47:45.645 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.653+0000 7f1792af5000 20 client.4914 populate_metadata read hostname 'smithi044' 2024-04-17T19:47:45.645 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.653+0000 7f1792af5000 1 --2- 172.21.15.44:0/891597327 >> [v2:172.21.15.62:6834/2585862759,v1:172.21.15.62:6835/2585862759] conn(0x55583ff097d0 0x555840418900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:45.645 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.653+0000 7f1792af5000 4 client.4914 mds_command: new command op to 4294 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-17T19:47:45.645 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.653+0000 7f1792af5000 1 -- 172.21.15.44:0/891597327 --> [v2:172.21.15.62:6834/2585862759,v1:172.21.15.62:6835/2585862759] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5558401fcbe0 con 0x55583ff097d0 2024-04-17T19:47:45.645 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.653+0000 7f1788a00640 1 --2- 172.21.15.44:0/891597327 >> [v2:172.21.15.62:6834/2585862759,v1:172.21.15.62:6835/2585862759] conn(0x55583ff097d0 0x555840418900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:45.645 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.653+0000 7f1788a00640 1 --2- 172.21.15.44:0/891597327 >> [v2:172.21.15.62:6834/2585862759,v1:172.21.15.62:6835/2585862759] conn(0x55583ff097d0 0x555840418900 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=1a4d34179bf9b392 server_cookie=b085cbf27e0ccddb in_seq=0 out_seq=0 2024-04-17T19:47:45.645 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.653+0000 7f1769600640 10 client.4914 ms_handle_connect on v2:172.21.15.62:6834/2585862759 2024-04-17T19:47:45.647 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.653+0000 7f1769600640 1 -- 172.21.15.44:0/891597327 <== mds.1 v2:172.21.15.62:6834/2585862759 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x5558401fcbe0 con 0x55583ff097d0 2024-04-17T19:47:45.647 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.653+0000 7f1769600640 10 client.4914 handle_command_reply: tid=0 2024-04-17T19:47:45.647 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.653+0000 7f1792af5000 1 client.4914 shutdown 2024-04-17T19:47:45.647 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.653+0000 7f1792af5000 1 -- 172.21.15.44:0/891597327 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5558402ecc10 msgr2=0x555840417bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:45.647 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.653+0000 7f1792af5000 1 --2- 172.21.15.44:0/891597327 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5558402ecc10 0x555840417bc0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f177c0b0040 tx=0x7f177c01b0e0 comp rx=0 tx=0).stop 2024-04-17T19:47:45.647 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.653+0000 7f1792af5000 1 -- 172.21.15.44:0/891597327 shutdown_connections 2024-04-17T19:47:45.647 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.653+0000 7f1792af5000 1 --2- 172.21.15.44:0/891597327 >> [v2:172.21.15.62:6834/2585862759,v1:172.21.15.62:6835/2585862759] conn(0x55583ff097d0 0x555840418900 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:45.647 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.653+0000 7f1792af5000 1 --2- 172.21.15.44:0/891597327 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x5558402e5930 0x555840450450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:45.647 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.653+0000 7f1792af5000 1 --2- 172.21.15.44:0/891597327 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5558402ecc10 0x555840417bc0 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:45.647 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.653+0000 7f1792af5000 1 --2- 172.21.15.44:0/891597327 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55583fee5280 0x55584044ff10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:45.647 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.653+0000 7f1769600640 0 client.4914 ms_handle_reset on v2:172.21.15.62:6834/2585862759 2024-04-17T19:47:45.647 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.653+0000 7f1792af5000 1 -- 172.21.15.44:0/891597327 >> 172.21.15.44:0/891597327 conn(0x55584032e670 msgr2=0x555840451720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:47:45.647 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.657+0000 7f1792af5000 1 -- 172.21.15.44:0/891597327 shutdown_connections 2024-04-17T19:47:45.647 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.657+0000 7f1792af5000 1 -- 172.21.15.44:0/891597327 wait complete. 2024-04-17T19:47:45.648 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.657+0000 7f1792af5000 20 client.4914 trim_cache size 0 max 16384 2024-04-17T19:47:45.665 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.673+0000 7f1792af5000 1 Processor -- start 2024-04-17T19:47:45.665 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.673+0000 7f1792af5000 1 -- start start 2024-04-17T19:47:45.667 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.677+0000 7f1792af5000 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55584032e670 0x55584044e160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:45.667 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.677+0000 7f1792af5000 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55583fee5280 0x55584044e6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:45.667 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.677+0000 7f1792af5000 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x5558402e5930 0x55584044f010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:45.667 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.677+0000 7f1792af5000 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f1784202a00 con 0x55583fee5280 2024-04-17T19:47:45.667 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.677+0000 7f1792af5000 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f17842030d0 con 0x55584032e670 2024-04-17T19:47:45.667 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.677+0000 7f1792af5000 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7f1784201330 con 0x5558402e5930 2024-04-17T19:47:45.667 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.677+0000 7f1783e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55583fee5280 0x55584044e6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:45.667 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.677+0000 7f1783e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55583fee5280 0x55584044e6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:34272/0 (socket says 172.21.15.44:34272) 2024-04-17T19:47:45.668 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.677+0000 7f1783e00640 1 -- 172.21.15.44:0/1627875902 learned_addr learned my addr 172.21.15.44:0/1627875902 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-04-17T19:47:45.668 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.677+0000 7f1789400640 1 --2- 172.21.15.44:0/1627875902 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x5558402e5930 0x55584044f010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:45.668 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.677+0000 7f1788a00640 1 --2- 172.21.15.44:0/1627875902 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55584032e670 0x55584044e160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:45.669 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.677+0000 7f1783e00640 1 -- 172.21.15.44:0/1627875902 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x5558402e5930 msgr2=0x55584044f010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T19:47:45.669 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.677+0000 7f1783e00640 1 --2- 172.21.15.44:0/1627875902 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x5558402e5930 0x55584044f010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:45.669 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.677+0000 7f1783e00640 1 -- 172.21.15.44:0/1627875902 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55584032e670 msgr2=0x55584044e160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T19:47:45.669 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.677+0000 7f1783e00640 1 --2- 172.21.15.44:0/1627875902 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55584032e670 0x55584044e160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:45.669 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.677+0000 7f1783e00640 1 -- 172.21.15.44:0/1627875902 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5558402bce30 con 0x55583fee5280 2024-04-17T19:47:45.669 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.677+0000 7f1783e00640 1 --2- 172.21.15.44:0/1627875902 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55583fee5280 0x55584044e6a0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f1770005c00 tx=0x7f1770012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=949f83e6969d781f server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:47:45.669 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.677+0000 7f176be00640 1 -- 172.21.15.44:0/1627875902 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1770028070 con 0x55583fee5280 2024-04-17T19:47:45.670 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.677+0000 7f176be00640 1 -- 172.21.15.44:0/1627875902 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1770007710 con 0x55583fee5280 2024-04-17T19:47:45.670 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.677+0000 7f176be00640 1 -- 172.21.15.44:0/1627875902 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f177000e4b0 con 0x55583fee5280 2024-04-17T19:47:45.670 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.677+0000 7f1792af5000 1 -- 172.21.15.44:0/1627875902 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55583fee5280 msgr2=0x55584044e6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:45.670 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.677+0000 7f1792af5000 1 --2- 172.21.15.44:0/1627875902 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55583fee5280 0x55584044e6a0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f1770005c00 tx=0x7f1770012000 comp rx=0 tx=0).stop 2024-04-17T19:47:45.670 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.677+0000 7f1792af5000 1 -- 172.21.15.44:0/1627875902 shutdown_connections 2024-04-17T19:47:45.670 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.677+0000 7f1792af5000 1 --2- 172.21.15.44:0/1627875902 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x5558402e5930 0x55584044f010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:45.670 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.677+0000 7f1792af5000 1 --2- 172.21.15.44:0/1627875902 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55583fee5280 0x55584044e6a0 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:45.670 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.677+0000 7f1792af5000 1 --2- 172.21.15.44:0/1627875902 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55584032e670 0x55584044e160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:45.670 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.677+0000 7f1792af5000 1 -- 172.21.15.44:0/1627875902 >> 172.21.15.44:0/1627875902 conn(0x55584041b640 msgr2=0x555840471a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:47:45.670 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.677+0000 7f1792af5000 1 -- 172.21.15.44:0/1627875902 shutdown_connections 2024-04-17T19:47:45.670 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.677+0000 7f1792af5000 1 -- 172.21.15.44:0/1627875902 wait complete. 2024-04-17T19:47:45.671 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.677+0000 7f1792af5000 1 -- start start 2024-04-17T19:47:45.671 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.677+0000 7f1792af5000 1 Processor -- start 2024-04-17T19:47:45.673 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.681+0000 7f1792af5000 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x55583fee5280 0x5558404cb920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:45.673 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.681+0000 7f1792af5000 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5558402e5930 0x5558404cbe60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:45.673 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.681+0000 7f1792af5000 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55584032e670 0x55584046fdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:45.674 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.681+0000 7f1792af5000 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x555840267b20 con 0x55584032e670 2024-04-17T19:47:45.674 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.681+0000 7f1792af5000 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x555840262800 con 0x5558402e5930 2024-04-17T19:47:45.674 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.681+0000 7f1792af5000 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x555840270700 con 0x55583fee5280 2024-04-17T19:47:45.674 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.681+0000 7f1792af5000 10 client.0 _ll_register_callbacks cb 0x7f177c0b0070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-17T19:47:45.674 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.681+0000 7f1789400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55584032e670 0x55584046fdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:45.674 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.681+0000 7f1789400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55584032e670 0x55584046fdd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:34288/0 (socket says 172.21.15.44:34288) 2024-04-17T19:47:45.674 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.681+0000 7f1789400640 1 -- 172.21.15.44:0/338066262 learned_addr learned my addr 172.21.15.44:0/338066262 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-04-17T19:47:45.674 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.681+0000 7f1783e00640 1 --2- 172.21.15.44:0/338066262 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5558402e5930 0x5558404cbe60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:45.674 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.681+0000 7f1788a00640 1 --2- 172.21.15.44:0/338066262 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x55583fee5280 0x5558404cb920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:45.674 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.681+0000 7f1789400640 1 -- 172.21.15.44:0/338066262 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x55583fee5280 msgr2=0x5558404cb920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T19:47:45.674 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.681+0000 7f1789400640 1 --2- 172.21.15.44:0/338066262 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x55583fee5280 0x5558404cb920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:45.674 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.681+0000 7f1789400640 1 -- 172.21.15.44:0/338066262 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5558402e5930 msgr2=0x5558404cbe60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T19:47:45.674 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.681+0000 7f1789400640 1 --2- 172.21.15.44:0/338066262 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5558402e5930 0x5558404cbe60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:45.674 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.681+0000 7f1789400640 1 -- 172.21.15.44:0/338066262 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5558401f57e0 con 0x55584032e670 2024-04-17T19:47:45.675 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.681+0000 7f1789400640 1 --2- 172.21.15.44:0/338066262 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55584032e670 0x55584046fdd0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f177c0194b0 tx=0x7f177c009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=211a1dde6ed5e16c server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:47:45.675 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.681+0000 7f1769600640 10 client.0 ms_handle_connect on v2:172.21.15.44:3300/0 2024-04-17T19:47:45.675 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.681+0000 7f1769600640 1 -- 172.21.15.44:0/338066262 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f177c0d2030 con 0x55584032e670 2024-04-17T19:47:45.675 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.681+0000 7f1792af5000 1 -- 172.21.15.44:0/338066262 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1770007710 con 0x55584032e670 2024-04-17T19:47:45.675 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.681+0000 7f1769600640 1 -- 172.21.15.44:0/338066262 <== mon.0 v2:172.21.15.44:3300/0 2 ==== osd_map(27..27 src has 1..27) ==== 6619+0+0 (secure 0 0 0) 0x7f177c0a5900 con 0x55584032e670 2024-04-17T19:47:45.675 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.681+0000 7f1769600640 1 -- 172.21.15.44:0/338066262 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_get_version_reply(handle=1 version=18) ==== 24+0+0 (secure 0 0 0) 0x7f177c0db050 con 0x55584032e670 2024-04-17T19:47:45.675 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.681+0000 7f1792af5000 10 client.4920 fetch_fsmap learned FSMap version 18 2024-04-17T19:47:45.675 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.681+0000 7f1792af5000 1 -- 172.21.15.44:0/338066262 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,fsmap=18,monmap=2+}) -- 0x555840208670 con 0x55584032e670 2024-04-17T19:47:45.675 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.681+0000 7f1769600640 1 -- 172.21.15.44:0/338066262 <== mon.0 v2:172.21.15.44:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1770007710 con 0x55584032e670 2024-04-17T19:47:45.675 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.681+0000 7f1769600640 1 -- 172.21.15.44:0/338066262 <== mon.0 v2:172.21.15.44:3300/0 5 ==== fsmap(e 18) ==== 4792+0+0 (secure 0 0 0) 0x7f177c0de020 con 0x55584032e670 2024-04-17T19:47:45.675 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.681+0000 7f1792af5000 10 client.4920 fetch_fsmap finished waiting for FSMap version 18 2024-04-17T19:47:45.675 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.681+0000 7f1792af5000 10 client.4920 resolve_mds: resolved name 'd' to daemon mds.d 2024-04-17T19:47:45.675 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.681+0000 7f1792af5000 20 client.4920 populate_metadata read hostname 'smithi044' 2024-04-17T19:47:45.675 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.681+0000 7f1792af5000 1 --2- 172.21.15.44:0/338066262 >> [v2:172.21.15.62:6834/2585862759,v1:172.21.15.62:6835/2585862759] conn(0x55583ff22e80 0x555840470850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:45.675 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.681+0000 7f1792af5000 4 client.4920 mds_command: new command op to 4294 tid=0 multi_id=0 [{"prefix": "status"}] 2024-04-17T19:47:45.675 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.681+0000 7f1792af5000 1 -- 172.21.15.44:0/338066262 --> [v2:172.21.15.62:6834/2585862759,v1:172.21.15.62:6835/2585862759] -- command(tid 0: {"prefix": "status"}) -- 0x555840270f10 con 0x55583ff22e80 2024-04-17T19:47:45.677 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.681+0000 7f1788a00640 1 --2- 172.21.15.44:0/338066262 >> [v2:172.21.15.62:6834/2585862759,v1:172.21.15.62:6835/2585862759] conn(0x55583ff22e80 0x555840470850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:45.677 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.685+0000 7f1788a00640 1 --2- 172.21.15.44:0/338066262 >> [v2:172.21.15.62:6834/2585862759,v1:172.21.15.62:6835/2585862759] conn(0x55583ff22e80 0x555840470850 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=7702dc18dd762c8c server_cookie=aaf8ed4e4d663f1c in_seq=0 out_seq=0 2024-04-17T19:47:45.677 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.685+0000 7f1769600640 10 client.4920 ms_handle_connect on v2:172.21.15.62:6834/2585862759 2024-04-17T19:47:45.677 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.685+0000 7f1769600640 1 -- 172.21.15.44:0/338066262 <== mds.1 v2:172.21.15.62:6834/2585862759 1 ==== command_reply(tid 0: 0 ) ==== 8+0+331 (crc 0 0 0) 0x555840270f10 con 0x55583ff22e80 2024-04-17T19:47:45.677 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.685+0000 7f1769600640 10 client.4920 handle_command_reply: tid=0 2024-04-17T19:47:45.677 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.685+0000 7f1792af5000 1 client.4920 shutdown 2024-04-17T19:47:45.677 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.685+0000 7f1792af5000 1 -- 172.21.15.44:0/338066262 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55584032e670 msgr2=0x55584046fdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:45.677 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.685+0000 7f1792af5000 1 --2- 172.21.15.44:0/338066262 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55584032e670 0x55584046fdd0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f177c0194b0 tx=0x7f177c009750 comp rx=0 tx=0).stop 2024-04-17T19:47:45.677 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.685+0000 7f1792af5000 1 -- 172.21.15.44:0/338066262 shutdown_connections 2024-04-17T19:47:45.677 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.685+0000 7f1792af5000 1 --2- 172.21.15.44:0/338066262 >> [v2:172.21.15.62:6834/2585862759,v1:172.21.15.62:6835/2585862759] conn(0x55583ff22e80 0x555840470850 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:45.678 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.685+0000 7f1792af5000 1 --2- 172.21.15.44:0/338066262 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55584032e670 0x55584046fdd0 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:45.678 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.685+0000 7f1792af5000 1 --2- 172.21.15.44:0/338066262 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5558402e5930 0x5558404cbe60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:45.678 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.685+0000 7f1792af5000 1 --2- 172.21.15.44:0/338066262 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x55583fee5280 0x5558404cb920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:45.678 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.685+0000 7f1792af5000 1 -- 172.21.15.44:0/338066262 >> 172.21.15.44:0/338066262 conn(0x55584041b640 msgr2=0x5558404139a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:47:45.678 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.685+0000 7f1769600640 0 client.4920 ms_handle_reset on v2:172.21.15.62:6834/2585862759 2024-04-17T19:47:45.678 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.685+0000 7f1792af5000 1 -- 172.21.15.44:0/338066262 shutdown_connections 2024-04-17T19:47:45.678 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.685+0000 7f1792af5000 1 -- 172.21.15.44:0/338066262 wait complete. 2024-04-17T19:47:45.678 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.685+0000 7f1792af5000 20 client.4920 trim_cache size 0 max 16384 2024-04-17T19:47:45.678 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2024-04-17T19:47:45.678 INFO:teuthology.orchestra.run.smithi044.stdout: "cluster_fsid": "703f77ca-79c6-4a66-b576-62c526cb1021", 2024-04-17T19:47:45.679 INFO:teuthology.orchestra.run.smithi044.stdout: "whoami": 1, 2024-04-17T19:47:45.679 INFO:teuthology.orchestra.run.smithi044.stdout: "id": 4294, 2024-04-17T19:47:45.679 INFO:teuthology.orchestra.run.smithi044.stdout: "want_state": "up:active", 2024-04-17T19:47:45.679 INFO:teuthology.orchestra.run.smithi044.stdout: "state": "up:active", 2024-04-17T19:47:45.679 INFO:teuthology.orchestra.run.smithi044.stdout: "fs_name": "cephfs", 2024-04-17T19:47:45.679 INFO:teuthology.orchestra.run.smithi044.stdout: "rank_uptime": 27.904140599000002, 2024-04-17T19:47:45.679 INFO:teuthology.orchestra.run.smithi044.stdout: "mdsmap_epoch": 18, 2024-04-17T19:47:45.679 INFO:teuthology.orchestra.run.smithi044.stdout: "osdmap_epoch": 27, 2024-04-17T19:47:45.679 INFO:teuthology.orchestra.run.smithi044.stdout: "osdmap_epoch_barrier": 27, 2024-04-17T19:47:45.679 INFO:teuthology.orchestra.run.smithi044.stdout: "uptime": 56.302635594999998 2024-04-17T19:47:45.679 INFO:teuthology.orchestra.run.smithi044.stdout:} 2024-04-17T19:47:45.680 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.685+0000 7f178b400640 1 -- 172.21.15.44:0/1250217258 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f17640683b0 msgr2=0x7f176406a8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:45.680 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.685+0000 7f178b400640 1 --2- 172.21.15.44:0/1250217258 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f17640683b0 0x7f176406a8c0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f178414dc20 tx=0x7f1770009040 comp rx=0 tx=0).stop 2024-04-17T19:47:45.680 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.685+0000 7f178b400640 1 -- 172.21.15.44:0/1250217258 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f17840c80a0 msgr2=0x7f17841f8ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:45.680 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.685+0000 7f178b400640 1 --2- 172.21.15.44:0/1250217258 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f17840c80a0 0x7f17841f8ec0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f177800e870 tx=0x7f177800ec70 comp rx=0 tx=0).stop 2024-04-17T19:47:45.680 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.685+0000 7f178b400640 1 -- 172.21.15.44:0/1250217258 shutdown_connections 2024-04-17T19:47:45.680 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.685+0000 7f178b400640 1 --2- 172.21.15.44:0/1250217258 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f17640683b0 0x7f176406a8c0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:45.680 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.685+0000 7f178b400640 1 --2- 172.21.15.44:0/1250217258 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f1784159140 0x7f17841566e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:45.680 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.685+0000 7f178b400640 1 --2- 172.21.15.44:0/1250217258 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1784152860 0x7f17841f5880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:45.680 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.685+0000 7f178b400640 1 --2- 172.21.15.44:0/1250217258 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f17840c80a0 0x7f17841f8ec0 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:45.680 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.685+0000 7f178b400640 1 -- 172.21.15.44:0/1250217258 >> 172.21.15.44:0/1250217258 conn(0x7f178406c380 msgr2=0x7f1784150e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:47:45.680 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.685+0000 7f178b400640 1 -- 172.21.15.44:0/1250217258 shutdown_connections 2024-04-17T19:47:45.681 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.685+0000 7f178b400640 1 -- 172.21.15.44:0/1250217258 wait complete. 2024-04-17T19:47:45.695 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2024-04-17T19:47:45.848 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.857+0000 7f41ee800640 1 Processor -- start 2024-04-17T19:47:45.848 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.857+0000 7f41ee800640 1 -- start start 2024-04-17T19:47:45.850 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.857+0000 7f41ee800640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f41e8155f40 0x7f41e815c5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:45.850 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.857+0000 7f41ee800640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f41e806e460 con 0x7f41e80cb720 2024-04-17T19:47:45.850 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.857+0000 7f41ee800640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f41e815caf0 con 0x7f41e80cbb30 2024-04-17T19:47:45.850 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.857+0000 7f41ee800640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7f41e80ca6d0 con 0x7f41e8155f40 2024-04-17T19:47:45.850 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.857+0000 7f41dea00640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f41e80cb720 0x7f41e80c9720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:46882/0 (socket says 172.21.15.44:46882) 2024-04-17T19:47:45.850 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.857+0000 7f41dea00640 1 -- 172.21.15.44:0/641666158 learned_addr learned my addr 172.21.15.44:0/641666158 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-04-17T19:47:45.852 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.857+0000 7f41e7400640 1 --2- 172.21.15.44:0/641666158 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f41e8155f40 0x7f41e815c5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:45.852 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.861+0000 7f41e6a00640 1 -- 172.21.15.44:0/641666158 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2614519583 0 0) 0x7f41e806e460 con 0x7f41e80cb720 2024-04-17T19:47:45.852 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.861+0000 7f41e6a00640 1 -- 172.21.15.44:0/641666158 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f41cc003530 con 0x7f41e80cb720 2024-04-17T19:47:45.852 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.861+0000 7f41e6a00640 1 -- 172.21.15.44:0/641666158 <== mon.0 v1:172.21.15.44:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3368332166 0 0) 0x7f41cc003530 con 0x7f41e80cb720 2024-04-17T19:47:45.852 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.861+0000 7f41e6a00640 1 -- 172.21.15.44:0/641666158 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f41e8155f40 msgr2=0x7f41e815c5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T19:47:45.852 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.861+0000 7f41e6a00640 1 --2- 172.21.15.44:0/641666158 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f41e8155f40 0x7f41e815c5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:45.852 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.861+0000 7f41e6a00640 1 -- 172.21.15.44:0/641666158 >> v1:172.21.15.62:6789/0 conn(0x7f41e80cbb30 legacy=0x7f41e8166440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:45.852 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.861+0000 7f41e6a00640 1 -- 172.21.15.44:0/641666158 --> v1:172.21.15.44:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f41e806dbc0 con 0x7f41e80cb720 2024-04-17T19:47:45.852 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.861+0000 7f41e6a00640 1 -- 172.21.15.44:0/641666158 <== mon.0 v1:172.21.15.44:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1863569991 0 0) 0x7f41d0001680 con 0x7f41e80cb720 2024-04-17T19:47:45.852 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.861+0000 7f41e6a00640 1 -- 172.21.15.44:0/641666158 >> v1:172.21.15.44:6789/0 conn(0x7f41e80cb720 legacy=0x7f41e80c9720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:45.853 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.861+0000 7f41e6a00640 1 --2- 172.21.15.44:0/641666158 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f41e8155f40 0x7f41cc0039f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:45.853 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.861+0000 7f41e6a00640 1 --2- 172.21.15.44:0/641666158 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f41cc003f50 0x7f41cc004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:45.853 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.861+0000 7f41e6a00640 1 --2- 172.21.15.44:0/641666158 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f41cc004d50 0x7f41cc005160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:45.853 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.861+0000 7f41e6a00640 1 -- 172.21.15.44:0/641666158 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f41cc00bb00 con 0x7f41cc004d50 2024-04-17T19:47:45.853 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.861+0000 7f41e6a00640 1 -- 172.21.15.44:0/641666158 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f41cc00bcb0 con 0x7f41cc003f50 2024-04-17T19:47:45.853 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.861+0000 7f41e6a00640 1 -- 172.21.15.44:0/641666158 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7f41cc00beb0 con 0x7f41e8155f40 2024-04-17T19:47:45.853 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.861+0000 7f41e7400640 1 --2- 172.21.15.44:0/641666158 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f41e8155f40 0x7f41cc0039f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:45.853 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.861+0000 7f41e7e00640 1 --2- 172.21.15.44:0/641666158 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f41cc004d50 0x7f41cc005160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:45.853 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.861+0000 7f41dea00640 1 --2- 172.21.15.44:0/641666158 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f41cc003f50 0x7f41cc004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:45.853 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.861+0000 7f41e7e00640 1 -- 172.21.15.44:0/641666158 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f41e8155f40 msgr2=0x7f41cc0039f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T19:47:45.853 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.861+0000 7f41e7e00640 1 --2- 172.21.15.44:0/641666158 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f41e8155f40 0x7f41cc0039f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:45.853 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.861+0000 7f41e7e00640 1 -- 172.21.15.44:0/641666158 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f41cc003f50 msgr2=0x7f41cc004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T19:47:45.853 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.861+0000 7f41e7e00640 1 --2- 172.21.15.44:0/641666158 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f41cc003f50 0x7f41cc004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:45.853 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.861+0000 7f41e7e00640 1 -- 172.21.15.44:0/641666158 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f41cc003530 con 0x7f41cc004d50 2024-04-17T19:47:45.855 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.865+0000 7f41e7e00640 1 --2- 172.21.15.44:0/641666158 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f41cc004d50 0x7f41cc005160 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f41e80caa30 tx=0x7f41e001c840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e195dbf2e4e26520 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:47:45.855 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.865+0000 7f41e6a00640 1 -- 172.21.15.44:0/641666158 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41e00b2070 con 0x7f41cc004d50 2024-04-17T19:47:45.855 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.865+0000 7f41e6a00640 1 -- 172.21.15.44:0/641666158 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f41e00a5730 con 0x7f41cc004d50 2024-04-17T19:47:45.855 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.865+0000 7f41e6a00640 1 -- 172.21.15.44:0/641666158 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41e0001b60 con 0x7f41cc004d50 2024-04-17T19:47:45.856 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.865+0000 7f41ee800640 1 -- 172.21.15.44:0/641666158 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f41cc004d50 msgr2=0x7f41cc005160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:45.856 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.865+0000 7f41ee800640 1 --2- 172.21.15.44:0/641666158 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f41cc004d50 0x7f41cc005160 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f41e80caa30 tx=0x7f41e001c840 comp rx=0 tx=0).stop 2024-04-17T19:47:45.856 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.865+0000 7f41e7e00640 1 -- 172.21.15.44:0/641666158 reap_dead start 2024-04-17T19:47:45.856 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.865+0000 7f41ee800640 1 -- 172.21.15.44:0/641666158 shutdown_connections 2024-04-17T19:47:45.856 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.865+0000 7f41ee800640 1 -- 172.21.15.44:0/641666158 >> 172.21.15.44:0/641666158 conn(0x7f41e80722e0 msgr2=0x7f41e8072720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:47:45.856 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.865+0000 7f41ee800640 1 -- 172.21.15.44:0/641666158 shutdown_connections 2024-04-17T19:47:45.856 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.865+0000 7f41ee800640 1 -- 172.21.15.44:0/641666158 wait complete. 2024-04-17T19:47:45.858 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.865+0000 7f41ee800640 1 Processor -- start 2024-04-17T19:47:45.858 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.865+0000 7f41ee800640 1 -- start start 2024-04-17T19:47:45.861 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.869+0000 7f41ee800640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f41e80b3c30 0x7f41e8070900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:45.861 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.869+0000 7f41ee800640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f41e815e9f0 0x7f41e815ee00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:45.861 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.869+0000 7f41ee800640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f41e81516b0 0x7f41e8151ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:45.861 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.869+0000 7f41ee800640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f41e806e180 con 0x7f41e81516b0 2024-04-17T19:47:45.861 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.869+0000 7f41ee800640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f41e8156350 con 0x7f41e80b3c30 2024-04-17T19:47:45.861 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.869+0000 7f41ee800640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7f41e815bdb0 con 0x7f41e815e9f0 2024-04-17T19:47:45.861 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.869+0000 7f41e7e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f41e81516b0 0x7f41e8151ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:45.861 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.869+0000 7f41e7e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f41e81516b0 0x7f41e8151ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:34300/0 (socket says 172.21.15.44:34300) 2024-04-17T19:47:45.861 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.869+0000 7f41e7e00640 1 -- 172.21.15.44:0/3596400111 learned_addr learned my addr 172.21.15.44:0/3596400111 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-04-17T19:47:45.861 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.869+0000 7f41e7400640 1 --2- 172.21.15.44:0/3596400111 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f41e80b3c30 0x7f41e8070900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:45.861 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.869+0000 7f41dea00640 1 --2- 172.21.15.44:0/3596400111 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f41e815e9f0 0x7f41e815ee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:45.862 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.869+0000 7f41e7e00640 1 -- 172.21.15.44:0/3596400111 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f41e815e9f0 msgr2=0x7f41e815ee00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:45.862 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.869+0000 7f41e7e00640 1 --2- 172.21.15.44:0/3596400111 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f41e815e9f0 0x7f41e815ee00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:45.862 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.869+0000 7f41e7e00640 1 -- 172.21.15.44:0/3596400111 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f41e80b3c30 msgr2=0x7f41e8070900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:45.862 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.869+0000 7f41e7e00640 1 --2- 172.21.15.44:0/3596400111 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f41e80b3c30 0x7f41e8070900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:45.862 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.869+0000 7f41e7e00640 1 -- 172.21.15.44:0/3596400111 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f41e8152000 con 0x7f41e81516b0 2024-04-17T19:47:45.862 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.869+0000 7f41e7e00640 1 --2- 172.21.15.44:0/3596400111 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f41e81516b0 0x7f41e8151ac0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f41e001cd20 tx=0x7f41cc005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:47:45.862 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.869+0000 7f41dfe00640 1 -- 172.21.15.44:0/3596400111 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41e00bb070 con 0x7f41e81516b0 2024-04-17T19:47:45.862 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.869+0000 7f41dfe00640 1 -- 172.21.15.44:0/3596400111 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f41e0001b40 con 0x7f41e81516b0 2024-04-17T19:47:45.862 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.869+0000 7f41dfe00640 1 -- 172.21.15.44:0/3596400111 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41e00b2040 con 0x7f41e81516b0 2024-04-17T19:47:45.862 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.869+0000 7f41ee800640 1 -- 172.21.15.44:0/3596400111 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f41e80c6270 con 0x7f41e81516b0 2024-04-17T19:47:45.862 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.869+0000 7f41ee800640 1 -- 172.21.15.44:0/3596400111 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f41e81f2030 con 0x7f41e81516b0 2024-04-17T19:47:45.864 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.873+0000 7f41dfe00640 1 -- 172.21.15.44:0/3596400111 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f41e00a5b00 con 0x7f41e81516b0 2024-04-17T19:47:45.865 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.873+0000 7f41dfe00640 1 --2- 172.21.15.44:0/3596400111 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f41c4068380 0x7f41c406a890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:45.865 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.873+0000 7f41dfe00640 1 -- 172.21.15.44:0/3596400111 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6619+0+0 (secure 0 0 0) 0x7f41e011fc90 con 0x7f41e81516b0 2024-04-17T19:47:45.865 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.873+0000 7f41f5e7a000 1 Processor -- start 2024-04-17T19:47:45.865 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.873+0000 7f41e7400640 1 --2- 172.21.15.44:0/3596400111 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f41c4068380 0x7f41c406a890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:45.865 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.873+0000 7f41f5e7a000 1 -- start start 2024-04-17T19:47:45.866 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.873+0000 7f41e7400640 1 --2- 172.21.15.44:0/3596400111 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f41c4068380 0x7f41c406a890 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f41d8009be0 tx=0x7f41d8009190 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:47:45.867 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.877+0000 7f41f5e7a000 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x56304e2d8c10 0x56304e4421b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:45.867 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.877+0000 7f41f5e7a000 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x56304e2d1930 0x56304e4426f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:45.867 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.877+0000 7f41f5e7a000 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56304ded1280 0x56304e442c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:45.867 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.877+0000 7f41f5e7a000 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x56304e24f4f0 con 0x56304ded1280 2024-04-17T19:47:45.867 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.877+0000 7f41f5e7a000 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x56304e1e9c10 con 0x56304e2d8c10 2024-04-17T19:47:45.867 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.877+0000 7f41f5e7a000 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x56304e24b4b0 con 0x56304e2d1930 2024-04-17T19:47:45.868 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.877+0000 7f41e7e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56304ded1280 0x56304e442c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:45.868 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.877+0000 7f41e7400640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x56304e2d8c10 0x56304e4421b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:45.868 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.877+0000 7f41e7e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56304ded1280 0x56304e442c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:34310/0 (socket says 172.21.15.44:34310) 2024-04-17T19:47:45.868 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.877+0000 7f41dea00640 1 --2- 172.21.15.44:0/3300375917 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x56304e2d1930 0x56304e4426f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:45.869 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.877+0000 7f41e7e00640 1 -- 172.21.15.44:0/3300375917 learned_addr learned my addr 172.21.15.44:0/3300375917 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-04-17T19:47:45.869 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.877+0000 7f41e7e00640 1 -- 172.21.15.44:0/3300375917 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x56304e2d1930 msgr2=0x56304e4426f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T19:47:45.869 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.877+0000 7f41e7e00640 1 --2- 172.21.15.44:0/3300375917 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x56304e2d1930 0x56304e4426f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:45.869 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.877+0000 7f41e7e00640 1 -- 172.21.15.44:0/3300375917 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x56304e2d8c10 msgr2=0x56304e4421b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T19:47:45.869 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.877+0000 7f41e7e00640 1 --2- 172.21.15.44:0/3300375917 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x56304e2d8c10 0x56304e4421b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:45.869 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.877+0000 7f41e7e00640 1 -- 172.21.15.44:0/3300375917 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56304e1e9e60 con 0x56304ded1280 2024-04-17T19:47:45.869 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.877+0000 7f41e7e00640 1 --2- 172.21.15.44:0/3300375917 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56304ded1280 0x56304e442c30 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f41e00ebe20 tx=0x7f41e00ef320 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3405f7e61795968 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:47:45.869 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.877+0000 7f41d7e00640 1 -- 172.21.15.44:0/3300375917 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41e00ef9c0 con 0x56304ded1280 2024-04-17T19:47:45.869 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.877+0000 7f41d7e00640 1 -- 172.21.15.44:0/3300375917 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f41e00f3cc0 con 0x56304ded1280 2024-04-17T19:47:45.869 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.877+0000 7f41d7e00640 1 -- 172.21.15.44:0/3300375917 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41e00f8580 con 0x56304ded1280 2024-04-17T19:47:45.870 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.877+0000 7f41f5e7a000 1 -- 172.21.15.44:0/3300375917 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56304ded1280 msgr2=0x56304e442c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:45.870 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.877+0000 7f41f5e7a000 1 --2- 172.21.15.44:0/3300375917 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56304ded1280 0x56304e442c30 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f41e00ebe20 tx=0x7f41e00ef320 comp rx=0 tx=0).stop 2024-04-17T19:47:45.870 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.877+0000 7f41f5e7a000 1 -- 172.21.15.44:0/3300375917 shutdown_connections 2024-04-17T19:47:45.870 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.877+0000 7f41f5e7a000 1 --2- 172.21.15.44:0/3300375917 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x56304e2d1930 0x56304e4426f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:45.870 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.877+0000 7f41f5e7a000 1 --2- 172.21.15.44:0/3300375917 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56304ded1280 0x56304e442c30 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:45.870 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.877+0000 7f41f5e7a000 1 --2- 172.21.15.44:0/3300375917 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x56304e2d8c10 0x56304e4421b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:45.870 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.877+0000 7f41f5e7a000 1 -- 172.21.15.44:0/3300375917 >> 172.21.15.44:0/3300375917 conn(0x56304e31a670 msgr2=0x56304e43ff70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:47:45.870 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.877+0000 7f41f5e7a000 1 -- 172.21.15.44:0/3300375917 shutdown_connections 2024-04-17T19:47:45.871 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.877+0000 7f41f5e7a000 1 -- 172.21.15.44:0/3300375917 wait complete. 2024-04-17T19:47:45.871 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.877+0000 7f41f5e7a000 1 -- start start 2024-04-17T19:47:45.871 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.881+0000 7f41f5e7a000 1 Processor -- start 2024-04-17T19:47:45.873 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.881+0000 7f41f5e7a000 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56304ded1280 0x56304e43bf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:45.874 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.881+0000 7f41f5e7a000 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x56304e2d1930 0x56304e43c450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:45.874 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.881+0000 7f41f5e7a000 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x56304e2d8c10 0x56304e403bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:45.874 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.881+0000 7f41f5e7a000 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x56304e2909e0 con 0x56304ded1280 2024-04-17T19:47:45.874 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.881+0000 7f41f5e7a000 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x56304e20ca80 con 0x56304e2d1930 2024-04-17T19:47:45.874 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.881+0000 7f41f5e7a000 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x56304e20ad10 con 0x56304e2d8c10 2024-04-17T19:47:45.874 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.881+0000 7f41f5e7a000 10 client.0 _ll_register_callbacks cb 0x56304e3ecb20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-17T19:47:45.874 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.881+0000 7f41e7400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56304ded1280 0x56304e43bf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:45.874 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.881+0000 7f41e7400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56304ded1280 0x56304e43bf10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:34322/0 (socket says 172.21.15.44:34322) 2024-04-17T19:47:45.874 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.881+0000 7f41e7400640 1 -- 172.21.15.44:0/3855663889 learned_addr learned my addr 172.21.15.44:0/3855663889 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-04-17T19:47:45.874 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.881+0000 7f41dea00640 1 --2- 172.21.15.44:0/3855663889 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x56304e2d1930 0x56304e43c450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:45.874 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.881+0000 7f41e7e00640 1 --2- 172.21.15.44:0/3855663889 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x56304e2d8c10 0x56304e403bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:45.874 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.881+0000 7f41e7400640 1 -- 172.21.15.44:0/3855663889 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x56304e2d8c10 msgr2=0x56304e403bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T19:47:45.875 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.881+0000 7f41e7400640 1 --2- 172.21.15.44:0/3855663889 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x56304e2d8c10 0x56304e403bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:45.875 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.881+0000 7f41e7400640 1 -- 172.21.15.44:0/3855663889 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x56304e2d1930 msgr2=0x56304e43c450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T19:47:45.875 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.881+0000 7f41e7400640 1 --2- 172.21.15.44:0/3855663889 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x56304e2d1930 0x56304e43c450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:45.875 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.881+0000 7f41e7400640 1 -- 172.21.15.44:0/3855663889 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56304e21ae20 con 0x56304ded1280 2024-04-17T19:47:45.875 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.881+0000 7f41e7400640 1 --2- 172.21.15.44:0/3855663889 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56304ded1280 0x56304e43bf10 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f41d8003bd0 tx=0x7f41d80046d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7a0be43add3bef7d server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:47:45.875 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.881+0000 7f41d4c00640 10 client.0 ms_handle_connect on v2:172.21.15.44:3300/0 2024-04-17T19:47:45.875 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.881+0000 7f41d4c00640 1 -- 172.21.15.44:0/3855663889 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41d801b070 con 0x56304ded1280 2024-04-17T19:47:45.875 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.881+0000 7f41d4c00640 1 -- 172.21.15.44:0/3855663889 <== mon.0 v2:172.21.15.44:3300/0 2 ==== osd_map(27..27 src has 1..27) ==== 6619+0+0 (secure 0 0 0) 0x7f41d8004490 con 0x56304ded1280 2024-04-17T19:47:45.875 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.881+0000 7f41f5e7a000 1 -- 172.21.15.44:0/3855663889 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f41e00f3cc0 con 0x56304ded1280 2024-04-17T19:47:45.875 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.881+0000 7f41d4c00640 1 -- 172.21.15.44:0/3855663889 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_get_version_reply(handle=1 version=18) ==== 24+0+0 (secure 0 0 0) 0x7f41d8023ba0 con 0x56304ded1280 2024-04-17T19:47:45.875 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.881+0000 7f41f5e7a000 10 client.4932 fetch_fsmap learned FSMap version 18 2024-04-17T19:47:45.875 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.881+0000 7f41f5e7a000 1 -- 172.21.15.44:0/3855663889 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,fsmap=18,monmap=2+}) -- 0x56304e31aa80 con 0x56304ded1280 2024-04-17T19:47:45.875 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.881+0000 7f41d4c00640 1 -- 172.21.15.44:0/3855663889 <== mon.0 v2:172.21.15.44:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f41e00f3cc0 con 0x56304ded1280 2024-04-17T19:47:45.876 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.881+0000 7f41d4c00640 1 -- 172.21.15.44:0/3855663889 <== mon.0 v2:172.21.15.44:3300/0 5 ==== fsmap(e 18) ==== 4792+0+0 (secure 0 0 0) 0x7f41d8034050 con 0x56304ded1280 2024-04-17T19:47:45.876 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.881+0000 7f41f5e7a000 10 client.4932 fetch_fsmap finished waiting for FSMap version 18 2024-04-17T19:47:45.876 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.881+0000 7f41f5e7a000 10 client.4932 resolve_mds: resolved name 'b' to daemon mds.b 2024-04-17T19:47:45.877 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.881+0000 7f41f5e7a000 20 client.4932 populate_metadata read hostname 'smithi044' 2024-04-17T19:47:45.877 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.881+0000 7f41f5e7a000 1 --2- 172.21.15.44:0/3855663889 >> [v2:172.21.15.62:6838/1537667111,v1:172.21.15.62:6839/1537667111] conn(0x56304def57d0 0x56304e404900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:45.877 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.881+0000 7f41f5e7a000 4 client.4932 mds_command: new command op to 4306 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-17T19:47:45.877 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.881+0000 7f41f5e7a000 1 -- 172.21.15.44:0/3855663889 --> [v2:172.21.15.62:6838/1537667111,v1:172.21.15.62:6839/1537667111] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56304e1e8be0 con 0x56304def57d0 2024-04-17T19:47:45.877 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.885+0000 7f41dea00640 1 --2- 172.21.15.44:0/3855663889 >> [v2:172.21.15.62:6838/1537667111,v1:172.21.15.62:6839/1537667111] conn(0x56304def57d0 0x56304e404900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:45.877 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.885+0000 7f41dea00640 1 --2- 172.21.15.44:0/3855663889 >> [v2:172.21.15.62:6838/1537667111,v1:172.21.15.62:6839/1537667111] conn(0x56304def57d0 0x56304e404900 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=218ba003a53eb138 server_cookie=b7af8ab3ecbafdb in_seq=0 out_seq=0 2024-04-17T19:47:45.877 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.885+0000 7f41d4c00640 10 client.4932 ms_handle_connect on v2:172.21.15.62:6838/1537667111 2024-04-17T19:47:45.878 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.885+0000 7f41d4c00640 1 -- 172.21.15.44:0/3855663889 <== mds.0 v2:172.21.15.62:6838/1537667111 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x56304e1e8be0 con 0x56304def57d0 2024-04-17T19:47:45.878 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.885+0000 7f41d4c00640 10 client.4932 handle_command_reply: tid=0 2024-04-17T19:47:45.878 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.885+0000 7f41f5e7a000 1 client.4932 shutdown 2024-04-17T19:47:45.878 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.885+0000 7f41f5e7a000 1 -- 172.21.15.44:0/3855663889 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56304ded1280 msgr2=0x56304e43bf10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:45.879 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.885+0000 7f41f5e7a000 1 --2- 172.21.15.44:0/3855663889 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56304ded1280 0x56304e43bf10 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f41d8003bd0 tx=0x7f41d80046d0 comp rx=0 tx=0).stop 2024-04-17T19:47:45.879 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.885+0000 7f41f5e7a000 1 -- 172.21.15.44:0/3855663889 shutdown_connections 2024-04-17T19:47:45.879 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.885+0000 7f41f5e7a000 1 --2- 172.21.15.44:0/3855663889 >> [v2:172.21.15.62:6838/1537667111,v1:172.21.15.62:6839/1537667111] conn(0x56304def57d0 0x56304e404900 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:45.879 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.885+0000 7f41f5e7a000 1 --2- 172.21.15.44:0/3855663889 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x56304e2d8c10 0x56304e403bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:45.879 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.885+0000 7f41f5e7a000 1 --2- 172.21.15.44:0/3855663889 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x56304e2d1930 0x56304e43c450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:45.879 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.885+0000 7f41f5e7a000 1 --2- 172.21.15.44:0/3855663889 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56304ded1280 0x56304e43bf10 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:45.879 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.885+0000 7f41f5e7a000 1 -- 172.21.15.44:0/3855663889 >> 172.21.15.44:0/3855663889 conn(0x56304e31a670 msgr2=0x56304e43d720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:47:45.879 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.885+0000 7f41d4c00640 0 client.4932 ms_handle_reset on v2:172.21.15.62:6838/1537667111 2024-04-17T19:47:45.879 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.885+0000 7f41f5e7a000 1 -- 172.21.15.44:0/3855663889 shutdown_connections 2024-04-17T19:47:45.879 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.885+0000 7f41f5e7a000 1 -- 172.21.15.44:0/3855663889 wait complete. 2024-04-17T19:47:45.879 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.885+0000 7f41f5e7a000 20 client.4932 trim_cache size 0 max 16384 2024-04-17T19:47:45.896 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.905+0000 7f41f5e7a000 1 Processor -- start 2024-04-17T19:47:45.896 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.905+0000 7f41f5e7a000 1 -- start start 2024-04-17T19:47:45.899 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.905+0000 7f41f5e7a000 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x56304ded1280 0x56304e43b220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:45.899 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.905+0000 7f41f5e7a000 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56304e2d1930 0x56304e43a160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:45.899 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.905+0000 7f41f5e7a000 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x56304e2d8c10 0x56304e43a6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:45.899 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.905+0000 7f41f5e7a000 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f41e81fe7c0 con 0x56304e2d1930 2024-04-17T19:47:45.899 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.905+0000 7f41f5e7a000 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x56304e24e800 con 0x56304ded1280 2024-04-17T19:47:45.899 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.905+0000 7f41f5e7a000 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x56304e253b20 con 0x56304e2d8c10 2024-04-17T19:47:45.899 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.905+0000 7f41dea00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56304e2d1930 0x56304e43a160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:45.899 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.905+0000 7f41dea00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56304e2d1930 0x56304e43a160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:34338/0 (socket says 172.21.15.44:34338) 2024-04-17T19:47:45.899 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.905+0000 7f41dea00640 1 -- 172.21.15.44:0/169129920 learned_addr learned my addr 172.21.15.44:0/169129920 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-04-17T19:47:45.899 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.905+0000 7f41e7400640 1 --2- 172.21.15.44:0/169129920 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x56304ded1280 0x56304e43b220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:45.899 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.905+0000 7f41e7e00640 1 --2- 172.21.15.44:0/169129920 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x56304e2d8c10 0x56304e43a6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:45.899 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.909+0000 7f41dea00640 1 -- 172.21.15.44:0/169129920 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x56304e2d8c10 msgr2=0x56304e43a6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T19:47:45.900 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.909+0000 7f41dea00640 1 --2- 172.21.15.44:0/169129920 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x56304e2d8c10 0x56304e43a6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:45.900 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.909+0000 7f41dea00640 1 -- 172.21.15.44:0/169129920 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x56304ded1280 msgr2=0x56304e43b220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T19:47:45.900 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.909+0000 7f41dea00640 1 --2- 172.21.15.44:0/169129920 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x56304ded1280 0x56304e43b220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:45.900 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.909+0000 7f41dea00640 1 -- 172.21.15.44:0/169129920 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56304e2a8e30 con 0x56304e2d1930 2024-04-17T19:47:45.900 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.909+0000 7f41dea00640 1 --2- 172.21.15.44:0/169129920 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56304e2d1930 0x56304e43a160 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f41d00078f0 tx=0x7f41d0001de0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ff3bfe1cfa642353 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:47:45.901 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.909+0000 7f41d7400640 1 -- 172.21.15.44:0/169129920 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41d00191d0 con 0x56304e2d1930 2024-04-17T19:47:45.901 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.909+0000 7f41d7400640 1 -- 172.21.15.44:0/169129920 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f41d0027070 con 0x56304e2d1930 2024-04-17T19:47:45.901 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.909+0000 7f41d7400640 1 -- 172.21.15.44:0/169129920 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41d0019da0 con 0x56304e2d1930 2024-04-17T19:47:45.901 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.909+0000 7f41f5e7a000 1 -- 172.21.15.44:0/169129920 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56304e2d1930 msgr2=0x56304e43a160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:45.901 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.909+0000 7f41f5e7a000 1 --2- 172.21.15.44:0/169129920 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56304e2d1930 0x56304e43a160 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f41d00078f0 tx=0x7f41d0001de0 comp rx=0 tx=0).stop 2024-04-17T19:47:45.901 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.909+0000 7f41f5e7a000 1 -- 172.21.15.44:0/169129920 shutdown_connections 2024-04-17T19:47:45.901 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.909+0000 7f41f5e7a000 1 --2- 172.21.15.44:0/169129920 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x56304e2d8c10 0x56304e43a6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:45.902 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.909+0000 7f41f5e7a000 1 --2- 172.21.15.44:0/169129920 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56304e2d1930 0x56304e43a160 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:45.902 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.909+0000 7f41f5e7a000 1 --2- 172.21.15.44:0/169129920 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x56304ded1280 0x56304e43b220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:45.902 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.909+0000 7f41f5e7a000 1 -- 172.21.15.44:0/169129920 >> 172.21.15.44:0/169129920 conn(0x56304e31a670 msgr2=0x56304e45dc40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:47:45.902 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.909+0000 7f41f5e7a000 1 -- 172.21.15.44:0/169129920 shutdown_connections 2024-04-17T19:47:45.902 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.909+0000 7f41f5e7a000 1 -- 172.21.15.44:0/169129920 wait complete. 2024-04-17T19:47:45.902 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.909+0000 7f41f5e7a000 1 -- start start 2024-04-17T19:47:45.902 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.909+0000 7f41f5e7a000 1 Processor -- start 2024-04-17T19:47:45.905 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.913+0000 7f41f5e7a000 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56304ded1280 0x56304e45add0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:45.905 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.913+0000 7f41f5e7a000 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x56304e2d1930 0x56304e45b310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:45.905 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.913+0000 7f41f5e7a000 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x56304e2d8c10 0x56304e45b850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:45.905 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.913+0000 7f41f5e7a000 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x56304e1e57d0 con 0x56304ded1280 2024-04-17T19:47:45.905 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.913+0000 7f41f5e7a000 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x56304e25c700 con 0x56304e2d8c10 2024-04-17T19:47:45.905 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.913+0000 7f41f5e7a000 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x56304e40a7b0 con 0x56304e2d1930 2024-04-17T19:47:45.905 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.913+0000 7f41f5e7a000 10 client.0 _ll_register_callbacks cb 0x7f41d8014cf0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-17T19:47:45.905 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.913+0000 7f41e7400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56304ded1280 0x56304e45add0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:45.905 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.913+0000 7f41e7400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56304ded1280 0x56304e45add0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:34350/0 (socket says 172.21.15.44:34350) 2024-04-17T19:47:45.905 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.913+0000 7f41e7400640 1 -- 172.21.15.44:0/2444624465 learned_addr learned my addr 172.21.15.44:0/2444624465 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-04-17T19:47:45.905 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.913+0000 7f41dea00640 1 --2- 172.21.15.44:0/2444624465 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x56304e2d1930 0x56304e45b310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:45.906 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.913+0000 7f41e7e00640 1 --2- 172.21.15.44:0/2444624465 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x56304e2d8c10 0x56304e45b850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:45.906 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.913+0000 7f41e7400640 1 -- 172.21.15.44:0/2444624465 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x56304e2d1930 msgr2=0x56304e45b310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T19:47:45.906 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.913+0000 7f41e7400640 1 --2- 172.21.15.44:0/2444624465 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x56304e2d1930 0x56304e45b310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:45.906 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.913+0000 7f41e7400640 1 -- 172.21.15.44:0/2444624465 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x56304e2d8c10 msgr2=0x56304e45b850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T19:47:45.906 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.913+0000 7f41e7400640 1 --2- 172.21.15.44:0/2444624465 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x56304e2d8c10 0x56304e45b850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:45.906 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.913+0000 7f41e7400640 1 -- 172.21.15.44:0/2444624465 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56304e1e17e0 con 0x56304ded1280 2024-04-17T19:47:45.906 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.913+0000 7f41e7400640 1 --2- 172.21.15.44:0/2444624465 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56304ded1280 0x56304e45add0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f41d8003bd0 tx=0x7f41d8019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=27d0d2225de4cff7 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:47:45.906 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.913+0000 7f41d4c00640 10 client.0 ms_handle_connect on v2:172.21.15.44:3300/0 2024-04-17T19:47:45.906 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.913+0000 7f41d4c00640 1 -- 172.21.15.44:0/2444624465 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41d803c060 con 0x56304ded1280 2024-04-17T19:47:45.906 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.913+0000 7f41d4c00640 1 -- 172.21.15.44:0/2444624465 <== mon.0 v2:172.21.15.44:3300/0 2 ==== osd_map(27..27 src has 1..27) ==== 6619+0+0 (secure 0 0 0) 0x7f41d8037b70 con 0x56304ded1280 2024-04-17T19:47:45.906 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.913+0000 7f41f5e7a000 1 -- 172.21.15.44:0/2444624465 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f41d0027070 con 0x56304ded1280 2024-04-17T19:47:45.906 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.913+0000 7f41d4c00640 1 -- 172.21.15.44:0/2444624465 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_get_version_reply(handle=1 version=18) ==== 24+0+0 (secure 0 0 0) 0x7f41d8042050 con 0x56304ded1280 2024-04-17T19:47:45.906 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.913+0000 7f41f5e7a000 10 client.4938 fetch_fsmap learned FSMap version 18 2024-04-17T19:47:45.906 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.913+0000 7f41f5e7a000 1 -- 172.21.15.44:0/2444624465 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,fsmap=18,monmap=2+}) -- 0x56304e1f4670 con 0x56304ded1280 2024-04-17T19:47:45.907 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.913+0000 7f41d4c00640 1 -- 172.21.15.44:0/2444624465 <== mon.0 v2:172.21.15.44:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f41d0027070 con 0x56304ded1280 2024-04-17T19:47:45.907 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.913+0000 7f41d4c00640 1 -- 172.21.15.44:0/2444624465 <== mon.0 v2:172.21.15.44:3300/0 5 ==== fsmap(e 18) ==== 4792+0+0 (secure 0 0 0) 0x7f41d8045020 con 0x56304ded1280 2024-04-17T19:47:45.907 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.913+0000 7f41f5e7a000 10 client.4938 fetch_fsmap finished waiting for FSMap version 18 2024-04-17T19:47:45.907 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.913+0000 7f41f5e7a000 10 client.4938 resolve_mds: resolved name 'b' to daemon mds.b 2024-04-17T19:47:45.907 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.913+0000 7f41f5e7a000 20 client.4938 populate_metadata read hostname 'smithi044' 2024-04-17T19:47:45.907 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.913+0000 7f41f5e7a000 1 --2- 172.21.15.44:0/2444624465 >> [v2:172.21.15.62:6838/1537667111,v1:172.21.15.62:6839/1537667111] conn(0x56304dee3830 0x56304e45bd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:45.907 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.913+0000 7f41f5e7a000 4 client.4938 mds_command: new command op to 4306 tid=0 multi_id=0 [{"prefix": "status"}] 2024-04-17T19:47:45.907 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.913+0000 7f41f5e7a000 1 -- 172.21.15.44:0/2444624465 --> [v2:172.21.15.62:6838/1537667111,v1:172.21.15.62:6839/1537667111] -- command(tid 0: {"prefix": "status"}) -- 0x56304e25cf10 con 0x56304dee3830 2024-04-17T19:47:45.907 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.913+0000 7f41dea00640 1 --2- 172.21.15.44:0/2444624465 >> [v2:172.21.15.62:6838/1537667111,v1:172.21.15.62:6839/1537667111] conn(0x56304dee3830 0x56304e45bd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:45.908 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.913+0000 7f41dea00640 1 --2- 172.21.15.44:0/2444624465 >> [v2:172.21.15.62:6838/1537667111,v1:172.21.15.62:6839/1537667111] conn(0x56304dee3830 0x56304e45bd90 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=441e584637f2a2b4 server_cookie=3595372ed85fbad9 in_seq=0 out_seq=0 2024-04-17T19:47:45.909 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.913+0000 7f41d4c00640 10 client.4938 ms_handle_connect on v2:172.21.15.62:6838/1537667111 2024-04-17T19:47:45.909 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.913+0000 7f41d4c00640 1 -- 172.21.15.44:0/2444624465 <== mds.0 v2:172.21.15.62:6838/1537667111 1 ==== command_reply(tid 0: 0 ) ==== 8+0+331 (crc 0 0 0) 0x56304e25cf10 con 0x56304dee3830 2024-04-17T19:47:45.909 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.913+0000 7f41d4c00640 10 client.4938 handle_command_reply: tid=0 2024-04-17T19:47:45.909 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.913+0000 7f41f5e7a000 1 client.4938 shutdown 2024-04-17T19:47:45.909 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.913+0000 7f41f5e7a000 1 -- 172.21.15.44:0/2444624465 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56304ded1280 msgr2=0x56304e45add0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:45.909 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.913+0000 7f41f5e7a000 1 --2- 172.21.15.44:0/2444624465 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56304ded1280 0x56304e45add0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f41d8003bd0 tx=0x7f41d8019000 comp rx=0 tx=0).stop 2024-04-17T19:47:45.909 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.917+0000 7f41f5e7a000 1 -- 172.21.15.44:0/2444624465 shutdown_connections 2024-04-17T19:47:45.909 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.917+0000 7f41f5e7a000 1 --2- 172.21.15.44:0/2444624465 >> [v2:172.21.15.62:6838/1537667111,v1:172.21.15.62:6839/1537667111] conn(0x56304dee3830 0x56304e45bd90 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:45.909 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.917+0000 7f41f5e7a000 1 --2- 172.21.15.44:0/2444624465 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x56304e2d1930 0x56304e45b310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:45.909 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.917+0000 7f41f5e7a000 1 --2- 172.21.15.44:0/2444624465 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x56304e2d8c10 0x56304e45b850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:45.909 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.917+0000 7f41f5e7a000 1 --2- 172.21.15.44:0/2444624465 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56304ded1280 0x56304e45add0 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:45.909 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.917+0000 7f41f5e7a000 1 -- 172.21.15.44:0/2444624465 >> 172.21.15.44:0/2444624465 conn(0x56304e31a670 msgr2=0x56304e43a160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:47:45.909 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.917+0000 7f41d4c00640 0 client.4938 ms_handle_reset on v2:172.21.15.62:6838/1537667111 2024-04-17T19:47:45.910 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.917+0000 7f41f5e7a000 1 -- 172.21.15.44:0/2444624465 shutdown_connections 2024-04-17T19:47:45.910 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.917+0000 7f41f5e7a000 1 -- 172.21.15.44:0/2444624465 wait complete. 2024-04-17T19:47:45.910 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.917+0000 7f41f5e7a000 20 client.4938 trim_cache size 0 max 16384 2024-04-17T19:47:45.910 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2024-04-17T19:47:45.910 INFO:teuthology.orchestra.run.smithi044.stdout: "cluster_fsid": "703f77ca-79c6-4a66-b576-62c526cb1021", 2024-04-17T19:47:45.910 INFO:teuthology.orchestra.run.smithi044.stdout: "whoami": 0, 2024-04-17T19:47:45.910 INFO:teuthology.orchestra.run.smithi044.stdout: "id": 4306, 2024-04-17T19:47:45.910 INFO:teuthology.orchestra.run.smithi044.stdout: "want_state": "up:active", 2024-04-17T19:47:45.910 INFO:teuthology.orchestra.run.smithi044.stdout: "state": "up:active", 2024-04-17T19:47:45.910 INFO:teuthology.orchestra.run.smithi044.stdout: "fs_name": "cephfs", 2024-04-17T19:47:45.910 INFO:teuthology.orchestra.run.smithi044.stdout: "rank_uptime": 49.258763016000003, 2024-04-17T19:47:45.911 INFO:teuthology.orchestra.run.smithi044.stdout: "mdsmap_epoch": 18, 2024-04-17T19:47:45.911 INFO:teuthology.orchestra.run.smithi044.stdout: "osdmap_epoch": 27, 2024-04-17T19:47:45.911 INFO:teuthology.orchestra.run.smithi044.stdout: "osdmap_epoch_barrier": 27, 2024-04-17T19:47:45.911 INFO:teuthology.orchestra.run.smithi044.stdout: "uptime": 56.512511109999998 2024-04-17T19:47:45.911 INFO:teuthology.orchestra.run.smithi044.stdout:} 2024-04-17T19:47:45.911 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.917+0000 7f41ee800640 1 -- 172.21.15.44:0/3596400111 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f41c4068380 msgr2=0x7f41c406a890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:45.912 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.917+0000 7f41ee800640 1 --2- 172.21.15.44:0/3596400111 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f41c4068380 0x7f41c406a890 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f41d8009be0 tx=0x7f41d8009190 comp rx=0 tx=0).stop 2024-04-17T19:47:45.912 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.917+0000 7f41ee800640 1 -- 172.21.15.44:0/3596400111 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f41e81516b0 msgr2=0x7f41e8151ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:45.912 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.917+0000 7f41ee800640 1 --2- 172.21.15.44:0/3596400111 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f41e81516b0 0x7f41e8151ac0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f41e001cd20 tx=0x7f41cc005840 comp rx=0 tx=0).stop 2024-04-17T19:47:45.912 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.917+0000 7f41ee800640 1 -- 172.21.15.44:0/3596400111 shutdown_connections 2024-04-17T19:47:45.912 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.917+0000 7f41ee800640 1 --2- 172.21.15.44:0/3596400111 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f41c4068380 0x7f41c406a890 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:45.912 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.917+0000 7f41ee800640 1 --2- 172.21.15.44:0/3596400111 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f41e815e9f0 0x7f41e815ee00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:45.912 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.917+0000 7f41ee800640 1 --2- 172.21.15.44:0/3596400111 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f41e81516b0 0x7f41e8151ac0 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:45.912 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.917+0000 7f41ee800640 1 --2- 172.21.15.44:0/3596400111 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f41e80b3c30 0x7f41e8070900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:45.912 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.917+0000 7f41ee800640 1 -- 172.21.15.44:0/3596400111 >> 172.21.15.44:0/3596400111 conn(0x7f41e80722e0 msgr2=0x7f41e8153760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:47:45.912 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.917+0000 7f41ee800640 1 -- 172.21.15.44:0/3596400111 shutdown_connections 2024-04-17T19:47:45.912 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:45.917+0000 7f41ee800640 1 -- 172.21.15.44:0/3596400111 wait complete. 2024-04-17T19:47:45.927 INFO:teuthology.run_tasks:Running task sequential... 2024-04-17T19:47:45.936 INFO:teuthology.task.sequential:In sequential, running task sequential... 2024-04-17T19:47:45.937 INFO:teuthology.task.sequential:In sequential, running task print... 2024-04-17T19:47:45.937 INFO:teuthology.task.print:Enabling mgr modules 2024-04-17T19:47:45.937 INFO:teuthology.run_tasks:Running task kclient... 2024-04-17T19:47:45.954 INFO:tasks.kclient:Mounting kernel clients... 2024-04-17T19:47:45.954 INFO:tasks.kclient:config is {'client.0': {}} 2024-04-17T19:47:45.954 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-17T19:47:45.954 DEBUG:teuthology.orchestra.run.smithi044:> ip netns list 2024-04-17T19:47:45.963 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-ns--home-ubuntu-cephtest-mnt.admin (id: 0) 2024-04-17T19:47:45.964 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-17T19:47:45.964 DEBUG:teuthology.orchestra.run.smithi044:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-04-17T19:47:46.027 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-17T19:47:46.027 DEBUG:teuthology.orchestra.run.smithi044:> sudo ip link delete ceph-brx 2024-04-17T19:47:46.181 INFO:tasks.kclient:client.0 config is {'syntax': 'v2'} 2024-04-17T19:47:46.181 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-04-17T19:47:46.181 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-04-17T19:47:46.181 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-04-17T19:47:46.333 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:46.341+0000 7feacc600640 1 Processor -- start 2024-04-17T19:47:46.333 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:46.341+0000 7feacc600640 1 -- start start 2024-04-17T19:47:46.335 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:46.345+0000 7feacc600640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7feac40c73f0 0x7feac40c6ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:46.335 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:46.345+0000 7feacc600640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7feac40c6060 con 0x7feac4157f10 2024-04-17T19:47:46.335 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:46.345+0000 7feacc600640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7feac4158320 con 0x7feac4073ca0 2024-04-17T19:47:46.335 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:46.345+0000 7feacc600640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 -- 0x7feac40c4aa0 con 0x7feac40c73f0 2024-04-17T19:47:46.335 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:46.345+0000 7feaca600640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7feac4157f10 0x7feac40c9430 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:46886/0 (socket says 172.21.15.44:46886) 2024-04-17T19:47:46.335 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:46.345+0000 7feaca600640 1 -- 172.21.15.44:0/2371751272 learned_addr learned my addr 172.21.15.44:0/2371751272 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-04-17T19:47:46.335 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:46.345+0000 7feac9200640 1 --2- 172.21.15.44:0/2371751272 >> v2:172.21.15.62:3300/0 conn(0x7feac40c73f0 0x7feac40c6ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:46.337 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:46.345+0000 7feac3e00640 1 -- 172.21.15.44:0/2371751272 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1064207621 0 0) 0x7feac40c6060 con 0x7feac4157f10 2024-04-17T19:47:46.337 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:46.345+0000 7feac3e00640 1 -- 172.21.15.44:0/2371751272 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7feaac003450 con 0x7feac4157f10 2024-04-17T19:47:46.337 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:46.345+0000 7feac3e00640 1 -- 172.21.15.44:0/2371751272 <== mon.1 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2051268563 0 0) 0x7feac4158320 con 0x7feac4073ca0 2024-04-17T19:47:46.337 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:46.345+0000 7feac3e00640 1 -- 172.21.15.44:0/2371751272 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7feac40c6060 con 0x7feac4073ca0 2024-04-17T19:47:46.337 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:46.345+0000 7feac3e00640 1 -- 172.21.15.44:0/2371751272 <== mon.0 v1:172.21.15.44:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3322963428 0 0) 0x7feaac003450 con 0x7feac4157f10 2024-04-17T19:47:46.337 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:46.345+0000 7feac3e00640 1 -- 172.21.15.44:0/2371751272 >> v2:172.21.15.62:3300/0 conn(0x7feac40c73f0 msgr2=0x7feac40c6ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T19:47:46.338 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:46.345+0000 7feac3e00640 1 --2- 172.21.15.44:0/2371751272 >> v2:172.21.15.62:3300/0 conn(0x7feac40c73f0 0x7feac40c6ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:46.338 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:46.345+0000 7feac3e00640 1 -- 172.21.15.44:0/2371751272 >> v1:172.21.15.62:6789/0 conn(0x7feac4073ca0 legacy=0x7feac41520c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:46.338 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:46.345+0000 7feac3e00640 1 -- 172.21.15.44:0/2371751272 --> v1:172.21.15.44:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feac40c79c0 con 0x7feac4157f10 2024-04-17T19:47:46.338 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:46.345+0000 7feac3e00640 1 -- 172.21.15.44:0/2371751272 <== mon.0 v1:172.21.15.44:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1863569991 0 0) 0x7feabc001680 con 0x7feac4157f10 2024-04-17T19:47:46.338 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:46.345+0000 7feac3e00640 1 -- 172.21.15.44:0/2371751272 >> v1:172.21.15.44:6789/0 conn(0x7feac4157f10 legacy=0x7feac40c9430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:46.338 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:46.345+0000 7feac3e00640 1 --2- 172.21.15.44:0/2371751272 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7feaac003c90 0x7feaac008860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:46.338 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:46.345+0000 7feac3e00640 1 --2- 172.21.15.44:0/2371751272 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7feaac008da0 0x7feaac00b1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:46.338 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:46.345+0000 7feac3e00640 1 --2- 172.21.15.44:0/2371751272 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7feaac00b700 0x7feaac00db20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:46.338 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:46.345+0000 7feac3e00640 1 -- 172.21.15.44:0/2371751272 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7feaac00e360 con 0x7feaac003c90 2024-04-17T19:47:46.338 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:46.345+0000 7feac3e00640 1 -- 172.21.15.44:0/2371751272 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7feaac00e510 con 0x7feaac00b700 2024-04-17T19:47:46.338 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:46.345+0000 7feac3e00640 1 -- 172.21.15.44:0/2371751272 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7feaac00e710 con 0x7feaac008da0 2024-04-17T19:47:46.338 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:46.345+0000 7feac9c00640 1 --2- 172.21.15.44:0/2371751272 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7feaac003c90 0x7feaac008860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:46.338 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:46.345+0000 7feac9200640 1 --2- 172.21.15.44:0/2371751272 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7feaac008da0 0x7feaac00b1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:46.338 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:46.345+0000 7feaca600640 1 --2- 172.21.15.44:0/2371751272 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7feaac00b700 0x7feaac00db20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:46.339 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:46.345+0000 7feac9c00640 1 -- 172.21.15.44:0/2371751272 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7feaac008da0 msgr2=0x7feaac00b1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T19:47:46.339 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:46.345+0000 7feac9c00640 1 --2- 172.21.15.44:0/2371751272 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7feaac008da0 0x7feaac00b1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:46.339 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:46.345+0000 7feac9c00640 1 -- 172.21.15.44:0/2371751272 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7feaac00b700 msgr2=0x7feaac00db20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T19:47:46.339 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:46.345+0000 7feac9c00640 1 --2- 172.21.15.44:0/2371751272 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7feaac00b700 0x7feaac00db20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:46.339 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:46.345+0000 7feac9c00640 1 -- 172.21.15.44:0/2371751272 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feaac003450 con 0x7feaac003c90 2024-04-17T19:47:46.339 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:46.345+0000 7feaca600640 1 -- 172.21.15.44:0/2371751272 reap_dead start 2024-04-17T19:47:46.339 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:46.349+0000 7feac9c00640 1 --2- 172.21.15.44:0/2371751272 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7feaac003c90 0x7feaac008860 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7feab8001fd0 tx=0x7feab801c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8a4b55b886a68a3b server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:47:46.340 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:46.349+0000 7feac3e00640 1 -- 172.21.15.44:0/2371751272 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feab8001c20 con 0x7feaac003c90 2024-04-17T19:47:46.340 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:46.349+0000 7feac3e00640 1 -- 172.21.15.44:0/2371751272 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feab8003ba0 con 0x7feaac003c90 2024-04-17T19:47:46.340 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:46.349+0000 7feac3e00640 1 -- 172.21.15.44:0/2371751272 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feab80050d0 con 0x7feaac003c90 2024-04-17T19:47:46.340 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:46.349+0000 7feacc600640 1 -- 172.21.15.44:0/2371751272 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7feaac003c90 msgr2=0x7feaac008860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:46.340 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:46.349+0000 7feacc600640 1 --2- 172.21.15.44:0/2371751272 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7feaac003c90 0x7feaac008860 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7feab8001fd0 tx=0x7feab801c8e0 comp rx=0 tx=0).stop 2024-04-17T19:47:46.340 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:46.349+0000 7feacc600640 1 -- 172.21.15.44:0/2371751272 shutdown_connections 2024-04-17T19:47:46.341 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:46.349+0000 7feacc600640 1 --2- 172.21.15.44:0/2371751272 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7feaac003c90 0x7feaac008860 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:46.341 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:46.349+0000 7feacc600640 1 -- 172.21.15.44:0/2371751272 >> 172.21.15.44:0/2371751272 conn(0x7feac406c380 msgr2=0x7feac4070080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:47:46.341 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:46.349+0000 7feacc600640 1 -- 172.21.15.44:0/2371751272 shutdown_connections 2024-04-17T19:47:46.341 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:46.349+0000 7feacc600640 1 -- 172.21.15.44:0/2371751272 wait complete. 2024-04-17T19:47:46.343 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:46.353+0000 7feacc600640 1 Processor -- start 2024-04-17T19:47:46.343 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:46.353+0000 7feacc600640 1 -- start start 2024-04-17T19:47:46.345 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:46.353+0000 7feacc600640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7feaac003c90 0x7feac415ae50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:46.345 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:46.353+0000 7feacc600640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7feac41f89b0 0x7feac414ef90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:46.346 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:46.353+0000 7feacc600640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7feac414f7f0 0x7feac4155d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:46.346 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:46.353+0000 7feacc600640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7feac41524d0 con 0x7feaac003c90 2024-04-17T19:47:46.346 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:46.353+0000 7feacc600640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7feac40c6ee0 con 0x7feac414f7f0 2024-04-17T19:47:46.346 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:46.353+0000 7feacc600640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7feac4152650 con 0x7feac41f89b0 2024-04-17T19:47:46.346 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:46.353+0000 7feac9c00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7feaac003c90 0x7feac415ae50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:46.346 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:46.353+0000 7feac9c00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7feaac003c90 0x7feac415ae50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:34376/0 (socket says 172.21.15.44:34376) 2024-04-17T19:47:46.346 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:46.353+0000 7feac9c00640 1 -- 172.21.15.44:0/3290449001 learned_addr learned my addr 172.21.15.44:0/3290449001 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-04-17T19:47:46.346 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:46.353+0000 7feac9200640 1 --2- 172.21.15.44:0/3290449001 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7feac41f89b0 0x7feac414ef90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:46.346 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:46.353+0000 7feaca600640 1 --2- 172.21.15.44:0/3290449001 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7feac414f7f0 0x7feac4155d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:46.346 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:46.353+0000 7feac9c00640 1 -- 172.21.15.44:0/3290449001 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7feac41f89b0 msgr2=0x7feac414ef90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:46.346 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:46.353+0000 7feac9c00640 1 --2- 172.21.15.44:0/3290449001 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7feac41f89b0 0x7feac414ef90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:46.346 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:46.353+0000 7feac9c00640 1 -- 172.21.15.44:0/3290449001 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7feac414f7f0 msgr2=0x7feac4155d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:46.346 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:46.353+0000 7feac9c00640 1 --2- 172.21.15.44:0/3290449001 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7feac414f7f0 0x7feac4155d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:46.346 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:46.353+0000 7feac9c00640 1 -- 172.21.15.44:0/3290449001 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feac415bdd0 con 0x7feaac003c90 2024-04-17T19:47:46.347 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:46.353+0000 7feac9200640 1 --2- 172.21.15.44:0/3290449001 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7feac41f89b0 0x7feac414ef90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-17T19:47:46.347 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:46.353+0000 7feac9c00640 1 --2- 172.21.15.44:0/3290449001 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7feaac003c90 0x7feac415ae50 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7feab8005040 tx=0x7feaac003740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:47:46.347 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:46.353+0000 7feac1600640 1 -- 172.21.15.44:0/3290449001 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feab8003a00 con 0x7feaac003c90 2024-04-17T19:47:46.347 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:46.353+0000 7feac1600640 1 -- 172.21.15.44:0/3290449001 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feab8003d50 con 0x7feaac003c90 2024-04-17T19:47:46.347 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:46.353+0000 7feac1600640 1 -- 172.21.15.44:0/3290449001 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feab8006d80 con 0x7feaac003c90 2024-04-17T19:47:46.347 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:46.353+0000 7feacc600640 1 -- 172.21.15.44:0/3290449001 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feac415c0b0 con 0x7feaac003c90 2024-04-17T19:47:46.347 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:46.353+0000 7feacc600640 1 -- 172.21.15.44:0/3290449001 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feac41e9910 con 0x7feaac003c90 2024-04-17T19:47:46.347 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:46.353+0000 7feacc600640 1 -- 172.21.15.44:0/3290449001 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7feac404ff10 con 0x7feaac003c90 2024-04-17T19:47:46.347 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:46.357+0000 7feac1600640 1 -- 172.21.15.44:0/3290449001 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7feab80050d0 con 0x7feaac003c90 2024-04-17T19:47:46.349 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:46.357+0000 7feac1600640 1 --2- 172.21.15.44:0/3290449001 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7feaa40683b0 0x7feaa406a8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:46.349 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:46.357+0000 7feac1600640 1 -- 172.21.15.44:0/3290449001 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6619+0+0 (secure 0 0 0) 0x7feab81204e0 con 0x7feaac003c90 2024-04-17T19:47:46.349 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:46.357+0000 7feac9200640 1 --2- 172.21.15.44:0/3290449001 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7feaa40683b0 0x7feaa406a8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:46.350 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:46.357+0000 7feac9200640 1 --2- 172.21.15.44:0/3290449001 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7feaa40683b0 0x7feaa406a8c0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7feac40c5750 tx=0x7feab0008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:47:46.353 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:46.361+0000 7feac1600640 1 -- 172.21.15.44:0/3290449001 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7feab80165f0 con 0x7feaac003c90 2024-04-17T19:47:46.558 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:46.565+0000 7feacc600640 1 -- 172.21.15.44:0/3290449001 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7feac4155930 con 0x7feaac003c90 2024-04-17T19:47:46.558 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:46.565+0000 7feac1600640 1 -- 172.21.15.44:0/3290449001 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v18) ==== 53+0+88 (secure 0 0 0) 0x7feab80f0700 con 0x7feaac003c90 2024-04-17T19:47:46.559 INFO:teuthology.orchestra.run.smithi044.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2024-04-17T19:47:46.560 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:46.569+0000 7feacc600640 1 -- 172.21.15.44:0/3290449001 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7feaa40683b0 msgr2=0x7feaa406a8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:46.561 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:46.569+0000 7feacc600640 1 --2- 172.21.15.44:0/3290449001 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7feaa40683b0 0x7feaa406a8c0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7feac40c5750 tx=0x7feab0008040 comp rx=0 tx=0).stop 2024-04-17T19:47:46.561 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:46.569+0000 7feacc600640 1 -- 172.21.15.44:0/3290449001 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7feaac003c90 msgr2=0x7feac415ae50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:46.561 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:46.569+0000 7feacc600640 1 --2- 172.21.15.44:0/3290449001 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7feaac003c90 0x7feac415ae50 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7feab8005040 tx=0x7feaac003740 comp rx=0 tx=0).stop 2024-04-17T19:47:46.561 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:46.569+0000 7feacc600640 1 -- 172.21.15.44:0/3290449001 shutdown_connections 2024-04-17T19:47:46.561 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:46.569+0000 7feacc600640 1 --2- 172.21.15.44:0/3290449001 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7feaa40683b0 0x7feaa406a8c0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:46.561 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:46.569+0000 7feacc600640 1 --2- 172.21.15.44:0/3290449001 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7feac41f89b0 0x7feac414ef90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:46.561 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:46.569+0000 7feacc600640 1 --2- 172.21.15.44:0/3290449001 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7feac414f7f0 0x7feac4155d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:46.561 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:46.569+0000 7feacc600640 1 --2- 172.21.15.44:0/3290449001 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7feaac003c90 0x7feac415ae50 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:46.561 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:46.569+0000 7feacc600640 1 -- 172.21.15.44:0/3290449001 >> 172.21.15.44:0/3290449001 conn(0x7feac406c380 msgr2=0x7feac41ea990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:47:46.561 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:46.569+0000 7feacc600640 1 -- 172.21.15.44:0/3290449001 shutdown_connections 2024-04-17T19:47:46.561 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:46.569+0000 7feacc600640 1 -- 172.21.15.44:0/3290449001 wait complete. 2024-04-17T19:47:46.580 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-04-17T19:47:46.580 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-04-17T19:47:46.580 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi044.front.sepia.ceph.com 2024-04-17T19:47:46.580 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-04-17T19:47:46.580 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-04-17T19:47:46.580 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-04-17T19:47:46.580 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-04-17T19:47:46.580 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-04-17T19:47:46.581 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2024-04-17T19:47:46.581 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-17T19:47:46.581 DEBUG:teuthology.orchestra.run.smithi044:> ip addr 2024-04-17T19:47:46.590 INFO:teuthology.orchestra.run.smithi044.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-17T19:47:46.590 INFO:teuthology.orchestra.run.smithi044.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-17T19:47:46.590 INFO:teuthology.orchestra.run.smithi044.stdout: inet 127.0.0.1/8 scope host lo 2024-04-17T19:47:46.590 INFO:teuthology.orchestra.run.smithi044.stdout: valid_lft forever preferred_lft forever 2024-04-17T19:47:46.590 INFO:teuthology.orchestra.run.smithi044.stdout: inet6 ::1/128 scope host 2024-04-17T19:47:46.590 INFO:teuthology.orchestra.run.smithi044.stdout: valid_lft forever preferred_lft forever 2024-04-17T19:47:46.590 INFO:teuthology.orchestra.run.smithi044.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-17T19:47:46.590 INFO:teuthology.orchestra.run.smithi044.stdout: link/ether 0c:c4:7a:6b:f7:8c brd ff:ff:ff:ff:ff:ff 2024-04-17T19:47:46.590 INFO:teuthology.orchestra.run.smithi044.stdout: altname enp7s0f0 2024-04-17T19:47:46.590 INFO:teuthology.orchestra.run.smithi044.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-17T19:47:46.590 INFO:teuthology.orchestra.run.smithi044.stdout: link/ether 0c:c4:7a:6b:f7:8d brd ff:ff:ff:ff:ff:ff 2024-04-17T19:47:46.591 INFO:teuthology.orchestra.run.smithi044.stdout: altname enp7s0f1 2024-04-17T19:47:46.591 INFO:teuthology.orchestra.run.smithi044.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-04-17T19:47:46.591 INFO:teuthology.orchestra.run.smithi044.stdout: link/ether 0c:c4:7a:bd:15:72 brd ff:ff:ff:ff:ff:ff 2024-04-17T19:47:46.591 INFO:teuthology.orchestra.run.smithi044.stdout: altname enp1s0f0 2024-04-17T19:47:46.591 INFO:teuthology.orchestra.run.smithi044.stdout: inet 172.21.15.44/20 brd 172.21.15.255 scope global dynamic ens1f0 2024-04-17T19:47:46.591 INFO:teuthology.orchestra.run.smithi044.stdout: valid_lft 42376sec preferred_lft 42376sec 2024-04-17T19:47:46.591 INFO:teuthology.orchestra.run.smithi044.stdout: inet6 fe80::ec4:7aff:febd:1572/64 scope link 2024-04-17T19:47:46.591 INFO:teuthology.orchestra.run.smithi044.stdout: valid_lft forever preferred_lft forever 2024-04-17T19:47:46.591 INFO:teuthology.orchestra.run.smithi044.stdout:5: ens1f1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-17T19:47:46.591 INFO:teuthology.orchestra.run.smithi044.stdout: link/ether 0c:c4:7a:bd:15:73 brd ff:ff:ff:ff:ff:ff 2024-04-17T19:47:46.591 INFO:teuthology.orchestra.run.smithi044.stdout: altname enp1s0f1 2024-04-17T19:47:46.591 INFO:teuthology.orchestra.run.smithi044.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-04-17T19:47:46.591 INFO:teuthology.orchestra.run.smithi044.stdout: link/ether 02:42:b8:20:f4:9e brd ff:ff:ff:ff:ff:ff 2024-04-17T19:47:46.591 INFO:teuthology.orchestra.run.smithi044.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-04-17T19:47:46.591 INFO:teuthology.orchestra.run.smithi044.stdout: valid_lft forever preferred_lft forever 2024-04-17T19:47:46.592 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-04-17T19:47:46.592 DEBUG:teuthology.orchestra.run.smithi044:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-17T19:47:46.592 DEBUG:teuthology.orchestra.run.smithi044:> set -e 2024-04-17T19:47:46.593 DEBUG:teuthology.orchestra.run.smithi044:> sudo ip link add name ceph-brx type bridge 2024-04-17T19:47:46.593 DEBUG:teuthology.orchestra.run.smithi044:> sudo ip addr flush dev ceph-brx 2024-04-17T19:47:46.593 DEBUG:teuthology.orchestra.run.smithi044:> sudo ip link set ceph-brx up 2024-04-17T19:47:46.593 DEBUG:teuthology.orchestra.run.smithi044:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-04-17T19:47:46.593 DEBUG:teuthology.orchestra.run.smithi044:> ') 2024-04-17T19:47:46.685 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:46 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-17T19:47:46.746 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:46 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-17T19:47:46.753 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-17T19:47:46.753 DEBUG:teuthology.orchestra.run.smithi044:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-04-17T19:47:46.772 INFO:teuthology.orchestra.run.smithi044.stdout:1 2024-04-17T19:47:46.774 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-17T19:47:46.774 DEBUG:teuthology.orchestra.run.smithi044:> route 2024-04-17T19:47:46.827 INFO:teuthology.orchestra.run.smithi044.stdout:Kernel IP routing table 2024-04-17T19:47:46.827 INFO:teuthology.orchestra.run.smithi044.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-04-17T19:47:46.827 INFO:teuthology.orchestra.run.smithi044.stdout:default _gateway 0.0.0.0 UG 0 0 0 ens1f0 2024-04-17T19:47:46.827 INFO:teuthology.orchestra.run.smithi044.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-04-17T19:47:46.827 INFO:teuthology.orchestra.run.smithi044.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 ens1f0 2024-04-17T19:47:46.827 INFO:teuthology.orchestra.run.smithi044.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-04-17T19:47:46.828 DEBUG:teuthology.orchestra.run.smithi044:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-17T19:47:46.828 DEBUG:teuthology.orchestra.run.smithi044:> set -e 2024-04-17T19:47:46.828 DEBUG:teuthology.orchestra.run.smithi044:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-04-17T19:47:46.828 DEBUG:teuthology.orchestra.run.smithi044:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-04-17T19:47:46.828 DEBUG:teuthology.orchestra.run.smithi044:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-04-17T19:47:46.828 DEBUG:teuthology.orchestra.run.smithi044:> ') 2024-04-17T19:47:46.917 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:46 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-17T19:47:46.959 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:46 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-17T19:47:46.967 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-17T19:47:46.967 DEBUG:teuthology.orchestra.run.smithi044:> ip netns list 2024-04-17T19:47:46.976 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-17T19:47:46.977 DEBUG:teuthology.orchestra.run.smithi044:> ip netns list-id 2024-04-17T19:47:47.031 DEBUG:teuthology.orchestra.run.smithi044:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-17T19:47:47.031 DEBUG:teuthology.orchestra.run.smithi044:> set -e 2024-04-17T19:47:47.031 DEBUG:teuthology.orchestra.run.smithi044:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-17T19:47:47.031 DEBUG:teuthology.orchestra.run.smithi044:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2024-04-17T19:47:47.031 DEBUG:teuthology.orchestra.run.smithi044:> ') 2024-04-17T19:47:47.121 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:47 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-17T19:47:47.152 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:47 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-17T19:47:47.159 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2024-04-17T19:47:47.159 DEBUG:teuthology.orchestra.run.smithi044:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-17T19:47:47.159 DEBUG:teuthology.orchestra.run.smithi044:> set -e 2024-04-17T19:47:47.159 DEBUG:teuthology.orchestra.run.smithi044:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2024-04-17T19:47:47.159 DEBUG:teuthology.orchestra.run.smithi044:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-04-17T19:47:47.159 DEBUG:teuthology.orchestra.run.smithi044:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2024-04-17T19:47:47.159 DEBUG:teuthology.orchestra.run.smithi044:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2024-04-17T19:47:47.159 DEBUG:teuthology.orchestra.run.smithi044:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2024-04-17T19:47:47.160 DEBUG:teuthology.orchestra.run.smithi044:> ') 2024-04-17T19:47:47.208 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:47 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-17T19:47:47.297 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:47 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-17T19:47:47.304 DEBUG:teuthology.orchestra.run.smithi044:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-17T19:47:47.304 DEBUG:teuthology.orchestra.run.smithi044:> set -e 2024-04-17T19:47:47.304 DEBUG:teuthology.orchestra.run.smithi044:> sudo ip link set brx.0 up 2024-04-17T19:47:47.304 DEBUG:teuthology.orchestra.run.smithi044:> sudo ip link set dev brx.0 master ceph-brx 2024-04-17T19:47:47.304 DEBUG:teuthology.orchestra.run.smithi044:> ') 2024-04-17T19:47:47.398 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:47 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-17T19:47:47.429 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:47 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-17T19:47:47.435 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-17T19:47:47.435 DEBUG:teuthology.orchestra.run.smithi044:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-04-17T19:47:47.493 INFO:teuthology.orchestra.run.smithi044.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-04-17T19:47:47.493 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-17T19:47:47.494 DEBUG:teuthology.orchestra.run.smithi044:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-04-17T19:47:47.542 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2024-04-17T19:47:47.542 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-17T19:47:47.542 DEBUG:teuthology.orchestra.run.smithi044:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-04-17T19:47:47.647 INFO:teuthology.orchestra.run.smithi044.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-04-17T19:47:47.647 INFO:teuthology.orchestra.run.smithi044.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-04-17T19:47:48.259 INFO:teuthology.orchestra.run.smithi044.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-04-17T19:47:48.259 INFO:teuthology.orchestra.run.smithi044.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-04-17T19:47:48.259 INFO:teuthology.orchestra.run.smithi044.stdout:mount.ceph: resolved to: "172.21.15.44:3300,172.21.15.62:3300,172.21.15.62:3301" 2024-04-17T19:47:48.259 INFO:teuthology.orchestra.run.smithi044.stdout:mount.ceph: trying mount with new device syntax: 0@703f77ca-79c6-4a66-b576-62c526cb1021.cephfs=/ 2024-04-17T19:47:48.259 INFO:teuthology.orchestra.run.smithi044.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.44:3300/172.21.15.62:3300/172.21.15.62:3301" will pass to kernel 2024-04-17T19:47:48.263 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-04-17T19:47:48.263 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-17T19:47:48.263 DEBUG:teuthology.orchestra.run.smithi044:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-04-17T19:47:48.284 DEBUG:teuthology.orchestra.run.smithi044:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-17T19:47:48.383 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:48 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-04-17T19:47:48.388 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:48 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-17T19:47:48.395 INFO:teuthology.orchestra.run.smithi044.stdout:client4947 2024-04-17T19:47:48.395 DEBUG:teuthology.orchestra.run.smithi044:> set -ex 2024-04-17T19:47:48.395 DEBUG:teuthology.orchestra.run.smithi044:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-17T19:47:48.404 DEBUG:teuthology.orchestra.run.smithi044:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-17T19:47:48.498 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:48 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-04-17T19:47:48.502 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:48 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-17T19:47:48.509 INFO:teuthology.orchestra.run.smithi044.stdout:client4947 2024-04-17T19:47:48.509 DEBUG:teuthology.orchestra.run.smithi044:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-17T19:47:48.557 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:48 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-04-17T19:47:48.562 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:48 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-17T19:47:48.568 INFO:teuthology.orchestra.run.smithi044.stdout:client4947 2024-04-17T19:47:48.569 DEBUG:teuthology.orchestra.run.smithi044:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=300 -- bash -c 'sudo dd if=/sys/kernel/debug/ceph/703f77ca-79c6-4a66-b576-62c526cb1021.client4947/status') 2024-04-17T19:47:48.658 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:48 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-17T19:47:48.670 INFO:teuthology.orchestra.run.smithi044.stdout:instance: client.4947 (3)192.168.0.1:0/70704939 2024-04-17T19:47:48.670 INFO:teuthology.orchestra.run.smithi044.stdout:blocklisted: false 2024-04-17T19:47:48.670 INFO:teuthology.orchestra.run.smithi044.stderr:0+1 records in 2024-04-17T19:47:48.670 INFO:teuthology.orchestra.run.smithi044.stderr:0+1 records out 2024-04-17T19:47:48.671 INFO:teuthology.orchestra.run.smithi044.stderr:67 bytes copied, 5.2048e-05 s, 1.3 MB/s 2024-04-17T19:47:48.671 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:48 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-17T19:47:48.679 INFO:teuthology.run_tasks:Running task mon_thrash... 2024-04-17T19:47:48.692 INFO:tasks.mon_thrash:Beginning mon_thrash... 2024-04-17T19:47:48.692 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-17T19:47:48.849 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:48.857+0000 7fce3c400640 1 Processor -- start 2024-04-17T19:47:48.850 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:48.857+0000 7fce3c400640 1 -- start start 2024-04-17T19:47:48.851 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:48.857+0000 7fce3c400640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fce34152a60 0x7fce340c6920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:48.851 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:48.857+0000 7fce3c400640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fce34158eb0 0x7fce341592c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:48.851 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:48.857+0000 7fce3c400640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fce34152e70 con 0x7fce340c47c0 2024-04-17T19:47:48.851 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:48.857+0000 7fce3c400640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 -- 0x7fce340c52c0 con 0x7fce34152a60 2024-04-17T19:47:48.851 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:48.857+0000 7fce3c400640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7fce340c8840 con 0x7fce34158eb0 2024-04-17T19:47:48.852 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:48.857+0000 7fce39a00640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fce34152a60 0x7fce340c6920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:48.852 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:48.857+0000 7fce39a00640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fce34152a60 0x7fce340c6920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:34390/0 (socket says 172.21.15.44:34390) 2024-04-17T19:47:48.852 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:48.857+0000 7fce39a00640 1 -- 172.21.15.44:0/160467949 learned_addr learned my addr 172.21.15.44:0/160467949 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-04-17T19:47:48.852 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:48.861+0000 7fce39000640 1 --2- 172.21.15.44:0/160467949 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fce34158eb0 0x7fce341592c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:48.852 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:48.861+0000 7fce39a00640 1 -- 172.21.15.44:0/160467949 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fce34158eb0 msgr2=0x7fce341592c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T19:47:48.852 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:48.861+0000 7fce39a00640 1 --2- 172.21.15.44:0/160467949 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fce34158eb0 0x7fce341592c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:48.852 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:48.861+0000 7fce39a00640 1 -- 172.21.15.44:0/160467949 >> v1:172.21.15.62:6789/0 conn(0x7fce340c47c0 legacy=0x7fce3415bd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:48.852 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:48.861+0000 7fce39a00640 1 -- 172.21.15.44:0/160467949 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fce340c8b20 con 0x7fce34152a60 2024-04-17T19:47:48.854 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:48.861+0000 7fce39a00640 1 --2- 172.21.15.44:0/160467949 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fce34152a60 0x7fce340c6920 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fce34153040 tx=0x7fce2801ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c4013e0c4b1f6d02 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:47:48.854 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:48.861+0000 7fce33e00640 1 -- 172.21.15.44:0/160467949 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce280b5070 con 0x7fce34152a60 2024-04-17T19:47:48.854 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:48.861+0000 7fce33e00640 1 -- 172.21.15.44:0/160467949 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fce280a8a30 con 0x7fce34152a60 2024-04-17T19:47:48.854 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:48.861+0000 7fce33e00640 1 -- 172.21.15.44:0/160467949 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce280a8e00 con 0x7fce34152a60 2024-04-17T19:47:48.855 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:48.865+0000 7fce3c400640 1 -- 172.21.15.44:0/160467949 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fce34152a60 msgr2=0x7fce340c6920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:48.855 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:48.865+0000 7fce3c400640 1 --2- 172.21.15.44:0/160467949 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fce34152a60 0x7fce340c6920 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fce34153040 tx=0x7fce2801ed30 comp rx=0 tx=0).stop 2024-04-17T19:47:48.855 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:48.865+0000 7fce3c400640 1 -- 172.21.15.44:0/160467949 shutdown_connections 2024-04-17T19:47:48.855 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:48.865+0000 7fce3c400640 1 --2- 172.21.15.44:0/160467949 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fce34158eb0 0x7fce341592c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:48.855 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:48.865+0000 7fce3c400640 1 --2- 172.21.15.44:0/160467949 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fce34152a60 0x7fce340c6920 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:48.855 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:48.865+0000 7fce3c400640 1 -- 172.21.15.44:0/160467949 >> 172.21.15.44:0/160467949 conn(0x7fce3406c380 msgr2=0x7fce34070080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:47:48.855 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:48.865+0000 7fce3c400640 1 -- 172.21.15.44:0/160467949 shutdown_connections 2024-04-17T19:47:48.856 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:48.865+0000 7fce3c400640 1 -- 172.21.15.44:0/160467949 wait complete. 2024-04-17T19:47:48.857 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:48.865+0000 7fce3c400640 1 Processor -- start 2024-04-17T19:47:48.857 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:48.865+0000 7fce3c400640 1 -- start start 2024-04-17T19:47:48.860 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:48.869+0000 7fce3c400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fce340c47c0 0x7fce341f00e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:48.860 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:48.869+0000 7fce3c400640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fce34152a60 0x7fce341459a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:48.860 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:48.869+0000 7fce3c400640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fce34158eb0 0x7fce34145ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:48.860 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:48.869+0000 7fce3c400640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fce34158990 con 0x7fce340c47c0 2024-04-17T19:47:48.860 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:48.869+0000 7fce3c400640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7fce340c90e0 con 0x7fce34152a60 2024-04-17T19:47:48.860 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:48.869+0000 7fce3c400640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7fce340c6e60 con 0x7fce34158eb0 2024-04-17T19:47:48.860 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:48.869+0000 7fce39a00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fce340c47c0 0x7fce341f00e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:48.860 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:48.869+0000 7fce39a00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fce340c47c0 0x7fce341f00e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:34392/0 (socket says 172.21.15.44:34392) 2024-04-17T19:47:48.860 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:48.869+0000 7fce39a00640 1 -- 172.21.15.44:0/1037775713 learned_addr learned my addr 172.21.15.44:0/1037775713 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-04-17T19:47:48.860 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:48.869+0000 7fce39000640 1 --2- 172.21.15.44:0/1037775713 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fce34152a60 0x7fce341459a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:48.860 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:48.869+0000 7fce3a400640 1 --2- 172.21.15.44:0/1037775713 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fce34158eb0 0x7fce34145ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:48.860 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:48.869+0000 7fce39a00640 1 -- 172.21.15.44:0/1037775713 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fce34158eb0 msgr2=0x7fce34145ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:48.861 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:48.869+0000 7fce39a00640 1 --2- 172.21.15.44:0/1037775713 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fce34158eb0 0x7fce34145ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:48.861 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:48.869+0000 7fce39a00640 1 -- 172.21.15.44:0/1037775713 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fce34152a60 msgr2=0x7fce341459a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:48.861 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:48.869+0000 7fce39a00640 1 --2- 172.21.15.44:0/1037775713 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fce34152a60 0x7fce341459a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:48.861 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:48.869+0000 7fce39a00640 1 -- 172.21.15.44:0/1037775713 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fce341598f0 con 0x7fce340c47c0 2024-04-17T19:47:48.861 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:48.869+0000 7fce39000640 1 --2- 172.21.15.44:0/1037775713 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fce34152a60 0x7fce341459a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-17T19:47:48.861 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:48.869+0000 7fce39a00640 1 --2- 172.21.15.44:0/1037775713 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fce340c47c0 0x7fce341f00e0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fce280b3040 tx=0x7fce2801bad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:47:48.862 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:48.869+0000 7fce31600640 1 -- 172.21.15.44:0/1037775713 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce280b5070 con 0x7fce340c47c0 2024-04-17T19:47:48.862 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:48.869+0000 7fce31600640 1 -- 172.21.15.44:0/1037775713 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fce280b0a50 con 0x7fce340c47c0 2024-04-17T19:47:48.862 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:48.869+0000 7fce3c400640 1 -- 172.21.15.44:0/1037775713 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fce34155430 con 0x7fce340c47c0 2024-04-17T19:47:48.862 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:48.869+0000 7fce31600640 1 -- 172.21.15.44:0/1037775713 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce280b0e40 con 0x7fce340c47c0 2024-04-17T19:47:48.862 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:48.869+0000 7fce3c400640 1 -- 172.21.15.44:0/1037775713 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fce341559f0 con 0x7fce340c47c0 2024-04-17T19:47:48.862 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:48.869+0000 7fce3c400640 1 -- 172.21.15.44:0/1037775713 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fce341551c0 con 0x7fce340c47c0 2024-04-17T19:47:48.862 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:48.869+0000 7fce31600640 1 -- 172.21.15.44:0/1037775713 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fce280b9070 con 0x7fce340c47c0 2024-04-17T19:47:48.863 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:48.873+0000 7fce31600640 1 --2- 172.21.15.44:0/1037775713 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7fce140683b0 0x7fce1406a8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:48.863 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:48.873+0000 7fce31600640 1 -- 172.21.15.44:0/1037775713 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6619+0+0 (secure 0 0 0) 0x7fce28123e40 con 0x7fce340c47c0 2024-04-17T19:47:48.863 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:48.873+0000 7fce39000640 1 --2- 172.21.15.44:0/1037775713 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7fce140683b0 0x7fce1406a8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:48.864 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:48.873+0000 7fce39000640 1 --2- 172.21.15.44:0/1037775713 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7fce140683b0 0x7fce1406a8c0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fce34073f80 tx=0x7fce20008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:47:48.867 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:48.877+0000 7fce31600640 1 -- 172.21.15.44:0/1037775713 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fce280c1060 con 0x7fce340c47c0 2024-04-17T19:47:49.036 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:49.045+0000 7fce3c400640 1 -- 172.21.15.44:0/1037775713 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fce3404ff10 con 0x7fce340c47c0 2024-04-17T19:47:49.037 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:49.045+0000 7fce31600640 1 -- 172.21.15.44:0/1037775713 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) ==== 74+0+18623 (secure 0 0 0) 0x7fce28018890 con 0x7fce340c47c0 2024-04-17T19:47:49.038 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-04-17T19:47:49.038 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":27,"fsid":"703f77ca-79c6-4a66-b576-62c526cb1021","created":"2024-04-17T19:46:30.831994+0000","modified":"2024-04-17T19:47:37.943331+0000","last_up_change":"2024-04-17T19:46:41.988197+0000","last_in_change":"2024-04-17T19:46:33.407430+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-17T19:46:41.940380+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-17T19:46:54.222150+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-17T19:46:55.031694+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-17T19:46:58.707529+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"30520dc6-eea6-43d4-ab60-3ca9e92329dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6800","nonce":1018735925},{"type":"v1","addr":"172.21.15.44:6801","nonce":1018735925}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6802","nonce":1018735925},{"type":"v1","addr":"172.21.15.44:6803","nonce":1018735925}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6806","nonce":1018735925},{"type":"v1","addr":"172.21.15.44:6807","nonce":1018735925}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6804","nonce":1018735925},{"type":"v1","addr":"172.21.15.44:6805","nonce":1018735925}]},"public_addr":"172.21.15.44:6801/1018735925","cluster_addr":"172.21.15.44:6803/1018735925","heartbeat_back_addr":"172.21.15.44:6807/1018735925","heartbeat_front_addr":"172.21.15.44:6805/1018735925","state":["exists","up"]},{"osd":1,"uuid":"079bd511-b6ce-449b-8f11-17b311b12f7c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6817","nonce":1452577434},{"type":"v1","addr":"172.21.15.44:6820","nonce":1452577434}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6823","nonce":1452577434},{"type":"v1","addr":"172.21.15.44:6825","nonce":1452577434}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6830","nonce":1452577434},{"type":"v1","addr":"172.21.15.44:6831","nonce":1452577434}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6828","nonce":1452577434},{"type":"v1","addr":"172.21.15.44:6829","nonce":1452577434}]},"public_addr":"172.21.15.44:6820/1452577434","cluster_addr":"172.21.15.44:6825/1452577434","heartbeat_back_addr":"172.21.15.44:6831/1452577434","heartbeat_front_addr":"172.21.15.44:6829/1452577434","state":["exists","up"]},{"osd":2,"uuid":"34f0b9ab-b1d2-4ee9-841c-f15afbb6bec5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6816","nonce":1160071918},{"type":"v1","addr":"172.21.15.44:6818","nonce":1160071918}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6819","nonce":1160071918},{"type":"v1","addr":"172.21.15.44:6821","nonce":1160071918}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6826","nonce":1160071918},{"type":"v1","addr":"172.21.15.44:6827","nonce":1160071918}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6822","nonce":1160071918},{"type":"v1","addr":"172.21.15.44:6824","nonce":1160071918}]},"public_addr":"172.21.15.44:6818/1160071918","cluster_addr":"172.21.15.44:6821/1160071918","heartbeat_back_addr":"172.21.15.44:6827/1160071918","heartbeat_front_addr":"172.21.15.44:6824/1160071918","state":["exists","up"]},{"osd":3,"uuid":"4740032d-fe34-4b1b-bb85-f430896fc3c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6808","nonce":4236454921},{"type":"v1","addr":"172.21.15.44:6809","nonce":4236454921}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6810","nonce":4236454921},{"type":"v1","addr":"172.21.15.44:6811","nonce":4236454921}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6814","nonce":4236454921},{"type":"v1","addr":"172.21.15.44:6815","nonce":4236454921}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6812","nonce":4236454921},{"type":"v1","addr":"172.21.15.44:6813","nonce":4236454921}]},"public_addr":"172.21.15.44:6809/4236454921","cluster_addr":"172.21.15.44:6811/4236454921","heartbeat_back_addr":"172.21.15.44:6815/4236454921","heartbeat_front_addr":"172.21.15.44:6813/4236454921","state":["exists","up"]},{"osd":4,"uuid":"7dbedb00-302d-4d52-810c-e18839254da1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6800","nonce":2293251376},{"type":"v1","addr":"172.21.15.62:6801","nonce":2293251376}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6802","nonce":2293251376},{"type":"v1","addr":"172.21.15.62:6803","nonce":2293251376}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6806","nonce":2293251376},{"type":"v1","addr":"172.21.15.62:6807","nonce":2293251376}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6804","nonce":2293251376},{"type":"v1","addr":"172.21.15.62:6805","nonce":2293251376}]},"public_addr":"172.21.15.62:6801/2293251376","cluster_addr":"172.21.15.62:6803/2293251376","heartbeat_back_addr":"172.21.15.62:6807/2293251376","heartbeat_front_addr":"172.21.15.62:6805/2293251376","state":["exists","up"]},{"osd":5,"uuid":"38c1e8d9-393d-4f33-a97a-3295cf5c5b07","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6808","nonce":1551020300},{"type":"v1","addr":"172.21.15.62:6809","nonce":1551020300}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6810","nonce":1551020300},{"type":"v1","addr":"172.21.15.62:6811","nonce":1551020300}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6814","nonce":1551020300},{"type":"v1","addr":"172.21.15.62:6815","nonce":1551020300}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6812","nonce":1551020300},{"type":"v1","addr":"172.21.15.62:6813","nonce":1551020300}]},"public_addr":"172.21.15.62:6809/1551020300","cluster_addr":"172.21.15.62:6811/1551020300","heartbeat_back_addr":"172.21.15.62:6815/1551020300","heartbeat_front_addr":"172.21.15.62:6813/1551020300","state":["exists","up"]},{"osd":6,"uuid":"f6ff81c6-f14d-4477-88e3-9116cc5a2992","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6824","nonce":2602310256},{"type":"v1","addr":"172.21.15.62:6825","nonce":2602310256}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6826","nonce":2602310256},{"type":"v1","addr":"172.21.15.62:6827","nonce":2602310256}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6830","nonce":2602310256},{"type":"v1","addr":"172.21.15.62:6831","nonce":2602310256}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6828","nonce":2602310256},{"type":"v1","addr":"172.21.15.62:6829","nonce":2602310256}]},"public_addr":"172.21.15.62:6825/2602310256","cluster_addr":"172.21.15.62:6827/2602310256","heartbeat_back_addr":"172.21.15.62:6831/2602310256","heartbeat_front_addr":"172.21.15.62:6829/2602310256","state":["exists","up"]},{"osd":7,"uuid":"ce395bc3-bcb5-4b94-a523-5bb9df491eca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6816","nonce":2912738359},{"type":"v1","addr":"172.21.15.62:6817","nonce":2912738359}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6818","nonce":2912738359},{"type":"v1","addr":"172.21.15.62:6819","nonce":2912738359}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6822","nonce":2912738359},{"type":"v1","addr":"172.21.15.62:6823","nonce":2912738359}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6820","nonce":2912738359},{"type":"v1","addr":"172.21.15.62:6821","nonce":2912738359}]},"public_addr":"172.21.15.62:6817/2912738359","cluster_addr":"172.21.15.62:6819/2912738359","heartbeat_back_addr":"172.21.15.62:6823/2912738359","heartbeat_front_addr":"172.21.15.62:6821/2912738359","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T19:46:39.302883+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T19:46:39.177705+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T19:46:39.188894+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T19:46:39.313009+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T19:46:38.870508+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T19:46:38.790900+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T19:46:38.979163+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T19:46:38.992348+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.c","mappings":[{"from":0,"to":4}]},{"pgid":"3.15","mappings":[{"from":0,"to":7}]},{"pgid":"4.f","mappings":[{"from":7,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-17T19:47:49.039 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:49.049+0000 7fce3c400640 1 -- 172.21.15.44:0/1037775713 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7fce140683b0 msgr2=0x7fce1406a8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:49.040 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:49.049+0000 7fce3c400640 1 --2- 172.21.15.44:0/1037775713 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7fce140683b0 0x7fce1406a8c0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fce34073f80 tx=0x7fce20008040 comp rx=0 tx=0).stop 2024-04-17T19:47:49.040 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:49.049+0000 7fce3c400640 1 -- 172.21.15.44:0/1037775713 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fce340c47c0 msgr2=0x7fce341f00e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:49.040 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:49.049+0000 7fce3c400640 1 --2- 172.21.15.44:0/1037775713 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fce340c47c0 0x7fce341f00e0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fce280b3040 tx=0x7fce2801bad0 comp rx=0 tx=0).stop 2024-04-17T19:47:49.040 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:49.049+0000 7fce3c400640 1 -- 172.21.15.44:0/1037775713 shutdown_connections 2024-04-17T19:47:49.040 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:49.049+0000 7fce3c400640 1 --2- 172.21.15.44:0/1037775713 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7fce140683b0 0x7fce1406a8c0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:49.040 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:49.049+0000 7fce3c400640 1 --2- 172.21.15.44:0/1037775713 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fce34158eb0 0x7fce34145ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:49.040 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:49.049+0000 7fce3c400640 1 --2- 172.21.15.44:0/1037775713 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fce34152a60 0x7fce341459a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:49.040 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:49.049+0000 7fce3c400640 1 --2- 172.21.15.44:0/1037775713 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fce340c47c0 0x7fce341f00e0 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:49.040 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:49.049+0000 7fce3c400640 1 -- 172.21.15.44:0/1037775713 >> 172.21.15.44:0/1037775713 conn(0x7fce3406c380 msgr2=0x7fce340c9510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:47:49.040 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:49.049+0000 7fce3c400640 1 -- 172.21.15.44:0/1037775713 shutdown_connections 2024-04-17T19:47:49.040 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:49.049+0000 7fce3c400640 1 -- 172.21.15.44:0/1037775713 wait complete. 2024-04-17T19:47:49.060 INFO:tasks.mon_thrash.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-17T19:46:41.940380+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-17T19:46:54.222150+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-17T19:46:55.031694+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-04-17T19:46:58.707529+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-04-17T19:47:49.060 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-17T19:47:49.215 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:49.225+0000 7f6d03000640 1 Processor -- start 2024-04-17T19:47:49.215 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:49.225+0000 7f6d03000640 1 -- start start 2024-04-17T19:47:49.217 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:49.225+0000 7f6d03000640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f6cfc073f10 0x7f6cfc1588d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:49.217 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:49.225+0000 7f6d03000640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f6cfc152310 0x7f6cfc15be50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:49.217 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:49.225+0000 7f6d03000640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6cfc157e50 con 0x7f6cfc0c7530 2024-04-17T19:47:49.217 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:49.225+0000 7f6d03000640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 -- 0x7f6cfc158e10 con 0x7f6cfc073f10 2024-04-17T19:47:49.218 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:49.225+0000 7f6d03000640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 -- 0x7f6cfc15c390 con 0x7f6cfc152310 2024-04-17T19:47:49.218 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:49.225+0000 7f6cfbe00640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f6cfc073f10 0x7f6cfc1588d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:49.218 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:49.225+0000 7f6cfbe00640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f6cfc073f10 0x7f6cfc1588d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:34400/0 (socket says 172.21.15.44:34400) 2024-04-17T19:47:49.218 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:49.225+0000 7f6cfbe00640 1 -- 172.21.15.44:0/3799114645 learned_addr learned my addr 172.21.15.44:0/3799114645 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-04-17T19:47:49.218 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:49.225+0000 7f6cf3400640 1 --2- 172.21.15.44:0/3799114645 >> v2:172.21.15.62:3300/0 conn(0x7f6cfc152310 0x7f6cfc15be50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:49.218 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:49.225+0000 7f6cfbe00640 1 -- 172.21.15.44:0/3799114645 >> v2:172.21.15.62:3300/0 conn(0x7f6cfc152310 msgr2=0x7f6cfc15be50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T19:47:49.218 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:49.225+0000 7f6cfbe00640 1 --2- 172.21.15.44:0/3799114645 >> v2:172.21.15.62:3300/0 conn(0x7f6cfc152310 0x7f6cfc15be50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:49.218 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:49.225+0000 7f6cfbe00640 1 -- 172.21.15.44:0/3799114645 >> v1:172.21.15.62:6789/0 conn(0x7f6cfc0c7530 legacy=0x7f6cfc0c6060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:49.218 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:49.225+0000 7f6cfbe00640 1 -- 172.21.15.44:0/3799114645 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6cfc0c4310 con 0x7f6cfc073f10 2024-04-17T19:47:49.220 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:49.229+0000 7f6cfbe00640 1 --2- 172.21.15.44:0/3799114645 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6cfc073f10 0x7f6cfc1588d0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f6cfc073ec0 tx=0x7f6cec01c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aa253a19bb809396 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:47:49.220 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:49.229+0000 7f6cfb400640 1 -- 172.21.15.44:0/3799114645 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6cec0b0070 con 0x7f6cfc073f10 2024-04-17T19:47:49.220 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:49.229+0000 7f6cfb400640 1 -- 172.21.15.44:0/3799114645 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6cec0ab600 con 0x7f6cfc073f10 2024-04-17T19:47:49.220 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:49.229+0000 7f6cfb400640 1 -- 172.21.15.44:0/3799114645 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6cec0ab9d0 con 0x7f6cfc073f10 2024-04-17T19:47:49.221 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:49.229+0000 7f6d03000640 1 -- 172.21.15.44:0/3799114645 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6cfc073f10 msgr2=0x7f6cfc1588d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:49.221 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:49.229+0000 7f6d03000640 1 --2- 172.21.15.44:0/3799114645 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6cfc073f10 0x7f6cfc1588d0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f6cfc073ec0 tx=0x7f6cec01c520 comp rx=0 tx=0).stop 2024-04-17T19:47:49.222 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:49.229+0000 7f6d03000640 1 -- 172.21.15.44:0/3799114645 shutdown_connections 2024-04-17T19:47:49.222 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:49.229+0000 7f6d03000640 1 --2- 172.21.15.44:0/3799114645 >> v2:172.21.15.62:3300/0 conn(0x7f6cfc152310 0x7f6cfc15be50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:49.222 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:49.229+0000 7f6d03000640 1 --2- 172.21.15.44:0/3799114645 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6cfc073f10 0x7f6cfc1588d0 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:49.222 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:49.229+0000 7f6d03000640 1 -- 172.21.15.44:0/3799114645 >> 172.21.15.44:0/3799114645 conn(0x7f6cfc06c380 msgr2=0x7f6cfc070080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:47:49.222 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:49.229+0000 7f6d03000640 1 -- 172.21.15.44:0/3799114645 shutdown_connections 2024-04-17T19:47:49.222 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:49.229+0000 7f6d03000640 1 -- 172.21.15.44:0/3799114645 wait complete. 2024-04-17T19:47:49.223 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:49.237+0000 7f6d03000640 1 Processor -- start 2024-04-17T19:47:49.223 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:49.237+0000 7f6d03000640 1 -- start start 2024-04-17T19:47:49.226 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:49.237+0000 7f6d03000640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f6cfc073f10 0x7f6cfc165be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:49.226 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:49.237+0000 7f6d03000640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6cfc0c7530 0x7f6cfc15b380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:49.227 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:49.237+0000 7f6d03000640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6cfc152310 0x7f6cfc144c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:49.227 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:49.237+0000 7f6d03000640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f6cfc0c7d50 con 0x7f6cfc152310 2024-04-17T19:47:49.227 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:49.237+0000 7f6d03000640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f6cfc1583b0 con 0x7f6cfc0c7530 2024-04-17T19:47:49.227 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:49.237+0000 7f6d03000640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7f6cfc0c3ed0 con 0x7f6cfc073f10 2024-04-17T19:47:49.227 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:49.237+0000 7f6d01000640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6cfc152310 0x7f6cfc144c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:49.227 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:49.237+0000 7f6cf3400640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6cfc0c7530 0x7f6cfc15b380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:49.227 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:49.237+0000 7f6d01000640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6cfc152310 0x7f6cfc144c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:34410/0 (socket says 172.21.15.44:34410) 2024-04-17T19:47:49.227 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:49.237+0000 7f6d01000640 1 -- 172.21.15.44:0/1889535720 learned_addr learned my addr 172.21.15.44:0/1889535720 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-04-17T19:47:49.227 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:49.237+0000 7f6cfbe00640 1 --2- 172.21.15.44:0/1889535720 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f6cfc073f10 0x7f6cfc165be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:49.227 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:49.237+0000 7f6d01000640 1 -- 172.21.15.44:0/1889535720 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f6cfc073f10 msgr2=0x7f6cfc165be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:49.227 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:49.237+0000 7f6d01000640 1 --2- 172.21.15.44:0/1889535720 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f6cfc073f10 0x7f6cfc165be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:49.228 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:49.237+0000 7f6d01000640 1 -- 172.21.15.44:0/1889535720 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6cfc0c7530 msgr2=0x7f6cfc15b380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:49.228 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:49.237+0000 7f6d01000640 1 --2- 172.21.15.44:0/1889535720 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6cfc0c7530 0x7f6cfc15b380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:49.228 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:49.237+0000 7f6d01000640 1 -- 172.21.15.44:0/1889535720 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6cfc166120 con 0x7f6cfc152310 2024-04-17T19:47:49.228 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:49.237+0000 7f6d01000640 1 --2- 172.21.15.44:0/1889535720 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6cfc152310 0x7f6cfc144c20 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f6cf400c760 tx=0x7f6cf400cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:47:49.228 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:49.237+0000 7f6cf8c00640 1 -- 172.21.15.44:0/1889535720 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6cf4003b80 con 0x7f6cfc152310 2024-04-17T19:47:49.228 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:49.237+0000 7f6cf8c00640 1 -- 172.21.15.44:0/1889535720 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6cf4003d20 con 0x7f6cfc152310 2024-04-17T19:47:49.228 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:49.237+0000 7f6cf8c00640 1 -- 172.21.15.44:0/1889535720 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6cf400aa30 con 0x7f6cfc152310 2024-04-17T19:47:49.228 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:49.237+0000 7f6d03000640 1 -- 172.21.15.44:0/1889535720 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6cfc1f5100 con 0x7f6cfc152310 2024-04-17T19:47:49.228 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:49.237+0000 7f6d03000640 1 -- 172.21.15.44:0/1889535720 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6cfc1f5660 con 0x7f6cfc152310 2024-04-17T19:47:49.229 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:49.237+0000 7f6d03000640 1 -- 172.21.15.44:0/1889535720 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6cfc04ff10 con 0x7f6cfc152310 2024-04-17T19:47:49.229 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:49.237+0000 7f6cf8c00640 1 -- 172.21.15.44:0/1889535720 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f6cf400abd0 con 0x7f6cfc152310 2024-04-17T19:47:49.230 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:49.237+0000 7f6cf8c00640 1 --2- 172.21.15.44:0/1889535720 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f6cd80683b0 0x7f6cd806a8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:49.230 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:49.237+0000 7f6cf8c00640 1 -- 172.21.15.44:0/1889535720 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6619+0+0 (secure 0 0 0) 0x7f6cf4086b80 con 0x7f6cfc152310 2024-04-17T19:47:49.230 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:49.237+0000 7f6cfbe00640 1 --2- 172.21.15.44:0/1889535720 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f6cd80683b0 0x7f6cd806a8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:49.231 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:49.241+0000 7f6cfbe00640 1 --2- 172.21.15.44:0/1889535720 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f6cd80683b0 0x7f6cd806a8c0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f6cec0ad000 tx=0x7f6cec008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:47:49.234 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:49.241+0000 7f6cf8c00640 1 -- 172.21.15.44:0/1889535720 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f6cfc157e50 con 0x7f6cfc152310 2024-04-17T19:47:49.399 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:49.409+0000 7f6d03000640 1 -- 172.21.15.44:0/1889535720 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f6cfc1635c0 con 0x7f6cfc152310 2024-04-17T19:47:49.400 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:49.409+0000 7f6cf8c00640 1 -- 172.21.15.44:0/1889535720 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v27) ==== 93+0+10 (secure 0 0 0) 0x7f6cf4056630 con 0x7f6cfc152310 2024-04-17T19:47:49.400 INFO:teuthology.orchestra.run.smithi044.stdout:pg_num: 1 2024-04-17T19:47:49.402 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:49.409+0000 7f6d03000640 1 -- 172.21.15.44:0/1889535720 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f6cd80683b0 msgr2=0x7f6cd806a8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:49.402 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:49.409+0000 7f6d03000640 1 --2- 172.21.15.44:0/1889535720 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f6cd80683b0 0x7f6cd806a8c0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f6cec0ad000 tx=0x7f6cec008040 comp rx=0 tx=0).stop 2024-04-17T19:47:49.403 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:49.409+0000 7f6d03000640 1 -- 172.21.15.44:0/1889535720 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6cfc152310 msgr2=0x7f6cfc144c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:49.403 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:49.409+0000 7f6d03000640 1 --2- 172.21.15.44:0/1889535720 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6cfc152310 0x7f6cfc144c20 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f6cf400c760 tx=0x7f6cf400cc20 comp rx=0 tx=0).stop 2024-04-17T19:47:49.403 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:49.409+0000 7f6d03000640 1 -- 172.21.15.44:0/1889535720 shutdown_connections 2024-04-17T19:47:49.403 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:49.409+0000 7f6d03000640 1 --2- 172.21.15.44:0/1889535720 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f6cd80683b0 0x7f6cd806a8c0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:49.403 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:49.409+0000 7f6d03000640 1 --2- 172.21.15.44:0/1889535720 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6cfc152310 0x7f6cfc144c20 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:49.403 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:49.409+0000 7f6d03000640 1 --2- 172.21.15.44:0/1889535720 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6cfc0c7530 0x7f6cfc15b380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:49.403 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:49.409+0000 7f6d03000640 1 --2- 172.21.15.44:0/1889535720 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f6cfc073f10 0x7f6cfc165be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:49.403 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:49.409+0000 7f6d03000640 1 -- 172.21.15.44:0/1889535720 >> 172.21.15.44:0/1889535720 conn(0x7f6cfc06c380 msgr2=0x7f6cfc0cca70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:47:49.403 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:49.409+0000 7f6d03000640 1 -- 172.21.15.44:0/1889535720 shutdown_connections 2024-04-17T19:47:49.403 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:49.409+0000 7f6d03000640 1 -- 172.21.15.44:0/1889535720 wait complete. 2024-04-17T19:47:49.423 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-17T19:47:49.579 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:49.589+0000 7fa7aba00640 1 Processor -- start 2024-04-17T19:47:49.579 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:49.589+0000 7fa7aba00640 1 -- start start 2024-04-17T19:47:49.581 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:49.593+0000 7fa7aba00640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fa7a4073f10 0x7fa7a41588d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:49.582 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:49.593+0000 7fa7aba00640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa7a4157e50 con 0x7fa7a40c7530 2024-04-17T19:47:49.582 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:49.593+0000 7fa7aba00640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa7a4158e10 con 0x7fa7a4152310 2024-04-17T19:47:49.582 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:49.593+0000 7fa7aba00640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7fa7a40c4310 con 0x7fa7a4073f10 2024-04-17T19:47:49.582 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:49.593+0000 7fa7a9a00640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7fa7a40c7530 0x7fa7a41627d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:46894/0 (socket says 172.21.15.44:46894) 2024-04-17T19:47:49.582 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:49.593+0000 7fa7a9a00640 1 -- 172.21.15.44:0/2370129364 learned_addr learned my addr 172.21.15.44:0/2370129364 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-04-17T19:47:49.582 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:49.593+0000 7fa7a9000640 1 --2- 172.21.15.44:0/2370129364 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fa7a4073f10 0x7fa7a41588d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:49.582 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:49.593+0000 7fa7a3400640 1 -- 172.21.15.44:0/2370129364 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1351605631 0 0) 0x7fa79c0014a0 con 0x7fa7a40c7530 2024-04-17T19:47:49.582 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:49.593+0000 7fa7a3400640 1 -- 172.21.15.44:0/2370129364 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa78c003530 con 0x7fa7a40c7530 2024-04-17T19:47:49.583 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:49.593+0000 7fa7a3400640 1 -- 172.21.15.44:0/2370129364 <== mon.1 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 164498404 0 0) 0x7fa7a4158e10 con 0x7fa7a4152310 2024-04-17T19:47:49.583 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:49.593+0000 7fa7a3400640 1 -- 172.21.15.44:0/2370129364 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa79c0014a0 con 0x7fa7a4152310 2024-04-17T19:47:49.583 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:49.593+0000 7fa7a9000640 1 -- 172.21.15.44:0/2370129364 >> v1:172.21.15.62:6789/0 conn(0x7fa7a4152310 legacy=0x7fa7a415be50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:49.583 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:49.593+0000 7fa7a9000640 1 -- 172.21.15.44:0/2370129364 >> v1:172.21.15.44:6789/0 conn(0x7fa7a40c7530 legacy=0x7fa7a41627d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:49.583 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:49.593+0000 7fa7a3400640 1 -- 172.21.15.44:0/2370129364 <== mon.0 v1:172.21.15.44:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 212589952 0 0) 0x7fa78c003530 con 0x7fa7a40c7530 2024-04-17T19:47:49.583 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:49.593+0000 7fa7a9000640 1 -- 172.21.15.44:0/2370129364 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa7a40c45f0 con 0x7fa7a4073f10 2024-04-17T19:47:49.584 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:49.597+0000 7fa7a9000640 1 --2- 172.21.15.44:0/2370129364 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fa7a4073f10 0x7fa7a41588d0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fa79800a990 tx=0x7fa79801d7d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6bed03297b24eab server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:47:49.585 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:49.597+0000 7fa7a3400640 1 -- 172.21.15.44:0/2370129364 <== mon.2 v2:172.21.15.62:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa79c001bd0 con 0x7fa7a4073f10 2024-04-17T19:47:49.585 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:49.597+0000 7fa7a3400640 1 -- 172.21.15.44:0/2370129364 <== mon.2 v2:172.21.15.62:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa7980a9410 con 0x7fa7a4073f10 2024-04-17T19:47:49.585 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:49.597+0000 7fa7a3400640 1 -- 172.21.15.44:0/2370129364 <== mon.2 v2:172.21.15.62:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa79800b040 con 0x7fa7a4073f10 2024-04-17T19:47:49.586 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:49.597+0000 7fa7aba00640 1 -- 172.21.15.44:0/2370129364 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fa7a4073f10 msgr2=0x7fa7a41588d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:49.586 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:49.597+0000 7fa7aba00640 1 --2- 172.21.15.44:0/2370129364 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fa7a4073f10 0x7fa7a41588d0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fa79800a990 tx=0x7fa79801d7d0 comp rx=0 tx=0).stop 2024-04-17T19:47:49.586 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:49.597+0000 7fa7aba00640 1 -- 172.21.15.44:0/2370129364 shutdown_connections 2024-04-17T19:47:49.586 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:49.597+0000 7fa7aba00640 1 --2- 172.21.15.44:0/2370129364 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fa7a4073f10 0x7fa7a41588d0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:49.586 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:49.597+0000 7fa7aba00640 1 -- 172.21.15.44:0/2370129364 >> 172.21.15.44:0/2370129364 conn(0x7fa7a406c380 msgr2=0x7fa7a4070080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:47:49.587 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:49.597+0000 7fa7aba00640 1 -- 172.21.15.44:0/2370129364 shutdown_connections 2024-04-17T19:47:49.587 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:49.597+0000 7fa7aba00640 1 -- 172.21.15.44:0/2370129364 wait complete. 2024-04-17T19:47:49.588 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:49.601+0000 7fa7aba00640 1 Processor -- start 2024-04-17T19:47:49.588 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:49.601+0000 7fa7aba00640 1 -- start start 2024-04-17T19:47:49.592 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:49.601+0000 7fa7aba00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa7a4073f10 0x7fa7a4152780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:49.592 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:49.601+0000 7fa7aba00640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fa7a40c7530 0x7fa7a4153b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:49.592 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:49.601+0000 7fa7aba00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa7a4152310 0x7fa7a414eb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:49.592 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:49.601+0000 7fa7aba00640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fa7a40c3ed0 con 0x7fa7a4152310 2024-04-17T19:47:49.592 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:49.601+0000 7fa7aba00640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7fa7a40c7d50 con 0x7fa7a4073f10 2024-04-17T19:47:49.592 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:49.601+0000 7fa7aba00640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7fa7a40c4050 con 0x7fa7a40c7530 2024-04-17T19:47:49.592 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:49.601+0000 7fa7a9a00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa7a4152310 0x7fa7a414eb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:49.592 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:49.601+0000 7fa7a9a00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa7a4152310 0x7fa7a414eb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:34424/0 (socket says 172.21.15.44:34424) 2024-04-17T19:47:49.592 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:49.601+0000 7fa7a9a00640 1 -- 172.21.15.44:0/3666403199 learned_addr learned my addr 172.21.15.44:0/3666403199 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-04-17T19:47:49.593 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:49.601+0000 7fa7a9000640 1 --2- 172.21.15.44:0/3666403199 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa7a4073f10 0x7fa7a4152780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:49.593 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:49.601+0000 7fa7a3e00640 1 --2- 172.21.15.44:0/3666403199 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fa7a40c7530 0x7fa7a4153b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:49.593 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:49.601+0000 7fa7a9a00640 1 -- 172.21.15.44:0/3666403199 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fa7a40c7530 msgr2=0x7fa7a4153b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:49.593 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:49.601+0000 7fa7a9a00640 1 --2- 172.21.15.44:0/3666403199 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fa7a40c7530 0x7fa7a4153b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:49.593 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:49.601+0000 7fa7a9a00640 1 -- 172.21.15.44:0/3666403199 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa7a4073f10 msgr2=0x7fa7a4152780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:49.593 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:49.601+0000 7fa7a9a00640 1 --2- 172.21.15.44:0/3666403199 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa7a4073f10 0x7fa7a4152780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:49.593 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:49.601+0000 7fa7a9a00640 1 -- 172.21.15.44:0/3666403199 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa7a414f080 con 0x7fa7a4152310 2024-04-17T19:47:49.593 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:49.601+0000 7fa7a9a00640 1 --2- 172.21.15.44:0/3666403199 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa7a4152310 0x7fa7a414eb40 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fa79c001b20 tx=0x7fa79c00a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:47:49.594 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:49.605+0000 7fa7a0c00640 1 -- 172.21.15.44:0/3666403199 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa79c012400 con 0x7fa7a4152310 2024-04-17T19:47:49.594 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:49.605+0000 7fa7aba00640 1 -- 172.21.15.44:0/3666403199 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa7a41f6a80 con 0x7fa7a4152310 2024-04-17T19:47:49.594 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:49.605+0000 7fa7a0c00640 1 -- 172.21.15.44:0/3666403199 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa79c0125a0 con 0x7fa7a4152310 2024-04-17T19:47:49.594 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:49.605+0000 7fa7a0c00640 1 -- 172.21.15.44:0/3666403199 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa79c012990 con 0x7fa7a4152310 2024-04-17T19:47:49.594 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:49.605+0000 7fa7aba00640 1 -- 172.21.15.44:0/3666403199 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa7a41f7040 con 0x7fa7a4152310 2024-04-17T19:47:49.594 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:49.605+0000 7fa7aba00640 1 -- 172.21.15.44:0/3666403199 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa7a4152e30 con 0x7fa7a4152310 2024-04-17T19:47:49.595 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:49.605+0000 7fa7a0c00640 1 -- 172.21.15.44:0/3666403199 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fa79c012b30 con 0x7fa7a4152310 2024-04-17T19:47:49.595 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:49.605+0000 7fa7a0c00640 1 --2- 172.21.15.44:0/3666403199 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7fa784068380 0x7fa78406a890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:49.595 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:49.605+0000 7fa7a0c00640 1 -- 172.21.15.44:0/3666403199 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6619+0+0 (secure 0 0 0) 0x7fa79c0877d0 con 0x7fa7a4152310 2024-04-17T19:47:49.596 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:49.605+0000 7fa7a9000640 1 --2- 172.21.15.44:0/3666403199 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7fa784068380 0x7fa78406a890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:49.596 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:49.609+0000 7fa7a9000640 1 --2- 172.21.15.44:0/3666403199 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7fa784068380 0x7fa78406a890 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fa7980b0000 tx=0x7fa7980a8000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:47:49.598 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:49.609+0000 7fa7a0c00640 1 -- 172.21.15.44:0/3666403199 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fa7a4157e50 con 0x7fa7a4152310 2024-04-17T19:47:49.762 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:49.773+0000 7fa7aba00640 1 -- 172.21.15.44:0/3666403199 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7fa7a404ff10 con 0x7fa7a4152310 2024-04-17T19:47:49.762 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:49.773+0000 7fa7a0c00640 1 -- 172.21.15.44:0/3666403199 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v27) ==== 104+0+11 (secure 0 0 0) 0x7fa79c012e20 con 0x7fa7a4152310 2024-04-17T19:47:49.763 INFO:teuthology.orchestra.run.smithi044.stdout:pg_num: 32 2024-04-17T19:47:49.765 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:49.777+0000 7fa7aba00640 1 -- 172.21.15.44:0/3666403199 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7fa784068380 msgr2=0x7fa78406a890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:49.765 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:49.777+0000 7fa7aba00640 1 --2- 172.21.15.44:0/3666403199 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7fa784068380 0x7fa78406a890 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fa7980b0000 tx=0x7fa7980a8000 comp rx=0 tx=0).stop 2024-04-17T19:47:49.765 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:49.777+0000 7fa7aba00640 1 -- 172.21.15.44:0/3666403199 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa7a4152310 msgr2=0x7fa7a414eb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:49.765 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:49.777+0000 7fa7aba00640 1 --2- 172.21.15.44:0/3666403199 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa7a4152310 0x7fa7a414eb40 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fa79c001b20 tx=0x7fa79c00a430 comp rx=0 tx=0).stop 2024-04-17T19:47:49.765 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:49.777+0000 7fa7aba00640 1 -- 172.21.15.44:0/3666403199 shutdown_connections 2024-04-17T19:47:49.765 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:49.777+0000 7fa7aba00640 1 --2- 172.21.15.44:0/3666403199 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7fa784068380 0x7fa78406a890 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:49.765 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:49.777+0000 7fa7aba00640 1 --2- 172.21.15.44:0/3666403199 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fa7a40c7530 0x7fa7a4153b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:49.766 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:49.777+0000 7fa7aba00640 1 --2- 172.21.15.44:0/3666403199 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa7a4152310 0x7fa7a414eb40 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:49.766 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:49.777+0000 7fa7aba00640 1 --2- 172.21.15.44:0/3666403199 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa7a4073f10 0x7fa7a4152780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:49.766 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:49.777+0000 7fa7aba00640 1 -- 172.21.15.44:0/3666403199 >> 172.21.15.44:0/3666403199 conn(0x7fa7a406c380 msgr2=0x7fa7a40c5f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:47:49.766 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:49.777+0000 7fa7aba00640 1 -- 172.21.15.44:0/3666403199 shutdown_connections 2024-04-17T19:47:49.766 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:49.777+0000 7fa7aba00640 1 -- 172.21.15.44:0/3666403199 wait complete. 2024-04-17T19:47:49.785 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-17T19:47:49.940 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:49.953+0000 7f6070400640 1 Processor -- start 2024-04-17T19:47:49.940 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:49.953+0000 7f6070400640 1 -- start start 2024-04-17T19:47:49.942 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:49.953+0000 7f6070400640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f60680c4510 0x7f60680cafd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:49.942 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:49.953+0000 7f6070400640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f6068153bb0 0x7f60680c3be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:49.942 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:49.953+0000 7f6070400640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f60680c9750 0x7f60680c9b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:49.942 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:49.953+0000 7f6070400640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 -- 0x7f60680c4c10 con 0x7f60680c4510 2024-04-17T19:47:49.942 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:49.953+0000 7f6070400640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 -- 0x7f60680c4ed0 con 0x7f6068153bb0 2024-04-17T19:47:49.942 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:49.953+0000 7f6070400640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7f6068159a20 con 0x7f60680c9750 2024-04-17T19:47:49.943 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:49.953+0000 7f606da00640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f60680c4510 0x7f60680cafd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:49.943 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:49.953+0000 7f606da00640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f60680c4510 0x7f60680cafd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:34430/0 (socket says 172.21.15.44:34430) 2024-04-17T19:47:49.943 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:49.953+0000 7f606da00640 1 -- 172.21.15.44:0/3213250713 learned_addr learned my addr 172.21.15.44:0/3213250713 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-04-17T19:47:49.943 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:49.953+0000 7f606e400640 1 --2- 172.21.15.44:0/3213250713 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f60680c9750 0x7f60680c9b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:49.943 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:49.953+0000 7f606d000640 1 --2- 172.21.15.44:0/3213250713 >> v2:172.21.15.62:3300/0 conn(0x7f6068153bb0 0x7f60680c3be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:49.943 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:49.957+0000 7f606da00640 1 -- 172.21.15.44:0/3213250713 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f60680c9750 msgr2=0x7f60680c9b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T19:47:49.943 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:49.957+0000 7f606da00640 1 --2- 172.21.15.44:0/3213250713 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f60680c9750 0x7f60680c9b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:49.943 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:49.957+0000 7f606da00640 1 -- 172.21.15.44:0/3213250713 >> v2:172.21.15.62:3300/0 conn(0x7f6068153bb0 msgr2=0x7f60680c3be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T19:47:49.943 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:49.957+0000 7f606da00640 1 --2- 172.21.15.44:0/3213250713 >> v2:172.21.15.62:3300/0 conn(0x7f6068153bb0 0x7f60680c3be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:49.944 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:49.957+0000 7f606da00640 1 -- 172.21.15.44:0/3213250713 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6068159d00 con 0x7f60680c4510 2024-04-17T19:47:49.944 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:49.957+0000 7f606d000640 1 --2- 172.21.15.44:0/3213250713 >> v2:172.21.15.62:3300/0 conn(0x7f6068153bb0 0x7f60680c3be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-17T19:47:49.945 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:49.957+0000 7f606da00640 1 --2- 172.21.15.44:0/3213250713 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f60680c4510 0x7f60680cafd0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f60680739a0 tx=0x7f605c01ed10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=91a202147fe7785a server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:47:49.946 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:49.957+0000 7f6067e00640 1 -- 172.21.15.44:0/3213250713 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f605c0b5070 con 0x7f60680c4510 2024-04-17T19:47:49.946 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:49.957+0000 7f6067e00640 1 -- 172.21.15.44:0/3213250713 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f605c0a89d0 con 0x7f60680c4510 2024-04-17T19:47:49.946 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:49.957+0000 7f6067e00640 1 -- 172.21.15.44:0/3213250713 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f605c0a8da0 con 0x7f60680c4510 2024-04-17T19:47:49.947 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:49.957+0000 7f6070400640 1 -- 172.21.15.44:0/3213250713 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f60680c4510 msgr2=0x7f60680cafd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:49.947 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:49.957+0000 7f6070400640 1 --2- 172.21.15.44:0/3213250713 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f60680c4510 0x7f60680cafd0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f60680739a0 tx=0x7f605c01ed10 comp rx=0 tx=0).stop 2024-04-17T19:47:49.947 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:49.961+0000 7f6070400640 1 -- 172.21.15.44:0/3213250713 shutdown_connections 2024-04-17T19:47:49.947 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:49.961+0000 7f6070400640 1 --2- 172.21.15.44:0/3213250713 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f60680c9750 0x7f60680c9b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:49.947 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:49.961+0000 7f6070400640 1 --2- 172.21.15.44:0/3213250713 >> v2:172.21.15.62:3300/0 conn(0x7f6068153bb0 0x7f60680c3be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:49.947 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:49.961+0000 7f6070400640 1 --2- 172.21.15.44:0/3213250713 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f60680c4510 0x7f60680cafd0 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:49.947 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:49.961+0000 7f6070400640 1 -- 172.21.15.44:0/3213250713 >> 172.21.15.44:0/3213250713 conn(0x7f6068070a10 msgr2=0x7f6068067ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:47:49.947 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:49.961+0000 7f6070400640 1 -- 172.21.15.44:0/3213250713 shutdown_connections 2024-04-17T19:47:49.947 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:49.961+0000 7f6070400640 1 -- 172.21.15.44:0/3213250713 wait complete. 2024-04-17T19:47:49.949 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:49.961+0000 7f6070400640 1 Processor -- start 2024-04-17T19:47:49.949 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:49.961+0000 7f6070400640 1 -- start start 2024-04-17T19:47:49.952 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:49.961+0000 7f6070400640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f60680c4510 0x7f6068156d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:49.952 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:49.961+0000 7f6070400640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f60680c9750 0x7f60681558e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:49.952 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:49.961+0000 7f6070400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6068153bb0 0x7f6068159000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:49.952 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:49.961+0000 7f6070400640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f60680c51b0 con 0x7f6068153bb0 2024-04-17T19:47:49.952 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:49.961+0000 7f6070400640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f60680c4920 con 0x7f60680c9750 2024-04-17T19:47:49.952 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:49.961+0000 7f6070400640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7f6068153fc0 con 0x7f60680c4510 2024-04-17T19:47:49.952 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:49.965+0000 7f606e400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6068153bb0 0x7f6068159000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:49.952 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:49.965+0000 7f606e400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6068153bb0 0x7f6068159000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:34446/0 (socket says 172.21.15.44:34446) 2024-04-17T19:47:49.952 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:49.965+0000 7f606e400640 1 -- 172.21.15.44:0/1671976219 learned_addr learned my addr 172.21.15.44:0/1671976219 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-04-17T19:47:49.952 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:49.965+0000 7f606d000640 1 --2- 172.21.15.44:0/1671976219 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f60680c9750 0x7f60681558e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:49.952 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:49.965+0000 7f606da00640 1 --2- 172.21.15.44:0/1671976219 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f60680c4510 0x7f6068156d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:49.952 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:49.965+0000 7f606e400640 1 -- 172.21.15.44:0/1671976219 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f60680c4510 msgr2=0x7f6068156d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:49.953 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:49.965+0000 7f606e400640 1 --2- 172.21.15.44:0/1671976219 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f60680c4510 0x7f6068156d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:49.953 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:49.965+0000 7f606e400640 1 -- 172.21.15.44:0/1671976219 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f60680c9750 msgr2=0x7f60681558e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:49.953 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:49.965+0000 7f606e400640 1 --2- 172.21.15.44:0/1671976219 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f60680c9750 0x7f60681558e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:49.953 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:49.965+0000 7f606e400640 1 -- 172.21.15.44:0/1671976219 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6068154930 con 0x7f6068153bb0 2024-04-17T19:47:49.953 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:49.965+0000 7f606d000640 1 --2- 172.21.15.44:0/1671976219 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f60680c9750 0x7f60681558e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-17T19:47:49.953 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:49.965+0000 7f606e400640 1 --2- 172.21.15.44:0/1671976219 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6068153bb0 0x7f6068159000 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f606000ec10 tx=0x7f606000c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:47:49.953 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:49.965+0000 7f6065600640 1 -- 172.21.15.44:0/1671976219 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6060018020 con 0x7f6068153bb0 2024-04-17T19:47:49.953 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:49.965+0000 7f6065600640 1 -- 172.21.15.44:0/1671976219 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f606000cd40 con 0x7f6068153bb0 2024-04-17T19:47:49.953 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:49.965+0000 7f6065600640 1 -- 172.21.15.44:0/1671976219 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60600146c0 con 0x7f6068153bb0 2024-04-17T19:47:49.953 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:49.965+0000 7f6070400640 1 -- 172.21.15.44:0/1671976219 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6068154c10 con 0x7f6068153bb0 2024-04-17T19:47:49.953 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:49.965+0000 7f6070400640 1 -- 172.21.15.44:0/1671976219 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f60680cdbd0 con 0x7f6068153bb0 2024-04-17T19:47:49.954 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:49.965+0000 7f6070400640 1 -- 172.21.15.44:0/1671976219 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f606804ff10 con 0x7f6068153bb0 2024-04-17T19:47:49.954 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:49.965+0000 7f6065600640 1 -- 172.21.15.44:0/1671976219 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f606001b020 con 0x7f6068153bb0 2024-04-17T19:47:49.954 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:49.965+0000 7f6065600640 1 --2- 172.21.15.44:0/1671976219 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f6048068380 0x7f604806a890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:49.954 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:49.969+0000 7f6065600640 1 -- 172.21.15.44:0/1671976219 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6619+0+0 (secure 0 0 0) 0x7f6060087a60 con 0x7f6068153bb0 2024-04-17T19:47:49.955 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:49.969+0000 7f606da00640 1 --2- 172.21.15.44:0/1671976219 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f6048068380 0x7f604806a890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:49.956 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:49.969+0000 7f606da00640 1 --2- 172.21.15.44:0/1671976219 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f6048068380 0x7f604806a890 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f605c0b2000 tx=0x7f605c008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:47:49.959 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:49.973+0000 7f6065600640 1 -- 172.21.15.44:0/1671976219 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f6060022030 con 0x7f6068153bb0 2024-04-17T19:47:50.124 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:50.137+0000 7f6070400640 1 -- 172.21.15.44:0/1671976219 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f60680b3630 con 0x7f6068153bb0 2024-04-17T19:47:50.124 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:50.137+0000 7f6065600640 1 -- 172.21.15.44:0/1671976219 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v27) ==== 100+0+11 (secure 0 0 0) 0x7f6060010040 con 0x7f6068153bb0 2024-04-17T19:47:50.124 INFO:teuthology.orchestra.run.smithi044.stdout:pg_num: 64 2024-04-17T19:47:50.127 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:50.137+0000 7f6070400640 1 -- 172.21.15.44:0/1671976219 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f6048068380 msgr2=0x7f604806a890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:50.127 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:50.137+0000 7f6070400640 1 --2- 172.21.15.44:0/1671976219 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f6048068380 0x7f604806a890 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f605c0b2000 tx=0x7f605c008040 comp rx=0 tx=0).stop 2024-04-17T19:47:50.127 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:50.137+0000 7f6070400640 1 -- 172.21.15.44:0/1671976219 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6068153bb0 msgr2=0x7f6068159000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:50.127 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:50.137+0000 7f6070400640 1 --2- 172.21.15.44:0/1671976219 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6068153bb0 0x7f6068159000 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f606000ec10 tx=0x7f606000c490 comp rx=0 tx=0).stop 2024-04-17T19:47:50.127 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:50.137+0000 7f6070400640 1 -- 172.21.15.44:0/1671976219 shutdown_connections 2024-04-17T19:47:50.127 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:50.137+0000 7f6070400640 1 --2- 172.21.15.44:0/1671976219 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f6048068380 0x7f604806a890 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:50.127 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:50.137+0000 7f6070400640 1 --2- 172.21.15.44:0/1671976219 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6068153bb0 0x7f6068159000 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:50.127 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:50.137+0000 7f6070400640 1 --2- 172.21.15.44:0/1671976219 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f60680c9750 0x7f60681558e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:50.128 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:50.137+0000 7f6070400640 1 --2- 172.21.15.44:0/1671976219 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f60680c4510 0x7f6068156d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:50.128 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:50.137+0000 7f6070400640 1 -- 172.21.15.44:0/1671976219 >> 172.21.15.44:0/1671976219 conn(0x7f6068070a10 msgr2=0x7f60680cafd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:47:50.128 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:50.137+0000 7f6070400640 1 -- 172.21.15.44:0/1671976219 shutdown_connections 2024-04-17T19:47:50.128 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:50.137+0000 7f6070400640 1 -- 172.21.15.44:0/1671976219 wait complete. 2024-04-17T19:47:50.149 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-04-17T19:47:50.303 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:50.317+0000 7fb02fc00640 1 Processor -- start 2024-04-17T19:47:50.303 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:50.317+0000 7fb02fc00640 1 -- start start 2024-04-17T19:47:50.305 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:50.317+0000 7fb02fc00640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fb028152860 0x7fb0280c68b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:50.305 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:50.317+0000 7fb02fc00640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fb0280c80a0 0x7fb0280c84b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:50.305 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:50.317+0000 7fb02fc00640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb0280c89f0 con 0x7fb028159140 2024-04-17T19:47:50.305 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:50.317+0000 7fb02fc00640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 -- 0x7fb0280c6eb0 con 0x7fb028152860 2024-04-17T19:47:50.306 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:50.317+0000 7fb02fc00640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 -- 0x7fb0280c78e0 con 0x7fb0280c80a0 2024-04-17T19:47:50.306 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:50.317+0000 7fb02d200640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fb028152860 0x7fb0280c68b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:50.306 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:50.317+0000 7fb02d200640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fb028152860 0x7fb0280c68b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:34458/0 (socket says 172.21.15.44:34458) 2024-04-17T19:47:50.306 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:50.317+0000 7fb02d200640 1 -- 172.21.15.44:0/913351400 learned_addr learned my addr 172.21.15.44:0/913351400 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-04-17T19:47:50.306 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:50.317+0000 7fb02dc00640 1 --2- 172.21.15.44:0/913351400 >> v2:172.21.15.62:3300/0 conn(0x7fb0280c80a0 0x7fb0280c84b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:50.306 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:50.317+0000 7fb02d200640 1 -- 172.21.15.44:0/913351400 >> v2:172.21.15.62:3300/0 conn(0x7fb0280c80a0 msgr2=0x7fb0280c84b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T19:47:50.306 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:50.317+0000 7fb02d200640 1 --2- 172.21.15.44:0/913351400 >> v2:172.21.15.62:3300/0 conn(0x7fb0280c80a0 0x7fb0280c84b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:50.307 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:50.317+0000 7fb02d200640 1 -- 172.21.15.44:0/913351400 >> v1:172.21.15.62:6789/0 conn(0x7fb028159140 legacy=0x7fb0280c47e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:50.307 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:50.317+0000 7fb02d200640 1 -- 172.21.15.44:0/913351400 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb0280c4000 con 0x7fb028152860 2024-04-17T19:47:50.308 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:50.321+0000 7fb02d200640 1 --2- 172.21.15.44:0/913351400 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb028152860 0x7fb0280c68b0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fb02806fc00 tx=0x7fb01c01c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=15460a17fd698a69 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:47:50.309 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:50.321+0000 7fb027400640 1 -- 172.21.15.44:0/913351400 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb01c0b0070 con 0x7fb028152860 2024-04-17T19:47:50.309 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:50.321+0000 7fb027400640 1 -- 172.21.15.44:0/913351400 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb01c0ab600 con 0x7fb028152860 2024-04-17T19:47:50.309 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:50.321+0000 7fb027400640 1 -- 172.21.15.44:0/913351400 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb01c0ab9d0 con 0x7fb028152860 2024-04-17T19:47:50.310 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:50.321+0000 7fb02fc00640 1 -- 172.21.15.44:0/913351400 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb028152860 msgr2=0x7fb0280c68b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:50.310 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:50.321+0000 7fb02fc00640 1 --2- 172.21.15.44:0/913351400 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb028152860 0x7fb0280c68b0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fb02806fc00 tx=0x7fb01c01c490 comp rx=0 tx=0).stop 2024-04-17T19:47:50.310 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:50.321+0000 7fb02fc00640 1 -- 172.21.15.44:0/913351400 shutdown_connections 2024-04-17T19:47:50.310 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:50.321+0000 7fb02fc00640 1 --2- 172.21.15.44:0/913351400 >> v2:172.21.15.62:3300/0 conn(0x7fb0280c80a0 0x7fb0280c84b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:50.310 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:50.321+0000 7fb02fc00640 1 --2- 172.21.15.44:0/913351400 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb028152860 0x7fb0280c68b0 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:50.310 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:50.321+0000 7fb02fc00640 1 -- 172.21.15.44:0/913351400 >> 172.21.15.44:0/913351400 conn(0x7fb02806c380 msgr2=0x7fb028070080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:47:50.310 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:50.321+0000 7fb02fc00640 1 -- 172.21.15.44:0/913351400 shutdown_connections 2024-04-17T19:47:50.310 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:50.321+0000 7fb02fc00640 1 -- 172.21.15.44:0/913351400 wait complete. 2024-04-17T19:47:50.312 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:50.325+0000 7fb02fc00640 1 Processor -- start 2024-04-17T19:47:50.312 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:50.325+0000 7fb02fc00640 1 -- start start 2024-04-17T19:47:50.314 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:50.325+0000 7fb02fc00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb0280c80a0 0x7fb028147ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:50.314 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:50.325+0000 7fb02fc00640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fb028152860 0x7fb028072780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:50.314 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:50.325+0000 7fb02fc00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb028159140 0x7fb02813f330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:50.314 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:50.325+0000 7fb02fc00640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fb0280c5070 con 0x7fb028159140 2024-04-17T19:47:50.315 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:50.325+0000 7fb02fc00640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7fb0280c4ef0 con 0x7fb0280c80a0 2024-04-17T19:47:50.315 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:50.325+0000 7fb02fc00640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7fb028163850 con 0x7fb028152860 2024-04-17T19:47:50.315 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:50.325+0000 7fb02dc00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb028159140 0x7fb02813f330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:50.315 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:50.325+0000 7fb02dc00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb028159140 0x7fb02813f330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:34474/0 (socket says 172.21.15.44:34474) 2024-04-17T19:47:50.315 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:50.325+0000 7fb02dc00640 1 -- 172.21.15.44:0/779695540 learned_addr learned my addr 172.21.15.44:0/779695540 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-04-17T19:47:50.315 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:50.325+0000 7fb02d200640 1 --2- 172.21.15.44:0/779695540 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb0280c80a0 0x7fb028147ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:50.315 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:50.325+0000 7fb027e00640 1 --2- 172.21.15.44:0/779695540 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fb028152860 0x7fb028072780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:50.315 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:50.325+0000 7fb02dc00640 1 -- 172.21.15.44:0/779695540 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fb028152860 msgr2=0x7fb028072780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:50.315 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:50.325+0000 7fb02dc00640 1 --2- 172.21.15.44:0/779695540 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fb028152860 0x7fb028072780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:50.315 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:50.325+0000 7fb02dc00640 1 -- 172.21.15.44:0/779695540 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb0280c80a0 msgr2=0x7fb028147ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:50.315 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:50.325+0000 7fb02dc00640 1 --2- 172.21.15.44:0/779695540 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb0280c80a0 0x7fb028147ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:50.315 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:50.325+0000 7fb02dc00640 1 -- 172.21.15.44:0/779695540 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb028148220 con 0x7fb028159140 2024-04-17T19:47:50.316 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:50.329+0000 7fb02dc00640 1 --2- 172.21.15.44:0/779695540 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb028159140 0x7fb02813f330 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fb020009cb0 tx=0x7fb02000c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:47:50.316 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:50.329+0000 7fb024c00640 1 -- 172.21.15.44:0/779695540 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb020018020 con 0x7fb028159140 2024-04-17T19:47:50.316 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:50.329+0000 7fb024c00640 1 -- 172.21.15.44:0/779695540 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb020014480 con 0x7fb028159140 2024-04-17T19:47:50.316 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:50.329+0000 7fb024c00640 1 -- 172.21.15.44:0/779695540 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb020014870 con 0x7fb028159140 2024-04-17T19:47:50.316 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:50.329+0000 7fb02fc00640 1 -- 172.21.15.44:0/779695540 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb0281421b0 con 0x7fb028159140 2024-04-17T19:47:50.317 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:50.329+0000 7fb02fc00640 1 -- 172.21.15.44:0/779695540 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb028142cd0 con 0x7fb028159140 2024-04-17T19:47:50.317 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:50.329+0000 7fb02fc00640 1 -- 172.21.15.44:0/779695540 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb02804ff10 con 0x7fb028159140 2024-04-17T19:47:50.317 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:50.329+0000 7fb024c00640 1 -- 172.21.15.44:0/779695540 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fb02001b020 con 0x7fb028159140 2024-04-17T19:47:50.318 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:50.329+0000 7fb024c00640 1 --2- 172.21.15.44:0/779695540 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7fb0080683b0 0x7fb00806a8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:50.318 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:50.329+0000 7fb024c00640 1 -- 172.21.15.44:0/779695540 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6619+0+0 (secure 0 0 0) 0x7fb020087910 con 0x7fb028159140 2024-04-17T19:47:50.318 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:50.333+0000 7fb02d200640 1 --2- 172.21.15.44:0/779695540 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7fb0080683b0 0x7fb00806a8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:50.319 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:50.333+0000 7fb02d200640 1 --2- 172.21.15.44:0/779695540 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7fb0080683b0 0x7fb00806a8c0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fb01c0ad000 tx=0x7fb01c008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:47:50.322 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:50.337+0000 7fb024c00640 1 -- 172.21.15.44:0/779695540 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fb020022030 con 0x7fb028159140 2024-04-17T19:47:50.488 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:50.501+0000 7fb02fc00640 1 -- 172.21.15.44:0/779695540 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) -- 0x7fb0280c7e80 con 0x7fb028159140 2024-04-17T19:47:50.488 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:50.501+0000 7fb024c00640 1 -- 172.21.15.44:0/779695540 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v27) ==== 103+0+11 (secure 0 0 0) 0x7fb020010040 con 0x7fb028159140 2024-04-17T19:47:50.489 INFO:teuthology.orchestra.run.smithi044.stdout:pg_num: 32 2024-04-17T19:47:50.491 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:50.501+0000 7fb02fc00640 1 -- 172.21.15.44:0/779695540 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7fb0080683b0 msgr2=0x7fb00806a8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:50.491 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:50.501+0000 7fb02fc00640 1 --2- 172.21.15.44:0/779695540 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7fb0080683b0 0x7fb00806a8c0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fb01c0ad000 tx=0x7fb01c008040 comp rx=0 tx=0).stop 2024-04-17T19:47:50.491 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:50.501+0000 7fb02fc00640 1 -- 172.21.15.44:0/779695540 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb028159140 msgr2=0x7fb02813f330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:50.491 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:50.501+0000 7fb02fc00640 1 --2- 172.21.15.44:0/779695540 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb028159140 0x7fb02813f330 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fb020009cb0 tx=0x7fb02000c490 comp rx=0 tx=0).stop 2024-04-17T19:47:50.491 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:50.501+0000 7fb02fc00640 1 -- 172.21.15.44:0/779695540 shutdown_connections 2024-04-17T19:47:50.491 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:50.501+0000 7fb02fc00640 1 --2- 172.21.15.44:0/779695540 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7fb0080683b0 0x7fb00806a8c0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:50.491 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:50.501+0000 7fb02fc00640 1 --2- 172.21.15.44:0/779695540 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fb028152860 0x7fb028072780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:50.491 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:50.505+0000 7fb02fc00640 1 --2- 172.21.15.44:0/779695540 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb028159140 0x7fb02813f330 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:50.491 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:50.505+0000 7fb02fc00640 1 --2- 172.21.15.44:0/779695540 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb0280c80a0 0x7fb028147ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:50.491 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:50.505+0000 7fb02fc00640 1 -- 172.21.15.44:0/779695540 >> 172.21.15.44:0/779695540 conn(0x7fb02806c380 msgr2=0x7fb028146a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:47:50.492 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:50.505+0000 7fb02fc00640 1 -- 172.21.15.44:0/779695540 shutdown_connections 2024-04-17T19:47:50.492 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:50.505+0000 7fb02fc00640 1 -- 172.21.15.44:0/779695540 wait complete. 2024-04-17T19:47:50.511 INFO:tasks.mon_thrash.ceph_manager:waiting for clean 2024-04-17T19:47:50.511 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-17T19:47:50.661 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:50.673+0000 7fa868c00640 1 Processor -- start 2024-04-17T19:47:50.662 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:50.673+0000 7fa868c00640 1 -- start start 2024-04-17T19:47:50.664 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:50.677+0000 7fa868c00640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fa864073ca0 0x7fa8640c6ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:50.664 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:50.677+0000 7fa868c00640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fa864157f10 0x7fa8640c9430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:50.664 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:50.677+0000 7fa868c00640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa8640c6060 con 0x7fa8640c73f0 2024-04-17T19:47:50.664 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:50.677+0000 7fa868c00640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 -- 0x7fa8640c4aa0 con 0x7fa864073ca0 2024-04-17T19:47:50.664 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:50.677+0000 7fa868c00640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 -- 0x7fa864158320 con 0x7fa864157f10 2024-04-17T19:47:50.664 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:50.677+0000 7fa861e00640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fa864073ca0 0x7fa8640c6ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:50.664 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:50.677+0000 7fa861e00640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fa864073ca0 0x7fa8640c6ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:34484/0 (socket says 172.21.15.44:34484) 2024-04-17T19:47:50.664 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:50.677+0000 7fa861e00640 1 -- 172.21.15.44:0/1589295808 learned_addr learned my addr 172.21.15.44:0/1589295808 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-04-17T19:47:50.665 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:50.677+0000 7fa859400640 1 --1- 172.21.15.44:0/1589295808 >> v1:172.21.15.44:6789/0 conn(0x7fa8640c73f0 0x7fa8641520c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:46898/0 (socket says 172.21.15.44:46898) 2024-04-17T19:47:50.665 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:50.677+0000 7fa862800640 1 --2- 172.21.15.44:0/1589295808 >> v2:172.21.15.62:3300/0 conn(0x7fa864157f10 0x7fa8640c9430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:50.665 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:50.677+0000 7fa861e00640 1 -- 172.21.15.44:0/1589295808 >> v2:172.21.15.62:3300/0 conn(0x7fa864157f10 msgr2=0x7fa8640c9430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T19:47:50.665 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:50.677+0000 7fa861e00640 1 --2- 172.21.15.44:0/1589295808 >> v2:172.21.15.62:3300/0 conn(0x7fa864157f10 0x7fa8640c9430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:50.665 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:50.677+0000 7fa861e00640 1 -- 172.21.15.44:0/1589295808 >> v1:172.21.15.44:6789/0 conn(0x7fa8640c73f0 legacy=0x7fa8641520c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:50.665 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:50.677+0000 7fa861e00640 1 -- 172.21.15.44:0/1589295808 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa8640c79c0 con 0x7fa864073ca0 2024-04-17T19:47:50.667 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:50.681+0000 7fa861e00640 1 --2- 172.21.15.44:0/1589295808 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa864073ca0 0x7fa8640c6ad0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fa8640c3d70 tx=0x7fa84c01ebf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b86ca01465538dca server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:47:50.667 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:50.681+0000 7fa861400640 1 -- 172.21.15.44:0/1589295808 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa84c0b4070 con 0x7fa864073ca0 2024-04-17T19:47:50.667 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:50.681+0000 7fa861400640 1 -- 172.21.15.44:0/1589295808 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa84c0a7b50 con 0x7fa864073ca0 2024-04-17T19:47:50.667 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:50.681+0000 7fa861400640 1 -- 172.21.15.44:0/1589295808 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa84c0af440 con 0x7fa864073ca0 2024-04-17T19:47:50.668 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:50.681+0000 7fa868c00640 1 -- 172.21.15.44:0/1589295808 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa864073ca0 msgr2=0x7fa8640c6ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:50.668 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:50.681+0000 7fa868c00640 1 --2- 172.21.15.44:0/1589295808 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa864073ca0 0x7fa8640c6ad0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fa8640c3d70 tx=0x7fa84c01ebf0 comp rx=0 tx=0).stop 2024-04-17T19:47:50.668 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:50.681+0000 7fa868c00640 1 -- 172.21.15.44:0/1589295808 shutdown_connections 2024-04-17T19:47:50.668 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:50.681+0000 7fa868c00640 1 --2- 172.21.15.44:0/1589295808 >> v2:172.21.15.62:3300/0 conn(0x7fa864157f10 0x7fa8640c9430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:50.668 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:50.681+0000 7fa868c00640 1 --2- 172.21.15.44:0/1589295808 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa864073ca0 0x7fa8640c6ad0 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:50.668 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:50.681+0000 7fa868c00640 1 -- 172.21.15.44:0/1589295808 >> 172.21.15.44:0/1589295808 conn(0x7fa86406c380 msgr2=0x7fa864070080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:47:50.668 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:50.681+0000 7fa868c00640 1 -- 172.21.15.44:0/1589295808 shutdown_connections 2024-04-17T19:47:50.668 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:50.681+0000 7fa868c00640 1 -- 172.21.15.44:0/1589295808 wait complete. 2024-04-17T19:47:50.670 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:50.681+0000 7fa868c00640 1 Processor -- start 2024-04-17T19:47:50.670 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:50.681+0000 7fa868c00640 1 -- start start 2024-04-17T19:47:50.673 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:50.685+0000 7fa868c00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa864073ca0 0x7fa86414a170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:50.673 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:50.685+0000 7fa868c00640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fa8640c73f0 0x7fa864147bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:50.673 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:50.685+0000 7fa868c00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa864157f10 0x7fa864143170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:50.673 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:50.685+0000 7fa868c00640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fa8641648a0 con 0x7fa864073ca0 2024-04-17T19:47:50.673 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:50.685+0000 7fa868c00640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7fa8640c9d80 con 0x7fa864157f10 2024-04-17T19:47:50.673 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:50.685+0000 7fa868c00640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7fa864164a20 con 0x7fa8640c73f0 2024-04-17T19:47:50.673 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:50.685+0000 7fa861e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa864073ca0 0x7fa86414a170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:50.673 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:50.685+0000 7fa861e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa864073ca0 0x7fa86414a170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:34488/0 (socket says 172.21.15.44:34488) 2024-04-17T19:47:50.673 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:50.685+0000 7fa861e00640 1 -- 172.21.15.44:0/3293002402 learned_addr learned my addr 172.21.15.44:0/3293002402 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-04-17T19:47:50.673 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:50.685+0000 7fa862800640 1 --2- 172.21.15.44:0/3293002402 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa864157f10 0x7fa864143170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:50.673 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:50.685+0000 7fa861e00640 1 -- 172.21.15.44:0/3293002402 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fa8640c73f0 msgr2=0x7fa864147bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:50.673 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:50.685+0000 7fa859400640 1 --2- 172.21.15.44:0/3293002402 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fa8640c73f0 0x7fa864147bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:50.674 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:50.685+0000 7fa861e00640 1 --2- 172.21.15.44:0/3293002402 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fa8640c73f0 0x7fa864147bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:50.674 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:50.685+0000 7fa861e00640 1 -- 172.21.15.44:0/3293002402 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa864157f10 msgr2=0x7fa864143170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:50.674 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:50.685+0000 7fa861e00640 1 --2- 172.21.15.44:0/3293002402 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa864157f10 0x7fa864143170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:50.674 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:50.685+0000 7fa861e00640 1 -- 172.21.15.44:0/3293002402 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa8641564f0 con 0x7fa864073ca0 2024-04-17T19:47:50.674 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:50.685+0000 7fa862800640 1 --2- 172.21.15.44:0/3293002402 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa864157f10 0x7fa864143170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-17T19:47:50.674 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:50.685+0000 7fa859400640 1 --2- 172.21.15.44:0/3293002402 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fa8640c73f0 0x7fa864147bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-17T19:47:50.674 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:50.685+0000 7fa861e00640 1 --2- 172.21.15.44:0/3293002402 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa864073ca0 0x7fa86414a170 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fa84c00b2c0 tx=0x7fa84c01b990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:47:50.674 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:50.685+0000 7fa85aa00640 1 -- 172.21.15.44:0/3293002402 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa84c0b4030 con 0x7fa864073ca0 2024-04-17T19:47:50.674 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:50.685+0000 7fa85aa00640 1 -- 172.21.15.44:0/3293002402 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa84c0b6070 con 0x7fa864073ca0 2024-04-17T19:47:50.674 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:50.685+0000 7fa868c00640 1 -- 172.21.15.44:0/3293002402 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa86414a6b0 con 0x7fa864073ca0 2024-04-17T19:47:50.674 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:50.685+0000 7fa85aa00640 1 -- 172.21.15.44:0/3293002402 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa84c0ad790 con 0x7fa864073ca0 2024-04-17T19:47:50.674 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:50.685+0000 7fa868c00640 1 -- 172.21.15.44:0/3293002402 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa86414ab80 con 0x7fa864073ca0 2024-04-17T19:47:50.675 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:50.685+0000 7fa868c00640 1 -- 172.21.15.44:0/3293002402 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa86404ff10 con 0x7fa864073ca0 2024-04-17T19:47:50.675 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:50.689+0000 7fa85aa00640 1 -- 172.21.15.44:0/3293002402 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fa84c0c1060 con 0x7fa864073ca0 2024-04-17T19:47:50.676 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:50.689+0000 7fa85aa00640 1 --2- 172.21.15.44:0/3293002402 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7fa840068380 0x7fa84006a890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:50.676 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:50.689+0000 7fa85aa00640 1 -- 172.21.15.44:0/3293002402 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6619+0+0 (secure 0 0 0) 0x7fa84c121110 con 0x7fa864073ca0 2024-04-17T19:47:50.676 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:50.689+0000 7fa859400640 1 --2- 172.21.15.44:0/3293002402 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7fa840068380 0x7fa84006a890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:50.677 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:50.689+0000 7fa859400640 1 --2- 172.21.15.44:0/3293002402 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7fa840068380 0x7fa84006a890 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fa8640739d0 tx=0x7fa854009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:47:50.681 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:50.693+0000 7fa85aa00640 1 -- 172.21.15.44:0/3293002402 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fa84c0187e0 con 0x7fa864073ca0 2024-04-17T19:47:50.842 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:50.853+0000 7fa868c00640 1 -- 172.21.15.44:0/3293002402 --> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fa864155930 con 0x7fa840068380 2024-04-17T19:47:50.867 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:50.881+0000 7fa85aa00640 1 -- 172.21.15.44:0/3293002402 <== mgr.4102 v2:172.21.15.62:6832/1020159798 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+332733 (secure 0 0 0) 0x7fa864155930 con 0x7fa840068380 2024-04-17T19:47:50.871 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-04-17T19:47:50.873 INFO:teuthology.orchestra.run.smithi044.stderr:dumped all 2024-04-17T19:47:50.874 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:50.885+0000 7fa868c00640 1 -- 172.21.15.44:0/3293002402 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7fa840068380 msgr2=0x7fa84006a890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:50.874 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:50.885+0000 7fa868c00640 1 --2- 172.21.15.44:0/3293002402 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7fa840068380 0x7fa84006a890 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fa8640739d0 tx=0x7fa854009040 comp rx=0 tx=0).stop 2024-04-17T19:47:50.875 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:50.885+0000 7fa868c00640 1 -- 172.21.15.44:0/3293002402 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa864073ca0 msgr2=0x7fa86414a170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:50.875 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:50.885+0000 7fa868c00640 1 --2- 172.21.15.44:0/3293002402 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa864073ca0 0x7fa86414a170 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fa84c00b2c0 tx=0x7fa84c01b990 comp rx=0 tx=0).stop 2024-04-17T19:47:50.875 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:50.885+0000 7fa868c00640 1 -- 172.21.15.44:0/3293002402 shutdown_connections 2024-04-17T19:47:50.875 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:50.885+0000 7fa868c00640 1 --2- 172.21.15.44:0/3293002402 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7fa840068380 0x7fa84006a890 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:50.875 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:50.885+0000 7fa868c00640 1 --2- 172.21.15.44:0/3293002402 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fa8640c73f0 0x7fa864147bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:50.875 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:50.885+0000 7fa868c00640 1 --2- 172.21.15.44:0/3293002402 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa864157f10 0x7fa864143170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:50.875 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:50.885+0000 7fa868c00640 1 --2- 172.21.15.44:0/3293002402 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa864073ca0 0x7fa86414a170 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:50.875 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:50.885+0000 7fa868c00640 1 -- 172.21.15.44:0/3293002402 >> 172.21.15.44:0/3293002402 conn(0x7fa86406c380 msgr2=0x7fa864151450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:47:50.875 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:50.885+0000 7fa868c00640 1 -- 172.21.15.44:0/3293002402 shutdown_connections 2024-04-17T19:47:50.875 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:50.885+0000 7fa868c00640 1 -- 172.21.15.44:0/3293002402 wait complete. 2024-04-17T19:47:50.892 INFO:teuthology.orchestra.run.smithi044.stdout:{"pg_ready":true,"pg_map":{"version":55,"stamp":"2024-04-17T19:47:49.916665+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":600632,"num_objects":100,"num_object_clones":0,"num_object_copies":200,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":100,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":367,"num_write_kb":2482,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":299,"ondisk_log_size":299,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":218740,"kb_used_data":2592,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755980,"statfs":{"total":773094113280,"available":772870123520,"internally_reserved":0,"allocated":2654208,"data_stored":2126112,"data_compressed":66496,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":12751,"internal_metadata":221236785},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2812,"num_objects":35,"num_object_clones":0,"num_object_copies":70,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":35,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":69,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":23,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"11.962611"},"pg_stats":[{"pgid":"2.1f","version":"27'13","reported_seq":39,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:39.941990+0000","last_change":"2024-04-17T19:46:55.688623+0000","last_active":"2024-04-17T19:47:39.941990+0000","last_peered":"2024-04-17T19:47:39.941990+0000","last_clean":"2024-04-17T19:47:39.941990+0000","last_became_active":"2024-04-17T19:46:55.687455+0000","last_became_peered":"2024-04-17T19:46:55.687455+0000","last_unstale":"2024-04-17T19:47:39.941990+0000","last_undegraded":"2024-04-17T19:47:39.941990+0000","last_fullsized":"2024-04-17T19:47:39.941990+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:54.640133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:54.640133+0000","last_clean_scrub_stamp":"2024-04-17T19:46:54.640133+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:02:52.057635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:38.681304+0000","last_change":"2024-04-17T19:46:56.683770+0000","last_active":"2024-04-17T19:47:38.681304+0000","last_peered":"2024-04-17T19:47:38.681304+0000","last_clean":"2024-04-17T19:47:38.681304+0000","last_became_active":"2024-04-17T19:46:56.683111+0000","last_became_peered":"2024-04-17T19:46:56.683111+0000","last_unstale":"2024-04-17T19:47:38.681304+0000","last_undegraded":"2024-04-17T19:47:38.681304+0000","last_fullsized":"2024-04-17T19:47:38.681304+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_clean_scrub_stamp":"2024-04-17T19:46:55.648649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T22:25:59.135091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:37.965689+0000","last_change":"2024-04-17T19:47:00.788461+0000","last_active":"2024-04-17T19:47:37.965689+0000","last_peered":"2024-04-17T19:47:37.965689+0000","last_clean":"2024-04-17T19:47:37.965689+0000","last_became_active":"2024-04-17T19:47:00.787654+0000","last_became_peered":"2024-04-17T19:47:00.787654+0000","last_unstale":"2024-04-17T19:47:37.965689+0000","last_undegraded":"2024-04-17T19:47:37.965689+0000","last_fullsized":"2024-04-17T19:47:37.965689+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_clean_scrub_stamp":"2024-04-17T19:46:59.695482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T07:28:34.234670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4,1],"acting":[7,6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1e","version":"25'2","reported_seq":28,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:38.681324+0000","last_change":"2024-04-17T19:46:55.703749+0000","last_active":"2024-04-17T19:47:38.681324+0000","last_peered":"2024-04-17T19:47:38.681324+0000","last_clean":"2024-04-17T19:47:38.681324+0000","last_became_active":"2024-04-17T19:46:55.695191+0000","last_became_peered":"2024-04-17T19:46:55.695191+0000","last_unstale":"2024-04-17T19:47:38.681324+0000","last_undegraded":"2024-04-17T19:47:38.681324+0000","last_fullsized":"2024-04-17T19:47:38.681324+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:54.640133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:54.640133+0000","last_clean_scrub_stamp":"2024-04-17T19:46:54.640133+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:24:42.573542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:38.681601+0000","last_change":"2024-04-17T19:46:56.684814+0000","last_active":"2024-04-17T19:47:38.681601+0000","last_peered":"2024-04-17T19:47:38.681601+0000","last_clean":"2024-04-17T19:47:38.681601+0000","last_became_active":"2024-04-17T19:46:56.684475+0000","last_became_peered":"2024-04-17T19:46:56.684475+0000","last_unstale":"2024-04-17T19:47:38.681601+0000","last_undegraded":"2024-04-17T19:47:38.681601+0000","last_fullsized":"2024-04-17T19:47:38.681601+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_clean_scrub_stamp":"2024-04-17T19:46:55.648649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T05:38:55.394025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:37.955024+0000","last_change":"2024-04-17T19:47:00.769813+0000","last_active":"2024-04-17T19:47:37.955024+0000","last_peered":"2024-04-17T19:47:37.955024+0000","last_clean":"2024-04-17T19:47:37.955024+0000","last_became_active":"2024-04-17T19:47:00.769370+0000","last_became_peered":"2024-04-17T19:47:00.769370+0000","last_unstale":"2024-04-17T19:47:37.955024+0000","last_undegraded":"2024-04-17T19:47:37.955024+0000","last_fullsized":"2024-04-17T19:47:37.955024+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_clean_scrub_stamp":"2024-04-17T19:46:59.695482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:23:20.430751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,4,6],"acting":[2,7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1d","version":"27'12","reported_seq":38,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:39.944794+0000","last_change":"2024-04-17T19:46:55.695159+0000","last_active":"2024-04-17T19:47:39.944794+0000","last_peered":"2024-04-17T19:47:39.944794+0000","last_clean":"2024-04-17T19:47:39.944794+0000","last_became_active":"2024-04-17T19:46:55.694285+0000","last_became_peered":"2024-04-17T19:46:55.694285+0000","last_unstale":"2024-04-17T19:47:39.944794+0000","last_undegraded":"2024-04-17T19:47:39.944794+0000","last_fullsized":"2024-04-17T19:47:39.944794+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:54.640133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:54.640133+0000","last_clean_scrub_stamp":"2024-04-17T19:46:54.640133+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T04:52:16.008572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:38.680488+0000","last_change":"2024-04-17T19:46:56.700734+0000","last_active":"2024-04-17T19:47:38.680488+0000","last_peered":"2024-04-17T19:47:38.680488+0000","last_clean":"2024-04-17T19:47:38.680488+0000","last_became_active":"2024-04-17T19:46:56.700413+0000","last_became_peered":"2024-04-17T19:46:56.700413+0000","last_unstale":"2024-04-17T19:47:38.680488+0000","last_undegraded":"2024-04-17T19:47:38.680488+0000","last_fullsized":"2024-04-17T19:47:38.680488+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_clean_scrub_stamp":"2024-04-17T19:46:55.648649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:57:40.700986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:37.955497+0000","last_change":"2024-04-17T19:47:00.772341+0000","last_active":"2024-04-17T19:47:37.955497+0000","last_peered":"2024-04-17T19:47:37.955497+0000","last_clean":"2024-04-17T19:47:37.955497+0000","last_became_active":"2024-04-17T19:47:00.771578+0000","last_became_peered":"2024-04-17T19:47:00.771578+0000","last_unstale":"2024-04-17T19:47:37.955497+0000","last_undegraded":"2024-04-17T19:47:37.955497+0000","last_fullsized":"2024-04-17T19:47:37.955497+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_clean_scrub_stamp":"2024-04-17T19:46:59.695482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:51:07.602172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,3,6],"acting":[2,5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1c","version":"27'5","reported_seq":31,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:39.944708+0000","last_change":"2024-04-17T19:46:55.687607+0000","last_active":"2024-04-17T19:47:39.944708+0000","last_peered":"2024-04-17T19:47:39.944708+0000","last_clean":"2024-04-17T19:47:39.944708+0000","last_became_active":"2024-04-17T19:46:55.687282+0000","last_became_peered":"2024-04-17T19:46:55.687282+0000","last_unstale":"2024-04-17T19:47:39.944708+0000","last_undegraded":"2024-04-17T19:47:39.944708+0000","last_fullsized":"2024-04-17T19:47:39.944708+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:54.640133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:54.640133+0000","last_clean_scrub_stamp":"2024-04-17T19:46:54.640133+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T05:52:32.550876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:38.473724+0000","last_change":"2024-04-17T19:46:56.690268+0000","last_active":"2024-04-17T19:47:38.473724+0000","last_peered":"2024-04-17T19:47:38.473724+0000","last_clean":"2024-04-17T19:47:38.473724+0000","last_became_active":"2024-04-17T19:46:56.689988+0000","last_became_peered":"2024-04-17T19:46:56.689988+0000","last_unstale":"2024-04-17T19:47:38.473724+0000","last_undegraded":"2024-04-17T19:47:38.473724+0000","last_fullsized":"2024-04-17T19:47:38.473724+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_clean_scrub_stamp":"2024-04-17T19:46:55.648649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T01:29:59.423734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:37.955248+0000","last_change":"2024-04-17T19:47:00.759608+0000","last_active":"2024-04-17T19:47:37.955248+0000","last_peered":"2024-04-17T19:47:37.955248+0000","last_clean":"2024-04-17T19:47:37.955248+0000","last_became_active":"2024-04-17T19:47:00.759059+0000","last_became_peered":"2024-04-17T19:47:00.759059+0000","last_unstale":"2024-04-17T19:47:37.955248+0000","last_undegraded":"2024-04-17T19:47:37.955248+0000","last_fullsized":"2024-04-17T19:47:37.955248+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_clean_scrub_stamp":"2024-04-17T19:46:59.695482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:22:37.460235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,5,7],"acting":[2,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:38.472984+0000","last_change":"2024-04-17T19:46:56.688273+0000","last_active":"2024-04-17T19:47:38.472984+0000","last_peered":"2024-04-17T19:47:38.472984+0000","last_clean":"2024-04-17T19:47:38.472984+0000","last_became_active":"2024-04-17T19:46:56.687662+0000","last_became_peered":"2024-04-17T19:46:56.687662+0000","last_unstale":"2024-04-17T19:47:38.472984+0000","last_undegraded":"2024-04-17T19:47:38.472984+0000","last_fullsized":"2024-04-17T19:47:38.472984+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_clean_scrub_stamp":"2024-04-17T19:46:55.648649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:51:46.684685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"25'4","reported_seq":30,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:38.473275+0000","last_change":"2024-04-17T19:46:55.692833+0000","last_active":"2024-04-17T19:47:38.473275+0000","last_peered":"2024-04-17T19:47:38.473275+0000","last_clean":"2024-04-17T19:47:38.473275+0000","last_became_active":"2024-04-17T19:46:55.689006+0000","last_became_peered":"2024-04-17T19:46:55.689006+0000","last_unstale":"2024-04-17T19:47:38.473275+0000","last_undegraded":"2024-04-17T19:47:38.473275+0000","last_fullsized":"2024-04-17T19:47:38.473275+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:54.640133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:54.640133+0000","last_clean_scrub_stamp":"2024-04-17T19:46:54.640133+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:57:39.692470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:38.473595+0000","last_change":"2024-04-17T19:47:00.757063+0000","last_active":"2024-04-17T19:47:38.473595+0000","last_peered":"2024-04-17T19:47:38.473595+0000","last_clean":"2024-04-17T19:47:38.473595+0000","last_became_active":"2024-04-17T19:47:00.756456+0000","last_became_peered":"2024-04-17T19:47:00.756456+0000","last_unstale":"2024-04-17T19:47:38.473595+0000","last_undegraded":"2024-04-17T19:47:38.473595+0000","last_fullsized":"2024-04-17T19:47:38.473595+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_clean_scrub_stamp":"2024-04-17T19:46:59.695482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T02:52:51.655611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,5],"acting":[3,1,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:37.966741+0000","last_change":"2024-04-17T19:46:56.691544+0000","last_active":"2024-04-17T19:47:37.966741+0000","last_peered":"2024-04-17T19:47:37.966741+0000","last_clean":"2024-04-17T19:47:37.966741+0000","last_became_active":"2024-04-17T19:46:56.690828+0000","last_became_peered":"2024-04-17T19:46:56.690828+0000","last_unstale":"2024-04-17T19:47:37.966741+0000","last_undegraded":"2024-04-17T19:47:37.966741+0000","last_fullsized":"2024-04-17T19:47:37.966741+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_clean_scrub_stamp":"2024-04-17T19:46:55.648649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:11:01.745657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.a","version":"27'3","reported_seq":29,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:37.960376+0000","last_change":"2024-04-17T19:46:55.715857+0000","last_active":"2024-04-17T19:47:37.960376+0000","last_peered":"2024-04-17T19:47:37.960376+0000","last_clean":"2024-04-17T19:47:37.960376+0000","last_became_active":"2024-04-17T19:46:55.715197+0000","last_became_peered":"2024-04-17T19:46:55.715197+0000","last_unstale":"2024-04-17T19:47:37.960376+0000","last_undegraded":"2024-04-17T19:47:37.960376+0000","last_fullsized":"2024-04-17T19:47:37.960376+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:54.640133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:54.640133+0000","last_clean_scrub_stamp":"2024-04-17T19:46:54.640133+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:25:07.379181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:37.958849+0000","last_change":"2024-04-17T19:47:00.773528+0000","last_active":"2024-04-17T19:47:37.958849+0000","last_peered":"2024-04-17T19:47:37.958849+0000","last_clean":"2024-04-17T19:47:37.958849+0000","last_became_active":"2024-04-17T19:47:00.773077+0000","last_became_peered":"2024-04-17T19:47:00.773077+0000","last_unstale":"2024-04-17T19:47:37.958849+0000","last_undegraded":"2024-04-17T19:47:37.958849+0000","last_fullsized":"2024-04-17T19:47:37.958849+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_clean_scrub_stamp":"2024-04-17T19:46:59.695482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T02:53:18.654740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,6,1],"acting":[0,4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:37.956292+0000","last_change":"2024-04-17T19:46:56.695617+0000","last_active":"2024-04-17T19:47:37.956292+0000","last_peered":"2024-04-17T19:47:37.956292+0000","last_clean":"2024-04-17T19:47:37.956292+0000","last_became_active":"2024-04-17T19:46:56.695205+0000","last_became_peered":"2024-04-17T19:46:56.695205+0000","last_unstale":"2024-04-17T19:47:37.956292+0000","last_undegraded":"2024-04-17T19:47:37.956292+0000","last_fullsized":"2024-04-17T19:47:37.956292+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_clean_scrub_stamp":"2024-04-17T19:46:55.648649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T05:05:36.718886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"27'7","reported_seq":33,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:39.942290+0000","last_change":"2024-04-17T19:46:55.686220+0000","last_active":"2024-04-17T19:47:39.942290+0000","last_peered":"2024-04-17T19:47:39.942290+0000","last_clean":"2024-04-17T19:47:39.942290+0000","last_became_active":"2024-04-17T19:46:55.684782+0000","last_became_peered":"2024-04-17T19:46:55.684782+0000","last_unstale":"2024-04-17T19:47:39.942290+0000","last_undegraded":"2024-04-17T19:47:39.942290+0000","last_fullsized":"2024-04-17T19:47:39.942290+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:54.640133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:54.640133+0000","last_clean_scrub_stamp":"2024-04-17T19:46:54.640133+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:57:31.750325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":12,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:38.474847+0000","last_change":"2024-04-17T19:47:38.474847+0000","last_active":"2024-04-17T19:47:38.474847+0000","last_peered":"2024-04-17T19:47:38.474847+0000","last_clean":"2024-04-17T19:47:38.474847+0000","last_became_active":"2024-04-17T19:47:38.474208+0000","last_became_peered":"2024-04-17T19:47:38.474208+0000","last_unstale":"2024-04-17T19:47:38.474847+0000","last_undegraded":"2024-04-17T19:47:38.474847+0000","last_fullsized":"2024-04-17T19:47:38.474847+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_clean_scrub_stamp":"2024-04-17T19:46:59.695482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T05:15:30.939022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2,3],"acting":[0,4,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:38.472652+0000","last_change":"2024-04-17T19:46:56.700069+0000","last_active":"2024-04-17T19:47:38.472652+0000","last_peered":"2024-04-17T19:47:38.472652+0000","last_clean":"2024-04-17T19:47:38.472652+0000","last_became_active":"2024-04-17T19:46:56.699525+0000","last_became_peered":"2024-04-17T19:46:56.699525+0000","last_unstale":"2024-04-17T19:47:38.472652+0000","last_undegraded":"2024-04-17T19:47:38.472652+0000","last_fullsized":"2024-04-17T19:47:38.472652+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_clean_scrub_stamp":"2024-04-17T19:46:55.648649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T00:28:36.944531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.8","version":"25'2","reported_seq":28,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:37.958651+0000","last_change":"2024-04-17T19:46:55.684594+0000","last_active":"2024-04-17T19:47:37.958651+0000","last_peered":"2024-04-17T19:47:37.958651+0000","last_clean":"2024-04-17T19:47:37.958651+0000","last_became_active":"2024-04-17T19:46:55.683145+0000","last_became_peered":"2024-04-17T19:46:55.683145+0000","last_unstale":"2024-04-17T19:47:37.958651+0000","last_undegraded":"2024-04-17T19:47:37.958651+0000","last_fullsized":"2024-04-17T19:47:37.958651+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:54.640133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:54.640133+0000","last_clean_scrub_stamp":"2024-04-17T19:46:54.640133+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T02:39:08.241534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:37.956099+0000","last_change":"2024-04-17T19:47:00.768781+0000","last_active":"2024-04-17T19:47:37.956099+0000","last_peered":"2024-04-17T19:47:37.956099+0000","last_clean":"2024-04-17T19:47:37.956099+0000","last_became_active":"2024-04-17T19:47:00.768277+0000","last_became_peered":"2024-04-17T19:47:00.768277+0000","last_unstale":"2024-04-17T19:47:37.956099+0000","last_undegraded":"2024-04-17T19:47:37.956099+0000","last_fullsized":"2024-04-17T19:47:37.956099+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_clean_scrub_stamp":"2024-04-17T19:46:59.695482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:07:00.936098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,7],"acting":[2,1,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:37.959400+0000","last_change":"2024-04-17T19:46:56.695528+0000","last_active":"2024-04-17T19:47:37.959400+0000","last_peered":"2024-04-17T19:47:37.959400+0000","last_clean":"2024-04-17T19:47:37.959400+0000","last_became_active":"2024-04-17T19:46:56.694993+0000","last_became_peered":"2024-04-17T19:46:56.694993+0000","last_unstale":"2024-04-17T19:47:37.959400+0000","last_undegraded":"2024-04-17T19:47:37.959400+0000","last_fullsized":"2024-04-17T19:47:37.959400+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_clean_scrub_stamp":"2024-04-17T19:46:55.648649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:08:14.848448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"27'7","reported_seq":33,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:39.945807+0000","last_change":"2024-04-17T19:46:55.688859+0000","last_active":"2024-04-17T19:47:39.945807+0000","last_peered":"2024-04-17T19:47:39.945807+0000","last_clean":"2024-04-17T19:47:39.945807+0000","last_became_active":"2024-04-17T19:46:55.688507+0000","last_became_peered":"2024-04-17T19:46:55.688507+0000","last_unstale":"2024-04-17T19:47:39.945807+0000","last_undegraded":"2024-04-17T19:47:39.945807+0000","last_fullsized":"2024-04-17T19:47:39.945807+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:54.640133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:54.640133+0000","last_clean_scrub_stamp":"2024-04-17T19:46:54.640133+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T01:53:38.377482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:37.955118+0000","last_change":"2024-04-17T19:47:00.781482+0000","last_active":"2024-04-17T19:47:37.955118+0000","last_peered":"2024-04-17T19:47:37.955118+0000","last_clean":"2024-04-17T19:47:37.955118+0000","last_became_active":"2024-04-17T19:47:00.780994+0000","last_became_peered":"2024-04-17T19:47:00.780994+0000","last_unstale":"2024-04-17T19:47:37.955118+0000","last_undegraded":"2024-04-17T19:47:37.955118+0000","last_fullsized":"2024-04-17T19:47:37.955118+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_clean_scrub_stamp":"2024-04-17T19:46:59.695482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T01:46:40.550031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,3,1],"acting":[2,6,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:37.962746+0000","last_change":"2024-04-17T19:46:56.695874+0000","last_active":"2024-04-17T19:47:37.962746+0000","last_peered":"2024-04-17T19:47:37.962746+0000","last_clean":"2024-04-17T19:47:37.962746+0000","last_became_active":"2024-04-17T19:46:56.694650+0000","last_became_peered":"2024-04-17T19:46:56.694650+0000","last_unstale":"2024-04-17T19:47:37.962746+0000","last_undegraded":"2024-04-17T19:47:37.962746+0000","last_fullsized":"2024-04-17T19:47:37.962746+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_clean_scrub_stamp":"2024-04-17T19:46:55.648649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:44:38.787541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"25'7","reported_seq":33,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:37.959993+0000","last_change":"2024-04-17T19:46:55.684490+0000","last_active":"2024-04-17T19:47:37.959993+0000","last_peered":"2024-04-17T19:47:37.959993+0000","last_clean":"2024-04-17T19:47:37.959993+0000","last_became_active":"2024-04-17T19:46:55.680100+0000","last_became_peered":"2024-04-17T19:46:55.680100+0000","last_unstale":"2024-04-17T19:47:37.959993+0000","last_undegraded":"2024-04-17T19:47:37.959993+0000","last_fullsized":"2024-04-17T19:47:37.959993+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:54.640133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:54.640133+0000","last_clean_scrub_stamp":"2024-04-17T19:46:54.640133+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:27:38.256174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:37.956166+0000","last_change":"2024-04-17T19:47:00.777588+0000","last_active":"2024-04-17T19:47:37.956166+0000","last_peered":"2024-04-17T19:47:37.956166+0000","last_clean":"2024-04-17T19:47:37.956166+0000","last_became_active":"2024-04-17T19:47:00.776873+0000","last_became_peered":"2024-04-17T19:47:00.776873+0000","last_unstale":"2024-04-17T19:47:37.956166+0000","last_undegraded":"2024-04-17T19:47:37.956166+0000","last_fullsized":"2024-04-17T19:47:37.956166+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_clean_scrub_stamp":"2024-04-17T19:46:59.695482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T02:52:42.471996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,6,3],"acting":[4,1,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:37.961483+0000","last_change":"2024-04-17T19:46:56.681681+0000","last_active":"2024-04-17T19:47:37.961483+0000","last_peered":"2024-04-17T19:47:37.961483+0000","last_clean":"2024-04-17T19:47:37.961483+0000","last_became_active":"2024-04-17T19:46:56.681316+0000","last_became_peered":"2024-04-17T19:46:56.681316+0000","last_unstale":"2024-04-17T19:47:37.961483+0000","last_undegraded":"2024-04-17T19:47:37.961483+0000","last_fullsized":"2024-04-17T19:47:37.961483+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_clean_scrub_stamp":"2024-04-17T19:46:55.648649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T07:28:30.187837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"27'4","reported_seq":30,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:38.474045+0000","last_change":"2024-04-17T19:46:55.692826+0000","last_active":"2024-04-17T19:47:38.474045+0000","last_peered":"2024-04-17T19:47:38.474045+0000","last_clean":"2024-04-17T19:47:38.474045+0000","last_became_active":"2024-04-17T19:46:55.691031+0000","last_became_peered":"2024-04-17T19:46:55.691031+0000","last_unstale":"2024-04-17T19:47:38.474045+0000","last_undegraded":"2024-04-17T19:47:38.474045+0000","last_fullsized":"2024-04-17T19:47:38.474045+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:54.640133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:54.640133+0000","last_clean_scrub_stamp":"2024-04-17T19:46:54.640133+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T05:52:32.550876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:37.959441+0000","last_change":"2024-04-17T19:47:00.777416+0000","last_active":"2024-04-17T19:47:37.959441+0000","last_peered":"2024-04-17T19:47:37.959441+0000","last_clean":"2024-04-17T19:47:37.959441+0000","last_became_active":"2024-04-17T19:47:00.771531+0000","last_became_peered":"2024-04-17T19:47:00.771531+0000","last_unstale":"2024-04-17T19:47:37.959441+0000","last_undegraded":"2024-04-17T19:47:37.959441+0000","last_fullsized":"2024-04-17T19:47:37.959441+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_clean_scrub_stamp":"2024-04-17T19:46:59.695482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:30:31.288100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,2,7],"acting":[6,0,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:37.955789+0000","last_change":"2024-04-17T19:46:56.692250+0000","last_active":"2024-04-17T19:47:37.955789+0000","last_peered":"2024-04-17T19:47:37.955789+0000","last_clean":"2024-04-17T19:47:37.955789+0000","last_became_active":"2024-04-17T19:46:56.691801+0000","last_became_peered":"2024-04-17T19:46:56.691801+0000","last_unstale":"2024-04-17T19:47:37.955789+0000","last_undegraded":"2024-04-17T19:47:37.955789+0000","last_fullsized":"2024-04-17T19:47:37.955789+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_clean_scrub_stamp":"2024-04-17T19:46:55.648649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T01:53:39.385998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"25'1","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:38.680963+0000","last_change":"2024-04-17T19:46:55.713556+0000","last_active":"2024-04-17T19:47:38.680963+0000","last_peered":"2024-04-17T19:47:38.680963+0000","last_clean":"2024-04-17T19:47:38.680963+0000","last_became_active":"2024-04-17T19:46:55.712908+0000","last_became_peered":"2024-04-17T19:46:55.712908+0000","last_unstale":"2024-04-17T19:47:38.680963+0000","last_undegraded":"2024-04-17T19:47:38.680963+0000","last_fullsized":"2024-04-17T19:47:38.680963+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:54.640133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:54.640133+0000","last_clean_scrub_stamp":"2024-04-17T19:46:54.640133+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:57:31.750325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:37.959212+0000","last_change":"2024-04-17T19:47:00.776868+0000","last_active":"2024-04-17T19:47:37.959212+0000","last_peered":"2024-04-17T19:47:37.959212+0000","last_clean":"2024-04-17T19:47:37.959212+0000","last_became_active":"2024-04-17T19:47:00.771385+0000","last_became_peered":"2024-04-17T19:47:00.771385+0000","last_unstale":"2024-04-17T19:47:37.959212+0000","last_undegraded":"2024-04-17T19:47:37.959212+0000","last_fullsized":"2024-04-17T19:47:37.959212+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_clean_scrub_stamp":"2024-04-17T19:46:59.695482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T01:46:40.550031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5,7],"acting":[6,3,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:37.959076+0000","last_change":"2024-04-17T19:46:56.709288+0000","last_active":"2024-04-17T19:47:37.959076+0000","last_peered":"2024-04-17T19:47:37.959076+0000","last_clean":"2024-04-17T19:47:37.959076+0000","last_became_active":"2024-04-17T19:46:56.708572+0000","last_became_peered":"2024-04-17T19:46:56.708572+0000","last_unstale":"2024-04-17T19:47:37.959076+0000","last_undegraded":"2024-04-17T19:47:37.959076+0000","last_fullsized":"2024-04-17T19:47:37.959076+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_clean_scrub_stamp":"2024-04-17T19:46:55.648649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:51:03.555339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"27'5","reported_seq":31,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:39.945558+0000","last_change":"2024-04-17T19:46:55.708506+0000","last_active":"2024-04-17T19:47:39.945558+0000","last_peered":"2024-04-17T19:47:39.945558+0000","last_clean":"2024-04-17T19:47:39.945558+0000","last_became_active":"2024-04-17T19:46:55.708175+0000","last_became_peered":"2024-04-17T19:46:55.708175+0000","last_unstale":"2024-04-17T19:47:39.945558+0000","last_undegraded":"2024-04-17T19:47:39.945558+0000","last_fullsized":"2024-04-17T19:47:39.945558+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:54.640133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:54.640133+0000","last_clean_scrub_stamp":"2024-04-17T19:46:54.640133+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T22:25:04.163982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:37.961026+0000","last_change":"2024-04-17T19:47:00.786657+0000","last_active":"2024-04-17T19:47:37.961026+0000","last_peered":"2024-04-17T19:47:37.961026+0000","last_clean":"2024-04-17T19:47:37.961026+0000","last_became_active":"2024-04-17T19:47:00.780743+0000","last_became_peered":"2024-04-17T19:47:00.780743+0000","last_unstale":"2024-04-17T19:47:37.961026+0000","last_undegraded":"2024-04-17T19:47:37.961026+0000","last_fullsized":"2024-04-17T19:47:37.961026+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_clean_scrub_stamp":"2024-04-17T19:46:59.695482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:07:00.936098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0,3],"acting":[6,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:38.680049+0000","last_change":"2024-04-17T19:46:56.679752+0000","last_active":"2024-04-17T19:47:38.680049+0000","last_peered":"2024-04-17T19:47:38.680049+0000","last_clean":"2024-04-17T19:47:38.680049+0000","last_became_active":"2024-04-17T19:46:56.679230+0000","last_became_peered":"2024-04-17T19:46:56.679230+0000","last_unstale":"2024-04-17T19:47:38.680049+0000","last_undegraded":"2024-04-17T19:47:38.680049+0000","last_fullsized":"2024-04-17T19:47:38.680049+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_clean_scrub_stamp":"2024-04-17T19:46:55.648649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:08:14.848448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"27'5","reported_seq":31,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:37.966499+0000","last_change":"2024-04-17T19:46:55.715967+0000","last_active":"2024-04-17T19:47:37.966499+0000","last_peered":"2024-04-17T19:47:37.966499+0000","last_clean":"2024-04-17T19:47:37.966499+0000","last_became_active":"2024-04-17T19:46:55.715247+0000","last_became_peered":"2024-04-17T19:46:55.715247+0000","last_unstale":"2024-04-17T19:47:37.966499+0000","last_undegraded":"2024-04-17T19:47:37.966499+0000","last_fullsized":"2024-04-17T19:47:37.966499+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:54.640133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:54.640133+0000","last_clean_scrub_stamp":"2024-04-17T19:46:54.640133+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T00:40:58.757373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:37.963823+0000","last_change":"2024-04-17T19:47:00.769901+0000","last_active":"2024-04-17T19:47:37.963823+0000","last_peered":"2024-04-17T19:47:37.963823+0000","last_clean":"2024-04-17T19:47:37.963823+0000","last_became_active":"2024-04-17T19:47:00.768634+0000","last_became_peered":"2024-04-17T19:47:00.768634+0000","last_unstale":"2024-04-17T19:47:37.963823+0000","last_undegraded":"2024-04-17T19:47:37.963823+0000","last_fullsized":"2024-04-17T19:47:37.963823+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_clean_scrub_stamp":"2024-04-17T19:46:59.695482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T04:48:47.816818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,7],"acting":[6,0,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:37.959325+0000","last_change":"2024-04-17T19:46:56.703467+0000","last_active":"2024-04-17T19:47:37.959325+0000","last_peered":"2024-04-17T19:47:37.959325+0000","last_clean":"2024-04-17T19:47:37.959325+0000","last_became_active":"2024-04-17T19:46:56.703148+0000","last_became_peered":"2024-04-17T19:46:56.703148+0000","last_unstale":"2024-04-17T19:47:37.959325+0000","last_undegraded":"2024-04-17T19:47:37.959325+0000","last_fullsized":"2024-04-17T19:47:37.959325+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_clean_scrub_stamp":"2024-04-17T19:46:55.648649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T22:01:49.863892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"27'4","reported_seq":30,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:38.472900+0000","last_change":"2024-04-17T19:46:55.715941+0000","last_active":"2024-04-17T19:47:38.472900+0000","last_peered":"2024-04-17T19:47:38.472900+0000","last_clean":"2024-04-17T19:47:38.472900+0000","last_became_active":"2024-04-17T19:46:55.715527+0000","last_became_peered":"2024-04-17T19:46:55.715527+0000","last_unstale":"2024-04-17T19:47:38.472900+0000","last_undegraded":"2024-04-17T19:47:38.472900+0000","last_fullsized":"2024-04-17T19:47:38.472900+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:54.640133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:54.640133+0000","last_clean_scrub_stamp":"2024-04-17T19:46:54.640133+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:11:00.737141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:38.680961+0000","last_change":"2024-04-17T19:47:00.784031+0000","last_active":"2024-04-17T19:47:38.680961+0000","last_peered":"2024-04-17T19:47:38.680961+0000","last_clean":"2024-04-17T19:47:38.680961+0000","last_became_active":"2024-04-17T19:47:00.783386+0000","last_became_peered":"2024-04-17T19:47:00.783386+0000","last_unstale":"2024-04-17T19:47:38.680961+0000","last_undegraded":"2024-04-17T19:47:38.680961+0000","last_fullsized":"2024-04-17T19:47:38.680961+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_clean_scrub_stamp":"2024-04-17T19:46:59.695482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:00:44.689926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6,1],"acting":[5,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:37.957296+0000","last_change":"2024-04-17T19:46:56.692287+0000","last_active":"2024-04-17T19:47:37.957296+0000","last_peered":"2024-04-17T19:47:37.957296+0000","last_clean":"2024-04-17T19:47:37.957296+0000","last_became_active":"2024-04-17T19:46:56.691917+0000","last_became_peered":"2024-04-17T19:46:56.691917+0000","last_unstale":"2024-04-17T19:47:37.957296+0000","last_undegraded":"2024-04-17T19:47:37.957296+0000","last_fullsized":"2024-04-17T19:47:37.957296+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_clean_scrub_stamp":"2024-04-17T19:46:55.648649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T07:37:05.790432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.3","version":"27'6","reported_seq":32,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:38.473446+0000","last_change":"2024-04-17T19:46:55.686031+0000","last_active":"2024-04-17T19:47:38.473446+0000","last_peered":"2024-04-17T19:47:38.473446+0000","last_clean":"2024-04-17T19:47:38.473446+0000","last_became_active":"2024-04-17T19:46:55.685599+0000","last_became_peered":"2024-04-17T19:46:55.685599+0000","last_unstale":"2024-04-17T19:47:38.473446+0000","last_undegraded":"2024-04-17T19:47:38.473446+0000","last_fullsized":"2024-04-17T19:47:38.473446+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:54.640133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:54.640133+0000","last_clean_scrub_stamp":"2024-04-17T19:46:54.640133+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T01:39:32.586696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":182,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:38.680037+0000","last_change":"2024-04-17T19:46:43.000943+0000","last_active":"2024-04-17T19:47:38.680037+0000","last_peered":"2024-04-17T19:47:38.680037+0000","last_clean":"2024-04-17T19:47:38.680037+0000","last_became_active":"2024-04-17T19:46:43.000652+0000","last_became_peered":"2024-04-17T19:46:43.000652+0000","last_unstale":"2024-04-17T19:47:38.680037+0000","last_undegraded":"2024-04-17T19:47:38.680037+0000","last_fullsized":"2024-04-17T19:47:38.680037+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:41.988197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:41.988197+0000","last_clean_scrub_stamp":"2024-04-17T19:46:41.988197+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T19:53:52.845547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:38.473843+0000","last_change":"2024-04-17T19:47:00.731680+0000","last_active":"2024-04-17T19:47:38.473843+0000","last_peered":"2024-04-17T19:47:38.473843+0000","last_clean":"2024-04-17T19:47:38.473843+0000","last_became_active":"2024-04-17T19:47:00.731093+0000","last_became_peered":"2024-04-17T19:47:00.731093+0000","last_unstale":"2024-04-17T19:47:38.473843+0000","last_undegraded":"2024-04-17T19:47:38.473843+0000","last_fullsized":"2024-04-17T19:47:38.473843+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_clean_scrub_stamp":"2024-04-17T19:46:59.695482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T04:59:23.336626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:38.473799+0000","last_change":"2024-04-17T19:46:56.692443+0000","last_active":"2024-04-17T19:47:38.473799+0000","last_peered":"2024-04-17T19:47:38.473799+0000","last_clean":"2024-04-17T19:47:38.473799+0000","last_became_active":"2024-04-17T19:46:56.692106+0000","last_became_peered":"2024-04-17T19:46:56.692106+0000","last_unstale":"2024-04-17T19:47:38.473799+0000","last_undegraded":"2024-04-17T19:47:38.473799+0000","last_fullsized":"2024-04-17T19:47:38.473799+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_clean_scrub_stamp":"2024-04-17T19:46:55.648649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T04:07:54.102221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.c","version":"25'5","reported_seq":31,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:37.961966+0000","last_change":"2024-04-17T19:46:55.689884+0000","last_active":"2024-04-17T19:47:37.961966+0000","last_peered":"2024-04-17T19:47:37.961966+0000","last_clean":"2024-04-17T19:47:37.961966+0000","last_became_active":"2024-04-17T19:46:55.689059+0000","last_became_peered":"2024-04-17T19:46:55.689059+0000","last_unstale":"2024-04-17T19:47:37.961966+0000","last_undegraded":"2024-04-17T19:47:37.961966+0000","last_fullsized":"2024-04-17T19:47:37.961966+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:54.640133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:54.640133+0000","last_clean_scrub_stamp":"2024-04-17T19:46:54.640133+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T04:52:16.008572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1170,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:37.955292+0000","last_change":"2024-04-17T19:47:00.760432+0000","last_active":"2024-04-17T19:47:37.955292+0000","last_peered":"2024-04-17T19:47:37.955292+0000","last_clean":"2024-04-17T19:47:37.955292+0000","last_became_active":"2024-04-17T19:47:00.759946+0000","last_became_peered":"2024-04-17T19:47:00.759946+0000","last_unstale":"2024-04-17T19:47:37.955292+0000","last_undegraded":"2024-04-17T19:47:37.955292+0000","last_fullsized":"2024-04-17T19:47:37.955292+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_clean_scrub_stamp":"2024-04-17T19:46:59.695482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:30:31.288100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,7,4],"acting":[2,3,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":10,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:37.971066+0000","last_change":"2024-04-17T19:47:37.967945+0000","last_active":"2024-04-17T19:47:37.971066+0000","last_peered":"2024-04-17T19:47:37.971066+0000","last_clean":"2024-04-17T19:47:37.971066+0000","last_became_active":"2024-04-17T19:47:37.967613+0000","last_became_peered":"2024-04-17T19:47:37.967613+0000","last_unstale":"2024-04-17T19:47:37.971066+0000","last_undegraded":"2024-04-17T19:47:37.971066+0000","last_fullsized":"2024-04-17T19:47:37.971066+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_clean_scrub_stamp":"2024-04-17T19:46:55.648649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:31:43.713056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.d","version":"27'3","reported_seq":29,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:38.681511+0000","last_change":"2024-04-17T19:46:55.704346+0000","last_active":"2024-04-17T19:47:38.681511+0000","last_peered":"2024-04-17T19:47:38.681511+0000","last_clean":"2024-04-17T19:47:38.681511+0000","last_became_active":"2024-04-17T19:46:55.703334+0000","last_became_peered":"2024-04-17T19:46:55.703334+0000","last_unstale":"2024-04-17T19:47:38.681511+0000","last_undegraded":"2024-04-17T19:47:38.681511+0000","last_fullsized":"2024-04-17T19:47:38.681511+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:54.640133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:54.640133+0000","last_clean_scrub_stamp":"2024-04-17T19:46:54.640133+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:01:11.327106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:38.680615+0000","last_change":"2024-04-17T19:47:00.745450+0000","last_active":"2024-04-17T19:47:38.680615+0000","last_peered":"2024-04-17T19:47:38.680615+0000","last_clean":"2024-04-17T19:47:38.680615+0000","last_became_active":"2024-04-17T19:47:00.744227+0000","last_became_peered":"2024-04-17T19:47:00.744227+0000","last_unstale":"2024-04-17T19:47:38.680615+0000","last_undegraded":"2024-04-17T19:47:38.680615+0000","last_fullsized":"2024-04-17T19:47:38.680615+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_clean_scrub_stamp":"2024-04-17T19:46:59.695482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:52:15.523817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1,3],"acting":[5,4,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:37.960492+0000","last_change":"2024-04-17T19:46:56.687926+0000","last_active":"2024-04-17T19:47:37.960492+0000","last_peered":"2024-04-17T19:47:37.960492+0000","last_clean":"2024-04-17T19:47:37.960492+0000","last_became_active":"2024-04-17T19:46:56.687352+0000","last_became_peered":"2024-04-17T19:46:56.687352+0000","last_unstale":"2024-04-17T19:47:37.960492+0000","last_undegraded":"2024-04-17T19:47:37.960492+0000","last_fullsized":"2024-04-17T19:47:37.960492+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_clean_scrub_stamp":"2024-04-17T19:46:55.648649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T01:32:52.608291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.e","version":"27'5","reported_seq":31,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:39.943513+0000","last_change":"2024-04-17T19:46:55.716397+0000","last_active":"2024-04-17T19:47:39.943513+0000","last_peered":"2024-04-17T19:47:39.943513+0000","last_clean":"2024-04-17T19:47:39.943513+0000","last_became_active":"2024-04-17T19:46:55.715196+0000","last_became_peered":"2024-04-17T19:46:55.715196+0000","last_unstale":"2024-04-17T19:47:39.943513+0000","last_undegraded":"2024-04-17T19:47:39.943513+0000","last_fullsized":"2024-04-17T19:47:39.943513+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:54.640133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:54.640133+0000","last_clean_scrub_stamp":"2024-04-17T19:46:54.640133+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:24:42.573542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:38.472456+0000","last_change":"2024-04-17T19:47:00.735608+0000","last_active":"2024-04-17T19:47:38.472456+0000","last_peered":"2024-04-17T19:47:38.472456+0000","last_clean":"2024-04-17T19:47:38.472456+0000","last_became_active":"2024-04-17T19:47:00.735120+0000","last_became_peered":"2024-04-17T19:47:00.735120+0000","last_unstale":"2024-04-17T19:47:38.472456+0000","last_undegraded":"2024-04-17T19:47:38.472456+0000","last_fullsized":"2024-04-17T19:47:38.472456+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_clean_scrub_stamp":"2024-04-17T19:46:59.695482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T04:40:43.846198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:37.956463+0000","last_change":"2024-04-17T19:46:56.706026+0000","last_active":"2024-04-17T19:47:37.956463+0000","last_peered":"2024-04-17T19:47:37.956463+0000","last_clean":"2024-04-17T19:47:37.956463+0000","last_became_active":"2024-04-17T19:46:56.704786+0000","last_became_peered":"2024-04-17T19:46:56.704786+0000","last_unstale":"2024-04-17T19:47:37.956463+0000","last_undegraded":"2024-04-17T19:47:37.956463+0000","last_fullsized":"2024-04-17T19:47:37.956463+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_clean_scrub_stamp":"2024-04-17T19:46:55.648649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:59:17.441539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.f","version":"25'2","reported_seq":28,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:37.960546+0000","last_change":"2024-04-17T19:46:55.707082+0000","last_active":"2024-04-17T19:47:37.960546+0000","last_peered":"2024-04-17T19:47:37.960546+0000","last_clean":"2024-04-17T19:47:37.960546+0000","last_became_active":"2024-04-17T19:46:55.706729+0000","last_became_peered":"2024-04-17T19:46:55.706729+0000","last_unstale":"2024-04-17T19:47:37.960546+0000","last_undegraded":"2024-04-17T19:47:37.960546+0000","last_fullsized":"2024-04-17T19:47:37.960546+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:54.640133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:54.640133+0000","last_clean_scrub_stamp":"2024-04-17T19:46:54.640133+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:11:00.737141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:38.680019+0000","last_change":"2024-04-17T19:47:00.744054+0000","last_active":"2024-04-17T19:47:38.680019+0000","last_peered":"2024-04-17T19:47:38.680019+0000","last_clean":"2024-04-17T19:47:38.680019+0000","last_became_active":"2024-04-17T19:47:00.743582+0000","last_became_peered":"2024-04-17T19:47:00.743582+0000","last_unstale":"2024-04-17T19:47:38.680019+0000","last_undegraded":"2024-04-17T19:47:38.680019+0000","last_fullsized":"2024-04-17T19:47:38.680019+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_clean_scrub_stamp":"2024-04-17T19:46:59.695482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T22:25:09.219331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,2],"acting":[1,5,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:38.472657+0000","last_change":"2024-04-17T19:46:56.692435+0000","last_active":"2024-04-17T19:47:38.472657+0000","last_peered":"2024-04-17T19:47:38.472657+0000","last_clean":"2024-04-17T19:47:38.472657+0000","last_became_active":"2024-04-17T19:46:56.692038+0000","last_became_peered":"2024-04-17T19:46:56.692038+0000","last_unstale":"2024-04-17T19:47:38.472657+0000","last_undegraded":"2024-04-17T19:47:38.472657+0000","last_fullsized":"2024-04-17T19:47:38.472657+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_clean_scrub_stamp":"2024-04-17T19:46:55.648649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:06:56.889266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.10","version":"27'17","reported_seq":43,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:37.956615+0000","last_change":"2024-04-17T19:46:55.692188+0000","last_active":"2024-04-17T19:47:37.956615+0000","last_peered":"2024-04-17T19:47:37.956615+0000","last_clean":"2024-04-17T19:47:37.956615+0000","last_became_active":"2024-04-17T19:46:55.691286+0000","last_became_peered":"2024-04-17T19:46:55.691286+0000","last_unstale":"2024-04-17T19:47:37.956615+0000","last_undegraded":"2024-04-17T19:47:37.956615+0000","last_fullsized":"2024-04-17T19:47:37.956615+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:54.640133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:54.640133+0000","last_clean_scrub_stamp":"2024-04-17T19:46:54.640133+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:01:11.327106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:38.681208+0000","last_change":"2024-04-17T19:47:00.781167+0000","last_active":"2024-04-17T19:47:38.681208+0000","last_peered":"2024-04-17T19:47:38.681208+0000","last_clean":"2024-04-17T19:47:38.681208+0000","last_became_active":"2024-04-17T19:47:00.780167+0000","last_became_peered":"2024-04-17T19:47:00.780167+0000","last_unstale":"2024-04-17T19:47:38.681208+0000","last_undegraded":"2024-04-17T19:47:38.681208+0000","last_fullsized":"2024-04-17T19:47:38.681208+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_clean_scrub_stamp":"2024-04-17T19:46:59.695482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T00:07:51.831352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1,6],"acting":[5,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:38.679918+0000","last_change":"2024-04-17T19:46:56.676150+0000","last_active":"2024-04-17T19:47:38.679918+0000","last_peered":"2024-04-17T19:47:38.679918+0000","last_clean":"2024-04-17T19:47:38.679918+0000","last_became_active":"2024-04-17T19:46:56.675826+0000","last_became_peered":"2024-04-17T19:46:56.675826+0000","last_unstale":"2024-04-17T19:47:38.679918+0000","last_undegraded":"2024-04-17T19:47:38.679918+0000","last_fullsized":"2024-04-17T19:47:38.679918+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_clean_scrub_stamp":"2024-04-17T19:46:55.648649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T04:52:17.017088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.11","version":"25'5","reported_seq":31,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:37.958832+0000","last_change":"2024-04-17T19:46:55.682001+0000","last_active":"2024-04-17T19:47:37.958832+0000","last_peered":"2024-04-17T19:47:37.958832+0000","last_clean":"2024-04-17T19:47:37.958832+0000","last_became_active":"2024-04-17T19:46:55.681607+0000","last_became_peered":"2024-04-17T19:46:55.681607+0000","last_unstale":"2024-04-17T19:47:37.958832+0000","last_undegraded":"2024-04-17T19:47:37.958832+0000","last_fullsized":"2024-04-17T19:47:37.958832+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:54.640133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:54.640133+0000","last_clean_scrub_stamp":"2024-04-17T19:46:54.640133+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T04:43:37.994081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:38.681469+0000","last_change":"2024-04-17T19:47:00.756396+0000","last_active":"2024-04-17T19:47:38.681469+0000","last_peered":"2024-04-17T19:47:38.681469+0000","last_clean":"2024-04-17T19:47:38.681469+0000","last_became_active":"2024-04-17T19:47:00.755282+0000","last_became_peered":"2024-04-17T19:47:00.755282+0000","last_unstale":"2024-04-17T19:47:38.681469+0000","last_undegraded":"2024-04-17T19:47:38.681469+0000","last_fullsized":"2024-04-17T19:47:38.681469+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_clean_scrub_stamp":"2024-04-17T19:46:59.695482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:08:25.082826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6,4],"acting":[5,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:38.473076+0000","last_change":"2024-04-17T19:46:56.694764+0000","last_active":"2024-04-17T19:47:38.473076+0000","last_peered":"2024-04-17T19:47:38.473076+0000","last_clean":"2024-04-17T19:47:38.473076+0000","last_became_active":"2024-04-17T19:46:56.694449+0000","last_became_peered":"2024-04-17T19:46:56.694449+0000","last_unstale":"2024-04-17T19:47:38.473076+0000","last_undegraded":"2024-04-17T19:47:38.473076+0000","last_fullsized":"2024-04-17T19:47:38.473076+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_clean_scrub_stamp":"2024-04-17T19:46:55.648649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T02:53:14.607908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.12","version":"27'5","reported_seq":31,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:38.473300+0000","last_change":"2024-04-17T19:46:55.689900+0000","last_active":"2024-04-17T19:47:38.473300+0000","last_peered":"2024-04-17T19:47:38.473300+0000","last_clean":"2024-04-17T19:47:38.473300+0000","last_became_active":"2024-04-17T19:46:55.689607+0000","last_became_peered":"2024-04-17T19:46:55.689607+0000","last_unstale":"2024-04-17T19:47:38.473300+0000","last_undegraded":"2024-04-17T19:47:38.473300+0000","last_fullsized":"2024-04-17T19:47:38.473300+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:54.640133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:54.640133+0000","last_clean_scrub_stamp":"2024-04-17T19:46:54.640133+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:59:16.433023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:37.960916+0000","last_change":"2024-04-17T19:47:00.786434+0000","last_active":"2024-04-17T19:47:37.960916+0000","last_peered":"2024-04-17T19:47:37.960916+0000","last_clean":"2024-04-17T19:47:37.960916+0000","last_became_active":"2024-04-17T19:47:00.781025+0000","last_became_peered":"2024-04-17T19:47:00.781025+0000","last_unstale":"2024-04-17T19:47:37.960916+0000","last_undegraded":"2024-04-17T19:47:37.960916+0000","last_fullsized":"2024-04-17T19:47:37.960916+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_clean_scrub_stamp":"2024-04-17T19:46:59.695482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:51:07.602172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0,7],"acting":[6,4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:37.959795+0000","last_change":"2024-04-17T19:46:56.693555+0000","last_active":"2024-04-17T19:47:37.959795+0000","last_peered":"2024-04-17T19:47:37.959795+0000","last_clean":"2024-04-17T19:47:37.959795+0000","last_became_active":"2024-04-17T19:46:56.687385+0000","last_became_peered":"2024-04-17T19:46:56.687385+0000","last_unstale":"2024-04-17T19:47:37.959795+0000","last_undegraded":"2024-04-17T19:47:37.959795+0000","last_fullsized":"2024-04-17T19:47:37.959795+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_clean_scrub_stamp":"2024-04-17T19:46:55.648649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T05:52:33.559392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"27'9","reported_seq":35,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:39.942137+0000","last_change":"2024-04-17T19:46:55.700010+0000","last_active":"2024-04-17T19:47:39.942137+0000","last_peered":"2024-04-17T19:47:39.942137+0000","last_clean":"2024-04-17T19:47:39.942137+0000","last_became_active":"2024-04-17T19:46:55.698962+0000","last_became_peered":"2024-04-17T19:46:55.698962+0000","last_unstale":"2024-04-17T19:47:39.942137+0000","last_undegraded":"2024-04-17T19:47:39.942137+0000","last_fullsized":"2024-04-17T19:47:39.942137+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:54.640133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:54.640133+0000","last_clean_scrub_stamp":"2024-04-17T19:46:54.640133+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T01:25:12.780134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:38.473662+0000","last_change":"2024-04-17T19:47:00.760341+0000","last_active":"2024-04-17T19:47:38.473662+0000","last_peered":"2024-04-17T19:47:38.473662+0000","last_clean":"2024-04-17T19:47:38.473662+0000","last_became_active":"2024-04-17T19:47:00.759892+0000","last_became_peered":"2024-04-17T19:47:00.759892+0000","last_unstale":"2024-04-17T19:47:38.473662+0000","last_undegraded":"2024-04-17T19:47:38.473662+0000","last_fullsized":"2024-04-17T19:47:38.473662+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_clean_scrub_stamp":"2024-04-17T19:46:59.695482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T05:15:30.939022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5,6],"acting":[3,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":10,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:37.969993+0000","last_change":"2024-04-17T19:47:37.969333+0000","last_active":"2024-04-17T19:47:37.969993+0000","last_peered":"2024-04-17T19:47:37.969993+0000","last_clean":"2024-04-17T19:47:37.969993+0000","last_became_active":"2024-04-17T19:47:37.968623+0000","last_became_peered":"2024-04-17T19:47:37.968623+0000","last_unstale":"2024-04-17T19:47:37.969993+0000","last_undegraded":"2024-04-17T19:47:37.969993+0000","last_fullsized":"2024-04-17T19:47:37.969993+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_clean_scrub_stamp":"2024-04-17T19:46:55.648649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T04:48:43.769985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"27'13","reported_seq":39,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:39.938719+0000","last_change":"2024-04-17T19:46:55.697242+0000","last_active":"2024-04-17T19:47:39.938719+0000","last_peered":"2024-04-17T19:47:39.938719+0000","last_clean":"2024-04-17T19:47:39.938719+0000","last_became_active":"2024-04-17T19:46:55.696876+0000","last_became_peered":"2024-04-17T19:46:55.696876+0000","last_unstale":"2024-04-17T19:47:39.938719+0000","last_undegraded":"2024-04-17T19:47:39.938719+0000","last_fullsized":"2024-04-17T19:47:39.938719+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:54.640133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:54.640133+0000","last_clean_scrub_stamp":"2024-04-17T19:46:54.640133+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:24:28.029324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3842,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:37.956764+0000","last_change":"2024-04-17T19:47:00.743810+0000","last_active":"2024-04-17T19:47:37.956764+0000","last_peered":"2024-04-17T19:47:37.956764+0000","last_clean":"2024-04-17T19:47:37.956764+0000","last_became_active":"2024-04-17T19:47:00.742290+0000","last_became_peered":"2024-04-17T19:47:00.742290+0000","last_unstale":"2024-04-17T19:47:37.956764+0000","last_undegraded":"2024-04-17T19:47:37.956764+0000","last_fullsized":"2024-04-17T19:47:37.956764+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_clean_scrub_stamp":"2024-04-17T19:46:59.695482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T04:20:00.039224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,5,0],"acting":[4,3,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:38.473539+0000","last_change":"2024-04-17T19:46:56.680527+0000","last_active":"2024-04-17T19:47:38.473539+0000","last_peered":"2024-04-17T19:47:38.473539+0000","last_clean":"2024-04-17T19:47:38.473539+0000","last_became_active":"2024-04-17T19:46:56.680171+0000","last_became_peered":"2024-04-17T19:46:56.680171+0000","last_unstale":"2024-04-17T19:47:38.473539+0000","last_undegraded":"2024-04-17T19:47:38.473539+0000","last_fullsized":"2024-04-17T19:47:38.473539+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_clean_scrub_stamp":"2024-04-17T19:46:55.648649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T07:11:10.748292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.15","version":"25'5","reported_seq":31,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:37.967800+0000","last_change":"2024-04-17T19:46:55.707717+0000","last_active":"2024-04-17T19:47:37.967800+0000","last_peered":"2024-04-17T19:47:37.967800+0000","last_clean":"2024-04-17T19:47:37.967800+0000","last_became_active":"2024-04-17T19:46:55.706967+0000","last_became_peered":"2024-04-17T19:46:55.706967+0000","last_unstale":"2024-04-17T19:47:37.967800+0000","last_undegraded":"2024-04-17T19:47:37.967800+0000","last_fullsized":"2024-04-17T19:47:37.967800+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:54.640133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:54.640133+0000","last_clean_scrub_stamp":"2024-04-17T19:46:54.640133+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T05:10:04.380307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:37.955790+0000","last_change":"2024-04-17T19:47:00.758723+0000","last_active":"2024-04-17T19:47:37.955790+0000","last_peered":"2024-04-17T19:47:37.955790+0000","last_clean":"2024-04-17T19:47:37.955790+0000","last_became_active":"2024-04-17T19:47:00.758209+0000","last_became_peered":"2024-04-17T19:47:00.758209+0000","last_unstale":"2024-04-17T19:47:37.955790+0000","last_undegraded":"2024-04-17T19:47:37.955790+0000","last_fullsized":"2024-04-17T19:47:37.955790+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_clean_scrub_stamp":"2024-04-17T19:46:59.695482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T04:48:47.816818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1,7],"acting":[2,3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:38.681788+0000","last_change":"2024-04-17T19:46:56.684067+0000","last_active":"2024-04-17T19:47:38.681788+0000","last_peered":"2024-04-17T19:47:38.681788+0000","last_clean":"2024-04-17T19:47:38.681788+0000","last_became_active":"2024-04-17T19:46:56.683685+0000","last_became_peered":"2024-04-17T19:46:56.683685+0000","last_unstale":"2024-04-17T19:47:38.681788+0000","last_undegraded":"2024-04-17T19:47:38.681788+0000","last_fullsized":"2024-04-17T19:47:38.681788+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_clean_scrub_stamp":"2024-04-17T19:46:55.648649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T02:52:38.425163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"27'4","reported_seq":30,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:39.941416+0000","last_change":"2024-04-17T19:46:55.687311+0000","last_active":"2024-04-17T19:47:39.941416+0000","last_peered":"2024-04-17T19:47:39.941416+0000","last_clean":"2024-04-17T19:47:39.941416+0000","last_became_active":"2024-04-17T19:46:55.687019+0000","last_became_peered":"2024-04-17T19:46:55.687019+0000","last_unstale":"2024-04-17T19:47:39.941416+0000","last_undegraded":"2024-04-17T19:47:39.941416+0000","last_fullsized":"2024-04-17T19:47:39.941416+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:54.640133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:54.640133+0000","last_clean_scrub_stamp":"2024-04-17T19:46:54.640133+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T01:53:38.377482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:37.965522+0000","last_change":"2024-04-17T19:47:00.780072+0000","last_active":"2024-04-17T19:47:37.965522+0000","last_peered":"2024-04-17T19:47:37.965522+0000","last_clean":"2024-04-17T19:47:37.965522+0000","last_became_active":"2024-04-17T19:47:00.777053+0000","last_became_peered":"2024-04-17T19:47:00.777053+0000","last_unstale":"2024-04-17T19:47:37.965522+0000","last_undegraded":"2024-04-17T19:47:37.965522+0000","last_fullsized":"2024-04-17T19:47:37.965522+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_clean_scrub_stamp":"2024-04-17T19:46:59.695482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T22:01:53.910725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,3,2],"acting":[7,1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:37.956350+0000","last_change":"2024-04-17T19:46:56.692985+0000","last_active":"2024-04-17T19:47:37.956350+0000","last_peered":"2024-04-17T19:47:37.956350+0000","last_clean":"2024-04-17T19:47:37.956350+0000","last_became_active":"2024-04-17T19:46:56.692287+0000","last_became_peered":"2024-04-17T19:46:56.692287+0000","last_unstale":"2024-04-17T19:47:37.956350+0000","last_undegraded":"2024-04-17T19:47:37.956350+0000","last_fullsized":"2024-04-17T19:47:37.956350+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_clean_scrub_stamp":"2024-04-17T19:46:55.648649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:20:50.341776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.17","version":"25'4","reported_seq":30,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:38.680720+0000","last_change":"2024-04-17T19:46:55.691681+0000","last_active":"2024-04-17T19:47:38.680720+0000","last_peered":"2024-04-17T19:47:38.680720+0000","last_clean":"2024-04-17T19:47:38.680720+0000","last_became_active":"2024-04-17T19:46:55.691354+0000","last_became_peered":"2024-04-17T19:46:55.691354+0000","last_unstale":"2024-04-17T19:47:38.680720+0000","last_undegraded":"2024-04-17T19:47:38.680720+0000","last_fullsized":"2024-04-17T19:47:38.680720+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:54.640133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:54.640133+0000","last_clean_scrub_stamp":"2024-04-17T19:46:54.640133+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T00:40:58.757373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:37.957567+0000","last_change":"2024-04-17T19:47:00.764854+0000","last_active":"2024-04-17T19:47:37.957567+0000","last_peered":"2024-04-17T19:47:37.957567+0000","last_clean":"2024-04-17T19:47:37.957567+0000","last_became_active":"2024-04-17T19:47:00.763550+0000","last_became_peered":"2024-04-17T19:47:00.763550+0000","last_unstale":"2024-04-17T19:47:37.957567+0000","last_undegraded":"2024-04-17T19:47:37.957567+0000","last_fullsized":"2024-04-17T19:47:37.957567+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_clean_scrub_stamp":"2024-04-17T19:46:59.695482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T04:26:38.527427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,3,7],"acting":[4,0,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:37.959102+0000","last_change":"2024-04-17T19:47:00.746028+0000","last_active":"2024-04-17T19:47:37.959102+0000","last_peered":"2024-04-17T19:47:37.959102+0000","last_clean":"2024-04-17T19:47:37.959102+0000","last_became_active":"2024-04-17T19:47:00.744828+0000","last_became_peered":"2024-04-17T19:47:00.744828+0000","last_unstale":"2024-04-17T19:47:37.959102+0000","last_undegraded":"2024-04-17T19:47:37.959102+0000","last_fullsized":"2024-04-17T19:47:37.959102+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_clean_scrub_stamp":"2024-04-17T19:46:59.695482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T22:37:58.836823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,5,3],"acting":[4,1,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:37.957622+0000","last_change":"2024-04-17T19:46:56.691650+0000","last_active":"2024-04-17T19:47:37.957622+0000","last_peered":"2024-04-17T19:47:37.957622+0000","last_clean":"2024-04-17T19:47:37.957622+0000","last_became_active":"2024-04-17T19:46:56.690810+0000","last_became_peered":"2024-04-17T19:46:56.690810+0000","last_unstale":"2024-04-17T19:47:37.957622+0000","last_undegraded":"2024-04-17T19:47:37.957622+0000","last_fullsized":"2024-04-17T19:47:37.957622+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_clean_scrub_stamp":"2024-04-17T19:46:55.648649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T04:25:07.123916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.18","version":"27'3","reported_seq":29,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:38.472788+0000","last_change":"2024-04-17T19:46:55.691871+0000","last_active":"2024-04-17T19:47:38.472788+0000","last_peered":"2024-04-17T19:47:38.472788+0000","last_clean":"2024-04-17T19:47:38.472788+0000","last_became_active":"2024-04-17T19:46:55.690539+0000","last_became_peered":"2024-04-17T19:46:55.690539+0000","last_unstale":"2024-04-17T19:47:38.472788+0000","last_undegraded":"2024-04-17T19:47:38.472788+0000","last_fullsized":"2024-04-17T19:47:38.472788+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:54.640133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:54.640133+0000","last_clean_scrub_stamp":"2024-04-17T19:46:54.640133+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T04:52:16.008572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:38.474049+0000","last_change":"2024-04-17T19:47:00.749616+0000","last_active":"2024-04-17T19:47:38.474049+0000","last_peered":"2024-04-17T19:47:38.474049+0000","last_clean":"2024-04-17T19:47:38.474049+0000","last_became_active":"2024-04-17T19:47:00.749061+0000","last_became_peered":"2024-04-17T19:47:00.749061+0000","last_unstale":"2024-04-17T19:47:38.474049+0000","last_undegraded":"2024-04-17T19:47:38.474049+0000","last_fullsized":"2024-04-17T19:47:38.474049+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_clean_scrub_stamp":"2024-04-17T19:46:59.695482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:33:36.676817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5,1],"acting":[3,2,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:38.680049+0000","last_change":"2024-04-17T19:46:56.692190+0000","last_active":"2024-04-17T19:47:38.680049+0000","last_peered":"2024-04-17T19:47:38.680049+0000","last_clean":"2024-04-17T19:47:38.680049+0000","last_became_active":"2024-04-17T19:46:56.691524+0000","last_became_peered":"2024-04-17T19:46:56.691524+0000","last_unstale":"2024-04-17T19:47:38.680049+0000","last_undegraded":"2024-04-17T19:47:38.680049+0000","last_fullsized":"2024-04-17T19:47:38.680049+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_clean_scrub_stamp":"2024-04-17T19:46:55.648649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:44:38.787541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"27'3","reported_seq":29,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:37.960367+0000","last_change":"2024-04-17T19:46:55.700265+0000","last_active":"2024-04-17T19:47:37.960367+0000","last_peered":"2024-04-17T19:47:37.960367+0000","last_clean":"2024-04-17T19:47:37.960367+0000","last_became_active":"2024-04-17T19:46:55.699166+0000","last_became_peered":"2024-04-17T19:46:55.699166+0000","last_unstale":"2024-04-17T19:47:37.960367+0000","last_undegraded":"2024-04-17T19:47:37.960367+0000","last_fullsized":"2024-04-17T19:47:37.960367+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:54.640133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:54.640133+0000","last_clean_scrub_stamp":"2024-04-17T19:46:54.640133+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T02:39:08.241534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"25'7","reported_seq":33,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:38.473168+0000","last_change":"2024-04-17T19:46:55.687779+0000","last_active":"2024-04-17T19:47:38.473168+0000","last_peered":"2024-04-17T19:47:38.473168+0000","last_clean":"2024-04-17T19:47:38.473168+0000","last_became_active":"2024-04-17T19:46:55.687401+0000","last_became_peered":"2024-04-17T19:46:55.687401+0000","last_unstale":"2024-04-17T19:47:38.473168+0000","last_undegraded":"2024-04-17T19:47:38.473168+0000","last_fullsized":"2024-04-17T19:47:38.473168+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:54.640133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:54.640133+0000","last_clean_scrub_stamp":"2024-04-17T19:46:54.640133+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:20:49.333260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:37.956661+0000","last_change":"2024-04-17T19:46:56.691635+0000","last_active":"2024-04-17T19:47:37.956661+0000","last_peered":"2024-04-17T19:47:37.956661+0000","last_clean":"2024-04-17T19:47:37.956661+0000","last_became_active":"2024-04-17T19:46:56.691199+0000","last_became_peered":"2024-04-17T19:46:56.691199+0000","last_unstale":"2024-04-17T19:47:37.956661+0000","last_undegraded":"2024-04-17T19:47:37.956661+0000","last_fullsized":"2024-04-17T19:47:37.956661+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_clean_scrub_stamp":"2024-04-17T19:46:55.648649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:00:10.859769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:37.960761+0000","last_change":"2024-04-17T19:47:00.776142+0000","last_active":"2024-04-17T19:47:37.960761+0000","last_peered":"2024-04-17T19:47:37.960761+0000","last_clean":"2024-04-17T19:47:37.960761+0000","last_became_active":"2024-04-17T19:47:00.774592+0000","last_became_peered":"2024-04-17T19:47:00.774592+0000","last_unstale":"2024-04-17T19:47:37.960761+0000","last_undegraded":"2024-04-17T19:47:37.960761+0000","last_fullsized":"2024-04-17T19:47:37.960761+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_clean_scrub_stamp":"2024-04-17T19:46:59.695482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:04:03.656402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,7],"acting":[4,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"25'5","reported_seq":31,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:38.680704+0000","last_change":"2024-04-17T19:46:55.713656+0000","last_active":"2024-04-17T19:47:38.680704+0000","last_peered":"2024-04-17T19:47:38.680704+0000","last_clean":"2024-04-17T19:47:38.680704+0000","last_became_active":"2024-04-17T19:46:55.712982+0000","last_became_peered":"2024-04-17T19:46:55.712982+0000","last_unstale":"2024-04-17T19:47:38.680704+0000","last_undegraded":"2024-04-17T19:47:38.680704+0000","last_fullsized":"2024-04-17T19:47:38.680704+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:54.640133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:54.640133+0000","last_clean_scrub_stamp":"2024-04-17T19:46:54.640133+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:02:52.057635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:38.680192+0000","last_change":"2024-04-17T19:46:56.681984+0000","last_active":"2024-04-17T19:47:38.680192+0000","last_peered":"2024-04-17T19:47:38.680192+0000","last_clean":"2024-04-17T19:47:38.680192+0000","last_became_active":"2024-04-17T19:46:56.679830+0000","last_became_peered":"2024-04-17T19:46:56.679830+0000","last_unstale":"2024-04-17T19:47:38.680192+0000","last_undegraded":"2024-04-17T19:47:38.680192+0000","last_fullsized":"2024-04-17T19:47:38.680192+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_clean_scrub_stamp":"2024-04-17T19:46:55.648649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:11:01.745657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:37.967087+0000","last_change":"2024-04-17T19:47:00.777411+0000","last_active":"2024-04-17T19:47:37.967087+0000","last_peered":"2024-04-17T19:47:37.967087+0000","last_clean":"2024-04-17T19:47:37.967087+0000","last_became_active":"2024-04-17T19:47:00.776357+0000","last_became_peered":"2024-04-17T19:47:00.776357+0000","last_unstale":"2024-04-17T19:47:37.967087+0000","last_undegraded":"2024-04-17T19:47:37.967087+0000","last_fullsized":"2024-04-17T19:47:37.967087+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_clean_scrub_stamp":"2024-04-17T19:46:59.695482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:41:22.030097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,1,0],"acting":[7,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:37.955117+0000","last_change":"2024-04-17T19:46:56.706021+0000","last_active":"2024-04-17T19:47:37.955117+0000","last_peered":"2024-04-17T19:47:37.955117+0000","last_clean":"2024-04-17T19:47:37.955117+0000","last_became_active":"2024-04-17T19:46:56.702724+0000","last_became_peered":"2024-04-17T19:46:56.702724+0000","last_unstale":"2024-04-17T19:47:37.955117+0000","last_undegraded":"2024-04-17T19:47:37.955117+0000","last_fullsized":"2024-04-17T19:47:37.955117+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_clean_scrub_stamp":"2024-04-17T19:46:55.648649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:11:01.745657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:37.966033+0000","last_change":"2024-04-17T19:46:56.685239+0000","last_active":"2024-04-17T19:47:37.966033+0000","last_peered":"2024-04-17T19:47:37.966033+0000","last_clean":"2024-04-17T19:47:37.966033+0000","last_became_active":"2024-04-17T19:46:56.684771+0000","last_became_peered":"2024-04-17T19:46:56.684771+0000","last_unstale":"2024-04-17T19:47:37.966033+0000","last_undegraded":"2024-04-17T19:47:37.966033+0000","last_fullsized":"2024-04-17T19:47:37.966033+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_clean_scrub_stamp":"2024-04-17T19:46:55.648649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T04:52:17.017088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:38.472866+0000","last_change":"2024-04-17T19:46:56.686238+0000","last_active":"2024-04-17T19:47:38.472866+0000","last_peered":"2024-04-17T19:47:38.472866+0000","last_clean":"2024-04-17T19:47:38.472866+0000","last_became_active":"2024-04-17T19:46:56.685745+0000","last_became_peered":"2024-04-17T19:46:56.685745+0000","last_unstale":"2024-04-17T19:47:38.472866+0000","last_undegraded":"2024-04-17T19:47:38.472866+0000","last_fullsized":"2024-04-17T19:47:38.472866+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_clean_scrub_stamp":"2024-04-17T19:46:55.648649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:01:01.006486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:38.680580+0000","last_change":"2024-04-17T19:46:56.675844+0000","last_active":"2024-04-17T19:47:38.680580+0000","last_peered":"2024-04-17T19:47:38.680580+0000","last_clean":"2024-04-17T19:47:38.680580+0000","last_became_active":"2024-04-17T19:46:56.675519+0000","last_became_peered":"2024-04-17T19:46:56.675519+0000","last_unstale":"2024-04-17T19:47:38.680580+0000","last_undegraded":"2024-04-17T19:47:38.680580+0000","last_fullsized":"2024-04-17T19:47:38.680580+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_clean_scrub_stamp":"2024-04-17T19:46:55.648649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T00:46:07.348168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:37.961313+0000","last_change":"2024-04-17T19:46:56.699663+0000","last_active":"2024-04-17T19:47:37.961313+0000","last_peered":"2024-04-17T19:47:37.961313+0000","last_clean":"2024-04-17T19:47:37.961313+0000","last_became_active":"2024-04-17T19:46:56.699293+0000","last_became_peered":"2024-04-17T19:46:56.699293+0000","last_unstale":"2024-04-17T19:47:37.961313+0000","last_undegraded":"2024-04-17T19:47:37.961313+0000","last_fullsized":"2024-04-17T19:47:37.961313+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_clean_scrub_stamp":"2024-04-17T19:46:55.648649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T22:25:05.172498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:37.963317+0000","last_change":"2024-04-17T19:46:56.684368+0000","last_active":"2024-04-17T19:47:37.963317+0000","last_peered":"2024-04-17T19:47:37.963317+0000","last_clean":"2024-04-17T19:47:37.963317+0000","last_became_active":"2024-04-17T19:46:56.683963+0000","last_became_peered":"2024-04-17T19:46:56.683963+0000","last_unstale":"2024-04-17T19:47:37.963317+0000","last_undegraded":"2024-04-17T19:47:37.963317+0000","last_fullsized":"2024-04-17T19:47:37.963317+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_clean_scrub_stamp":"2024-04-17T19:46:55.648649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:41:17.983264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:37.956243+0000","last_change":"2024-04-17T19:46:56.704924+0000","last_active":"2024-04-17T19:47:37.956243+0000","last_peered":"2024-04-17T19:47:37.956243+0000","last_clean":"2024-04-17T19:47:37.956243+0000","last_became_active":"2024-04-17T19:46:56.692688+0000","last_became_peered":"2024-04-17T19:46:56.692688+0000","last_unstale":"2024-04-17T19:47:37.956243+0000","last_undegraded":"2024-04-17T19:47:37.956243+0000","last_fullsized":"2024-04-17T19:47:37.956243+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_clean_scrub_stamp":"2024-04-17T19:46:55.648649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T01:39:33.595213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:38.681406+0000","last_change":"2024-04-17T19:46:56.685081+0000","last_active":"2024-04-17T19:47:38.681406+0000","last_peered":"2024-04-17T19:47:38.681406+0000","last_clean":"2024-04-17T19:47:38.681406+0000","last_became_active":"2024-04-17T19:46:56.684714+0000","last_became_peered":"2024-04-17T19:46:56.684714+0000","last_unstale":"2024-04-17T19:47:38.681406+0000","last_undegraded":"2024-04-17T19:47:38.681406+0000","last_fullsized":"2024-04-17T19:47:38.681406+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_clean_scrub_stamp":"2024-04-17T19:46:55.648649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T04:26:34.480594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:38.472709+0000","last_change":"2024-04-17T19:46:56.681089+0000","last_active":"2024-04-17T19:47:38.472709+0000","last_peered":"2024-04-17T19:47:38.472709+0000","last_clean":"2024-04-17T19:47:38.472709+0000","last_became_active":"2024-04-17T19:46:56.679818+0000","last_became_peered":"2024-04-17T19:46:56.679818+0000","last_unstale":"2024-04-17T19:47:38.472709+0000","last_undegraded":"2024-04-17T19:47:38.472709+0000","last_fullsized":"2024-04-17T19:47:38.472709+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_clean_scrub_stamp":"2024-04-17T19:46:55.648649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T01:32:52.608291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:38.680342+0000","last_change":"2024-04-17T19:46:56.674556+0000","last_active":"2024-04-17T19:47:38.680342+0000","last_peered":"2024-04-17T19:47:38.680342+0000","last_clean":"2024-04-17T19:47:38.680342+0000","last_became_active":"2024-04-17T19:46:56.674164+0000","last_became_peered":"2024-04-17T19:46:56.674164+0000","last_unstale":"2024-04-17T19:47:38.680342+0000","last_undegraded":"2024-04-17T19:47:38.680342+0000","last_fullsized":"2024-04-17T19:47:38.680342+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_clean_scrub_stamp":"2024-04-17T19:46:55.648649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T22:53:45.664676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:38.680104+0000","last_change":"2024-04-17T19:46:56.697359+0000","last_active":"2024-04-17T19:47:38.680104+0000","last_peered":"2024-04-17T19:47:38.680104+0000","last_clean":"2024-04-17T19:47:38.680104+0000","last_became_active":"2024-04-17T19:46:56.695255+0000","last_became_peered":"2024-04-17T19:46:56.695255+0000","last_unstale":"2024-04-17T19:47:38.680104+0000","last_undegraded":"2024-04-17T19:47:38.680104+0000","last_fullsized":"2024-04-17T19:47:38.680104+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_clean_scrub_stamp":"2024-04-17T19:46:55.648649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T01:53:39.385998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:37.956557+0000","last_change":"2024-04-17T19:46:56.692366+0000","last_active":"2024-04-17T19:47:37.956557+0000","last_peered":"2024-04-17T19:47:37.956557+0000","last_clean":"2024-04-17T19:47:37.956557+0000","last_became_active":"2024-04-17T19:46:56.691942+0000","last_became_peered":"2024-04-17T19:46:56.691942+0000","last_unstale":"2024-04-17T19:47:37.956557+0000","last_undegraded":"2024-04-17T19:47:37.956557+0000","last_fullsized":"2024-04-17T19:47:37.956557+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_clean_scrub_stamp":"2024-04-17T19:46:55.648649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T02:34:05.358659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:37.959169+0000","last_change":"2024-04-17T19:46:56.693507+0000","last_active":"2024-04-17T19:47:37.959169+0000","last_peered":"2024-04-17T19:47:37.959169+0000","last_clean":"2024-04-17T19:47:37.959169+0000","last_became_active":"2024-04-17T19:46:56.691938+0000","last_became_peered":"2024-04-17T19:46:56.691938+0000","last_unstale":"2024-04-17T19:47:37.959169+0000","last_undegraded":"2024-04-17T19:47:37.959169+0000","last_fullsized":"2024-04-17T19:47:37.959169+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_clean_scrub_stamp":"2024-04-17T19:46:55.648649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T04:48:43.769985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:38.473897+0000","last_change":"2024-04-17T19:46:56.700707+0000","last_active":"2024-04-17T19:47:38.473897+0000","last_peered":"2024-04-17T19:47:38.473897+0000","last_clean":"2024-04-17T19:47:38.473897+0000","last_became_active":"2024-04-17T19:46:56.700346+0000","last_became_peered":"2024-04-17T19:46:56.700346+0000","last_unstale":"2024-04-17T19:47:38.473897+0000","last_undegraded":"2024-04-17T19:47:38.473897+0000","last_fullsized":"2024-04-17T19:47:38.473897+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_clean_scrub_stamp":"2024-04-17T19:46:55.648649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:58:35.976326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:37.967869+0000","last_change":"2024-04-17T19:46:56.705410+0000","last_active":"2024-04-17T19:47:37.967869+0000","last_peered":"2024-04-17T19:47:37.967869+0000","last_clean":"2024-04-17T19:47:37.967869+0000","last_became_active":"2024-04-17T19:46:56.705076+0000","last_became_peered":"2024-04-17T19:46:56.705076+0000","last_unstale":"2024-04-17T19:47:37.967869+0000","last_undegraded":"2024-04-17T19:47:37.967869+0000","last_fullsized":"2024-04-17T19:47:37.967869+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_clean_scrub_stamp":"2024-04-17T19:46:55.648649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T01:53:39.385998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:38.474198+0000","last_change":"2024-04-17T19:46:56.697436+0000","last_active":"2024-04-17T19:47:38.474198+0000","last_peered":"2024-04-17T19:47:38.474198+0000","last_clean":"2024-04-17T19:47:38.474198+0000","last_became_active":"2024-04-17T19:46:56.696667+0000","last_became_peered":"2024-04-17T19:46:56.696667+0000","last_unstale":"2024-04-17T19:47:38.474198+0000","last_undegraded":"2024-04-17T19:47:38.474198+0000","last_fullsized":"2024-04-17T19:47:38.474198+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_clean_scrub_stamp":"2024-04-17T19:46:55.648649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:54:05.520742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:38.472593+0000","last_change":"2024-04-17T19:46:56.680847+0000","last_active":"2024-04-17T19:47:38.472593+0000","last_peered":"2024-04-17T19:47:38.472593+0000","last_clean":"2024-04-17T19:47:38.472593+0000","last_became_active":"2024-04-17T19:46:56.680224+0000","last_became_peered":"2024-04-17T19:46:56.680224+0000","last_unstale":"2024-04-17T19:47:38.472593+0000","last_undegraded":"2024-04-17T19:47:38.472593+0000","last_fullsized":"2024-04-17T19:47:38.472593+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_clean_scrub_stamp":"2024-04-17T19:46:55.648649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T04:48:43.769985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:38.680021+0000","last_change":"2024-04-17T19:46:56.688647+0000","last_active":"2024-04-17T19:47:38.680021+0000","last_peered":"2024-04-17T19:47:38.680021+0000","last_clean":"2024-04-17T19:47:38.680021+0000","last_became_active":"2024-04-17T19:46:56.688294+0000","last_became_peered":"2024-04-17T19:46:56.688294+0000","last_unstale":"2024-04-17T19:47:38.680021+0000","last_undegraded":"2024-04-17T19:47:38.680021+0000","last_fullsized":"2024-04-17T19:47:38.680021+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_clean_scrub_stamp":"2024-04-17T19:46:55.648649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T02:34:05.358659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:37.959511+0000","last_change":"2024-04-17T19:46:56.686415+0000","last_active":"2024-04-17T19:47:37.959511+0000","last_peered":"2024-04-17T19:47:37.959511+0000","last_clean":"2024-04-17T19:47:37.959511+0000","last_became_active":"2024-04-17T19:46:56.684639+0000","last_became_peered":"2024-04-17T19:46:56.684639+0000","last_unstale":"2024-04-17T19:47:37.959511+0000","last_undegraded":"2024-04-17T19:47:37.959511+0000","last_fullsized":"2024-04-17T19:47:37.959511+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_clean_scrub_stamp":"2024-04-17T19:46:55.648649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:20:50.341776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:37.959975+0000","last_change":"2024-04-17T19:46:56.694678+0000","last_active":"2024-04-17T19:47:37.959975+0000","last_peered":"2024-04-17T19:47:37.959975+0000","last_clean":"2024-04-17T19:47:37.959975+0000","last_became_active":"2024-04-17T19:46:56.694213+0000","last_became_peered":"2024-04-17T19:46:56.694213+0000","last_unstale":"2024-04-17T19:47:37.959975+0000","last_undegraded":"2024-04-17T19:47:37.959975+0000","last_fullsized":"2024-04-17T19:47:37.959975+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_clean_scrub_stamp":"2024-04-17T19:46:55.648649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:59:17.441539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:37.959122+0000","last_change":"2024-04-17T19:46:56.693810+0000","last_active":"2024-04-17T19:47:37.959122+0000","last_peered":"2024-04-17T19:47:37.959122+0000","last_clean":"2024-04-17T19:47:37.959122+0000","last_became_active":"2024-04-17T19:46:56.692874+0000","last_became_peered":"2024-04-17T19:46:56.692874+0000","last_unstale":"2024-04-17T19:47:37.959122+0000","last_undegraded":"2024-04-17T19:47:37.959122+0000","last_fullsized":"2024-04-17T19:47:37.959122+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_clean_scrub_stamp":"2024-04-17T19:46:55.648649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:30:27.241267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:37.959629+0000","last_change":"2024-04-17T19:46:56.700330+0000","last_active":"2024-04-17T19:47:37.959629+0000","last_peered":"2024-04-17T19:47:37.959629+0000","last_clean":"2024-04-17T19:47:37.959629+0000","last_became_active":"2024-04-17T19:46:56.700013+0000","last_became_peered":"2024-04-17T19:46:56.700013+0000","last_unstale":"2024-04-17T19:47:37.959629+0000","last_undegraded":"2024-04-17T19:47:37.959629+0000","last_fullsized":"2024-04-17T19:47:37.959629+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_clean_scrub_stamp":"2024-04-17T19:46:55.648649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:23:16.383918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:37.959780+0000","last_change":"2024-04-17T19:46:56.709400+0000","last_active":"2024-04-17T19:47:37.959780+0000","last_peered":"2024-04-17T19:47:37.959780+0000","last_clean":"2024-04-17T19:47:37.959780+0000","last_became_active":"2024-04-17T19:46:56.708606+0000","last_became_peered":"2024-04-17T19:46:56.708606+0000","last_unstale":"2024-04-17T19:47:37.959780+0000","last_undegraded":"2024-04-17T19:47:37.959780+0000","last_fullsized":"2024-04-17T19:47:37.959780+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_clean_scrub_stamp":"2024-04-17T19:46:55.648649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T01:46:36.503198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:38.680684+0000","last_change":"2024-04-17T19:46:56.681267+0000","last_active":"2024-04-17T19:47:38.680684+0000","last_peered":"2024-04-17T19:47:38.680684+0000","last_clean":"2024-04-17T19:47:38.680684+0000","last_became_active":"2024-04-17T19:46:56.680919+0000","last_became_peered":"2024-04-17T19:46:56.680919+0000","last_unstale":"2024-04-17T19:47:38.680684+0000","last_undegraded":"2024-04-17T19:47:38.680684+0000","last_fullsized":"2024-04-17T19:47:38.680684+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_clean_scrub_stamp":"2024-04-17T19:46:55.648649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T01:39:33.595213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:38.679931+0000","last_change":"2024-04-17T19:46:56.688682+0000","last_active":"2024-04-17T19:47:38.679931+0000","last_peered":"2024-04-17T19:47:38.679931+0000","last_clean":"2024-04-17T19:47:38.679931+0000","last_became_active":"2024-04-17T19:46:56.688320+0000","last_became_peered":"2024-04-17T19:46:56.688320+0000","last_unstale":"2024-04-17T19:47:38.679931+0000","last_undegraded":"2024-04-17T19:47:38.679931+0000","last_fullsized":"2024-04-17T19:47:38.679931+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_clean_scrub_stamp":"2024-04-17T19:46:55.648649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:00:10.859769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:37.958823+0000","last_change":"2024-04-17T19:46:56.699129+0000","last_active":"2024-04-17T19:47:37.958823+0000","last_peered":"2024-04-17T19:47:37.958823+0000","last_clean":"2024-04-17T19:47:37.958823+0000","last_became_active":"2024-04-17T19:46:56.698840+0000","last_became_peered":"2024-04-17T19:46:56.698840+0000","last_unstale":"2024-04-17T19:47:37.958823+0000","last_undegraded":"2024-04-17T19:47:37.958823+0000","last_fullsized":"2024-04-17T19:47:37.958823+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_clean_scrub_stamp":"2024-04-17T19:46:55.648649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T05:35:47.746622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:37.955407+0000","last_change":"2024-04-17T19:46:56.705903+0000","last_active":"2024-04-17T19:47:37.955407+0000","last_peered":"2024-04-17T19:47:37.955407+0000","last_clean":"2024-04-17T19:47:37.955407+0000","last_became_active":"2024-04-17T19:46:56.705539+0000","last_became_peered":"2024-04-17T19:46:56.705539+0000","last_unstale":"2024-04-17T19:47:37.955407+0000","last_undegraded":"2024-04-17T19:47:37.955407+0000","last_fullsized":"2024-04-17T19:47:37.955407+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_clean_scrub_stamp":"2024-04-17T19:46:55.648649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:57:40.700986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:37.959021+0000","last_change":"2024-04-17T19:46:56.694456+0000","last_active":"2024-04-17T19:47:37.959021+0000","last_peered":"2024-04-17T19:47:37.959021+0000","last_clean":"2024-04-17T19:47:37.959021+0000","last_became_active":"2024-04-17T19:46:56.693954+0000","last_became_peered":"2024-04-17T19:46:56.693954+0000","last_unstale":"2024-04-17T19:47:37.959021+0000","last_undegraded":"2024-04-17T19:47:37.959021+0000","last_fullsized":"2024-04-17T19:47:37.959021+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_clean_scrub_stamp":"2024-04-17T19:46:55.648649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:22:33.413402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:37.955612+0000","last_change":"2024-04-17T19:46:56.706411+0000","last_active":"2024-04-17T19:47:37.955612+0000","last_peered":"2024-04-17T19:47:37.955612+0000","last_clean":"2024-04-17T19:47:37.955612+0000","last_became_active":"2024-04-17T19:46:56.706021+0000","last_became_peered":"2024-04-17T19:46:56.706021+0000","last_unstale":"2024-04-17T19:47:37.955612+0000","last_undegraded":"2024-04-17T19:47:37.955612+0000","last_fullsized":"2024-04-17T19:47:37.955612+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_clean_scrub_stamp":"2024-04-17T19:46:55.648649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T05:52:33.559392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:38.681042+0000","last_change":"2024-04-17T19:46:56.696930+0000","last_active":"2024-04-17T19:47:38.681042+0000","last_peered":"2024-04-17T19:47:38.681042+0000","last_clean":"2024-04-17T19:47:38.681042+0000","last_became_active":"2024-04-17T19:46:56.696492+0000","last_became_peered":"2024-04-17T19:46:56.696492+0000","last_unstale":"2024-04-17T19:47:38.681042+0000","last_undegraded":"2024-04-17T19:47:38.681042+0000","last_fullsized":"2024-04-17T19:47:38.681042+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_clean_scrub_stamp":"2024-04-17T19:46:55.648649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:43:54.268148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:38.681098+0000","last_change":"2024-04-17T19:46:56.683448+0000","last_active":"2024-04-17T19:47:38.681098+0000","last_peered":"2024-04-17T19:47:38.681098+0000","last_clean":"2024-04-17T19:47:38.681098+0000","last_became_active":"2024-04-17T19:46:56.682772+0000","last_became_peered":"2024-04-17T19:46:56.682772+0000","last_unstale":"2024-04-17T19:47:38.681098+0000","last_undegraded":"2024-04-17T19:47:38.681098+0000","last_fullsized":"2024-04-17T19:47:38.681098+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_clean_scrub_stamp":"2024-04-17T19:46:55.648649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T22:39:31.496708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:37.960403+0000","last_change":"2024-04-17T19:46:56.695275+0000","last_active":"2024-04-17T19:47:37.960403+0000","last_peered":"2024-04-17T19:47:37.960403+0000","last_clean":"2024-04-17T19:47:37.960403+0000","last_became_active":"2024-04-17T19:46:56.694743+0000","last_became_peered":"2024-04-17T19:46:56.694743+0000","last_unstale":"2024-04-17T19:47:37.960403+0000","last_undegraded":"2024-04-17T19:47:37.960403+0000","last_fullsized":"2024-04-17T19:47:37.960403+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_clean_scrub_stamp":"2024-04-17T19:46:55.648649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:01:01.006486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":10264,"num_objects":98,"num_object_clones":0,"num_object_copies":196,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":208,"num_write_kb":66,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":262144,"data_stored":20528,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":182,"ondisk_log_size":182,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":66496,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509456,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27328,"kb_used_data":312,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344512,"statfs":{"total":96636764160,"available":96608780288,"internally_reserved":0,"allocated":319488,"data_stored":116660,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509457,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27312,"kb_used_data":296,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344528,"statfs":{"total":96636764160,"available":96608796672,"internally_reserved":0,"allocated":303104,"data_stored":117986,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509457,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27340,"kb_used_data":320,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344500,"statfs":{"total":96636764160,"available":96608768000,"internally_reserved":0,"allocated":327680,"data_stored":118328,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509457,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27316,"kb_used_data":296,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344524,"statfs":{"total":96636764160,"available":96608792576,"internally_reserved":0,"allocated":303104,"data_stored":119516,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509456,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27380,"kb_used_data":360,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344460,"statfs":{"total":96636764160,"available":96608727040,"internally_reserved":0,"allocated":368640,"data_stored":707388,"data_compressed":33248,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509456,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27332,"kb_used_data":312,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344508,"statfs":{"total":96636764160,"available":96608776192,"internally_reserved":0,"allocated":319488,"data_stored":118148,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574864,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27380,"kb_used_data":364,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344460,"statfs":{"total":96636764160,"available":96608727040,"internally_reserved":0,"allocated":372736,"data_stored":706800,"data_compressed":33248,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574864,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27352,"kb_used_data":332,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344488,"statfs":{"total":96636764160,"available":96608755712,"internally_reserved":0,"allocated":339968,"data_stored":121286,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33248,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33248,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":2542,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1414,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":3910,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":2722,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":5680,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":826,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2380,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1054,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-17T19:47:50.897 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-17T19:47:51.090 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:51.101+0000 7f1f21600640 1 Processor -- start 2024-04-17T19:47:51.090 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:51.101+0000 7f1f21600640 1 -- start start 2024-04-17T19:47:51.093 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:51.105+0000 7f1f21600640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f1f1c06c620 0x7f1f1c0c8ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:51.093 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:51.105+0000 7f1f21600640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f1f1c1641d0 0x7f1f1c1665f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:51.093 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:51.105+0000 7f1f21600640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1f1c06d2e0 con 0x7f1f1c06ca30 2024-04-17T19:47:51.093 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:51.105+0000 7f1f21600640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 -- 0x7f1f1c15c7d0 con 0x7f1f1c06c620 2024-04-17T19:47:51.093 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:51.105+0000 7f1f21600640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 -- 0x7f1f1c15c4f0 con 0x7f1f1c1641d0 2024-04-17T19:47:51.093 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:51.105+0000 7f1f1aa00640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f1f1c06c620 0x7f1f1c0c8ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:51.093 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:51.105+0000 7f1f1aa00640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f1f1c06c620 0x7f1f1c0c8ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:34504/0 (socket says 172.21.15.44:34504) 2024-04-17T19:47:51.093 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:51.105+0000 7f1f1aa00640 1 -- 172.21.15.44:0/3577315436 learned_addr learned my addr 172.21.15.44:0/3577315436 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-04-17T19:47:51.094 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:51.105+0000 7f1f1b400640 1 --2- 172.21.15.44:0/3577315436 >> v2:172.21.15.62:3300/0 conn(0x7f1f1c1641d0 0x7f1f1c1665f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:51.094 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:51.105+0000 7f1f1aa00640 1 -- 172.21.15.44:0/3577315436 >> v2:172.21.15.62:3300/0 conn(0x7f1f1c1641d0 msgr2=0x7f1f1c1665f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T19:47:51.094 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:51.105+0000 7f1f1aa00640 1 --2- 172.21.15.44:0/3577315436 >> v2:172.21.15.62:3300/0 conn(0x7f1f1c1641d0 0x7f1f1c1665f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:51.094 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:51.105+0000 7f1f1aa00640 1 -- 172.21.15.44:0/3577315436 >> v1:172.21.15.62:6789/0 conn(0x7f1f1c06ca30 legacy=0x7f1f1c0c91e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:51.094 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:51.105+0000 7f1f1aa00640 1 -- 172.21.15.44:0/3577315436 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1f1c06be20 con 0x7f1f1c06c620 2024-04-17T19:47:51.096 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:51.109+0000 7f1f1aa00640 1 --2- 172.21.15.44:0/3577315436 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1f1c06c620 0x7f1f1c0c8ca0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f1f1c06fbe0 tx=0x7f1f0c01ed10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=16805a702f620ec1 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:47:51.096 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:51.109+0000 7f1f1a000640 1 -- 172.21.15.44:0/3577315436 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f0c0b5070 con 0x7f1f1c06c620 2024-04-17T19:47:51.096 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:51.109+0000 7f1f1a000640 1 -- 172.21.15.44:0/3577315436 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1f0c0a8a10 con 0x7f1f1c06c620 2024-04-17T19:47:51.096 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:51.109+0000 7f1f1a000640 1 -- 172.21.15.44:0/3577315436 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f0c0a8de0 con 0x7f1f1c06c620 2024-04-17T19:47:51.097 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:51.109+0000 7f1f21600640 1 -- 172.21.15.44:0/3577315436 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1f1c06c620 msgr2=0x7f1f1c0c8ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:51.097 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:51.109+0000 7f1f21600640 1 --2- 172.21.15.44:0/3577315436 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1f1c06c620 0x7f1f1c0c8ca0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f1f1c06fbe0 tx=0x7f1f0c01ed10 comp rx=0 tx=0).stop 2024-04-17T19:47:51.097 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:51.109+0000 7f1f21600640 1 -- 172.21.15.44:0/3577315436 shutdown_connections 2024-04-17T19:47:51.097 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:51.109+0000 7f1f21600640 1 --2- 172.21.15.44:0/3577315436 >> v2:172.21.15.62:3300/0 conn(0x7f1f1c1641d0 0x7f1f1c1665f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:51.097 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:51.109+0000 7f1f21600640 1 --2- 172.21.15.44:0/3577315436 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1f1c06c620 0x7f1f1c0c8ca0 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:51.097 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:51.109+0000 7f1f21600640 1 -- 172.21.15.44:0/3577315436 >> 172.21.15.44:0/3577315436 conn(0x7f1f1c070740 msgr2=0x7f1f1c070b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:47:51.097 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:51.109+0000 7f1f21600640 1 -- 172.21.15.44:0/3577315436 shutdown_connections 2024-04-17T19:47:51.098 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:51.109+0000 7f1f21600640 1 -- 172.21.15.44:0/3577315436 wait complete. 2024-04-17T19:47:51.099 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:51.113+0000 7f1f21600640 1 Processor -- start 2024-04-17T19:47:51.099 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:51.113+0000 7f1f21600640 1 -- start start 2024-04-17T19:47:51.102 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:51.113+0000 7f1f21600640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f1f1c06c620 0x7f1f1c15e660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:51.102 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:51.113+0000 7f1f21600640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1f1c06ca30 0x7f1f1c15d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:51.102 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:51.113+0000 7f1f21600640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1f1c1641d0 0x7f1f1c0c8cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:51.102 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:51.113+0000 7f1f21600640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f1f1c067ce0 con 0x7f1f1c06ca30 2024-04-17T19:47:51.102 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:51.113+0000 7f1f21600640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f1f1c0c58d0 con 0x7f1f1c1641d0 2024-04-17T19:47:51.102 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:51.113+0000 7f1f21600640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7f1f1c06e460 con 0x7f1f1c06c620 2024-04-17T19:47:51.102 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:51.113+0000 7f1f13e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1f1c06ca30 0x7f1f1c15d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:51.102 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:51.113+0000 7f1f13e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1f1c06ca30 0x7f1f1c15d3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:34512/0 (socket says 172.21.15.44:34512) 2024-04-17T19:47:51.102 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:51.113+0000 7f1f13e00640 1 -- 172.21.15.44:0/72093728 learned_addr learned my addr 172.21.15.44:0/72093728 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-04-17T19:47:51.103 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:51.113+0000 7f1f1b400640 1 --2- 172.21.15.44:0/72093728 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1f1c1641d0 0x7f1f1c0c8cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:51.103 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:51.113+0000 7f1f1aa00640 1 --2- 172.21.15.44:0/72093728 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f1f1c06c620 0x7f1f1c15e660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:51.103 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:51.113+0000 7f1f13e00640 1 -- 172.21.15.44:0/72093728 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f1f1c06c620 msgr2=0x7f1f1c15e660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:51.103 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:51.113+0000 7f1f13e00640 1 --2- 172.21.15.44:0/72093728 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f1f1c06c620 0x7f1f1c15e660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:51.103 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:51.113+0000 7f1f13e00640 1 -- 172.21.15.44:0/72093728 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1f1c1641d0 msgr2=0x7f1f1c0c8cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:51.103 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:51.113+0000 7f1f13e00640 1 --2- 172.21.15.44:0/72093728 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1f1c1641d0 0x7f1f1c0c8cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:51.103 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:51.113+0000 7f1f13e00640 1 -- 172.21.15.44:0/72093728 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1f1c150bb0 con 0x7f1f1c06ca30 2024-04-17T19:47:51.103 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:51.113+0000 7f1f1aa00640 1 --2- 172.21.15.44:0/72093728 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f1f1c06c620 0x7f1f1c15e660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-17T19:47:51.103 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:51.113+0000 7f1f13e00640 1 --2- 172.21.15.44:0/72093728 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1f1c06ca30 0x7f1f1c15d3c0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f1f0400c370 tx=0x7f1f0400c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:47:51.103 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:51.113+0000 7f1f12a00640 1 -- 172.21.15.44:0/72093728 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f040052d0 con 0x7f1f1c06ca30 2024-04-17T19:47:51.103 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:51.113+0000 7f1f12a00640 1 -- 172.21.15.44:0/72093728 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1f04005470 con 0x7f1f1c06ca30 2024-04-17T19:47:51.103 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:51.113+0000 7f1f12a00640 1 -- 172.21.15.44:0/72093728 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f04007260 con 0x7f1f1c06ca30 2024-04-17T19:47:51.104 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:51.113+0000 7f1f21600640 1 -- 172.21.15.44:0/72093728 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1f1c150e50 con 0x7f1f1c06ca30 2024-04-17T19:47:51.104 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:51.113+0000 7f1f21600640 1 -- 172.21.15.44:0/72093728 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1f1c15cbc0 con 0x7f1f1c06ca30 2024-04-17T19:47:51.104 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:51.117+0000 7f1f21600640 1 -- 172.21.15.44:0/72093728 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1f1c151330 con 0x7f1f1c06ca30 2024-04-17T19:47:51.105 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:51.117+0000 7f1f12a00640 1 -- 172.21.15.44:0/72093728 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f1f04007400 con 0x7f1f1c06ca30 2024-04-17T19:47:51.105 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:51.117+0000 7f1f12a00640 1 --2- 172.21.15.44:0/72093728 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f1ef80683b0 0x7f1ef806a8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:51.105 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:51.117+0000 7f1f12a00640 1 -- 172.21.15.44:0/72093728 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6619+0+0 (secure 0 0 0) 0x7f1f04086130 con 0x7f1f1c06ca30 2024-04-17T19:47:51.105 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:51.117+0000 7f1f1aa00640 1 --2- 172.21.15.44:0/72093728 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f1ef80683b0 0x7f1ef806a8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:51.106 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:51.117+0000 7f1f1aa00640 1 --2- 172.21.15.44:0/72093728 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f1ef80683b0 0x7f1ef806a8c0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f1f0c0b2000 tx=0x7f1f0c008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:47:51.109 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:51.121+0000 7f1f12a00640 1 -- 172.21.15.44:0/72093728 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f1f1c151330 con 0x7f1f1c06ca30 2024-04-17T19:47:51.271 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:51.285+0000 7f1f21600640 1 -- 172.21.15.44:0/72093728 --> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f1f1c04ff10 con 0x7f1ef80683b0 2024-04-17T19:47:51.295 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:51.309+0000 7f1f12a00640 1 -- 172.21.15.44:0/72093728 <== mgr.4102 v2:172.21.15.62:6832/1020159798 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+332733 (secure 0 0 0) 0x7f1f1c04ff10 con 0x7f1ef80683b0 2024-04-17T19:47:51.299 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-04-17T19:47:51.301 INFO:teuthology.orchestra.run.smithi044.stderr:dumped all 2024-04-17T19:47:51.302 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:51.313+0000 7f1f21600640 1 -- 172.21.15.44:0/72093728 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f1ef80683b0 msgr2=0x7f1ef806a8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:51.302 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:51.313+0000 7f1f21600640 1 --2- 172.21.15.44:0/72093728 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f1ef80683b0 0x7f1ef806a8c0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f1f0c0b2000 tx=0x7f1f0c008040 comp rx=0 tx=0).stop 2024-04-17T19:47:51.302 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:51.313+0000 7f1f21600640 1 -- 172.21.15.44:0/72093728 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1f1c06ca30 msgr2=0x7f1f1c15d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:51.302 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:51.313+0000 7f1f21600640 1 --2- 172.21.15.44:0/72093728 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1f1c06ca30 0x7f1f1c15d3c0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f1f0400c370 tx=0x7f1f0400c830 comp rx=0 tx=0).stop 2024-04-17T19:47:51.302 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:51.313+0000 7f1f21600640 1 -- 172.21.15.44:0/72093728 shutdown_connections 2024-04-17T19:47:51.302 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:51.313+0000 7f1f21600640 1 --2- 172.21.15.44:0/72093728 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f1ef80683b0 0x7f1ef806a8c0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:51.302 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:51.313+0000 7f1f21600640 1 --2- 172.21.15.44:0/72093728 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1f1c1641d0 0x7f1f1c0c8cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:51.303 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:51.313+0000 7f1f21600640 1 --2- 172.21.15.44:0/72093728 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1f1c06ca30 0x7f1f1c15d3c0 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:51.303 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:51.313+0000 7f1f21600640 1 --2- 172.21.15.44:0/72093728 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f1f1c06c620 0x7f1f1c15e660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:51.303 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:51.313+0000 7f1f21600640 1 -- 172.21.15.44:0/72093728 >> 172.21.15.44:0/72093728 conn(0x7f1f1c070740 msgr2=0x7f1f1c0cb160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:47:51.303 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:51.313+0000 7f1f21600640 1 -- 172.21.15.44:0/72093728 shutdown_connections 2024-04-17T19:47:51.303 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:51.313+0000 7f1f21600640 1 -- 172.21.15.44:0/72093728 wait complete. 2024-04-17T19:47:51.320 INFO:teuthology.orchestra.run.smithi044.stdout:{"pg_ready":true,"pg_map":{"version":55,"stamp":"2024-04-17T19:47:49.916665+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":600632,"num_objects":100,"num_object_clones":0,"num_object_copies":200,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":100,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":367,"num_write_kb":2482,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":299,"ondisk_log_size":299,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":218740,"kb_used_data":2592,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755980,"statfs":{"total":773094113280,"available":772870123520,"internally_reserved":0,"allocated":2654208,"data_stored":2126112,"data_compressed":66496,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":12751,"internal_metadata":221236785},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2812,"num_objects":35,"num_object_clones":0,"num_object_copies":70,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":35,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":69,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":23,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"11.962611"},"pg_stats":[{"pgid":"2.1f","version":"27'13","reported_seq":39,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:39.941990+0000","last_change":"2024-04-17T19:46:55.688623+0000","last_active":"2024-04-17T19:47:39.941990+0000","last_peered":"2024-04-17T19:47:39.941990+0000","last_clean":"2024-04-17T19:47:39.941990+0000","last_became_active":"2024-04-17T19:46:55.687455+0000","last_became_peered":"2024-04-17T19:46:55.687455+0000","last_unstale":"2024-04-17T19:47:39.941990+0000","last_undegraded":"2024-04-17T19:47:39.941990+0000","last_fullsized":"2024-04-17T19:47:39.941990+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:54.640133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:54.640133+0000","last_clean_scrub_stamp":"2024-04-17T19:46:54.640133+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:02:52.057635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:38.681304+0000","last_change":"2024-04-17T19:46:56.683770+0000","last_active":"2024-04-17T19:47:38.681304+0000","last_peered":"2024-04-17T19:47:38.681304+0000","last_clean":"2024-04-17T19:47:38.681304+0000","last_became_active":"2024-04-17T19:46:56.683111+0000","last_became_peered":"2024-04-17T19:46:56.683111+0000","last_unstale":"2024-04-17T19:47:38.681304+0000","last_undegraded":"2024-04-17T19:47:38.681304+0000","last_fullsized":"2024-04-17T19:47:38.681304+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_clean_scrub_stamp":"2024-04-17T19:46:55.648649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T22:25:59.135091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:37.965689+0000","last_change":"2024-04-17T19:47:00.788461+0000","last_active":"2024-04-17T19:47:37.965689+0000","last_peered":"2024-04-17T19:47:37.965689+0000","last_clean":"2024-04-17T19:47:37.965689+0000","last_became_active":"2024-04-17T19:47:00.787654+0000","last_became_peered":"2024-04-17T19:47:00.787654+0000","last_unstale":"2024-04-17T19:47:37.965689+0000","last_undegraded":"2024-04-17T19:47:37.965689+0000","last_fullsized":"2024-04-17T19:47:37.965689+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_clean_scrub_stamp":"2024-04-17T19:46:59.695482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T07:28:34.234670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4,1],"acting":[7,6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1e","version":"25'2","reported_seq":28,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:38.681324+0000","last_change":"2024-04-17T19:46:55.703749+0000","last_active":"2024-04-17T19:47:38.681324+0000","last_peered":"2024-04-17T19:47:38.681324+0000","last_clean":"2024-04-17T19:47:38.681324+0000","last_became_active":"2024-04-17T19:46:55.695191+0000","last_became_peered":"2024-04-17T19:46:55.695191+0000","last_unstale":"2024-04-17T19:47:38.681324+0000","last_undegraded":"2024-04-17T19:47:38.681324+0000","last_fullsized":"2024-04-17T19:47:38.681324+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:54.640133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:54.640133+0000","last_clean_scrub_stamp":"2024-04-17T19:46:54.640133+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:24:42.573542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:38.681601+0000","last_change":"2024-04-17T19:46:56.684814+0000","last_active":"2024-04-17T19:47:38.681601+0000","last_peered":"2024-04-17T19:47:38.681601+0000","last_clean":"2024-04-17T19:47:38.681601+0000","last_became_active":"2024-04-17T19:46:56.684475+0000","last_became_peered":"2024-04-17T19:46:56.684475+0000","last_unstale":"2024-04-17T19:47:38.681601+0000","last_undegraded":"2024-04-17T19:47:38.681601+0000","last_fullsized":"2024-04-17T19:47:38.681601+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_clean_scrub_stamp":"2024-04-17T19:46:55.648649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T05:38:55.394025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:37.955024+0000","last_change":"2024-04-17T19:47:00.769813+0000","last_active":"2024-04-17T19:47:37.955024+0000","last_peered":"2024-04-17T19:47:37.955024+0000","last_clean":"2024-04-17T19:47:37.955024+0000","last_became_active":"2024-04-17T19:47:00.769370+0000","last_became_peered":"2024-04-17T19:47:00.769370+0000","last_unstale":"2024-04-17T19:47:37.955024+0000","last_undegraded":"2024-04-17T19:47:37.955024+0000","last_fullsized":"2024-04-17T19:47:37.955024+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_clean_scrub_stamp":"2024-04-17T19:46:59.695482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:23:20.430751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,4,6],"acting":[2,7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1d","version":"27'12","reported_seq":38,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:39.944794+0000","last_change":"2024-04-17T19:46:55.695159+0000","last_active":"2024-04-17T19:47:39.944794+0000","last_peered":"2024-04-17T19:47:39.944794+0000","last_clean":"2024-04-17T19:47:39.944794+0000","last_became_active":"2024-04-17T19:46:55.694285+0000","last_became_peered":"2024-04-17T19:46:55.694285+0000","last_unstale":"2024-04-17T19:47:39.944794+0000","last_undegraded":"2024-04-17T19:47:39.944794+0000","last_fullsized":"2024-04-17T19:47:39.944794+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:54.640133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:54.640133+0000","last_clean_scrub_stamp":"2024-04-17T19:46:54.640133+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T04:52:16.008572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:38.680488+0000","last_change":"2024-04-17T19:46:56.700734+0000","last_active":"2024-04-17T19:47:38.680488+0000","last_peered":"2024-04-17T19:47:38.680488+0000","last_clean":"2024-04-17T19:47:38.680488+0000","last_became_active":"2024-04-17T19:46:56.700413+0000","last_became_peered":"2024-04-17T19:46:56.700413+0000","last_unstale":"2024-04-17T19:47:38.680488+0000","last_undegraded":"2024-04-17T19:47:38.680488+0000","last_fullsized":"2024-04-17T19:47:38.680488+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_clean_scrub_stamp":"2024-04-17T19:46:55.648649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:57:40.700986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:37.955497+0000","last_change":"2024-04-17T19:47:00.772341+0000","last_active":"2024-04-17T19:47:37.955497+0000","last_peered":"2024-04-17T19:47:37.955497+0000","last_clean":"2024-04-17T19:47:37.955497+0000","last_became_active":"2024-04-17T19:47:00.771578+0000","last_became_peered":"2024-04-17T19:47:00.771578+0000","last_unstale":"2024-04-17T19:47:37.955497+0000","last_undegraded":"2024-04-17T19:47:37.955497+0000","last_fullsized":"2024-04-17T19:47:37.955497+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_clean_scrub_stamp":"2024-04-17T19:46:59.695482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:51:07.602172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,3,6],"acting":[2,5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1c","version":"27'5","reported_seq":31,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:39.944708+0000","last_change":"2024-04-17T19:46:55.687607+0000","last_active":"2024-04-17T19:47:39.944708+0000","last_peered":"2024-04-17T19:47:39.944708+0000","last_clean":"2024-04-17T19:47:39.944708+0000","last_became_active":"2024-04-17T19:46:55.687282+0000","last_became_peered":"2024-04-17T19:46:55.687282+0000","last_unstale":"2024-04-17T19:47:39.944708+0000","last_undegraded":"2024-04-17T19:47:39.944708+0000","last_fullsized":"2024-04-17T19:47:39.944708+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:54.640133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:54.640133+0000","last_clean_scrub_stamp":"2024-04-17T19:46:54.640133+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T05:52:32.550876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:38.473724+0000","last_change":"2024-04-17T19:46:56.690268+0000","last_active":"2024-04-17T19:47:38.473724+0000","last_peered":"2024-04-17T19:47:38.473724+0000","last_clean":"2024-04-17T19:47:38.473724+0000","last_became_active":"2024-04-17T19:46:56.689988+0000","last_became_peered":"2024-04-17T19:46:56.689988+0000","last_unstale":"2024-04-17T19:47:38.473724+0000","last_undegraded":"2024-04-17T19:47:38.473724+0000","last_fullsized":"2024-04-17T19:47:38.473724+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_clean_scrub_stamp":"2024-04-17T19:46:55.648649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T01:29:59.423734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:37.955248+0000","last_change":"2024-04-17T19:47:00.759608+0000","last_active":"2024-04-17T19:47:37.955248+0000","last_peered":"2024-04-17T19:47:37.955248+0000","last_clean":"2024-04-17T19:47:37.955248+0000","last_became_active":"2024-04-17T19:47:00.759059+0000","last_became_peered":"2024-04-17T19:47:00.759059+0000","last_unstale":"2024-04-17T19:47:37.955248+0000","last_undegraded":"2024-04-17T19:47:37.955248+0000","last_fullsized":"2024-04-17T19:47:37.955248+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_clean_scrub_stamp":"2024-04-17T19:46:59.695482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:22:37.460235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,5,7],"acting":[2,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:38.472984+0000","last_change":"2024-04-17T19:46:56.688273+0000","last_active":"2024-04-17T19:47:38.472984+0000","last_peered":"2024-04-17T19:47:38.472984+0000","last_clean":"2024-04-17T19:47:38.472984+0000","last_became_active":"2024-04-17T19:46:56.687662+0000","last_became_peered":"2024-04-17T19:46:56.687662+0000","last_unstale":"2024-04-17T19:47:38.472984+0000","last_undegraded":"2024-04-17T19:47:38.472984+0000","last_fullsized":"2024-04-17T19:47:38.472984+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_clean_scrub_stamp":"2024-04-17T19:46:55.648649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:51:46.684685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"25'4","reported_seq":30,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:38.473275+0000","last_change":"2024-04-17T19:46:55.692833+0000","last_active":"2024-04-17T19:47:38.473275+0000","last_peered":"2024-04-17T19:47:38.473275+0000","last_clean":"2024-04-17T19:47:38.473275+0000","last_became_active":"2024-04-17T19:46:55.689006+0000","last_became_peered":"2024-04-17T19:46:55.689006+0000","last_unstale":"2024-04-17T19:47:38.473275+0000","last_undegraded":"2024-04-17T19:47:38.473275+0000","last_fullsized":"2024-04-17T19:47:38.473275+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:54.640133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:54.640133+0000","last_clean_scrub_stamp":"2024-04-17T19:46:54.640133+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:57:39.692470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:38.473595+0000","last_change":"2024-04-17T19:47:00.757063+0000","last_active":"2024-04-17T19:47:38.473595+0000","last_peered":"2024-04-17T19:47:38.473595+0000","last_clean":"2024-04-17T19:47:38.473595+0000","last_became_active":"2024-04-17T19:47:00.756456+0000","last_became_peered":"2024-04-17T19:47:00.756456+0000","last_unstale":"2024-04-17T19:47:38.473595+0000","last_undegraded":"2024-04-17T19:47:38.473595+0000","last_fullsized":"2024-04-17T19:47:38.473595+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_clean_scrub_stamp":"2024-04-17T19:46:59.695482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T02:52:51.655611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,5],"acting":[3,1,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:37.966741+0000","last_change":"2024-04-17T19:46:56.691544+0000","last_active":"2024-04-17T19:47:37.966741+0000","last_peered":"2024-04-17T19:47:37.966741+0000","last_clean":"2024-04-17T19:47:37.966741+0000","last_became_active":"2024-04-17T19:46:56.690828+0000","last_became_peered":"2024-04-17T19:46:56.690828+0000","last_unstale":"2024-04-17T19:47:37.966741+0000","last_undegraded":"2024-04-17T19:47:37.966741+0000","last_fullsized":"2024-04-17T19:47:37.966741+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_clean_scrub_stamp":"2024-04-17T19:46:55.648649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:11:01.745657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.a","version":"27'3","reported_seq":29,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:37.960376+0000","last_change":"2024-04-17T19:46:55.715857+0000","last_active":"2024-04-17T19:47:37.960376+0000","last_peered":"2024-04-17T19:47:37.960376+0000","last_clean":"2024-04-17T19:47:37.960376+0000","last_became_active":"2024-04-17T19:46:55.715197+0000","last_became_peered":"2024-04-17T19:46:55.715197+0000","last_unstale":"2024-04-17T19:47:37.960376+0000","last_undegraded":"2024-04-17T19:47:37.960376+0000","last_fullsized":"2024-04-17T19:47:37.960376+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:54.640133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:54.640133+0000","last_clean_scrub_stamp":"2024-04-17T19:46:54.640133+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:25:07.379181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:37.958849+0000","last_change":"2024-04-17T19:47:00.773528+0000","last_active":"2024-04-17T19:47:37.958849+0000","last_peered":"2024-04-17T19:47:37.958849+0000","last_clean":"2024-04-17T19:47:37.958849+0000","last_became_active":"2024-04-17T19:47:00.773077+0000","last_became_peered":"2024-04-17T19:47:00.773077+0000","last_unstale":"2024-04-17T19:47:37.958849+0000","last_undegraded":"2024-04-17T19:47:37.958849+0000","last_fullsized":"2024-04-17T19:47:37.958849+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_clean_scrub_stamp":"2024-04-17T19:46:59.695482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T02:53:18.654740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,6,1],"acting":[0,4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:37.956292+0000","last_change":"2024-04-17T19:46:56.695617+0000","last_active":"2024-04-17T19:47:37.956292+0000","last_peered":"2024-04-17T19:47:37.956292+0000","last_clean":"2024-04-17T19:47:37.956292+0000","last_became_active":"2024-04-17T19:46:56.695205+0000","last_became_peered":"2024-04-17T19:46:56.695205+0000","last_unstale":"2024-04-17T19:47:37.956292+0000","last_undegraded":"2024-04-17T19:47:37.956292+0000","last_fullsized":"2024-04-17T19:47:37.956292+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_clean_scrub_stamp":"2024-04-17T19:46:55.648649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T05:05:36.718886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"27'7","reported_seq":33,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:39.942290+0000","last_change":"2024-04-17T19:46:55.686220+0000","last_active":"2024-04-17T19:47:39.942290+0000","last_peered":"2024-04-17T19:47:39.942290+0000","last_clean":"2024-04-17T19:47:39.942290+0000","last_became_active":"2024-04-17T19:46:55.684782+0000","last_became_peered":"2024-04-17T19:46:55.684782+0000","last_unstale":"2024-04-17T19:47:39.942290+0000","last_undegraded":"2024-04-17T19:47:39.942290+0000","last_fullsized":"2024-04-17T19:47:39.942290+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:54.640133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:54.640133+0000","last_clean_scrub_stamp":"2024-04-17T19:46:54.640133+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:57:31.750325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":12,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:38.474847+0000","last_change":"2024-04-17T19:47:38.474847+0000","last_active":"2024-04-17T19:47:38.474847+0000","last_peered":"2024-04-17T19:47:38.474847+0000","last_clean":"2024-04-17T19:47:38.474847+0000","last_became_active":"2024-04-17T19:47:38.474208+0000","last_became_peered":"2024-04-17T19:47:38.474208+0000","last_unstale":"2024-04-17T19:47:38.474847+0000","last_undegraded":"2024-04-17T19:47:38.474847+0000","last_fullsized":"2024-04-17T19:47:38.474847+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_clean_scrub_stamp":"2024-04-17T19:46:59.695482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T05:15:30.939022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2,3],"acting":[0,4,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:38.472652+0000","last_change":"2024-04-17T19:46:56.700069+0000","last_active":"2024-04-17T19:47:38.472652+0000","last_peered":"2024-04-17T19:47:38.472652+0000","last_clean":"2024-04-17T19:47:38.472652+0000","last_became_active":"2024-04-17T19:46:56.699525+0000","last_became_peered":"2024-04-17T19:46:56.699525+0000","last_unstale":"2024-04-17T19:47:38.472652+0000","last_undegraded":"2024-04-17T19:47:38.472652+0000","last_fullsized":"2024-04-17T19:47:38.472652+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_clean_scrub_stamp":"2024-04-17T19:46:55.648649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T00:28:36.944531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.8","version":"25'2","reported_seq":28,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:37.958651+0000","last_change":"2024-04-17T19:46:55.684594+0000","last_active":"2024-04-17T19:47:37.958651+0000","last_peered":"2024-04-17T19:47:37.958651+0000","last_clean":"2024-04-17T19:47:37.958651+0000","last_became_active":"2024-04-17T19:46:55.683145+0000","last_became_peered":"2024-04-17T19:46:55.683145+0000","last_unstale":"2024-04-17T19:47:37.958651+0000","last_undegraded":"2024-04-17T19:47:37.958651+0000","last_fullsized":"2024-04-17T19:47:37.958651+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:54.640133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:54.640133+0000","last_clean_scrub_stamp":"2024-04-17T19:46:54.640133+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T02:39:08.241534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:37.956099+0000","last_change":"2024-04-17T19:47:00.768781+0000","last_active":"2024-04-17T19:47:37.956099+0000","last_peered":"2024-04-17T19:47:37.956099+0000","last_clean":"2024-04-17T19:47:37.956099+0000","last_became_active":"2024-04-17T19:47:00.768277+0000","last_became_peered":"2024-04-17T19:47:00.768277+0000","last_unstale":"2024-04-17T19:47:37.956099+0000","last_undegraded":"2024-04-17T19:47:37.956099+0000","last_fullsized":"2024-04-17T19:47:37.956099+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_clean_scrub_stamp":"2024-04-17T19:46:59.695482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:07:00.936098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,7],"acting":[2,1,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:37.959400+0000","last_change":"2024-04-17T19:46:56.695528+0000","last_active":"2024-04-17T19:47:37.959400+0000","last_peered":"2024-04-17T19:47:37.959400+0000","last_clean":"2024-04-17T19:47:37.959400+0000","last_became_active":"2024-04-17T19:46:56.694993+0000","last_became_peered":"2024-04-17T19:46:56.694993+0000","last_unstale":"2024-04-17T19:47:37.959400+0000","last_undegraded":"2024-04-17T19:47:37.959400+0000","last_fullsized":"2024-04-17T19:47:37.959400+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_clean_scrub_stamp":"2024-04-17T19:46:55.648649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:08:14.848448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"27'7","reported_seq":33,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:39.945807+0000","last_change":"2024-04-17T19:46:55.688859+0000","last_active":"2024-04-17T19:47:39.945807+0000","last_peered":"2024-04-17T19:47:39.945807+0000","last_clean":"2024-04-17T19:47:39.945807+0000","last_became_active":"2024-04-17T19:46:55.688507+0000","last_became_peered":"2024-04-17T19:46:55.688507+0000","last_unstale":"2024-04-17T19:47:39.945807+0000","last_undegraded":"2024-04-17T19:47:39.945807+0000","last_fullsized":"2024-04-17T19:47:39.945807+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:54.640133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:54.640133+0000","last_clean_scrub_stamp":"2024-04-17T19:46:54.640133+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T01:53:38.377482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:37.955118+0000","last_change":"2024-04-17T19:47:00.781482+0000","last_active":"2024-04-17T19:47:37.955118+0000","last_peered":"2024-04-17T19:47:37.955118+0000","last_clean":"2024-04-17T19:47:37.955118+0000","last_became_active":"2024-04-17T19:47:00.780994+0000","last_became_peered":"2024-04-17T19:47:00.780994+0000","last_unstale":"2024-04-17T19:47:37.955118+0000","last_undegraded":"2024-04-17T19:47:37.955118+0000","last_fullsized":"2024-04-17T19:47:37.955118+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_clean_scrub_stamp":"2024-04-17T19:46:59.695482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T01:46:40.550031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,3,1],"acting":[2,6,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:37.962746+0000","last_change":"2024-04-17T19:46:56.695874+0000","last_active":"2024-04-17T19:47:37.962746+0000","last_peered":"2024-04-17T19:47:37.962746+0000","last_clean":"2024-04-17T19:47:37.962746+0000","last_became_active":"2024-04-17T19:46:56.694650+0000","last_became_peered":"2024-04-17T19:46:56.694650+0000","last_unstale":"2024-04-17T19:47:37.962746+0000","last_undegraded":"2024-04-17T19:47:37.962746+0000","last_fullsized":"2024-04-17T19:47:37.962746+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_clean_scrub_stamp":"2024-04-17T19:46:55.648649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:44:38.787541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"25'7","reported_seq":33,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:37.959993+0000","last_change":"2024-04-17T19:46:55.684490+0000","last_active":"2024-04-17T19:47:37.959993+0000","last_peered":"2024-04-17T19:47:37.959993+0000","last_clean":"2024-04-17T19:47:37.959993+0000","last_became_active":"2024-04-17T19:46:55.680100+0000","last_became_peered":"2024-04-17T19:46:55.680100+0000","last_unstale":"2024-04-17T19:47:37.959993+0000","last_undegraded":"2024-04-17T19:47:37.959993+0000","last_fullsized":"2024-04-17T19:47:37.959993+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:54.640133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:54.640133+0000","last_clean_scrub_stamp":"2024-04-17T19:46:54.640133+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:27:38.256174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:37.956166+0000","last_change":"2024-04-17T19:47:00.777588+0000","last_active":"2024-04-17T19:47:37.956166+0000","last_peered":"2024-04-17T19:47:37.956166+0000","last_clean":"2024-04-17T19:47:37.956166+0000","last_became_active":"2024-04-17T19:47:00.776873+0000","last_became_peered":"2024-04-17T19:47:00.776873+0000","last_unstale":"2024-04-17T19:47:37.956166+0000","last_undegraded":"2024-04-17T19:47:37.956166+0000","last_fullsized":"2024-04-17T19:47:37.956166+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_clean_scrub_stamp":"2024-04-17T19:46:59.695482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T02:52:42.471996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,6,3],"acting":[4,1,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:37.961483+0000","last_change":"2024-04-17T19:46:56.681681+0000","last_active":"2024-04-17T19:47:37.961483+0000","last_peered":"2024-04-17T19:47:37.961483+0000","last_clean":"2024-04-17T19:47:37.961483+0000","last_became_active":"2024-04-17T19:46:56.681316+0000","last_became_peered":"2024-04-17T19:46:56.681316+0000","last_unstale":"2024-04-17T19:47:37.961483+0000","last_undegraded":"2024-04-17T19:47:37.961483+0000","last_fullsized":"2024-04-17T19:47:37.961483+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_clean_scrub_stamp":"2024-04-17T19:46:55.648649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T07:28:30.187837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"27'4","reported_seq":30,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:38.474045+0000","last_change":"2024-04-17T19:46:55.692826+0000","last_active":"2024-04-17T19:47:38.474045+0000","last_peered":"2024-04-17T19:47:38.474045+0000","last_clean":"2024-04-17T19:47:38.474045+0000","last_became_active":"2024-04-17T19:46:55.691031+0000","last_became_peered":"2024-04-17T19:46:55.691031+0000","last_unstale":"2024-04-17T19:47:38.474045+0000","last_undegraded":"2024-04-17T19:47:38.474045+0000","last_fullsized":"2024-04-17T19:47:38.474045+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:54.640133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:54.640133+0000","last_clean_scrub_stamp":"2024-04-17T19:46:54.640133+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T05:52:32.550876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:37.959441+0000","last_change":"2024-04-17T19:47:00.777416+0000","last_active":"2024-04-17T19:47:37.959441+0000","last_peered":"2024-04-17T19:47:37.959441+0000","last_clean":"2024-04-17T19:47:37.959441+0000","last_became_active":"2024-04-17T19:47:00.771531+0000","last_became_peered":"2024-04-17T19:47:00.771531+0000","last_unstale":"2024-04-17T19:47:37.959441+0000","last_undegraded":"2024-04-17T19:47:37.959441+0000","last_fullsized":"2024-04-17T19:47:37.959441+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_clean_scrub_stamp":"2024-04-17T19:46:59.695482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:30:31.288100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,2,7],"acting":[6,0,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:37.955789+0000","last_change":"2024-04-17T19:46:56.692250+0000","last_active":"2024-04-17T19:47:37.955789+0000","last_peered":"2024-04-17T19:47:37.955789+0000","last_clean":"2024-04-17T19:47:37.955789+0000","last_became_active":"2024-04-17T19:46:56.691801+0000","last_became_peered":"2024-04-17T19:46:56.691801+0000","last_unstale":"2024-04-17T19:47:37.955789+0000","last_undegraded":"2024-04-17T19:47:37.955789+0000","last_fullsized":"2024-04-17T19:47:37.955789+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_clean_scrub_stamp":"2024-04-17T19:46:55.648649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T01:53:39.385998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"25'1","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:38.680963+0000","last_change":"2024-04-17T19:46:55.713556+0000","last_active":"2024-04-17T19:47:38.680963+0000","last_peered":"2024-04-17T19:47:38.680963+0000","last_clean":"2024-04-17T19:47:38.680963+0000","last_became_active":"2024-04-17T19:46:55.712908+0000","last_became_peered":"2024-04-17T19:46:55.712908+0000","last_unstale":"2024-04-17T19:47:38.680963+0000","last_undegraded":"2024-04-17T19:47:38.680963+0000","last_fullsized":"2024-04-17T19:47:38.680963+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:54.640133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:54.640133+0000","last_clean_scrub_stamp":"2024-04-17T19:46:54.640133+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:57:31.750325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:37.959212+0000","last_change":"2024-04-17T19:47:00.776868+0000","last_active":"2024-04-17T19:47:37.959212+0000","last_peered":"2024-04-17T19:47:37.959212+0000","last_clean":"2024-04-17T19:47:37.959212+0000","last_became_active":"2024-04-17T19:47:00.771385+0000","last_became_peered":"2024-04-17T19:47:00.771385+0000","last_unstale":"2024-04-17T19:47:37.959212+0000","last_undegraded":"2024-04-17T19:47:37.959212+0000","last_fullsized":"2024-04-17T19:47:37.959212+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_clean_scrub_stamp":"2024-04-17T19:46:59.695482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T01:46:40.550031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5,7],"acting":[6,3,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:37.959076+0000","last_change":"2024-04-17T19:46:56.709288+0000","last_active":"2024-04-17T19:47:37.959076+0000","last_peered":"2024-04-17T19:47:37.959076+0000","last_clean":"2024-04-17T19:47:37.959076+0000","last_became_active":"2024-04-17T19:46:56.708572+0000","last_became_peered":"2024-04-17T19:46:56.708572+0000","last_unstale":"2024-04-17T19:47:37.959076+0000","last_undegraded":"2024-04-17T19:47:37.959076+0000","last_fullsized":"2024-04-17T19:47:37.959076+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_clean_scrub_stamp":"2024-04-17T19:46:55.648649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:51:03.555339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"27'5","reported_seq":31,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:39.945558+0000","last_change":"2024-04-17T19:46:55.708506+0000","last_active":"2024-04-17T19:47:39.945558+0000","last_peered":"2024-04-17T19:47:39.945558+0000","last_clean":"2024-04-17T19:47:39.945558+0000","last_became_active":"2024-04-17T19:46:55.708175+0000","last_became_peered":"2024-04-17T19:46:55.708175+0000","last_unstale":"2024-04-17T19:47:39.945558+0000","last_undegraded":"2024-04-17T19:47:39.945558+0000","last_fullsized":"2024-04-17T19:47:39.945558+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:54.640133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:54.640133+0000","last_clean_scrub_stamp":"2024-04-17T19:46:54.640133+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T22:25:04.163982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:37.961026+0000","last_change":"2024-04-17T19:47:00.786657+0000","last_active":"2024-04-17T19:47:37.961026+0000","last_peered":"2024-04-17T19:47:37.961026+0000","last_clean":"2024-04-17T19:47:37.961026+0000","last_became_active":"2024-04-17T19:47:00.780743+0000","last_became_peered":"2024-04-17T19:47:00.780743+0000","last_unstale":"2024-04-17T19:47:37.961026+0000","last_undegraded":"2024-04-17T19:47:37.961026+0000","last_fullsized":"2024-04-17T19:47:37.961026+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_clean_scrub_stamp":"2024-04-17T19:46:59.695482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:07:00.936098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0,3],"acting":[6,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:38.680049+0000","last_change":"2024-04-17T19:46:56.679752+0000","last_active":"2024-04-17T19:47:38.680049+0000","last_peered":"2024-04-17T19:47:38.680049+0000","last_clean":"2024-04-17T19:47:38.680049+0000","last_became_active":"2024-04-17T19:46:56.679230+0000","last_became_peered":"2024-04-17T19:46:56.679230+0000","last_unstale":"2024-04-17T19:47:38.680049+0000","last_undegraded":"2024-04-17T19:47:38.680049+0000","last_fullsized":"2024-04-17T19:47:38.680049+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_clean_scrub_stamp":"2024-04-17T19:46:55.648649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:08:14.848448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"27'5","reported_seq":31,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:37.966499+0000","last_change":"2024-04-17T19:46:55.715967+0000","last_active":"2024-04-17T19:47:37.966499+0000","last_peered":"2024-04-17T19:47:37.966499+0000","last_clean":"2024-04-17T19:47:37.966499+0000","last_became_active":"2024-04-17T19:46:55.715247+0000","last_became_peered":"2024-04-17T19:46:55.715247+0000","last_unstale":"2024-04-17T19:47:37.966499+0000","last_undegraded":"2024-04-17T19:47:37.966499+0000","last_fullsized":"2024-04-17T19:47:37.966499+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:54.640133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:54.640133+0000","last_clean_scrub_stamp":"2024-04-17T19:46:54.640133+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T00:40:58.757373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:37.963823+0000","last_change":"2024-04-17T19:47:00.769901+0000","last_active":"2024-04-17T19:47:37.963823+0000","last_peered":"2024-04-17T19:47:37.963823+0000","last_clean":"2024-04-17T19:47:37.963823+0000","last_became_active":"2024-04-17T19:47:00.768634+0000","last_became_peered":"2024-04-17T19:47:00.768634+0000","last_unstale":"2024-04-17T19:47:37.963823+0000","last_undegraded":"2024-04-17T19:47:37.963823+0000","last_fullsized":"2024-04-17T19:47:37.963823+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_clean_scrub_stamp":"2024-04-17T19:46:59.695482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T04:48:47.816818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,7],"acting":[6,0,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:37.959325+0000","last_change":"2024-04-17T19:46:56.703467+0000","last_active":"2024-04-17T19:47:37.959325+0000","last_peered":"2024-04-17T19:47:37.959325+0000","last_clean":"2024-04-17T19:47:37.959325+0000","last_became_active":"2024-04-17T19:46:56.703148+0000","last_became_peered":"2024-04-17T19:46:56.703148+0000","last_unstale":"2024-04-17T19:47:37.959325+0000","last_undegraded":"2024-04-17T19:47:37.959325+0000","last_fullsized":"2024-04-17T19:47:37.959325+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_clean_scrub_stamp":"2024-04-17T19:46:55.648649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T22:01:49.863892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"27'4","reported_seq":30,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:38.472900+0000","last_change":"2024-04-17T19:46:55.715941+0000","last_active":"2024-04-17T19:47:38.472900+0000","last_peered":"2024-04-17T19:47:38.472900+0000","last_clean":"2024-04-17T19:47:38.472900+0000","last_became_active":"2024-04-17T19:46:55.715527+0000","last_became_peered":"2024-04-17T19:46:55.715527+0000","last_unstale":"2024-04-17T19:47:38.472900+0000","last_undegraded":"2024-04-17T19:47:38.472900+0000","last_fullsized":"2024-04-17T19:47:38.472900+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:54.640133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:54.640133+0000","last_clean_scrub_stamp":"2024-04-17T19:46:54.640133+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:11:00.737141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:38.680961+0000","last_change":"2024-04-17T19:47:00.784031+0000","last_active":"2024-04-17T19:47:38.680961+0000","last_peered":"2024-04-17T19:47:38.680961+0000","last_clean":"2024-04-17T19:47:38.680961+0000","last_became_active":"2024-04-17T19:47:00.783386+0000","last_became_peered":"2024-04-17T19:47:00.783386+0000","last_unstale":"2024-04-17T19:47:38.680961+0000","last_undegraded":"2024-04-17T19:47:38.680961+0000","last_fullsized":"2024-04-17T19:47:38.680961+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_clean_scrub_stamp":"2024-04-17T19:46:59.695482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:00:44.689926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6,1],"acting":[5,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:37.957296+0000","last_change":"2024-04-17T19:46:56.692287+0000","last_active":"2024-04-17T19:47:37.957296+0000","last_peered":"2024-04-17T19:47:37.957296+0000","last_clean":"2024-04-17T19:47:37.957296+0000","last_became_active":"2024-04-17T19:46:56.691917+0000","last_became_peered":"2024-04-17T19:46:56.691917+0000","last_unstale":"2024-04-17T19:47:37.957296+0000","last_undegraded":"2024-04-17T19:47:37.957296+0000","last_fullsized":"2024-04-17T19:47:37.957296+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_clean_scrub_stamp":"2024-04-17T19:46:55.648649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T07:37:05.790432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.3","version":"27'6","reported_seq":32,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:38.473446+0000","last_change":"2024-04-17T19:46:55.686031+0000","last_active":"2024-04-17T19:47:38.473446+0000","last_peered":"2024-04-17T19:47:38.473446+0000","last_clean":"2024-04-17T19:47:38.473446+0000","last_became_active":"2024-04-17T19:46:55.685599+0000","last_became_peered":"2024-04-17T19:46:55.685599+0000","last_unstale":"2024-04-17T19:47:38.473446+0000","last_undegraded":"2024-04-17T19:47:38.473446+0000","last_fullsized":"2024-04-17T19:47:38.473446+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:54.640133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:54.640133+0000","last_clean_scrub_stamp":"2024-04-17T19:46:54.640133+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T01:39:32.586696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":182,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:38.680037+0000","last_change":"2024-04-17T19:46:43.000943+0000","last_active":"2024-04-17T19:47:38.680037+0000","last_peered":"2024-04-17T19:47:38.680037+0000","last_clean":"2024-04-17T19:47:38.680037+0000","last_became_active":"2024-04-17T19:46:43.000652+0000","last_became_peered":"2024-04-17T19:46:43.000652+0000","last_unstale":"2024-04-17T19:47:38.680037+0000","last_undegraded":"2024-04-17T19:47:38.680037+0000","last_fullsized":"2024-04-17T19:47:38.680037+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:41.988197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:41.988197+0000","last_clean_scrub_stamp":"2024-04-17T19:46:41.988197+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T19:53:52.845547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:38.473843+0000","last_change":"2024-04-17T19:47:00.731680+0000","last_active":"2024-04-17T19:47:38.473843+0000","last_peered":"2024-04-17T19:47:38.473843+0000","last_clean":"2024-04-17T19:47:38.473843+0000","last_became_active":"2024-04-17T19:47:00.731093+0000","last_became_peered":"2024-04-17T19:47:00.731093+0000","last_unstale":"2024-04-17T19:47:38.473843+0000","last_undegraded":"2024-04-17T19:47:38.473843+0000","last_fullsized":"2024-04-17T19:47:38.473843+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_clean_scrub_stamp":"2024-04-17T19:46:59.695482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T04:59:23.336626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:38.473799+0000","last_change":"2024-04-17T19:46:56.692443+0000","last_active":"2024-04-17T19:47:38.473799+0000","last_peered":"2024-04-17T19:47:38.473799+0000","last_clean":"2024-04-17T19:47:38.473799+0000","last_became_active":"2024-04-17T19:46:56.692106+0000","last_became_peered":"2024-04-17T19:46:56.692106+0000","last_unstale":"2024-04-17T19:47:38.473799+0000","last_undegraded":"2024-04-17T19:47:38.473799+0000","last_fullsized":"2024-04-17T19:47:38.473799+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_clean_scrub_stamp":"2024-04-17T19:46:55.648649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T04:07:54.102221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.c","version":"25'5","reported_seq":31,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:37.961966+0000","last_change":"2024-04-17T19:46:55.689884+0000","last_active":"2024-04-17T19:47:37.961966+0000","last_peered":"2024-04-17T19:47:37.961966+0000","last_clean":"2024-04-17T19:47:37.961966+0000","last_became_active":"2024-04-17T19:46:55.689059+0000","last_became_peered":"2024-04-17T19:46:55.689059+0000","last_unstale":"2024-04-17T19:47:37.961966+0000","last_undegraded":"2024-04-17T19:47:37.961966+0000","last_fullsized":"2024-04-17T19:47:37.961966+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:54.640133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:54.640133+0000","last_clean_scrub_stamp":"2024-04-17T19:46:54.640133+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T04:52:16.008572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1170,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:37.955292+0000","last_change":"2024-04-17T19:47:00.760432+0000","last_active":"2024-04-17T19:47:37.955292+0000","last_peered":"2024-04-17T19:47:37.955292+0000","last_clean":"2024-04-17T19:47:37.955292+0000","last_became_active":"2024-04-17T19:47:00.759946+0000","last_became_peered":"2024-04-17T19:47:00.759946+0000","last_unstale":"2024-04-17T19:47:37.955292+0000","last_undegraded":"2024-04-17T19:47:37.955292+0000","last_fullsized":"2024-04-17T19:47:37.955292+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_clean_scrub_stamp":"2024-04-17T19:46:59.695482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:30:31.288100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,7,4],"acting":[2,3,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":10,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:37.971066+0000","last_change":"2024-04-17T19:47:37.967945+0000","last_active":"2024-04-17T19:47:37.971066+0000","last_peered":"2024-04-17T19:47:37.971066+0000","last_clean":"2024-04-17T19:47:37.971066+0000","last_became_active":"2024-04-17T19:47:37.967613+0000","last_became_peered":"2024-04-17T19:47:37.967613+0000","last_unstale":"2024-04-17T19:47:37.971066+0000","last_undegraded":"2024-04-17T19:47:37.971066+0000","last_fullsized":"2024-04-17T19:47:37.971066+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_clean_scrub_stamp":"2024-04-17T19:46:55.648649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:31:43.713056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.d","version":"27'3","reported_seq":29,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:38.681511+0000","last_change":"2024-04-17T19:46:55.704346+0000","last_active":"2024-04-17T19:47:38.681511+0000","last_peered":"2024-04-17T19:47:38.681511+0000","last_clean":"2024-04-17T19:47:38.681511+0000","last_became_active":"2024-04-17T19:46:55.703334+0000","last_became_peered":"2024-04-17T19:46:55.703334+0000","last_unstale":"2024-04-17T19:47:38.681511+0000","last_undegraded":"2024-04-17T19:47:38.681511+0000","last_fullsized":"2024-04-17T19:47:38.681511+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:54.640133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:54.640133+0000","last_clean_scrub_stamp":"2024-04-17T19:46:54.640133+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:01:11.327106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:38.680615+0000","last_change":"2024-04-17T19:47:00.745450+0000","last_active":"2024-04-17T19:47:38.680615+0000","last_peered":"2024-04-17T19:47:38.680615+0000","last_clean":"2024-04-17T19:47:38.680615+0000","last_became_active":"2024-04-17T19:47:00.744227+0000","last_became_peered":"2024-04-17T19:47:00.744227+0000","last_unstale":"2024-04-17T19:47:38.680615+0000","last_undegraded":"2024-04-17T19:47:38.680615+0000","last_fullsized":"2024-04-17T19:47:38.680615+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_clean_scrub_stamp":"2024-04-17T19:46:59.695482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:52:15.523817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1,3],"acting":[5,4,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:37.960492+0000","last_change":"2024-04-17T19:46:56.687926+0000","last_active":"2024-04-17T19:47:37.960492+0000","last_peered":"2024-04-17T19:47:37.960492+0000","last_clean":"2024-04-17T19:47:37.960492+0000","last_became_active":"2024-04-17T19:46:56.687352+0000","last_became_peered":"2024-04-17T19:46:56.687352+0000","last_unstale":"2024-04-17T19:47:37.960492+0000","last_undegraded":"2024-04-17T19:47:37.960492+0000","last_fullsized":"2024-04-17T19:47:37.960492+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_clean_scrub_stamp":"2024-04-17T19:46:55.648649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T01:32:52.608291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.e","version":"27'5","reported_seq":31,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:39.943513+0000","last_change":"2024-04-17T19:46:55.716397+0000","last_active":"2024-04-17T19:47:39.943513+0000","last_peered":"2024-04-17T19:47:39.943513+0000","last_clean":"2024-04-17T19:47:39.943513+0000","last_became_active":"2024-04-17T19:46:55.715196+0000","last_became_peered":"2024-04-17T19:46:55.715196+0000","last_unstale":"2024-04-17T19:47:39.943513+0000","last_undegraded":"2024-04-17T19:47:39.943513+0000","last_fullsized":"2024-04-17T19:47:39.943513+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:54.640133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:54.640133+0000","last_clean_scrub_stamp":"2024-04-17T19:46:54.640133+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:24:42.573542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:38.472456+0000","last_change":"2024-04-17T19:47:00.735608+0000","last_active":"2024-04-17T19:47:38.472456+0000","last_peered":"2024-04-17T19:47:38.472456+0000","last_clean":"2024-04-17T19:47:38.472456+0000","last_became_active":"2024-04-17T19:47:00.735120+0000","last_became_peered":"2024-04-17T19:47:00.735120+0000","last_unstale":"2024-04-17T19:47:38.472456+0000","last_undegraded":"2024-04-17T19:47:38.472456+0000","last_fullsized":"2024-04-17T19:47:38.472456+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_clean_scrub_stamp":"2024-04-17T19:46:59.695482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T04:40:43.846198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:37.956463+0000","last_change":"2024-04-17T19:46:56.706026+0000","last_active":"2024-04-17T19:47:37.956463+0000","last_peered":"2024-04-17T19:47:37.956463+0000","last_clean":"2024-04-17T19:47:37.956463+0000","last_became_active":"2024-04-17T19:46:56.704786+0000","last_became_peered":"2024-04-17T19:46:56.704786+0000","last_unstale":"2024-04-17T19:47:37.956463+0000","last_undegraded":"2024-04-17T19:47:37.956463+0000","last_fullsized":"2024-04-17T19:47:37.956463+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_clean_scrub_stamp":"2024-04-17T19:46:55.648649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:59:17.441539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.f","version":"25'2","reported_seq":28,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:37.960546+0000","last_change":"2024-04-17T19:46:55.707082+0000","last_active":"2024-04-17T19:47:37.960546+0000","last_peered":"2024-04-17T19:47:37.960546+0000","last_clean":"2024-04-17T19:47:37.960546+0000","last_became_active":"2024-04-17T19:46:55.706729+0000","last_became_peered":"2024-04-17T19:46:55.706729+0000","last_unstale":"2024-04-17T19:47:37.960546+0000","last_undegraded":"2024-04-17T19:47:37.960546+0000","last_fullsized":"2024-04-17T19:47:37.960546+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:54.640133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:54.640133+0000","last_clean_scrub_stamp":"2024-04-17T19:46:54.640133+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:11:00.737141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:38.680019+0000","last_change":"2024-04-17T19:47:00.744054+0000","last_active":"2024-04-17T19:47:38.680019+0000","last_peered":"2024-04-17T19:47:38.680019+0000","last_clean":"2024-04-17T19:47:38.680019+0000","last_became_active":"2024-04-17T19:47:00.743582+0000","last_became_peered":"2024-04-17T19:47:00.743582+0000","last_unstale":"2024-04-17T19:47:38.680019+0000","last_undegraded":"2024-04-17T19:47:38.680019+0000","last_fullsized":"2024-04-17T19:47:38.680019+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_clean_scrub_stamp":"2024-04-17T19:46:59.695482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T22:25:09.219331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,2],"acting":[1,5,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:38.472657+0000","last_change":"2024-04-17T19:46:56.692435+0000","last_active":"2024-04-17T19:47:38.472657+0000","last_peered":"2024-04-17T19:47:38.472657+0000","last_clean":"2024-04-17T19:47:38.472657+0000","last_became_active":"2024-04-17T19:46:56.692038+0000","last_became_peered":"2024-04-17T19:46:56.692038+0000","last_unstale":"2024-04-17T19:47:38.472657+0000","last_undegraded":"2024-04-17T19:47:38.472657+0000","last_fullsized":"2024-04-17T19:47:38.472657+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_clean_scrub_stamp":"2024-04-17T19:46:55.648649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:06:56.889266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.10","version":"27'17","reported_seq":43,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:37.956615+0000","last_change":"2024-04-17T19:46:55.692188+0000","last_active":"2024-04-17T19:47:37.956615+0000","last_peered":"2024-04-17T19:47:37.956615+0000","last_clean":"2024-04-17T19:47:37.956615+0000","last_became_active":"2024-04-17T19:46:55.691286+0000","last_became_peered":"2024-04-17T19:46:55.691286+0000","last_unstale":"2024-04-17T19:47:37.956615+0000","last_undegraded":"2024-04-17T19:47:37.956615+0000","last_fullsized":"2024-04-17T19:47:37.956615+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:54.640133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:54.640133+0000","last_clean_scrub_stamp":"2024-04-17T19:46:54.640133+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:01:11.327106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:38.681208+0000","last_change":"2024-04-17T19:47:00.781167+0000","last_active":"2024-04-17T19:47:38.681208+0000","last_peered":"2024-04-17T19:47:38.681208+0000","last_clean":"2024-04-17T19:47:38.681208+0000","last_became_active":"2024-04-17T19:47:00.780167+0000","last_became_peered":"2024-04-17T19:47:00.780167+0000","last_unstale":"2024-04-17T19:47:38.681208+0000","last_undegraded":"2024-04-17T19:47:38.681208+0000","last_fullsized":"2024-04-17T19:47:38.681208+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_clean_scrub_stamp":"2024-04-17T19:46:59.695482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T00:07:51.831352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1,6],"acting":[5,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:38.679918+0000","last_change":"2024-04-17T19:46:56.676150+0000","last_active":"2024-04-17T19:47:38.679918+0000","last_peered":"2024-04-17T19:47:38.679918+0000","last_clean":"2024-04-17T19:47:38.679918+0000","last_became_active":"2024-04-17T19:46:56.675826+0000","last_became_peered":"2024-04-17T19:46:56.675826+0000","last_unstale":"2024-04-17T19:47:38.679918+0000","last_undegraded":"2024-04-17T19:47:38.679918+0000","last_fullsized":"2024-04-17T19:47:38.679918+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_clean_scrub_stamp":"2024-04-17T19:46:55.648649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T04:52:17.017088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.11","version":"25'5","reported_seq":31,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:37.958832+0000","last_change":"2024-04-17T19:46:55.682001+0000","last_active":"2024-04-17T19:47:37.958832+0000","last_peered":"2024-04-17T19:47:37.958832+0000","last_clean":"2024-04-17T19:47:37.958832+0000","last_became_active":"2024-04-17T19:46:55.681607+0000","last_became_peered":"2024-04-17T19:46:55.681607+0000","last_unstale":"2024-04-17T19:47:37.958832+0000","last_undegraded":"2024-04-17T19:47:37.958832+0000","last_fullsized":"2024-04-17T19:47:37.958832+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:54.640133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:54.640133+0000","last_clean_scrub_stamp":"2024-04-17T19:46:54.640133+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T04:43:37.994081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:38.681469+0000","last_change":"2024-04-17T19:47:00.756396+0000","last_active":"2024-04-17T19:47:38.681469+0000","last_peered":"2024-04-17T19:47:38.681469+0000","last_clean":"2024-04-17T19:47:38.681469+0000","last_became_active":"2024-04-17T19:47:00.755282+0000","last_became_peered":"2024-04-17T19:47:00.755282+0000","last_unstale":"2024-04-17T19:47:38.681469+0000","last_undegraded":"2024-04-17T19:47:38.681469+0000","last_fullsized":"2024-04-17T19:47:38.681469+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_clean_scrub_stamp":"2024-04-17T19:46:59.695482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:08:25.082826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6,4],"acting":[5,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:38.473076+0000","last_change":"2024-04-17T19:46:56.694764+0000","last_active":"2024-04-17T19:47:38.473076+0000","last_peered":"2024-04-17T19:47:38.473076+0000","last_clean":"2024-04-17T19:47:38.473076+0000","last_became_active":"2024-04-17T19:46:56.694449+0000","last_became_peered":"2024-04-17T19:46:56.694449+0000","last_unstale":"2024-04-17T19:47:38.473076+0000","last_undegraded":"2024-04-17T19:47:38.473076+0000","last_fullsized":"2024-04-17T19:47:38.473076+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_clean_scrub_stamp":"2024-04-17T19:46:55.648649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T02:53:14.607908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.12","version":"27'5","reported_seq":31,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:38.473300+0000","last_change":"2024-04-17T19:46:55.689900+0000","last_active":"2024-04-17T19:47:38.473300+0000","last_peered":"2024-04-17T19:47:38.473300+0000","last_clean":"2024-04-17T19:47:38.473300+0000","last_became_active":"2024-04-17T19:46:55.689607+0000","last_became_peered":"2024-04-17T19:46:55.689607+0000","last_unstale":"2024-04-17T19:47:38.473300+0000","last_undegraded":"2024-04-17T19:47:38.473300+0000","last_fullsized":"2024-04-17T19:47:38.473300+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:54.640133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:54.640133+0000","last_clean_scrub_stamp":"2024-04-17T19:46:54.640133+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:59:16.433023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:37.960916+0000","last_change":"2024-04-17T19:47:00.786434+0000","last_active":"2024-04-17T19:47:37.960916+0000","last_peered":"2024-04-17T19:47:37.960916+0000","last_clean":"2024-04-17T19:47:37.960916+0000","last_became_active":"2024-04-17T19:47:00.781025+0000","last_became_peered":"2024-04-17T19:47:00.781025+0000","last_unstale":"2024-04-17T19:47:37.960916+0000","last_undegraded":"2024-04-17T19:47:37.960916+0000","last_fullsized":"2024-04-17T19:47:37.960916+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_clean_scrub_stamp":"2024-04-17T19:46:59.695482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:51:07.602172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0,7],"acting":[6,4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:37.959795+0000","last_change":"2024-04-17T19:46:56.693555+0000","last_active":"2024-04-17T19:47:37.959795+0000","last_peered":"2024-04-17T19:47:37.959795+0000","last_clean":"2024-04-17T19:47:37.959795+0000","last_became_active":"2024-04-17T19:46:56.687385+0000","last_became_peered":"2024-04-17T19:46:56.687385+0000","last_unstale":"2024-04-17T19:47:37.959795+0000","last_undegraded":"2024-04-17T19:47:37.959795+0000","last_fullsized":"2024-04-17T19:47:37.959795+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_clean_scrub_stamp":"2024-04-17T19:46:55.648649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T05:52:33.559392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"27'9","reported_seq":35,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:39.942137+0000","last_change":"2024-04-17T19:46:55.700010+0000","last_active":"2024-04-17T19:47:39.942137+0000","last_peered":"2024-04-17T19:47:39.942137+0000","last_clean":"2024-04-17T19:47:39.942137+0000","last_became_active":"2024-04-17T19:46:55.698962+0000","last_became_peered":"2024-04-17T19:46:55.698962+0000","last_unstale":"2024-04-17T19:47:39.942137+0000","last_undegraded":"2024-04-17T19:47:39.942137+0000","last_fullsized":"2024-04-17T19:47:39.942137+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:54.640133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:54.640133+0000","last_clean_scrub_stamp":"2024-04-17T19:46:54.640133+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T01:25:12.780134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:38.473662+0000","last_change":"2024-04-17T19:47:00.760341+0000","last_active":"2024-04-17T19:47:38.473662+0000","last_peered":"2024-04-17T19:47:38.473662+0000","last_clean":"2024-04-17T19:47:38.473662+0000","last_became_active":"2024-04-17T19:47:00.759892+0000","last_became_peered":"2024-04-17T19:47:00.759892+0000","last_unstale":"2024-04-17T19:47:38.473662+0000","last_undegraded":"2024-04-17T19:47:38.473662+0000","last_fullsized":"2024-04-17T19:47:38.473662+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_clean_scrub_stamp":"2024-04-17T19:46:59.695482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T05:15:30.939022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5,6],"acting":[3,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":10,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:37.969993+0000","last_change":"2024-04-17T19:47:37.969333+0000","last_active":"2024-04-17T19:47:37.969993+0000","last_peered":"2024-04-17T19:47:37.969993+0000","last_clean":"2024-04-17T19:47:37.969993+0000","last_became_active":"2024-04-17T19:47:37.968623+0000","last_became_peered":"2024-04-17T19:47:37.968623+0000","last_unstale":"2024-04-17T19:47:37.969993+0000","last_undegraded":"2024-04-17T19:47:37.969993+0000","last_fullsized":"2024-04-17T19:47:37.969993+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_clean_scrub_stamp":"2024-04-17T19:46:55.648649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T04:48:43.769985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"27'13","reported_seq":39,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:39.938719+0000","last_change":"2024-04-17T19:46:55.697242+0000","last_active":"2024-04-17T19:47:39.938719+0000","last_peered":"2024-04-17T19:47:39.938719+0000","last_clean":"2024-04-17T19:47:39.938719+0000","last_became_active":"2024-04-17T19:46:55.696876+0000","last_became_peered":"2024-04-17T19:46:55.696876+0000","last_unstale":"2024-04-17T19:47:39.938719+0000","last_undegraded":"2024-04-17T19:47:39.938719+0000","last_fullsized":"2024-04-17T19:47:39.938719+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:54.640133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:54.640133+0000","last_clean_scrub_stamp":"2024-04-17T19:46:54.640133+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:24:28.029324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3842,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:37.956764+0000","last_change":"2024-04-17T19:47:00.743810+0000","last_active":"2024-04-17T19:47:37.956764+0000","last_peered":"2024-04-17T19:47:37.956764+0000","last_clean":"2024-04-17T19:47:37.956764+0000","last_became_active":"2024-04-17T19:47:00.742290+0000","last_became_peered":"2024-04-17T19:47:00.742290+0000","last_unstale":"2024-04-17T19:47:37.956764+0000","last_undegraded":"2024-04-17T19:47:37.956764+0000","last_fullsized":"2024-04-17T19:47:37.956764+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_clean_scrub_stamp":"2024-04-17T19:46:59.695482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T04:20:00.039224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,5,0],"acting":[4,3,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:38.473539+0000","last_change":"2024-04-17T19:46:56.680527+0000","last_active":"2024-04-17T19:47:38.473539+0000","last_peered":"2024-04-17T19:47:38.473539+0000","last_clean":"2024-04-17T19:47:38.473539+0000","last_became_active":"2024-04-17T19:46:56.680171+0000","last_became_peered":"2024-04-17T19:46:56.680171+0000","last_unstale":"2024-04-17T19:47:38.473539+0000","last_undegraded":"2024-04-17T19:47:38.473539+0000","last_fullsized":"2024-04-17T19:47:38.473539+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_clean_scrub_stamp":"2024-04-17T19:46:55.648649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T07:11:10.748292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.15","version":"25'5","reported_seq":31,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:37.967800+0000","last_change":"2024-04-17T19:46:55.707717+0000","last_active":"2024-04-17T19:47:37.967800+0000","last_peered":"2024-04-17T19:47:37.967800+0000","last_clean":"2024-04-17T19:47:37.967800+0000","last_became_active":"2024-04-17T19:46:55.706967+0000","last_became_peered":"2024-04-17T19:46:55.706967+0000","last_unstale":"2024-04-17T19:47:37.967800+0000","last_undegraded":"2024-04-17T19:47:37.967800+0000","last_fullsized":"2024-04-17T19:47:37.967800+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:54.640133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:54.640133+0000","last_clean_scrub_stamp":"2024-04-17T19:46:54.640133+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T05:10:04.380307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:37.955790+0000","last_change":"2024-04-17T19:47:00.758723+0000","last_active":"2024-04-17T19:47:37.955790+0000","last_peered":"2024-04-17T19:47:37.955790+0000","last_clean":"2024-04-17T19:47:37.955790+0000","last_became_active":"2024-04-17T19:47:00.758209+0000","last_became_peered":"2024-04-17T19:47:00.758209+0000","last_unstale":"2024-04-17T19:47:37.955790+0000","last_undegraded":"2024-04-17T19:47:37.955790+0000","last_fullsized":"2024-04-17T19:47:37.955790+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_clean_scrub_stamp":"2024-04-17T19:46:59.695482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T04:48:47.816818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1,7],"acting":[2,3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:38.681788+0000","last_change":"2024-04-17T19:46:56.684067+0000","last_active":"2024-04-17T19:47:38.681788+0000","last_peered":"2024-04-17T19:47:38.681788+0000","last_clean":"2024-04-17T19:47:38.681788+0000","last_became_active":"2024-04-17T19:46:56.683685+0000","last_became_peered":"2024-04-17T19:46:56.683685+0000","last_unstale":"2024-04-17T19:47:38.681788+0000","last_undegraded":"2024-04-17T19:47:38.681788+0000","last_fullsized":"2024-04-17T19:47:38.681788+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_clean_scrub_stamp":"2024-04-17T19:46:55.648649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T02:52:38.425163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"27'4","reported_seq":30,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:39.941416+0000","last_change":"2024-04-17T19:46:55.687311+0000","last_active":"2024-04-17T19:47:39.941416+0000","last_peered":"2024-04-17T19:47:39.941416+0000","last_clean":"2024-04-17T19:47:39.941416+0000","last_became_active":"2024-04-17T19:46:55.687019+0000","last_became_peered":"2024-04-17T19:46:55.687019+0000","last_unstale":"2024-04-17T19:47:39.941416+0000","last_undegraded":"2024-04-17T19:47:39.941416+0000","last_fullsized":"2024-04-17T19:47:39.941416+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:54.640133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:54.640133+0000","last_clean_scrub_stamp":"2024-04-17T19:46:54.640133+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T01:53:38.377482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:37.965522+0000","last_change":"2024-04-17T19:47:00.780072+0000","last_active":"2024-04-17T19:47:37.965522+0000","last_peered":"2024-04-17T19:47:37.965522+0000","last_clean":"2024-04-17T19:47:37.965522+0000","last_became_active":"2024-04-17T19:47:00.777053+0000","last_became_peered":"2024-04-17T19:47:00.777053+0000","last_unstale":"2024-04-17T19:47:37.965522+0000","last_undegraded":"2024-04-17T19:47:37.965522+0000","last_fullsized":"2024-04-17T19:47:37.965522+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_clean_scrub_stamp":"2024-04-17T19:46:59.695482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T22:01:53.910725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,3,2],"acting":[7,1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:37.956350+0000","last_change":"2024-04-17T19:46:56.692985+0000","last_active":"2024-04-17T19:47:37.956350+0000","last_peered":"2024-04-17T19:47:37.956350+0000","last_clean":"2024-04-17T19:47:37.956350+0000","last_became_active":"2024-04-17T19:46:56.692287+0000","last_became_peered":"2024-04-17T19:46:56.692287+0000","last_unstale":"2024-04-17T19:47:37.956350+0000","last_undegraded":"2024-04-17T19:47:37.956350+0000","last_fullsized":"2024-04-17T19:47:37.956350+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_clean_scrub_stamp":"2024-04-17T19:46:55.648649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:20:50.341776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.17","version":"25'4","reported_seq":30,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:38.680720+0000","last_change":"2024-04-17T19:46:55.691681+0000","last_active":"2024-04-17T19:47:38.680720+0000","last_peered":"2024-04-17T19:47:38.680720+0000","last_clean":"2024-04-17T19:47:38.680720+0000","last_became_active":"2024-04-17T19:46:55.691354+0000","last_became_peered":"2024-04-17T19:46:55.691354+0000","last_unstale":"2024-04-17T19:47:38.680720+0000","last_undegraded":"2024-04-17T19:47:38.680720+0000","last_fullsized":"2024-04-17T19:47:38.680720+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:54.640133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:54.640133+0000","last_clean_scrub_stamp":"2024-04-17T19:46:54.640133+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T00:40:58.757373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:37.957567+0000","last_change":"2024-04-17T19:47:00.764854+0000","last_active":"2024-04-17T19:47:37.957567+0000","last_peered":"2024-04-17T19:47:37.957567+0000","last_clean":"2024-04-17T19:47:37.957567+0000","last_became_active":"2024-04-17T19:47:00.763550+0000","last_became_peered":"2024-04-17T19:47:00.763550+0000","last_unstale":"2024-04-17T19:47:37.957567+0000","last_undegraded":"2024-04-17T19:47:37.957567+0000","last_fullsized":"2024-04-17T19:47:37.957567+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_clean_scrub_stamp":"2024-04-17T19:46:59.695482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T04:26:38.527427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,3,7],"acting":[4,0,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:37.959102+0000","last_change":"2024-04-17T19:47:00.746028+0000","last_active":"2024-04-17T19:47:37.959102+0000","last_peered":"2024-04-17T19:47:37.959102+0000","last_clean":"2024-04-17T19:47:37.959102+0000","last_became_active":"2024-04-17T19:47:00.744828+0000","last_became_peered":"2024-04-17T19:47:00.744828+0000","last_unstale":"2024-04-17T19:47:37.959102+0000","last_undegraded":"2024-04-17T19:47:37.959102+0000","last_fullsized":"2024-04-17T19:47:37.959102+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_clean_scrub_stamp":"2024-04-17T19:46:59.695482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T22:37:58.836823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,5,3],"acting":[4,1,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:37.957622+0000","last_change":"2024-04-17T19:46:56.691650+0000","last_active":"2024-04-17T19:47:37.957622+0000","last_peered":"2024-04-17T19:47:37.957622+0000","last_clean":"2024-04-17T19:47:37.957622+0000","last_became_active":"2024-04-17T19:46:56.690810+0000","last_became_peered":"2024-04-17T19:46:56.690810+0000","last_unstale":"2024-04-17T19:47:37.957622+0000","last_undegraded":"2024-04-17T19:47:37.957622+0000","last_fullsized":"2024-04-17T19:47:37.957622+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_clean_scrub_stamp":"2024-04-17T19:46:55.648649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T04:25:07.123916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.18","version":"27'3","reported_seq":29,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:38.472788+0000","last_change":"2024-04-17T19:46:55.691871+0000","last_active":"2024-04-17T19:47:38.472788+0000","last_peered":"2024-04-17T19:47:38.472788+0000","last_clean":"2024-04-17T19:47:38.472788+0000","last_became_active":"2024-04-17T19:46:55.690539+0000","last_became_peered":"2024-04-17T19:46:55.690539+0000","last_unstale":"2024-04-17T19:47:38.472788+0000","last_undegraded":"2024-04-17T19:47:38.472788+0000","last_fullsized":"2024-04-17T19:47:38.472788+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:54.640133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:54.640133+0000","last_clean_scrub_stamp":"2024-04-17T19:46:54.640133+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T04:52:16.008572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:38.474049+0000","last_change":"2024-04-17T19:47:00.749616+0000","last_active":"2024-04-17T19:47:38.474049+0000","last_peered":"2024-04-17T19:47:38.474049+0000","last_clean":"2024-04-17T19:47:38.474049+0000","last_became_active":"2024-04-17T19:47:00.749061+0000","last_became_peered":"2024-04-17T19:47:00.749061+0000","last_unstale":"2024-04-17T19:47:38.474049+0000","last_undegraded":"2024-04-17T19:47:38.474049+0000","last_fullsized":"2024-04-17T19:47:38.474049+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_clean_scrub_stamp":"2024-04-17T19:46:59.695482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:33:36.676817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5,1],"acting":[3,2,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:38.680049+0000","last_change":"2024-04-17T19:46:56.692190+0000","last_active":"2024-04-17T19:47:38.680049+0000","last_peered":"2024-04-17T19:47:38.680049+0000","last_clean":"2024-04-17T19:47:38.680049+0000","last_became_active":"2024-04-17T19:46:56.691524+0000","last_became_peered":"2024-04-17T19:46:56.691524+0000","last_unstale":"2024-04-17T19:47:38.680049+0000","last_undegraded":"2024-04-17T19:47:38.680049+0000","last_fullsized":"2024-04-17T19:47:38.680049+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_clean_scrub_stamp":"2024-04-17T19:46:55.648649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:44:38.787541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"27'3","reported_seq":29,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:37.960367+0000","last_change":"2024-04-17T19:46:55.700265+0000","last_active":"2024-04-17T19:47:37.960367+0000","last_peered":"2024-04-17T19:47:37.960367+0000","last_clean":"2024-04-17T19:47:37.960367+0000","last_became_active":"2024-04-17T19:46:55.699166+0000","last_became_peered":"2024-04-17T19:46:55.699166+0000","last_unstale":"2024-04-17T19:47:37.960367+0000","last_undegraded":"2024-04-17T19:47:37.960367+0000","last_fullsized":"2024-04-17T19:47:37.960367+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:54.640133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:54.640133+0000","last_clean_scrub_stamp":"2024-04-17T19:46:54.640133+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T02:39:08.241534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"25'7","reported_seq":33,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:38.473168+0000","last_change":"2024-04-17T19:46:55.687779+0000","last_active":"2024-04-17T19:47:38.473168+0000","last_peered":"2024-04-17T19:47:38.473168+0000","last_clean":"2024-04-17T19:47:38.473168+0000","last_became_active":"2024-04-17T19:46:55.687401+0000","last_became_peered":"2024-04-17T19:46:55.687401+0000","last_unstale":"2024-04-17T19:47:38.473168+0000","last_undegraded":"2024-04-17T19:47:38.473168+0000","last_fullsized":"2024-04-17T19:47:38.473168+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:54.640133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:54.640133+0000","last_clean_scrub_stamp":"2024-04-17T19:46:54.640133+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:20:49.333260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:37.956661+0000","last_change":"2024-04-17T19:46:56.691635+0000","last_active":"2024-04-17T19:47:37.956661+0000","last_peered":"2024-04-17T19:47:37.956661+0000","last_clean":"2024-04-17T19:47:37.956661+0000","last_became_active":"2024-04-17T19:46:56.691199+0000","last_became_peered":"2024-04-17T19:46:56.691199+0000","last_unstale":"2024-04-17T19:47:37.956661+0000","last_undegraded":"2024-04-17T19:47:37.956661+0000","last_fullsized":"2024-04-17T19:47:37.956661+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_clean_scrub_stamp":"2024-04-17T19:46:55.648649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:00:10.859769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:37.960761+0000","last_change":"2024-04-17T19:47:00.776142+0000","last_active":"2024-04-17T19:47:37.960761+0000","last_peered":"2024-04-17T19:47:37.960761+0000","last_clean":"2024-04-17T19:47:37.960761+0000","last_became_active":"2024-04-17T19:47:00.774592+0000","last_became_peered":"2024-04-17T19:47:00.774592+0000","last_unstale":"2024-04-17T19:47:37.960761+0000","last_undegraded":"2024-04-17T19:47:37.960761+0000","last_fullsized":"2024-04-17T19:47:37.960761+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_clean_scrub_stamp":"2024-04-17T19:46:59.695482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:04:03.656402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,7],"acting":[4,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"25'5","reported_seq":31,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:38.680704+0000","last_change":"2024-04-17T19:46:55.713656+0000","last_active":"2024-04-17T19:47:38.680704+0000","last_peered":"2024-04-17T19:47:38.680704+0000","last_clean":"2024-04-17T19:47:38.680704+0000","last_became_active":"2024-04-17T19:46:55.712982+0000","last_became_peered":"2024-04-17T19:46:55.712982+0000","last_unstale":"2024-04-17T19:47:38.680704+0000","last_undegraded":"2024-04-17T19:47:38.680704+0000","last_fullsized":"2024-04-17T19:47:38.680704+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:54.640133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:54.640133+0000","last_clean_scrub_stamp":"2024-04-17T19:46:54.640133+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:02:52.057635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:38.680192+0000","last_change":"2024-04-17T19:46:56.681984+0000","last_active":"2024-04-17T19:47:38.680192+0000","last_peered":"2024-04-17T19:47:38.680192+0000","last_clean":"2024-04-17T19:47:38.680192+0000","last_became_active":"2024-04-17T19:46:56.679830+0000","last_became_peered":"2024-04-17T19:46:56.679830+0000","last_unstale":"2024-04-17T19:47:38.680192+0000","last_undegraded":"2024-04-17T19:47:38.680192+0000","last_fullsized":"2024-04-17T19:47:38.680192+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_clean_scrub_stamp":"2024-04-17T19:46:55.648649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:11:01.745657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:37.967087+0000","last_change":"2024-04-17T19:47:00.777411+0000","last_active":"2024-04-17T19:47:37.967087+0000","last_peered":"2024-04-17T19:47:37.967087+0000","last_clean":"2024-04-17T19:47:37.967087+0000","last_became_active":"2024-04-17T19:47:00.776357+0000","last_became_peered":"2024-04-17T19:47:00.776357+0000","last_unstale":"2024-04-17T19:47:37.967087+0000","last_undegraded":"2024-04-17T19:47:37.967087+0000","last_fullsized":"2024-04-17T19:47:37.967087+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_clean_scrub_stamp":"2024-04-17T19:46:59.695482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:41:22.030097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,1,0],"acting":[7,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:37.955117+0000","last_change":"2024-04-17T19:46:56.706021+0000","last_active":"2024-04-17T19:47:37.955117+0000","last_peered":"2024-04-17T19:47:37.955117+0000","last_clean":"2024-04-17T19:47:37.955117+0000","last_became_active":"2024-04-17T19:46:56.702724+0000","last_became_peered":"2024-04-17T19:46:56.702724+0000","last_unstale":"2024-04-17T19:47:37.955117+0000","last_undegraded":"2024-04-17T19:47:37.955117+0000","last_fullsized":"2024-04-17T19:47:37.955117+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_clean_scrub_stamp":"2024-04-17T19:46:55.648649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:11:01.745657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:37.966033+0000","last_change":"2024-04-17T19:46:56.685239+0000","last_active":"2024-04-17T19:47:37.966033+0000","last_peered":"2024-04-17T19:47:37.966033+0000","last_clean":"2024-04-17T19:47:37.966033+0000","last_became_active":"2024-04-17T19:46:56.684771+0000","last_became_peered":"2024-04-17T19:46:56.684771+0000","last_unstale":"2024-04-17T19:47:37.966033+0000","last_undegraded":"2024-04-17T19:47:37.966033+0000","last_fullsized":"2024-04-17T19:47:37.966033+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_clean_scrub_stamp":"2024-04-17T19:46:55.648649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T04:52:17.017088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:38.472866+0000","last_change":"2024-04-17T19:46:56.686238+0000","last_active":"2024-04-17T19:47:38.472866+0000","last_peered":"2024-04-17T19:47:38.472866+0000","last_clean":"2024-04-17T19:47:38.472866+0000","last_became_active":"2024-04-17T19:46:56.685745+0000","last_became_peered":"2024-04-17T19:46:56.685745+0000","last_unstale":"2024-04-17T19:47:38.472866+0000","last_undegraded":"2024-04-17T19:47:38.472866+0000","last_fullsized":"2024-04-17T19:47:38.472866+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_clean_scrub_stamp":"2024-04-17T19:46:55.648649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:01:01.006486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:38.680580+0000","last_change":"2024-04-17T19:46:56.675844+0000","last_active":"2024-04-17T19:47:38.680580+0000","last_peered":"2024-04-17T19:47:38.680580+0000","last_clean":"2024-04-17T19:47:38.680580+0000","last_became_active":"2024-04-17T19:46:56.675519+0000","last_became_peered":"2024-04-17T19:46:56.675519+0000","last_unstale":"2024-04-17T19:47:38.680580+0000","last_undegraded":"2024-04-17T19:47:38.680580+0000","last_fullsized":"2024-04-17T19:47:38.680580+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_clean_scrub_stamp":"2024-04-17T19:46:55.648649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T00:46:07.348168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:37.961313+0000","last_change":"2024-04-17T19:46:56.699663+0000","last_active":"2024-04-17T19:47:37.961313+0000","last_peered":"2024-04-17T19:47:37.961313+0000","last_clean":"2024-04-17T19:47:37.961313+0000","last_became_active":"2024-04-17T19:46:56.699293+0000","last_became_peered":"2024-04-17T19:46:56.699293+0000","last_unstale":"2024-04-17T19:47:37.961313+0000","last_undegraded":"2024-04-17T19:47:37.961313+0000","last_fullsized":"2024-04-17T19:47:37.961313+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_clean_scrub_stamp":"2024-04-17T19:46:55.648649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T22:25:05.172498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:37.963317+0000","last_change":"2024-04-17T19:46:56.684368+0000","last_active":"2024-04-17T19:47:37.963317+0000","last_peered":"2024-04-17T19:47:37.963317+0000","last_clean":"2024-04-17T19:47:37.963317+0000","last_became_active":"2024-04-17T19:46:56.683963+0000","last_became_peered":"2024-04-17T19:46:56.683963+0000","last_unstale":"2024-04-17T19:47:37.963317+0000","last_undegraded":"2024-04-17T19:47:37.963317+0000","last_fullsized":"2024-04-17T19:47:37.963317+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_clean_scrub_stamp":"2024-04-17T19:46:55.648649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:41:17.983264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:37.956243+0000","last_change":"2024-04-17T19:46:56.704924+0000","last_active":"2024-04-17T19:47:37.956243+0000","last_peered":"2024-04-17T19:47:37.956243+0000","last_clean":"2024-04-17T19:47:37.956243+0000","last_became_active":"2024-04-17T19:46:56.692688+0000","last_became_peered":"2024-04-17T19:46:56.692688+0000","last_unstale":"2024-04-17T19:47:37.956243+0000","last_undegraded":"2024-04-17T19:47:37.956243+0000","last_fullsized":"2024-04-17T19:47:37.956243+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_clean_scrub_stamp":"2024-04-17T19:46:55.648649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T01:39:33.595213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:38.681406+0000","last_change":"2024-04-17T19:46:56.685081+0000","last_active":"2024-04-17T19:47:38.681406+0000","last_peered":"2024-04-17T19:47:38.681406+0000","last_clean":"2024-04-17T19:47:38.681406+0000","last_became_active":"2024-04-17T19:46:56.684714+0000","last_became_peered":"2024-04-17T19:46:56.684714+0000","last_unstale":"2024-04-17T19:47:38.681406+0000","last_undegraded":"2024-04-17T19:47:38.681406+0000","last_fullsized":"2024-04-17T19:47:38.681406+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_clean_scrub_stamp":"2024-04-17T19:46:55.648649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T04:26:34.480594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:38.472709+0000","last_change":"2024-04-17T19:46:56.681089+0000","last_active":"2024-04-17T19:47:38.472709+0000","last_peered":"2024-04-17T19:47:38.472709+0000","last_clean":"2024-04-17T19:47:38.472709+0000","last_became_active":"2024-04-17T19:46:56.679818+0000","last_became_peered":"2024-04-17T19:46:56.679818+0000","last_unstale":"2024-04-17T19:47:38.472709+0000","last_undegraded":"2024-04-17T19:47:38.472709+0000","last_fullsized":"2024-04-17T19:47:38.472709+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_clean_scrub_stamp":"2024-04-17T19:46:55.648649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T01:32:52.608291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:38.680342+0000","last_change":"2024-04-17T19:46:56.674556+0000","last_active":"2024-04-17T19:47:38.680342+0000","last_peered":"2024-04-17T19:47:38.680342+0000","last_clean":"2024-04-17T19:47:38.680342+0000","last_became_active":"2024-04-17T19:46:56.674164+0000","last_became_peered":"2024-04-17T19:46:56.674164+0000","last_unstale":"2024-04-17T19:47:38.680342+0000","last_undegraded":"2024-04-17T19:47:38.680342+0000","last_fullsized":"2024-04-17T19:47:38.680342+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_clean_scrub_stamp":"2024-04-17T19:46:55.648649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T22:53:45.664676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:38.680104+0000","last_change":"2024-04-17T19:46:56.697359+0000","last_active":"2024-04-17T19:47:38.680104+0000","last_peered":"2024-04-17T19:47:38.680104+0000","last_clean":"2024-04-17T19:47:38.680104+0000","last_became_active":"2024-04-17T19:46:56.695255+0000","last_became_peered":"2024-04-17T19:46:56.695255+0000","last_unstale":"2024-04-17T19:47:38.680104+0000","last_undegraded":"2024-04-17T19:47:38.680104+0000","last_fullsized":"2024-04-17T19:47:38.680104+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_clean_scrub_stamp":"2024-04-17T19:46:55.648649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T01:53:39.385998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:37.956557+0000","last_change":"2024-04-17T19:46:56.692366+0000","last_active":"2024-04-17T19:47:37.956557+0000","last_peered":"2024-04-17T19:47:37.956557+0000","last_clean":"2024-04-17T19:47:37.956557+0000","last_became_active":"2024-04-17T19:46:56.691942+0000","last_became_peered":"2024-04-17T19:46:56.691942+0000","last_unstale":"2024-04-17T19:47:37.956557+0000","last_undegraded":"2024-04-17T19:47:37.956557+0000","last_fullsized":"2024-04-17T19:47:37.956557+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_clean_scrub_stamp":"2024-04-17T19:46:55.648649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T02:34:05.358659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:37.959169+0000","last_change":"2024-04-17T19:46:56.693507+0000","last_active":"2024-04-17T19:47:37.959169+0000","last_peered":"2024-04-17T19:47:37.959169+0000","last_clean":"2024-04-17T19:47:37.959169+0000","last_became_active":"2024-04-17T19:46:56.691938+0000","last_became_peered":"2024-04-17T19:46:56.691938+0000","last_unstale":"2024-04-17T19:47:37.959169+0000","last_undegraded":"2024-04-17T19:47:37.959169+0000","last_fullsized":"2024-04-17T19:47:37.959169+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_clean_scrub_stamp":"2024-04-17T19:46:55.648649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T04:48:43.769985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:38.473897+0000","last_change":"2024-04-17T19:46:56.700707+0000","last_active":"2024-04-17T19:47:38.473897+0000","last_peered":"2024-04-17T19:47:38.473897+0000","last_clean":"2024-04-17T19:47:38.473897+0000","last_became_active":"2024-04-17T19:46:56.700346+0000","last_became_peered":"2024-04-17T19:46:56.700346+0000","last_unstale":"2024-04-17T19:47:38.473897+0000","last_undegraded":"2024-04-17T19:47:38.473897+0000","last_fullsized":"2024-04-17T19:47:38.473897+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_clean_scrub_stamp":"2024-04-17T19:46:55.648649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:58:35.976326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:37.967869+0000","last_change":"2024-04-17T19:46:56.705410+0000","last_active":"2024-04-17T19:47:37.967869+0000","last_peered":"2024-04-17T19:47:37.967869+0000","last_clean":"2024-04-17T19:47:37.967869+0000","last_became_active":"2024-04-17T19:46:56.705076+0000","last_became_peered":"2024-04-17T19:46:56.705076+0000","last_unstale":"2024-04-17T19:47:37.967869+0000","last_undegraded":"2024-04-17T19:47:37.967869+0000","last_fullsized":"2024-04-17T19:47:37.967869+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_clean_scrub_stamp":"2024-04-17T19:46:55.648649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T01:53:39.385998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:38.474198+0000","last_change":"2024-04-17T19:46:56.697436+0000","last_active":"2024-04-17T19:47:38.474198+0000","last_peered":"2024-04-17T19:47:38.474198+0000","last_clean":"2024-04-17T19:47:38.474198+0000","last_became_active":"2024-04-17T19:46:56.696667+0000","last_became_peered":"2024-04-17T19:46:56.696667+0000","last_unstale":"2024-04-17T19:47:38.474198+0000","last_undegraded":"2024-04-17T19:47:38.474198+0000","last_fullsized":"2024-04-17T19:47:38.474198+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_clean_scrub_stamp":"2024-04-17T19:46:55.648649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:54:05.520742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:38.472593+0000","last_change":"2024-04-17T19:46:56.680847+0000","last_active":"2024-04-17T19:47:38.472593+0000","last_peered":"2024-04-17T19:47:38.472593+0000","last_clean":"2024-04-17T19:47:38.472593+0000","last_became_active":"2024-04-17T19:46:56.680224+0000","last_became_peered":"2024-04-17T19:46:56.680224+0000","last_unstale":"2024-04-17T19:47:38.472593+0000","last_undegraded":"2024-04-17T19:47:38.472593+0000","last_fullsized":"2024-04-17T19:47:38.472593+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_clean_scrub_stamp":"2024-04-17T19:46:55.648649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T04:48:43.769985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:38.680021+0000","last_change":"2024-04-17T19:46:56.688647+0000","last_active":"2024-04-17T19:47:38.680021+0000","last_peered":"2024-04-17T19:47:38.680021+0000","last_clean":"2024-04-17T19:47:38.680021+0000","last_became_active":"2024-04-17T19:46:56.688294+0000","last_became_peered":"2024-04-17T19:46:56.688294+0000","last_unstale":"2024-04-17T19:47:38.680021+0000","last_undegraded":"2024-04-17T19:47:38.680021+0000","last_fullsized":"2024-04-17T19:47:38.680021+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_clean_scrub_stamp":"2024-04-17T19:46:55.648649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T02:34:05.358659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:37.959511+0000","last_change":"2024-04-17T19:46:56.686415+0000","last_active":"2024-04-17T19:47:37.959511+0000","last_peered":"2024-04-17T19:47:37.959511+0000","last_clean":"2024-04-17T19:47:37.959511+0000","last_became_active":"2024-04-17T19:46:56.684639+0000","last_became_peered":"2024-04-17T19:46:56.684639+0000","last_unstale":"2024-04-17T19:47:37.959511+0000","last_undegraded":"2024-04-17T19:47:37.959511+0000","last_fullsized":"2024-04-17T19:47:37.959511+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_clean_scrub_stamp":"2024-04-17T19:46:55.648649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:20:50.341776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:37.959975+0000","last_change":"2024-04-17T19:46:56.694678+0000","last_active":"2024-04-17T19:47:37.959975+0000","last_peered":"2024-04-17T19:47:37.959975+0000","last_clean":"2024-04-17T19:47:37.959975+0000","last_became_active":"2024-04-17T19:46:56.694213+0000","last_became_peered":"2024-04-17T19:46:56.694213+0000","last_unstale":"2024-04-17T19:47:37.959975+0000","last_undegraded":"2024-04-17T19:47:37.959975+0000","last_fullsized":"2024-04-17T19:47:37.959975+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_clean_scrub_stamp":"2024-04-17T19:46:55.648649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:59:17.441539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:37.959122+0000","last_change":"2024-04-17T19:46:56.693810+0000","last_active":"2024-04-17T19:47:37.959122+0000","last_peered":"2024-04-17T19:47:37.959122+0000","last_clean":"2024-04-17T19:47:37.959122+0000","last_became_active":"2024-04-17T19:46:56.692874+0000","last_became_peered":"2024-04-17T19:46:56.692874+0000","last_unstale":"2024-04-17T19:47:37.959122+0000","last_undegraded":"2024-04-17T19:47:37.959122+0000","last_fullsized":"2024-04-17T19:47:37.959122+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_clean_scrub_stamp":"2024-04-17T19:46:55.648649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:30:27.241267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:37.959629+0000","last_change":"2024-04-17T19:46:56.700330+0000","last_active":"2024-04-17T19:47:37.959629+0000","last_peered":"2024-04-17T19:47:37.959629+0000","last_clean":"2024-04-17T19:47:37.959629+0000","last_became_active":"2024-04-17T19:46:56.700013+0000","last_became_peered":"2024-04-17T19:46:56.700013+0000","last_unstale":"2024-04-17T19:47:37.959629+0000","last_undegraded":"2024-04-17T19:47:37.959629+0000","last_fullsized":"2024-04-17T19:47:37.959629+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_clean_scrub_stamp":"2024-04-17T19:46:55.648649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:23:16.383918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:37.959780+0000","last_change":"2024-04-17T19:46:56.709400+0000","last_active":"2024-04-17T19:47:37.959780+0000","last_peered":"2024-04-17T19:47:37.959780+0000","last_clean":"2024-04-17T19:47:37.959780+0000","last_became_active":"2024-04-17T19:46:56.708606+0000","last_became_peered":"2024-04-17T19:46:56.708606+0000","last_unstale":"2024-04-17T19:47:37.959780+0000","last_undegraded":"2024-04-17T19:47:37.959780+0000","last_fullsized":"2024-04-17T19:47:37.959780+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_clean_scrub_stamp":"2024-04-17T19:46:55.648649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T01:46:36.503198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:38.680684+0000","last_change":"2024-04-17T19:46:56.681267+0000","last_active":"2024-04-17T19:47:38.680684+0000","last_peered":"2024-04-17T19:47:38.680684+0000","last_clean":"2024-04-17T19:47:38.680684+0000","last_became_active":"2024-04-17T19:46:56.680919+0000","last_became_peered":"2024-04-17T19:46:56.680919+0000","last_unstale":"2024-04-17T19:47:38.680684+0000","last_undegraded":"2024-04-17T19:47:38.680684+0000","last_fullsized":"2024-04-17T19:47:38.680684+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_clean_scrub_stamp":"2024-04-17T19:46:55.648649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T01:39:33.595213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:38.679931+0000","last_change":"2024-04-17T19:46:56.688682+0000","last_active":"2024-04-17T19:47:38.679931+0000","last_peered":"2024-04-17T19:47:38.679931+0000","last_clean":"2024-04-17T19:47:38.679931+0000","last_became_active":"2024-04-17T19:46:56.688320+0000","last_became_peered":"2024-04-17T19:46:56.688320+0000","last_unstale":"2024-04-17T19:47:38.679931+0000","last_undegraded":"2024-04-17T19:47:38.679931+0000","last_fullsized":"2024-04-17T19:47:38.679931+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_clean_scrub_stamp":"2024-04-17T19:46:55.648649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:00:10.859769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:37.958823+0000","last_change":"2024-04-17T19:46:56.699129+0000","last_active":"2024-04-17T19:47:37.958823+0000","last_peered":"2024-04-17T19:47:37.958823+0000","last_clean":"2024-04-17T19:47:37.958823+0000","last_became_active":"2024-04-17T19:46:56.698840+0000","last_became_peered":"2024-04-17T19:46:56.698840+0000","last_unstale":"2024-04-17T19:47:37.958823+0000","last_undegraded":"2024-04-17T19:47:37.958823+0000","last_fullsized":"2024-04-17T19:47:37.958823+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_clean_scrub_stamp":"2024-04-17T19:46:55.648649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T05:35:47.746622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:37.955407+0000","last_change":"2024-04-17T19:46:56.705903+0000","last_active":"2024-04-17T19:47:37.955407+0000","last_peered":"2024-04-17T19:47:37.955407+0000","last_clean":"2024-04-17T19:47:37.955407+0000","last_became_active":"2024-04-17T19:46:56.705539+0000","last_became_peered":"2024-04-17T19:46:56.705539+0000","last_unstale":"2024-04-17T19:47:37.955407+0000","last_undegraded":"2024-04-17T19:47:37.955407+0000","last_fullsized":"2024-04-17T19:47:37.955407+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_clean_scrub_stamp":"2024-04-17T19:46:55.648649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:57:40.700986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:37.959021+0000","last_change":"2024-04-17T19:46:56.694456+0000","last_active":"2024-04-17T19:47:37.959021+0000","last_peered":"2024-04-17T19:47:37.959021+0000","last_clean":"2024-04-17T19:47:37.959021+0000","last_became_active":"2024-04-17T19:46:56.693954+0000","last_became_peered":"2024-04-17T19:46:56.693954+0000","last_unstale":"2024-04-17T19:47:37.959021+0000","last_undegraded":"2024-04-17T19:47:37.959021+0000","last_fullsized":"2024-04-17T19:47:37.959021+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_clean_scrub_stamp":"2024-04-17T19:46:55.648649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:22:33.413402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:37.955612+0000","last_change":"2024-04-17T19:46:56.706411+0000","last_active":"2024-04-17T19:47:37.955612+0000","last_peered":"2024-04-17T19:47:37.955612+0000","last_clean":"2024-04-17T19:47:37.955612+0000","last_became_active":"2024-04-17T19:46:56.706021+0000","last_became_peered":"2024-04-17T19:46:56.706021+0000","last_unstale":"2024-04-17T19:47:37.955612+0000","last_undegraded":"2024-04-17T19:47:37.955612+0000","last_fullsized":"2024-04-17T19:47:37.955612+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_clean_scrub_stamp":"2024-04-17T19:46:55.648649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T05:52:33.559392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:38.681042+0000","last_change":"2024-04-17T19:46:56.696930+0000","last_active":"2024-04-17T19:47:38.681042+0000","last_peered":"2024-04-17T19:47:38.681042+0000","last_clean":"2024-04-17T19:47:38.681042+0000","last_became_active":"2024-04-17T19:46:56.696492+0000","last_became_peered":"2024-04-17T19:46:56.696492+0000","last_unstale":"2024-04-17T19:47:38.681042+0000","last_undegraded":"2024-04-17T19:47:38.681042+0000","last_fullsized":"2024-04-17T19:47:38.681042+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_clean_scrub_stamp":"2024-04-17T19:46:55.648649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:43:54.268148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:38.681098+0000","last_change":"2024-04-17T19:46:56.683448+0000","last_active":"2024-04-17T19:47:38.681098+0000","last_peered":"2024-04-17T19:47:38.681098+0000","last_clean":"2024-04-17T19:47:38.681098+0000","last_became_active":"2024-04-17T19:46:56.682772+0000","last_became_peered":"2024-04-17T19:46:56.682772+0000","last_unstale":"2024-04-17T19:47:38.681098+0000","last_undegraded":"2024-04-17T19:47:38.681098+0000","last_fullsized":"2024-04-17T19:47:38.681098+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_clean_scrub_stamp":"2024-04-17T19:46:55.648649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T22:39:31.496708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:37.960403+0000","last_change":"2024-04-17T19:46:56.695275+0000","last_active":"2024-04-17T19:47:37.960403+0000","last_peered":"2024-04-17T19:47:37.960403+0000","last_clean":"2024-04-17T19:47:37.960403+0000","last_became_active":"2024-04-17T19:46:56.694743+0000","last_became_peered":"2024-04-17T19:46:56.694743+0000","last_unstale":"2024-04-17T19:47:37.960403+0000","last_undegraded":"2024-04-17T19:47:37.960403+0000","last_fullsized":"2024-04-17T19:47:37.960403+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_clean_scrub_stamp":"2024-04-17T19:46:55.648649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:01:01.006486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":10264,"num_objects":98,"num_object_clones":0,"num_object_copies":196,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":208,"num_write_kb":66,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":262144,"data_stored":20528,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":182,"ondisk_log_size":182,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":66496,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509456,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27328,"kb_used_data":312,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344512,"statfs":{"total":96636764160,"available":96608780288,"internally_reserved":0,"allocated":319488,"data_stored":116660,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509457,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27312,"kb_used_data":296,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344528,"statfs":{"total":96636764160,"available":96608796672,"internally_reserved":0,"allocated":303104,"data_stored":117986,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509457,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27340,"kb_used_data":320,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344500,"statfs":{"total":96636764160,"available":96608768000,"internally_reserved":0,"allocated":327680,"data_stored":118328,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509457,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27316,"kb_used_data":296,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344524,"statfs":{"total":96636764160,"available":96608792576,"internally_reserved":0,"allocated":303104,"data_stored":119516,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509456,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27380,"kb_used_data":360,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344460,"statfs":{"total":96636764160,"available":96608727040,"internally_reserved":0,"allocated":368640,"data_stored":707388,"data_compressed":33248,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509456,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27332,"kb_used_data":312,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344508,"statfs":{"total":96636764160,"available":96608776192,"internally_reserved":0,"allocated":319488,"data_stored":118148,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574864,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27380,"kb_used_data":364,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344460,"statfs":{"total":96636764160,"available":96608727040,"internally_reserved":0,"allocated":372736,"data_stored":706800,"data_compressed":33248,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574864,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27352,"kb_used_data":332,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344488,"statfs":{"total":96636764160,"available":96608755712,"internally_reserved":0,"allocated":339968,"data_stored":121286,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33248,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33248,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":2542,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1414,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":3910,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":2722,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":5680,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":826,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2380,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1054,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-17T19:47:51.325 INFO:tasks.mon_thrash.ceph_manager:clean! 2024-04-17T19:47:51.325 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-17T19:47:51.513 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:51.525+0000 7efccdc00640 1 Processor -- start 2024-04-17T19:47:51.514 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:51.525+0000 7efccdc00640 1 -- start start 2024-04-17T19:47:51.515 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:51.529+0000 7efccdc00640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7efcc80c66d0 0x7efcc81536a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:51.515 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:51.529+0000 7efccdc00640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efcc8153ff0 con 0x7efcc8153be0 2024-04-17T19:47:51.515 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:51.529+0000 7efccdc00640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efcc8159ad0 con 0x7efcc8073f30 2024-04-17T19:47:51.516 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:51.529+0000 7efccdc00640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7efcc8159db0 con 0x7efcc80c66d0 2024-04-17T19:47:51.516 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:51.529+0000 7efcbe000640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7efcc8153be0 0x7efcc8073820 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:46902/0 (socket says 172.21.15.44:46902) 2024-04-17T19:47:51.516 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:51.529+0000 7efcbe000640 1 -- 172.21.15.44:0/761133835 learned_addr learned my addr 172.21.15.44:0/761133835 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-04-17T19:47:51.516 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:51.529+0000 7efcc6a00640 1 --2- 172.21.15.44:0/761133835 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7efcc80c66d0 0x7efcc81536a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:51.517 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:51.529+0000 7efcc6000640 1 -- 172.21.15.44:0/761133835 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2523829493 0 0) 0x7efcc8153ff0 con 0x7efcc8153be0 2024-04-17T19:47:51.517 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:51.529+0000 7efcc6000640 1 -- 172.21.15.44:0/761133835 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7efcac003530 con 0x7efcc8153be0 2024-04-17T19:47:51.517 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:51.529+0000 7efcc6000640 1 -- 172.21.15.44:0/761133835 <== mon.1 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 362577423 0 0) 0x7efcc8159ad0 con 0x7efcc8073f30 2024-04-17T19:47:51.517 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:51.529+0000 7efcc6000640 1 -- 172.21.15.44:0/761133835 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7efcc8153ff0 con 0x7efcc8073f30 2024-04-17T19:47:51.517 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:51.529+0000 7efcc6000640 1 -- 172.21.15.44:0/761133835 <== mon.0 v1:172.21.15.44:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1699377058 0 0) 0x7efcac003530 con 0x7efcc8153be0 2024-04-17T19:47:51.517 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:51.529+0000 7efcc6a00640 1 -- 172.21.15.44:0/761133835 >> v1:172.21.15.62:6789/0 conn(0x7efcc8073f30 legacy=0x7efcc80725b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:51.517 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:51.529+0000 7efcc6a00640 1 -- 172.21.15.44:0/761133835 >> v1:172.21.15.44:6789/0 conn(0x7efcc8153be0 legacy=0x7efcc8073820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:51.517 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:51.529+0000 7efcc6a00640 1 -- 172.21.15.44:0/761133835 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efcc815a090 con 0x7efcc80c66d0 2024-04-17T19:47:51.519 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:51.533+0000 7efcc6a00640 1 --2- 172.21.15.44:0/761133835 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7efcc80c66d0 0x7efcc81536a0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7efcb80097f0 tx=0x7efcb801c400 comp rx=0 tx=0).ready entity=mon.2 client_cookie=930726e828fc596b server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:47:51.520 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:51.533+0000 7efcc6000640 1 -- 172.21.15.44:0/761133835 <== mon.2 v2:172.21.15.62:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efcb80b0070 con 0x7efcc80c66d0 2024-04-17T19:47:51.520 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:51.533+0000 7efcc6000640 1 -- 172.21.15.44:0/761133835 <== mon.2 v2:172.21.15.62:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efcb80ab400 con 0x7efcc80c66d0 2024-04-17T19:47:51.520 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:51.533+0000 7efcc6000640 1 -- 172.21.15.44:0/761133835 <== mon.2 v2:172.21.15.62:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efcb0001680 con 0x7efcc80c66d0 2024-04-17T19:47:51.521 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:51.533+0000 7efccdc00640 1 -- 172.21.15.44:0/761133835 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7efcc80c66d0 msgr2=0x7efcc81536a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:51.521 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:51.533+0000 7efccdc00640 1 --2- 172.21.15.44:0/761133835 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7efcc80c66d0 0x7efcc81536a0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7efcb80097f0 tx=0x7efcb801c400 comp rx=0 tx=0).stop 2024-04-17T19:47:51.521 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:51.533+0000 7efccdc00640 1 -- 172.21.15.44:0/761133835 shutdown_connections 2024-04-17T19:47:51.521 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:51.533+0000 7efccdc00640 1 --2- 172.21.15.44:0/761133835 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7efcc80c66d0 0x7efcc81536a0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:51.521 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:51.533+0000 7efccdc00640 1 -- 172.21.15.44:0/761133835 >> 172.21.15.44:0/761133835 conn(0x7efcc806c380 msgr2=0x7efcc8070080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:47:51.521 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:51.533+0000 7efccdc00640 1 -- 172.21.15.44:0/761133835 shutdown_connections 2024-04-17T19:47:51.521 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:51.533+0000 7efccdc00640 1 -- 172.21.15.44:0/761133835 wait complete. 2024-04-17T19:47:51.523 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:51.537+0000 7efccdc00640 1 Processor -- start 2024-04-17T19:47:51.523 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:51.537+0000 7efccdc00640 1 -- start start 2024-04-17T19:47:51.526 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:51.537+0000 7efccdc00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7efcc8073f30 0x7efcc8141f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:51.526 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:51.537+0000 7efccdc00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7efcc80c66d0 0x7efcc81f8cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:51.526 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:51.537+0000 7efccdc00640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7efcc8153be0 0x7efcc81f56f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:51.526 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:51.537+0000 7efccdc00640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7efcc8167c10 con 0x7efcc80c66d0 2024-04-17T19:47:51.526 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:51.537+0000 7efccdc00640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7efcc8167a90 con 0x7efcc8073f30 2024-04-17T19:47:51.526 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:51.537+0000 7efccdc00640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7efcc8167d90 con 0x7efcc8153be0 2024-04-17T19:47:51.526 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:51.537+0000 7efcbe000640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7efcc80c66d0 0x7efcc81f8cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:51.527 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:51.537+0000 7efcbe000640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7efcc80c66d0 0x7efcc81f8cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:34522/0 (socket says 172.21.15.44:34522) 2024-04-17T19:47:51.527 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:51.537+0000 7efcbe000640 1 -- 172.21.15.44:0/1091663361 learned_addr learned my addr 172.21.15.44:0/1091663361 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-04-17T19:47:51.527 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:51.537+0000 7efcc6a00640 1 --2- 172.21.15.44:0/1091663361 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7efcc8073f30 0x7efcc8141f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:51.527 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:51.537+0000 7efcc7400640 1 --2- 172.21.15.44:0/1091663361 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7efcc8153be0 0x7efcc81f56f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:51.527 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:51.537+0000 7efcbe000640 1 -- 172.21.15.44:0/1091663361 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7efcc8153be0 msgr2=0x7efcc81f56f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:51.527 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:51.537+0000 7efcbe000640 1 --2- 172.21.15.44:0/1091663361 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7efcc8153be0 0x7efcc81f56f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:51.527 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:51.537+0000 7efcbe000640 1 -- 172.21.15.44:0/1091663361 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7efcc8073f30 msgr2=0x7efcc8141f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:51.527 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:51.537+0000 7efcbe000640 1 --2- 172.21.15.44:0/1091663361 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7efcc8073f30 0x7efcc8141f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:51.527 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:51.537+0000 7efcbe000640 1 -- 172.21.15.44:0/1091663361 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efcc81f9200 con 0x7efcc80c66d0 2024-04-17T19:47:51.527 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:51.537+0000 7efcc7400640 1 --2- 172.21.15.44:0/1091663361 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7efcc8153be0 0x7efcc81f56f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-17T19:47:51.527 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:51.537+0000 7efcbe000640 1 --2- 172.21.15.44:0/1091663361 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7efcc80c66d0 0x7efcc81f8cc0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7efcb000c780 tx=0x7efcb000cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:47:51.527 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:51.537+0000 7efcbf400640 1 -- 172.21.15.44:0/1091663361 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efcb0005ae0 con 0x7efcc80c66d0 2024-04-17T19:47:51.527 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:51.537+0000 7efcbf400640 1 -- 172.21.15.44:0/1091663361 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efcb0005c80 con 0x7efcc80c66d0 2024-04-17T19:47:51.527 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:51.537+0000 7efcbf400640 1 -- 172.21.15.44:0/1091663361 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efcb00072b0 con 0x7efcc80c66d0 2024-04-17T19:47:51.528 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:51.537+0000 7efccdc00640 1 -- 172.21.15.44:0/1091663361 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efcc81465e0 con 0x7efcc80c66d0 2024-04-17T19:47:51.528 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:51.537+0000 7efccdc00640 1 -- 172.21.15.44:0/1091663361 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efcc80c7f90 con 0x7efcc80c66d0 2024-04-17T19:47:51.528 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:51.541+0000 7efccdc00640 1 -- 172.21.15.44:0/1091663361 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efcc80c5de0 con 0x7efcc80c66d0 2024-04-17T19:47:51.528 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:51.541+0000 7efcbf400640 1 -- 172.21.15.44:0/1091663361 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7efcb0007450 con 0x7efcc80c66d0 2024-04-17T19:47:51.529 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:51.541+0000 7efcbf400640 1 --2- 172.21.15.44:0/1091663361 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7efca4068380 0x7efca406a890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:51.529 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:51.541+0000 7efcbf400640 1 -- 172.21.15.44:0/1091663361 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6619+0+0 (secure 0 0 0) 0x7efcb0086b80 con 0x7efcc80c66d0 2024-04-17T19:47:51.529 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:51.541+0000 7efcc6a00640 1 --2- 172.21.15.44:0/1091663361 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7efca4068380 0x7efca406a890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:51.530 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:51.545+0000 7efcc6a00640 1 --2- 172.21.15.44:0/1091663361 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7efca4068380 0x7efca406a890 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7efcb80ad000 tx=0x7efcb8008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:47:51.533 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:51.545+0000 7efcbf400640 1 -- 172.21.15.44:0/1091663361 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7efcb0056d40 con 0x7efcc80c66d0 2024-04-17T19:47:51.704 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:51.717+0000 7efccdc00640 1 -- 172.21.15.44:0/1091663361 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7efcc804ff10 con 0x7efcc80c66d0 2024-04-17T19:47:51.706 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:51.717+0000 7efcbf400640 1 -- 172.21.15.44:0/1091663361 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) ==== 74+0+18623 (secure 0 0 0) 0x7efcb0056640 con 0x7efcc80c66d0 2024-04-17T19:47:51.706 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-04-17T19:47:51.706 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":27,"fsid":"703f77ca-79c6-4a66-b576-62c526cb1021","created":"2024-04-17T19:46:30.831994+0000","modified":"2024-04-17T19:47:37.943331+0000","last_up_change":"2024-04-17T19:46:41.988197+0000","last_in_change":"2024-04-17T19:46:33.407430+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-17T19:46:41.940380+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-17T19:46:54.222150+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-17T19:46:55.031694+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-17T19:46:58.707529+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"30520dc6-eea6-43d4-ab60-3ca9e92329dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6800","nonce":1018735925},{"type":"v1","addr":"172.21.15.44:6801","nonce":1018735925}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6802","nonce":1018735925},{"type":"v1","addr":"172.21.15.44:6803","nonce":1018735925}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6806","nonce":1018735925},{"type":"v1","addr":"172.21.15.44:6807","nonce":1018735925}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6804","nonce":1018735925},{"type":"v1","addr":"172.21.15.44:6805","nonce":1018735925}]},"public_addr":"172.21.15.44:6801/1018735925","cluster_addr":"172.21.15.44:6803/1018735925","heartbeat_back_addr":"172.21.15.44:6807/1018735925","heartbeat_front_addr":"172.21.15.44:6805/1018735925","state":["exists","up"]},{"osd":1,"uuid":"079bd511-b6ce-449b-8f11-17b311b12f7c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6817","nonce":1452577434},{"type":"v1","addr":"172.21.15.44:6820","nonce":1452577434}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6823","nonce":1452577434},{"type":"v1","addr":"172.21.15.44:6825","nonce":1452577434}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6830","nonce":1452577434},{"type":"v1","addr":"172.21.15.44:6831","nonce":1452577434}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6828","nonce":1452577434},{"type":"v1","addr":"172.21.15.44:6829","nonce":1452577434}]},"public_addr":"172.21.15.44:6820/1452577434","cluster_addr":"172.21.15.44:6825/1452577434","heartbeat_back_addr":"172.21.15.44:6831/1452577434","heartbeat_front_addr":"172.21.15.44:6829/1452577434","state":["exists","up"]},{"osd":2,"uuid":"34f0b9ab-b1d2-4ee9-841c-f15afbb6bec5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6816","nonce":1160071918},{"type":"v1","addr":"172.21.15.44:6818","nonce":1160071918}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6819","nonce":1160071918},{"type":"v1","addr":"172.21.15.44:6821","nonce":1160071918}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6826","nonce":1160071918},{"type":"v1","addr":"172.21.15.44:6827","nonce":1160071918}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6822","nonce":1160071918},{"type":"v1","addr":"172.21.15.44:6824","nonce":1160071918}]},"public_addr":"172.21.15.44:6818/1160071918","cluster_addr":"172.21.15.44:6821/1160071918","heartbeat_back_addr":"172.21.15.44:6827/1160071918","heartbeat_front_addr":"172.21.15.44:6824/1160071918","state":["exists","up"]},{"osd":3,"uuid":"4740032d-fe34-4b1b-bb85-f430896fc3c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6808","nonce":4236454921},{"type":"v1","addr":"172.21.15.44:6809","nonce":4236454921}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6810","nonce":4236454921},{"type":"v1","addr":"172.21.15.44:6811","nonce":4236454921}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6814","nonce":4236454921},{"type":"v1","addr":"172.21.15.44:6815","nonce":4236454921}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6812","nonce":4236454921},{"type":"v1","addr":"172.21.15.44:6813","nonce":4236454921}]},"public_addr":"172.21.15.44:6809/4236454921","cluster_addr":"172.21.15.44:6811/4236454921","heartbeat_back_addr":"172.21.15.44:6815/4236454921","heartbeat_front_addr":"172.21.15.44:6813/4236454921","state":["exists","up"]},{"osd":4,"uuid":"7dbedb00-302d-4d52-810c-e18839254da1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6800","nonce":2293251376},{"type":"v1","addr":"172.21.15.62:6801","nonce":2293251376}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6802","nonce":2293251376},{"type":"v1","addr":"172.21.15.62:6803","nonce":2293251376}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6806","nonce":2293251376},{"type":"v1","addr":"172.21.15.62:6807","nonce":2293251376}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6804","nonce":2293251376},{"type":"v1","addr":"172.21.15.62:6805","nonce":2293251376}]},"public_addr":"172.21.15.62:6801/2293251376","cluster_addr":"172.21.15.62:6803/2293251376","heartbeat_back_addr":"172.21.15.62:6807/2293251376","heartbeat_front_addr":"172.21.15.62:6805/2293251376","state":["exists","up"]},{"osd":5,"uuid":"38c1e8d9-393d-4f33-a97a-3295cf5c5b07","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6808","nonce":1551020300},{"type":"v1","addr":"172.21.15.62:6809","nonce":1551020300}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6810","nonce":1551020300},{"type":"v1","addr":"172.21.15.62:6811","nonce":1551020300}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6814","nonce":1551020300},{"type":"v1","addr":"172.21.15.62:6815","nonce":1551020300}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6812","nonce":1551020300},{"type":"v1","addr":"172.21.15.62:6813","nonce":1551020300}]},"public_addr":"172.21.15.62:6809/1551020300","cluster_addr":"172.21.15.62:6811/1551020300","heartbeat_back_addr":"172.21.15.62:6815/1551020300","heartbeat_front_addr":"172.21.15.62:6813/1551020300","state":["exists","up"]},{"osd":6,"uuid":"f6ff81c6-f14d-4477-88e3-9116cc5a2992","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6824","nonce":2602310256},{"type":"v1","addr":"172.21.15.62:6825","nonce":2602310256}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6826","nonce":2602310256},{"type":"v1","addr":"172.21.15.62:6827","nonce":2602310256}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6830","nonce":2602310256},{"type":"v1","addr":"172.21.15.62:6831","nonce":2602310256}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6828","nonce":2602310256},{"type":"v1","addr":"172.21.15.62:6829","nonce":2602310256}]},"public_addr":"172.21.15.62:6825/2602310256","cluster_addr":"172.21.15.62:6827/2602310256","heartbeat_back_addr":"172.21.15.62:6831/2602310256","heartbeat_front_addr":"172.21.15.62:6829/2602310256","state":["exists","up"]},{"osd":7,"uuid":"ce395bc3-bcb5-4b94-a523-5bb9df491eca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6816","nonce":2912738359},{"type":"v1","addr":"172.21.15.62:6817","nonce":2912738359}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6818","nonce":2912738359},{"type":"v1","addr":"172.21.15.62:6819","nonce":2912738359}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6822","nonce":2912738359},{"type":"v1","addr":"172.21.15.62:6823","nonce":2912738359}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6820","nonce":2912738359},{"type":"v1","addr":"172.21.15.62:6821","nonce":2912738359}]},"public_addr":"172.21.15.62:6817/2912738359","cluster_addr":"172.21.15.62:6819/2912738359","heartbeat_back_addr":"172.21.15.62:6823/2912738359","heartbeat_front_addr":"172.21.15.62:6821/2912738359","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T19:46:39.302883+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T19:46:39.177705+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T19:46:39.188894+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T19:46:39.313009+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T19:46:38.870508+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T19:46:38.790900+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T19:46:38.979163+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T19:46:38.992348+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.c","mappings":[{"from":0,"to":4}]},{"pgid":"3.15","mappings":[{"from":0,"to":7}]},{"pgid":"4.f","mappings":[{"from":7,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-17T19:47:51.708 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:51.721+0000 7efccdc00640 1 -- 172.21.15.44:0/1091663361 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7efca4068380 msgr2=0x7efca406a890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:51.709 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:51.721+0000 7efccdc00640 1 --2- 172.21.15.44:0/1091663361 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7efca4068380 0x7efca406a890 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7efcb80ad000 tx=0x7efcb8008040 comp rx=0 tx=0).stop 2024-04-17T19:47:51.709 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:51.721+0000 7efccdc00640 1 -- 172.21.15.44:0/1091663361 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7efcc80c66d0 msgr2=0x7efcc81f8cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:51.709 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:51.721+0000 7efccdc00640 1 --2- 172.21.15.44:0/1091663361 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7efcc80c66d0 0x7efcc81f8cc0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7efcb000c780 tx=0x7efcb000cc40 comp rx=0 tx=0).stop 2024-04-17T19:47:51.709 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:51.721+0000 7efccdc00640 1 -- 172.21.15.44:0/1091663361 shutdown_connections 2024-04-17T19:47:51.709 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:51.721+0000 7efccdc00640 1 --2- 172.21.15.44:0/1091663361 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7efca4068380 0x7efca406a890 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:51.709 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:51.721+0000 7efccdc00640 1 --2- 172.21.15.44:0/1091663361 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7efcc8153be0 0x7efcc81f56f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:51.709 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:51.721+0000 7efccdc00640 1 --2- 172.21.15.44:0/1091663361 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7efcc80c66d0 0x7efcc81f8cc0 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:51.709 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:51.721+0000 7efccdc00640 1 --2- 172.21.15.44:0/1091663361 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7efcc8073f30 0x7efcc8141f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:51.709 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:51.721+0000 7efccdc00640 1 -- 172.21.15.44:0/1091663361 >> 172.21.15.44:0/1091663361 conn(0x7efcc806c380 msgr2=0x7efcc8152190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:47:51.709 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:51.721+0000 7efccdc00640 1 -- 172.21.15.44:0/1091663361 shutdown_connections 2024-04-17T19:47:51.709 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:51.721+0000 7efccdc00640 1 -- 172.21.15.44:0/1091663361 wait complete. 2024-04-17T19:47:51.729 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-17T19:46:41.940380+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-17T19:46:54.222150+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-17T19:46:55.031694+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-04-17T19:46:58.707529+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-04-17T19:47:51.729 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-17T19:47:51.883 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:51.897+0000 7f5f6e000640 1 Processor -- start 2024-04-17T19:47:51.884 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:51.897+0000 7f5f6e000640 1 -- start start 2024-04-17T19:47:51.885 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:51.897+0000 7f5f6e000640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f5f68152860 0x7f5f680c68b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:51.885 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:51.897+0000 7f5f6e000640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5f680c4000 con 0x7f5f680c80a0 2024-04-17T19:47:51.885 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:51.897+0000 7f5f6e000640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5f680c42e0 con 0x7f5f68159140 2024-04-17T19:47:51.886 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:51.897+0000 7f5f6e000640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7f5f680c6eb0 con 0x7f5f68152860 2024-04-17T19:47:51.886 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:51.897+0000 7f5f67e00640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f5f680c80a0 0x7f5f680c84b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:46904/0 (socket says 172.21.15.44:46904) 2024-04-17T19:47:51.886 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:51.897+0000 7f5f67e00640 1 -- 172.21.15.44:0/659986795 learned_addr learned my addr 172.21.15.44:0/659986795 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-04-17T19:47:51.886 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:51.897+0000 7f5f67400640 1 --2- 172.21.15.44:0/659986795 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f5f68152860 0x7f5f680c68b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:51.887 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:51.897+0000 7f5f66a00640 1 -- 172.21.15.44:0/659986795 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2248876614 0 0) 0x7f5f680c4000 con 0x7f5f680c80a0 2024-04-17T19:47:51.887 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:51.897+0000 7f5f66a00640 1 -- 172.21.15.44:0/659986795 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5f4c005740 con 0x7f5f680c80a0 2024-04-17T19:47:51.887 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:51.897+0000 7f5f66a00640 1 -- 172.21.15.44:0/659986795 <== mon.1 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3545821138 0 0) 0x7f5f680c42e0 con 0x7f5f68159140 2024-04-17T19:47:51.887 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:51.897+0000 7f5f66a00640 1 -- 172.21.15.44:0/659986795 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5f680c4000 con 0x7f5f68159140 2024-04-17T19:47:51.887 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:51.897+0000 7f5f66a00640 1 -- 172.21.15.44:0/659986795 <== mon.0 v1:172.21.15.44:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1342176205 0 0) 0x7f5f4c005740 con 0x7f5f680c80a0 2024-04-17T19:47:51.887 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:51.897+0000 7f5f67400640 1 -- 172.21.15.44:0/659986795 >> v1:172.21.15.62:6789/0 conn(0x7f5f68159140 legacy=0x7f5f680c47e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:51.887 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:51.897+0000 7f5f67400640 1 -- 172.21.15.44:0/659986795 >> v1:172.21.15.44:6789/0 conn(0x7f5f680c80a0 legacy=0x7f5f680c84b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:51.887 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:51.897+0000 7f5f67400640 1 -- 172.21.15.44:0/659986795 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5f680c7570 con 0x7f5f68152860 2024-04-17T19:47:51.889 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:51.901+0000 7f5f67400640 1 --2- 172.21.15.44:0/659986795 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f5f68152860 0x7f5f680c68b0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f5f580097f0 tx=0x7f5f5801c390 comp rx=0 tx=0).ready entity=mon.2 client_cookie=331e994cef4b6efe server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:47:51.889 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:51.901+0000 7f5f66a00640 1 -- 172.21.15.44:0/659986795 <== mon.2 v2:172.21.15.62:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f580b0070 con 0x7f5f68152860 2024-04-17T19:47:51.889 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:51.901+0000 7f5f66a00640 1 -- 172.21.15.44:0/659986795 <== mon.2 v2:172.21.15.62:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5f580ab400 con 0x7f5f68152860 2024-04-17T19:47:51.890 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:51.901+0000 7f5f66a00640 1 -- 172.21.15.44:0/659986795 <== mon.2 v2:172.21.15.62:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f60001a00 con 0x7f5f68152860 2024-04-17T19:47:51.890 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:51.901+0000 7f5f6e000640 1 -- 172.21.15.44:0/659986795 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f5f68152860 msgr2=0x7f5f680c68b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:51.891 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:51.901+0000 7f5f6e000640 1 --2- 172.21.15.44:0/659986795 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f5f68152860 0x7f5f680c68b0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f5f580097f0 tx=0x7f5f5801c390 comp rx=0 tx=0).stop 2024-04-17T19:47:51.891 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:51.901+0000 7f5f6e000640 1 -- 172.21.15.44:0/659986795 shutdown_connections 2024-04-17T19:47:51.891 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:51.901+0000 7f5f6e000640 1 --2- 172.21.15.44:0/659986795 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f5f68152860 0x7f5f680c68b0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:51.891 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:51.901+0000 7f5f6e000640 1 -- 172.21.15.44:0/659986795 >> 172.21.15.44:0/659986795 conn(0x7f5f6806c380 msgr2=0x7f5f68070080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:47:51.891 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:51.901+0000 7f5f6e000640 1 -- 172.21.15.44:0/659986795 shutdown_connections 2024-04-17T19:47:51.891 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:51.901+0000 7f5f6e000640 1 -- 172.21.15.44:0/659986795 wait complete. 2024-04-17T19:47:51.892 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:51.905+0000 7f5f6e000640 1 Processor -- start 2024-04-17T19:47:51.892 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:51.905+0000 7f5f6e000640 1 -- start start 2024-04-17T19:47:51.895 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:51.905+0000 7f5f6e000640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5f680c80a0 0x7f5f681f5400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:51.896 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:51.905+0000 7f5f6e000640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f5f68152860 0x7f5f68150350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:51.896 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:51.905+0000 7f5f6e000640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5f68159140 0x7f5f6813c6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:51.896 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:51.905+0000 7f5f6e000640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f5f680ca170 con 0x7f5f680c80a0 2024-04-17T19:47:51.896 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:51.905+0000 7f5f6e000640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f5f680c9ff0 con 0x7f5f68159140 2024-04-17T19:47:51.896 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:51.905+0000 7f5f6e000640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7f5f680ca2f0 con 0x7f5f68152860 2024-04-17T19:47:51.896 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:51.905+0000 7f5f67400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5f680c80a0 0x7f5f681f5400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:51.896 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:51.905+0000 7f5f67400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5f680c80a0 0x7f5f681f5400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:34538/0 (socket says 172.21.15.44:34538) 2024-04-17T19:47:51.896 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:51.905+0000 7f5f67400640 1 -- 172.21.15.44:0/2415569122 learned_addr learned my addr 172.21.15.44:0/2415569122 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-04-17T19:47:51.896 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:51.909+0000 7f5f67e00640 1 --2- 172.21.15.44:0/2415569122 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5f68159140 0x7f5f6813c6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:51.896 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:51.909+0000 7f5f5fe00640 1 --2- 172.21.15.44:0/2415569122 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f5f68152860 0x7f5f68150350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:51.896 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:51.909+0000 7f5f67400640 1 -- 172.21.15.44:0/2415569122 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f5f68152860 msgr2=0x7f5f68150350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:51.896 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:51.909+0000 7f5f67400640 1 --2- 172.21.15.44:0/2415569122 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f5f68152860 0x7f5f68150350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:51.896 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:51.909+0000 7f5f67400640 1 -- 172.21.15.44:0/2415569122 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5f68159140 msgr2=0x7f5f6813c6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:51.897 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:51.909+0000 7f5f67400640 1 --2- 172.21.15.44:0/2415569122 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5f68159140 0x7f5f6813c6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:51.897 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:51.909+0000 7f5f67400640 1 -- 172.21.15.44:0/2415569122 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5f681f5940 con 0x7f5f680c80a0 2024-04-17T19:47:51.897 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:51.909+0000 7f5f5fe00640 1 --2- 172.21.15.44:0/2415569122 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f5f68152860 0x7f5f68150350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-17T19:47:51.897 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:51.909+0000 7f5f67400640 1 --2- 172.21.15.44:0/2415569122 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5f680c80a0 0x7f5f681f5400 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f5f58000c10 tx=0x7f5f58019130 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:47:51.897 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:51.909+0000 7f5f5f400640 1 -- 172.21.15.44:0/2415569122 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f580b0040 con 0x7f5f680c80a0 2024-04-17T19:47:51.897 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:51.909+0000 7f5f5f400640 1 -- 172.21.15.44:0/2415569122 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5f58003620 con 0x7f5f680c80a0 2024-04-17T19:47:51.897 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:51.909+0000 7f5f6e000640 1 -- 172.21.15.44:0/2415569122 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5f68150eb0 con 0x7f5f680c80a0 2024-04-17T19:47:51.897 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:51.909+0000 7f5f5f400640 1 -- 172.21.15.44:0/2415569122 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f580039d0 con 0x7f5f680c80a0 2024-04-17T19:47:51.897 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:51.909+0000 7f5f6e000640 1 -- 172.21.15.44:0/2415569122 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5f68142930 con 0x7f5f680c80a0 2024-04-17T19:47:51.898 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:51.909+0000 7f5f6e000640 1 -- 172.21.15.44:0/2415569122 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5f6804ff10 con 0x7f5f680c80a0 2024-04-17T19:47:51.898 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:51.909+0000 7f5f5f400640 1 -- 172.21.15.44:0/2415569122 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f5f580bd020 con 0x7f5f680c80a0 2024-04-17T19:47:51.898 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:51.909+0000 7f5f5f400640 1 --2- 172.21.15.44:0/2415569122 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f5f44068380 0x7f5f4406a890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:51.898 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:51.913+0000 7f5f5f400640 1 -- 172.21.15.44:0/2415569122 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6619+0+0 (secure 0 0 0) 0x7f5f58120620 con 0x7f5f680c80a0 2024-04-17T19:47:51.899 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:51.913+0000 7f5f5fe00640 1 --2- 172.21.15.44:0/2415569122 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f5f44068380 0x7f5f4406a890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:51.900 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:51.913+0000 7f5f5fe00640 1 --2- 172.21.15.44:0/2415569122 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f5f44068380 0x7f5f4406a890 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f5f500011f0 tx=0x7f5f50009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:47:51.903 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:51.917+0000 7f5f5f400640 1 -- 172.21.15.44:0/2415569122 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f5f58016010 con 0x7f5f680c80a0 2024-04-17T19:47:52.073 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:52.085+0000 7f5f6e000640 1 -- 172.21.15.44:0/2415569122 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f5f681f5020 con 0x7f5f680c80a0 2024-04-17T19:47:52.074 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:52.085+0000 7f5f5f400640 1 -- 172.21.15.44:0/2415569122 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v27) ==== 93+0+10 (secure 0 0 0) 0x7f5f580f0720 con 0x7f5f680c80a0 2024-04-17T19:47:52.074 INFO:teuthology.orchestra.run.smithi044.stdout:pg_num: 1 2024-04-17T19:47:52.076 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:52.089+0000 7f5f6e000640 1 -- 172.21.15.44:0/2415569122 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f5f44068380 msgr2=0x7f5f4406a890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:52.076 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:52.089+0000 7f5f6e000640 1 --2- 172.21.15.44:0/2415569122 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f5f44068380 0x7f5f4406a890 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f5f500011f0 tx=0x7f5f50009040 comp rx=0 tx=0).stop 2024-04-17T19:47:52.076 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:52.089+0000 7f5f6e000640 1 -- 172.21.15.44:0/2415569122 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5f680c80a0 msgr2=0x7f5f681f5400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:52.076 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:52.089+0000 7f5f6e000640 1 --2- 172.21.15.44:0/2415569122 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5f680c80a0 0x7f5f681f5400 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f5f58000c10 tx=0x7f5f58019130 comp rx=0 tx=0).stop 2024-04-17T19:47:52.076 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:52.089+0000 7f5f6e000640 1 -- 172.21.15.44:0/2415569122 shutdown_connections 2024-04-17T19:47:52.076 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:52.089+0000 7f5f6e000640 1 --2- 172.21.15.44:0/2415569122 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f5f44068380 0x7f5f4406a890 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:52.077 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:52.089+0000 7f5f6e000640 1 --2- 172.21.15.44:0/2415569122 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f5f68152860 0x7f5f68150350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:52.077 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:52.089+0000 7f5f6e000640 1 --2- 172.21.15.44:0/2415569122 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5f68159140 0x7f5f6813c6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:52.077 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:52.089+0000 7f5f6e000640 1 --2- 172.21.15.44:0/2415569122 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5f680c80a0 0x7f5f681f5400 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:52.077 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:52.089+0000 7f5f6e000640 1 -- 172.21.15.44:0/2415569122 >> 172.21.15.44:0/2415569122 conn(0x7f5f6806c380 msgr2=0x7f5f681474b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:47:52.077 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:52.089+0000 7f5f6e000640 1 -- 172.21.15.44:0/2415569122 shutdown_connections 2024-04-17T19:47:52.077 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:52.089+0000 7f5f6e000640 1 -- 172.21.15.44:0/2415569122 wait complete. 2024-04-17T19:47:52.096 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-17T19:47:52.250 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:52.261+0000 7f6437000640 1 Processor -- start 2024-04-17T19:47:52.250 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:52.261+0000 7f6437000640 1 -- start start 2024-04-17T19:47:52.252 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:52.265+0000 7f6437000640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f64300c41b0 0x7f6430153a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:52.252 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:52.265+0000 7f6437000640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f64300ca3e0 con 0x7f643015a340 2024-04-17T19:47:52.252 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:52.265+0000 7f6437000640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f64300ca650 con 0x7f6430159f30 2024-04-17T19:47:52.252 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:52.265+0000 7f6437000640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 -- 0x7f64300ca930 con 0x7f64300c41b0 2024-04-17T19:47:52.252 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:52.265+0000 7f6436600640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f643015a340 0x7f6430164060 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:46908/0 (socket says 172.21.15.44:46908) 2024-04-17T19:47:52.252 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:52.265+0000 7f6436600640 1 -- 172.21.15.44:0/833258596 learned_addr learned my addr 172.21.15.44:0/833258596 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-04-17T19:47:52.254 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:52.265+0000 7f6435c00640 1 --2- 172.21.15.44:0/833258596 >> v2:172.21.15.62:3300/0 conn(0x7f64300c41b0 0x7f6430153a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:52.254 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:52.265+0000 7f642fe00640 1 -- 172.21.15.44:0/833258596 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2242539694 0 0) 0x7f64300ca3e0 con 0x7f643015a340 2024-04-17T19:47:52.254 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:52.265+0000 7f642fe00640 1 -- 172.21.15.44:0/833258596 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6418003530 con 0x7f643015a340 2024-04-17T19:47:52.254 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:52.265+0000 7f642fe00640 1 -- 172.21.15.44:0/833258596 <== mon.1 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1618748371 0 0) 0x7f64300ca650 con 0x7f6430159f30 2024-04-17T19:47:52.254 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:52.265+0000 7f642fe00640 1 -- 172.21.15.44:0/833258596 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f64300ca3e0 con 0x7f6430159f30 2024-04-17T19:47:52.254 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:52.265+0000 7f642fe00640 1 -- 172.21.15.44:0/833258596 <== mon.0 v1:172.21.15.44:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2099305109 0 0) 0x7f6418003530 con 0x7f643015a340 2024-04-17T19:47:52.254 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:52.265+0000 7f642fe00640 1 -- 172.21.15.44:0/833258596 >> v2:172.21.15.62:3300/0 conn(0x7f64300c41b0 msgr2=0x7f6430153a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T19:47:52.254 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:52.265+0000 7f642fe00640 1 --2- 172.21.15.44:0/833258596 >> v2:172.21.15.62:3300/0 conn(0x7f64300c41b0 0x7f6430153a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:52.254 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:52.265+0000 7f642fe00640 1 -- 172.21.15.44:0/833258596 >> v1:172.21.15.62:6789/0 conn(0x7f6430159f30 legacy=0x7f64300cb9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:52.254 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:52.265+0000 7f642fe00640 1 -- 172.21.15.44:0/833258596 --> v1:172.21.15.44:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6430159a10 con 0x7f643015a340 2024-04-17T19:47:52.254 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:52.265+0000 7f642fe00640 1 -- 172.21.15.44:0/833258596 <== mon.0 v1:172.21.15.44:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1863569991 0 0) 0x7f6428001a00 con 0x7f643015a340 2024-04-17T19:47:52.254 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:52.265+0000 7f642fe00640 1 -- 172.21.15.44:0/833258596 >> v1:172.21.15.44:6789/0 conn(0x7f643015a340 legacy=0x7f6430164060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:52.255 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:52.265+0000 7f642fe00640 1 --2- 172.21.15.44:0/833258596 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f6418003ba0 0x7f6418003ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:52.255 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:52.265+0000 7f642fe00640 1 --2- 172.21.15.44:0/833258596 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6418004810 0x7f6418004c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:52.255 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:52.265+0000 7f642fe00640 1 --2- 172.21.15.44:0/833258596 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6418005220 0x7f641800b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:52.255 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:52.265+0000 7f642fe00640 1 -- 172.21.15.44:0/833258596 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f64300ca930 con 0x7f6418005220 2024-04-17T19:47:52.255 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:52.265+0000 7f642fe00640 1 -- 172.21.15.44:0/833258596 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f641800c100 con 0x7f6418004810 2024-04-17T19:47:52.255 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:52.265+0000 7f642fe00640 1 -- 172.21.15.44:0/833258596 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7f641800c300 con 0x7f6418003ba0 2024-04-17T19:47:52.255 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:52.265+0000 7f6436600640 1 --2- 172.21.15.44:0/833258596 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6418005220 0x7f641800b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:52.255 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:52.265+0000 7f6435200640 1 --2- 172.21.15.44:0/833258596 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6418004810 0x7f6418004c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:52.255 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:52.265+0000 7f6435c00640 1 --2- 172.21.15.44:0/833258596 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f6418003ba0 0x7f6418003ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:52.255 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:52.265+0000 7f6436600640 1 -- 172.21.15.44:0/833258596 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f6418003ba0 msgr2=0x7f6418003ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T19:47:52.255 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:52.265+0000 7f6436600640 1 --2- 172.21.15.44:0/833258596 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f6418003ba0 0x7f6418003ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:52.255 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:52.265+0000 7f6436600640 1 -- 172.21.15.44:0/833258596 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6418004810 msgr2=0x7f6418004c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T19:47:52.255 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:52.265+0000 7f6436600640 1 --2- 172.21.15.44:0/833258596 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6418004810 0x7f6418004c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:52.255 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:52.265+0000 7f6436600640 1 -- 172.21.15.44:0/833258596 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6418003530 con 0x7f6418005220 2024-04-17T19:47:52.257 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:52.269+0000 7f6436600640 1 -- 172.21.15.44:0/833258596 reap_dead start 2024-04-17T19:47:52.257 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:52.269+0000 7f6436600640 1 --2- 172.21.15.44:0/833258596 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6418005220 0x7f641800b9d0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f642800a750 tx=0x7f642801d260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b1a9825818b578dd server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:47:52.257 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:52.269+0000 7f642fe00640 1 -- 172.21.15.44:0/833258596 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f642800a370 con 0x7f6418005220 2024-04-17T19:47:52.257 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:52.269+0000 7f642fe00640 1 -- 172.21.15.44:0/833258596 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f64280ad630 con 0x7f6418005220 2024-04-17T19:47:52.257 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:52.269+0000 7f642fe00640 1 -- 172.21.15.44:0/833258596 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f64280ada20 con 0x7f6418005220 2024-04-17T19:47:52.258 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:52.269+0000 7f6437000640 1 -- 172.21.15.44:0/833258596 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6418005220 msgr2=0x7f641800b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:52.258 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:52.269+0000 7f6437000640 1 --2- 172.21.15.44:0/833258596 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6418005220 0x7f641800b9d0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f642800a750 tx=0x7f642801d260 comp rx=0 tx=0).stop 2024-04-17T19:47:52.258 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:52.269+0000 7f6437000640 1 -- 172.21.15.44:0/833258596 shutdown_connections 2024-04-17T19:47:52.258 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:52.269+0000 7f6437000640 1 --2- 172.21.15.44:0/833258596 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6418005220 0x7f641800b9d0 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:52.258 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:52.269+0000 7f6437000640 1 -- 172.21.15.44:0/833258596 >> 172.21.15.44:0/833258596 conn(0x7f6430072320 msgr2=0x7f6430072730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:47:52.258 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:52.269+0000 7f6437000640 1 -- 172.21.15.44:0/833258596 shutdown_connections 2024-04-17T19:47:52.258 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:52.269+0000 7f6437000640 1 -- 172.21.15.44:0/833258596 wait complete. 2024-04-17T19:47:52.260 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:52.273+0000 7f6437000640 1 Processor -- start 2024-04-17T19:47:52.260 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:52.273+0000 7f6437000640 1 -- start start 2024-04-17T19:47:52.262 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:52.273+0000 7f6437000640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6418005220 0x7f64301e40f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:52.262 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:52.273+0000 7f6437000640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f643014f0b0 0x7f64301e53d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:52.262 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:52.273+0000 7f6437000640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f64301e5910 0x7f64300c4a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:52.263 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:52.273+0000 7f6437000640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f643015db10 con 0x7f64301e5910 2024-04-17T19:47:52.263 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:52.273+0000 7f6437000640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f64300c4890 con 0x7f6418005220 2024-04-17T19:47:52.263 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:52.273+0000 7f6437000640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7f64301e4b00 con 0x7f643014f0b0 2024-04-17T19:47:52.263 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:52.273+0000 7f6436600640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f64301e5910 0x7f64300c4a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:52.263 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:52.273+0000 7f6436600640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f64301e5910 0x7f64300c4a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:34556/0 (socket says 172.21.15.44:34556) 2024-04-17T19:47:52.263 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:52.273+0000 7f6436600640 1 -- 172.21.15.44:0/267006122 learned_addr learned my addr 172.21.15.44:0/267006122 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-04-17T19:47:52.263 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:52.273+0000 7f6435c00640 1 --2- 172.21.15.44:0/267006122 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6418005220 0x7f64301e40f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:52.263 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:52.273+0000 7f6435200640 1 --2- 172.21.15.44:0/267006122 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f643014f0b0 0x7f64301e53d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:52.263 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:52.273+0000 7f6436600640 1 -- 172.21.15.44:0/267006122 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f643014f0b0 msgr2=0x7f64301e53d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:52.263 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:52.273+0000 7f6436600640 1 --2- 172.21.15.44:0/267006122 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f643014f0b0 0x7f64301e53d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:52.263 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:52.273+0000 7f6436600640 1 -- 172.21.15.44:0/267006122 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6418005220 msgr2=0x7f64301e40f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:52.263 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:52.273+0000 7f6436600640 1 --2- 172.21.15.44:0/267006122 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6418005220 0x7f64301e40f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:52.263 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:52.273+0000 7f6436600640 1 -- 172.21.15.44:0/267006122 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f64301e4630 con 0x7f64301e5910 2024-04-17T19:47:52.263 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:52.273+0000 7f6435c00640 1 --2- 172.21.15.44:0/267006122 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6418005220 0x7f64301e40f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-17T19:47:52.263 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:52.277+0000 7f6436600640 1 --2- 172.21.15.44:0/267006122 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f64301e5910 0x7f64300c4a10 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f642801d090 tx=0x7f6418005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:47:52.264 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:52.277+0000 7f642d600640 1 -- 172.21.15.44:0/267006122 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f642800a370 con 0x7f64301e5910 2024-04-17T19:47:52.264 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:52.277+0000 7f642d600640 1 -- 172.21.15.44:0/267006122 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f64280ad7e0 con 0x7f64301e5910 2024-04-17T19:47:52.264 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:52.277+0000 7f6437000640 1 -- 172.21.15.44:0/267006122 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f64301f1e30 con 0x7f64301e5910 2024-04-17T19:47:52.264 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:52.277+0000 7f642d600640 1 -- 172.21.15.44:0/267006122 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f64280adbd0 con 0x7f64301e5910 2024-04-17T19:47:52.265 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:52.277+0000 7f6437000640 1 -- 172.21.15.44:0/267006122 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f64301f23f0 con 0x7f64301e5910 2024-04-17T19:47:52.265 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:52.277+0000 7f6437000640 1 -- 172.21.15.44:0/267006122 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f643004fea0 con 0x7f64301e5910 2024-04-17T19:47:52.265 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:52.277+0000 7f642d600640 1 -- 172.21.15.44:0/267006122 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f6428007070 con 0x7f64301e5910 2024-04-17T19:47:52.265 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:52.277+0000 7f642d600640 1 --2- 172.21.15.44:0/267006122 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f6410068380 0x7f641006a890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:52.266 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:52.277+0000 7f642d600640 1 -- 172.21.15.44:0/267006122 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6619+0+0 (secure 0 0 0) 0x7f6428121540 con 0x7f64301e5910 2024-04-17T19:47:52.266 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:52.277+0000 7f6435c00640 1 --2- 172.21.15.44:0/267006122 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f6410068380 0x7f641006a890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:52.267 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:52.281+0000 7f6435c00640 1 --2- 172.21.15.44:0/267006122 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f6410068380 0x7f641006a890 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f64240099d0 tx=0x7f6424008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:47:52.270 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:52.281+0000 7f642d600640 1 -- 172.21.15.44:0/267006122 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f64280be060 con 0x7f64301e5910 2024-04-17T19:47:52.434 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:52.445+0000 7f6437000640 1 -- 172.21.15.44:0/267006122 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f64300cac30 con 0x7f64301e5910 2024-04-17T19:47:52.434 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:52.449+0000 7f642d600640 1 -- 172.21.15.44:0/267006122 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v27) ==== 104+0+11 (secure 0 0 0) 0x7f64280b4070 con 0x7f64301e5910 2024-04-17T19:47:52.435 INFO:teuthology.orchestra.run.smithi044.stdout:pg_num: 32 2024-04-17T19:47:52.437 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:52.449+0000 7f6437000640 1 -- 172.21.15.44:0/267006122 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f6410068380 msgr2=0x7f641006a890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:52.437 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:52.449+0000 7f6437000640 1 --2- 172.21.15.44:0/267006122 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f6410068380 0x7f641006a890 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f64240099d0 tx=0x7f6424008040 comp rx=0 tx=0).stop 2024-04-17T19:47:52.437 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:52.449+0000 7f6437000640 1 -- 172.21.15.44:0/267006122 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f64301e5910 msgr2=0x7f64300c4a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:52.437 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:52.449+0000 7f6437000640 1 --2- 172.21.15.44:0/267006122 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f64301e5910 0x7f64300c4a10 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f642801d090 tx=0x7f6418005840 comp rx=0 tx=0).stop 2024-04-17T19:47:52.437 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:52.449+0000 7f6437000640 1 -- 172.21.15.44:0/267006122 shutdown_connections 2024-04-17T19:47:52.437 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:52.449+0000 7f6437000640 1 --2- 172.21.15.44:0/267006122 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f6410068380 0x7f641006a890 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:52.437 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:52.449+0000 7f6437000640 1 --2- 172.21.15.44:0/267006122 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f643014f0b0 0x7f64301e53d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:52.437 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:52.449+0000 7f6437000640 1 --2- 172.21.15.44:0/267006122 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f64301e5910 0x7f64300c4a10 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:52.437 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:52.449+0000 7f6437000640 1 --2- 172.21.15.44:0/267006122 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6418005220 0x7f64301e40f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:52.437 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:52.449+0000 7f6437000640 1 -- 172.21.15.44:0/267006122 >> 172.21.15.44:0/267006122 conn(0x7f6430072320 msgr2=0x7f6430072730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:47:52.437 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:52.449+0000 7f6437000640 1 -- 172.21.15.44:0/267006122 shutdown_connections 2024-04-17T19:47:52.438 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:52.449+0000 7f6437000640 1 -- 172.21.15.44:0/267006122 wait complete. 2024-04-17T19:47:52.456 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-17T19:47:52.612 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:52.625+0000 7ffa8cc00640 1 Processor -- start 2024-04-17T19:47:52.612 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:52.625+0000 7ffa8cc00640 1 -- start start 2024-04-17T19:47:52.614 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:52.625+0000 7ffa8cc00640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7ffa8815c500 0x7ffa88155d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:52.614 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:52.625+0000 7ffa8cc00640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7ffa880c65f0 0x7ffa880c6a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:52.614 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:52.625+0000 7ffa8cc00640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ffa880c61f0 con 0x7ffa880c7a00 2024-04-17T19:47:52.614 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:52.625+0000 7ffa8cc00640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 -- 0x7ffa88156290 con 0x7ffa8815c500 2024-04-17T19:47:52.614 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:52.625+0000 7ffa8cc00640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7ffa8815c910 con 0x7ffa880c65f0 2024-04-17T19:47:52.614 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:52.625+0000 7ffa7fe00640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7ffa880c65f0 0x7ffa880c6a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:52.614 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:52.625+0000 7ffa85e00640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7ffa8815c500 0x7ffa88155d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:52.614 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:52.625+0000 7ffa86800640 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7ffa880c7a00 0x7ffa880c7e10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.44:32864/0 (socket says 172.21.15.44:32864) 2024-04-17T19:47:52.614 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:52.625+0000 7ffa86800640 1 -- 172.21.15.44:0/4107031386 learned_addr learned my addr 172.21.15.44:0/4107031386 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-04-17T19:47:52.615 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:52.625+0000 7ffa7fe00640 1 -- 172.21.15.44:0/4107031386 >> v2:172.21.15.62:3300/0 conn(0x7ffa8815c500 msgr2=0x7ffa88155d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T19:47:52.615 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:52.625+0000 7ffa7fe00640 1 --2- 172.21.15.44:0/4107031386 >> v2:172.21.15.62:3300/0 conn(0x7ffa8815c500 0x7ffa88155d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:52.615 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:52.625+0000 7ffa7fe00640 1 -- 172.21.15.44:0/4107031386 >> v1:172.21.15.62:6789/0 conn(0x7ffa880c7a00 legacy=0x7ffa880c7e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:52.615 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:52.625+0000 7ffa7fe00640 1 -- 172.21.15.44:0/4107031386 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffa880c7520 con 0x7ffa880c65f0 2024-04-17T19:47:52.615 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:52.625+0000 7ffa85e00640 1 --2- 172.21.15.44:0/4107031386 >> v2:172.21.15.62:3300/0 conn(0x7ffa8815c500 0x7ffa88155d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-17T19:47:52.618 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:52.629+0000 7ffa7fe00640 1 --2- 172.21.15.44:0/4107031386 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7ffa880c65f0 0x7ffa880c6a00 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7ffa700097c0 tx=0x7ffa7001c4a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=128a650e2db7b4b7 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:47:52.618 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:52.629+0000 7ffa85400640 1 -- 172.21.15.44:0/4107031386 <== mon.2 v2:172.21.15.62:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa700b1070 con 0x7ffa880c65f0 2024-04-17T19:47:52.618 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:52.629+0000 7ffa85400640 1 -- 172.21.15.44:0/4107031386 <== mon.2 v2:172.21.15.62:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffa700ac410 con 0x7ffa880c65f0 2024-04-17T19:47:52.618 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:52.629+0000 7ffa85400640 1 -- 172.21.15.44:0/4107031386 <== mon.2 v2:172.21.15.62:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa700ac7e0 con 0x7ffa880c65f0 2024-04-17T19:47:52.619 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:52.633+0000 7ffa8cc00640 1 -- 172.21.15.44:0/4107031386 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7ffa880c65f0 msgr2=0x7ffa880c6a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:52.619 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:52.633+0000 7ffa8cc00640 1 --2- 172.21.15.44:0/4107031386 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7ffa880c65f0 0x7ffa880c6a00 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7ffa700097c0 tx=0x7ffa7001c4a0 comp rx=0 tx=0).stop 2024-04-17T19:47:52.619 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:52.633+0000 7ffa8cc00640 1 -- 172.21.15.44:0/4107031386 shutdown_connections 2024-04-17T19:47:52.619 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:52.633+0000 7ffa8cc00640 1 --2- 172.21.15.44:0/4107031386 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7ffa880c65f0 0x7ffa880c6a00 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:52.619 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:52.633+0000 7ffa8cc00640 1 --2- 172.21.15.44:0/4107031386 >> v2:172.21.15.62:3300/0 conn(0x7ffa8815c500 0x7ffa88155d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:52.619 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:52.633+0000 7ffa8cc00640 1 -- 172.21.15.44:0/4107031386 >> 172.21.15.44:0/4107031386 conn(0x7ffa8806c380 msgr2=0x7ffa88070080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:47:52.619 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:52.633+0000 7ffa8cc00640 1 -- 172.21.15.44:0/4107031386 shutdown_connections 2024-04-17T19:47:52.619 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:52.633+0000 7ffa8cc00640 1 -- 172.21.15.44:0/4107031386 wait complete. 2024-04-17T19:47:52.621 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:52.633+0000 7ffa8cc00640 1 Processor -- start 2024-04-17T19:47:52.621 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:52.633+0000 7ffa8cc00640 1 -- start start 2024-04-17T19:47:52.624 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:52.637+0000 7ffa8cc00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ffa880c65f0 0x7ffa88157550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:52.624 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:52.637+0000 7ffa8cc00640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7ffa880c7a00 0x7ffa8814c440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:52.624 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:52.637+0000 7ffa8cc00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ffa8815c500 0x7ffa8815ef50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:52.624 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:52.637+0000 7ffa8cc00640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7ffa88073c10 con 0x7ffa880c65f0 2024-04-17T19:47:52.624 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:52.637+0000 7ffa8cc00640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7ffa88074280 con 0x7ffa8815c500 2024-04-17T19:47:52.624 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:52.637+0000 7ffa8cc00640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7ffa88073d90 con 0x7ffa880c7a00 2024-04-17T19:47:52.624 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:52.637+0000 7ffa85e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ffa880c65f0 0x7ffa88157550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:52.624 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:52.637+0000 7ffa85e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ffa880c65f0 0x7ffa88157550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:34558/0 (socket says 172.21.15.44:34558) 2024-04-17T19:47:52.625 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:52.637+0000 7ffa85e00640 1 -- 172.21.15.44:0/1275516645 learned_addr learned my addr 172.21.15.44:0/1275516645 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-04-17T19:47:52.625 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:52.637+0000 7ffa86800640 1 --2- 172.21.15.44:0/1275516645 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ffa8815c500 0x7ffa8815ef50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:52.625 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:52.637+0000 7ffa7fe00640 1 --2- 172.21.15.44:0/1275516645 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7ffa880c7a00 0x7ffa8814c440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:52.625 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:52.637+0000 7ffa85e00640 1 -- 172.21.15.44:0/1275516645 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7ffa880c7a00 msgr2=0x7ffa8814c440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:52.625 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:52.637+0000 7ffa85e00640 1 --2- 172.21.15.44:0/1275516645 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7ffa880c7a00 0x7ffa8814c440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:52.625 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:52.637+0000 7ffa85e00640 1 -- 172.21.15.44:0/1275516645 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ffa8815c500 msgr2=0x7ffa8815ef50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:52.625 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:52.637+0000 7ffa85e00640 1 --2- 172.21.15.44:0/1275516645 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ffa8815c500 0x7ffa8815ef50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:52.625 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:52.637+0000 7ffa85e00640 1 -- 172.21.15.44:0/1275516645 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffa8815d530 con 0x7ffa880c65f0 2024-04-17T19:47:52.625 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:52.637+0000 7ffa7fe00640 1 --2- 172.21.15.44:0/1275516645 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7ffa880c7a00 0x7ffa8814c440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-17T19:47:52.625 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:52.637+0000 7ffa85e00640 1 --2- 172.21.15.44:0/1275516645 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ffa880c65f0 0x7ffa88157550 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7ffa7800e9e0 tx=0x7ffa7800eea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:47:52.625 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:52.637+0000 7ffa7e000640 1 -- 172.21.15.44:0/1275516645 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa78017070 con 0x7ffa880c65f0 2024-04-17T19:47:52.625 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:52.637+0000 7ffa7e000640 1 -- 172.21.15.44:0/1275516645 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffa7800ca30 con 0x7ffa880c65f0 2024-04-17T19:47:52.625 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:52.637+0000 7ffa8cc00640 1 -- 172.21.15.44:0/1275516645 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffa8815d810 con 0x7ffa880c65f0 2024-04-17T19:47:52.625 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:52.637+0000 7ffa7e000640 1 -- 172.21.15.44:0/1275516645 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa7800ce00 con 0x7ffa880c65f0 2024-04-17T19:47:52.625 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:52.637+0000 7ffa8cc00640 1 -- 172.21.15.44:0/1275516645 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffa8815ddd0 con 0x7ffa880c65f0 2024-04-17T19:47:52.626 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:52.637+0000 7ffa8cc00640 1 -- 172.21.15.44:0/1275516645 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffa8804ff10 con 0x7ffa880c65f0 2024-04-17T19:47:52.626 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:52.637+0000 7ffa7e000640 1 -- 172.21.15.44:0/1275516645 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7ffa7801a070 con 0x7ffa880c65f0 2024-04-17T19:47:52.627 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:52.641+0000 7ffa7e000640 1 --2- 172.21.15.44:0/1275516645 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7ffa64068380 0x7ffa6406a890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:52.627 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:52.641+0000 7ffa7e000640 1 -- 172.21.15.44:0/1275516645 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6619+0+0 (secure 0 0 0) 0x7ffa78086f20 con 0x7ffa880c65f0 2024-04-17T19:47:52.627 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:52.641+0000 7ffa7fe00640 1 --2- 172.21.15.44:0/1275516645 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7ffa64068380 0x7ffa6406a890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:52.628 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:52.641+0000 7ffa7fe00640 1 --2- 172.21.15.44:0/1275516645 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7ffa64068380 0x7ffa6406a890 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7ffa700ae000 tx=0x7ffa70008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:47:52.631 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:52.645+0000 7ffa7e000640 1 -- 172.21.15.44:0/1275516645 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7ffa78056af0 con 0x7ffa880c65f0 2024-04-17T19:47:52.802 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:52.813+0000 7ffa8cc00640 1 -- 172.21.15.44:0/1275516645 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7ffa88159450 con 0x7ffa880c65f0 2024-04-17T19:47:52.803 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:52.817+0000 7ffa7e000640 1 -- 172.21.15.44:0/1275516645 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v27) ==== 100+0+11 (secure 0 0 0) 0x7ffa7805adf0 con 0x7ffa880c65f0 2024-04-17T19:47:52.803 INFO:teuthology.orchestra.run.smithi044.stdout:pg_num: 64 2024-04-17T19:47:52.805 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:52.817+0000 7ffa8cc00640 1 -- 172.21.15.44:0/1275516645 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7ffa64068380 msgr2=0x7ffa6406a890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:52.805 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:52.817+0000 7ffa8cc00640 1 --2- 172.21.15.44:0/1275516645 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7ffa64068380 0x7ffa6406a890 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7ffa700ae000 tx=0x7ffa70008040 comp rx=0 tx=0).stop 2024-04-17T19:47:52.805 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:52.817+0000 7ffa8cc00640 1 -- 172.21.15.44:0/1275516645 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ffa880c65f0 msgr2=0x7ffa88157550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:52.805 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:52.817+0000 7ffa8cc00640 1 --2- 172.21.15.44:0/1275516645 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ffa880c65f0 0x7ffa88157550 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7ffa7800e9e0 tx=0x7ffa7800eea0 comp rx=0 tx=0).stop 2024-04-17T19:47:52.805 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:52.817+0000 7ffa8cc00640 1 -- 172.21.15.44:0/1275516645 shutdown_connections 2024-04-17T19:47:52.805 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:52.817+0000 7ffa8cc00640 1 --2- 172.21.15.44:0/1275516645 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7ffa64068380 0x7ffa6406a890 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:52.806 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:52.817+0000 7ffa8cc00640 1 --2- 172.21.15.44:0/1275516645 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7ffa880c7a00 0x7ffa8814c440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:52.806 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:52.817+0000 7ffa8cc00640 1 --2- 172.21.15.44:0/1275516645 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ffa8815c500 0x7ffa8815ef50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:52.806 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:52.817+0000 7ffa8cc00640 1 --2- 172.21.15.44:0/1275516645 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ffa880c65f0 0x7ffa88157550 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:52.806 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:52.817+0000 7ffa8cc00640 1 -- 172.21.15.44:0/1275516645 >> 172.21.15.44:0/1275516645 conn(0x7ffa8806c380 msgr2=0x7ffa88153140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:47:52.806 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:52.817+0000 7ffa8cc00640 1 -- 172.21.15.44:0/1275516645 shutdown_connections 2024-04-17T19:47:52.806 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:52.817+0000 7ffa8cc00640 1 -- 172.21.15.44:0/1275516645 wait complete. 2024-04-17T19:47:52.825 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-04-17T19:47:52.980 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:52.993+0000 7fbcd3000640 1 Processor -- start 2024-04-17T19:47:52.980 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:52.993+0000 7fbcd3000640 1 -- start start 2024-04-17T19:47:52.982 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:52.993+0000 7fbcd3000640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fbccc0c7cc0 0x7fbccc072e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:52.982 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:52.993+0000 7fbcd3000640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fbccc0c8e50 0x7fbccc0733c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:52.982 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:52.993+0000 7fbcd3000640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbccc073f90 con 0x7fbccc0c47c0 2024-04-17T19:47:52.983 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:52.993+0000 7fbcd3000640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 -- 0x7fbccc074270 con 0x7fbccc0c7cc0 2024-04-17T19:47:52.983 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:52.993+0000 7fbcd3000640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7fbccc0c94d0 con 0x7fbccc0c8e50 2024-04-17T19:47:52.983 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:52.993+0000 7fbccbe00640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fbccc0c7cc0 0x7fbccc072e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:52.983 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:52.993+0000 7fbcc3e00640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7fbccc0c47c0 0x7fbccc0c8740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:46910/0 (socket says 172.21.15.44:46910) 2024-04-17T19:47:52.983 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:52.997+0000 7fbcc3e00640 1 -- 172.21.15.44:0/3065661913 learned_addr learned my addr 172.21.15.44:0/3065661913 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-04-17T19:47:52.983 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:52.997+0000 7fbcd1000640 1 --2- 172.21.15.44:0/3065661913 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fbccc0c8e50 0x7fbccc0733c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:52.983 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:52.997+0000 7fbccbe00640 1 -- 172.21.15.44:0/3065661913 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fbccc0c8e50 msgr2=0x7fbccc0733c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T19:47:52.983 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:52.997+0000 7fbccbe00640 1 --2- 172.21.15.44:0/3065661913 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fbccc0c8e50 0x7fbccc0733c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:52.983 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:52.997+0000 7fbccbe00640 1 -- 172.21.15.44:0/3065661913 >> v1:172.21.15.44:6789/0 conn(0x7fbccc0c47c0 legacy=0x7fbccc0c8740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:52.984 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:52.997+0000 7fbccbe00640 1 -- 172.21.15.44:0/3065661913 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbccc0c97b0 con 0x7fbccc0c7cc0 2024-04-17T19:47:52.984 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:52.997+0000 7fbccb400640 1 -- 172.21.15.44:0/3065661913 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1232971807 0 0) 0x7fbccc073f90 con 0x7fbccc0c47c0 2024-04-17T19:47:52.986 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:52.997+0000 7fbccbe00640 1 --2- 172.21.15.44:0/3065661913 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbccc0c7cc0 0x7fbccc072e80 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fbcbc0097c0 tx=0x7fbcbc01c4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=60e0b81bff2d37b6 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:47:52.986 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:52.997+0000 7fbccb400640 1 -- 172.21.15.44:0/3065661913 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbcbc0b0070 con 0x7fbccc0c7cc0 2024-04-17T19:47:52.986 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:52.997+0000 7fbccb400640 1 -- 172.21.15.44:0/3065661913 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbcbc0ab600 con 0x7fbccc0c7cc0 2024-04-17T19:47:52.986 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:52.997+0000 7fbccb400640 1 -- 172.21.15.44:0/3065661913 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbcbc0ab9d0 con 0x7fbccc0c7cc0 2024-04-17T19:47:52.987 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:53.001+0000 7fbcd3000640 1 -- 172.21.15.44:0/3065661913 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbccc0c7cc0 msgr2=0x7fbccc072e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:52.987 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:53.001+0000 7fbcd3000640 1 --2- 172.21.15.44:0/3065661913 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbccc0c7cc0 0x7fbccc072e80 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fbcbc0097c0 tx=0x7fbcbc01c4a0 comp rx=0 tx=0).stop 2024-04-17T19:47:52.987 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:53.001+0000 7fbcd3000640 1 -- 172.21.15.44:0/3065661913 shutdown_connections 2024-04-17T19:47:52.987 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:53.001+0000 7fbcd3000640 1 --2- 172.21.15.44:0/3065661913 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fbccc0c8e50 0x7fbccc0733c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:52.987 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:53.001+0000 7fbcd3000640 1 --2- 172.21.15.44:0/3065661913 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbccc0c7cc0 0x7fbccc072e80 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:52.987 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:53.001+0000 7fbcd3000640 1 -- 172.21.15.44:0/3065661913 >> 172.21.15.44:0/3065661913 conn(0x7fbccc0c9dc0 msgr2=0x7fbccc0ca1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:47:52.987 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:53.001+0000 7fbcd3000640 1 -- 172.21.15.44:0/3065661913 shutdown_connections 2024-04-17T19:47:52.987 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:53.001+0000 7fbcd3000640 1 -- 172.21.15.44:0/3065661913 wait complete. 2024-04-17T19:47:52.989 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:53.001+0000 7fbcd3000640 1 Processor -- start 2024-04-17T19:47:52.989 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:53.001+0000 7fbcd3000640 1 -- start start 2024-04-17T19:47:52.991 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:53.005+0000 7fbcd3000640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fbccc0c47c0 0x7fbccc159830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:52.991 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:53.005+0000 7fbcd3000640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbccc0c7cc0 0x7fbccc141ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:52.991 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:53.005+0000 7fbcd3000640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbccc0c8e50 0x7fbccc144c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:52.991 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:53.005+0000 7fbcd3000640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fbccc168ef0 con 0x7fbccc0c7cc0 2024-04-17T19:47:52.991 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:53.005+0000 7fbcd3000640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7fbccc168d70 con 0x7fbccc0c8e50 2024-04-17T19:47:52.991 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:53.005+0000 7fbcd3000640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7fbccc169070 con 0x7fbccc0c47c0 2024-04-17T19:47:52.991 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:53.005+0000 7fbcc3e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbccc0c7cc0 0x7fbccc141ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:52.991 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:53.005+0000 7fbcc3e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbccc0c7cc0 0x7fbccc141ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:34582/0 (socket says 172.21.15.44:34582) 2024-04-17T19:47:52.992 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:53.005+0000 7fbcc3e00640 1 -- 172.21.15.44:0/2580734993 learned_addr learned my addr 172.21.15.44:0/2580734993 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-04-17T19:47:52.992 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:53.005+0000 7fbccbe00640 1 --2- 172.21.15.44:0/2580734993 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fbccc0c47c0 0x7fbccc159830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:52.992 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:53.005+0000 7fbcd1000640 1 --2- 172.21.15.44:0/2580734993 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbccc0c8e50 0x7fbccc144c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:52.992 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:53.005+0000 7fbcc3e00640 1 -- 172.21.15.44:0/2580734993 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fbccc0c47c0 msgr2=0x7fbccc159830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:52.992 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:53.005+0000 7fbcc3e00640 1 --2- 172.21.15.44:0/2580734993 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fbccc0c47c0 0x7fbccc159830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:52.992 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:53.005+0000 7fbcc3e00640 1 -- 172.21.15.44:0/2580734993 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbccc0c8e50 msgr2=0x7fbccc144c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:52.993 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:53.005+0000 7fbcc3e00640 1 --2- 172.21.15.44:0/2580734993 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbccc0c8e50 0x7fbccc144c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:52.993 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:53.005+0000 7fbcc3e00640 1 -- 172.21.15.44:0/2580734993 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbccc15c410 con 0x7fbccc0c7cc0 2024-04-17T19:47:52.993 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:53.005+0000 7fbcc3e00640 1 --2- 172.21.15.44:0/2580734993 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbccc0c7cc0 0x7fbccc141ff0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fbcb400c480 tx=0x7fbcb400c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:47:52.994 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:53.005+0000 7fbcc8c00640 1 -- 172.21.15.44:0/2580734993 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbcb4018070 con 0x7fbccc0c7cc0 2024-04-17T19:47:52.994 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:53.005+0000 7fbcc8c00640 1 -- 172.21.15.44:0/2580734993 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbcb4007500 con 0x7fbccc0c7cc0 2024-04-17T19:47:52.994 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:53.005+0000 7fbcc8c00640 1 -- 172.21.15.44:0/2580734993 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbcb4004a30 con 0x7fbccc0c7cc0 2024-04-17T19:47:52.994 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:53.005+0000 7fbcd3000640 1 -- 172.21.15.44:0/2580734993 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbccc15c6f0 con 0x7fbccc0c7cc0 2024-04-17T19:47:52.994 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:53.005+0000 7fbcd3000640 1 -- 172.21.15.44:0/2580734993 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbccc159e00 con 0x7fbccc0c7cc0 2024-04-17T19:47:52.995 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:53.009+0000 7fbcd3000640 1 -- 172.21.15.44:0/2580734993 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbccc04ff10 con 0x7fbccc0c7cc0 2024-04-17T19:47:52.996 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:53.009+0000 7fbcc8c00640 1 -- 172.21.15.44:0/2580734993 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fbcb4004bd0 con 0x7fbccc0c7cc0 2024-04-17T19:47:52.997 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:53.009+0000 7fbcc8c00640 1 --2- 172.21.15.44:0/2580734993 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7fbca80683b0 0x7fbca806a8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:52.997 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:53.009+0000 7fbcc8c00640 1 -- 172.21.15.44:0/2580734993 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6619+0+0 (secure 0 0 0) 0x7fbcb4085eb0 con 0x7fbccc0c7cc0 2024-04-17T19:47:52.998 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:53.009+0000 7fbccbe00640 1 --2- 172.21.15.44:0/2580734993 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7fbca80683b0 0x7fbca806a8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:52.999 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:53.013+0000 7fbccbe00640 1 --2- 172.21.15.44:0/2580734993 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7fbca80683b0 0x7fbca806a8c0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fbcbc0ad000 tx=0x7fbcbc0a6000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:47:53.002 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:53.013+0000 7fbcc8c00640 1 -- 172.21.15.44:0/2580734993 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fbcb4055a80 con 0x7fbccc0c7cc0 2024-04-17T19:47:53.167 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:53.181+0000 7fbcd3000640 1 -- 172.21.15.44:0/2580734993 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) -- 0x7fbccc157a00 con 0x7fbccc0c7cc0 2024-04-17T19:47:53.167 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:53.181+0000 7fbcc8c00640 1 -- 172.21.15.44:0/2580734993 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v27) ==== 103+0+11 (secure 0 0 0) 0x7fbcb4059d80 con 0x7fbccc0c7cc0 2024-04-17T19:47:53.168 INFO:teuthology.orchestra.run.smithi044.stdout:pg_num: 32 2024-04-17T19:47:53.170 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:53.181+0000 7fbcd3000640 1 -- 172.21.15.44:0/2580734993 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7fbca80683b0 msgr2=0x7fbca806a8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:53.170 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:53.181+0000 7fbcd3000640 1 --2- 172.21.15.44:0/2580734993 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7fbca80683b0 0x7fbca806a8c0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fbcbc0ad000 tx=0x7fbcbc0a6000 comp rx=0 tx=0).stop 2024-04-17T19:47:53.170 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:53.181+0000 7fbcd3000640 1 -- 172.21.15.44:0/2580734993 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbccc0c7cc0 msgr2=0x7fbccc141ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:53.170 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:53.181+0000 7fbcd3000640 1 --2- 172.21.15.44:0/2580734993 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbccc0c7cc0 0x7fbccc141ff0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fbcb400c480 tx=0x7fbcb400c940 comp rx=0 tx=0).stop 2024-04-17T19:47:53.170 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:53.181+0000 7fbcd3000640 1 -- 172.21.15.44:0/2580734993 shutdown_connections 2024-04-17T19:47:53.170 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:53.181+0000 7fbcd3000640 1 --2- 172.21.15.44:0/2580734993 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7fbca80683b0 0x7fbca806a8c0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:53.170 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:53.181+0000 7fbcd3000640 1 --2- 172.21.15.44:0/2580734993 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbccc0c8e50 0x7fbccc144c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:53.171 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:53.181+0000 7fbcd3000640 1 --2- 172.21.15.44:0/2580734993 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbccc0c7cc0 0x7fbccc141ff0 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:53.171 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:53.181+0000 7fbcd3000640 1 --2- 172.21.15.44:0/2580734993 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fbccc0c47c0 0x7fbccc159830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:53.171 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:53.181+0000 7fbcd3000640 1 -- 172.21.15.44:0/2580734993 >> 172.21.15.44:0/2580734993 conn(0x7fbccc0c9dc0 msgr2=0x7fbccc0cc870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:47:53.171 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:53.181+0000 7fbcd3000640 1 -- 172.21.15.44:0/2580734993 shutdown_connections 2024-04-17T19:47:53.171 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:53.181+0000 7fbcd3000640 1 -- 172.21.15.44:0/2580734993 wait complete. 2024-04-17T19:47:53.190 DEBUG:tasks.mon_thrash:Yielding 2024-04-17T19:47:53.191 INFO:teuthology.run_tasks:Running task workunit... 2024-04-17T19:47:53.205 INFO:tasks.workunit:Pulling workunits from ref f3a98d3f110319c567ec86bf70955c141495ccf6 2024-04-17T19:47:53.205 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-04-17T19:47:53.205 INFO:tasks.workunit:timeout=3h 2024-04-17T19:47:53.205 INFO:tasks.workunit:cleanup=True 2024-04-17T19:47:53.206 DEBUG:teuthology.orchestra.run.smithi044:> stat -- /home/ubuntu/cephtest/mnt.0 2024-04-17T19:47:53.206 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-17T19:47:53.215 INFO:teuthology.orchestra.run.smithi044.stdout: File: /home/ubuntu/cephtest/mnt.0 2024-04-17T19:47:53.215 INFO:teuthology.orchestra.run.smithi044.stdout: Size: 0 Blocks: 0 IO Block: 65536 directory 2024-04-17T19:47:53.215 INFO:teuthology.orchestra.run.smithi044.stdout:Device: 2ch/44d Inode: 1 Links: 2 2024-04-17T19:47:53.215 INFO:teuthology.orchestra.run.smithi044.stdout:Access: (1777/drwxrwxrwt) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-17T19:47:53.215 INFO:teuthology.orchestra.run.smithi044.stdout:Access: 1970-01-01 00:00:00.000000000 +0000 2024-04-17T19:47:53.215 INFO:teuthology.orchestra.run.smithi044.stdout:Modify: 2024-04-17 19:47:01.663841679 +0000 2024-04-17T19:47:53.215 INFO:teuthology.orchestra.run.smithi044.stdout:Change: 2024-04-17 19:47:10.209437059 +0000 2024-04-17T19:47:53.216 INFO:teuthology.orchestra.run.smithi044.stdout: Birth: 2024-04-17 19:47:01.663841679 +0000 2024-04-17T19:47:53.216 INFO:tasks.workunit:Did not need to create dir /home/ubuntu/cephtest/mnt.0 2024-04-17T19:47:53.216 DEBUG:teuthology.orchestra.run.smithi044:> cd -- /home/ubuntu/cephtest/mnt.0 && sudo install -d -m 0755 --owner=ubuntu -- client.0 2024-04-17T19:47:53.296 DEBUG:teuthology.orchestra.run.smithi044:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph-ci.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout f3a98d3f110319c567ec86bf70955c141495ccf6 2024-04-17T19:47:53.348 INFO:tasks.workunit.client.0.smithi044.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-04-17T19:47:53.361 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:53.373+0000 7fe5c4c00640 1 Processor -- start 2024-04-17T19:47:53.361 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:53.373+0000 7fe5c4c00640 1 -- start start 2024-04-17T19:47:53.363 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:53.377+0000 7fe5c4c00640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fe5c00b1a80 0x7fe5c00cba20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:53.363 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:53.377+0000 7fe5c4c00640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe5c015a600 con 0x7fe5c00cbf60 2024-04-17T19:47:53.363 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:53.377+0000 7fe5c4c00640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe5c00ca3b0 con 0x7fe5c00caf70 2024-04-17T19:47:53.363 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:53.377+0000 7fe5c4c00640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7fe5c00cb380 con 0x7fe5c00b1a80 2024-04-17T19:47:53.364 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:53.377+0000 7fe5be800640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7fe5c00cbf60 0x7fe5c0164170 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:46912/0 (socket says 172.21.15.44:46912) 2024-04-17T19:47:53.364 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:53.377+0000 7fe5be800640 1 -- 172.21.15.44:0/1676748947 learned_addr learned my addr 172.21.15.44:0/1676748947 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-04-17T19:47:53.364 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:53.377+0000 7fe5b7e00640 1 --2- 172.21.15.44:0/1676748947 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fe5c00b1a80 0x7fe5c00cba20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:53.364 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:53.377+0000 7fe5bd400640 1 -- 172.21.15.44:0/1676748947 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1144165265 0 0) 0x7fe5c015a600 con 0x7fe5c00cbf60 2024-04-17T19:47:53.364 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:53.377+0000 7fe5bd400640 1 -- 172.21.15.44:0/1676748947 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe5a4003530 con 0x7fe5c00cbf60 2024-04-17T19:47:53.364 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:53.377+0000 7fe5bd400640 1 -- 172.21.15.44:0/1676748947 <== mon.1 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1618547621 0 0) 0x7fe5c00ca3b0 con 0x7fe5c00caf70 2024-04-17T19:47:53.365 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:53.377+0000 7fe5bd400640 1 -- 172.21.15.44:0/1676748947 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe5c015a600 con 0x7fe5c00caf70 2024-04-17T19:47:53.365 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:53.377+0000 7fe5b7e00640 1 -- 172.21.15.44:0/1676748947 >> v1:172.21.15.62:6789/0 conn(0x7fe5c00caf70 legacy=0x7fe5c015d680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:53.365 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:53.377+0000 7fe5b7e00640 1 -- 172.21.15.44:0/1676748947 >> v1:172.21.15.44:6789/0 conn(0x7fe5c00cbf60 legacy=0x7fe5c0164170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:53.365 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:53.377+0000 7fe5b7e00640 1 -- 172.21.15.44:0/1676748947 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe5c015ce80 con 0x7fe5c00b1a80 2024-04-17T19:47:53.367 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:53.381+0000 7fe5b7e00640 1 --2- 172.21.15.44:0/1676748947 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fe5c00b1a80 0x7fe5c00cba20 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fe5a80097f0 tx=0x7fe5a801c450 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b1854f8e08416c54 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:47:53.368 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:53.381+0000 7fe5bd400640 1 -- 172.21.15.44:0/1676748947 <== mon.2 v2:172.21.15.62:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5a80b0070 con 0x7fe5c00b1a80 2024-04-17T19:47:53.368 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:53.381+0000 7fe5bd400640 1 -- 172.21.15.44:0/1676748947 <== mon.2 v2:172.21.15.62:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe5a80ab600 con 0x7fe5c00b1a80 2024-04-17T19:47:53.368 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:53.381+0000 7fe5bd400640 1 -- 172.21.15.44:0/1676748947 <== mon.2 v2:172.21.15.62:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5a80ab9b0 con 0x7fe5c00b1a80 2024-04-17T19:47:53.369 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:53.381+0000 7fe5c4c00640 1 -- 172.21.15.44:0/1676748947 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fe5c00b1a80 msgr2=0x7fe5c00cba20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:53.369 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:53.381+0000 7fe5c4c00640 1 --2- 172.21.15.44:0/1676748947 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fe5c00b1a80 0x7fe5c00cba20 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fe5a80097f0 tx=0x7fe5a801c450 comp rx=0 tx=0).stop 2024-04-17T19:47:53.369 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:53.381+0000 7fe5c4c00640 1 -- 172.21.15.44:0/1676748947 shutdown_connections 2024-04-17T19:47:53.369 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:53.381+0000 7fe5c4c00640 1 --2- 172.21.15.44:0/1676748947 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fe5c00b1a80 0x7fe5c00cba20 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:53.369 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:53.381+0000 7fe5c4c00640 1 -- 172.21.15.44:0/1676748947 >> 172.21.15.44:0/1676748947 conn(0x7fe5c0067eb0 msgr2=0x7fe5c00682c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:47:53.369 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:53.381+0000 7fe5c4c00640 1 -- 172.21.15.44:0/1676748947 shutdown_connections 2024-04-17T19:47:53.369 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:53.381+0000 7fe5c4c00640 1 -- 172.21.15.44:0/1676748947 wait complete. 2024-04-17T19:47:53.371 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:53.385+0000 7fe5c4c00640 1 Processor -- start 2024-04-17T19:47:53.371 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:53.385+0000 7fe5c4c00640 1 -- start start 2024-04-17T19:47:53.373 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:53.385+0000 7fe5c4c00640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fe5c00b1a80 0x7fe5c006def0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:53.373 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:53.385+0000 7fe5c4c00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe5c00caf70 0x7fe5c01f8630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:53.373 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:53.385+0000 7fe5c4c00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe5c00cbf60 0x7fe5c0146fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:53.373 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:53.385+0000 7fe5c4c00640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fe5c00b1e90 con 0x7fe5c00cbf60 2024-04-17T19:47:53.373 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:53.385+0000 7fe5c4c00640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7fe5c015dd90 con 0x7fe5c00caf70 2024-04-17T19:47:53.373 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:53.385+0000 7fe5c4c00640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7fe5c015a270 con 0x7fe5c00b1a80 2024-04-17T19:47:53.373 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:53.385+0000 7fe5be800640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe5c00cbf60 0x7fe5c0146fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:53.373 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:53.385+0000 7fe5be800640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe5c00cbf60 0x7fe5c0146fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:34586/0 (socket says 172.21.15.44:34586) 2024-04-17T19:47:53.373 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:53.385+0000 7fe5be800640 1 -- 172.21.15.44:0/3778804964 learned_addr learned my addr 172.21.15.44:0/3778804964 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-04-17T19:47:53.373 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:53.385+0000 7fe5b7e00640 1 --2- 172.21.15.44:0/3778804964 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe5c00caf70 0x7fe5c01f8630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:53.373 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:53.385+0000 7fe5bde00640 1 --2- 172.21.15.44:0/3778804964 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fe5c00b1a80 0x7fe5c006def0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:53.375 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:53.385+0000 7fe5be800640 1 -- 172.21.15.44:0/3778804964 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fe5c00b1a80 msgr2=0x7fe5c006def0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:53.375 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:53.385+0000 7fe5be800640 1 --2- 172.21.15.44:0/3778804964 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fe5c00b1a80 0x7fe5c006def0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:53.375 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:53.385+0000 7fe5be800640 1 -- 172.21.15.44:0/3778804964 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe5c00caf70 msgr2=0x7fe5c01f8630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:53.375 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:53.385+0000 7fe5be800640 1 --2- 172.21.15.44:0/3778804964 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe5c00caf70 0x7fe5c01f8630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:53.375 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:53.385+0000 7fe5be800640 1 -- 172.21.15.44:0/3778804964 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe5c006e430 con 0x7fe5c00cbf60 2024-04-17T19:47:53.375 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:53.385+0000 7fe5be800640 1 --2- 172.21.15.44:0/3778804964 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe5c00cbf60 0x7fe5c0146fd0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fe5b800caa0 tx=0x7fe5b800cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:47:53.375 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:53.385+0000 7fe5b6000640 1 -- 172.21.15.44:0/3778804964 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5b8017070 con 0x7fe5c00cbf60 2024-04-17T19:47:53.375 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:53.385+0000 7fe5b6000640 1 -- 172.21.15.44:0/3778804964 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe5b800ac00 con 0x7fe5c00cbf60 2024-04-17T19:47:53.375 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:53.385+0000 7fe5b6000640 1 -- 172.21.15.44:0/3778804964 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5b8012400 con 0x7fe5c00cbf60 2024-04-17T19:47:53.375 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:53.385+0000 7fe5c4c00640 1 -- 172.21.15.44:0/3778804964 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe5c0164c10 con 0x7fe5c00cbf60 2024-04-17T19:47:53.375 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:53.385+0000 7fe5c4c00640 1 -- 172.21.15.44:0/3778804964 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe5c015b4f0 con 0x7fe5c00cbf60 2024-04-17T19:47:53.375 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:53.389+0000 7fe5c4c00640 1 -- 172.21.15.44:0/3778804964 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe5c004ff10 con 0x7fe5c00cbf60 2024-04-17T19:47:53.376 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:53.389+0000 7fe5b6000640 1 -- 172.21.15.44:0/3778804964 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fe5b801a070 con 0x7fe5c00cbf60 2024-04-17T19:47:53.377 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:53.389+0000 7fe5b6000640 1 --2- 172.21.15.44:0/3778804964 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7fe59c068380 0x7fe59c06a890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:53.377 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:53.389+0000 7fe5b6000640 1 -- 172.21.15.44:0/3778804964 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6619+0+0 (secure 0 0 0) 0x7fe5b8086a00 con 0x7fe5c00cbf60 2024-04-17T19:47:53.377 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:53.389+0000 7fe5bde00640 1 --2- 172.21.15.44:0/3778804964 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7fe59c068380 0x7fe59c06a890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:53.378 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:53.389+0000 7fe5bde00640 1 --2- 172.21.15.44:0/3778804964 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7fe59c068380 0x7fe59c06a890 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fe5b00011f0 tx=0x7fe5b0009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:47:53.381 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:53.393+0000 7fe5b6000640 1 -- 172.21.15.44:0/3778804964 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fe5b80565d0 con 0x7fe5c00cbf60 2024-04-17T19:47:53.582 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:53.593+0000 7fe5c4c00640 1 -- 172.21.15.44:0/3778804964 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fe5c00cad50 con 0x7fe5c00cbf60 2024-04-17T19:47:53.583 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:53.597+0000 7fe5b6000640 1 -- 172.21.15.44:0/3778804964 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 18 v18) ==== 94+0+6911 (secure 0 0 0) 0x7fe5b805a8d0 con 0x7fe5c00cbf60 2024-04-17T19:47:53.583 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-04-17T19:47:53.583 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":18,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4263,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.44:6835/1724891996","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6832","nonce":1724891996},{"type":"v1","addr":"172.21.15.44:6835","nonce":1724891996}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":18,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-17T19:46:56.083202+0000","modified":"2024-04-17T19:47:39.954509+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":4306,"mds_1":4294,"mds_2":4269,"mds_3":4268,"mds_4":4266},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4266":{"gid":4266,"name":"c","rank":4,"incarnation":17,"state":"up:active","state_seq":14,"addr":"172.21.15.44:6836/2201911513","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6833","nonce":2201911513},{"type":"v1","addr":"172.21.15.44:6836","nonce":2201911513}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4268":{"gid":4268,"name":"f","rank":3,"incarnation":15,"state":"up:active","state_seq":13,"addr":"172.21.15.62:6837/3085335335","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6836","nonce":3085335335},{"type":"v1","addr":"172.21.15.62:6837","nonce":3085335335}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4269":{"gid":4269,"name":"e","rank":2,"incarnation":13,"state":"up:active","state_seq":11,"addr":"172.21.15.44:6837/4073536070","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6834","nonce":4073536070},{"type":"v1","addr":"172.21.15.44:6837","nonce":4073536070}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4294":{"gid":4294,"name":"d","rank":1,"incarnation":9,"state":"up:active","state_seq":10,"addr":"172.21.15.62:6835/2585862759","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6834","nonce":2585862759},{"type":"v1","addr":"172.21.15.62:6835","nonce":2585862759}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4306":{"gid":4306,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":5,"addr":"172.21.15.62:6839/1537667111","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6838","nonce":1537667111},{"type":"v1","addr":"172.21.15.62:6839","nonce":1537667111}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4306,"qdb_cluster":[4266,4268,4294,4269,4306]},"id":1}]} 2024-04-17T19:47:53.583 INFO:teuthology.orchestra.run.smithi044.stderr:dumped fsmap epoch 18 2024-04-17T19:47:53.585 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:53.597+0000 7fe5c4c00640 1 -- 172.21.15.44:0/3778804964 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7fe59c068380 msgr2=0x7fe59c06a890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:53.585 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:53.597+0000 7fe5c4c00640 1 --2- 172.21.15.44:0/3778804964 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7fe59c068380 0x7fe59c06a890 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fe5b00011f0 tx=0x7fe5b0009040 comp rx=0 tx=0).stop 2024-04-17T19:47:53.585 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:53.597+0000 7fe5c4c00640 1 -- 172.21.15.44:0/3778804964 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe5c00cbf60 msgr2=0x7fe5c0146fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:53.585 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:53.597+0000 7fe5c4c00640 1 --2- 172.21.15.44:0/3778804964 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe5c00cbf60 0x7fe5c0146fd0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fe5b800caa0 tx=0x7fe5b800cf60 comp rx=0 tx=0).stop 2024-04-17T19:47:53.585 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:53.597+0000 7fe5c4c00640 1 -- 172.21.15.44:0/3778804964 shutdown_connections 2024-04-17T19:47:53.585 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:53.597+0000 7fe5c4c00640 1 --2- 172.21.15.44:0/3778804964 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7fe59c068380 0x7fe59c06a890 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:53.585 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:53.597+0000 7fe5c4c00640 1 --2- 172.21.15.44:0/3778804964 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe5c00cbf60 0x7fe5c0146fd0 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:53.585 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:53.597+0000 7fe5c4c00640 1 --2- 172.21.15.44:0/3778804964 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe5c00caf70 0x7fe5c01f8630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:53.585 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:53.597+0000 7fe5c4c00640 1 --2- 172.21.15.44:0/3778804964 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fe5c00b1a80 0x7fe5c006def0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:53.585 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:53.597+0000 7fe5c4c00640 1 -- 172.21.15.44:0/3778804964 >> 172.21.15.44:0/3778804964 conn(0x7fe5c0067eb0 msgr2=0x7fe5c00c4df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:47:53.585 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:53.597+0000 7fe5c4c00640 1 -- 172.21.15.44:0/3778804964 shutdown_connections 2024-04-17T19:47:53.585 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:53.597+0000 7fe5c4c00640 1 -- 172.21.15.44:0/3778804964 wait complete. 2024-04-17T19:47:53.606 INFO:tasks.mon_thrash.mon_thrasher:start thrashing 2024-04-17T19:47:53.606 INFO:tasks.mon_thrash.mon_thrasher:seed: 1713383271, revive delay: 20.0, thrash delay: 10.0 thrash many: False, maintain quorum: True store thrash: False, probability: 50 freeze mon: prob 10.0 duration 15.0 2024-04-17T19:47:53.606 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2024-04-17T19:47:53.606 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-04-17T19:47:53.800 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:53.813+0000 7f3d3b400640 1 Processor -- start 2024-04-17T19:47:53.800 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:53.813+0000 7f3d3b400640 1 -- start start 2024-04-17T19:47:53.802 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:53.813+0000 7f3d3b400640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f3d340c5a80 0x7f3d340ca1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:53.802 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:53.813+0000 7f3d3b400640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3d3415bb10 con 0x7f3d340cf380 2024-04-17T19:47:53.802 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:53.813+0000 7f3d3b400640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3d3415bdf0 con 0x7f3d340cb9b0 2024-04-17T19:47:53.802 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:53.813+0000 7f3d3b400640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7f3d340ca7e0 con 0x7f3d340c5a80 2024-04-17T19:47:53.802 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:53.813+0000 7f3d39400640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f3d340cf380 0x7f3d341662f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:46924/0 (socket says 172.21.15.44:46924) 2024-04-17T19:47:53.802 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:53.813+0000 7f3d39400640 1 -- 172.21.15.44:0/3959663536 learned_addr learned my addr 172.21.15.44:0/3959663536 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-04-17T19:47:53.802 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:53.813+0000 7f3d38a00640 1 --2- 172.21.15.44:0/3959663536 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f3d340c5a80 0x7f3d340ca1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:53.803 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:53.813+0000 7f3d33400640 1 -- 172.21.15.44:0/3959663536 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3589191051 0 0) 0x7f3d3415bb10 con 0x7f3d340cf380 2024-04-17T19:47:53.803 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:53.813+0000 7f3d33400640 1 -- 172.21.15.44:0/3959663536 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3d1c003530 con 0x7f3d340cf380 2024-04-17T19:47:53.803 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:53.817+0000 7f3d33400640 1 -- 172.21.15.44:0/3959663536 <== mon.1 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3876892148 0 0) 0x7f3d3415bdf0 con 0x7f3d340cb9b0 2024-04-17T19:47:53.803 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:53.817+0000 7f3d33400640 1 -- 172.21.15.44:0/3959663536 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3d3415bb10 con 0x7f3d340cb9b0 2024-04-17T19:47:53.803 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:53.817+0000 7f3d38a00640 1 -- 172.21.15.44:0/3959663536 >> v1:172.21.15.62:6789/0 conn(0x7f3d340cb9b0 legacy=0x7f3d340cec70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:53.803 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:53.817+0000 7f3d38a00640 1 -- 172.21.15.44:0/3959663536 >> v1:172.21.15.44:6789/0 conn(0x7f3d340cf380 legacy=0x7f3d341662f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:53.803 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:53.817+0000 7f3d38a00640 1 -- 172.21.15.44:0/3959663536 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3d3415c0d0 con 0x7f3d340c5a80 2024-04-17T19:47:53.806 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:53.817+0000 7f3d38a00640 1 --2- 172.21.15.44:0/3959663536 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f3d340c5a80 0x7f3d340ca1c0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f3d280097f0 tx=0x7f3d2801c4e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=eee71bf3521f7614 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:47:53.806 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:53.817+0000 7f3d33400640 1 -- 172.21.15.44:0/3959663536 <== mon.2 v2:172.21.15.62:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d280ab5f0 con 0x7f3d340c5a80 2024-04-17T19:47:53.806 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:53.817+0000 7f3d33400640 1 -- 172.21.15.44:0/3959663536 <== mon.2 v2:172.21.15.62:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3d280b0070 con 0x7f3d340c5a80 2024-04-17T19:47:53.806 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:53.817+0000 7f3d33400640 1 -- 172.21.15.44:0/3959663536 <== mon.2 v2:172.21.15.62:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d280ab990 con 0x7f3d340c5a80 2024-04-17T19:47:53.807 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:53.821+0000 7f3d3b400640 1 -- 172.21.15.44:0/3959663536 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f3d340c5a80 msgr2=0x7f3d340ca1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:53.807 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:53.821+0000 7f3d3b400640 1 --2- 172.21.15.44:0/3959663536 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f3d340c5a80 0x7f3d340ca1c0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f3d280097f0 tx=0x7f3d2801c4e0 comp rx=0 tx=0).stop 2024-04-17T19:47:53.807 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:53.821+0000 7f3d3b400640 1 -- 172.21.15.44:0/3959663536 shutdown_connections 2024-04-17T19:47:53.807 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:53.821+0000 7f3d3b400640 1 --2- 172.21.15.44:0/3959663536 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f3d340c5a80 0x7f3d340ca1c0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:53.807 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:53.821+0000 7f3d3b400640 1 -- 172.21.15.44:0/3959663536 >> 172.21.15.44:0/3959663536 conn(0x7f3d34067eb0 msgr2=0x7f3d340682c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:47:53.807 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:53.821+0000 7f3d3b400640 1 -- 172.21.15.44:0/3959663536 shutdown_connections 2024-04-17T19:47:53.807 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:53.821+0000 7f3d3b400640 1 -- 172.21.15.44:0/3959663536 wait complete. 2024-04-17T19:47:53.809 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:53.821+0000 7f3d3b400640 1 Processor -- start 2024-04-17T19:47:53.809 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:53.821+0000 7f3d3b400640 1 -- start start 2024-04-17T19:47:53.811 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:53.825+0000 7f3d3b400640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f3d340c5a80 0x7f3d340aea40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:53.811 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:53.825+0000 7f3d3b400640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3d340cb9b0 0x7f3d340b3e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:53.811 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:53.825+0000 7f3d3b400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3d340cf380 0x7f3d3415f0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:53.811 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:53.825+0000 7f3d3b400640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f3d3416a640 con 0x7f3d340cf380 2024-04-17T19:47:53.811 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:53.825+0000 7f3d3b400640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f3d340caa10 con 0x7f3d340cb9b0 2024-04-17T19:47:53.812 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:53.825+0000 7f3d3b400640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7f3d3416a7c0 con 0x7f3d340c5a80 2024-04-17T19:47:53.812 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:53.825+0000 7f3d39400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3d340cf380 0x7f3d3415f0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:53.812 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:53.825+0000 7f3d39400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3d340cf380 0x7f3d3415f0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:34602/0 (socket says 172.21.15.44:34602) 2024-04-17T19:47:53.812 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:53.825+0000 7f3d39400640 1 -- 172.21.15.44:0/1366634078 learned_addr learned my addr 172.21.15.44:0/1366634078 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-04-17T19:47:53.812 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:53.825+0000 7f3d38a00640 1 --2- 172.21.15.44:0/1366634078 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f3d340c5a80 0x7f3d340aea40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:53.812 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:53.825+0000 7f3d33e00640 1 --2- 172.21.15.44:0/1366634078 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3d340cb9b0 0x7f3d340b3e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:53.812 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:53.825+0000 7f3d39400640 1 -- 172.21.15.44:0/1366634078 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f3d340c5a80 msgr2=0x7f3d340aea40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:53.812 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:53.825+0000 7f3d39400640 1 --2- 172.21.15.44:0/1366634078 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f3d340c5a80 0x7f3d340aea40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:53.812 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:53.825+0000 7f3d39400640 1 -- 172.21.15.44:0/1366634078 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3d340cb9b0 msgr2=0x7f3d340b3e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:53.812 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:53.825+0000 7f3d39400640 1 --2- 172.21.15.44:0/1366634078 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3d340cb9b0 0x7f3d340b3e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:53.812 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:53.825+0000 7f3d39400640 1 -- 172.21.15.44:0/1366634078 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3d341521e0 con 0x7f3d340cf380 2024-04-17T19:47:53.812 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:53.825+0000 7f3d33e00640 1 --2- 172.21.15.44:0/1366634078 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3d340cb9b0 0x7f3d340b3e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-17T19:47:53.813 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:53.825+0000 7f3d39400640 1 --2- 172.21.15.44:0/1366634078 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3d340cf380 0x7f3d3415f0a0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f3d2c00cb20 tx=0x7f3d2c00a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:47:53.813 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:53.825+0000 7f3d30c00640 1 -- 172.21.15.44:0/1366634078 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d2c017070 con 0x7f3d340cf380 2024-04-17T19:47:53.813 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:53.825+0000 7f3d30c00640 1 -- 172.21.15.44:0/1366634078 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3d2c00ac40 con 0x7f3d340cf380 2024-04-17T19:47:53.813 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:53.825+0000 7f3d3b400640 1 -- 172.21.15.44:0/1366634078 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3d34157a20 con 0x7f3d340cf380 2024-04-17T19:47:53.813 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:53.825+0000 7f3d30c00640 1 -- 172.21.15.44:0/1366634078 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d2c012400 con 0x7f3d340cf380 2024-04-17T19:47:53.813 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:53.825+0000 7f3d3b400640 1 -- 172.21.15.44:0/1366634078 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3d34151e90 con 0x7f3d340cf380 2024-04-17T19:47:53.814 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:53.825+0000 7f3d3b400640 1 -- 172.21.15.44:0/1366634078 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3d3404ff10 con 0x7f3d340cf380 2024-04-17T19:47:53.814 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:53.829+0000 7f3d30c00640 1 -- 172.21.15.44:0/1366634078 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f3d2c01a070 con 0x7f3d340cf380 2024-04-17T19:47:53.815 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:53.829+0000 7f3d30c00640 1 --2- 172.21.15.44:0/1366634078 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f3d14068380 0x7f3d1406a890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:53.815 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:53.829+0000 7f3d30c00640 1 -- 172.21.15.44:0/1366634078 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6619+0+0 (secure 0 0 0) 0x7f3d2c0869d0 con 0x7f3d340cf380 2024-04-17T19:47:53.816 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:53.829+0000 7f3d38a00640 1 --2- 172.21.15.44:0/1366634078 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f3d14068380 0x7f3d1406a890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:53.816 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:53.829+0000 7f3d38a00640 1 --2- 172.21.15.44:0/1366634078 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f3d14068380 0x7f3d1406a890 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f3d280af000 tx=0x7f3d280a7000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:47:53.819 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:53.833+0000 7f3d30c00640 1 -- 172.21.15.44:0/1366634078 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f3d34157a20 con 0x7f3d340cf380 2024-04-17T19:47:53.850 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T19:47:53.854 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T19:47:54.070 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:54.081+0000 7f3d3b400640 1 -- 172.21.15.44:0/1366634078 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f3d340cad90 con 0x7f3d340cf380 2024-04-17T19:47:54.070 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:54.081+0000 7f3d30c00640 1 -- 172.21.15.44:0/1366634078 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1556 (secure 0 0 0) 0x7f3d2c056510 con 0x7f3d340cf380 2024-04-17T19:47:54.070 INFO:teuthology.orchestra.run.smithi044.stdout:{"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":83,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"703f77ca-79c6-4a66-b576-62c526cb1021","modified":"2024-04-17T19:45:55.379749Z","created":"2024-04-17T19:45:55.379749Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:3300","nonce":0},{"type":"v1","addr":"172.21.15.44:6789","nonce":0}]},"addr":"172.21.15.44:6789/0","public_addr":"172.21.15.44:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:3300","nonce":0},{"type":"v1","addr":"172.21.15.62:6789","nonce":0}]},"addr":"172.21.15.62:6789/0","public_addr":"172.21.15.62:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:3301","nonce":0},{"type":"v1","addr":"172.21.15.62:6790","nonce":0}]},"addr":"172.21.15.62:6790/0","public_addr":"172.21.15.62:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-04-17T19:47:54.072 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:54.085+0000 7f3d3b400640 1 -- 172.21.15.44:0/1366634078 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f3d14068380 msgr2=0x7f3d1406a890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:54.072 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:54.085+0000 7f3d3b400640 1 --2- 172.21.15.44:0/1366634078 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f3d14068380 0x7f3d1406a890 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f3d280af000 tx=0x7f3d280a7000 comp rx=0 tx=0).stop 2024-04-17T19:47:54.072 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:54.085+0000 7f3d3b400640 1 -- 172.21.15.44:0/1366634078 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3d340cf380 msgr2=0x7f3d3415f0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:54.072 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:54.085+0000 7f3d3b400640 1 --2- 172.21.15.44:0/1366634078 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3d340cf380 0x7f3d3415f0a0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f3d2c00cb20 tx=0x7f3d2c00a060 comp rx=0 tx=0).stop 2024-04-17T19:47:54.072 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:54.085+0000 7f3d3b400640 1 -- 172.21.15.44:0/1366634078 shutdown_connections 2024-04-17T19:47:54.072 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:54.085+0000 7f3d3b400640 1 --2- 172.21.15.44:0/1366634078 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f3d14068380 0x7f3d1406a890 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:54.073 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:54.085+0000 7f3d3b400640 1 --2- 172.21.15.44:0/1366634078 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3d340cf380 0x7f3d3415f0a0 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:54.073 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:54.085+0000 7f3d3b400640 1 --2- 172.21.15.44:0/1366634078 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3d340cb9b0 0x7f3d340b3e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:54.073 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:54.085+0000 7f3d3b400640 1 --2- 172.21.15.44:0/1366634078 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f3d340c5a80 0x7f3d340aea40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:54.073 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:54.085+0000 7f3d3b400640 1 -- 172.21.15.44:0/1366634078 >> 172.21.15.44:0/1366634078 conn(0x7f3d34067eb0 msgr2=0x7f3d340682c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:47:54.073 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:54.085+0000 7f3d3b400640 1 -- 172.21.15.44:0/1366634078 shutdown_connections 2024-04-17T19:47:54.073 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:54.085+0000 7f3d3b400640 1 -- 172.21.15.44:0/1366634078 wait complete. 2024-04-17T19:47:54.092 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2024-04-17T19:47:54.092 INFO:tasks.mon_thrash.mon_thrasher:making sure all monitors are in the quorum 2024-04-17T19:47:54.092 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon a 2024-04-17T19:47:54.093 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2024-04-17T19:47:54.245 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:54.257+0000 7f44d1800640 1 Processor -- start 2024-04-17T19:47:54.245 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:54.257+0000 7f44d1800640 1 -- start start 2024-04-17T19:47:54.247 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:54.261+0000 7f44d1800640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f44cc152310 0x7f44cc15be50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:54.247 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:54.261+0000 7f44d1800640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f44cc157e50 con 0x7f44cc073f10 2024-04-17T19:47:54.247 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:54.261+0000 7f44d1800640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f44cc15c390 con 0x7f44cc0c7530 2024-04-17T19:47:54.247 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:54.261+0000 7f44d1800640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 -- 0x7f44cc0c4310 con 0x7f44cc152310 2024-04-17T19:47:54.247 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:54.261+0000 7f44caa00640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f44cc073f10 0x7f44cc1588d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:46940/0 (socket says 172.21.15.44:46940) 2024-04-17T19:47:54.247 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:54.261+0000 7f44caa00640 1 -- 172.21.15.44:0/2396973378 learned_addr learned my addr 172.21.15.44:0/2396973378 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-04-17T19:47:54.249 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:54.261+0000 7f44c3e00640 1 --2- 172.21.15.44:0/2396973378 >> v2:172.21.15.62:3300/0 conn(0x7f44cc152310 0x7f44cc15be50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:54.249 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:54.261+0000 7f44ca000640 1 -- 172.21.15.44:0/2396973378 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3818597755 0 0) 0x7f44bc001120 con 0x7f44cc073f10 2024-04-17T19:47:54.249 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:54.261+0000 7f44ca000640 1 -- 172.21.15.44:0/2396973378 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f44b0003530 con 0x7f44cc073f10 2024-04-17T19:47:54.249 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:54.261+0000 7f44ca000640 1 -- 172.21.15.44:0/2396973378 <== mon.0 v1:172.21.15.44:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3878882886 0 0) 0x7f44b0003530 con 0x7f44cc073f10 2024-04-17T19:47:54.249 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:54.261+0000 7f44ca000640 1 -- 172.21.15.44:0/2396973378 >> v2:172.21.15.62:3300/0 conn(0x7f44cc152310 msgr2=0x7f44cc15be50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T19:47:54.249 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:54.261+0000 7f44ca000640 1 --2- 172.21.15.44:0/2396973378 >> v2:172.21.15.62:3300/0 conn(0x7f44cc152310 0x7f44cc15be50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:54.249 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:54.261+0000 7f44ca000640 1 -- 172.21.15.44:0/2396973378 >> v1:172.21.15.62:6789/0 conn(0x7f44cc0c7530 legacy=0x7f44cc1627d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:54.249 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:54.261+0000 7f44ca000640 1 -- 172.21.15.44:0/2396973378 --> v1:172.21.15.44:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f44cc0c45f0 con 0x7f44cc073f10 2024-04-17T19:47:54.249 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:54.261+0000 7f44ca000640 1 -- 172.21.15.44:0/2396973378 <== mon.0 v1:172.21.15.44:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1863569991 0 0) 0x7f44bc001850 con 0x7f44cc073f10 2024-04-17T19:47:54.249 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:54.261+0000 7f44ca000640 1 -- 172.21.15.44:0/2396973378 >> v1:172.21.15.44:6789/0 conn(0x7f44cc073f10 legacy=0x7f44cc1588d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:54.249 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:54.261+0000 7f44ca000640 1 --2- 172.21.15.44:0/2396973378 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f44b00039c0 0x7f44b0003df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:54.249 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:54.261+0000 7f44ca000640 1 --2- 172.21.15.44:0/2396973378 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f44b0004810 0x7f44b0004c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:54.249 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:54.261+0000 7f44ca000640 1 --2- 172.21.15.44:0/2396973378 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f44b0005160 0x7f44b000b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:54.250 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:54.261+0000 7f44ca000640 1 -- 172.21.15.44:0/2396973378 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f44cc0c4310 con 0x7f44b0005160 2024-04-17T19:47:54.250 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:54.261+0000 7f44ca000640 1 -- 172.21.15.44:0/2396973378 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f44b000c0d0 con 0x7f44b0004810 2024-04-17T19:47:54.250 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:54.261+0000 7f44ca000640 1 -- 172.21.15.44:0/2396973378 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7f44b000c2d0 con 0x7f44b00039c0 2024-04-17T19:47:54.250 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:54.261+0000 7f44cb400640 1 --2- 172.21.15.44:0/2396973378 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f44b0005160 0x7f44b000b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:54.250 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:54.261+0000 7f44c3e00640 1 --2- 172.21.15.44:0/2396973378 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f44b0004810 0x7f44b0004c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:54.250 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:54.261+0000 7f44caa00640 1 --2- 172.21.15.44:0/2396973378 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f44b00039c0 0x7f44b0003df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:54.250 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:54.261+0000 7f44cb400640 1 -- 172.21.15.44:0/2396973378 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f44b00039c0 msgr2=0x7f44b0003df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T19:47:54.250 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:54.261+0000 7f44cb400640 1 --2- 172.21.15.44:0/2396973378 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f44b00039c0 0x7f44b0003df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:54.250 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:54.261+0000 7f44cb400640 1 -- 172.21.15.44:0/2396973378 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f44b0004810 msgr2=0x7f44b0004c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T19:47:54.250 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:54.261+0000 7f44cb400640 1 --2- 172.21.15.44:0/2396973378 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f44b0004810 0x7f44b0004c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:54.250 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:54.261+0000 7f44cb400640 1 -- 172.21.15.44:0/2396973378 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f44b0003530 con 0x7f44b0005160 2024-04-17T19:47:54.251 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:54.265+0000 7f44cb400640 1 -- 172.21.15.44:0/2396973378 reap_dead start 2024-04-17T19:47:54.252 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:54.265+0000 7f44cb400640 1 --2- 172.21.15.44:0/2396973378 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f44b0005160 0x7f44b000b9d0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f44cc0745c0 tx=0x7f44c401c840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4d6251b3ae3bce5c server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:47:54.252 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:54.265+0000 7f44ca000640 1 -- 172.21.15.44:0/2396973378 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44c4001b60 con 0x7f44b0005160 2024-04-17T19:47:54.252 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:54.265+0000 7f44ca000640 1 -- 172.21.15.44:0/2396973378 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f44c4003b80 con 0x7f44b0005160 2024-04-17T19:47:54.252 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:54.265+0000 7f44ca000640 1 -- 172.21.15.44:0/2396973378 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44c40050d0 con 0x7f44b0005160 2024-04-17T19:47:54.252 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:54.265+0000 7f44d1800640 1 -- 172.21.15.44:0/2396973378 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f44b0005160 msgr2=0x7f44b000b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:54.253 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:54.265+0000 7f44d1800640 1 --2- 172.21.15.44:0/2396973378 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f44b0005160 0x7f44b000b9d0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f44cc0745c0 tx=0x7f44c401c840 comp rx=0 tx=0).stop 2024-04-17T19:47:54.253 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:54.265+0000 7f44d1800640 1 -- 172.21.15.44:0/2396973378 shutdown_connections 2024-04-17T19:47:54.253 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:54.265+0000 7f44d1800640 1 --2- 172.21.15.44:0/2396973378 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f44b0005160 0x7f44b000b9d0 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:54.253 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:54.265+0000 7f44d1800640 1 -- 172.21.15.44:0/2396973378 >> 172.21.15.44:0/2396973378 conn(0x7f44cc06c380 msgr2=0x7f44cc070080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:47:54.253 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:54.265+0000 7f44d1800640 1 -- 172.21.15.44:0/2396973378 shutdown_connections 2024-04-17T19:47:54.253 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:54.265+0000 7f44d1800640 1 -- 172.21.15.44:0/2396973378 wait complete. 2024-04-17T19:47:54.255 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:54.269+0000 7f44d1800640 1 Processor -- start 2024-04-17T19:47:54.255 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:54.269+0000 7f44d1800640 1 -- start start 2024-04-17T19:47:54.257 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:54.269+0000 7f44d1800640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f44b0005160 0x7f44cc1f5680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:54.257 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:54.269+0000 7f44d1800640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f44cc1502e0 0x7f44cc1496f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:54.257 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:54.269+0000 7f44d1800640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f44cc0c86a0 0x7f44cc141480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:54.257 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:54.269+0000 7f44d1800640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f44cc1583b0 con 0x7f44cc0c86a0 2024-04-17T19:47:54.257 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:54.269+0000 7f44d1800640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f44cc1580d0 con 0x7f44cc1502e0 2024-04-17T19:47:54.257 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:54.269+0000 7f44d1800640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7f44cc0c3ed0 con 0x7f44b0005160 2024-04-17T19:47:54.257 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:54.269+0000 7f44cb400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f44cc0c86a0 0x7f44cc141480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:54.258 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:54.269+0000 7f44cb400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f44cc0c86a0 0x7f44cc141480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:34630/0 (socket says 172.21.15.44:34630) 2024-04-17T19:47:54.258 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:54.269+0000 7f44cb400640 1 -- 172.21.15.44:0/665271556 learned_addr learned my addr 172.21.15.44:0/665271556 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-04-17T19:47:54.258 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:54.269+0000 7f44caa00640 1 --2- 172.21.15.44:0/665271556 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f44b0005160 0x7f44cc1f5680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:54.258 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:54.269+0000 7f44c3e00640 1 --2- 172.21.15.44:0/665271556 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f44cc1502e0 0x7f44cc1496f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:54.258 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:54.269+0000 7f44cb400640 1 -- 172.21.15.44:0/665271556 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f44b0005160 msgr2=0x7f44cc1f5680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:54.258 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:54.269+0000 7f44cb400640 1 --2- 172.21.15.44:0/665271556 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f44b0005160 0x7f44cc1f5680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:54.258 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:54.269+0000 7f44cb400640 1 -- 172.21.15.44:0/665271556 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f44cc1502e0 msgr2=0x7f44cc1496f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:54.258 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:54.269+0000 7f44cb400640 1 --2- 172.21.15.44:0/665271556 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f44cc1502e0 0x7f44cc1496f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:54.258 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:54.269+0000 7f44cb400640 1 -- 172.21.15.44:0/665271556 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f44cc14a280 con 0x7f44cc0c86a0 2024-04-17T19:47:54.258 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:54.269+0000 7f44cb400640 1 --2- 172.21.15.44:0/665271556 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f44cc0c86a0 0x7f44cc141480 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f44c401d0e0 tx=0x7f44b0005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:47:54.260 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:54.269+0000 7f44c2a00640 1 -- 172.21.15.44:0/665271556 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44c40ad030 con 0x7f44cc0c86a0 2024-04-17T19:47:54.260 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:54.269+0000 7f44c2a00640 1 -- 172.21.15.44:0/665271556 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f44c4001b40 con 0x7f44cc0c86a0 2024-04-17T19:47:54.260 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:54.269+0000 7f44c2a00640 1 -- 172.21.15.44:0/665271556 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44c40a6880 con 0x7f44cc0c86a0 2024-04-17T19:47:54.260 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:54.269+0000 7f44d1800640 1 -- 172.21.15.44:0/665271556 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f44cc150960 con 0x7f44cc0c86a0 2024-04-17T19:47:54.260 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:54.269+0000 7f44d1800640 1 -- 172.21.15.44:0/665271556 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f44cc150ee0 con 0x7f44cc0c86a0 2024-04-17T19:47:54.260 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:54.273+0000 7f44d1800640 1 --2- 172.21.15.44:0/665271556 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f44cc0c8ab0 0x7f44cc1f5bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:54.260 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:54.273+0000 7f44d1800640 1 -- 172.21.15.44:0/665271556 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f44cc04ff10 con 0x7f44cc0c8ab0 2024-04-17T19:47:54.260 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:54.273+0000 7f44caa00640 1 --2- 172.21.15.44:0/665271556 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f44cc0c8ab0 0x7f44cc1f5bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:54.260 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:54.273+0000 7f44caa00640 1 -- 172.21.15.44:0/665271556 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f44cc072cb0 con 0x7f44cc0c8ab0 2024-04-17T19:47:54.260 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:54.273+0000 7f44caa00640 1 --2- 172.21.15.44:0/665271556 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f44cc0c8ab0 0x7f44cc1f5bc0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f44bc000f70 tx=0x7f44bc014cd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:47:54.260 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:54.273+0000 7f44c2a00640 1 -- 172.21.15.44:0/665271556 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44bc010040 con 0x7f44cc0c8ab0 2024-04-17T19:47:54.260 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:54.273+0000 7f44c2a00640 1 -- 172.21.15.44:0/665271556 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f44c40a6a20 con 0x7f44cc0c86a0 2024-04-17T19:47:54.261 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:54.273+0000 7f44c2a00640 1 --2- 172.21.15.44:0/665271556 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f44a8068280 0x7f44a806a790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:54.261 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:54.273+0000 7f44c2a00640 1 -- 172.21.15.44:0/665271556 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6619+0+0 (secure 0 0 0) 0x7f44c4120540 con 0x7f44cc0c86a0 2024-04-17T19:47:54.261 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:54.273+0000 7f44c2a00640 1 -- 172.21.15.44:0/665271556 <== mon.0 v2:172.21.15.44:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f44bc01c070 con 0x7f44cc0c8ab0 2024-04-17T19:47:54.261 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:54.273+0000 7f44c2a00640 1 -- 172.21.15.44:0/665271556 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f44cc0c8ab0 msgr2=0x7f44cc1f5bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:54.262 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:54.273+0000 7f44c2a00640 1 --2- 172.21.15.44:0/665271556 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f44cc0c8ab0 0x7f44cc1f5bc0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f44bc000f70 tx=0x7f44bc014cd0 comp rx=0 tx=0).stop 2024-04-17T19:47:54.262 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:54.273+0000 7f44c2a00640 1 -- 172.21.15.44:0/665271556 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f44cc0c8ab0 msgr2=0x7f44cc1f5bc0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-04-17T19:47:54.262 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:54.273+0000 7f44c2a00640 1 --2- 172.21.15.44:0/665271556 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f44cc0c8ab0 0x7f44cc1f5bc0 secure :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f44bc000f70 tx=0x7f44bc014cd0 comp rx=0 tx=0).stop 2024-04-17T19:47:54.262 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:54.273+0000 7f44c3e00640 1 --2- 172.21.15.44:0/665271556 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f44a8068280 0x7f44a806a790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:54.262 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:54.273+0000 7f44c3e00640 1 --2- 172.21.15.44:0/665271556 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f44a8068280 0x7f44a806a790 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f44cc0708f0 tx=0x7f44b4009190 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:47:54.267 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:54.281+0000 7f44d1800640 1 --2- 172.21.15.44:0/665271556 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f44cc1419c0 0x7f44cc14af00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:54.267 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:54.281+0000 7f44d1800640 1 -- 172.21.15.44:0/665271556 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f44cc141dd0 con 0x7f44cc1419c0 2024-04-17T19:47:54.267 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:54.281+0000 7f44caa00640 1 --2- 172.21.15.44:0/665271556 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f44cc1419c0 0x7f44cc14af00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:54.267 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:54.281+0000 7f44caa00640 1 -- 172.21.15.44:0/665271556 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f44cc0c7fb0 con 0x7f44cc1419c0 2024-04-17T19:47:54.268 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:54.281+0000 7f44caa00640 1 --2- 172.21.15.44:0/665271556 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f44cc1419c0 0x7f44cc14af00 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f44bc000f70 tx=0x7f44bc000bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:47:54.268 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:54.281+0000 7f44c2a00640 1 -- 172.21.15.44:0/665271556 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44bc017670 con 0x7f44cc1419c0 2024-04-17T19:47:54.268 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:54.281+0000 7f44c2a00640 1 -- 172.21.15.44:0/665271556 <== mon.0 v2:172.21.15.44:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+5201 (secure 0 0 0) 0x7f44bc017670 con 0x7f44cc1419c0 2024-04-17T19:47:54.268 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:54.281+0000 7f44c2a00640 1 -- 172.21.15.44:0/665271556 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f44cc1419c0 msgr2=0x7f44cc14af00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:54.269 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:54.281+0000 7f44c2a00640 1 --2- 172.21.15.44:0/665271556 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f44cc1419c0 0x7f44cc14af00 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f44bc000f70 tx=0x7f44bc000bd0 comp rx=0 tx=0).stop 2024-04-17T19:47:54.269 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:54.281+0000 7f44c2a00640 1 -- 172.21.15.44:0/665271556 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f44cc1419c0 msgr2=0x7f44cc14af00 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-04-17T19:47:54.269 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:54.281+0000 7f44c2a00640 1 --2- 172.21.15.44:0/665271556 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f44cc1419c0 0x7f44cc14af00 secure :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f44bc000f70 tx=0x7f44bc000bd0 comp rx=0 tx=0).stop 2024-04-17T19:47:54.269 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2024-04-17T19:47:54.269 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "a", 2024-04-17T19:47:54.269 INFO:teuthology.orchestra.run.smithi044.stdout: "rank": 0, 2024-04-17T19:47:54.269 INFO:teuthology.orchestra.run.smithi044.stdout: "state": "leader", 2024-04-17T19:47:54.269 INFO:teuthology.orchestra.run.smithi044.stdout: "election_epoch": 4, 2024-04-17T19:47:54.269 INFO:teuthology.orchestra.run.smithi044.stdout: "uptime": 83742, 2024-04-17T19:47:54.269 INFO:teuthology.orchestra.run.smithi044.stdout: "quorum": [ 2024-04-17T19:47:54.270 INFO:teuthology.orchestra.run.smithi044.stdout: 0, 2024-04-17T19:47:54.270 INFO:teuthology.orchestra.run.smithi044.stdout: 1, 2024-04-17T19:47:54.270 INFO:teuthology.orchestra.run.smithi044.stdout: 2 2024-04-17T19:47:54.270 INFO:teuthology.orchestra.run.smithi044.stdout: ], 2024-04-17T19:47:54.270 INFO:teuthology.orchestra.run.smithi044.stdout: "quorum_age": 83, 2024-04-17T19:47:54.270 INFO:teuthology.orchestra.run.smithi044.stdout: "features": { 2024-04-17T19:47:54.270 INFO:teuthology.orchestra.run.smithi044.stdout: "required_con": "2450521708007866372", 2024-04-17T19:47:54.270 INFO:teuthology.orchestra.run.smithi044.stdout: "required_mon": [ 2024-04-17T19:47:54.270 INFO:teuthology.orchestra.run.smithi044.stdout: "kraken", 2024-04-17T19:47:54.270 INFO:teuthology.orchestra.run.smithi044.stdout: "luminous", 2024-04-17T19:47:54.271 INFO:teuthology.orchestra.run.smithi044.stdout: "mimic", 2024-04-17T19:47:54.271 INFO:teuthology.orchestra.run.smithi044.stdout: "osdmap-prune", 2024-04-17T19:47:54.271 INFO:teuthology.orchestra.run.smithi044.stdout: "nautilus", 2024-04-17T19:47:54.271 INFO:teuthology.orchestra.run.smithi044.stdout: "octopus", 2024-04-17T19:47:54.271 INFO:teuthology.orchestra.run.smithi044.stdout: "pacific", 2024-04-17T19:47:54.271 INFO:teuthology.orchestra.run.smithi044.stdout: "elector-pinging", 2024-04-17T19:47:54.271 INFO:teuthology.orchestra.run.smithi044.stdout: "quincy", 2024-04-17T19:47:54.271 INFO:teuthology.orchestra.run.smithi044.stdout: "reef", 2024-04-17T19:47:54.271 INFO:teuthology.orchestra.run.smithi044.stdout: "squid" 2024-04-17T19:47:54.271 INFO:teuthology.orchestra.run.smithi044.stdout: ], 2024-04-17T19:47:54.271 INFO:teuthology.orchestra.run.smithi044.stdout: "quorum_con": "4540701547738038271", 2024-04-17T19:47:54.271 INFO:teuthology.orchestra.run.smithi044.stdout: "quorum_mon": [ 2024-04-17T19:47:54.271 INFO:teuthology.orchestra.run.smithi044.stdout: "kraken", 2024-04-17T19:47:54.271 INFO:teuthology.orchestra.run.smithi044.stdout: "luminous", 2024-04-17T19:47:54.272 INFO:teuthology.orchestra.run.smithi044.stdout: "mimic", 2024-04-17T19:47:54.272 INFO:teuthology.orchestra.run.smithi044.stdout: "osdmap-prune", 2024-04-17T19:47:54.272 INFO:teuthology.orchestra.run.smithi044.stdout: "nautilus", 2024-04-17T19:47:54.272 INFO:teuthology.orchestra.run.smithi044.stdout: "octopus", 2024-04-17T19:47:54.272 INFO:teuthology.orchestra.run.smithi044.stdout: "pacific", 2024-04-17T19:47:54.272 INFO:teuthology.orchestra.run.smithi044.stdout: "elector-pinging", 2024-04-17T19:47:54.272 INFO:teuthology.orchestra.run.smithi044.stdout: "quincy", 2024-04-17T19:47:54.272 INFO:teuthology.orchestra.run.smithi044.stdout: "reef", 2024-04-17T19:47:54.272 INFO:teuthology.orchestra.run.smithi044.stdout: "squid" 2024-04-17T19:47:54.272 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T19:47:54.272 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T19:47:54.272 INFO:teuthology.orchestra.run.smithi044.stdout: "outside_quorum": [], 2024-04-17T19:47:54.272 INFO:teuthology.orchestra.run.smithi044.stdout: "extra_probe_peers": [], 2024-04-17T19:47:54.272 INFO:teuthology.orchestra.run.smithi044.stdout: "sync_provider": [], 2024-04-17T19:47:54.273 INFO:teuthology.orchestra.run.smithi044.stdout: "monmap": { 2024-04-17T19:47:54.273 INFO:teuthology.orchestra.run.smithi044.stdout: "epoch": 1, 2024-04-17T19:47:54.273 INFO:teuthology.orchestra.run.smithi044.stdout: "fsid": "703f77ca-79c6-4a66-b576-62c526cb1021", 2024-04-17T19:47:54.273 INFO:teuthology.orchestra.run.smithi044.stdout: "modified": "2024-04-17T19:45:55.379749Z", 2024-04-17T19:47:54.273 INFO:teuthology.orchestra.run.smithi044.stdout: "created": "2024-04-17T19:45:55.379749Z", 2024-04-17T19:47:54.273 INFO:teuthology.orchestra.run.smithi044.stdout: "min_mon_release": 19, 2024-04-17T19:47:54.273 INFO:teuthology.orchestra.run.smithi044.stdout: "min_mon_release_name": "squid", 2024-04-17T19:47:54.273 INFO:teuthology.orchestra.run.smithi044.stdout: "election_strategy": 1, 2024-04-17T19:47:54.273 INFO:teuthology.orchestra.run.smithi044.stdout: "disallowed_leaders: ": "", 2024-04-17T19:47:54.273 INFO:teuthology.orchestra.run.smithi044.stdout: "stretch_mode": false, 2024-04-17T19:47:54.273 INFO:teuthology.orchestra.run.smithi044.stdout: "tiebreaker_mon": "", 2024-04-17T19:47:54.273 INFO:teuthology.orchestra.run.smithi044.stdout: "removed_ranks: ": "", 2024-04-17T19:47:54.273 INFO:teuthology.orchestra.run.smithi044.stdout: "features": { 2024-04-17T19:47:54.273 INFO:teuthology.orchestra.run.smithi044.stdout: "persistent": [ 2024-04-17T19:47:54.274 INFO:teuthology.orchestra.run.smithi044.stdout: "kraken", 2024-04-17T19:47:54.274 INFO:teuthology.orchestra.run.smithi044.stdout: "luminous", 2024-04-17T19:47:54.274 INFO:teuthology.orchestra.run.smithi044.stdout: "mimic", 2024-04-17T19:47:54.274 INFO:teuthology.orchestra.run.smithi044.stdout: "osdmap-prune", 2024-04-17T19:47:54.274 INFO:teuthology.orchestra.run.smithi044.stdout: "nautilus", 2024-04-17T19:47:54.274 INFO:teuthology.orchestra.run.smithi044.stdout: "octopus", 2024-04-17T19:47:54.274 INFO:teuthology.orchestra.run.smithi044.stdout: "pacific", 2024-04-17T19:47:54.274 INFO:teuthology.orchestra.run.smithi044.stdout: "elector-pinging", 2024-04-17T19:47:54.274 INFO:teuthology.orchestra.run.smithi044.stdout: "quincy", 2024-04-17T19:47:54.274 INFO:teuthology.orchestra.run.smithi044.stdout: "reef", 2024-04-17T19:47:54.274 INFO:teuthology.orchestra.run.smithi044.stdout: "squid" 2024-04-17T19:47:54.274 INFO:teuthology.orchestra.run.smithi044.stdout: ], 2024-04-17T19:47:54.274 INFO:teuthology.orchestra.run.smithi044.stdout: "optional": [] 2024-04-17T19:47:54.274 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T19:47:54.275 INFO:teuthology.orchestra.run.smithi044.stdout: "mons": [ 2024-04-17T19:47:54.275 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T19:47:54.275 INFO:teuthology.orchestra.run.smithi044.stdout: "rank": 0, 2024-04-17T19:47:54.275 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "a", 2024-04-17T19:47:54.275 INFO:teuthology.orchestra.run.smithi044.stdout: "public_addrs": { 2024-04-17T19:47:54.275 INFO:teuthology.orchestra.run.smithi044.stdout: "addrvec": [ 2024-04-17T19:47:54.275 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T19:47:54.275 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "v2", 2024-04-17T19:47:54.275 INFO:teuthology.orchestra.run.smithi044.stdout: "addr": "172.21.15.44:3300", 2024-04-17T19:47:54.275 INFO:teuthology.orchestra.run.smithi044.stdout: "nonce": 0 2024-04-17T19:47:54.275 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T19:47:54.275 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T19:47:54.275 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "v1", 2024-04-17T19:47:54.275 INFO:teuthology.orchestra.run.smithi044.stdout: "addr": "172.21.15.44:6789", 2024-04-17T19:47:54.275 INFO:teuthology.orchestra.run.smithi044.stdout: "nonce": 0 2024-04-17T19:47:54.276 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T19:47:54.276 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T19:47:54.276 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T19:47:54.276 INFO:teuthology.orchestra.run.smithi044.stdout: "addr": "172.21.15.44:6789/0", 2024-04-17T19:47:54.276 INFO:teuthology.orchestra.run.smithi044.stdout: "public_addr": "172.21.15.44:6789/0", 2024-04-17T19:47:54.276 INFO:teuthology.orchestra.run.smithi044.stdout: "priority": 0, 2024-04-17T19:47:54.276 INFO:teuthology.orchestra.run.smithi044.stdout: "weight": 0, 2024-04-17T19:47:54.276 INFO:teuthology.orchestra.run.smithi044.stdout: "crush_location": "{}" 2024-04-17T19:47:54.276 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T19:47:54.276 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T19:47:54.276 INFO:teuthology.orchestra.run.smithi044.stdout: "rank": 1, 2024-04-17T19:47:54.276 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "b", 2024-04-17T19:47:54.276 INFO:teuthology.orchestra.run.smithi044.stdout: "public_addrs": { 2024-04-17T19:47:54.277 INFO:teuthology.orchestra.run.smithi044.stdout: "addrvec": [ 2024-04-17T19:47:54.277 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T19:47:54.277 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "v2", 2024-04-17T19:47:54.277 INFO:teuthology.orchestra.run.smithi044.stdout: "addr": "172.21.15.62:3300", 2024-04-17T19:47:54.277 INFO:teuthology.orchestra.run.smithi044.stdout: "nonce": 0 2024-04-17T19:47:54.277 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T19:47:54.277 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T19:47:54.277 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "v1", 2024-04-17T19:47:54.277 INFO:teuthology.orchestra.run.smithi044.stdout: "addr": "172.21.15.62:6789", 2024-04-17T19:47:54.277 INFO:teuthology.orchestra.run.smithi044.stdout: "nonce": 0 2024-04-17T19:47:54.277 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T19:47:54.277 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T19:47:54.278 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T19:47:54.278 INFO:teuthology.orchestra.run.smithi044.stdout: "addr": "172.21.15.62:6789/0", 2024-04-17T19:47:54.278 INFO:teuthology.orchestra.run.smithi044.stdout: "public_addr": "172.21.15.62:6789/0", 2024-04-17T19:47:54.278 INFO:teuthology.orchestra.run.smithi044.stdout: "priority": 0, 2024-04-17T19:47:54.278 INFO:teuthology.orchestra.run.smithi044.stdout: "weight": 0, 2024-04-17T19:47:54.278 INFO:teuthology.orchestra.run.smithi044.stdout: "crush_location": "{}" 2024-04-17T19:47:54.278 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T19:47:54.278 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T19:47:54.278 INFO:teuthology.orchestra.run.smithi044.stdout: "rank": 2, 2024-04-17T19:47:54.278 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "c", 2024-04-17T19:47:54.278 INFO:teuthology.orchestra.run.smithi044.stdout: "public_addrs": { 2024-04-17T19:47:54.278 INFO:teuthology.orchestra.run.smithi044.stdout: "addrvec": [ 2024-04-17T19:47:54.278 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T19:47:54.279 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "v2", 2024-04-17T19:47:54.279 INFO:teuthology.orchestra.run.smithi044.stdout: "addr": "172.21.15.62:3301", 2024-04-17T19:47:54.279 INFO:teuthology.orchestra.run.smithi044.stdout: "nonce": 0 2024-04-17T19:47:54.279 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T19:47:54.279 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T19:47:54.279 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "v1", 2024-04-17T19:47:54.279 INFO:teuthology.orchestra.run.smithi044.stdout: "addr": "172.21.15.62:6790", 2024-04-17T19:47:54.279 INFO:teuthology.orchestra.run.smithi044.stdout: "nonce": 0 2024-04-17T19:47:54.279 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T19:47:54.279 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T19:47:54.279 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T19:47:54.279 INFO:teuthology.orchestra.run.smithi044.stdout: "addr": "172.21.15.62:6790/0", 2024-04-17T19:47:54.279 INFO:teuthology.orchestra.run.smithi044.stdout: "public_addr": "172.21.15.62:6790/0", 2024-04-17T19:47:54.279 INFO:teuthology.orchestra.run.smithi044.stdout: "priority": 0, 2024-04-17T19:47:54.279 INFO:teuthology.orchestra.run.smithi044.stdout: "weight": 0, 2024-04-17T19:47:54.280 INFO:teuthology.orchestra.run.smithi044.stdout: "crush_location": "{}" 2024-04-17T19:47:54.280 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T19:47:54.280 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T19:47:54.280 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T19:47:54.280 INFO:teuthology.orchestra.run.smithi044.stdout: "feature_map": { 2024-04-17T19:47:54.280 INFO:teuthology.orchestra.run.smithi044.stdout: "mon": [ 2024-04-17T19:47:54.280 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T19:47:54.280 INFO:teuthology.orchestra.run.smithi044.stdout: "features": "0x3f03cffffffdffff", 2024-04-17T19:47:54.280 INFO:teuthology.orchestra.run.smithi044.stdout: "release": "luminous", 2024-04-17T19:47:54.280 INFO:teuthology.orchestra.run.smithi044.stdout: "num": 1 2024-04-17T19:47:54.280 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T19:47:54.280 INFO:teuthology.orchestra.run.smithi044.stdout: ], 2024-04-17T19:47:54.280 INFO:teuthology.orchestra.run.smithi044.stdout: "mds": [ 2024-04-17T19:47:54.280 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T19:47:54.280 INFO:teuthology.orchestra.run.smithi044.stdout: "features": "0x3f03cffffffdffff", 2024-04-17T19:47:54.281 INFO:teuthology.orchestra.run.smithi044.stdout: "release": "luminous", 2024-04-17T19:47:54.281 INFO:teuthology.orchestra.run.smithi044.stdout: "num": 3 2024-04-17T19:47:54.281 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T19:47:54.281 INFO:teuthology.orchestra.run.smithi044.stdout: ], 2024-04-17T19:47:54.281 INFO:teuthology.orchestra.run.smithi044.stdout: "osd": [ 2024-04-17T19:47:54.281 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T19:47:54.281 INFO:teuthology.orchestra.run.smithi044.stdout: "features": "0x3f03cffffffdffff", 2024-04-17T19:47:54.281 INFO:teuthology.orchestra.run.smithi044.stdout: "release": "luminous", 2024-04-17T19:47:54.281 INFO:teuthology.orchestra.run.smithi044.stdout: "num": 4 2024-04-17T19:47:54.281 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T19:47:54.281 INFO:teuthology.orchestra.run.smithi044.stdout: ], 2024-04-17T19:47:54.281 INFO:teuthology.orchestra.run.smithi044.stdout: "client": [ 2024-04-17T19:47:54.281 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T19:47:54.281 INFO:teuthology.orchestra.run.smithi044.stdout: "features": "0x2f018fb87aa4aafe", 2024-04-17T19:47:54.282 INFO:teuthology.orchestra.run.smithi044.stdout: "release": "luminous", 2024-04-17T19:47:54.282 INFO:teuthology.orchestra.run.smithi044.stdout: "num": 1 2024-04-17T19:47:54.282 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T19:47:54.282 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T19:47:54.282 INFO:teuthology.orchestra.run.smithi044.stdout: "features": "0x3f03cffffffdffff", 2024-04-17T19:47:54.282 INFO:teuthology.orchestra.run.smithi044.stdout: "release": "luminous", 2024-04-17T19:47:54.282 INFO:teuthology.orchestra.run.smithi044.stdout: "num": 2 2024-04-17T19:47:54.282 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T19:47:54.282 INFO:teuthology.orchestra.run.smithi044.stdout: ], 2024-04-17T19:47:54.282 INFO:teuthology.orchestra.run.smithi044.stdout: "mgr": [ 2024-04-17T19:47:54.282 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T19:47:54.282 INFO:teuthology.orchestra.run.smithi044.stdout: "features": "0x3f03cffffffdffff", 2024-04-17T19:47:54.282 INFO:teuthology.orchestra.run.smithi044.stdout: "release": "luminous", 2024-04-17T19:47:54.283 INFO:teuthology.orchestra.run.smithi044.stdout: "num": 1 2024-04-17T19:47:54.283 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T19:47:54.283 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T19:47:54.283 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T19:47:54.283 INFO:teuthology.orchestra.run.smithi044.stdout: "stretch_mode": false 2024-04-17T19:47:54.283 INFO:teuthology.orchestra.run.smithi044.stdout:} 2024-04-17T19:47:54.284 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:54.281+0000 7f44d1800640 1 -- 172.21.15.44:0/665271556 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f44a8068280 msgr2=0x7f44a806a790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:54.284 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:54.281+0000 7f44d1800640 1 --2- 172.21.15.44:0/665271556 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f44a8068280 0x7f44a806a790 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f44cc0708f0 tx=0x7f44b4009190 comp rx=0 tx=0).stop 2024-04-17T19:47:54.284 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:54.281+0000 7f44cb400640 1 -- 172.21.15.44:0/665271556 reap_dead start 2024-04-17T19:47:54.284 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:54.281+0000 7f44d1800640 1 -- 172.21.15.44:0/665271556 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f44cc0c86a0 msgr2=0x7f44cc141480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:54.284 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:54.281+0000 7f44d1800640 1 --2- 172.21.15.44:0/665271556 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f44cc0c86a0 0x7f44cc141480 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f44c401d0e0 tx=0x7f44b0005840 comp rx=0 tx=0).stop 2024-04-17T19:47:54.284 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:54.281+0000 7f44d1800640 1 -- 172.21.15.44:0/665271556 shutdown_connections 2024-04-17T19:47:54.284 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:54.281+0000 7f44d1800640 1 --2- 172.21.15.44:0/665271556 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f44cc0c86a0 0x7f44cc141480 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:54.284 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:54.281+0000 7f44d1800640 1 -- 172.21.15.44:0/665271556 >> 172.21.15.44:0/665271556 conn(0x7f44cc06c380 msgr2=0x7f44cc06fe70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:47:54.284 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:54.281+0000 7f44d1800640 1 -- 172.21.15.44:0/665271556 shutdown_connections 2024-04-17T19:47:54.284 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:54.281+0000 7f44d1800640 1 -- 172.21.15.44:0/665271556 wait complete. 2024-04-17T19:47:54.288 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-04-17T19:47:54.288 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon b 2024-04-17T19:47:54.288 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2024-04-17T19:47:54.441 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:54.453+0000 7f7b5bc00640 1 Processor -- start 2024-04-17T19:47:54.442 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:54.453+0000 7f7b5bc00640 1 -- start start 2024-04-17T19:47:54.443 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:54.457+0000 7f7b5bc00640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f7b54153a00 0x7f7b54159de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:54.443 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:54.457+0000 7f7b5bc00640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7b5415a730 con 0x7f7b54072700 2024-04-17T19:47:54.443 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:54.457+0000 7f7b5bc00640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7b54072d60 con 0x7f7b5415a320 2024-04-17T19:47:54.443 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:54.457+0000 7f7b5bc00640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 -- 0x7f7b54072b10 con 0x7f7b54153a00 2024-04-17T19:47:54.444 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:54.457+0000 7f7b59200640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f7b54072700 0x7f7b540c60e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:46950/0 (socket says 172.21.15.44:46950) 2024-04-17T19:47:54.444 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:54.457+0000 7f7b59200640 1 -- 172.21.15.44:0/3958701875 learned_addr learned my addr 172.21.15.44:0/3958701875 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-04-17T19:47:54.444 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:54.457+0000 7f7b53e00640 1 --2- 172.21.15.44:0/3958701875 >> v2:172.21.15.62:3300/0 conn(0x7f7b54153a00 0x7f7b54159de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:54.444 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:54.457+0000 7f7b53400640 1 -- 172.21.15.44:0/3958701875 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2161646526 0 0) 0x7f7b48001120 con 0x7f7b54072700 2024-04-17T19:47:54.445 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:54.457+0000 7f7b53400640 1 -- 172.21.15.44:0/3958701875 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7b3c003530 con 0x7f7b54072700 2024-04-17T19:47:54.445 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:54.457+0000 7f7b53e00640 1 -- 172.21.15.44:0/3958701875 >> v1:172.21.15.62:6789/0 conn(0x7f7b5415a320 legacy=0x7f7b54164130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:54.445 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:54.457+0000 7f7b53e00640 1 -- 172.21.15.44:0/3958701875 >> v1:172.21.15.44:6789/0 conn(0x7f7b54072700 legacy=0x7f7b540c60e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:54.445 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:54.457+0000 7f7b53400640 1 -- 172.21.15.44:0/3958701875 <== mon.0 v1:172.21.15.44:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3029857596 0 0) 0x7f7b3c003530 con 0x7f7b54072700 2024-04-17T19:47:54.445 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:54.457+0000 7f7b53e00640 1 -- 172.21.15.44:0/3958701875 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7b54073810 con 0x7f7b54153a00 2024-04-17T19:47:54.447 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:54.461+0000 7f7b53e00640 1 --2- 172.21.15.44:0/3958701875 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7b54153a00 0x7f7b54159de0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f7b400097c0 tx=0x7f7b4001ebb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a28184d4c06bd6ce server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:47:54.447 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:54.461+0000 7f7b53400640 1 -- 172.21.15.44:0/3958701875 <== mon.1 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b400b5070 con 0x7f7b54153a00 2024-04-17T19:47:54.447 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:54.461+0000 7f7b53400640 1 -- 172.21.15.44:0/3958701875 <== mon.1 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7b400a8630 con 0x7f7b54153a00 2024-04-17T19:47:54.447 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:54.461+0000 7f7b53400640 1 -- 172.21.15.44:0/3958701875 <== mon.1 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b48001850 con 0x7f7b54153a00 2024-04-17T19:47:54.448 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:54.461+0000 7f7b5bc00640 1 -- 172.21.15.44:0/3958701875 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7b54153a00 msgr2=0x7f7b54159de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:54.448 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:54.461+0000 7f7b5bc00640 1 --2- 172.21.15.44:0/3958701875 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7b54153a00 0x7f7b54159de0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f7b400097c0 tx=0x7f7b4001ebb0 comp rx=0 tx=0).stop 2024-04-17T19:47:54.448 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:54.461+0000 7f7b5bc00640 1 -- 172.21.15.44:0/3958701875 shutdown_connections 2024-04-17T19:47:54.448 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:54.461+0000 7f7b5bc00640 1 --2- 172.21.15.44:0/3958701875 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7b54153a00 0x7f7b54159de0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:54.449 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:54.461+0000 7f7b5bc00640 1 -- 172.21.15.44:0/3958701875 >> 172.21.15.44:0/3958701875 conn(0x7f7b5406c380 msgr2=0x7f7b54070080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:47:54.449 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:54.461+0000 7f7b5bc00640 1 -- 172.21.15.44:0/3958701875 shutdown_connections 2024-04-17T19:47:54.449 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:54.461+0000 7f7b5bc00640 1 -- 172.21.15.44:0/3958701875 wait complete. 2024-04-17T19:47:54.450 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:54.465+0000 7f7b5bc00640 1 Processor -- start 2024-04-17T19:47:54.451 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:54.465+0000 7f7b5bc00640 1 -- start start 2024-04-17T19:47:54.453 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:54.465+0000 7f7b5bc00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7b54072700 0x7f7b54141e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:54.454 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:54.465+0000 7f7b5bc00640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f7b54153a00 0x7f7b540c47b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:54.454 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:54.465+0000 7f7b5bc00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7b5415a320 0x7f7b5413db60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:54.454 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:54.465+0000 7f7b5bc00640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f7b540740b0 con 0x7f7b54072700 2024-04-17T19:47:54.454 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:54.465+0000 7f7b5bc00640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f7b54073dd0 con 0x7f7b5415a320 2024-04-17T19:47:54.454 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:54.465+0000 7f7b5bc00640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7f7b54074390 con 0x7f7b54153a00 2024-04-17T19:47:54.454 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:54.465+0000 7f7b59200640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7b54072700 0x7f7b54141e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:54.454 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:54.465+0000 7f7b59200640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7b54072700 0x7f7b54141e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:34654/0 (socket says 172.21.15.44:34654) 2024-04-17T19:47:54.454 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:54.465+0000 7f7b59200640 1 -- 172.21.15.44:0/1483086311 learned_addr learned my addr 172.21.15.44:0/1483086311 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-04-17T19:47:54.454 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:54.465+0000 7f7b59c00640 1 --2- 172.21.15.44:0/1483086311 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7b5415a320 0x7f7b5413db60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:54.454 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:54.465+0000 7f7b53e00640 1 --2- 172.21.15.44:0/1483086311 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f7b54153a00 0x7f7b540c47b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:54.454 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:54.465+0000 7f7b59200640 1 -- 172.21.15.44:0/1483086311 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f7b54153a00 msgr2=0x7f7b540c47b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:54.455 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:54.465+0000 7f7b59200640 1 --2- 172.21.15.44:0/1483086311 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f7b54153a00 0x7f7b540c47b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:54.455 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:54.465+0000 7f7b59200640 1 -- 172.21.15.44:0/1483086311 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7b5415a320 msgr2=0x7f7b5413db60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:54.455 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:54.465+0000 7f7b59200640 1 --2- 172.21.15.44:0/1483086311 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7b5415a320 0x7f7b5413db60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:54.455 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:54.465+0000 7f7b59200640 1 -- 172.21.15.44:0/1483086311 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7b541e48c0 con 0x7f7b54072700 2024-04-17T19:47:54.455 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:54.465+0000 7f7b59c00640 1 --2- 172.21.15.44:0/1483086311 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7b5415a320 0x7f7b5413db60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-17T19:47:54.455 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:54.465+0000 7f7b59200640 1 --2- 172.21.15.44:0/1483086311 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7b54072700 0x7f7b54141e60 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f7b4800c580 tx=0x7f7b4800ca40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:47:54.455 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:54.465+0000 7f7b50c00640 1 -- 172.21.15.44:0/1483086311 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b48017070 con 0x7f7b54072700 2024-04-17T19:47:54.455 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:54.465+0000 7f7b50c00640 1 -- 172.21.15.44:0/1483086311 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7b48005d10 con 0x7f7b54072700 2024-04-17T19:47:54.455 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:54.465+0000 7f7b50c00640 1 -- 172.21.15.44:0/1483086311 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b48007330 con 0x7f7b54072700 2024-04-17T19:47:54.455 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:54.465+0000 7f7b5bc00640 1 -- 172.21.15.44:0/1483086311 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7b540c5960 con 0x7f7b54072700 2024-04-17T19:47:54.455 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:54.465+0000 7f7b5bc00640 1 -- 172.21.15.44:0/1483086311 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7b541e3de0 con 0x7f7b54072700 2024-04-17T19:47:54.456 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:54.469+0000 7f7b5bc00640 1 --2- 172.21.15.44:0/1483086311 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7b540c50c0 0x7f7b541e4020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:54.457 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:54.469+0000 7f7b5bc00640 1 -- 172.21.15.44:0/1483086311 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f7b541573c0 con 0x7f7b540c50c0 2024-04-17T19:47:54.457 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:54.469+0000 7f7b53e00640 1 --2- 172.21.15.44:0/1483086311 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7b540c50c0 0x7f7b541e4020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:54.457 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:54.469+0000 7f7b53e00640 1 -- 172.21.15.44:0/1483086311 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f7b540c5f00 con 0x7f7b540c50c0 2024-04-17T19:47:54.457 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:54.469+0000 7f7b50c00640 1 -- 172.21.15.44:0/1483086311 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f7b4801a070 con 0x7f7b54072700 2024-04-17T19:47:54.457 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:54.469+0000 7f7b53e00640 1 --2- 172.21.15.44:0/1483086311 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7b540c50c0 0x7f7b541e4020 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f7b5406cc80 tx=0x7f7b4001b950 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:47:54.457 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:54.469+0000 7f7b50c00640 1 --2- 172.21.15.44:0/1483086311 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f7b340683b0 0x7f7b3406a8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:54.457 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:54.469+0000 7f7b50c00640 1 -- 172.21.15.44:0/1483086311 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6619+0+0 (secure 0 0 0) 0x7f7b480861f0 con 0x7f7b54072700 2024-04-17T19:47:54.457 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:54.469+0000 7f7b50c00640 1 -- 172.21.15.44:0/1483086311 <== mon.1 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b400be030 con 0x7f7b540c50c0 2024-04-17T19:47:54.457 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:54.469+0000 7f7b59c00640 1 --2- 172.21.15.44:0/1483086311 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f7b340683b0 0x7f7b3406a8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:54.458 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:54.469+0000 7f7b50c00640 1 -- 172.21.15.44:0/1483086311 <== mon.1 v2:172.21.15.62:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f7b400b6040 con 0x7f7b540c50c0 2024-04-17T19:47:54.458 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:54.469+0000 7f7b50c00640 1 -- 172.21.15.44:0/1483086311 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7b540c50c0 msgr2=0x7f7b541e4020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:54.458 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:54.469+0000 7f7b50c00640 1 --2- 172.21.15.44:0/1483086311 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7b540c50c0 0x7f7b541e4020 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f7b5406cc80 tx=0x7f7b4001b950 comp rx=0 tx=0).stop 2024-04-17T19:47:54.458 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:54.469+0000 7f7b50c00640 1 -- 172.21.15.44:0/1483086311 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7b540c50c0 msgr2=0x7f7b541e4020 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-04-17T19:47:54.458 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:54.469+0000 7f7b50c00640 1 --2- 172.21.15.44:0/1483086311 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7b540c50c0 0x7f7b541e4020 secure :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f7b5406cc80 tx=0x7f7b4001b950 comp rx=0 tx=0).stop 2024-04-17T19:47:54.458 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:54.469+0000 7f7b59c00640 1 --2- 172.21.15.44:0/1483086311 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f7b340683b0 0x7f7b3406a8c0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f7b4c0012f0 tx=0x7f7b4c009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:47:54.463 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:54.477+0000 7f7b5bc00640 1 --2- 172.21.15.44:0/1483086311 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7b540c41b0 0x7f7b5413e0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:54.463 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:54.477+0000 7f7b5bc00640 1 -- 172.21.15.44:0/1483086311 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f7b541e4560 con 0x7f7b540c41b0 2024-04-17T19:47:54.464 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:54.477+0000 7f7b53e00640 1 --2- 172.21.15.44:0/1483086311 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7b540c41b0 0x7f7b5413e0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:54.464 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:54.477+0000 7f7b53e00640 1 -- 172.21.15.44:0/1483086311 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f7b5413e5e0 con 0x7f7b540c41b0 2024-04-17T19:47:54.465 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:54.477+0000 7f7b53e00640 1 --2- 172.21.15.44:0/1483086311 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7b540c41b0 0x7f7b5413e0a0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f7b400097c0 tx=0x7f7b400aa000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:47:54.465 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:54.477+0000 7f7b50c00640 1 -- 172.21.15.44:0/1483086311 <== mon.1 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b400be070 con 0x7f7b540c41b0 2024-04-17T19:47:54.466 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:54.477+0000 7f7b50c00640 1 -- 172.21.15.44:0/1483086311 <== mon.1 v2:172.21.15.62:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4886 (secure 0 0 0) 0x7f7b40003d50 con 0x7f7b540c41b0 2024-04-17T19:47:54.466 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:54.477+0000 7f7b50c00640 1 -- 172.21.15.44:0/1483086311 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7b540c41b0 msgr2=0x7f7b5413e0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:54.466 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:54.477+0000 7f7b50c00640 1 --2- 172.21.15.44:0/1483086311 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7b540c41b0 0x7f7b5413e0a0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f7b400097c0 tx=0x7f7b400aa000 comp rx=0 tx=0).stop 2024-04-17T19:47:54.466 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:54.477+0000 7f7b50c00640 1 -- 172.21.15.44:0/1483086311 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7b540c41b0 msgr2=0x7f7b5413e0a0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-04-17T19:47:54.466 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:54.477+0000 7f7b50c00640 1 --2- 172.21.15.44:0/1483086311 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7b540c41b0 0x7f7b5413e0a0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:54.467 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2024-04-17T19:47:54.467 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "b", 2024-04-17T19:47:54.467 INFO:teuthology.orchestra.run.smithi044.stdout: "rank": 1, 2024-04-17T19:47:54.467 INFO:teuthology.orchestra.run.smithi044.stdout: "state": "peon", 2024-04-17T19:47:54.467 INFO:teuthology.orchestra.run.smithi044.stdout: "election_epoch": 4, 2024-04-17T19:47:54.467 INFO:teuthology.orchestra.run.smithi044.stdout: "uptime": 83909, 2024-04-17T19:47:54.467 INFO:teuthology.orchestra.run.smithi044.stdout: "quorum": [ 2024-04-17T19:47:54.467 INFO:teuthology.orchestra.run.smithi044.stdout: 0, 2024-04-17T19:47:54.467 INFO:teuthology.orchestra.run.smithi044.stdout: 1, 2024-04-17T19:47:54.467 INFO:teuthology.orchestra.run.smithi044.stdout: 2 2024-04-17T19:47:54.467 INFO:teuthology.orchestra.run.smithi044.stdout: ], 2024-04-17T19:47:54.467 INFO:teuthology.orchestra.run.smithi044.stdout: "quorum_age": 83, 2024-04-17T19:47:54.467 INFO:teuthology.orchestra.run.smithi044.stdout: "features": { 2024-04-17T19:47:54.467 INFO:teuthology.orchestra.run.smithi044.stdout: "required_con": "2450521708007866372", 2024-04-17T19:47:54.467 INFO:teuthology.orchestra.run.smithi044.stdout: "required_mon": [ 2024-04-17T19:47:54.468 INFO:teuthology.orchestra.run.smithi044.stdout: "kraken", 2024-04-17T19:47:54.468 INFO:teuthology.orchestra.run.smithi044.stdout: "luminous", 2024-04-17T19:47:54.468 INFO:teuthology.orchestra.run.smithi044.stdout: "mimic", 2024-04-17T19:47:54.468 INFO:teuthology.orchestra.run.smithi044.stdout: "osdmap-prune", 2024-04-17T19:47:54.468 INFO:teuthology.orchestra.run.smithi044.stdout: "nautilus", 2024-04-17T19:47:54.468 INFO:teuthology.orchestra.run.smithi044.stdout: "octopus", 2024-04-17T19:47:54.468 INFO:teuthology.orchestra.run.smithi044.stdout: "pacific", 2024-04-17T19:47:54.468 INFO:teuthology.orchestra.run.smithi044.stdout: "elector-pinging", 2024-04-17T19:47:54.468 INFO:teuthology.orchestra.run.smithi044.stdout: "quincy", 2024-04-17T19:47:54.468 INFO:teuthology.orchestra.run.smithi044.stdout: "reef", 2024-04-17T19:47:54.468 INFO:teuthology.orchestra.run.smithi044.stdout: "squid" 2024-04-17T19:47:54.468 INFO:teuthology.orchestra.run.smithi044.stdout: ], 2024-04-17T19:47:54.468 INFO:teuthology.orchestra.run.smithi044.stdout: "quorum_con": "4540701547738038271", 2024-04-17T19:47:54.468 INFO:teuthology.orchestra.run.smithi044.stdout: "quorum_mon": [ 2024-04-17T19:47:54.469 INFO:teuthology.orchestra.run.smithi044.stdout: "kraken", 2024-04-17T19:47:54.469 INFO:teuthology.orchestra.run.smithi044.stdout: "luminous", 2024-04-17T19:47:54.469 INFO:teuthology.orchestra.run.smithi044.stdout: "mimic", 2024-04-17T19:47:54.469 INFO:teuthology.orchestra.run.smithi044.stdout: "osdmap-prune", 2024-04-17T19:47:54.469 INFO:teuthology.orchestra.run.smithi044.stdout: "nautilus", 2024-04-17T19:47:54.469 INFO:teuthology.orchestra.run.smithi044.stdout: "octopus", 2024-04-17T19:47:54.469 INFO:teuthology.orchestra.run.smithi044.stdout: "pacific", 2024-04-17T19:47:54.469 INFO:teuthology.orchestra.run.smithi044.stdout: "elector-pinging", 2024-04-17T19:47:54.469 INFO:teuthology.orchestra.run.smithi044.stdout: "quincy", 2024-04-17T19:47:54.469 INFO:teuthology.orchestra.run.smithi044.stdout: "reef", 2024-04-17T19:47:54.469 INFO:teuthology.orchestra.run.smithi044.stdout: "squid" 2024-04-17T19:47:54.469 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T19:47:54.469 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T19:47:54.469 INFO:teuthology.orchestra.run.smithi044.stdout: "outside_quorum": [], 2024-04-17T19:47:54.470 INFO:teuthology.orchestra.run.smithi044.stdout: "extra_probe_peers": [], 2024-04-17T19:47:54.470 INFO:teuthology.orchestra.run.smithi044.stdout: "sync_provider": [], 2024-04-17T19:47:54.470 INFO:teuthology.orchestra.run.smithi044.stdout: "monmap": { 2024-04-17T19:47:54.470 INFO:teuthology.orchestra.run.smithi044.stdout: "epoch": 1, 2024-04-17T19:47:54.470 INFO:teuthology.orchestra.run.smithi044.stdout: "fsid": "703f77ca-79c6-4a66-b576-62c526cb1021", 2024-04-17T19:47:54.470 INFO:teuthology.orchestra.run.smithi044.stdout: "modified": "2024-04-17T19:45:55.379749Z", 2024-04-17T19:47:54.470 INFO:teuthology.orchestra.run.smithi044.stdout: "created": "2024-04-17T19:45:55.379749Z", 2024-04-17T19:47:54.470 INFO:teuthology.orchestra.run.smithi044.stdout: "min_mon_release": 19, 2024-04-17T19:47:54.470 INFO:teuthology.orchestra.run.smithi044.stdout: "min_mon_release_name": "squid", 2024-04-17T19:47:54.470 INFO:teuthology.orchestra.run.smithi044.stdout: "election_strategy": 1, 2024-04-17T19:47:54.470 INFO:teuthology.orchestra.run.smithi044.stdout: "disallowed_leaders: ": "", 2024-04-17T19:47:54.470 INFO:teuthology.orchestra.run.smithi044.stdout: "stretch_mode": false, 2024-04-17T19:47:54.470 INFO:teuthology.orchestra.run.smithi044.stdout: "tiebreaker_mon": "", 2024-04-17T19:47:54.471 INFO:teuthology.orchestra.run.smithi044.stdout: "removed_ranks: ": "", 2024-04-17T19:47:54.471 INFO:teuthology.orchestra.run.smithi044.stdout: "features": { 2024-04-17T19:47:54.471 INFO:teuthology.orchestra.run.smithi044.stdout: "persistent": [ 2024-04-17T19:47:54.471 INFO:teuthology.orchestra.run.smithi044.stdout: "kraken", 2024-04-17T19:47:54.471 INFO:teuthology.orchestra.run.smithi044.stdout: "luminous", 2024-04-17T19:47:54.471 INFO:teuthology.orchestra.run.smithi044.stdout: "mimic", 2024-04-17T19:47:54.471 INFO:teuthology.orchestra.run.smithi044.stdout: "osdmap-prune", 2024-04-17T19:47:54.471 INFO:teuthology.orchestra.run.smithi044.stdout: "nautilus", 2024-04-17T19:47:54.471 INFO:teuthology.orchestra.run.smithi044.stdout: "octopus", 2024-04-17T19:47:54.471 INFO:teuthology.orchestra.run.smithi044.stdout: "pacific", 2024-04-17T19:47:54.471 INFO:teuthology.orchestra.run.smithi044.stdout: "elector-pinging", 2024-04-17T19:47:54.472 INFO:teuthology.orchestra.run.smithi044.stdout: "quincy", 2024-04-17T19:47:54.472 INFO:teuthology.orchestra.run.smithi044.stdout: "reef", 2024-04-17T19:47:54.472 INFO:teuthology.orchestra.run.smithi044.stdout: "squid" 2024-04-17T19:47:54.472 INFO:teuthology.orchestra.run.smithi044.stdout: ], 2024-04-17T19:47:54.472 INFO:teuthology.orchestra.run.smithi044.stdout: "optional": [] 2024-04-17T19:47:54.472 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T19:47:54.472 INFO:teuthology.orchestra.run.smithi044.stdout: "mons": [ 2024-04-17T19:47:54.472 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T19:47:54.472 INFO:teuthology.orchestra.run.smithi044.stdout: "rank": 0, 2024-04-17T19:47:54.472 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "a", 2024-04-17T19:47:54.472 INFO:teuthology.orchestra.run.smithi044.stdout: "public_addrs": { 2024-04-17T19:47:54.472 INFO:teuthology.orchestra.run.smithi044.stdout: "addrvec": [ 2024-04-17T19:47:54.472 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T19:47:54.472 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "v2", 2024-04-17T19:47:54.472 INFO:teuthology.orchestra.run.smithi044.stdout: "addr": "172.21.15.44:3300", 2024-04-17T19:47:54.473 INFO:teuthology.orchestra.run.smithi044.stdout: "nonce": 0 2024-04-17T19:47:54.473 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T19:47:54.473 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T19:47:54.473 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "v1", 2024-04-17T19:47:54.473 INFO:teuthology.orchestra.run.smithi044.stdout: "addr": "172.21.15.44:6789", 2024-04-17T19:47:54.473 INFO:teuthology.orchestra.run.smithi044.stdout: "nonce": 0 2024-04-17T19:47:54.473 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T19:47:54.473 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T19:47:54.473 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T19:47:54.473 INFO:teuthology.orchestra.run.smithi044.stdout: "addr": "172.21.15.44:6789/0", 2024-04-17T19:47:54.473 INFO:teuthology.orchestra.run.smithi044.stdout: "public_addr": "172.21.15.44:6789/0", 2024-04-17T19:47:54.473 INFO:teuthology.orchestra.run.smithi044.stdout: "priority": 0, 2024-04-17T19:47:54.473 INFO:teuthology.orchestra.run.smithi044.stdout: "weight": 0, 2024-04-17T19:47:54.473 INFO:teuthology.orchestra.run.smithi044.stdout: "crush_location": "{}" 2024-04-17T19:47:54.474 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T19:47:54.474 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T19:47:54.474 INFO:teuthology.orchestra.run.smithi044.stdout: "rank": 1, 2024-04-17T19:47:54.474 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "b", 2024-04-17T19:47:54.474 INFO:teuthology.orchestra.run.smithi044.stdout: "public_addrs": { 2024-04-17T19:47:54.474 INFO:teuthology.orchestra.run.smithi044.stdout: "addrvec": [ 2024-04-17T19:47:54.474 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T19:47:54.474 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "v2", 2024-04-17T19:47:54.474 INFO:teuthology.orchestra.run.smithi044.stdout: "addr": "172.21.15.62:3300", 2024-04-17T19:47:54.474 INFO:teuthology.orchestra.run.smithi044.stdout: "nonce": 0 2024-04-17T19:47:54.474 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T19:47:54.474 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T19:47:54.474 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "v1", 2024-04-17T19:47:54.474 INFO:teuthology.orchestra.run.smithi044.stdout: "addr": "172.21.15.62:6789", 2024-04-17T19:47:54.475 INFO:teuthology.orchestra.run.smithi044.stdout: "nonce": 0 2024-04-17T19:47:54.475 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T19:47:54.475 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T19:47:54.475 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T19:47:54.475 INFO:teuthology.orchestra.run.smithi044.stdout: "addr": "172.21.15.62:6789/0", 2024-04-17T19:47:54.475 INFO:teuthology.orchestra.run.smithi044.stdout: "public_addr": "172.21.15.62:6789/0", 2024-04-17T19:47:54.475 INFO:teuthology.orchestra.run.smithi044.stdout: "priority": 0, 2024-04-17T19:47:54.475 INFO:teuthology.orchestra.run.smithi044.stdout: "weight": 0, 2024-04-17T19:47:54.475 INFO:teuthology.orchestra.run.smithi044.stdout: "crush_location": "{}" 2024-04-17T19:47:54.475 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T19:47:54.475 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T19:47:54.475 INFO:teuthology.orchestra.run.smithi044.stdout: "rank": 2, 2024-04-17T19:47:54.475 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "c", 2024-04-17T19:47:54.475 INFO:teuthology.orchestra.run.smithi044.stdout: "public_addrs": { 2024-04-17T19:47:54.475 INFO:teuthology.orchestra.run.smithi044.stdout: "addrvec": [ 2024-04-17T19:47:54.475 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T19:47:54.476 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "v2", 2024-04-17T19:47:54.476 INFO:teuthology.orchestra.run.smithi044.stdout: "addr": "172.21.15.62:3301", 2024-04-17T19:47:54.476 INFO:teuthology.orchestra.run.smithi044.stdout: "nonce": 0 2024-04-17T19:47:54.476 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T19:47:54.476 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T19:47:54.476 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "v1", 2024-04-17T19:47:54.476 INFO:teuthology.orchestra.run.smithi044.stdout: "addr": "172.21.15.62:6790", 2024-04-17T19:47:54.476 INFO:teuthology.orchestra.run.smithi044.stdout: "nonce": 0 2024-04-17T19:47:54.476 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T19:47:54.476 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T19:47:54.476 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T19:47:54.476 INFO:teuthology.orchestra.run.smithi044.stdout: "addr": "172.21.15.62:6790/0", 2024-04-17T19:47:54.476 INFO:teuthology.orchestra.run.smithi044.stdout: "public_addr": "172.21.15.62:6790/0", 2024-04-17T19:47:54.476 INFO:teuthology.orchestra.run.smithi044.stdout: "priority": 0, 2024-04-17T19:47:54.477 INFO:teuthology.orchestra.run.smithi044.stdout: "weight": 0, 2024-04-17T19:47:54.477 INFO:teuthology.orchestra.run.smithi044.stdout: "crush_location": "{}" 2024-04-17T19:47:54.477 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T19:47:54.477 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T19:47:54.477 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T19:47:54.477 INFO:teuthology.orchestra.run.smithi044.stdout: "feature_map": { 2024-04-17T19:47:54.477 INFO:teuthology.orchestra.run.smithi044.stdout: "mon": [ 2024-04-17T19:47:54.477 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T19:47:54.477 INFO:teuthology.orchestra.run.smithi044.stdout: "features": "0x3f03cffffffdffff", 2024-04-17T19:47:54.477 INFO:teuthology.orchestra.run.smithi044.stdout: "release": "luminous", 2024-04-17T19:47:54.477 INFO:teuthology.orchestra.run.smithi044.stdout: "num": 1 2024-04-17T19:47:54.477 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T19:47:54.477 INFO:teuthology.orchestra.run.smithi044.stdout: ], 2024-04-17T19:47:54.478 INFO:teuthology.orchestra.run.smithi044.stdout: "mds": [ 2024-04-17T19:47:54.478 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T19:47:54.478 INFO:teuthology.orchestra.run.smithi044.stdout: "features": "0x3f03cffffffdffff", 2024-04-17T19:47:54.478 INFO:teuthology.orchestra.run.smithi044.stdout: "release": "luminous", 2024-04-17T19:47:54.478 INFO:teuthology.orchestra.run.smithi044.stdout: "num": 2 2024-04-17T19:47:54.478 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T19:47:54.478 INFO:teuthology.orchestra.run.smithi044.stdout: ], 2024-04-17T19:47:54.478 INFO:teuthology.orchestra.run.smithi044.stdout: "osd": [ 2024-04-17T19:47:54.478 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T19:47:54.478 INFO:teuthology.orchestra.run.smithi044.stdout: "features": "0x3f03cffffffdffff", 2024-04-17T19:47:54.478 INFO:teuthology.orchestra.run.smithi044.stdout: "release": "luminous", 2024-04-17T19:47:54.479 INFO:teuthology.orchestra.run.smithi044.stdout: "num": 3 2024-04-17T19:47:54.479 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T19:47:54.479 INFO:teuthology.orchestra.run.smithi044.stdout: ], 2024-04-17T19:47:54.479 INFO:teuthology.orchestra.run.smithi044.stdout: "client": [ 2024-04-17T19:47:54.479 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T19:47:54.479 INFO:teuthology.orchestra.run.smithi044.stdout: "features": "0x3f03cffffffdffff", 2024-04-17T19:47:54.479 INFO:teuthology.orchestra.run.smithi044.stdout: "release": "luminous", 2024-04-17T19:47:54.479 INFO:teuthology.orchestra.run.smithi044.stdout: "num": 3 2024-04-17T19:47:54.479 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T19:47:54.479 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T19:47:54.479 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T19:47:54.479 INFO:teuthology.orchestra.run.smithi044.stdout: "stretch_mode": false 2024-04-17T19:47:54.479 INFO:teuthology.orchestra.run.smithi044.stdout:} 2024-04-17T19:47:54.480 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:54.477+0000 7f7b5bc00640 1 -- 172.21.15.44:0/1483086311 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f7b340683b0 msgr2=0x7f7b3406a8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:54.480 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:54.477+0000 7f7b5bc00640 1 --2- 172.21.15.44:0/1483086311 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f7b340683b0 0x7f7b3406a8c0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f7b4c0012f0 tx=0x7f7b4c009040 comp rx=0 tx=0).stop 2024-04-17T19:47:54.480 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:54.477+0000 7f7b5bc00640 1 -- 172.21.15.44:0/1483086311 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7b54072700 msgr2=0x7f7b54141e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:54.480 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:54.477+0000 7f7b5bc00640 1 --2- 172.21.15.44:0/1483086311 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7b54072700 0x7f7b54141e60 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f7b4800c580 tx=0x7f7b4800ca40 comp rx=0 tx=0).stop 2024-04-17T19:47:54.480 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:54.477+0000 7f7b59c00640 1 -- 172.21.15.44:0/1483086311 reap_dead start 2024-04-17T19:47:54.480 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:54.481+0000 7f7b59c00640 1 -- 172.21.15.44:0/1483086311 reap_dead start 2024-04-17T19:47:54.481 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:54.481+0000 7f7b5bc00640 1 -- 172.21.15.44:0/1483086311 shutdown_connections 2024-04-17T19:47:54.481 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:54.481+0000 7f7b5bc00640 1 -- 172.21.15.44:0/1483086311 >> 172.21.15.44:0/1483086311 conn(0x7f7b5406c380 msgr2=0x7f7b54146820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:47:54.481 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:54.481+0000 7f7b5bc00640 1 -- 172.21.15.44:0/1483086311 shutdown_connections 2024-04-17T19:47:54.481 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:54.481+0000 7f7b5bc00640 1 -- 172.21.15.44:0/1483086311 wait complete. 2024-04-17T19:47:54.485 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-04-17T19:47:54.486 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon c 2024-04-17T19:47:54.486 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2024-04-17T19:47:54.644 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:54.653+0000 7fe721400640 1 Processor -- start 2024-04-17T19:47:54.644 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:54.653+0000 7fe721400640 1 -- start start 2024-04-17T19:47:54.644 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:54.653+0000 7fe721400640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fe71c15fc20 0x7fe71c06d450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:54.644 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:54.653+0000 7fe721400640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fe71c06d990 0x7fe71c166300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:54.645 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:54.653+0000 7fe721400640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe71c0c5650 con 0x7fe71c15f810 2024-04-17T19:47:54.645 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:54.653+0000 7fe721400640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 -- 0x7fe71c15f380 con 0x7fe71c15fc20 2024-04-17T19:47:54.645 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:54.653+0000 7fe721400640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 -- 0x7fe71c0c5930 con 0x7fe71c06d990 2024-04-17T19:47:54.645 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:54.653+0000 7fe713e00640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fe71c15fc20 0x7fe71c06d450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:54.645 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:54.653+0000 7fe71a800640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7fe71c15f810 0x7fe71c0cf000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:46956/0 (socket says 172.21.15.44:46956) 2024-04-17T19:47:54.646 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:54.653+0000 7fe71a800640 1 -- 172.21.15.44:0/91781405 learned_addr learned my addr 172.21.15.44:0/91781405 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-04-17T19:47:54.646 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:54.653+0000 7fe71b200640 1 --2- 172.21.15.44:0/91781405 >> v2:172.21.15.62:3300/0 conn(0x7fe71c06d990 0x7fe71c166300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:54.646 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:54.653+0000 7fe713e00640 1 -- 172.21.15.44:0/91781405 >> v2:172.21.15.62:3300/0 conn(0x7fe71c06d990 msgr2=0x7fe71c166300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T19:47:54.646 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:54.653+0000 7fe713e00640 1 --2- 172.21.15.44:0/91781405 >> v2:172.21.15.62:3300/0 conn(0x7fe71c06d990 0x7fe71c166300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:54.646 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:54.653+0000 7fe713e00640 1 -- 172.21.15.44:0/91781405 >> v1:172.21.15.44:6789/0 conn(0x7fe71c15f810 legacy=0x7fe71c0cf000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:54.646 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:54.653+0000 7fe713e00640 1 -- 172.21.15.44:0/91781405 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe71c0c5c10 con 0x7fe71c15fc20 2024-04-17T19:47:54.654 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:54.657+0000 7fe713e00640 1 --2- 172.21.15.44:0/91781405 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe71c15fc20 0x7fe71c06d450 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fe71c156220 tx=0x7fe70401ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bab39815dec0050f server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:47:54.655 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:54.657+0000 7fe719e00640 1 -- 172.21.15.44:0/91781405 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7040b5070 con 0x7fe71c15fc20 2024-04-17T19:47:54.655 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:54.657+0000 7fe719e00640 1 -- 172.21.15.44:0/91781405 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe7040a8970 con 0x7fe71c15fc20 2024-04-17T19:47:54.655 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:54.657+0000 7fe719e00640 1 -- 172.21.15.44:0/91781405 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7040a8d40 con 0x7fe71c15fc20 2024-04-17T19:47:54.655 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:54.657+0000 7fe721400640 1 -- 172.21.15.44:0/91781405 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe71c15fc20 msgr2=0x7fe71c06d450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:54.655 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:54.657+0000 7fe721400640 1 --2- 172.21.15.44:0/91781405 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe71c15fc20 0x7fe71c06d450 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fe71c156220 tx=0x7fe70401ec70 comp rx=0 tx=0).stop 2024-04-17T19:47:54.655 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:54.657+0000 7fe721400640 1 -- 172.21.15.44:0/91781405 shutdown_connections 2024-04-17T19:47:54.656 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:54.657+0000 7fe721400640 1 --2- 172.21.15.44:0/91781405 >> v2:172.21.15.62:3300/0 conn(0x7fe71c06d990 0x7fe71c166300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:54.656 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:54.657+0000 7fe721400640 1 --2- 172.21.15.44:0/91781405 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe71c15fc20 0x7fe71c06d450 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:54.656 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:54.657+0000 7fe721400640 1 -- 172.21.15.44:0/91781405 >> 172.21.15.44:0/91781405 conn(0x7fe71c067eb0 msgr2=0x7fe71c0682c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:47:54.656 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:54.657+0000 7fe721400640 1 -- 172.21.15.44:0/91781405 shutdown_connections 2024-04-17T19:47:54.656 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:54.657+0000 7fe721400640 1 -- 172.21.15.44:0/91781405 wait complete. 2024-04-17T19:47:54.656 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:54.661+0000 7fe721400640 1 Processor -- start 2024-04-17T19:47:54.657 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:54.661+0000 7fe721400640 1 -- start start 2024-04-17T19:47:54.657 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:54.661+0000 7fe721400640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fe71c06d990 0x7fe71c148a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:54.657 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:54.661+0000 7fe721400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe71c15f810 0x7fe71c146130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:54.657 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:54.661+0000 7fe721400640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe71c15fc20 0x7fe71c0cdd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:54.657 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:54.661+0000 7fe721400640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fe71c0c5ef0 con 0x7fe71c15f810 2024-04-17T19:47:54.657 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:54.661+0000 7fe721400640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7fe71c06dda0 con 0x7fe71c15fc20 2024-04-17T19:47:54.658 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:54.661+0000 7fe721400640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7fe71c0cf710 con 0x7fe71c06d990 2024-04-17T19:47:54.658 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:54.661+0000 7fe713e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe71c15f810 0x7fe71c146130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:54.658 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:54.661+0000 7fe713e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe71c15f810 0x7fe71c146130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:34674/0 (socket says 172.21.15.44:34674) 2024-04-17T19:47:54.658 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:54.661+0000 7fe713e00640 1 -- 172.21.15.44:0/3404464229 learned_addr learned my addr 172.21.15.44:0/3404464229 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-04-17T19:47:54.658 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:54.661+0000 7fe71a800640 1 --2- 172.21.15.44:0/3404464229 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fe71c06d990 0x7fe71c148a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:54.658 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:54.661+0000 7fe71b200640 1 --2- 172.21.15.44:0/3404464229 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe71c15fc20 0x7fe71c0cdd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:54.659 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:54.661+0000 7fe713e00640 1 -- 172.21.15.44:0/3404464229 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fe71c06d990 msgr2=0x7fe71c148a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:54.659 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:54.661+0000 7fe713e00640 1 --2- 172.21.15.44:0/3404464229 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fe71c06d990 0x7fe71c148a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:54.659 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:54.661+0000 7fe713e00640 1 -- 172.21.15.44:0/3404464229 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe71c15fc20 msgr2=0x7fe71c0cdd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:54.659 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:54.661+0000 7fe713e00640 1 --2- 172.21.15.44:0/3404464229 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe71c15fc20 0x7fe71c0cdd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:47:54.659 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:54.661+0000 7fe713e00640 1 -- 172.21.15.44:0/3404464229 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe71c148f70 con 0x7fe71c15f810 2024-04-17T19:47:54.659 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:54.661+0000 7fe713e00640 1 --2- 172.21.15.44:0/3404464229 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe71c15f810 0x7fe71c146130 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fe7040b3040 tx=0x7fe70401ba10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:47:54.660 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:54.661+0000 7fe712a00640 1 -- 172.21.15.44:0/3404464229 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7040bf070 con 0x7fe71c15f810 2024-04-17T19:47:54.660 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:54.661+0000 7fe712a00640 1 -- 172.21.15.44:0/3404464229 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe7040b07a0 con 0x7fe71c15f810 2024-04-17T19:47:54.660 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:54.661+0000 7fe721400640 1 -- 172.21.15.44:0/3404464229 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe71c1f2f10 con 0x7fe71c15f810 2024-04-17T19:47:54.660 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:54.661+0000 7fe712a00640 1 -- 172.21.15.44:0/3404464229 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7040b5040 con 0x7fe71c15f810 2024-04-17T19:47:54.660 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:54.665+0000 7fe721400640 1 -- 172.21.15.44:0/3404464229 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe71c1f31b0 con 0x7fe71c15f810 2024-04-17T19:47:54.660 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:54.665+0000 7fe721400640 1 --2- 172.21.15.44:0/3404464229 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fe71c15cb40 0x7fe71c0ce290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:54.661 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:54.665+0000 7fe721400640 1 -- 172.21.15.44:0/3404464229 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7fe71c149440 con 0x7fe71c15cb40 2024-04-17T19:47:54.661 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:54.665+0000 7fe71a800640 1 --2- 172.21.15.44:0/3404464229 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fe71c15cb40 0x7fe71c0ce290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:54.661 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:54.665+0000 7fe71a800640 1 -- 172.21.15.44:0/3404464229 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fe71c04ff10 con 0x7fe71c15cb40 2024-04-17T19:47:54.661 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:54.665+0000 7fe712a00640 1 -- 172.21.15.44:0/3404464229 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fe7040c2070 con 0x7fe71c15f810 2024-04-17T19:47:54.661 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:54.665+0000 7fe71a800640 1 --2- 172.21.15.44:0/3404464229 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fe71c15cb40 0x7fe71c0ce290 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fe70c00e400 tx=0x7fe70c00e8c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:47:54.661 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:54.665+0000 7fe712a00640 1 --2- 172.21.15.44:0/3404464229 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7fe6f8068380 0x7fe6f806a890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:54.661 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:54.665+0000 7fe712a00640 1 -- 172.21.15.44:0/3404464229 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6619+0+0 (secure 0 0 0) 0x7fe704123530 con 0x7fe71c15f810 2024-04-17T19:47:54.662 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:54.665+0000 7fe712a00640 1 -- 172.21.15.44:0/3404464229 <== mon.2 v2:172.21.15.62:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe70c019070 con 0x7fe71c15cb40 2024-04-17T19:47:54.662 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:54.665+0000 7fe71b200640 1 --2- 172.21.15.44:0/3404464229 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7fe6f8068380 0x7fe6f806a890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:54.662 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:54.665+0000 7fe712a00640 1 -- 172.21.15.44:0/3404464229 <== mon.2 v2:172.21.15.62:3301/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7fe70c005ad0 con 0x7fe71c15cb40 2024-04-17T19:47:54.662 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:54.665+0000 7fe712a00640 1 -- 172.21.15.44:0/3404464229 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fe71c15cb40 msgr2=0x7fe71c0ce290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:54.662 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:54.665+0000 7fe712a00640 1 --2- 172.21.15.44:0/3404464229 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fe71c15cb40 0x7fe71c0ce290 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fe70c00e400 tx=0x7fe70c00e8c0 comp rx=0 tx=0).stop 2024-04-17T19:47:54.662 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:54.665+0000 7fe712a00640 1 -- 172.21.15.44:0/3404464229 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fe71c15cb40 msgr2=0x7fe71c0ce290 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-04-17T19:47:54.662 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:54.665+0000 7fe712a00640 1 --2- 172.21.15.44:0/3404464229 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fe71c15cb40 0x7fe71c0ce290 secure :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fe70c00e400 tx=0x7fe70c00e8c0 comp rx=0 tx=0).stop 2024-04-17T19:47:54.664 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:54.669+0000 7fe71b200640 1 --2- 172.21.15.44:0/3404464229 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7fe6f8068380 0x7fe6f806a890 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fe71c0745c0 tx=0x7fe71400b040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:47:54.664 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:54.673+0000 7fe721400640 1 --2- 172.21.15.44:0/3404464229 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fe71c146670 0x7fe71c14d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:47:54.665 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:54.673+0000 7fe721400640 1 -- 172.21.15.44:0/3404464229 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7fe71c152930 con 0x7fe71c146670 2024-04-17T19:47:54.665 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:54.673+0000 7fe71a800640 1 --2- 172.21.15.44:0/3404464229 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fe71c146670 0x7fe71c14d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:47:54.665 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:54.673+0000 7fe71a800640 1 -- 172.21.15.44:0/3404464229 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fe71c14f650 con 0x7fe71c146670 2024-04-17T19:47:54.665 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:54.677+0000 7fe71a800640 1 --2- 172.21.15.44:0/3404464229 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fe71c146670 0x7fe71c14d5d0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fe70c00e400 tx=0x7fe70c000ee0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:47:54.665 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:54.677+0000 7fe712a00640 1 -- 172.21.15.44:0/3404464229 <== mon.2 v2:172.21.15.62:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe70c019040 con 0x7fe71c146670 2024-04-17T19:47:54.665 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:54.677+0000 7fe712a00640 1 -- 172.21.15.44:0/3404464229 <== mon.2 v2:172.21.15.62:3301/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+5056 (secure 0 0 0) 0x7fe70c007350 con 0x7fe71c146670 2024-04-17T19:47:54.665 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:54.677+0000 7fe712a00640 1 -- 172.21.15.44:0/3404464229 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fe71c146670 msgr2=0x7fe71c14d5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:54.665 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:54.677+0000 7fe712a00640 1 --2- 172.21.15.44:0/3404464229 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fe71c146670 0x7fe71c14d5d0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fe70c00e400 tx=0x7fe70c000ee0 comp rx=0 tx=0).stop 2024-04-17T19:47:54.665 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:54.677+0000 7fe712a00640 1 -- 172.21.15.44:0/3404464229 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fe71c146670 msgr2=0x7fe71c14d5d0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-04-17T19:47:54.665 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:54.677+0000 7fe712a00640 1 --2- 172.21.15.44:0/3404464229 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fe71c146670 0x7fe71c14d5d0 secure :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fe70c00e400 tx=0x7fe70c000ee0 comp rx=0 tx=0).stop 2024-04-17T19:47:54.666 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2024-04-17T19:47:54.666 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "c", 2024-04-17T19:47:54.666 INFO:teuthology.orchestra.run.smithi044.stdout: "rank": 2, 2024-04-17T19:47:54.666 INFO:teuthology.orchestra.run.smithi044.stdout: "state": "peon", 2024-04-17T19:47:54.666 INFO:teuthology.orchestra.run.smithi044.stdout: "election_epoch": 4, 2024-04-17T19:47:54.666 INFO:teuthology.orchestra.run.smithi044.stdout: "uptime": 84105, 2024-04-17T19:47:54.667 INFO:teuthology.orchestra.run.smithi044.stdout: "quorum": [ 2024-04-17T19:47:54.667 INFO:teuthology.orchestra.run.smithi044.stdout: 0, 2024-04-17T19:47:54.667 INFO:teuthology.orchestra.run.smithi044.stdout: 1, 2024-04-17T19:47:54.667 INFO:teuthology.orchestra.run.smithi044.stdout: 2 2024-04-17T19:47:54.667 INFO:teuthology.orchestra.run.smithi044.stdout: ], 2024-04-17T19:47:54.667 INFO:teuthology.orchestra.run.smithi044.stdout: "quorum_age": 83, 2024-04-17T19:47:54.667 INFO:teuthology.orchestra.run.smithi044.stdout: "features": { 2024-04-17T19:47:54.667 INFO:teuthology.orchestra.run.smithi044.stdout: "required_con": "2450521708007866372", 2024-04-17T19:47:54.667 INFO:teuthology.orchestra.run.smithi044.stdout: "required_mon": [ 2024-04-17T19:47:54.668 INFO:teuthology.orchestra.run.smithi044.stdout: "kraken", 2024-04-17T19:47:54.668 INFO:teuthology.orchestra.run.smithi044.stdout: "luminous", 2024-04-17T19:47:54.668 INFO:teuthology.orchestra.run.smithi044.stdout: "mimic", 2024-04-17T19:47:54.668 INFO:teuthology.orchestra.run.smithi044.stdout: "osdmap-prune", 2024-04-17T19:47:54.668 INFO:teuthology.orchestra.run.smithi044.stdout: "nautilus", 2024-04-17T19:47:54.668 INFO:teuthology.orchestra.run.smithi044.stdout: "octopus", 2024-04-17T19:47:54.668 INFO:teuthology.orchestra.run.smithi044.stdout: "pacific", 2024-04-17T19:47:54.668 INFO:teuthology.orchestra.run.smithi044.stdout: "elector-pinging", 2024-04-17T19:47:54.668 INFO:teuthology.orchestra.run.smithi044.stdout: "quincy", 2024-04-17T19:47:54.669 INFO:teuthology.orchestra.run.smithi044.stdout: "reef", 2024-04-17T19:47:54.669 INFO:teuthology.orchestra.run.smithi044.stdout: "squid" 2024-04-17T19:47:54.669 INFO:teuthology.orchestra.run.smithi044.stdout: ], 2024-04-17T19:47:54.669 INFO:teuthology.orchestra.run.smithi044.stdout: "quorum_con": "4540701547738038271", 2024-04-17T19:47:54.669 INFO:teuthology.orchestra.run.smithi044.stdout: "quorum_mon": [ 2024-04-17T19:47:54.669 INFO:teuthology.orchestra.run.smithi044.stdout: "kraken", 2024-04-17T19:47:54.669 INFO:teuthology.orchestra.run.smithi044.stdout: "luminous", 2024-04-17T19:47:54.669 INFO:teuthology.orchestra.run.smithi044.stdout: "mimic", 2024-04-17T19:47:54.669 INFO:teuthology.orchestra.run.smithi044.stdout: "osdmap-prune", 2024-04-17T19:47:54.669 INFO:teuthology.orchestra.run.smithi044.stdout: "nautilus", 2024-04-17T19:47:54.670 INFO:teuthology.orchestra.run.smithi044.stdout: "octopus", 2024-04-17T19:47:54.670 INFO:teuthology.orchestra.run.smithi044.stdout: "pacific", 2024-04-17T19:47:54.670 INFO:teuthology.orchestra.run.smithi044.stdout: "elector-pinging", 2024-04-17T19:47:54.670 INFO:teuthology.orchestra.run.smithi044.stdout: "quincy", 2024-04-17T19:47:54.670 INFO:teuthology.orchestra.run.smithi044.stdout: "reef", 2024-04-17T19:47:54.670 INFO:teuthology.orchestra.run.smithi044.stdout: "squid" 2024-04-17T19:47:54.670 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T19:47:54.670 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T19:47:54.670 INFO:teuthology.orchestra.run.smithi044.stdout: "outside_quorum": [], 2024-04-17T19:47:54.670 INFO:teuthology.orchestra.run.smithi044.stdout: "extra_probe_peers": [], 2024-04-17T19:47:54.671 INFO:teuthology.orchestra.run.smithi044.stdout: "sync_provider": [], 2024-04-17T19:47:54.671 INFO:teuthology.orchestra.run.smithi044.stdout: "monmap": { 2024-04-17T19:47:54.671 INFO:teuthology.orchestra.run.smithi044.stdout: "epoch": 1, 2024-04-17T19:47:54.671 INFO:teuthology.orchestra.run.smithi044.stdout: "fsid": "703f77ca-79c6-4a66-b576-62c526cb1021", 2024-04-17T19:47:54.671 INFO:teuthology.orchestra.run.smithi044.stdout: "modified": "2024-04-17T19:45:55.379749Z", 2024-04-17T19:47:54.671 INFO:teuthology.orchestra.run.smithi044.stdout: "created": "2024-04-17T19:45:55.379749Z", 2024-04-17T19:47:54.671 INFO:teuthology.orchestra.run.smithi044.stdout: "min_mon_release": 19, 2024-04-17T19:47:54.671 INFO:teuthology.orchestra.run.smithi044.stdout: "min_mon_release_name": "squid", 2024-04-17T19:47:54.671 INFO:teuthology.orchestra.run.smithi044.stdout: "election_strategy": 1, 2024-04-17T19:47:54.672 INFO:teuthology.orchestra.run.smithi044.stdout: "disallowed_leaders: ": "", 2024-04-17T19:47:54.672 INFO:teuthology.orchestra.run.smithi044.stdout: "stretch_mode": false, 2024-04-17T19:47:54.672 INFO:teuthology.orchestra.run.smithi044.stdout: "tiebreaker_mon": "", 2024-04-17T19:47:54.672 INFO:teuthology.orchestra.run.smithi044.stdout: "removed_ranks: ": "", 2024-04-17T19:47:54.672 INFO:teuthology.orchestra.run.smithi044.stdout: "features": { 2024-04-17T19:47:54.672 INFO:teuthology.orchestra.run.smithi044.stdout: "persistent": [ 2024-04-17T19:47:54.672 INFO:teuthology.orchestra.run.smithi044.stdout: "kraken", 2024-04-17T19:47:54.672 INFO:teuthology.orchestra.run.smithi044.stdout: "luminous", 2024-04-17T19:47:54.672 INFO:teuthology.orchestra.run.smithi044.stdout: "mimic", 2024-04-17T19:47:54.672 INFO:teuthology.orchestra.run.smithi044.stdout: "osdmap-prune", 2024-04-17T19:47:54.673 INFO:teuthology.orchestra.run.smithi044.stdout: "nautilus", 2024-04-17T19:47:54.673 INFO:teuthology.orchestra.run.smithi044.stdout: "octopus", 2024-04-17T19:47:54.673 INFO:teuthology.orchestra.run.smithi044.stdout: "pacific", 2024-04-17T19:47:54.673 INFO:teuthology.orchestra.run.smithi044.stdout: "elector-pinging", 2024-04-17T19:47:54.673 INFO:teuthology.orchestra.run.smithi044.stdout: "quincy", 2024-04-17T19:47:54.673 INFO:teuthology.orchestra.run.smithi044.stdout: "reef", 2024-04-17T19:47:54.673 INFO:teuthology.orchestra.run.smithi044.stdout: "squid" 2024-04-17T19:47:54.674 INFO:teuthology.orchestra.run.smithi044.stdout: ], 2024-04-17T19:47:54.674 INFO:teuthology.orchestra.run.smithi044.stdout: "optional": [] 2024-04-17T19:47:54.674 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T19:47:54.674 INFO:teuthology.orchestra.run.smithi044.stdout: "mons": [ 2024-04-17T19:47:54.674 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T19:47:54.674 INFO:teuthology.orchestra.run.smithi044.stdout: "rank": 0, 2024-04-17T19:47:54.675 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "a", 2024-04-17T19:47:54.675 INFO:teuthology.orchestra.run.smithi044.stdout: "public_addrs": { 2024-04-17T19:47:54.675 INFO:teuthology.orchestra.run.smithi044.stdout: "addrvec": [ 2024-04-17T19:47:54.675 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T19:47:54.675 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "v2", 2024-04-17T19:47:54.675 INFO:teuthology.orchestra.run.smithi044.stdout: "addr": "172.21.15.44:3300", 2024-04-17T19:47:54.676 INFO:teuthology.orchestra.run.smithi044.stdout: "nonce": 0 2024-04-17T19:47:54.676 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T19:47:54.676 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T19:47:54.676 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "v1", 2024-04-17T19:47:54.676 INFO:teuthology.orchestra.run.smithi044.stdout: "addr": "172.21.15.44:6789", 2024-04-17T19:47:54.676 INFO:teuthology.orchestra.run.smithi044.stdout: "nonce": 0 2024-04-17T19:47:54.677 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T19:47:54.677 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T19:47:54.677 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T19:47:54.677 INFO:teuthology.orchestra.run.smithi044.stdout: "addr": "172.21.15.44:6789/0", 2024-04-17T19:47:54.677 INFO:teuthology.orchestra.run.smithi044.stdout: "public_addr": "172.21.15.44:6789/0", 2024-04-17T19:47:54.677 INFO:teuthology.orchestra.run.smithi044.stdout: "priority": 0, 2024-04-17T19:47:54.678 INFO:teuthology.orchestra.run.smithi044.stdout: "weight": 0, 2024-04-17T19:47:54.678 INFO:teuthology.orchestra.run.smithi044.stdout: "crush_location": "{}" 2024-04-17T19:47:54.678 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T19:47:54.678 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T19:47:54.678 INFO:teuthology.orchestra.run.smithi044.stdout: "rank": 1, 2024-04-17T19:47:54.678 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "b", 2024-04-17T19:47:54.679 INFO:teuthology.orchestra.run.smithi044.stdout: "public_addrs": { 2024-04-17T19:47:54.679 INFO:teuthology.orchestra.run.smithi044.stdout: "addrvec": [ 2024-04-17T19:47:54.679 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T19:47:54.679 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "v2", 2024-04-17T19:47:54.679 INFO:teuthology.orchestra.run.smithi044.stdout: "addr": "172.21.15.62:3300", 2024-04-17T19:47:54.679 INFO:teuthology.orchestra.run.smithi044.stdout: "nonce": 0 2024-04-17T19:47:54.680 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T19:47:54.680 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T19:47:54.680 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "v1", 2024-04-17T19:47:54.680 INFO:teuthology.orchestra.run.smithi044.stdout: "addr": "172.21.15.62:6789", 2024-04-17T19:47:54.680 INFO:teuthology.orchestra.run.smithi044.stdout: "nonce": 0 2024-04-17T19:47:54.680 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T19:47:54.681 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T19:47:54.681 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T19:47:54.681 INFO:teuthology.orchestra.run.smithi044.stdout: "addr": "172.21.15.62:6789/0", 2024-04-17T19:47:54.681 INFO:teuthology.orchestra.run.smithi044.stdout: "public_addr": "172.21.15.62:6789/0", 2024-04-17T19:47:54.681 INFO:teuthology.orchestra.run.smithi044.stdout: "priority": 0, 2024-04-17T19:47:54.681 INFO:teuthology.orchestra.run.smithi044.stdout: "weight": 0, 2024-04-17T19:47:54.682 INFO:teuthology.orchestra.run.smithi044.stdout: "crush_location": "{}" 2024-04-17T19:47:54.682 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T19:47:54.682 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T19:47:54.682 INFO:teuthology.orchestra.run.smithi044.stdout: "rank": 2, 2024-04-17T19:47:54.682 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "c", 2024-04-17T19:47:54.682 INFO:teuthology.orchestra.run.smithi044.stdout: "public_addrs": { 2024-04-17T19:47:54.683 INFO:teuthology.orchestra.run.smithi044.stdout: "addrvec": [ 2024-04-17T19:47:54.683 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T19:47:54.683 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "v2", 2024-04-17T19:47:54.683 INFO:teuthology.orchestra.run.smithi044.stdout: "addr": "172.21.15.62:3301", 2024-04-17T19:47:54.683 INFO:teuthology.orchestra.run.smithi044.stdout: "nonce": 0 2024-04-17T19:47:54.683 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T19:47:54.684 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T19:47:54.684 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "v1", 2024-04-17T19:47:54.684 INFO:teuthology.orchestra.run.smithi044.stdout: "addr": "172.21.15.62:6790", 2024-04-17T19:47:54.684 INFO:teuthology.orchestra.run.smithi044.stdout: "nonce": 0 2024-04-17T19:47:54.684 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T19:47:54.684 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T19:47:54.685 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T19:47:54.685 INFO:teuthology.orchestra.run.smithi044.stdout: "addr": "172.21.15.62:6790/0", 2024-04-17T19:47:54.685 INFO:teuthology.orchestra.run.smithi044.stdout: "public_addr": "172.21.15.62:6790/0", 2024-04-17T19:47:54.685 INFO:teuthology.orchestra.run.smithi044.stdout: "priority": 0, 2024-04-17T19:47:54.685 INFO:teuthology.orchestra.run.smithi044.stdout: "weight": 0, 2024-04-17T19:47:54.685 INFO:teuthology.orchestra.run.smithi044.stdout: "crush_location": "{}" 2024-04-17T19:47:54.686 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T19:47:54.686 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T19:47:54.686 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T19:47:54.686 INFO:teuthology.orchestra.run.smithi044.stdout: "feature_map": { 2024-04-17T19:47:54.686 INFO:teuthology.orchestra.run.smithi044.stdout: "mon": [ 2024-04-17T19:47:54.686 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T19:47:54.687 INFO:teuthology.orchestra.run.smithi044.stdout: "features": "0x3f03cffffffdffff", 2024-04-17T19:47:54.687 INFO:teuthology.orchestra.run.smithi044.stdout: "release": "luminous", 2024-04-17T19:47:54.687 INFO:teuthology.orchestra.run.smithi044.stdout: "num": 1 2024-04-17T19:47:54.687 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T19:47:54.687 INFO:teuthology.orchestra.run.smithi044.stdout: ], 2024-04-17T19:47:54.688 INFO:teuthology.orchestra.run.smithi044.stdout: "mds": [ 2024-04-17T19:47:54.688 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T19:47:54.688 INFO:teuthology.orchestra.run.smithi044.stdout: "features": "0x3f03cffffffdffff", 2024-04-17T19:47:54.688 INFO:teuthology.orchestra.run.smithi044.stdout: "release": "luminous", 2024-04-17T19:47:54.688 INFO:teuthology.orchestra.run.smithi044.stdout: "num": 1 2024-04-17T19:47:54.688 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T19:47:54.689 INFO:teuthology.orchestra.run.smithi044.stdout: ], 2024-04-17T19:47:54.689 INFO:teuthology.orchestra.run.smithi044.stdout: "osd": [ 2024-04-17T19:47:54.689 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T19:47:54.689 INFO:teuthology.orchestra.run.smithi044.stdout: "features": "0x3f03cffffffdffff", 2024-04-17T19:47:54.689 INFO:teuthology.orchestra.run.smithi044.stdout: "release": "luminous", 2024-04-17T19:47:54.689 INFO:teuthology.orchestra.run.smithi044.stdout: "num": 1 2024-04-17T19:47:54.689 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T19:47:54.690 INFO:teuthology.orchestra.run.smithi044.stdout: ], 2024-04-17T19:47:54.690 INFO:teuthology.orchestra.run.smithi044.stdout: "client": [ 2024-04-17T19:47:54.690 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T19:47:54.690 INFO:teuthology.orchestra.run.smithi044.stdout: "features": "0x3f03cffffffdffff", 2024-04-17T19:47:54.690 INFO:teuthology.orchestra.run.smithi044.stdout: "release": "luminous", 2024-04-17T19:47:54.691 INFO:teuthology.orchestra.run.smithi044.stdout: "num": 3 2024-04-17T19:47:54.691 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T19:47:54.691 INFO:teuthology.orchestra.run.smithi044.stdout: ], 2024-04-17T19:47:54.691 INFO:teuthology.orchestra.run.smithi044.stdout: "mgr": [ 2024-04-17T19:47:54.691 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T19:47:54.691 INFO:teuthology.orchestra.run.smithi044.stdout: "features": "0x3f03cffffffdffff", 2024-04-17T19:47:54.691 INFO:teuthology.orchestra.run.smithi044.stdout: "release": "luminous", 2024-04-17T19:47:54.692 INFO:teuthology.orchestra.run.smithi044.stdout: "num": 1 2024-04-17T19:47:54.692 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T19:47:54.692 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T19:47:54.692 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T19:47:54.692 INFO:teuthology.orchestra.run.smithi044.stdout: "stretch_mode": false 2024-04-17T19:47:54.692 INFO:teuthology.orchestra.run.smithi044.stdout:} 2024-04-17T19:47:54.695 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:54.677+0000 7fe721400640 1 -- 172.21.15.44:0/3404464229 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7fe6f8068380 msgr2=0x7fe6f806a890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:54.695 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:54.677+0000 7fe721400640 1 --2- 172.21.15.44:0/3404464229 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7fe6f8068380 0x7fe6f806a890 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fe71c0745c0 tx=0x7fe71400b040 comp rx=0 tx=0).stop 2024-04-17T19:47:54.696 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:54.677+0000 7fe721400640 1 -- 172.21.15.44:0/3404464229 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe71c15f810 msgr2=0x7fe71c146130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:47:54.696 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:54.677+0000 7fe721400640 1 --2- 172.21.15.44:0/3404464229 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe71c15f810 0x7fe71c146130 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fe7040b3040 tx=0x7fe70401ba10 comp rx=0 tx=0).stop 2024-04-17T19:47:54.696 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:54.677+0000 7fe71b200640 1 -- 172.21.15.44:0/3404464229 reap_dead start 2024-04-17T19:47:54.696 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:54.677+0000 7fe71b200640 1 -- 172.21.15.44:0/3404464229 reap_dead start 2024-04-17T19:47:54.696 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:54.677+0000 7fe721400640 1 -- 172.21.15.44:0/3404464229 shutdown_connections 2024-04-17T19:47:54.696 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:54.677+0000 7fe721400640 1 -- 172.21.15.44:0/3404464229 >> 172.21.15.44:0/3404464229 conn(0x7fe71c067eb0 msgr2=0x7fe71c14bd30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:47:54.697 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:54.677+0000 7fe721400640 1 -- 172.21.15.44:0/3404464229 shutdown_connections 2024-04-17T19:47:54.697 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:47:54.677+0000 7fe721400640 1 -- 172.21.15.44:0/3404464229 wait complete. 2024-04-17T19:47:54.697 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-04-17T19:47:54.698 INFO:tasks.mon_thrash.mon_thrasher:monitors to thrash: ['c'] 2024-04-17T19:47:54.698 INFO:tasks.mon_thrash.mon_thrasher:monitors to freeze: ['b'] 2024-04-17T19:47:54.698 INFO:tasks.mon_thrash.mon_thrasher:thrashing mon.c 2024-04-17T19:47:54.698 INFO:tasks.mon_thrash.mon_thrasher:killing mon.c 2024-04-17T19:47:54.698 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2024-04-17T19:47:54.699 INFO:teuthology.orchestra.run:waiting for 300 2024-04-17T19:47:54.722 INFO:tasks.ceph.mon.c:Stopped 2024-04-17T19:47:54.722 INFO:tasks.mon_thrash:Sending STOP to mon b 2024-04-17T19:47:54.722 INFO:tasks.ceph.mon.b:Sent signal 19 2024-04-17T19:47:54.722 INFO:tasks.mon_thrash.mon_thrasher:waiting for 15.0 secs to unfreeze mons 2024-04-17T19:48:09.723 INFO:tasks.mon_thrash:Sending CONT to mon b 2024-04-17T19:48:09.724 INFO:tasks.ceph.mon.b:Sent signal 18 2024-04-17T19:48:09.724 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 2 2024-04-17T19:48:09.725 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-04-17T19:48:09.889 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:09.900+0000 7f2450200640 1 Processor -- start 2024-04-17T19:48:09.889 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:09.900+0000 7f2450200640 1 -- start start 2024-04-17T19:48:09.892 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:09.904+0000 7f2450200640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f2448152a60 0x7f24480c6920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:48:09.892 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:09.904+0000 7f2450200640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f2448158eb0 0x7f24481592c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:48:09.892 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:09.904+0000 7f2450200640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f24480c47c0 0x7f24480c4bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:48:09.892 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:09.904+0000 7f2450200640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 -- 0x7f2448152e70 con 0x7f2448152a60 2024-04-17T19:48:09.892 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:09.904+0000 7f2450200640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 -- 0x7f24480c52c0 con 0x7f24480c47c0 2024-04-17T19:48:09.892 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:09.904+0000 7f2450200640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7f24480c8840 con 0x7f2448158eb0 2024-04-17T19:48:09.892 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:09.904+0000 7f244d800640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f2448152a60 0x7f24480c6920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:48:09.892 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:09.904+0000 7f244ce00640 1 -- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f2448158eb0 msgr2=0x7f24481592c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.62:3301/0 2024-04-17T19:48:09.892 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:09.904+0000 7f244ce00640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f2448158eb0 0x7f24481592c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-17T19:48:09.892 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:09.904+0000 7f244d800640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f2448152a60 0x7f24480c6920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:38306/0 (socket says 172.21.15.44:38306) 2024-04-17T19:48:09.893 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:09.904+0000 7f244d800640 1 -- 172.21.15.44:0/1117079149 learned_addr learned my addr 172.21.15.44:0/1117079149 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-04-17T19:48:09.893 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:09.904+0000 7f244e200640 1 --2- 172.21.15.44:0/1117079149 >> v2:172.21.15.62:3300/0 conn(0x7f24480c47c0 0x7f24480c4bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:48:09.893 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:09.904+0000 7f244d800640 1 -- 172.21.15.44:0/1117079149 >> v2:172.21.15.44:3300/0 conn(0x7f2448152a60 msgr2=0x7f24480c6920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-04-17T19:48:09.893 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:09.904+0000 7f244d800640 1 -- 172.21.15.44:0/1117079149 >> v2:172.21.15.44:3300/0 conn(0x7f2448152a60 msgr2=0x7f24480c6920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-17T19:48:09.893 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:09.904+0000 7f244d800640 1 --2- 172.21.15.44:0/1117079149 >> v2:172.21.15.44:3300/0 conn(0x7f2448152a60 0x7f24480c6920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-17T19:48:09.893 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:09.904+0000 7f244d800640 1 --2- 172.21.15.44:0/1117079149 >> v2:172.21.15.44:3300/0 conn(0x7f2448152a60 0x7f24480c6920 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-17T19:48:09.893 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:09.904+0000 7f244e200640 1 -- 172.21.15.44:0/1117079149 >> v2:172.21.15.62:3300/0 conn(0x7f24480c47c0 msgr2=0x7f24480c4bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-04-17T19:48:09.893 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:09.904+0000 7f244e200640 1 -- 172.21.15.44:0/1117079149 >> v2:172.21.15.62:3300/0 conn(0x7f24480c47c0 msgr2=0x7f24480c4bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-17T19:48:09.893 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:09.904+0000 7f244e200640 1 --2- 172.21.15.44:0/1117079149 >> v2:172.21.15.62:3300/0 conn(0x7f24480c47c0 0x7f24480c4bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-17T19:48:09.893 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:09.904+0000 7f244e200640 1 --2- 172.21.15.44:0/1117079149 >> v2:172.21.15.62:3300/0 conn(0x7f24480c47c0 0x7f24480c4bd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-17T19:48:10.095 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:10.108+0000 7f244ce00640 1 -- 172.21.15.44:0/1117079149 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f2448158eb0 msgr2=0x7f24481592c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.62:3301/0 2024-04-17T19:48:10.095 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:10.108+0000 7f244d800640 1 --2- 172.21.15.44:0/1117079149 >> v2:172.21.15.44:3300/0 conn(0x7f2448152a60 0x7f24480c6920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:48:10.095 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:10.108+0000 7f244ce00640 1 --2- 172.21.15.44:0/1117079149 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f2448158eb0 0x7f24481592c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-17T19:48:10.096 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:10.108+0000 7f244d800640 1 -- 172.21.15.44:0/1117079149 >> v2:172.21.15.44:3300/0 conn(0x7f2448152a60 msgr2=0x7f24480c6920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-04-17T19:48:10.096 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:10.108+0000 7f244d800640 1 -- 172.21.15.44:0/1117079149 >> v2:172.21.15.44:3300/0 conn(0x7f2448152a60 msgr2=0x7f24480c6920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-17T19:48:10.096 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:10.108+0000 7f244d800640 1 --2- 172.21.15.44:0/1117079149 >> v2:172.21.15.44:3300/0 conn(0x7f2448152a60 0x7f24480c6920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-17T19:48:10.096 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:10.108+0000 7f244e200640 1 --2- 172.21.15.44:0/1117079149 >> v2:172.21.15.62:3300/0 conn(0x7f24480c47c0 0x7f24480c4bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:48:10.096 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:10.108+0000 7f244d800640 1 --2- 172.21.15.44:0/1117079149 >> v2:172.21.15.44:3300/0 conn(0x7f2448152a60 0x7f24480c6920 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-17T19:48:10.096 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:10.108+0000 7f244e200640 1 -- 172.21.15.44:0/1117079149 >> v2:172.21.15.62:3300/0 conn(0x7f24480c47c0 msgr2=0x7f24480c4bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-04-17T19:48:10.096 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:10.108+0000 7f244e200640 1 -- 172.21.15.44:0/1117079149 >> v2:172.21.15.62:3300/0 conn(0x7f24480c47c0 msgr2=0x7f24480c4bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-17T19:48:10.096 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:10.108+0000 7f244e200640 1 --2- 172.21.15.44:0/1117079149 >> v2:172.21.15.62:3300/0 conn(0x7f24480c47c0 0x7f24480c4bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-17T19:48:10.096 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:10.108+0000 7f244e200640 1 --2- 172.21.15.44:0/1117079149 >> v2:172.21.15.62:3300/0 conn(0x7f24480c47c0 0x7f24480c4bd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-17T19:48:10.499 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:10.512+0000 7f244ce00640 1 -- 172.21.15.44:0/1117079149 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f2448158eb0 msgr2=0x7f24481592c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.62:3301/0 2024-04-17T19:48:10.500 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:10.512+0000 7f244d800640 1 --2- 172.21.15.44:0/1117079149 >> v2:172.21.15.44:3300/0 conn(0x7f2448152a60 0x7f24480c6920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:48:10.500 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:10.512+0000 7f244ce00640 1 --2- 172.21.15.44:0/1117079149 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f2448158eb0 0x7f24481592c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-17T19:48:10.500 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:10.512+0000 7f244e200640 1 --2- 172.21.15.44:0/1117079149 >> v2:172.21.15.62:3300/0 conn(0x7f24480c47c0 0x7f24480c4bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:48:10.500 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:10.512+0000 7f244d800640 1 -- 172.21.15.44:0/1117079149 >> v2:172.21.15.44:3300/0 conn(0x7f2448152a60 msgr2=0x7f24480c6920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-04-17T19:48:10.500 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:10.512+0000 7f244d800640 1 -- 172.21.15.44:0/1117079149 >> v2:172.21.15.44:3300/0 conn(0x7f2448152a60 msgr2=0x7f24480c6920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-17T19:48:10.500 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:10.512+0000 7f244d800640 1 --2- 172.21.15.44:0/1117079149 >> v2:172.21.15.44:3300/0 conn(0x7f2448152a60 0x7f24480c6920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-17T19:48:10.500 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:10.512+0000 7f244d800640 1 --2- 172.21.15.44:0/1117079149 >> v2:172.21.15.44:3300/0 conn(0x7f2448152a60 0x7f24480c6920 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-17T19:48:10.500 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:10.512+0000 7f244e200640 1 -- 172.21.15.44:0/1117079149 >> v2:172.21.15.62:3300/0 conn(0x7f24480c47c0 msgr2=0x7f24480c4bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-04-17T19:48:10.500 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:10.512+0000 7f244e200640 1 -- 172.21.15.44:0/1117079149 >> v2:172.21.15.62:3300/0 conn(0x7f24480c47c0 msgr2=0x7f24480c4bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-17T19:48:10.500 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:10.512+0000 7f244e200640 1 --2- 172.21.15.44:0/1117079149 >> v2:172.21.15.62:3300/0 conn(0x7f24480c47c0 0x7f24480c4bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-17T19:48:10.500 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:10.512+0000 7f244e200640 1 --2- 172.21.15.44:0/1117079149 >> v2:172.21.15.62:3300/0 conn(0x7f24480c47c0 0x7f24480c4bd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-17T19:48:11.303 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:11.316+0000 7f244ce00640 1 -- 172.21.15.44:0/1117079149 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f2448158eb0 msgr2=0x7f24481592c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.62:3301/0 2024-04-17T19:48:11.303 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:11.316+0000 7f244d800640 1 --2- 172.21.15.44:0/1117079149 >> v2:172.21.15.44:3300/0 conn(0x7f2448152a60 0x7f24480c6920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:48:11.304 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:11.316+0000 7f244ce00640 1 --2- 172.21.15.44:0/1117079149 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f2448158eb0 0x7f24481592c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-17T19:48:11.304 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:11.316+0000 7f244e200640 1 --2- 172.21.15.44:0/1117079149 >> v2:172.21.15.62:3300/0 conn(0x7f24480c47c0 0x7f24480c4bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:48:11.304 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:11.316+0000 7f244d800640 1 -- 172.21.15.44:0/1117079149 >> v2:172.21.15.44:3300/0 conn(0x7f2448152a60 msgr2=0x7f24480c6920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-04-17T19:48:11.304 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:11.316+0000 7f244d800640 1 -- 172.21.15.44:0/1117079149 >> v2:172.21.15.44:3300/0 conn(0x7f2448152a60 msgr2=0x7f24480c6920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-17T19:48:11.304 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:11.316+0000 7f244d800640 1 --2- 172.21.15.44:0/1117079149 >> v2:172.21.15.44:3300/0 conn(0x7f2448152a60 0x7f24480c6920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-17T19:48:11.304 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:11.316+0000 7f244d800640 1 --2- 172.21.15.44:0/1117079149 >> v2:172.21.15.44:3300/0 conn(0x7f2448152a60 0x7f24480c6920 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-17T19:48:11.304 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:11.316+0000 7f244e200640 1 -- 172.21.15.44:0/1117079149 >> v2:172.21.15.62:3300/0 conn(0x7f24480c47c0 msgr2=0x7f24480c4bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-04-17T19:48:11.304 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:11.316+0000 7f244e200640 1 -- 172.21.15.44:0/1117079149 >> v2:172.21.15.62:3300/0 conn(0x7f24480c47c0 msgr2=0x7f24480c4bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-17T19:48:11.304 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:11.316+0000 7f244e200640 1 --2- 172.21.15.44:0/1117079149 >> v2:172.21.15.62:3300/0 conn(0x7f24480c47c0 0x7f24480c4bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-17T19:48:11.304 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:11.316+0000 7f244e200640 1 --2- 172.21.15.44:0/1117079149 >> v2:172.21.15.62:3300/0 conn(0x7f24480c47c0 0x7f24480c4bd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-17T19:48:12.891 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:12.904+0000 7f2446a00640 1 -- 172.21.15.44:0/1117079149 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f2448158eb0 msgr2=0x7f24481592c0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-17T19:48:12.891 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:12.904+0000 7f2446a00640 1 --2- 172.21.15.44:0/1117079149 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f2448158eb0 0x7f24481592c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:48:12.891 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:12.904+0000 7f2446a00640 1 -- 172.21.15.44:0/1117079149 >> v2:172.21.15.62:3300/0 conn(0x7f24480c47c0 msgr2=0x7f24480c4bd0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-17T19:48:12.891 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:12.904+0000 7f2446a00640 1 --2- 172.21.15.44:0/1117079149 >> v2:172.21.15.62:3300/0 conn(0x7f24480c47c0 0x7f24480c4bd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:48:12.891 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:12.904+0000 7f2446a00640 1 -- 172.21.15.44:0/1117079149 >> v2:172.21.15.44:3300/0 conn(0x7f2448152a60 msgr2=0x7f24480c6920 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-17T19:48:12.891 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:12.904+0000 7f2446a00640 1 --2- 172.21.15.44:0/1117079149 >> v2:172.21.15.44:3300/0 conn(0x7f2448152a60 0x7f24480c6920 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:48:12.892 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:12.904+0000 7f2446a00640 1 -- 172.21.15.44:0/1117079149 --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f24480c8b20 con 0x7f24280036c0 2024-04-17T19:48:12.892 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:12.904+0000 7f2446a00640 1 -- 172.21.15.44:0/1117079149 --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f242800c1d0 con 0x7f2428007410 2024-04-17T19:48:14.745 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:14.756+0000 7f2447e00640 1 -- 172.21.15.44:0/1117079149 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2739161195 0 0) 0x7f24480c8b20 con 0x7f24280036c0 2024-04-17T19:48:14.746 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:14.756+0000 7f2447e00640 1 -- 172.21.15.44:0/1117079149 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2430003530 con 0x7f24280036c0 2024-04-17T19:48:14.747 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:14.756+0000 7f2447e00640 1 -- 172.21.15.44:0/1117079149 <== mon.0 v1:172.21.15.44:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 316685024 0 0) 0x7f2430003530 con 0x7f24280036c0 2024-04-17T19:48:14.747 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:14.756+0000 7f2447e00640 1 -- 172.21.15.44:0/1117079149 >> v1:172.21.15.62:6789/0 conn(0x7f2428007410 legacy=0x7f2428009920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:48:14.748 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:14.756+0000 7f2447e00640 1 -- 172.21.15.44:0/1117079149 --> v1:172.21.15.44:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f242800d4d0 con 0x7f24280036c0 2024-04-17T19:48:14.748 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:14.756+0000 7f2447e00640 1 -- 172.21.15.44:0/1117079149 <== mon.0 v1:172.21.15.44:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1863569991 0 0) 0x7f243c00e780 con 0x7f24280036c0 2024-04-17T19:48:14.748 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:14.756+0000 7f2447e00640 1 -- 172.21.15.44:0/1117079149 >> v1:172.21.15.44:6789/0 conn(0x7f24280036c0 legacy=0x7f2428005b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:48:14.748 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:14.756+0000 7f244e200640 1 -- 172.21.15.44:0/1117079149 reap_dead start 2024-04-17T19:48:14.748 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:14.760+0000 7f2447e00640 1 --2- 172.21.15.44:0/1117079149 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f24300039c0 0x7f2430003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:48:14.748 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:14.760+0000 7f2447e00640 1 --2- 172.21.15.44:0/1117079149 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f2430004810 0x7f2430004c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:48:14.748 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:14.760+0000 7f2447e00640 1 --2- 172.21.15.44:0/1117079149 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2430005400 0x7f243000ba90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:48:14.748 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:14.760+0000 7f2447e00640 1 -- 172.21.15.44:0/1117079149 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f243000c340 con 0x7f24300039c0 2024-04-17T19:48:14.748 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:14.760+0000 7f2447e00640 1 -- 172.21.15.44:0/1117079149 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f243000c4f0 con 0x7f2430005400 2024-04-17T19:48:14.748 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:14.760+0000 7f2447e00640 1 -- 172.21.15.44:0/1117079149 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7f243000c6f0 con 0x7f2430004810 2024-04-17T19:48:14.748 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:14.760+0000 7f244ce00640 1 -- 172.21.15.44:0/1117079149 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f2430004810 msgr2=0x7f2430004c20 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.62:3301/0 2024-04-17T19:48:14.748 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:14.760+0000 7f244ce00640 1 --2- 172.21.15.44:0/1117079149 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f2430004810 0x7f2430004c20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-17T19:48:14.748 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:14.760+0000 7f244d800640 1 --2- 172.21.15.44:0/1117079149 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f24300039c0 0x7f2430003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:48:14.748 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:14.760+0000 7f244e200640 1 --2- 172.21.15.44:0/1117079149 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2430005400 0x7f243000ba90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:48:14.749 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:14.760+0000 7f244d800640 1 -- 172.21.15.44:0/1117079149 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f2430004810 msgr2=0x7f2430004c20 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-17T19:48:14.749 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:14.760+0000 7f244d800640 1 --2- 172.21.15.44:0/1117079149 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f2430004810 0x7f2430004c20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:48:14.749 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:14.760+0000 7f244d800640 1 -- 172.21.15.44:0/1117079149 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2430005400 msgr2=0x7f243000ba90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T19:48:14.749 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:14.760+0000 7f244d800640 1 --2- 172.21.15.44:0/1117079149 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2430005400 0x7f243000ba90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:48:14.749 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:14.760+0000 7f244d800640 1 -- 172.21.15.44:0/1117079149 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2430003530 con 0x7f24300039c0 2024-04-17T19:48:14.749 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:14.760+0000 7f244e200640 1 --2- 172.21.15.44:0/1117079149 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2430005400 0x7f243000ba90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-17T19:48:14.750 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:14.760+0000 7f244d800640 1 --2- 172.21.15.44:0/1117079149 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f24300039c0 0x7f2430003e10 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f243c013780 tx=0x7f243c0203f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4e5e3372db900f3a server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:48:14.751 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:14.764+0000 7f2447e00640 1 -- 172.21.15.44:0/1117079149 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f243c013450 con 0x7f24300039c0 2024-04-17T19:48:14.751 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:14.764+0000 7f2447e00640 1 -- 172.21.15.44:0/1117079149 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f243c0ac050 con 0x7f24300039c0 2024-04-17T19:48:14.751 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:14.764+0000 7f2447e00640 1 -- 172.21.15.44:0/1117079149 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f243c004270 con 0x7f24300039c0 2024-04-17T19:48:14.752 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:14.764+0000 7f2450200640 1 -- 172.21.15.44:0/1117079149 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f24300039c0 msgr2=0x7f2430003e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:48:14.752 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:14.764+0000 7f2450200640 1 --2- 172.21.15.44:0/1117079149 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f24300039c0 0x7f2430003e10 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f243c013780 tx=0x7f243c0203f0 comp rx=0 tx=0).stop 2024-04-17T19:48:14.752 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:14.764+0000 7f2450200640 1 -- 172.21.15.44:0/1117079149 shutdown_connections 2024-04-17T19:48:14.752 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:14.764+0000 7f2450200640 1 --2- 172.21.15.44:0/1117079149 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f2430004810 0x7f2430004c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:48:14.752 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:14.764+0000 7f2450200640 1 --2- 172.21.15.44:0/1117079149 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2430005400 0x7f243000ba90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:48:14.752 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:14.764+0000 7f2450200640 1 --2- 172.21.15.44:0/1117079149 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f24300039c0 0x7f2430003e10 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:48:14.752 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:14.764+0000 7f2450200640 1 -- 172.21.15.44:0/1117079149 >> 172.21.15.44:0/1117079149 conn(0x7f244806c380 msgr2=0x7f2448070080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:48:14.752 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:14.764+0000 7f2450200640 1 -- 172.21.15.44:0/1117079149 shutdown_connections 2024-04-17T19:48:14.752 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:14.764+0000 7f2450200640 1 -- 172.21.15.44:0/1117079149 wait complete. 2024-04-17T19:48:14.754 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:14.768+0000 7f2450200640 1 Processor -- start 2024-04-17T19:48:14.755 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:14.768+0000 7f2450200640 1 -- start start 2024-04-17T19:48:14.757 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:14.768+0000 7f2450200640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f24300039c0 0x7f24481ed150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:48:14.757 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:14.768+0000 7f2450200640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2430004810 0x7f2448143200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:48:14.757 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:14.768+0000 7f2450200640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2448140110 0x7f2448070040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:48:14.757 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:14.768+0000 7f2450200640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f2448158990 con 0x7f2430004810 2024-04-17T19:48:14.757 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:14.768+0000 7f2450200640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f24480c90e0 con 0x7f2448140110 2024-04-17T19:48:14.757 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:14.768+0000 7f2450200640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7f24480c4bd0 con 0x7f24300039c0 2024-04-17T19:48:14.758 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:14.768+0000 7f244d800640 1 -- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f24300039c0 msgr2=0x7f24481ed150 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.62:3301/0 2024-04-17T19:48:14.758 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:14.768+0000 7f244d800640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f24300039c0 0x7f24481ed150 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-17T19:48:14.758 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:14.768+0000 7f244ce00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2430004810 0x7f2448143200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:48:14.758 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:14.768+0000 7f244ce00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2430004810 0x7f2448143200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:38362/0 (socket says 172.21.15.44:38362) 2024-04-17T19:48:14.758 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:14.768+0000 7f244ce00640 1 -- 172.21.15.44:0/1556336457 learned_addr learned my addr 172.21.15.44:0/1556336457 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-04-17T19:48:14.758 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:14.768+0000 7f244e200640 1 --2- 172.21.15.44:0/1556336457 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2448140110 0x7f2448070040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:48:14.758 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:14.768+0000 7f244ce00640 1 -- 172.21.15.44:0/1556336457 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f24300039c0 msgr2=0x7f24481ed150 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-17T19:48:14.758 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:14.768+0000 7f244ce00640 1 --2- 172.21.15.44:0/1556336457 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f24300039c0 0x7f24481ed150 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:48:14.758 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:14.768+0000 7f244ce00640 1 -- 172.21.15.44:0/1556336457 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2448140110 msgr2=0x7f2448070040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:48:14.758 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:14.768+0000 7f244ce00640 1 --2- 172.21.15.44:0/1556336457 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2448140110 0x7f2448070040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:48:14.758 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:14.768+0000 7f244ce00640 1 -- 172.21.15.44:0/1556336457 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2448143740 con 0x7f2430004810 2024-04-17T19:48:14.759 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:14.768+0000 7f244ce00640 1 --2- 172.21.15.44:0/1556336457 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2430004810 0x7f2448143200 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f243400b900 tx=0x7f243400bdc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:48:14.759 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:14.768+0000 7f2445600640 1 -- 172.21.15.44:0/1556336457 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f243400cc10 con 0x7f2430004810 2024-04-17T19:48:14.759 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:14.768+0000 7f2445600640 1 -- 172.21.15.44:0/1556336457 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2434010030 con 0x7f2430004810 2024-04-17T19:48:14.759 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:14.768+0000 7f2450200640 1 -- 172.21.15.44:0/1556336457 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f24481ee080 con 0x7f2430004810 2024-04-17T19:48:14.760 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:14.768+0000 7f2445600640 1 -- 172.21.15.44:0/1556336457 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2434016430 con 0x7f2430004810 2024-04-17T19:48:14.760 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:14.768+0000 7f2450200640 1 -- 172.21.15.44:0/1556336457 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f24481edda0 con 0x7f2430004810 2024-04-17T19:48:14.760 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:14.772+0000 7f2450200640 1 -- 172.21.15.44:0/1556336457 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f24481ed830 con 0x7f2430004810 2024-04-17T19:48:14.761 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:14.772+0000 7f2445600640 1 -- 172.21.15.44:0/1556336457 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f24340153e0 con 0x7f2430004810 2024-04-17T19:48:14.762 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:14.772+0000 7f2445600640 1 --2- 172.21.15.44:0/1556336457 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f242806bd50 0x7f242806e260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:48:14.762 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:14.772+0000 7f2445600640 1 -- 172.21.15.44:0/1556336457 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6619+0+0 (secure 0 0 0) 0x7f24340871a0 con 0x7f2430004810 2024-04-17T19:48:14.762 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:14.772+0000 7f244d800640 1 --2- 172.21.15.44:0/1556336457 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f242806bd50 0x7f242806e260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:48:14.763 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:14.776+0000 7f244d800640 1 --2- 172.21.15.44:0/1556336457 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f242806bd50 0x7f242806e260 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f243c00b310 tx=0x7f243c004740 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:48:14.766 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:14.776+0000 7f2445600640 1 -- 172.21.15.44:0/1556336457 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f2434056cd0 con 0x7f2430004810 2024-04-17T19:48:14.998 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:15.008+0000 7f2450200640 1 -- 172.21.15.44:0/1556336457 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f244804ff10 con 0x7f2430004810 2024-04-17T19:48:14.998 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:15.012+0000 7f2445600640 1 -- 172.21.15.44:0/1556336457 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1549 (secure 0 0 0) 0x7f243405afd0 con 0x7f2430004810 2024-04-17T19:48:14.999 INFO:teuthology.orchestra.run.smithi044.stdout:{"election_epoch":6,"quorum":[0,1],"quorum_names":["a","b"],"quorum_leader_name":"a","quorum_age":0,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"703f77ca-79c6-4a66-b576-62c526cb1021","modified":"2024-04-17T19:45:55.379749Z","created":"2024-04-17T19:45:55.379749Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:3300","nonce":0},{"type":"v1","addr":"172.21.15.44:6789","nonce":0}]},"addr":"172.21.15.44:6789/0","public_addr":"172.21.15.44:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:3300","nonce":0},{"type":"v1","addr":"172.21.15.62:6789","nonce":0}]},"addr":"172.21.15.62:6789/0","public_addr":"172.21.15.62:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:3301","nonce":0},{"type":"v1","addr":"172.21.15.62:6790","nonce":0}]},"addr":"172.21.15.62:6790/0","public_addr":"172.21.15.62:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-04-17T19:48:15.001 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:15.012+0000 7f2450200640 1 -- 172.21.15.44:0/1556336457 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f242806bd50 msgr2=0x7f242806e260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:48:15.001 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:15.012+0000 7f2450200640 1 --2- 172.21.15.44:0/1556336457 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f242806bd50 0x7f242806e260 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f243c00b310 tx=0x7f243c004740 comp rx=0 tx=0).stop 2024-04-17T19:48:15.001 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:15.012+0000 7f2450200640 1 -- 172.21.15.44:0/1556336457 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2430004810 msgr2=0x7f2448143200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:48:15.001 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:15.012+0000 7f2450200640 1 --2- 172.21.15.44:0/1556336457 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2430004810 0x7f2448143200 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f243400b900 tx=0x7f243400bdc0 comp rx=0 tx=0).stop 2024-04-17T19:48:15.001 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:15.012+0000 7f2450200640 1 -- 172.21.15.44:0/1556336457 shutdown_connections 2024-04-17T19:48:15.001 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:15.012+0000 7f2450200640 1 --2- 172.21.15.44:0/1556336457 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f242806bd50 0x7f242806e260 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:48:15.001 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:15.012+0000 7f2450200640 1 --2- 172.21.15.44:0/1556336457 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2448140110 0x7f2448070040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:48:15.001 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:15.012+0000 7f2450200640 1 --2- 172.21.15.44:0/1556336457 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2430004810 0x7f2448143200 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:48:15.001 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:15.012+0000 7f2450200640 1 --2- 172.21.15.44:0/1556336457 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f24300039c0 0x7f24481ed150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:48:15.001 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:15.012+0000 7f2450200640 1 -- 172.21.15.44:0/1556336457 >> 172.21.15.44:0/1556336457 conn(0x7f244806c380 msgr2=0x7f24481458c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:48:15.001 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:15.012+0000 7f2450200640 1 -- 172.21.15.44:0/1556336457 shutdown_connections 2024-04-17T19:48:15.001 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:15.012+0000 7f2450200640 1 -- 172.21.15.44:0/1556336457 wait complete. 2024-04-17T19:48:15.020 INFO:tasks.mon_thrash.ceph_manager:quorum is size 2 2024-04-17T19:48:15.020 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 2 for mon a 2024-04-17T19:48:15.021 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2024-04-17T19:48:15.173 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:15.184+0000 7f23b5200640 1 Processor -- start 2024-04-17T19:48:15.173 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:15.184+0000 7f23b5200640 1 -- start start 2024-04-17T19:48:15.175 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:15.188+0000 7f23b5200640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f23b00c7cc0 0x7f23b0072e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:48:15.175 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:15.188+0000 7f23b5200640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f23b00c8e50 0x7f23b00733c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:48:15.175 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:15.188+0000 7f23b5200640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f23b0073f90 con 0x7f23b00c47c0 2024-04-17T19:48:15.176 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:15.188+0000 7f23b5200640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 -- 0x7f23b0074270 con 0x7f23b00c7cc0 2024-04-17T19:48:15.176 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:15.188+0000 7f23b5200640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7f23b00c94d0 con 0x7f23b00c8e50 2024-04-17T19:48:15.176 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:15.188+0000 7f23ade00640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f23b00c7cc0 0x7f23b0072e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:48:15.176 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:15.188+0000 7f23ae800640 1 -- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f23b00c8e50 msgr2=0x7f23b00733c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.62:3301/0 2024-04-17T19:48:15.176 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:15.188+0000 7f23ae800640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f23b00c8e50 0x7f23b00733c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-17T19:48:15.176 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:15.188+0000 7f23ade00640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f23b00c7cc0 0x7f23b0072e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:38368/0 (socket says 172.21.15.44:38368) 2024-04-17T19:48:15.176 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:15.188+0000 7f23ade00640 1 -- 172.21.15.44:0/3183052045 learned_addr learned my addr 172.21.15.44:0/3183052045 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-04-17T19:48:15.176 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:15.188+0000 7f23ade00640 1 -- 172.21.15.44:0/3183052045 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f23b00c8e50 msgr2=0x7f23b00733c0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-17T19:48:15.176 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:15.188+0000 7f23ade00640 1 --2- 172.21.15.44:0/3183052045 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f23b00c8e50 0x7f23b00733c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:48:15.176 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:15.188+0000 7f23ade00640 1 -- 172.21.15.44:0/3183052045 >> v1:172.21.15.62:6789/0 conn(0x7f23b00c47c0 legacy=0x7f23b00c8740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:48:15.176 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:15.188+0000 7f23ade00640 1 -- 172.21.15.44:0/3183052045 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f23b00c97b0 con 0x7f23b00c7cc0 2024-04-17T19:48:15.178 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:15.188+0000 7f23ade00640 1 --2- 172.21.15.44:0/3183052045 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f23b00c7cc0 0x7f23b0072e80 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f23a0009870 tx=0x7f23a001c580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b6d272128937fe9 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:48:15.179 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:15.188+0000 7f23ad400640 1 -- 172.21.15.44:0/3183052045 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23a00b2070 con 0x7f23b00c7cc0 2024-04-17T19:48:15.179 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:15.192+0000 7f23ad400640 1 -- 172.21.15.44:0/3183052045 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f23a00ad680 con 0x7f23b00c7cc0 2024-04-17T19:48:15.179 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:15.192+0000 7f23ad400640 1 -- 172.21.15.44:0/3183052045 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23a00ada50 con 0x7f23b00c7cc0 2024-04-17T19:48:15.179 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:15.192+0000 7f23b5200640 1 -- 172.21.15.44:0/3183052045 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f23b00c7cc0 msgr2=0x7f23b0072e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:48:15.179 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:15.192+0000 7f23b5200640 1 --2- 172.21.15.44:0/3183052045 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f23b00c7cc0 0x7f23b0072e80 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f23a0009870 tx=0x7f23a001c580 comp rx=0 tx=0).stop 2024-04-17T19:48:15.180 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:15.192+0000 7f23b5200640 1 -- 172.21.15.44:0/3183052045 shutdown_connections 2024-04-17T19:48:15.180 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:15.192+0000 7f23b5200640 1 --2- 172.21.15.44:0/3183052045 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f23b00c8e50 0x7f23b00733c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:48:15.180 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:15.192+0000 7f23b5200640 1 --2- 172.21.15.44:0/3183052045 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f23b00c7cc0 0x7f23b0072e80 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:48:15.180 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:15.192+0000 7f23b5200640 1 -- 172.21.15.44:0/3183052045 >> 172.21.15.44:0/3183052045 conn(0x7f23b00c9dc0 msgr2=0x7f23b00ca1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:48:15.180 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:15.192+0000 7f23b5200640 1 -- 172.21.15.44:0/3183052045 shutdown_connections 2024-04-17T19:48:15.180 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:15.192+0000 7f23b5200640 1 -- 172.21.15.44:0/3183052045 wait complete. 2024-04-17T19:48:15.181 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:15.192+0000 7f23b5200640 1 Processor -- start 2024-04-17T19:48:15.181 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:15.192+0000 7f23b5200640 1 -- start start 2024-04-17T19:48:15.185 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:15.196+0000 7f23b5200640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f23b00c47c0 0x7f23b01f8e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:48:15.185 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:15.196+0000 7f23b5200640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f23b00c7cc0 0x7f23b015bcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:48:15.185 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:15.196+0000 7f23b5200640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f23b00c8e50 0x7f23b00cba70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:48:15.185 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:15.196+0000 7f23b5200640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f23b0168ef0 con 0x7f23b00c8e50 2024-04-17T19:48:15.185 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:15.196+0000 7f23b5200640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f23b0168d70 con 0x7f23b00c47c0 2024-04-17T19:48:15.185 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:15.196+0000 7f23b5200640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7f23b0169070 con 0x7f23b00c7cc0 2024-04-17T19:48:15.185 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:15.196+0000 7f23a7e00640 1 -- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f23b00c7cc0 msgr2=0x7f23b015bcb0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.62:3301/0 2024-04-17T19:48:15.185 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:15.196+0000 7f23a7e00640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f23b00c7cc0 0x7f23b015bcb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-17T19:48:15.185 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:15.196+0000 7f23ae800640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f23b00c8e50 0x7f23b00cba70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:48:15.185 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:15.196+0000 7f23ae800640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f23b00c8e50 0x7f23b00cba70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:38378/0 (socket says 172.21.15.44:38378) 2024-04-17T19:48:15.186 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:15.196+0000 7f23ae800640 1 -- 172.21.15.44:0/3204373039 learned_addr learned my addr 172.21.15.44:0/3204373039 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-04-17T19:48:15.186 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:15.196+0000 7f23ade00640 1 --2- 172.21.15.44:0/3204373039 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f23b00c47c0 0x7f23b01f8e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:48:15.186 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:15.196+0000 7f23ae800640 1 -- 172.21.15.44:0/3204373039 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f23b00c7cc0 msgr2=0x7f23b015bcb0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-17T19:48:15.186 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:15.196+0000 7f23ae800640 1 --2- 172.21.15.44:0/3204373039 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f23b00c7cc0 0x7f23b015bcb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:48:15.186 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:15.196+0000 7f23ae800640 1 -- 172.21.15.44:0/3204373039 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f23b00c47c0 msgr2=0x7f23b01f8e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:48:15.186 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:15.196+0000 7f23ae800640 1 --2- 172.21.15.44:0/3204373039 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f23b00c47c0 0x7f23b01f8e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:48:15.186 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:15.196+0000 7f23ae800640 1 -- 172.21.15.44:0/3204373039 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f23b015c1f0 con 0x7f23b00c8e50 2024-04-17T19:48:15.186 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:15.196+0000 7f23ae800640 1 --2- 172.21.15.44:0/3204373039 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f23b00c8e50 0x7f23b00cba70 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f23a800ba90 tx=0x7f23a800bf50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:48:15.186 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:15.196+0000 7f23a6000640 1 -- 172.21.15.44:0/3204373039 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23a800cc10 con 0x7f23b00c8e50 2024-04-17T19:48:15.186 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:15.196+0000 7f23a6000640 1 -- 172.21.15.44:0/3204373039 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f23a8010070 con 0x7f23b00c8e50 2024-04-17T19:48:15.186 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:15.196+0000 7f23b5200640 1 -- 172.21.15.44:0/3204373039 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f23b015ac10 con 0x7f23b00c8e50 2024-04-17T19:48:15.187 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:15.196+0000 7f23a6000640 1 -- 172.21.15.44:0/3204373039 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23a8015470 con 0x7f23b00c8e50 2024-04-17T19:48:15.187 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:15.196+0000 7f23b5200640 1 -- 172.21.15.44:0/3204373039 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f23b015b1d0 con 0x7f23b00c8e50 2024-04-17T19:48:15.187 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:15.196+0000 7f23b5200640 1 --2- 172.21.15.44:0/3204373039 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f23b0149be0 0x7f23b01562b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:48:15.187 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:15.196+0000 7f23b5200640 1 -- 172.21.15.44:0/3204373039 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f23b015c6c0 con 0x7f23b0149be0 2024-04-17T19:48:15.188 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:15.196+0000 7f23ade00640 1 --2- 172.21.15.44:0/3204373039 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f23b0149be0 0x7f23b01562b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:48:15.188 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:15.196+0000 7f23ade00640 1 -- 172.21.15.44:0/3204373039 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f23b004ff10 con 0x7f23b0149be0 2024-04-17T19:48:15.189 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:15.196+0000 7f23ade00640 1 --2- 172.21.15.44:0/3204373039 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f23b0149be0 0x7f23b01562b0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f23b0072090 tx=0x7f23a0019320 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:48:15.189 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:15.196+0000 7f23a6000640 1 -- 172.21.15.44:0/3204373039 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23a00be070 con 0x7f23b0149be0 2024-04-17T19:48:15.189 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:15.196+0000 7f23a6000640 1 -- 172.21.15.44:0/3204373039 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f23a8015630 con 0x7f23b00c8e50 2024-04-17T19:48:15.189 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:15.200+0000 7f23a6000640 1 --2- 172.21.15.44:0/3204373039 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f238c0682b0 0x7f238c06a7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:48:15.189 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:15.200+0000 7f23a6000640 1 -- 172.21.15.44:0/3204373039 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6619+0+0 (secure 0 0 0) 0x7f23a8086ed0 con 0x7f23b00c8e50 2024-04-17T19:48:15.189 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:15.200+0000 7f23a6000640 1 -- 172.21.15.44:0/3204373039 <== mon.0 v2:172.21.15.44:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f23a00ada20 con 0x7f23b0149be0 2024-04-17T19:48:15.189 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:15.200+0000 7f23a6000640 1 -- 172.21.15.44:0/3204373039 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f23b0149be0 msgr2=0x7f23b01562b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:48:15.189 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:15.200+0000 7f23a6000640 1 --2- 172.21.15.44:0/3204373039 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f23b0149be0 0x7f23b01562b0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f23b0072090 tx=0x7f23a0019320 comp rx=0 tx=0).stop 2024-04-17T19:48:15.189 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:15.200+0000 7f23a6000640 1 -- 172.21.15.44:0/3204373039 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f23b0149be0 msgr2=0x7f23b01562b0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-04-17T19:48:15.189 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:15.200+0000 7f23a6000640 1 --2- 172.21.15.44:0/3204373039 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f23b0149be0 0x7f23b01562b0 secure :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f23b0072090 tx=0x7f23a0019320 comp rx=0 tx=0).stop 2024-04-17T19:48:15.189 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:15.200+0000 7f23a7e00640 1 --2- 172.21.15.44:0/3204373039 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f238c0682b0 0x7f238c06a7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:48:15.190 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:15.200+0000 7f23a7e00640 1 --2- 172.21.15.44:0/3204373039 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f238c0682b0 0x7f238c06a7c0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f23b0143e10 tx=0x7f2398007a00 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:48:15.194 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:15.204+0000 7f23b5200640 1 --2- 172.21.15.44:0/3204373039 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f23b01581c0 0x7f23b01567f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:48:15.194 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:15.204+0000 7f23b5200640 1 -- 172.21.15.44:0/3204373039 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f23b0158770 con 0x7f23b01581c0 2024-04-17T19:48:15.194 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:15.204+0000 7f23ade00640 1 --2- 172.21.15.44:0/3204373039 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f23b01581c0 0x7f23b01567f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:48:15.194 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:15.204+0000 7f23ade00640 1 -- 172.21.15.44:0/3204373039 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f23b006d450 con 0x7f23b01581c0 2024-04-17T19:48:15.195 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:15.204+0000 7f23ade00640 1 --2- 172.21.15.44:0/3204373039 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f23b01581c0 0x7f23b01567f0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f23b0067c70 tx=0x7f23a0008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:48:15.195 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:15.208+0000 7f23a6000640 1 -- 172.21.15.44:0/3204373039 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23a00b2040 con 0x7f23b01581c0 2024-04-17T19:48:15.195 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:15.208+0000 7f23a6000640 1 -- 172.21.15.44:0/3204373039 <== mon.0 v2:172.21.15.44:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+5190 (secure 0 0 0) 0x7f23a0003b20 con 0x7f23b01581c0 2024-04-17T19:48:15.195 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:15.208+0000 7f23a6000640 1 -- 172.21.15.44:0/3204373039 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f23b01581c0 msgr2=0x7f23b01567f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:48:15.195 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:15.208+0000 7f23a6000640 1 --2- 172.21.15.44:0/3204373039 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f23b01581c0 0x7f23b01567f0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f23b0067c70 tx=0x7f23a0008040 comp rx=0 tx=0).stop 2024-04-17T19:48:15.196 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:15.208+0000 7f23a6000640 1 -- 172.21.15.44:0/3204373039 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f23b01581c0 msgr2=0x7f23b01567f0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-04-17T19:48:15.196 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:15.208+0000 7f23a6000640 1 --2- 172.21.15.44:0/3204373039 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f23b01581c0 0x7f23b01567f0 secure :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f23b0067c70 tx=0x7f23a0008040 comp rx=0 tx=0).stop 2024-04-17T19:48:15.196 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2024-04-17T19:48:15.196 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "a", 2024-04-17T19:48:15.196 INFO:teuthology.orchestra.run.smithi044.stdout: "rank": 0, 2024-04-17T19:48:15.196 INFO:teuthology.orchestra.run.smithi044.stdout: "state": "leader", 2024-04-17T19:48:15.196 INFO:teuthology.orchestra.run.smithi044.stdout: "election_epoch": 6, 2024-04-17T19:48:15.196 INFO:teuthology.orchestra.run.smithi044.stdout: "uptime": 104669, 2024-04-17T19:48:15.197 INFO:teuthology.orchestra.run.smithi044.stdout: "quorum": [ 2024-04-17T19:48:15.197 INFO:teuthology.orchestra.run.smithi044.stdout: 0, 2024-04-17T19:48:15.197 INFO:teuthology.orchestra.run.smithi044.stdout: 1 2024-04-17T19:48:15.197 INFO:teuthology.orchestra.run.smithi044.stdout: ], 2024-04-17T19:48:15.197 INFO:teuthology.orchestra.run.smithi044.stdout: "quorum_age": 0, 2024-04-17T19:48:15.197 INFO:teuthology.orchestra.run.smithi044.stdout: "features": { 2024-04-17T19:48:15.197 INFO:teuthology.orchestra.run.smithi044.stdout: "required_con": "2450521708007866372", 2024-04-17T19:48:15.197 INFO:teuthology.orchestra.run.smithi044.stdout: "required_mon": [ 2024-04-17T19:48:15.197 INFO:teuthology.orchestra.run.smithi044.stdout: "kraken", 2024-04-17T19:48:15.197 INFO:teuthology.orchestra.run.smithi044.stdout: "luminous", 2024-04-17T19:48:15.197 INFO:teuthology.orchestra.run.smithi044.stdout: "mimic", 2024-04-17T19:48:15.197 INFO:teuthology.orchestra.run.smithi044.stdout: "osdmap-prune", 2024-04-17T19:48:15.198 INFO:teuthology.orchestra.run.smithi044.stdout: "nautilus", 2024-04-17T19:48:15.198 INFO:teuthology.orchestra.run.smithi044.stdout: "octopus", 2024-04-17T19:48:15.198 INFO:teuthology.orchestra.run.smithi044.stdout: "pacific", 2024-04-17T19:48:15.198 INFO:teuthology.orchestra.run.smithi044.stdout: "elector-pinging", 2024-04-17T19:48:15.198 INFO:teuthology.orchestra.run.smithi044.stdout: "quincy", 2024-04-17T19:48:15.198 INFO:teuthology.orchestra.run.smithi044.stdout: "reef", 2024-04-17T19:48:15.198 INFO:teuthology.orchestra.run.smithi044.stdout: "squid" 2024-04-17T19:48:15.198 INFO:teuthology.orchestra.run.smithi044.stdout: ], 2024-04-17T19:48:15.198 INFO:teuthology.orchestra.run.smithi044.stdout: "quorum_con": "4540701547738038271", 2024-04-17T19:48:15.198 INFO:teuthology.orchestra.run.smithi044.stdout: "quorum_mon": [ 2024-04-17T19:48:15.198 INFO:teuthology.orchestra.run.smithi044.stdout: "kraken", 2024-04-17T19:48:15.198 INFO:teuthology.orchestra.run.smithi044.stdout: "luminous", 2024-04-17T19:48:15.199 INFO:teuthology.orchestra.run.smithi044.stdout: "mimic", 2024-04-17T19:48:15.199 INFO:teuthology.orchestra.run.smithi044.stdout: "osdmap-prune", 2024-04-17T19:48:15.199 INFO:teuthology.orchestra.run.smithi044.stdout: "nautilus", 2024-04-17T19:48:15.199 INFO:teuthology.orchestra.run.smithi044.stdout: "octopus", 2024-04-17T19:48:15.199 INFO:teuthology.orchestra.run.smithi044.stdout: "pacific", 2024-04-17T19:48:15.199 INFO:teuthology.orchestra.run.smithi044.stdout: "elector-pinging", 2024-04-17T19:48:15.199 INFO:teuthology.orchestra.run.smithi044.stdout: "quincy", 2024-04-17T19:48:15.199 INFO:teuthology.orchestra.run.smithi044.stdout: "reef", 2024-04-17T19:48:15.199 INFO:teuthology.orchestra.run.smithi044.stdout: "squid" 2024-04-17T19:48:15.199 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T19:48:15.199 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T19:48:15.199 INFO:teuthology.orchestra.run.smithi044.stdout: "outside_quorum": [], 2024-04-17T19:48:15.199 INFO:teuthology.orchestra.run.smithi044.stdout: "extra_probe_peers": [], 2024-04-17T19:48:15.200 INFO:teuthology.orchestra.run.smithi044.stdout: "sync_provider": [], 2024-04-17T19:48:15.200 INFO:teuthology.orchestra.run.smithi044.stdout: "monmap": { 2024-04-17T19:48:15.200 INFO:teuthology.orchestra.run.smithi044.stdout: "epoch": 1, 2024-04-17T19:48:15.200 INFO:teuthology.orchestra.run.smithi044.stdout: "fsid": "703f77ca-79c6-4a66-b576-62c526cb1021", 2024-04-17T19:48:15.200 INFO:teuthology.orchestra.run.smithi044.stdout: "modified": "2024-04-17T19:45:55.379749Z", 2024-04-17T19:48:15.200 INFO:teuthology.orchestra.run.smithi044.stdout: "created": "2024-04-17T19:45:55.379749Z", 2024-04-17T19:48:15.200 INFO:teuthology.orchestra.run.smithi044.stdout: "min_mon_release": 19, 2024-04-17T19:48:15.200 INFO:teuthology.orchestra.run.smithi044.stdout: "min_mon_release_name": "squid", 2024-04-17T19:48:15.200 INFO:teuthology.orchestra.run.smithi044.stdout: "election_strategy": 1, 2024-04-17T19:48:15.200 INFO:teuthology.orchestra.run.smithi044.stdout: "disallowed_leaders: ": "", 2024-04-17T19:48:15.200 INFO:teuthology.orchestra.run.smithi044.stdout: "stretch_mode": false, 2024-04-17T19:48:15.200 INFO:teuthology.orchestra.run.smithi044.stdout: "tiebreaker_mon": "", 2024-04-17T19:48:15.200 INFO:teuthology.orchestra.run.smithi044.stdout: "removed_ranks: ": "", 2024-04-17T19:48:15.201 INFO:teuthology.orchestra.run.smithi044.stdout: "features": { 2024-04-17T19:48:15.201 INFO:teuthology.orchestra.run.smithi044.stdout: "persistent": [ 2024-04-17T19:48:15.201 INFO:teuthology.orchestra.run.smithi044.stdout: "kraken", 2024-04-17T19:48:15.201 INFO:teuthology.orchestra.run.smithi044.stdout: "luminous", 2024-04-17T19:48:15.201 INFO:teuthology.orchestra.run.smithi044.stdout: "mimic", 2024-04-17T19:48:15.201 INFO:teuthology.orchestra.run.smithi044.stdout: "osdmap-prune", 2024-04-17T19:48:15.201 INFO:teuthology.orchestra.run.smithi044.stdout: "nautilus", 2024-04-17T19:48:15.201 INFO:teuthology.orchestra.run.smithi044.stdout: "octopus", 2024-04-17T19:48:15.201 INFO:teuthology.orchestra.run.smithi044.stdout: "pacific", 2024-04-17T19:48:15.201 INFO:teuthology.orchestra.run.smithi044.stdout: "elector-pinging", 2024-04-17T19:48:15.201 INFO:teuthology.orchestra.run.smithi044.stdout: "quincy", 2024-04-17T19:48:15.201 INFO:teuthology.orchestra.run.smithi044.stdout: "reef", 2024-04-17T19:48:15.201 INFO:teuthology.orchestra.run.smithi044.stdout: "squid" 2024-04-17T19:48:15.202 INFO:teuthology.orchestra.run.smithi044.stdout: ], 2024-04-17T19:48:15.202 INFO:teuthology.orchestra.run.smithi044.stdout: "optional": [] 2024-04-17T19:48:15.202 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T19:48:15.202 INFO:teuthology.orchestra.run.smithi044.stdout: "mons": [ 2024-04-17T19:48:15.202 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T19:48:15.202 INFO:teuthology.orchestra.run.smithi044.stdout: "rank": 0, 2024-04-17T19:48:15.202 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "a", 2024-04-17T19:48:15.202 INFO:teuthology.orchestra.run.smithi044.stdout: "public_addrs": { 2024-04-17T19:48:15.202 INFO:teuthology.orchestra.run.smithi044.stdout: "addrvec": [ 2024-04-17T19:48:15.202 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T19:48:15.202 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "v2", 2024-04-17T19:48:15.202 INFO:teuthology.orchestra.run.smithi044.stdout: "addr": "172.21.15.44:3300", 2024-04-17T19:48:15.203 INFO:teuthology.orchestra.run.smithi044.stdout: "nonce": 0 2024-04-17T19:48:15.203 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T19:48:15.203 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T19:48:15.203 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "v1", 2024-04-17T19:48:15.203 INFO:teuthology.orchestra.run.smithi044.stdout: "addr": "172.21.15.44:6789", 2024-04-17T19:48:15.203 INFO:teuthology.orchestra.run.smithi044.stdout: "nonce": 0 2024-04-17T19:48:15.203 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T19:48:15.203 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T19:48:15.203 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T19:48:15.203 INFO:teuthology.orchestra.run.smithi044.stdout: "addr": "172.21.15.44:6789/0", 2024-04-17T19:48:15.203 INFO:teuthology.orchestra.run.smithi044.stdout: "public_addr": "172.21.15.44:6789/0", 2024-04-17T19:48:15.203 INFO:teuthology.orchestra.run.smithi044.stdout: "priority": 0, 2024-04-17T19:48:15.204 INFO:teuthology.orchestra.run.smithi044.stdout: "weight": 0, 2024-04-17T19:48:15.204 INFO:teuthology.orchestra.run.smithi044.stdout: "crush_location": "{}" 2024-04-17T19:48:15.204 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T19:48:15.204 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T19:48:15.204 INFO:teuthology.orchestra.run.smithi044.stdout: "rank": 1, 2024-04-17T19:48:15.204 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "b", 2024-04-17T19:48:15.204 INFO:teuthology.orchestra.run.smithi044.stdout: "public_addrs": { 2024-04-17T19:48:15.204 INFO:teuthology.orchestra.run.smithi044.stdout: "addrvec": [ 2024-04-17T19:48:15.204 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T19:48:15.204 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "v2", 2024-04-17T19:48:15.204 INFO:teuthology.orchestra.run.smithi044.stdout: "addr": "172.21.15.62:3300", 2024-04-17T19:48:15.204 INFO:teuthology.orchestra.run.smithi044.stdout: "nonce": 0 2024-04-17T19:48:15.204 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T19:48:15.205 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T19:48:15.205 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "v1", 2024-04-17T19:48:15.205 INFO:teuthology.orchestra.run.smithi044.stdout: "addr": "172.21.15.62:6789", 2024-04-17T19:48:15.205 INFO:teuthology.orchestra.run.smithi044.stdout: "nonce": 0 2024-04-17T19:48:15.205 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T19:48:15.205 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T19:48:15.205 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T19:48:15.205 INFO:teuthology.orchestra.run.smithi044.stdout: "addr": "172.21.15.62:6789/0", 2024-04-17T19:48:15.205 INFO:teuthology.orchestra.run.smithi044.stdout: "public_addr": "172.21.15.62:6789/0", 2024-04-17T19:48:15.205 INFO:teuthology.orchestra.run.smithi044.stdout: "priority": 0, 2024-04-17T19:48:15.205 INFO:teuthology.orchestra.run.smithi044.stdout: "weight": 0, 2024-04-17T19:48:15.205 INFO:teuthology.orchestra.run.smithi044.stdout: "crush_location": "{}" 2024-04-17T19:48:15.206 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T19:48:15.206 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T19:48:15.206 INFO:teuthology.orchestra.run.smithi044.stdout: "rank": 2, 2024-04-17T19:48:15.206 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "c", 2024-04-17T19:48:15.206 INFO:teuthology.orchestra.run.smithi044.stdout: "public_addrs": { 2024-04-17T19:48:15.206 INFO:teuthology.orchestra.run.smithi044.stdout: "addrvec": [ 2024-04-17T19:48:15.206 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T19:48:15.206 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "v2", 2024-04-17T19:48:15.206 INFO:teuthology.orchestra.run.smithi044.stdout: "addr": "172.21.15.62:3301", 2024-04-17T19:48:15.206 INFO:teuthology.orchestra.run.smithi044.stdout: "nonce": 0 2024-04-17T19:48:15.207 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T19:48:15.207 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T19:48:15.207 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "v1", 2024-04-17T19:48:15.207 INFO:teuthology.orchestra.run.smithi044.stdout: "addr": "172.21.15.62:6790", 2024-04-17T19:48:15.207 INFO:teuthology.orchestra.run.smithi044.stdout: "nonce": 0 2024-04-17T19:48:15.207 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T19:48:15.207 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T19:48:15.207 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T19:48:15.207 INFO:teuthology.orchestra.run.smithi044.stdout: "addr": "172.21.15.62:6790/0", 2024-04-17T19:48:15.207 INFO:teuthology.orchestra.run.smithi044.stdout: "public_addr": "172.21.15.62:6790/0", 2024-04-17T19:48:15.207 INFO:teuthology.orchestra.run.smithi044.stdout: "priority": 0, 2024-04-17T19:48:15.207 INFO:teuthology.orchestra.run.smithi044.stdout: "weight": 0, 2024-04-17T19:48:15.208 INFO:teuthology.orchestra.run.smithi044.stdout: "crush_location": "{}" 2024-04-17T19:48:15.208 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T19:48:15.208 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T19:48:15.208 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T19:48:15.208 INFO:teuthology.orchestra.run.smithi044.stdout: "feature_map": { 2024-04-17T19:48:15.208 INFO:teuthology.orchestra.run.smithi044.stdout: "mon": [ 2024-04-17T19:48:15.208 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T19:48:15.208 INFO:teuthology.orchestra.run.smithi044.stdout: "features": "0x3f03cffffffdffff", 2024-04-17T19:48:15.208 INFO:teuthology.orchestra.run.smithi044.stdout: "release": "luminous", 2024-04-17T19:48:15.208 INFO:teuthology.orchestra.run.smithi044.stdout: "num": 1 2024-04-17T19:48:15.208 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T19:48:15.208 INFO:teuthology.orchestra.run.smithi044.stdout: ], 2024-04-17T19:48:15.209 INFO:teuthology.orchestra.run.smithi044.stdout: "mds": [ 2024-04-17T19:48:15.209 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T19:48:15.209 INFO:teuthology.orchestra.run.smithi044.stdout: "features": "0x3f03cffffffdffff", 2024-04-17T19:48:15.209 INFO:teuthology.orchestra.run.smithi044.stdout: "release": "luminous", 2024-04-17T19:48:15.209 INFO:teuthology.orchestra.run.smithi044.stdout: "num": 4 2024-04-17T19:48:15.209 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T19:48:15.209 INFO:teuthology.orchestra.run.smithi044.stdout: ], 2024-04-17T19:48:15.209 INFO:teuthology.orchestra.run.smithi044.stdout: "osd": [ 2024-04-17T19:48:15.209 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T19:48:15.209 INFO:teuthology.orchestra.run.smithi044.stdout: "features": "0x3f03cffffffdffff", 2024-04-17T19:48:15.209 INFO:teuthology.orchestra.run.smithi044.stdout: "release": "luminous", 2024-04-17T19:48:15.209 INFO:teuthology.orchestra.run.smithi044.stdout: "num": 4 2024-04-17T19:48:15.210 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T19:48:15.210 INFO:teuthology.orchestra.run.smithi044.stdout: ], 2024-04-17T19:48:15.210 INFO:teuthology.orchestra.run.smithi044.stdout: "client": [ 2024-04-17T19:48:15.210 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T19:48:15.210 INFO:teuthology.orchestra.run.smithi044.stdout: "features": "0x2f018fb87aa4aafe", 2024-04-17T19:48:15.210 INFO:teuthology.orchestra.run.smithi044.stdout: "release": "luminous", 2024-04-17T19:48:15.210 INFO:teuthology.orchestra.run.smithi044.stdout: "num": 1 2024-04-17T19:48:15.210 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T19:48:15.210 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T19:48:15.210 INFO:teuthology.orchestra.run.smithi044.stdout: "features": "0x3f03cffffffdffff", 2024-04-17T19:48:15.210 INFO:teuthology.orchestra.run.smithi044.stdout: "release": "luminous", 2024-04-17T19:48:15.210 INFO:teuthology.orchestra.run.smithi044.stdout: "num": 3 2024-04-17T19:48:15.211 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T19:48:15.211 INFO:teuthology.orchestra.run.smithi044.stdout: ], 2024-04-17T19:48:15.211 INFO:teuthology.orchestra.run.smithi044.stdout: "mgr": [ 2024-04-17T19:48:15.211 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T19:48:15.211 INFO:teuthology.orchestra.run.smithi044.stdout: "features": "0x3f03cffffffdffff", 2024-04-17T19:48:15.211 INFO:teuthology.orchestra.run.smithi044.stdout: "release": "luminous", 2024-04-17T19:48:15.211 INFO:teuthology.orchestra.run.smithi044.stdout: "num": 1 2024-04-17T19:48:15.211 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T19:48:15.211 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T19:48:15.211 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T19:48:15.211 INFO:teuthology.orchestra.run.smithi044.stdout: "stretch_mode": false 2024-04-17T19:48:15.211 INFO:teuthology.orchestra.run.smithi044.stdout:} 2024-04-17T19:48:15.212 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:15.208+0000 7f23b5200640 1 -- 172.21.15.44:0/3204373039 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f238c0682b0 msgr2=0x7f238c06a7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:48:15.212 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:15.208+0000 7f23b5200640 1 --2- 172.21.15.44:0/3204373039 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f238c0682b0 0x7f238c06a7c0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f23b0143e10 tx=0x7f2398007a00 comp rx=0 tx=0).stop 2024-04-17T19:48:15.212 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:15.208+0000 7f23b5200640 1 -- 172.21.15.44:0/3204373039 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f23b00c8e50 msgr2=0x7f23b00cba70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:48:15.212 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:15.208+0000 7f23ae800640 1 -- 172.21.15.44:0/3204373039 reap_dead start 2024-04-17T19:48:15.213 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:15.208+0000 7f23b5200640 1 --2- 172.21.15.44:0/3204373039 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f23b00c8e50 0x7f23b00cba70 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f23a800ba90 tx=0x7f23a800bf50 comp rx=0 tx=0).stop 2024-04-17T19:48:15.213 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:15.208+0000 7f23b5200640 1 -- 172.21.15.44:0/3204373039 shutdown_connections 2024-04-17T19:48:15.213 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:15.208+0000 7f23b5200640 1 --2- 172.21.15.44:0/3204373039 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f23b00c8e50 0x7f23b00cba70 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:48:15.213 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:15.208+0000 7f23b5200640 1 -- 172.21.15.44:0/3204373039 >> 172.21.15.44:0/3204373039 conn(0x7f23b00c9dc0 msgr2=0x7f23b0153500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:48:15.213 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:15.208+0000 7f23b5200640 1 -- 172.21.15.44:0/3204373039 shutdown_connections 2024-04-17T19:48:15.213 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:15.208+0000 7f23b5200640 1 -- 172.21.15.44:0/3204373039 wait complete. 2024-04-17T19:48:15.214 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 2 2024-04-17T19:48:15.214 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 2 for mon b 2024-04-17T19:48:15.214 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2024-04-17T19:48:15.367 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:15.380+0000 7f4986800640 1 Processor -- start 2024-04-17T19:48:15.367 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:15.380+0000 7f4986800640 1 -- start start 2024-04-17T19:48:15.369 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:15.380+0000 7f4986800640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f49800c7cc0 0x7f4980072e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:48:15.369 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:15.380+0000 7f4986800640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f49800c47c0 0x7f49800733c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:48:15.369 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:15.380+0000 7f4986800640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4980073f90 con 0x7f49800c8740 2024-04-17T19:48:15.369 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:15.380+0000 7f4986800640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 -- 0x7f4980074270 con 0x7f49800c7cc0 2024-04-17T19:48:15.369 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:15.380+0000 7f4986800640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 -- 0x7f49800c94d0 con 0x7f49800c47c0 2024-04-17T19:48:15.369 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:15.380+0000 7f497f400640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f49800c7cc0 0x7f4980072e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:48:15.369 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:15.380+0000 7f497f400640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f49800c7cc0 0x7f4980072e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:52168/0 (socket says 172.21.15.44:52168) 2024-04-17T19:48:15.369 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:15.380+0000 7f497f400640 1 -- 172.21.15.44:0/4231032769 learned_addr learned my addr 172.21.15.44:0/4231032769 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-04-17T19:48:15.369 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:15.380+0000 7f4977e00640 1 --2- 172.21.15.44:0/4231032769 >> v2:172.21.15.62:3300/0 conn(0x7f49800c47c0 0x7f49800733c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:48:15.370 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:15.380+0000 7f497f400640 1 -- 172.21.15.44:0/4231032769 >> v2:172.21.15.62:3300/0 conn(0x7f49800c47c0 msgr2=0x7f49800733c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T19:48:15.370 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:15.380+0000 7f497f400640 1 --2- 172.21.15.44:0/4231032769 >> v2:172.21.15.62:3300/0 conn(0x7f49800c47c0 0x7f49800733c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:48:15.370 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:15.380+0000 7f497f400640 1 -- 172.21.15.44:0/4231032769 >> v1:172.21.15.62:6789/0 conn(0x7f49800c8740 legacy=0x7f49800c8b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:48:15.370 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:15.380+0000 7f497f400640 1 -- 172.21.15.44:0/4231032769 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f49800c97b0 con 0x7f49800c7cc0 2024-04-17T19:48:15.372 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:15.384+0000 7f497f400640 1 --2- 172.21.15.44:0/4231032769 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f49800c7cc0 0x7f4980072e80 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f4980072090 tx=0x7f497001c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3d567278f791c431 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:48:15.372 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:15.384+0000 7f497ea00640 1 -- 172.21.15.44:0/4231032769 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49700b0070 con 0x7f49800c7cc0 2024-04-17T19:48:15.372 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:15.384+0000 7f497ea00640 1 -- 172.21.15.44:0/4231032769 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f49700ab600 con 0x7f49800c7cc0 2024-04-17T19:48:15.372 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:15.384+0000 7f497ea00640 1 -- 172.21.15.44:0/4231032769 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49700ab9d0 con 0x7f49800c7cc0 2024-04-17T19:48:15.373 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:15.384+0000 7f4986800640 1 -- 172.21.15.44:0/4231032769 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f49800c7cc0 msgr2=0x7f4980072e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:48:15.373 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:15.384+0000 7f4986800640 1 --2- 172.21.15.44:0/4231032769 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f49800c7cc0 0x7f4980072e80 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f4980072090 tx=0x7f497001c520 comp rx=0 tx=0).stop 2024-04-17T19:48:15.373 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:15.384+0000 7f4986800640 1 -- 172.21.15.44:0/4231032769 shutdown_connections 2024-04-17T19:48:15.373 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:15.384+0000 7f4986800640 1 --2- 172.21.15.44:0/4231032769 >> v2:172.21.15.62:3300/0 conn(0x7f49800c47c0 0x7f49800733c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:48:15.374 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:15.384+0000 7f4986800640 1 --2- 172.21.15.44:0/4231032769 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f49800c7cc0 0x7f4980072e80 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:48:15.374 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:15.384+0000 7f4986800640 1 -- 172.21.15.44:0/4231032769 >> 172.21.15.44:0/4231032769 conn(0x7f49800c9dc0 msgr2=0x7f49800ca1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:48:15.374 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:15.384+0000 7f4986800640 1 -- 172.21.15.44:0/4231032769 shutdown_connections 2024-04-17T19:48:15.374 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:15.384+0000 7f4986800640 1 -- 172.21.15.44:0/4231032769 wait complete. 2024-04-17T19:48:15.375 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:15.388+0000 7f4986800640 1 Processor -- start 2024-04-17T19:48:15.375 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:15.388+0000 7f4986800640 1 -- start start 2024-04-17T19:48:15.377 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:15.388+0000 7f4986800640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f49800c47c0 0x7f49801575d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:48:15.377 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:15.388+0000 7f4986800640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f49800c7cc0 0x7f49801f89c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:48:15.377 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:15.388+0000 7f4986800640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f49800c8740 0x7f4980145650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:48:15.377 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:15.388+0000 7f4986800640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f4980168ef0 con 0x7f49800c8740 2024-04-17T19:48:15.377 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:15.388+0000 7f4986800640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f4980168d70 con 0x7f49800c47c0 2024-04-17T19:48:15.377 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:15.388+0000 7f4986800640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7f4980169070 con 0x7f49800c7cc0 2024-04-17T19:48:15.377 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:15.388+0000 7f4977e00640 1 -- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f49800c7cc0 msgr2=0x7f49801f89c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.62:3301/0 2024-04-17T19:48:15.378 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:15.388+0000 7f4977e00640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f49800c7cc0 0x7f49801f89c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-17T19:48:15.378 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:15.388+0000 7f497fe00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f49800c8740 0x7f4980145650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:48:15.378 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:15.388+0000 7f497fe00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f49800c8740 0x7f4980145650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:52182/0 (socket says 172.21.15.44:52182) 2024-04-17T19:48:15.378 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:15.388+0000 7f497fe00640 1 -- 172.21.15.44:0/748937809 learned_addr learned my addr 172.21.15.44:0/748937809 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-04-17T19:48:15.378 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:15.388+0000 7f497f400640 1 --2- 172.21.15.44:0/748937809 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f49800c47c0 0x7f49801575d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:48:15.379 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:15.388+0000 7f497fe00640 1 -- 172.21.15.44:0/748937809 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f49800c7cc0 msgr2=0x7f49801f89c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-17T19:48:15.379 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:15.388+0000 7f497fe00640 1 --2- 172.21.15.44:0/748937809 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f49800c7cc0 0x7f49801f89c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:48:15.379 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:15.388+0000 7f497fe00640 1 -- 172.21.15.44:0/748937809 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f49800c47c0 msgr2=0x7f49801575d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:48:15.379 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:15.388+0000 7f497fe00640 1 --2- 172.21.15.44:0/748937809 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f49800c47c0 0x7f49801575d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:48:15.380 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:15.388+0000 7f497fe00640 1 -- 172.21.15.44:0/748937809 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4980157b10 con 0x7f49800c8740 2024-04-17T19:48:15.380 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:15.388+0000 7f497fe00640 1 --2- 172.21.15.44:0/748937809 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f49800c8740 0x7f4980145650 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f497800c760 tx=0x7f497800cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:48:15.380 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:15.388+0000 7f4977400640 1 -- 172.21.15.44:0/748937809 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4978003b80 con 0x7f49800c8740 2024-04-17T19:48:15.380 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:15.388+0000 7f4977400640 1 -- 172.21.15.44:0/748937809 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4978003d20 con 0x7f49800c8740 2024-04-17T19:48:15.380 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:15.388+0000 7f4977400640 1 -- 172.21.15.44:0/748937809 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f497800aa90 con 0x7f49800c8740 2024-04-17T19:48:15.380 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:15.388+0000 7f4986800640 1 -- 172.21.15.44:0/748937809 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f49801f9320 con 0x7f49800c8740 2024-04-17T19:48:15.380 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:15.388+0000 7f4986800640 1 -- 172.21.15.44:0/748937809 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f498014fea0 con 0x7f49800c8740 2024-04-17T19:48:15.380 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:15.392+0000 7f4986800640 1 --2- 172.21.15.44:0/748937809 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4980157ce0 0x7f4980145b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:48:15.380 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:15.392+0000 7f4986800640 1 -- 172.21.15.44:0/748937809 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f4980157030 con 0x7f4980157ce0 2024-04-17T19:48:15.380 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:15.392+0000 7f497f400640 1 --2- 172.21.15.44:0/748937809 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4980157ce0 0x7f4980145b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:48:15.381 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:15.392+0000 7f4977400640 1 -- 172.21.15.44:0/748937809 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f497800ac30 con 0x7f49800c8740 2024-04-17T19:48:15.381 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:15.392+0000 7f497f400640 1 -- 172.21.15.44:0/748937809 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f498004ff10 con 0x7f4980157ce0 2024-04-17T19:48:15.382 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:15.392+0000 7f497f400640 1 --2- 172.21.15.44:0/748937809 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4980157ce0 0x7f4980145b90 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f49800cd250 tx=0x7f497001ad60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:48:15.382 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:15.392+0000 7f4977400640 1 --2- 172.21.15.44:0/748937809 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f495c068360 0x7f495c06a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:48:15.382 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:15.392+0000 7f4977400640 1 -- 172.21.15.44:0/748937809 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6619+0+0 (secure 0 0 0) 0x7f4978086af0 con 0x7f49800c8740 2024-04-17T19:48:15.382 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:15.392+0000 7f4977400640 1 -- 172.21.15.44:0/748937809 <== mon.1 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49700bb030 con 0x7f4980157ce0 2024-04-17T19:48:15.382 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:15.392+0000 7f4977e00640 1 --2- 172.21.15.44:0/748937809 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f495c068360 0x7f495c06a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:48:15.383 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:15.392+0000 7f4977400640 1 -- 172.21.15.44:0/748937809 <== mon.1 v2:172.21.15.62:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f49700b6470 con 0x7f4980157ce0 2024-04-17T19:48:15.383 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:15.392+0000 7f4977400640 1 -- 172.21.15.44:0/748937809 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4980157ce0 msgr2=0x7f4980145b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:48:15.383 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:15.392+0000 7f4977400640 1 --2- 172.21.15.44:0/748937809 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4980157ce0 0x7f4980145b90 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f49800cd250 tx=0x7f497001ad60 comp rx=0 tx=0).stop 2024-04-17T19:48:15.383 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:15.392+0000 7f4977400640 1 -- 172.21.15.44:0/748937809 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4980157ce0 msgr2=0x7f4980145b90 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-04-17T19:48:15.383 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:15.392+0000 7f4977400640 1 --2- 172.21.15.44:0/748937809 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4980157ce0 0x7f4980145b90 secure :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f49800cd250 tx=0x7f497001ad60 comp rx=0 tx=0).stop 2024-04-17T19:48:15.383 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:15.396+0000 7f4977e00640 1 --2- 172.21.15.44:0/748937809 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f495c068360 0x7f495c06a870 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f4968006f40 tx=0x7f4968008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:48:15.388 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:15.400+0000 7f4986800640 1 --2- 172.21.15.44:0/748937809 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f498015f610 0x7f49801f5280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:48:15.388 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:15.400+0000 7f4986800640 1 -- 172.21.15.44:0/748937809 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f4980166120 con 0x7f498015f610 2024-04-17T19:48:15.388 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:15.400+0000 7f497f400640 1 --2- 172.21.15.44:0/748937809 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f498015f610 0x7f49801f5280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:48:15.389 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:15.400+0000 7f497f400640 1 -- 172.21.15.44:0/748937809 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f498006d450 con 0x7f498015f610 2024-04-17T19:48:15.389 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:15.400+0000 7f497f400640 1 --2- 172.21.15.44:0/748937809 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f498015f610 0x7f49801f5280 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f497001abd0 tx=0x7f49700192c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:48:15.390 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:15.400+0000 7f4977400640 1 -- 172.21.15.44:0/748937809 <== mon.1 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49700bb040 con 0x7f498015f610 2024-04-17T19:48:15.391 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:15.404+0000 7f4977400640 1 -- 172.21.15.44:0/748937809 <== mon.1 v2:172.21.15.62:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+5045 (secure 0 0 0) 0x7f49700b6ce0 con 0x7f498015f610 2024-04-17T19:48:15.391 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:15.404+0000 7f4977400640 1 -- 172.21.15.44:0/748937809 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f498015f610 msgr2=0x7f49801f5280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:48:15.391 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:15.404+0000 7f4977400640 1 --2- 172.21.15.44:0/748937809 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f498015f610 0x7f49801f5280 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f497001abd0 tx=0x7f49700192c0 comp rx=0 tx=0).stop 2024-04-17T19:48:15.391 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:15.404+0000 7f4977400640 1 -- 172.21.15.44:0/748937809 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f498015f610 msgr2=0x7f49801f5280 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-04-17T19:48:15.391 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:15.404+0000 7f4977400640 1 --2- 172.21.15.44:0/748937809 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f498015f610 0x7f49801f5280 secure :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f497001abd0 tx=0x7f49700192c0 comp rx=0 tx=0).stop 2024-04-17T19:48:15.391 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2024-04-17T19:48:15.392 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "b", 2024-04-17T19:48:15.392 INFO:teuthology.orchestra.run.smithi044.stdout: "rank": 1, 2024-04-17T19:48:15.392 INFO:teuthology.orchestra.run.smithi044.stdout: "state": "peon", 2024-04-17T19:48:15.392 INFO:teuthology.orchestra.run.smithi044.stdout: "election_epoch": 6, 2024-04-17T19:48:15.392 INFO:teuthology.orchestra.run.smithi044.stdout: "uptime": 104833, 2024-04-17T19:48:15.392 INFO:teuthology.orchestra.run.smithi044.stdout: "quorum": [ 2024-04-17T19:48:15.392 INFO:teuthology.orchestra.run.smithi044.stdout: 0, 2024-04-17T19:48:15.392 INFO:teuthology.orchestra.run.smithi044.stdout: 1 2024-04-17T19:48:15.392 INFO:teuthology.orchestra.run.smithi044.stdout: ], 2024-04-17T19:48:15.392 INFO:teuthology.orchestra.run.smithi044.stdout: "quorum_age": 0, 2024-04-17T19:48:15.392 INFO:teuthology.orchestra.run.smithi044.stdout: "features": { 2024-04-17T19:48:15.392 INFO:teuthology.orchestra.run.smithi044.stdout: "required_con": "2450521708007866372", 2024-04-17T19:48:15.392 INFO:teuthology.orchestra.run.smithi044.stdout: "required_mon": [ 2024-04-17T19:48:15.393 INFO:teuthology.orchestra.run.smithi044.stdout: "kraken", 2024-04-17T19:48:15.393 INFO:teuthology.orchestra.run.smithi044.stdout: "luminous", 2024-04-17T19:48:15.393 INFO:teuthology.orchestra.run.smithi044.stdout: "mimic", 2024-04-17T19:48:15.393 INFO:teuthology.orchestra.run.smithi044.stdout: "osdmap-prune", 2024-04-17T19:48:15.393 INFO:teuthology.orchestra.run.smithi044.stdout: "nautilus", 2024-04-17T19:48:15.393 INFO:teuthology.orchestra.run.smithi044.stdout: "octopus", 2024-04-17T19:48:15.393 INFO:teuthology.orchestra.run.smithi044.stdout: "pacific", 2024-04-17T19:48:15.393 INFO:teuthology.orchestra.run.smithi044.stdout: "elector-pinging", 2024-04-17T19:48:15.393 INFO:teuthology.orchestra.run.smithi044.stdout: "quincy", 2024-04-17T19:48:15.393 INFO:teuthology.orchestra.run.smithi044.stdout: "reef", 2024-04-17T19:48:15.393 INFO:teuthology.orchestra.run.smithi044.stdout: "squid" 2024-04-17T19:48:15.393 INFO:teuthology.orchestra.run.smithi044.stdout: ], 2024-04-17T19:48:15.393 INFO:teuthology.orchestra.run.smithi044.stdout: "quorum_con": "4540701547738038271", 2024-04-17T19:48:15.393 INFO:teuthology.orchestra.run.smithi044.stdout: "quorum_mon": [ 2024-04-17T19:48:15.394 INFO:teuthology.orchestra.run.smithi044.stdout: "kraken", 2024-04-17T19:48:15.394 INFO:teuthology.orchestra.run.smithi044.stdout: "luminous", 2024-04-17T19:48:15.394 INFO:teuthology.orchestra.run.smithi044.stdout: "mimic", 2024-04-17T19:48:15.394 INFO:teuthology.orchestra.run.smithi044.stdout: "osdmap-prune", 2024-04-17T19:48:15.394 INFO:teuthology.orchestra.run.smithi044.stdout: "nautilus", 2024-04-17T19:48:15.394 INFO:teuthology.orchestra.run.smithi044.stdout: "octopus", 2024-04-17T19:48:15.394 INFO:teuthology.orchestra.run.smithi044.stdout: "pacific", 2024-04-17T19:48:15.394 INFO:teuthology.orchestra.run.smithi044.stdout: "elector-pinging", 2024-04-17T19:48:15.394 INFO:teuthology.orchestra.run.smithi044.stdout: "quincy", 2024-04-17T19:48:15.394 INFO:teuthology.orchestra.run.smithi044.stdout: "reef", 2024-04-17T19:48:15.394 INFO:teuthology.orchestra.run.smithi044.stdout: "squid" 2024-04-17T19:48:15.394 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T19:48:15.394 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T19:48:15.395 INFO:teuthology.orchestra.run.smithi044.stdout: "outside_quorum": [], 2024-04-17T19:48:15.395 INFO:teuthology.orchestra.run.smithi044.stdout: "extra_probe_peers": [], 2024-04-17T19:48:15.395 INFO:teuthology.orchestra.run.smithi044.stdout: "sync_provider": [], 2024-04-17T19:48:15.395 INFO:teuthology.orchestra.run.smithi044.stdout: "monmap": { 2024-04-17T19:48:15.395 INFO:teuthology.orchestra.run.smithi044.stdout: "epoch": 1, 2024-04-17T19:48:15.395 INFO:teuthology.orchestra.run.smithi044.stdout: "fsid": "703f77ca-79c6-4a66-b576-62c526cb1021", 2024-04-17T19:48:15.395 INFO:teuthology.orchestra.run.smithi044.stdout: "modified": "2024-04-17T19:45:55.379749Z", 2024-04-17T19:48:15.395 INFO:teuthology.orchestra.run.smithi044.stdout: "created": "2024-04-17T19:45:55.379749Z", 2024-04-17T19:48:15.395 INFO:teuthology.orchestra.run.smithi044.stdout: "min_mon_release": 19, 2024-04-17T19:48:15.395 INFO:teuthology.orchestra.run.smithi044.stdout: "min_mon_release_name": "squid", 2024-04-17T19:48:15.395 INFO:teuthology.orchestra.run.smithi044.stdout: "election_strategy": 1, 2024-04-17T19:48:15.395 INFO:teuthology.orchestra.run.smithi044.stdout: "disallowed_leaders: ": "", 2024-04-17T19:48:15.395 INFO:teuthology.orchestra.run.smithi044.stdout: "stretch_mode": false, 2024-04-17T19:48:15.396 INFO:teuthology.orchestra.run.smithi044.stdout: "tiebreaker_mon": "", 2024-04-17T19:48:15.396 INFO:teuthology.orchestra.run.smithi044.stdout: "removed_ranks: ": "", 2024-04-17T19:48:15.396 INFO:teuthology.orchestra.run.smithi044.stdout: "features": { 2024-04-17T19:48:15.396 INFO:teuthology.orchestra.run.smithi044.stdout: "persistent": [ 2024-04-17T19:48:15.396 INFO:teuthology.orchestra.run.smithi044.stdout: "kraken", 2024-04-17T19:48:15.396 INFO:teuthology.orchestra.run.smithi044.stdout: "luminous", 2024-04-17T19:48:15.396 INFO:teuthology.orchestra.run.smithi044.stdout: "mimic", 2024-04-17T19:48:15.396 INFO:teuthology.orchestra.run.smithi044.stdout: "osdmap-prune", 2024-04-17T19:48:15.396 INFO:teuthology.orchestra.run.smithi044.stdout: "nautilus", 2024-04-17T19:48:15.396 INFO:teuthology.orchestra.run.smithi044.stdout: "octopus", 2024-04-17T19:48:15.396 INFO:teuthology.orchestra.run.smithi044.stdout: "pacific", 2024-04-17T19:48:15.396 INFO:teuthology.orchestra.run.smithi044.stdout: "elector-pinging", 2024-04-17T19:48:15.396 INFO:teuthology.orchestra.run.smithi044.stdout: "quincy", 2024-04-17T19:48:15.397 INFO:teuthology.orchestra.run.smithi044.stdout: "reef", 2024-04-17T19:48:15.397 INFO:teuthology.orchestra.run.smithi044.stdout: "squid" 2024-04-17T19:48:15.397 INFO:teuthology.orchestra.run.smithi044.stdout: ], 2024-04-17T19:48:15.397 INFO:teuthology.orchestra.run.smithi044.stdout: "optional": [] 2024-04-17T19:48:15.397 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T19:48:15.397 INFO:teuthology.orchestra.run.smithi044.stdout: "mons": [ 2024-04-17T19:48:15.397 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T19:48:15.397 INFO:teuthology.orchestra.run.smithi044.stdout: "rank": 0, 2024-04-17T19:48:15.397 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "a", 2024-04-17T19:48:15.397 INFO:teuthology.orchestra.run.smithi044.stdout: "public_addrs": { 2024-04-17T19:48:15.397 INFO:teuthology.orchestra.run.smithi044.stdout: "addrvec": [ 2024-04-17T19:48:15.397 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T19:48:15.397 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "v2", 2024-04-17T19:48:15.397 INFO:teuthology.orchestra.run.smithi044.stdout: "addr": "172.21.15.44:3300", 2024-04-17T19:48:15.398 INFO:teuthology.orchestra.run.smithi044.stdout: "nonce": 0 2024-04-17T19:48:15.398 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T19:48:15.398 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T19:48:15.398 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "v1", 2024-04-17T19:48:15.398 INFO:teuthology.orchestra.run.smithi044.stdout: "addr": "172.21.15.44:6789", 2024-04-17T19:48:15.398 INFO:teuthology.orchestra.run.smithi044.stdout: "nonce": 0 2024-04-17T19:48:15.398 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T19:48:15.398 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T19:48:15.398 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T19:48:15.398 INFO:teuthology.orchestra.run.smithi044.stdout: "addr": "172.21.15.44:6789/0", 2024-04-17T19:48:15.398 INFO:teuthology.orchestra.run.smithi044.stdout: "public_addr": "172.21.15.44:6789/0", 2024-04-17T19:48:15.398 INFO:teuthology.orchestra.run.smithi044.stdout: "priority": 0, 2024-04-17T19:48:15.398 INFO:teuthology.orchestra.run.smithi044.stdout: "weight": 0, 2024-04-17T19:48:15.399 INFO:teuthology.orchestra.run.smithi044.stdout: "crush_location": "{}" 2024-04-17T19:48:15.399 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T19:48:15.399 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T19:48:15.399 INFO:teuthology.orchestra.run.smithi044.stdout: "rank": 1, 2024-04-17T19:48:15.399 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "b", 2024-04-17T19:48:15.399 INFO:teuthology.orchestra.run.smithi044.stdout: "public_addrs": { 2024-04-17T19:48:15.399 INFO:teuthology.orchestra.run.smithi044.stdout: "addrvec": [ 2024-04-17T19:48:15.399 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T19:48:15.399 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "v2", 2024-04-17T19:48:15.399 INFO:teuthology.orchestra.run.smithi044.stdout: "addr": "172.21.15.62:3300", 2024-04-17T19:48:15.399 INFO:teuthology.orchestra.run.smithi044.stdout: "nonce": 0 2024-04-17T19:48:15.399 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T19:48:15.400 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T19:48:15.400 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "v1", 2024-04-17T19:48:15.400 INFO:teuthology.orchestra.run.smithi044.stdout: "addr": "172.21.15.62:6789", 2024-04-17T19:48:15.400 INFO:teuthology.orchestra.run.smithi044.stdout: "nonce": 0 2024-04-17T19:48:15.400 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T19:48:15.400 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T19:48:15.400 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T19:48:15.400 INFO:teuthology.orchestra.run.smithi044.stdout: "addr": "172.21.15.62:6789/0", 2024-04-17T19:48:15.400 INFO:teuthology.orchestra.run.smithi044.stdout: "public_addr": "172.21.15.62:6789/0", 2024-04-17T19:48:15.400 INFO:teuthology.orchestra.run.smithi044.stdout: "priority": 0, 2024-04-17T19:48:15.400 INFO:teuthology.orchestra.run.smithi044.stdout: "weight": 0, 2024-04-17T19:48:15.400 INFO:teuthology.orchestra.run.smithi044.stdout: "crush_location": "{}" 2024-04-17T19:48:15.400 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T19:48:15.401 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T19:48:15.401 INFO:teuthology.orchestra.run.smithi044.stdout: "rank": 2, 2024-04-17T19:48:15.401 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "c", 2024-04-17T19:48:15.401 INFO:teuthology.orchestra.run.smithi044.stdout: "public_addrs": { 2024-04-17T19:48:15.401 INFO:teuthology.orchestra.run.smithi044.stdout: "addrvec": [ 2024-04-17T19:48:15.401 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T19:48:15.401 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "v2", 2024-04-17T19:48:15.401 INFO:teuthology.orchestra.run.smithi044.stdout: "addr": "172.21.15.62:3301", 2024-04-17T19:48:15.401 INFO:teuthology.orchestra.run.smithi044.stdout: "nonce": 0 2024-04-17T19:48:15.401 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T19:48:15.401 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T19:48:15.401 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "v1", 2024-04-17T19:48:15.401 INFO:teuthology.orchestra.run.smithi044.stdout: "addr": "172.21.15.62:6790", 2024-04-17T19:48:15.401 INFO:teuthology.orchestra.run.smithi044.stdout: "nonce": 0 2024-04-17T19:48:15.402 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T19:48:15.402 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T19:48:15.402 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T19:48:15.402 INFO:teuthology.orchestra.run.smithi044.stdout: "addr": "172.21.15.62:6790/0", 2024-04-17T19:48:15.402 INFO:teuthology.orchestra.run.smithi044.stdout: "public_addr": "172.21.15.62:6790/0", 2024-04-17T19:48:15.402 INFO:teuthology.orchestra.run.smithi044.stdout: "priority": 0, 2024-04-17T19:48:15.402 INFO:teuthology.orchestra.run.smithi044.stdout: "weight": 0, 2024-04-17T19:48:15.402 INFO:teuthology.orchestra.run.smithi044.stdout: "crush_location": "{}" 2024-04-17T19:48:15.402 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T19:48:15.402 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T19:48:15.402 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T19:48:15.403 INFO:teuthology.orchestra.run.smithi044.stdout: "feature_map": { 2024-04-17T19:48:15.403 INFO:teuthology.orchestra.run.smithi044.stdout: "mon": [ 2024-04-17T19:48:15.403 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T19:48:15.403 INFO:teuthology.orchestra.run.smithi044.stdout: "features": "0x3f03cffffffdffff", 2024-04-17T19:48:15.403 INFO:teuthology.orchestra.run.smithi044.stdout: "release": "luminous", 2024-04-17T19:48:15.403 INFO:teuthology.orchestra.run.smithi044.stdout: "num": 1 2024-04-17T19:48:15.403 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T19:48:15.403 INFO:teuthology.orchestra.run.smithi044.stdout: ], 2024-04-17T19:48:15.403 INFO:teuthology.orchestra.run.smithi044.stdout: "mds": [ 2024-04-17T19:48:15.403 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T19:48:15.403 INFO:teuthology.orchestra.run.smithi044.stdout: "features": "0x3f03cffffffdffff", 2024-04-17T19:48:15.403 INFO:teuthology.orchestra.run.smithi044.stdout: "release": "luminous", 2024-04-17T19:48:15.403 INFO:teuthology.orchestra.run.smithi044.stdout: "num": 2 2024-04-17T19:48:15.403 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T19:48:15.404 INFO:teuthology.orchestra.run.smithi044.stdout: ], 2024-04-17T19:48:15.404 INFO:teuthology.orchestra.run.smithi044.stdout: "osd": [ 2024-04-17T19:48:15.404 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T19:48:15.404 INFO:teuthology.orchestra.run.smithi044.stdout: "features": "0x3f03cffffffdffff", 2024-04-17T19:48:15.404 INFO:teuthology.orchestra.run.smithi044.stdout: "release": "luminous", 2024-04-17T19:48:15.404 INFO:teuthology.orchestra.run.smithi044.stdout: "num": 4 2024-04-17T19:48:15.404 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T19:48:15.404 INFO:teuthology.orchestra.run.smithi044.stdout: ], 2024-04-17T19:48:15.404 INFO:teuthology.orchestra.run.smithi044.stdout: "client": [ 2024-04-17T19:48:15.404 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T19:48:15.404 INFO:teuthology.orchestra.run.smithi044.stdout: "features": "0x3f03cffffffdffff", 2024-04-17T19:48:15.404 INFO:teuthology.orchestra.run.smithi044.stdout: "release": "luminous", 2024-04-17T19:48:15.404 INFO:teuthology.orchestra.run.smithi044.stdout: "num": 4 2024-04-17T19:48:15.405 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T19:48:15.405 INFO:teuthology.orchestra.run.smithi044.stdout: ], 2024-04-17T19:48:15.405 INFO:teuthology.orchestra.run.smithi044.stdout: "mgr": [ 2024-04-17T19:48:15.405 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T19:48:15.405 INFO:teuthology.orchestra.run.smithi044.stdout: "features": "0x3f03cffffffdffff", 2024-04-17T19:48:15.405 INFO:teuthology.orchestra.run.smithi044.stdout: "release": "luminous", 2024-04-17T19:48:15.405 INFO:teuthology.orchestra.run.smithi044.stdout: "num": 1 2024-04-17T19:48:15.405 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T19:48:15.405 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T19:48:15.405 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T19:48:15.405 INFO:teuthology.orchestra.run.smithi044.stdout: "stretch_mode": false 2024-04-17T19:48:15.405 INFO:teuthology.orchestra.run.smithi044.stdout:} 2024-04-17T19:48:15.406 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:15.404+0000 7f4986800640 1 -- 172.21.15.44:0/748937809 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f495c068360 msgr2=0x7f495c06a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:48:15.406 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:15.404+0000 7f4986800640 1 --2- 172.21.15.44:0/748937809 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f495c068360 0x7f495c06a870 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f4968006f40 tx=0x7f4968008040 comp rx=0 tx=0).stop 2024-04-17T19:48:15.406 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:15.404+0000 7f4986800640 1 -- 172.21.15.44:0/748937809 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f49800c8740 msgr2=0x7f4980145650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:48:15.406 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:15.404+0000 7f4986800640 1 --2- 172.21.15.44:0/748937809 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f49800c8740 0x7f4980145650 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f497800c760 tx=0x7f497800cc20 comp rx=0 tx=0).stop 2024-04-17T19:48:15.406 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:15.404+0000 7f497fe00640 1 -- 172.21.15.44:0/748937809 reap_dead start 2024-04-17T19:48:15.407 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:15.404+0000 7f497fe00640 1 -- 172.21.15.44:0/748937809 reap_dead start 2024-04-17T19:48:15.407 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:15.404+0000 7f4986800640 1 -- 172.21.15.44:0/748937809 shutdown_connections 2024-04-17T19:48:15.407 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:15.404+0000 7f4986800640 1 -- 172.21.15.44:0/748937809 >> 172.21.15.44:0/748937809 conn(0x7f49800c9dc0 msgr2=0x7f49801521d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:48:15.407 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:15.404+0000 7f4986800640 1 -- 172.21.15.44:0/748937809 shutdown_connections 2024-04-17T19:48:15.407 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:15.404+0000 7f4986800640 1 -- 172.21.15.44:0/748937809 wait complete. 2024-04-17T19:48:15.410 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 2 2024-04-17T19:48:15.410 INFO:tasks.mon_thrash.mon_thrasher:waiting for 20.0 secs before reviving monitors 2024-04-17T19:48:23.898 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T19:48:23.902 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T19:48:35.411 INFO:tasks.mon_thrash.mon_thrasher:killing mon.c 2024-04-17T19:48:35.412 INFO:tasks.mon_thrash.mon_thrasher:reviving mon.c 2024-04-17T19:48:35.412 INFO:tasks.ceph.mon.c:Restarting daemon 2024-04-17T19:48:35.412 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2024-04-17T19:48:35.415 INFO:tasks.ceph.mon.c:Started 2024-04-17T19:48:35.415 INFO:tasks.mon_thrash:Sending STOP to mon b 2024-04-17T19:48:35.415 INFO:tasks.ceph.mon.b:Sent signal 19 2024-04-17T19:48:35.416 INFO:tasks.mon_thrash.mon_thrasher:waiting for 15.0 secs to unfreeze mons 2024-04-17T19:48:50.417 INFO:tasks.mon_thrash:Sending CONT to mon b 2024-04-17T19:48:50.417 INFO:tasks.ceph.mon.b:Sent signal 18 2024-04-17T19:48:50.417 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2024-04-17T19:48:50.418 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-04-17T19:48:50.597 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:50.608+0000 7f43cae00640 1 Processor -- start 2024-04-17T19:48:50.597 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:50.608+0000 7f43cae00640 1 -- start start 2024-04-17T19:48:50.599 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:50.612+0000 7f43cae00640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f43c415a3d0 0x7f43c40c9900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:48:50.599 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:50.612+0000 7f43cae00640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f43c40cbef0 con 0x7f43c40c94f0 2024-04-17T19:48:50.599 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:50.612+0000 7f43cae00640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f43c4153be0 con 0x7f43c40c4500 2024-04-17T19:48:50.599 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:50.612+0000 7f43cae00640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 -- 0x7f43c40ca1e0 con 0x7f43c415a3d0 2024-04-17T19:48:50.600 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:50.612+0000 7f43c9a00640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f43c40c94f0 0x7f43c4159cc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:47336/0 (socket says 172.21.15.44:47336) 2024-04-17T19:48:50.600 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:50.612+0000 7f43c9000640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f43c415a3d0 0x7f43c40c9900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:48:50.600 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:50.612+0000 7f43c9a00640 1 -- 172.21.15.44:0/2850485616 learned_addr learned my addr 172.21.15.44:0/2850485616 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-04-17T19:48:50.600 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:50.612+0000 7f43c9000640 1 -- 172.21.15.44:0/2850485616 >> v1:172.21.15.62:6789/0 conn(0x7f43c40c4500 legacy=0x7f43c40c4910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:48:50.600 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:50.612+0000 7f43c9000640 1 -- 172.21.15.44:0/2850485616 >> v1:172.21.15.44:6789/0 conn(0x7f43c40c94f0 legacy=0x7f43c4159cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:48:50.600 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:50.612+0000 7f43c9000640 1 -- 172.21.15.44:0/2850485616 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f43c40ca4a0 con 0x7f43c415a3d0 2024-04-17T19:48:50.600 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:50.612+0000 7f43c3e00640 1 -- 172.21.15.44:0/2850485616 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2441611762 0 0) 0x7f43c40cbef0 con 0x7f43c40c94f0 2024-04-17T19:48:50.604 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:50.616+0000 7f43c9000640 1 --2- 172.21.15.44:0/2850485616 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f43c415a3d0 0x7f43c40c9900 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f43b00097c0 tx=0x7f43b001c410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=29bffd1750029bc5 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:48:50.605 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:50.616+0000 7f43c3e00640 1 -- 172.21.15.44:0/2850485616 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43b00b0070 con 0x7f43c415a3d0 2024-04-17T19:48:50.605 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:50.616+0000 7f43c3e00640 1 -- 172.21.15.44:0/2850485616 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f43b00ab600 con 0x7f43c415a3d0 2024-04-17T19:48:50.605 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:50.616+0000 7f43c3e00640 1 -- 172.21.15.44:0/2850485616 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43b00ab9d0 con 0x7f43c415a3d0 2024-04-17T19:48:50.606 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:50.616+0000 7f43cae00640 1 -- 172.21.15.44:0/2850485616 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f43c415a3d0 msgr2=0x7f43c40c9900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:48:50.606 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:50.616+0000 7f43cae00640 1 --2- 172.21.15.44:0/2850485616 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f43c415a3d0 0x7f43c40c9900 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f43b00097c0 tx=0x7f43b001c410 comp rx=0 tx=0).stop 2024-04-17T19:48:50.606 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:50.616+0000 7f43cae00640 1 -- 172.21.15.44:0/2850485616 shutdown_connections 2024-04-17T19:48:50.606 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:50.616+0000 7f43cae00640 1 --2- 172.21.15.44:0/2850485616 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f43c415a3d0 0x7f43c40c9900 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:48:50.606 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:50.616+0000 7f43cae00640 1 -- 172.21.15.44:0/2850485616 >> 172.21.15.44:0/2850485616 conn(0x7f43c4072150 msgr2=0x7f43c4072560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:48:50.606 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:50.616+0000 7f43cae00640 1 -- 172.21.15.44:0/2850485616 shutdown_connections 2024-04-17T19:48:50.606 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:50.616+0000 7f43cae00640 1 -- 172.21.15.44:0/2850485616 wait complete. 2024-04-17T19:48:50.609 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:50.620+0000 7f43cae00640 1 Processor -- start 2024-04-17T19:48:50.610 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:50.620+0000 7f43cae00640 1 -- start start 2024-04-17T19:48:50.612 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:50.624+0000 7f43cae00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f43c40c4500 0x7f43c414c140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:48:50.612 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:50.624+0000 7f43cae00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f43c40c94f0 0x7f43c414c680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:48:50.612 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:50.624+0000 7f43cae00640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f43c415a3d0 0x7f43c414f710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:48:50.612 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:50.624+0000 7f43cae00640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f43c4159730 con 0x7f43c40c94f0 2024-04-17T19:48:50.613 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:50.624+0000 7f43cae00640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f43c40cb020 con 0x7f43c40c4500 2024-04-17T19:48:50.613 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:50.624+0000 7f43cae00640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7f43c406ce90 con 0x7f43c415a3d0 2024-04-17T19:48:50.613 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:50.624+0000 7f43c9000640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f43c40c94f0 0x7f43c414c680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:48:50.613 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:50.624+0000 7f43c9a00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f43c40c4500 0x7f43c414c140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:48:50.613 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:50.624+0000 7f43c9000640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f43c40c94f0 0x7f43c414c680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:32792/0 (socket says 172.21.15.44:32792) 2024-04-17T19:48:50.613 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:50.624+0000 7f43c9000640 1 -- 172.21.15.44:0/478295931 learned_addr learned my addr 172.21.15.44:0/478295931 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-04-17T19:48:50.613 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:50.624+0000 7f43ca400640 1 --2- 172.21.15.44:0/478295931 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f43c415a3d0 0x7f43c414f710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:48:50.614 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:50.624+0000 7f43c9000640 1 -- 172.21.15.44:0/478295931 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f43c415a3d0 msgr2=0x7f43c414f710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:48:50.614 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:50.624+0000 7f43c9000640 1 --2- 172.21.15.44:0/478295931 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f43c415a3d0 0x7f43c414f710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:48:50.614 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:50.624+0000 7f43c9000640 1 -- 172.21.15.44:0/478295931 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f43c40c4500 msgr2=0x7f43c414c140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:48:50.614 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:50.624+0000 7f43c9000640 1 --2- 172.21.15.44:0/478295931 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f43c40c4500 0x7f43c414c140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:48:50.615 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:50.624+0000 7f43c9000640 1 -- 172.21.15.44:0/478295931 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f43c41518f0 con 0x7f43c40c94f0 2024-04-17T19:48:50.615 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:50.624+0000 7f43c9000640 1 --2- 172.21.15.44:0/478295931 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f43c40c94f0 0x7f43c414c680 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f43b00097c0 tx=0x7f43b001ac50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:48:50.615 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:50.624+0000 7f43c1600640 1 -- 172.21.15.44:0/478295931 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43b00bc070 con 0x7f43c40c94f0 2024-04-17T19:48:50.615 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:50.624+0000 7f43c1600640 1 -- 172.21.15.44:0/478295931 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f43b00b1040 con 0x7f43c40c94f0 2024-04-17T19:48:50.615 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:50.624+0000 7f43c1600640 1 -- 172.21.15.44:0/478295931 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43b00b0050 con 0x7f43c40c94f0 2024-04-17T19:48:50.615 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:50.624+0000 7f43cae00640 1 -- 172.21.15.44:0/478295931 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f43c414cbc0 con 0x7f43c40c94f0 2024-04-17T19:48:50.615 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:50.628+0000 7f43cae00640 1 -- 172.21.15.44:0/478295931 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f43c41f08d0 con 0x7f43c40c94f0 2024-04-17T19:48:50.615 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:50.628+0000 7f43cae00640 1 -- 172.21.15.44:0/478295931 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f43c404fea0 con 0x7f43c40c94f0 2024-04-17T19:48:50.617 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:50.628+0000 7f43c1600640 1 -- 172.21.15.44:0/478295931 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f43b0004270 con 0x7f43c40c94f0 2024-04-17T19:48:50.618 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:50.632+0000 7f43c1600640 1 --2- 172.21.15.44:0/478295931 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f43a4068380 0x7f43a406a890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:48:50.619 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:50.632+0000 7f43c1600640 1 -- 172.21.15.44:0/478295931 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6619+0+0 (secure 0 0 0) 0x7f43b01207e0 con 0x7f43c40c94f0 2024-04-17T19:48:50.619 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:50.632+0000 7f43c9a00640 1 --2- 172.21.15.44:0/478295931 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f43a4068380 0x7f43a406a890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:48:50.620 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:50.632+0000 7f43c9a00640 1 --2- 172.21.15.44:0/478295931 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f43a4068380 0x7f43a406a890 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f43b8000f70 tx=0x7f43b8007240 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:48:50.623 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:50.636+0000 7f43c1600640 1 -- 172.21.15.44:0/478295931 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f43b0016090 con 0x7f43c40c94f0 2024-04-17T19:48:50.855 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:50.868+0000 7f43cae00640 1 -- 172.21.15.44:0/478295931 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f43c4151c20 con 0x7f43c40c94f0 2024-04-17T19:48:50.855 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:50.868+0000 7f43c1600640 1 -- 172.21.15.44:0/478295931 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1556 (secure 0 0 0) 0x7f43b00f04a0 con 0x7f43c40c94f0 2024-04-17T19:48:50.855 INFO:teuthology.orchestra.run.smithi044.stdout:{"election_epoch":14,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":0,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"703f77ca-79c6-4a66-b576-62c526cb1021","modified":"2024-04-17T19:45:55.379749Z","created":"2024-04-17T19:45:55.379749Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:3300","nonce":0},{"type":"v1","addr":"172.21.15.44:6789","nonce":0}]},"addr":"172.21.15.44:6789/0","public_addr":"172.21.15.44:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:3300","nonce":0},{"type":"v1","addr":"172.21.15.62:6789","nonce":0}]},"addr":"172.21.15.62:6789/0","public_addr":"172.21.15.62:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:3301","nonce":0},{"type":"v1","addr":"172.21.15.62:6790","nonce":0}]},"addr":"172.21.15.62:6790/0","public_addr":"172.21.15.62:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-04-17T19:48:50.859 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:50.872+0000 7f43cae00640 1 -- 172.21.15.44:0/478295931 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f43a4068380 msgr2=0x7f43a406a890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:48:50.859 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:50.872+0000 7f43cae00640 1 --2- 172.21.15.44:0/478295931 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f43a4068380 0x7f43a406a890 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f43b8000f70 tx=0x7f43b8007240 comp rx=0 tx=0).stop 2024-04-17T19:48:50.859 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:50.872+0000 7f43cae00640 1 -- 172.21.15.44:0/478295931 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f43c40c94f0 msgr2=0x7f43c414c680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:48:50.859 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:50.872+0000 7f43cae00640 1 --2- 172.21.15.44:0/478295931 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f43c40c94f0 0x7f43c414c680 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f43b00097c0 tx=0x7f43b001ac50 comp rx=0 tx=0).stop 2024-04-17T19:48:50.859 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:50.872+0000 7f43cae00640 1 -- 172.21.15.44:0/478295931 shutdown_connections 2024-04-17T19:48:50.859 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:50.872+0000 7f43cae00640 1 --2- 172.21.15.44:0/478295931 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f43a4068380 0x7f43a406a890 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:48:50.859 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:50.872+0000 7f43cae00640 1 --2- 172.21.15.44:0/478295931 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f43c415a3d0 0x7f43c414f710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:48:50.859 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:50.872+0000 7f43cae00640 1 --2- 172.21.15.44:0/478295931 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f43c40c94f0 0x7f43c414c680 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:48:50.859 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:50.872+0000 7f43cae00640 1 --2- 172.21.15.44:0/478295931 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f43c40c4500 0x7f43c414c140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:48:50.859 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:50.872+0000 7f43cae00640 1 -- 172.21.15.44:0/478295931 >> 172.21.15.44:0/478295931 conn(0x7f43c4072150 msgr2=0x7f43c40753b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:48:50.859 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:50.872+0000 7f43cae00640 1 -- 172.21.15.44:0/478295931 shutdown_connections 2024-04-17T19:48:50.859 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:50.872+0000 7f43cae00640 1 -- 172.21.15.44:0/478295931 wait complete. 2024-04-17T19:48:50.887 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2024-04-17T19:48:50.887 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon a 2024-04-17T19:48:50.887 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2024-04-17T19:48:51.063 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:51.076+0000 7f4951400640 1 Processor -- start 2024-04-17T19:48:51.063 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:51.076+0000 7f4951400640 1 -- start start 2024-04-17T19:48:51.065 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:51.076+0000 7f4951400640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f494c155bc0 0x7f494c0cb5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:48:51.065 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:51.076+0000 7f4951400640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f494c15c530 0x7f494c0726a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:48:51.065 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:51.076+0000 7f4951400640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f494c0c4d10 con 0x7f494c072be0 2024-04-17T19:48:51.065 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:51.076+0000 7f4951400640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 -- 0x7f494c15c0a0 con 0x7f494c155bc0 2024-04-17T19:48:51.065 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:51.076+0000 7f4951400640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7f494c15c940 con 0x7f494c15c530 2024-04-17T19:48:51.065 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:51.076+0000 7f494a800640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f494c155bc0 0x7f494c0cb5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:48:51.065 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:51.076+0000 7f494b200640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f494c072be0 0x7f494c15efd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:47344/0 (socket says 172.21.15.44:47344) 2024-04-17T19:48:51.065 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:51.076+0000 7f494b200640 1 -- 172.21.15.44:0/11040264 learned_addr learned my addr 172.21.15.44:0/11040264 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-04-17T19:48:51.066 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:51.076+0000 7f4949e00640 1 --2- 172.21.15.44:0/11040264 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f494c15c530 0x7f494c0726a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:48:51.066 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:51.076+0000 7f494a800640 1 -- 172.21.15.44:0/11040264 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f494c15c530 msgr2=0x7f494c0726a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T19:48:51.066 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:51.076+0000 7f494a800640 1 --2- 172.21.15.44:0/11040264 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f494c15c530 0x7f494c0726a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:48:51.066 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:51.076+0000 7f494a800640 1 -- 172.21.15.44:0/11040264 >> v1:172.21.15.44:6789/0 conn(0x7f494c072be0 legacy=0x7f494c15efd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:48:51.067 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:51.076+0000 7f494a800640 1 -- 172.21.15.44:0/11040264 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f494c0ca440 con 0x7f494c155bc0 2024-04-17T19:48:51.067 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:51.076+0000 7f4949400640 1 -- 172.21.15.44:0/11040264 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 923531277 0 0) 0x7f494c0c4d10 con 0x7f494c072be0 2024-04-17T19:48:51.070 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:51.080+0000 7f494a800640 1 --2- 172.21.15.44:0/11040264 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f494c155bc0 0x7f494c0cb5e0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f493c0097c0 tx=0x7f493c01c4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cc561f11a2ce51a5 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:48:51.070 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:51.080+0000 7f4949400640 1 -- 172.21.15.44:0/11040264 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f493c0b0070 con 0x7f494c155bc0 2024-04-17T19:48:51.070 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:51.080+0000 7f4949400640 1 -- 172.21.15.44:0/11040264 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f493c0a4e50 con 0x7f494c155bc0 2024-04-17T19:48:51.070 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:51.080+0000 7f4949400640 1 -- 172.21.15.44:0/11040264 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f493c0ab820 con 0x7f494c155bc0 2024-04-17T19:48:51.071 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:51.084+0000 7f4951400640 1 -- 172.21.15.44:0/11040264 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f494c155bc0 msgr2=0x7f494c0cb5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:48:51.071 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:51.084+0000 7f4951400640 1 --2- 172.21.15.44:0/11040264 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f494c155bc0 0x7f494c0cb5e0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f493c0097c0 tx=0x7f493c01c4a0 comp rx=0 tx=0).stop 2024-04-17T19:48:51.071 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:51.084+0000 7f4951400640 1 -- 172.21.15.44:0/11040264 shutdown_connections 2024-04-17T19:48:51.071 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:51.084+0000 7f4951400640 1 --2- 172.21.15.44:0/11040264 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f494c15c530 0x7f494c0726a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:48:51.071 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:51.084+0000 7f4951400640 1 --2- 172.21.15.44:0/11040264 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f494c155bc0 0x7f494c0cb5e0 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:48:51.072 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:51.084+0000 7f4951400640 1 -- 172.21.15.44:0/11040264 >> 172.21.15.44:0/11040264 conn(0x7f494c067eb0 msgr2=0x7f494c0682c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:48:51.072 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:51.084+0000 7f4951400640 1 -- 172.21.15.44:0/11040264 shutdown_connections 2024-04-17T19:48:51.072 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:51.084+0000 7f4951400640 1 -- 172.21.15.44:0/11040264 wait complete. 2024-04-17T19:48:51.073 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:51.084+0000 7f4951400640 1 Processor -- start 2024-04-17T19:48:51.073 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:51.084+0000 7f4951400640 1 -- start start 2024-04-17T19:48:51.076 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:51.088+0000 7f4951400640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f494c072be0 0x7f494c1f4b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:48:51.076 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:51.088+0000 7f4951400640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f494c155bc0 0x7f494c14fd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:48:51.076 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:51.088+0000 7f4951400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f494c15c530 0x7f494c15cba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:48:51.077 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:51.088+0000 7f4951400640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f494c0caad0 con 0x7f494c15c530 2024-04-17T19:48:51.077 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:51.088+0000 7f4951400640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f494c0c5b40 con 0x7f494c072be0 2024-04-17T19:48:51.077 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:51.088+0000 7f4951400640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7f494c1f5530 con 0x7f494c155bc0 2024-04-17T19:48:51.077 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:51.088+0000 7f494b200640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f494c15c530 0x7f494c15cba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:48:51.077 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:51.088+0000 7f494b200640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f494c15c530 0x7f494c15cba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:32810/0 (socket says 172.21.15.44:32810) 2024-04-17T19:48:51.077 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:51.088+0000 7f494b200640 1 -- 172.21.15.44:0/54990484 learned_addr learned my addr 172.21.15.44:0/54990484 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-04-17T19:48:51.077 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:51.088+0000 7f494a800640 1 --2- 172.21.15.44:0/54990484 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f494c072be0 0x7f494c1f4b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:48:51.077 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:51.088+0000 7f4949e00640 1 --2- 172.21.15.44:0/54990484 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f494c155bc0 0x7f494c14fd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:48:51.077 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:51.088+0000 7f494b200640 1 -- 172.21.15.44:0/54990484 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f494c155bc0 msgr2=0x7f494c14fd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:48:51.077 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:51.088+0000 7f494b200640 1 --2- 172.21.15.44:0/54990484 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f494c155bc0 0x7f494c14fd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:48:51.077 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:51.088+0000 7f494b200640 1 -- 172.21.15.44:0/54990484 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f494c072be0 msgr2=0x7f494c1f4b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:48:51.077 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:51.088+0000 7f494b200640 1 --2- 172.21.15.44:0/54990484 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f494c072be0 0x7f494c1f4b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:48:51.077 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:51.088+0000 7f494b200640 1 -- 172.21.15.44:0/54990484 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f494c1f5060 con 0x7f494c15c530 2024-04-17T19:48:51.077 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:51.088+0000 7f494b200640 1 --2- 172.21.15.44:0/54990484 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f494c15c530 0x7f494c15cba0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f494400c6a0 tx=0x7f494400cb60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:48:51.078 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:51.088+0000 7f4942a00640 1 -- 172.21.15.44:0/54990484 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4944018070 con 0x7f494c15c530 2024-04-17T19:48:51.078 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:51.088+0000 7f4942a00640 1 -- 172.21.15.44:0/54990484 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4944004d70 con 0x7f494c15c530 2024-04-17T19:48:51.078 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:51.088+0000 7f4951400640 1 -- 172.21.15.44:0/54990484 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f494c0c6be0 con 0x7f494c15c530 2024-04-17T19:48:51.078 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:51.088+0000 7f4942a00640 1 -- 172.21.15.44:0/54990484 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f494400a880 con 0x7f494c15c530 2024-04-17T19:48:51.078 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:51.088+0000 7f4951400640 1 -- 172.21.15.44:0/54990484 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f494c0c71a0 con 0x7f494c15c530 2024-04-17T19:48:51.079 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:51.088+0000 7f4951400640 1 --2- 172.21.15.44:0/54990484 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f494c0c6580 0x7f494c15d0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:48:51.079 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:51.088+0000 7f4951400640 1 -- 172.21.15.44:0/54990484 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f494c0c7370 con 0x7f494c0c6580 2024-04-17T19:48:51.079 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:51.088+0000 7f494a800640 1 --2- 172.21.15.44:0/54990484 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f494c0c6580 0x7f494c15d0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:48:51.079 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:51.092+0000 7f494a800640 1 -- 172.21.15.44:0/54990484 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f494c04ff10 con 0x7f494c0c6580 2024-04-17T19:48:51.079 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:51.092+0000 7f494a800640 1 --2- 172.21.15.44:0/54990484 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f494c0c6580 0x7f494c15d0e0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f494c074650 tx=0x7f493c019240 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:48:51.079 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:51.092+0000 7f4942a00640 1 -- 172.21.15.44:0/54990484 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f494401b070 con 0x7f494c15c530 2024-04-17T19:48:51.080 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:51.092+0000 7f4942a00640 1 --2- 172.21.15.44:0/54990484 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f492c068380 0x7f492c06a890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:48:51.080 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:51.092+0000 7f4942a00640 1 -- 172.21.15.44:0/54990484 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6619+0+0 (secure 0 0 0) 0x7f4944086250 con 0x7f494c15c530 2024-04-17T19:48:51.080 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:51.092+0000 7f4942a00640 1 -- 172.21.15.44:0/54990484 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f493c0b0040 con 0x7f494c0c6580 2024-04-17T19:48:51.080 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:51.092+0000 7f4942a00640 1 -- 172.21.15.44:0/54990484 <== mon.0 v2:172.21.15.44:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f493c0093e0 con 0x7f494c0c6580 2024-04-17T19:48:51.080 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:51.092+0000 7f4942a00640 1 -- 172.21.15.44:0/54990484 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f494c0c6580 msgr2=0x7f494c15d0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:48:51.080 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:51.092+0000 7f4942a00640 1 --2- 172.21.15.44:0/54990484 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f494c0c6580 0x7f494c15d0e0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f494c074650 tx=0x7f493c019240 comp rx=0 tx=0).stop 2024-04-17T19:48:51.081 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:51.092+0000 7f4942a00640 1 -- 172.21.15.44:0/54990484 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f494c0c6580 msgr2=0x7f494c15d0e0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-17T19:48:51.081 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:51.092+0000 7f4942a00640 1 --2- 172.21.15.44:0/54990484 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f494c0c6580 0x7f494c15d0e0 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:48:51.081 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:51.092+0000 7f4949e00640 1 --2- 172.21.15.44:0/54990484 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f492c068380 0x7f492c06a890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:48:51.081 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:51.092+0000 7f4949e00640 1 --2- 172.21.15.44:0/54990484 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f492c068380 0x7f492c06a890 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f494c0cc1b0 tx=0x7f4938009190 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:48:51.086 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:51.100+0000 7f4951400640 1 --2- 172.21.15.44:0/54990484 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f494c0cf790 0x7f494c1f7f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:48:51.086 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:51.100+0000 7f4951400640 1 -- 172.21.15.44:0/54990484 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f494c0b5040 con 0x7f494c0cf790 2024-04-17T19:48:51.087 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:51.100+0000 7f494a800640 1 --2- 172.21.15.44:0/54990484 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f494c0cf790 0x7f494c1f7f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:48:51.087 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:51.100+0000 7f494a800640 1 -- 172.21.15.44:0/54990484 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f494c072720 con 0x7f494c0cf790 2024-04-17T19:48:51.088 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:51.100+0000 7f494a800640 1 --2- 172.21.15.44:0/54990484 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f494c0cf790 0x7f494c1f7f20 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f493c0090e0 tx=0x7f493c009190 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:48:51.088 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:51.100+0000 7f4942a00640 1 -- 172.21.15.44:0/54990484 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f493c0b0040 con 0x7f494c0cf790 2024-04-17T19:48:51.088 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:51.100+0000 7f4942a00640 1 -- 172.21.15.44:0/54990484 <== mon.0 v2:172.21.15.44:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+5202 (secure 0 0 0) 0x7f493c0abe40 con 0x7f494c0cf790 2024-04-17T19:48:51.088 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:51.100+0000 7f4942a00640 1 -- 172.21.15.44:0/54990484 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f494c0cf790 msgr2=0x7f494c1f7f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:48:51.088 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:51.100+0000 7f4942a00640 1 --2- 172.21.15.44:0/54990484 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f494c0cf790 0x7f494c1f7f20 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f493c0090e0 tx=0x7f493c009190 comp rx=0 tx=0).stop 2024-04-17T19:48:51.088 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:51.100+0000 7f4942a00640 1 -- 172.21.15.44:0/54990484 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f494c0cf790 msgr2=0x7f494c1f7f20 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-04-17T19:48:51.088 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:51.100+0000 7f4942a00640 1 --2- 172.21.15.44:0/54990484 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f494c0cf790 0x7f494c1f7f20 secure :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f493c0090e0 tx=0x7f493c009190 comp rx=0 tx=0).stop 2024-04-17T19:48:51.088 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2024-04-17T19:48:51.089 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "a", 2024-04-17T19:48:51.089 INFO:teuthology.orchestra.run.smithi044.stdout: "rank": 0, 2024-04-17T19:48:51.089 INFO:teuthology.orchestra.run.smithi044.stdout: "state": "leader", 2024-04-17T19:48:51.089 INFO:teuthology.orchestra.run.smithi044.stdout: "election_epoch": 14, 2024-04-17T19:48:51.089 INFO:teuthology.orchestra.run.smithi044.stdout: "uptime": 140561, 2024-04-17T19:48:51.089 INFO:teuthology.orchestra.run.smithi044.stdout: "quorum": [ 2024-04-17T19:48:51.089 INFO:teuthology.orchestra.run.smithi044.stdout: 0, 2024-04-17T19:48:51.089 INFO:teuthology.orchestra.run.smithi044.stdout: 1, 2024-04-17T19:48:51.089 INFO:teuthology.orchestra.run.smithi044.stdout: 2 2024-04-17T19:48:51.089 INFO:teuthology.orchestra.run.smithi044.stdout: ], 2024-04-17T19:48:51.089 INFO:teuthology.orchestra.run.smithi044.stdout: "quorum_age": 0, 2024-04-17T19:48:51.089 INFO:teuthology.orchestra.run.smithi044.stdout: "features": { 2024-04-17T19:48:51.089 INFO:teuthology.orchestra.run.smithi044.stdout: "required_con": "2450521708007866372", 2024-04-17T19:48:51.089 INFO:teuthology.orchestra.run.smithi044.stdout: "required_mon": [ 2024-04-17T19:48:51.089 INFO:teuthology.orchestra.run.smithi044.stdout: "kraken", 2024-04-17T19:48:51.090 INFO:teuthology.orchestra.run.smithi044.stdout: "luminous", 2024-04-17T19:48:51.090 INFO:teuthology.orchestra.run.smithi044.stdout: "mimic", 2024-04-17T19:48:51.090 INFO:teuthology.orchestra.run.smithi044.stdout: "osdmap-prune", 2024-04-17T19:48:51.090 INFO:teuthology.orchestra.run.smithi044.stdout: "nautilus", 2024-04-17T19:48:51.090 INFO:teuthology.orchestra.run.smithi044.stdout: "octopus", 2024-04-17T19:48:51.090 INFO:teuthology.orchestra.run.smithi044.stdout: "pacific", 2024-04-17T19:48:51.090 INFO:teuthology.orchestra.run.smithi044.stdout: "elector-pinging", 2024-04-17T19:48:51.090 INFO:teuthology.orchestra.run.smithi044.stdout: "quincy", 2024-04-17T19:48:51.090 INFO:teuthology.orchestra.run.smithi044.stdout: "reef", 2024-04-17T19:48:51.090 INFO:teuthology.orchestra.run.smithi044.stdout: "squid" 2024-04-17T19:48:51.090 INFO:teuthology.orchestra.run.smithi044.stdout: ], 2024-04-17T19:48:51.090 INFO:teuthology.orchestra.run.smithi044.stdout: "quorum_con": "4540701547738038271", 2024-04-17T19:48:51.090 INFO:teuthology.orchestra.run.smithi044.stdout: "quorum_mon": [ 2024-04-17T19:48:51.091 INFO:teuthology.orchestra.run.smithi044.stdout: "kraken", 2024-04-17T19:48:51.091 INFO:teuthology.orchestra.run.smithi044.stdout: "luminous", 2024-04-17T19:48:51.091 INFO:teuthology.orchestra.run.smithi044.stdout: "mimic", 2024-04-17T19:48:51.091 INFO:teuthology.orchestra.run.smithi044.stdout: "osdmap-prune", 2024-04-17T19:48:51.091 INFO:teuthology.orchestra.run.smithi044.stdout: "nautilus", 2024-04-17T19:48:51.091 INFO:teuthology.orchestra.run.smithi044.stdout: "octopus", 2024-04-17T19:48:51.091 INFO:teuthology.orchestra.run.smithi044.stdout: "pacific", 2024-04-17T19:48:51.091 INFO:teuthology.orchestra.run.smithi044.stdout: "elector-pinging", 2024-04-17T19:48:51.091 INFO:teuthology.orchestra.run.smithi044.stdout: "quincy", 2024-04-17T19:48:51.091 INFO:teuthology.orchestra.run.smithi044.stdout: "reef", 2024-04-17T19:48:51.091 INFO:teuthology.orchestra.run.smithi044.stdout: "squid" 2024-04-17T19:48:51.091 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T19:48:51.091 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T19:48:51.091 INFO:teuthology.orchestra.run.smithi044.stdout: "outside_quorum": [], 2024-04-17T19:48:51.091 INFO:teuthology.orchestra.run.smithi044.stdout: "extra_probe_peers": [], 2024-04-17T19:48:51.091 INFO:teuthology.orchestra.run.smithi044.stdout: "sync_provider": [], 2024-04-17T19:48:51.092 INFO:teuthology.orchestra.run.smithi044.stdout: "monmap": { 2024-04-17T19:48:51.092 INFO:teuthology.orchestra.run.smithi044.stdout: "epoch": 1, 2024-04-17T19:48:51.092 INFO:teuthology.orchestra.run.smithi044.stdout: "fsid": "703f77ca-79c6-4a66-b576-62c526cb1021", 2024-04-17T19:48:51.092 INFO:teuthology.orchestra.run.smithi044.stdout: "modified": "2024-04-17T19:45:55.379749Z", 2024-04-17T19:48:51.092 INFO:teuthology.orchestra.run.smithi044.stdout: "created": "2024-04-17T19:45:55.379749Z", 2024-04-17T19:48:51.092 INFO:teuthology.orchestra.run.smithi044.stdout: "min_mon_release": 19, 2024-04-17T19:48:51.092 INFO:teuthology.orchestra.run.smithi044.stdout: "min_mon_release_name": "squid", 2024-04-17T19:48:51.092 INFO:teuthology.orchestra.run.smithi044.stdout: "election_strategy": 1, 2024-04-17T19:48:51.092 INFO:teuthology.orchestra.run.smithi044.stdout: "disallowed_leaders: ": "", 2024-04-17T19:48:51.092 INFO:teuthology.orchestra.run.smithi044.stdout: "stretch_mode": false, 2024-04-17T19:48:51.092 INFO:teuthology.orchestra.run.smithi044.stdout: "tiebreaker_mon": "", 2024-04-17T19:48:51.092 INFO:teuthology.orchestra.run.smithi044.stdout: "removed_ranks: ": "", 2024-04-17T19:48:51.092 INFO:teuthology.orchestra.run.smithi044.stdout: "features": { 2024-04-17T19:48:51.092 INFO:teuthology.orchestra.run.smithi044.stdout: "persistent": [ 2024-04-17T19:48:51.092 INFO:teuthology.orchestra.run.smithi044.stdout: "kraken", 2024-04-17T19:48:51.093 INFO:teuthology.orchestra.run.smithi044.stdout: "luminous", 2024-04-17T19:48:51.093 INFO:teuthology.orchestra.run.smithi044.stdout: "mimic", 2024-04-17T19:48:51.093 INFO:teuthology.orchestra.run.smithi044.stdout: "osdmap-prune", 2024-04-17T19:48:51.093 INFO:teuthology.orchestra.run.smithi044.stdout: "nautilus", 2024-04-17T19:48:51.093 INFO:teuthology.orchestra.run.smithi044.stdout: "octopus", 2024-04-17T19:48:51.093 INFO:teuthology.orchestra.run.smithi044.stdout: "pacific", 2024-04-17T19:48:51.093 INFO:teuthology.orchestra.run.smithi044.stdout: "elector-pinging", 2024-04-17T19:48:51.093 INFO:teuthology.orchestra.run.smithi044.stdout: "quincy", 2024-04-17T19:48:51.093 INFO:teuthology.orchestra.run.smithi044.stdout: "reef", 2024-04-17T19:48:51.093 INFO:teuthology.orchestra.run.smithi044.stdout: "squid" 2024-04-17T19:48:51.093 INFO:teuthology.orchestra.run.smithi044.stdout: ], 2024-04-17T19:48:51.093 INFO:teuthology.orchestra.run.smithi044.stdout: "optional": [] 2024-04-17T19:48:51.093 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T19:48:51.093 INFO:teuthology.orchestra.run.smithi044.stdout: "mons": [ 2024-04-17T19:48:51.093 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T19:48:51.093 INFO:teuthology.orchestra.run.smithi044.stdout: "rank": 0, 2024-04-17T19:48:51.094 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "a", 2024-04-17T19:48:51.094 INFO:teuthology.orchestra.run.smithi044.stdout: "public_addrs": { 2024-04-17T19:48:51.094 INFO:teuthology.orchestra.run.smithi044.stdout: "addrvec": [ 2024-04-17T19:48:51.094 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T19:48:51.094 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "v2", 2024-04-17T19:48:51.094 INFO:teuthology.orchestra.run.smithi044.stdout: "addr": "172.21.15.44:3300", 2024-04-17T19:48:51.094 INFO:teuthology.orchestra.run.smithi044.stdout: "nonce": 0 2024-04-17T19:48:51.094 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T19:48:51.094 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T19:48:51.094 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "v1", 2024-04-17T19:48:51.094 INFO:teuthology.orchestra.run.smithi044.stdout: "addr": "172.21.15.44:6789", 2024-04-17T19:48:51.094 INFO:teuthology.orchestra.run.smithi044.stdout: "nonce": 0 2024-04-17T19:48:51.094 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T19:48:51.094 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T19:48:51.094 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T19:48:51.095 INFO:teuthology.orchestra.run.smithi044.stdout: "addr": "172.21.15.44:6789/0", 2024-04-17T19:48:51.095 INFO:teuthology.orchestra.run.smithi044.stdout: "public_addr": "172.21.15.44:6789/0", 2024-04-17T19:48:51.095 INFO:teuthology.orchestra.run.smithi044.stdout: "priority": 0, 2024-04-17T19:48:51.095 INFO:teuthology.orchestra.run.smithi044.stdout: "weight": 0, 2024-04-17T19:48:51.095 INFO:teuthology.orchestra.run.smithi044.stdout: "crush_location": "{}" 2024-04-17T19:48:51.095 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T19:48:51.095 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T19:48:51.095 INFO:teuthology.orchestra.run.smithi044.stdout: "rank": 1, 2024-04-17T19:48:51.095 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "b", 2024-04-17T19:48:51.095 INFO:teuthology.orchestra.run.smithi044.stdout: "public_addrs": { 2024-04-17T19:48:51.095 INFO:teuthology.orchestra.run.smithi044.stdout: "addrvec": [ 2024-04-17T19:48:51.095 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T19:48:51.095 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "v2", 2024-04-17T19:48:51.095 INFO:teuthology.orchestra.run.smithi044.stdout: "addr": "172.21.15.62:3300", 2024-04-17T19:48:51.095 INFO:teuthology.orchestra.run.smithi044.stdout: "nonce": 0 2024-04-17T19:48:51.095 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T19:48:51.096 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T19:48:51.096 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "v1", 2024-04-17T19:48:51.096 INFO:teuthology.orchestra.run.smithi044.stdout: "addr": "172.21.15.62:6789", 2024-04-17T19:48:51.096 INFO:teuthology.orchestra.run.smithi044.stdout: "nonce": 0 2024-04-17T19:48:51.096 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T19:48:51.096 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T19:48:51.096 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T19:48:51.096 INFO:teuthology.orchestra.run.smithi044.stdout: "addr": "172.21.15.62:6789/0", 2024-04-17T19:48:51.096 INFO:teuthology.orchestra.run.smithi044.stdout: "public_addr": "172.21.15.62:6789/0", 2024-04-17T19:48:51.096 INFO:teuthology.orchestra.run.smithi044.stdout: "priority": 0, 2024-04-17T19:48:51.096 INFO:teuthology.orchestra.run.smithi044.stdout: "weight": 0, 2024-04-17T19:48:51.096 INFO:teuthology.orchestra.run.smithi044.stdout: "crush_location": "{}" 2024-04-17T19:48:51.096 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T19:48:51.096 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T19:48:51.096 INFO:teuthology.orchestra.run.smithi044.stdout: "rank": 2, 2024-04-17T19:48:51.096 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "c", 2024-04-17T19:48:51.097 INFO:teuthology.orchestra.run.smithi044.stdout: "public_addrs": { 2024-04-17T19:48:51.097 INFO:teuthology.orchestra.run.smithi044.stdout: "addrvec": [ 2024-04-17T19:48:51.097 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T19:48:51.097 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "v2", 2024-04-17T19:48:51.097 INFO:teuthology.orchestra.run.smithi044.stdout: "addr": "172.21.15.62:3301", 2024-04-17T19:48:51.097 INFO:teuthology.orchestra.run.smithi044.stdout: "nonce": 0 2024-04-17T19:48:51.097 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T19:48:51.097 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T19:48:51.097 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "v1", 2024-04-17T19:48:51.097 INFO:teuthology.orchestra.run.smithi044.stdout: "addr": "172.21.15.62:6790", 2024-04-17T19:48:51.097 INFO:teuthology.orchestra.run.smithi044.stdout: "nonce": 0 2024-04-17T19:48:51.097 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T19:48:51.097 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T19:48:51.097 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T19:48:51.097 INFO:teuthology.orchestra.run.smithi044.stdout: "addr": "172.21.15.62:6790/0", 2024-04-17T19:48:51.098 INFO:teuthology.orchestra.run.smithi044.stdout: "public_addr": "172.21.15.62:6790/0", 2024-04-17T19:48:51.098 INFO:teuthology.orchestra.run.smithi044.stdout: "priority": 0, 2024-04-17T19:48:51.098 INFO:teuthology.orchestra.run.smithi044.stdout: "weight": 0, 2024-04-17T19:48:51.098 INFO:teuthology.orchestra.run.smithi044.stdout: "crush_location": "{}" 2024-04-17T19:48:51.098 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T19:48:51.098 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T19:48:51.098 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T19:48:51.098 INFO:teuthology.orchestra.run.smithi044.stdout: "feature_map": { 2024-04-17T19:48:51.098 INFO:teuthology.orchestra.run.smithi044.stdout: "mon": [ 2024-04-17T19:48:51.098 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T19:48:51.098 INFO:teuthology.orchestra.run.smithi044.stdout: "features": "0x3f03cffffffdffff", 2024-04-17T19:48:51.098 INFO:teuthology.orchestra.run.smithi044.stdout: "release": "luminous", 2024-04-17T19:48:51.099 INFO:teuthology.orchestra.run.smithi044.stdout: "num": 1 2024-04-17T19:48:51.099 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T19:48:51.099 INFO:teuthology.orchestra.run.smithi044.stdout: ], 2024-04-17T19:48:51.099 INFO:teuthology.orchestra.run.smithi044.stdout: "mds": [ 2024-04-17T19:48:51.099 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T19:48:51.099 INFO:teuthology.orchestra.run.smithi044.stdout: "features": "0x3f03cffffffdffff", 2024-04-17T19:48:51.099 INFO:teuthology.orchestra.run.smithi044.stdout: "release": "luminous", 2024-04-17T19:48:51.099 INFO:teuthology.orchestra.run.smithi044.stdout: "num": 4 2024-04-17T19:48:51.099 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T19:48:51.099 INFO:teuthology.orchestra.run.smithi044.stdout: ], 2024-04-17T19:48:51.099 INFO:teuthology.orchestra.run.smithi044.stdout: "osd": [ 2024-04-17T19:48:51.099 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T19:48:51.099 INFO:teuthology.orchestra.run.smithi044.stdout: "features": "0x3f03cffffffdffff", 2024-04-17T19:48:51.099 INFO:teuthology.orchestra.run.smithi044.stdout: "release": "luminous", 2024-04-17T19:48:51.100 INFO:teuthology.orchestra.run.smithi044.stdout: "num": 4 2024-04-17T19:48:51.100 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T19:48:51.100 INFO:teuthology.orchestra.run.smithi044.stdout: ], 2024-04-17T19:48:51.100 INFO:teuthology.orchestra.run.smithi044.stdout: "client": [ 2024-04-17T19:48:51.100 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T19:48:51.100 INFO:teuthology.orchestra.run.smithi044.stdout: "features": "0x2f018fb87aa4aafe", 2024-04-17T19:48:51.100 INFO:teuthology.orchestra.run.smithi044.stdout: "release": "luminous", 2024-04-17T19:48:51.100 INFO:teuthology.orchestra.run.smithi044.stdout: "num": 1 2024-04-17T19:48:51.100 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T19:48:51.100 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T19:48:51.100 INFO:teuthology.orchestra.run.smithi044.stdout: "features": "0x3f03cffffffdffff", 2024-04-17T19:48:51.100 INFO:teuthology.orchestra.run.smithi044.stdout: "release": "luminous", 2024-04-17T19:48:51.100 INFO:teuthology.orchestra.run.smithi044.stdout: "num": 3 2024-04-17T19:48:51.100 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T19:48:51.100 INFO:teuthology.orchestra.run.smithi044.stdout: ], 2024-04-17T19:48:51.100 INFO:teuthology.orchestra.run.smithi044.stdout: "mgr": [ 2024-04-17T19:48:51.101 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T19:48:51.101 INFO:teuthology.orchestra.run.smithi044.stdout: "features": "0x3f03cffffffdffff", 2024-04-17T19:48:51.101 INFO:teuthology.orchestra.run.smithi044.stdout: "release": "luminous", 2024-04-17T19:48:51.101 INFO:teuthology.orchestra.run.smithi044.stdout: "num": 1 2024-04-17T19:48:51.101 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T19:48:51.101 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T19:48:51.101 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T19:48:51.101 INFO:teuthology.orchestra.run.smithi044.stdout: "stretch_mode": false 2024-04-17T19:48:51.101 INFO:teuthology.orchestra.run.smithi044.stdout:} 2024-04-17T19:48:51.102 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:51.100+0000 7f4951400640 1 -- 172.21.15.44:0/54990484 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f492c068380 msgr2=0x7f492c06a890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:48:51.102 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:51.100+0000 7f4951400640 1 --2- 172.21.15.44:0/54990484 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f492c068380 0x7f492c06a890 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f494c0cc1b0 tx=0x7f4938009190 comp rx=0 tx=0).stop 2024-04-17T19:48:51.102 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:51.100+0000 7f4951400640 1 -- 172.21.15.44:0/54990484 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f494c15c530 msgr2=0x7f494c15cba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:48:51.102 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:51.100+0000 7f4951400640 1 --2- 172.21.15.44:0/54990484 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f494c15c530 0x7f494c15cba0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f494400c6a0 tx=0x7f494400cb60 comp rx=0 tx=0).stop 2024-04-17T19:48:51.102 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:51.100+0000 7f494b200640 1 -- 172.21.15.44:0/54990484 reap_dead start 2024-04-17T19:48:51.102 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:51.100+0000 7f494b200640 1 -- 172.21.15.44:0/54990484 reap_dead start 2024-04-17T19:48:51.102 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:51.100+0000 7f4951400640 1 -- 172.21.15.44:0/54990484 shutdown_connections 2024-04-17T19:48:51.102 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:51.100+0000 7f4951400640 1 -- 172.21.15.44:0/54990484 >> 172.21.15.44:0/54990484 conn(0x7f494c067eb0 msgr2=0x7f494c153eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:48:51.102 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:51.100+0000 7f4951400640 1 -- 172.21.15.44:0/54990484 shutdown_connections 2024-04-17T19:48:51.103 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:51.100+0000 7f4951400640 1 -- 172.21.15.44:0/54990484 wait complete. 2024-04-17T19:48:51.107 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-04-17T19:48:51.108 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon b 2024-04-17T19:48:51.108 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2024-04-17T19:48:51.266 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:51.276+0000 7fccd9a00640 1 Processor -- start 2024-04-17T19:48:51.266 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:51.276+0000 7fccd9a00640 1 -- start start 2024-04-17T19:48:51.268 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:51.280+0000 7fccd9a00640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fccd40c41b0 0x7fccd4153a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:48:51.268 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:51.280+0000 7fccd9a00640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fccd415a340 0x7fccd4164060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:48:51.268 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:51.280+0000 7fccd9a00640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fccd40ca3e0 con 0x7fccd4159f30 2024-04-17T19:48:51.268 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:51.280+0000 7fccd9a00640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 -- 0x7fccd40ca650 con 0x7fccd415a340 2024-04-17T19:48:51.268 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:51.280+0000 7fccd9a00640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7fccd40ca930 con 0x7fccd40c41b0 2024-04-17T19:48:51.268 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:51.280+0000 7fccd3400640 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7fccd4159f30 0x7fccd40cb9b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.44:59224/0 (socket says 172.21.15.44:59224) 2024-04-17T19:48:51.268 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:51.280+0000 7fccd3400640 1 -- 172.21.15.44:0/3988193032 learned_addr learned my addr 172.21.15.44:0/3988193032 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-04-17T19:48:51.268 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:51.280+0000 7fccd3e00640 1 --2- 172.21.15.44:0/3988193032 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fccd40c41b0 0x7fccd4153a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:48:51.269 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:51.280+0000 7fccd9000640 1 --2- 172.21.15.44:0/3988193032 >> v2:172.21.15.62:3300/0 conn(0x7fccd415a340 0x7fccd4164060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:48:51.269 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:51.280+0000 7fccd3e00640 1 -- 172.21.15.44:0/3988193032 >> v2:172.21.15.62:3300/0 conn(0x7fccd415a340 msgr2=0x7fccd4164060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T19:48:51.269 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:51.280+0000 7fccd3e00640 1 --2- 172.21.15.44:0/3988193032 >> v2:172.21.15.62:3300/0 conn(0x7fccd415a340 0x7fccd4164060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:48:51.269 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:51.280+0000 7fccd3e00640 1 -- 172.21.15.44:0/3988193032 >> v1:172.21.15.62:6789/0 conn(0x7fccd4159f30 legacy=0x7fccd40cb9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:48:51.269 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:51.280+0000 7fccd3e00640 1 -- 172.21.15.44:0/3988193032 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fccd4159a10 con 0x7fccd40c41b0 2024-04-17T19:48:51.269 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:51.280+0000 7fccd2a00640 1 -- 172.21.15.44:0/3988193032 <== mon.1 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1174136040 0 0) 0x7fccd40ca3e0 con 0x7fccd4159f30 2024-04-17T19:48:51.271 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:51.284+0000 7fccd3e00640 1 --2- 172.21.15.44:0/3988193032 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fccd40c41b0 0x7fccd4153a00 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fccc40097c0 tx=0x7fccc401ec90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=db2da82bb8449208 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:48:51.272 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:51.284+0000 7fccd2a00640 1 -- 172.21.15.44:0/3988193032 <== mon.2 v2:172.21.15.62:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fccc40b5070 con 0x7fccd40c41b0 2024-04-17T19:48:51.272 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:51.284+0000 7fccd2a00640 1 -- 172.21.15.44:0/3988193032 <== mon.2 v2:172.21.15.62:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fccc40a8990 con 0x7fccd40c41b0 2024-04-17T19:48:51.272 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:51.284+0000 7fccd2a00640 1 -- 172.21.15.44:0/3988193032 <== mon.2 v2:172.21.15.62:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fccc40a8d60 con 0x7fccd40c41b0 2024-04-17T19:48:51.273 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:51.284+0000 7fccd9a00640 1 -- 172.21.15.44:0/3988193032 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fccd40c41b0 msgr2=0x7fccd4153a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:48:51.273 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:51.284+0000 7fccd9a00640 1 --2- 172.21.15.44:0/3988193032 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fccd40c41b0 0x7fccd4153a00 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fccc40097c0 tx=0x7fccc401ec90 comp rx=0 tx=0).stop 2024-04-17T19:48:51.273 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:51.284+0000 7fccd9a00640 1 -- 172.21.15.44:0/3988193032 shutdown_connections 2024-04-17T19:48:51.273 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:51.284+0000 7fccd9a00640 1 --2- 172.21.15.44:0/3988193032 >> v2:172.21.15.62:3300/0 conn(0x7fccd415a340 0x7fccd4164060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:48:51.273 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:51.284+0000 7fccd9a00640 1 --2- 172.21.15.44:0/3988193032 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fccd40c41b0 0x7fccd4153a00 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:48:51.274 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:51.284+0000 7fccd9a00640 1 -- 172.21.15.44:0/3988193032 >> 172.21.15.44:0/3988193032 conn(0x7fccd4072320 msgr2=0x7fccd4072730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:48:51.274 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:51.284+0000 7fccd9a00640 1 -- 172.21.15.44:0/3988193032 shutdown_connections 2024-04-17T19:48:51.274 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:51.284+0000 7fccd9a00640 1 -- 172.21.15.44:0/3988193032 wait complete. 2024-04-17T19:48:51.275 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:51.288+0000 7fccd9a00640 1 Processor -- start 2024-04-17T19:48:51.275 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:51.288+0000 7fccd9a00640 1 -- start start 2024-04-17T19:48:51.277 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:51.288+0000 7fccd9a00640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fccd40c41b0 0x7fccd414a160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:48:51.277 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:51.288+0000 7fccd9a00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fccd4159f30 0x7fccd41426c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:48:51.277 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:51.288+0000 7fccd9a00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fccd415a340 0x7fccd4142c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:48:51.277 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:51.288+0000 7fccd9a00640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fccd40c4890 con 0x7fccd4159f30 2024-04-17T19:48:51.277 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:51.288+0000 7fccd9a00640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7fccd41596e0 con 0x7fccd415a340 2024-04-17T19:48:51.278 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:51.288+0000 7fccd9a00640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7fccd40cc0c0 con 0x7fccd40c41b0 2024-04-17T19:48:51.278 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:51.288+0000 7fccd3400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fccd4159f30 0x7fccd41426c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:48:51.278 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:51.288+0000 7fccd3400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fccd4159f30 0x7fccd41426c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:32836/0 (socket says 172.21.15.44:32836) 2024-04-17T19:48:51.278 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:51.288+0000 7fccd3400640 1 -- 172.21.15.44:0/3571190365 learned_addr learned my addr 172.21.15.44:0/3571190365 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-04-17T19:48:51.278 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:51.288+0000 7fccd9000640 1 --2- 172.21.15.44:0/3571190365 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fccd415a340 0x7fccd4142c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:48:51.278 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:51.288+0000 7fccd3e00640 1 --2- 172.21.15.44:0/3571190365 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fccd40c41b0 0x7fccd414a160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:48:51.279 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:51.288+0000 7fccd3400640 1 -- 172.21.15.44:0/3571190365 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fccd40c41b0 msgr2=0x7fccd414a160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:48:51.279 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:51.288+0000 7fccd3400640 1 --2- 172.21.15.44:0/3571190365 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fccd40c41b0 0x7fccd414a160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:48:51.279 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:51.288+0000 7fccd3400640 1 -- 172.21.15.44:0/3571190365 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fccd415a340 msgr2=0x7fccd4142c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:48:51.279 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:51.288+0000 7fccd3400640 1 --2- 172.21.15.44:0/3571190365 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fccd415a340 0x7fccd4142c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:48:51.279 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:51.288+0000 7fccd3400640 1 -- 172.21.15.44:0/3571190365 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fccd41499d0 con 0x7fccd4159f30 2024-04-17T19:48:51.279 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:51.292+0000 7fccd3400640 1 --2- 172.21.15.44:0/3571190365 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fccd4159f30 0x7fccd41426c0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7fccc000c4b0 tx=0x7fccc000c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:48:51.280 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:51.292+0000 7fcccbe00640 1 -- 172.21.15.44:0/3571190365 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fccc0018070 con 0x7fccd4159f30 2024-04-17T19:48:51.280 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:51.292+0000 7fcccbe00640 1 -- 172.21.15.44:0/3571190365 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fccc0007500 con 0x7fccd4159f30 2024-04-17T19:48:51.280 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:51.292+0000 7fcccbe00640 1 -- 172.21.15.44:0/3571190365 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fccc0004a30 con 0x7fccd4159f30 2024-04-17T19:48:51.280 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:51.292+0000 7fccd9a00640 1 -- 172.21.15.44:0/3571190365 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fccd414a6a0 con 0x7fccd4159f30 2024-04-17T19:48:51.280 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:51.292+0000 7fccd9a00640 1 -- 172.21.15.44:0/3571190365 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fccd4151530 con 0x7fccd4159f30 2024-04-17T19:48:51.280 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:51.292+0000 7fccd9a00640 1 --2- 172.21.15.44:0/3571190365 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fccd4151d90 0x7fccd40cd800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:48:51.280 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:51.292+0000 7fccd9a00640 1 -- 172.21.15.44:0/3571190365 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7fccd41521a0 con 0x7fccd4151d90 2024-04-17T19:48:51.280 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:51.292+0000 7fccd3e00640 1 --2- 172.21.15.44:0/3571190365 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fccd4151d90 0x7fccd40cd800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:48:51.281 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:51.292+0000 7fccd3e00640 1 -- 172.21.15.44:0/3571190365 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fccd404fea0 con 0x7fccd4151d90 2024-04-17T19:48:51.281 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:51.292+0000 7fccd3e00640 1 --2- 172.21.15.44:0/3571190365 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fccd4151d90 0x7fccd40cd800 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fccd4073010 tx=0x7fccc401d4d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:48:51.282 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:51.292+0000 7fcccbe00640 1 -- 172.21.15.44:0/3571190365 <== mon.1 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fccc40b5040 con 0x7fccd4151d90 2024-04-17T19:48:51.282 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:51.296+0000 7fcccbe00640 1 -- 172.21.15.44:0/3571190365 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fccc0004bd0 con 0x7fccd4159f30 2024-04-17T19:48:51.283 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:51.296+0000 7fcccbe00640 1 --2- 172.21.15.44:0/3571190365 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7fccb4068280 0x7fccb406a790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:48:51.283 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:51.296+0000 7fcccbe00640 1 -- 172.21.15.44:0/3571190365 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6619+0+0 (secure 0 0 0) 0x7fccc0085e80 con 0x7fccd4159f30 2024-04-17T19:48:51.284 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:51.296+0000 7fcccbe00640 1 -- 172.21.15.44:0/3571190365 <== mon.1 v2:172.21.15.62:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7fccc40bb670 con 0x7fccd4151d90 2024-04-17T19:48:51.284 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:51.296+0000 7fcccbe00640 1 -- 172.21.15.44:0/3571190365 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fccd4151d90 msgr2=0x7fccd40cd800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:48:51.284 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:51.296+0000 7fcccbe00640 1 --2- 172.21.15.44:0/3571190365 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fccd4151d90 0x7fccd40cd800 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fccd4073010 tx=0x7fccc401d4d0 comp rx=0 tx=0).stop 2024-04-17T19:48:51.284 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:51.296+0000 7fcccbe00640 1 -- 172.21.15.44:0/3571190365 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fccd4151d90 msgr2=0x7fccd40cd800 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-04-17T19:48:51.284 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:51.296+0000 7fcccbe00640 1 --2- 172.21.15.44:0/3571190365 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fccd4151d90 0x7fccd40cd800 secure :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fccd4073010 tx=0x7fccc401d4d0 comp rx=0 tx=0).stop 2024-04-17T19:48:51.284 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:51.296+0000 7fccd9000640 1 --2- 172.21.15.44:0/3571190365 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7fccb4068280 0x7fccb406a790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:48:51.285 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:51.296+0000 7fccd9000640 1 --2- 172.21.15.44:0/3571190365 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7fccb4068280 0x7fccb406a790 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fccd40cea80 tx=0x7fcccc00b040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:48:51.291 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:51.304+0000 7fccd9a00640 1 --2- 172.21.15.44:0/3571190365 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fccd40cdd40 0x7fccd4152340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:48:51.291 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:51.304+0000 7fccd9a00640 1 -- 172.21.15.44:0/3571190365 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7fccd40cb280 con 0x7fccd40cdd40 2024-04-17T19:48:51.291 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:51.304+0000 7fccd3e00640 1 --2- 172.21.15.44:0/3571190365 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fccd40cdd40 0x7fccd4152340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:48:51.292 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:51.304+0000 7fccd3e00640 1 -- 172.21.15.44:0/3571190365 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fccd4151ab0 con 0x7fccd40cdd40 2024-04-17T19:48:51.292 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:51.304+0000 7fccd3e00640 1 --2- 172.21.15.44:0/3571190365 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fccd40cdd40 0x7fccd4152340 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fccc401d340 tx=0x7fccc401ba30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:48:51.292 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:51.304+0000 7fcccbe00640 1 -- 172.21.15.44:0/3571190365 <== mon.1 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fccc40044a0 con 0x7fccd40cdd40 2024-04-17T19:48:51.293 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:51.304+0000 7fcccbe00640 1 -- 172.21.15.44:0/3571190365 <== mon.1 v2:172.21.15.62:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+5057 (secure 0 0 0) 0x7fccc40044a0 con 0x7fccd40cdd40 2024-04-17T19:48:51.294 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:51.304+0000 7fcccbe00640 1 -- 172.21.15.44:0/3571190365 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fccd40cdd40 msgr2=0x7fccd4152340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:48:51.294 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:51.304+0000 7fcccbe00640 1 --2- 172.21.15.44:0/3571190365 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fccd40cdd40 0x7fccd4152340 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fccc401d340 tx=0x7fccc401ba30 comp rx=0 tx=0).stop 2024-04-17T19:48:51.294 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:51.304+0000 7fcccbe00640 1 -- 172.21.15.44:0/3571190365 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fccd40cdd40 msgr2=0x7fccd4152340 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-04-17T19:48:51.294 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:51.304+0000 7fcccbe00640 1 --2- 172.21.15.44:0/3571190365 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fccd40cdd40 0x7fccd4152340 secure :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fccc401d340 tx=0x7fccc401ba30 comp rx=0 tx=0).stop 2024-04-17T19:48:51.294 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2024-04-17T19:48:51.294 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "b", 2024-04-17T19:48:51.294 INFO:teuthology.orchestra.run.smithi044.stdout: "rank": 1, 2024-04-17T19:48:51.294 INFO:teuthology.orchestra.run.smithi044.stdout: "state": "peon", 2024-04-17T19:48:51.294 INFO:teuthology.orchestra.run.smithi044.stdout: "election_epoch": 14, 2024-04-17T19:48:51.294 INFO:teuthology.orchestra.run.smithi044.stdout: "uptime": 140737, 2024-04-17T19:48:51.295 INFO:teuthology.orchestra.run.smithi044.stdout: "quorum": [ 2024-04-17T19:48:51.295 INFO:teuthology.orchestra.run.smithi044.stdout: 0, 2024-04-17T19:48:51.295 INFO:teuthology.orchestra.run.smithi044.stdout: 1, 2024-04-17T19:48:51.295 INFO:teuthology.orchestra.run.smithi044.stdout: 2 2024-04-17T19:48:51.295 INFO:teuthology.orchestra.run.smithi044.stdout: ], 2024-04-17T19:48:51.295 INFO:teuthology.orchestra.run.smithi044.stdout: "quorum_age": 0, 2024-04-17T19:48:51.295 INFO:teuthology.orchestra.run.smithi044.stdout: "features": { 2024-04-17T19:48:51.295 INFO:teuthology.orchestra.run.smithi044.stdout: "required_con": "2450521708007866372", 2024-04-17T19:48:51.295 INFO:teuthology.orchestra.run.smithi044.stdout: "required_mon": [ 2024-04-17T19:48:51.295 INFO:teuthology.orchestra.run.smithi044.stdout: "kraken", 2024-04-17T19:48:51.295 INFO:teuthology.orchestra.run.smithi044.stdout: "luminous", 2024-04-17T19:48:51.295 INFO:teuthology.orchestra.run.smithi044.stdout: "mimic", 2024-04-17T19:48:51.295 INFO:teuthology.orchestra.run.smithi044.stdout: "osdmap-prune", 2024-04-17T19:48:51.295 INFO:teuthology.orchestra.run.smithi044.stdout: "nautilus", 2024-04-17T19:48:51.295 INFO:teuthology.orchestra.run.smithi044.stdout: "octopus", 2024-04-17T19:48:51.296 INFO:teuthology.orchestra.run.smithi044.stdout: "pacific", 2024-04-17T19:48:51.296 INFO:teuthology.orchestra.run.smithi044.stdout: "elector-pinging", 2024-04-17T19:48:51.296 INFO:teuthology.orchestra.run.smithi044.stdout: "quincy", 2024-04-17T19:48:51.296 INFO:teuthology.orchestra.run.smithi044.stdout: "reef", 2024-04-17T19:48:51.296 INFO:teuthology.orchestra.run.smithi044.stdout: "squid" 2024-04-17T19:48:51.296 INFO:teuthology.orchestra.run.smithi044.stdout: ], 2024-04-17T19:48:51.296 INFO:teuthology.orchestra.run.smithi044.stdout: "quorum_con": "4540701547738038271", 2024-04-17T19:48:51.296 INFO:teuthology.orchestra.run.smithi044.stdout: "quorum_mon": [ 2024-04-17T19:48:51.296 INFO:teuthology.orchestra.run.smithi044.stdout: "kraken", 2024-04-17T19:48:51.296 INFO:teuthology.orchestra.run.smithi044.stdout: "luminous", 2024-04-17T19:48:51.296 INFO:teuthology.orchestra.run.smithi044.stdout: "mimic", 2024-04-17T19:48:51.296 INFO:teuthology.orchestra.run.smithi044.stdout: "osdmap-prune", 2024-04-17T19:48:51.296 INFO:teuthology.orchestra.run.smithi044.stdout: "nautilus", 2024-04-17T19:48:51.296 INFO:teuthology.orchestra.run.smithi044.stdout: "octopus", 2024-04-17T19:48:51.297 INFO:teuthology.orchestra.run.smithi044.stdout: "pacific", 2024-04-17T19:48:51.297 INFO:teuthology.orchestra.run.smithi044.stdout: "elector-pinging", 2024-04-17T19:48:51.297 INFO:teuthology.orchestra.run.smithi044.stdout: "quincy", 2024-04-17T19:48:51.297 INFO:teuthology.orchestra.run.smithi044.stdout: "reef", 2024-04-17T19:48:51.297 INFO:teuthology.orchestra.run.smithi044.stdout: "squid" 2024-04-17T19:48:51.297 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T19:48:51.297 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T19:48:51.297 INFO:teuthology.orchestra.run.smithi044.stdout: "outside_quorum": [], 2024-04-17T19:48:51.297 INFO:teuthology.orchestra.run.smithi044.stdout: "extra_probe_peers": [], 2024-04-17T19:48:51.297 INFO:teuthology.orchestra.run.smithi044.stdout: "sync_provider": [], 2024-04-17T19:48:51.297 INFO:teuthology.orchestra.run.smithi044.stdout: "monmap": { 2024-04-17T19:48:51.297 INFO:teuthology.orchestra.run.smithi044.stdout: "epoch": 1, 2024-04-17T19:48:51.297 INFO:teuthology.orchestra.run.smithi044.stdout: "fsid": "703f77ca-79c6-4a66-b576-62c526cb1021", 2024-04-17T19:48:51.297 INFO:teuthology.orchestra.run.smithi044.stdout: "modified": "2024-04-17T19:45:55.379749Z", 2024-04-17T19:48:51.298 INFO:teuthology.orchestra.run.smithi044.stdout: "created": "2024-04-17T19:45:55.379749Z", 2024-04-17T19:48:51.298 INFO:teuthology.orchestra.run.smithi044.stdout: "min_mon_release": 19, 2024-04-17T19:48:51.298 INFO:teuthology.orchestra.run.smithi044.stdout: "min_mon_release_name": "squid", 2024-04-17T19:48:51.298 INFO:teuthology.orchestra.run.smithi044.stdout: "election_strategy": 1, 2024-04-17T19:48:51.298 INFO:teuthology.orchestra.run.smithi044.stdout: "disallowed_leaders: ": "", 2024-04-17T19:48:51.298 INFO:teuthology.orchestra.run.smithi044.stdout: "stretch_mode": false, 2024-04-17T19:48:51.298 INFO:teuthology.orchestra.run.smithi044.stdout: "tiebreaker_mon": "", 2024-04-17T19:48:51.298 INFO:teuthology.orchestra.run.smithi044.stdout: "removed_ranks: ": "", 2024-04-17T19:48:51.298 INFO:teuthology.orchestra.run.smithi044.stdout: "features": { 2024-04-17T19:48:51.298 INFO:teuthology.orchestra.run.smithi044.stdout: "persistent": [ 2024-04-17T19:48:51.298 INFO:teuthology.orchestra.run.smithi044.stdout: "kraken", 2024-04-17T19:48:51.298 INFO:teuthology.orchestra.run.smithi044.stdout: "luminous", 2024-04-17T19:48:51.298 INFO:teuthology.orchestra.run.smithi044.stdout: "mimic", 2024-04-17T19:48:51.298 INFO:teuthology.orchestra.run.smithi044.stdout: "osdmap-prune", 2024-04-17T19:48:51.299 INFO:teuthology.orchestra.run.smithi044.stdout: "nautilus", 2024-04-17T19:48:51.299 INFO:teuthology.orchestra.run.smithi044.stdout: "octopus", 2024-04-17T19:48:51.299 INFO:teuthology.orchestra.run.smithi044.stdout: "pacific", 2024-04-17T19:48:51.299 INFO:teuthology.orchestra.run.smithi044.stdout: "elector-pinging", 2024-04-17T19:48:51.299 INFO:teuthology.orchestra.run.smithi044.stdout: "quincy", 2024-04-17T19:48:51.299 INFO:teuthology.orchestra.run.smithi044.stdout: "reef", 2024-04-17T19:48:51.299 INFO:teuthology.orchestra.run.smithi044.stdout: "squid" 2024-04-17T19:48:51.299 INFO:teuthology.orchestra.run.smithi044.stdout: ], 2024-04-17T19:48:51.299 INFO:teuthology.orchestra.run.smithi044.stdout: "optional": [] 2024-04-17T19:48:51.299 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T19:48:51.299 INFO:teuthology.orchestra.run.smithi044.stdout: "mons": [ 2024-04-17T19:48:51.299 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T19:48:51.299 INFO:teuthology.orchestra.run.smithi044.stdout: "rank": 0, 2024-04-17T19:48:51.299 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "a", 2024-04-17T19:48:51.300 INFO:teuthology.orchestra.run.smithi044.stdout: "public_addrs": { 2024-04-17T19:48:51.300 INFO:teuthology.orchestra.run.smithi044.stdout: "addrvec": [ 2024-04-17T19:48:51.300 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T19:48:51.300 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "v2", 2024-04-17T19:48:51.300 INFO:teuthology.orchestra.run.smithi044.stdout: "addr": "172.21.15.44:3300", 2024-04-17T19:48:51.300 INFO:teuthology.orchestra.run.smithi044.stdout: "nonce": 0 2024-04-17T19:48:51.300 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T19:48:51.300 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T19:48:51.300 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "v1", 2024-04-17T19:48:51.300 INFO:teuthology.orchestra.run.smithi044.stdout: "addr": "172.21.15.44:6789", 2024-04-17T19:48:51.300 INFO:teuthology.orchestra.run.smithi044.stdout: "nonce": 0 2024-04-17T19:48:51.300 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T19:48:51.300 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T19:48:51.300 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T19:48:51.301 INFO:teuthology.orchestra.run.smithi044.stdout: "addr": "172.21.15.44:6789/0", 2024-04-17T19:48:51.301 INFO:teuthology.orchestra.run.smithi044.stdout: "public_addr": "172.21.15.44:6789/0", 2024-04-17T19:48:51.301 INFO:teuthology.orchestra.run.smithi044.stdout: "priority": 0, 2024-04-17T19:48:51.301 INFO:teuthology.orchestra.run.smithi044.stdout: "weight": 0, 2024-04-17T19:48:51.301 INFO:teuthology.orchestra.run.smithi044.stdout: "crush_location": "{}" 2024-04-17T19:48:51.301 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T19:48:51.301 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T19:48:51.301 INFO:teuthology.orchestra.run.smithi044.stdout: "rank": 1, 2024-04-17T19:48:51.301 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "b", 2024-04-17T19:48:51.301 INFO:teuthology.orchestra.run.smithi044.stdout: "public_addrs": { 2024-04-17T19:48:51.301 INFO:teuthology.orchestra.run.smithi044.stdout: "addrvec": [ 2024-04-17T19:48:51.301 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T19:48:51.301 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "v2", 2024-04-17T19:48:51.301 INFO:teuthology.orchestra.run.smithi044.stdout: "addr": "172.21.15.62:3300", 2024-04-17T19:48:51.301 INFO:teuthology.orchestra.run.smithi044.stdout: "nonce": 0 2024-04-17T19:48:51.302 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T19:48:51.302 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T19:48:51.302 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "v1", 2024-04-17T19:48:51.302 INFO:teuthology.orchestra.run.smithi044.stdout: "addr": "172.21.15.62:6789", 2024-04-17T19:48:51.302 INFO:teuthology.orchestra.run.smithi044.stdout: "nonce": 0 2024-04-17T19:48:51.302 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T19:48:51.302 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T19:48:51.302 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T19:48:51.302 INFO:teuthology.orchestra.run.smithi044.stdout: "addr": "172.21.15.62:6789/0", 2024-04-17T19:48:51.302 INFO:teuthology.orchestra.run.smithi044.stdout: "public_addr": "172.21.15.62:6789/0", 2024-04-17T19:48:51.302 INFO:teuthology.orchestra.run.smithi044.stdout: "priority": 0, 2024-04-17T19:48:51.302 INFO:teuthology.orchestra.run.smithi044.stdout: "weight": 0, 2024-04-17T19:48:51.302 INFO:teuthology.orchestra.run.smithi044.stdout: "crush_location": "{}" 2024-04-17T19:48:51.302 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T19:48:51.302 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T19:48:51.303 INFO:teuthology.orchestra.run.smithi044.stdout: "rank": 2, 2024-04-17T19:48:51.303 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "c", 2024-04-17T19:48:51.303 INFO:teuthology.orchestra.run.smithi044.stdout: "public_addrs": { 2024-04-17T19:48:51.303 INFO:teuthology.orchestra.run.smithi044.stdout: "addrvec": [ 2024-04-17T19:48:51.303 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T19:48:51.303 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "v2", 2024-04-17T19:48:51.303 INFO:teuthology.orchestra.run.smithi044.stdout: "addr": "172.21.15.62:3301", 2024-04-17T19:48:51.303 INFO:teuthology.orchestra.run.smithi044.stdout: "nonce": 0 2024-04-17T19:48:51.303 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T19:48:51.303 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T19:48:51.303 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "v1", 2024-04-17T19:48:51.303 INFO:teuthology.orchestra.run.smithi044.stdout: "addr": "172.21.15.62:6790", 2024-04-17T19:48:51.303 INFO:teuthology.orchestra.run.smithi044.stdout: "nonce": 0 2024-04-17T19:48:51.303 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T19:48:51.303 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T19:48:51.304 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T19:48:51.304 INFO:teuthology.orchestra.run.smithi044.stdout: "addr": "172.21.15.62:6790/0", 2024-04-17T19:48:51.304 INFO:teuthology.orchestra.run.smithi044.stdout: "public_addr": "172.21.15.62:6790/0", 2024-04-17T19:48:51.304 INFO:teuthology.orchestra.run.smithi044.stdout: "priority": 0, 2024-04-17T19:48:51.304 INFO:teuthology.orchestra.run.smithi044.stdout: "weight": 0, 2024-04-17T19:48:51.304 INFO:teuthology.orchestra.run.smithi044.stdout: "crush_location": "{}" 2024-04-17T19:48:51.304 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T19:48:51.304 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T19:48:51.304 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T19:48:51.304 INFO:teuthology.orchestra.run.smithi044.stdout: "feature_map": { 2024-04-17T19:48:51.304 INFO:teuthology.orchestra.run.smithi044.stdout: "mon": [ 2024-04-17T19:48:51.304 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T19:48:51.304 INFO:teuthology.orchestra.run.smithi044.stdout: "features": "0x3f03cffffffdffff", 2024-04-17T19:48:51.305 INFO:teuthology.orchestra.run.smithi044.stdout: "release": "luminous", 2024-04-17T19:48:51.305 INFO:teuthology.orchestra.run.smithi044.stdout: "num": 1 2024-04-17T19:48:51.305 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T19:48:51.305 INFO:teuthology.orchestra.run.smithi044.stdout: ], 2024-04-17T19:48:51.305 INFO:teuthology.orchestra.run.smithi044.stdout: "mds": [ 2024-04-17T19:48:51.305 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T19:48:51.305 INFO:teuthology.orchestra.run.smithi044.stdout: "features": "0x3f03cffffffdffff", 2024-04-17T19:48:51.305 INFO:teuthology.orchestra.run.smithi044.stdout: "release": "luminous", 2024-04-17T19:48:51.305 INFO:teuthology.orchestra.run.smithi044.stdout: "num": 2 2024-04-17T19:48:51.305 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T19:48:51.305 INFO:teuthology.orchestra.run.smithi044.stdout: ], 2024-04-17T19:48:51.305 INFO:teuthology.orchestra.run.smithi044.stdout: "osd": [ 2024-04-17T19:48:51.305 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T19:48:51.306 INFO:teuthology.orchestra.run.smithi044.stdout: "features": "0x3f03cffffffdffff", 2024-04-17T19:48:51.306 INFO:teuthology.orchestra.run.smithi044.stdout: "release": "luminous", 2024-04-17T19:48:51.306 INFO:teuthology.orchestra.run.smithi044.stdout: "num": 4 2024-04-17T19:48:51.306 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T19:48:51.306 INFO:teuthology.orchestra.run.smithi044.stdout: ], 2024-04-17T19:48:51.306 INFO:teuthology.orchestra.run.smithi044.stdout: "client": [ 2024-04-17T19:48:51.306 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T19:48:51.306 INFO:teuthology.orchestra.run.smithi044.stdout: "features": "0x3f03cffffffdffff", 2024-04-17T19:48:51.306 INFO:teuthology.orchestra.run.smithi044.stdout: "release": "luminous", 2024-04-17T19:48:51.306 INFO:teuthology.orchestra.run.smithi044.stdout: "num": 4 2024-04-17T19:48:51.306 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T19:48:51.306 INFO:teuthology.orchestra.run.smithi044.stdout: ], 2024-04-17T19:48:51.306 INFO:teuthology.orchestra.run.smithi044.stdout: "mgr": [ 2024-04-17T19:48:51.306 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T19:48:51.307 INFO:teuthology.orchestra.run.smithi044.stdout: "features": "0x3f03cffffffdffff", 2024-04-17T19:48:51.307 INFO:teuthology.orchestra.run.smithi044.stdout: "release": "luminous", 2024-04-17T19:48:51.307 INFO:teuthology.orchestra.run.smithi044.stdout: "num": 1 2024-04-17T19:48:51.307 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T19:48:51.307 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T19:48:51.307 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T19:48:51.307 INFO:teuthology.orchestra.run.smithi044.stdout: "stretch_mode": false 2024-04-17T19:48:51.307 INFO:teuthology.orchestra.run.smithi044.stdout:} 2024-04-17T19:48:51.308 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:51.304+0000 7fccd9a00640 1 -- 172.21.15.44:0/3571190365 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7fccb4068280 msgr2=0x7fccb406a790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:48:51.308 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:51.304+0000 7fccd9a00640 1 --2- 172.21.15.44:0/3571190365 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7fccb4068280 0x7fccb406a790 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fccd40cea80 tx=0x7fcccc00b040 comp rx=0 tx=0).stop 2024-04-17T19:48:51.308 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:51.304+0000 7fccd9a00640 1 -- 172.21.15.44:0/3571190365 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fccd4159f30 msgr2=0x7fccd41426c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:48:51.308 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:51.304+0000 7fccd9a00640 1 --2- 172.21.15.44:0/3571190365 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fccd4159f30 0x7fccd41426c0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7fccc000c4b0 tx=0x7fccc000c970 comp rx=0 tx=0).stop 2024-04-17T19:48:51.308 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:51.304+0000 7fccd9000640 1 -- 172.21.15.44:0/3571190365 reap_dead start 2024-04-17T19:48:51.308 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:51.308+0000 7fccd9a00640 1 -- 172.21.15.44:0/3571190365 shutdown_connections 2024-04-17T19:48:51.308 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:51.308+0000 7fccd9a00640 1 --2- 172.21.15.44:0/3571190365 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fccd4159f30 0x7fccd41426c0 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:48:51.308 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:51.308+0000 7fccd9a00640 1 -- 172.21.15.44:0/3571190365 >> 172.21.15.44:0/3571190365 conn(0x7fccd4072320 msgr2=0x7fccd40b3070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:48:51.308 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:51.308+0000 7fccd9a00640 1 -- 172.21.15.44:0/3571190365 shutdown_connections 2024-04-17T19:48:51.308 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:51.308+0000 7fccd9a00640 1 -- 172.21.15.44:0/3571190365 wait complete. 2024-04-17T19:48:51.314 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-04-17T19:48:51.314 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon c 2024-04-17T19:48:51.314 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2024-04-17T19:48:51.483 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:51.496+0000 7f43d9000640 1 Processor -- start 2024-04-17T19:48:51.483 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:51.496+0000 7f43d9000640 1 -- start start 2024-04-17T19:48:51.485 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:51.496+0000 7f43d9000640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f43d40716b0 0x7f43d40c7060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:48:51.485 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:51.496+0000 7f43d9000640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f43d41598d0 con 0x7f43d415d7c0 2024-04-17T19:48:51.485 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:51.496+0000 7f43d9000640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f43d4159bb0 con 0x7f43d4071ac0 2024-04-17T19:48:51.485 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:51.496+0000 7f43d9000640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7f43d4159e90 con 0x7f43d40716b0 2024-04-17T19:48:51.485 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:51.496+0000 7f43d3e00640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f43d415d7c0 0x7f43d4153120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:47358/0 (socket says 172.21.15.44:47358) 2024-04-17T19:48:51.485 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:51.496+0000 7f43d3e00640 1 -- 172.21.15.44:0/4159930424 learned_addr learned my addr 172.21.15.44:0/4159930424 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-04-17T19:48:51.486 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:51.496+0000 7f43d3400640 1 --2- 172.21.15.44:0/4159930424 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f43d40716b0 0x7f43d40c7060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:48:51.486 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:51.496+0000 7f43d2000640 1 -- 172.21.15.44:0/4159930424 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1864563780 0 0) 0x7f43d41598d0 con 0x7f43d415d7c0 2024-04-17T19:48:51.486 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:51.496+0000 7f43d2000640 1 -- 172.21.15.44:0/4159930424 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f43b8003530 con 0x7f43d415d7c0 2024-04-17T19:48:51.486 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:51.496+0000 7f43d2000640 1 -- 172.21.15.44:0/4159930424 <== mon.1 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3444752860 0 0) 0x7f43d4159bb0 con 0x7f43d4071ac0 2024-04-17T19:48:51.486 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:51.496+0000 7f43d2000640 1 -- 172.21.15.44:0/4159930424 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f43d41598d0 con 0x7f43d4071ac0 2024-04-17T19:48:51.486 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:51.496+0000 7f43d3400640 1 -- 172.21.15.44:0/4159930424 >> v1:172.21.15.62:6789/0 conn(0x7f43d4071ac0 legacy=0x7f43d415d0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:48:51.486 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:51.496+0000 7f43d3400640 1 -- 172.21.15.44:0/4159930424 >> v1:172.21.15.44:6789/0 conn(0x7f43d415d7c0 legacy=0x7f43d4153120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:48:51.486 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:51.496+0000 7f43d3400640 1 -- 172.21.15.44:0/4159930424 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f43d415a170 con 0x7f43d40716b0 2024-04-17T19:48:51.488 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:51.500+0000 7f43d3400640 1 --2- 172.21.15.44:0/4159930424 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f43d40716b0 0x7f43d40c7060 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f43c40097f0 tx=0x7f43c401c4a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5fd3404d4cf9a7cb server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:48:51.489 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:51.500+0000 7f43d2000640 1 -- 172.21.15.44:0/4159930424 <== mon.2 v2:172.21.15.62:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43c40b0070 con 0x7f43d40716b0 2024-04-17T19:48:51.489 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:51.500+0000 7f43d2000640 1 -- 172.21.15.44:0/4159930424 <== mon.2 v2:172.21.15.62:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f43c40ab600 con 0x7f43d40716b0 2024-04-17T19:48:51.489 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:51.500+0000 7f43d2000640 1 -- 172.21.15.44:0/4159930424 <== mon.2 v2:172.21.15.62:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43c40ab9b0 con 0x7f43d40716b0 2024-04-17T19:48:51.490 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:51.500+0000 7f43d9000640 1 -- 172.21.15.44:0/4159930424 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f43d40716b0 msgr2=0x7f43d40c7060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:48:51.490 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:51.500+0000 7f43d9000640 1 --2- 172.21.15.44:0/4159930424 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f43d40716b0 0x7f43d40c7060 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f43c40097f0 tx=0x7f43c401c4a0 comp rx=0 tx=0).stop 2024-04-17T19:48:51.490 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:51.500+0000 7f43d9000640 1 -- 172.21.15.44:0/4159930424 shutdown_connections 2024-04-17T19:48:51.490 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:51.500+0000 7f43d9000640 1 --2- 172.21.15.44:0/4159930424 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f43d40716b0 0x7f43d40c7060 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:48:51.490 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:51.500+0000 7f43d9000640 1 -- 172.21.15.44:0/4159930424 >> 172.21.15.44:0/4159930424 conn(0x7f43d406f5f0 msgr2=0x7f43d40cda50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:48:51.490 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:51.500+0000 7f43d9000640 1 -- 172.21.15.44:0/4159930424 shutdown_connections 2024-04-17T19:48:51.490 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:51.504+0000 7f43d9000640 1 -- 172.21.15.44:0/4159930424 wait complete. 2024-04-17T19:48:51.492 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:51.504+0000 7f43d9000640 1 Processor -- start 2024-04-17T19:48:51.492 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:51.504+0000 7f43d9000640 1 -- start start 2024-04-17T19:48:51.494 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:51.504+0000 7f43d9000640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f43d40716b0 0x7f43d40cbef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:48:51.494 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:51.504+0000 7f43d9000640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f43d4071ac0 0x7f43d414f3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:48:51.494 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:51.504+0000 7f43d9000640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f43d415d7c0 0x7f43d41f88a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:48:51.495 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:51.504+0000 7f43d9000640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f43d4167c90 con 0x7f43d4071ac0 2024-04-17T19:48:51.495 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:51.504+0000 7f43d9000640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f43d4167b10 con 0x7f43d40716b0 2024-04-17T19:48:51.495 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:51.504+0000 7f43d9000640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7f43d4167e10 con 0x7f43d415d7c0 2024-04-17T19:48:51.495 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:51.508+0000 7f43d3400640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f43d40716b0 0x7f43d40cbef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:48:51.495 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:51.508+0000 7f43d2a00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f43d4071ac0 0x7f43d414f3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:48:51.495 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:51.508+0000 7f43d3400640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f43d40716b0 0x7f43d40cbef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.44:40364/0 (socket says 172.21.15.44:40364) 2024-04-17T19:48:51.495 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:51.508+0000 7f43d3400640 1 -- 172.21.15.44:0/2198556478 learned_addr learned my addr 172.21.15.44:0/2198556478 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-04-17T19:48:51.495 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:51.508+0000 7f43d3e00640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f43d415d7c0 0x7f43d41f88a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:48:51.496 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:51.508+0000 7f43d3400640 1 -- 172.21.15.44:0/2198556478 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f43d415d7c0 msgr2=0x7f43d41f88a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:48:51.496 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:51.508+0000 7f43d3400640 1 --2- 172.21.15.44:0/2198556478 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f43d415d7c0 0x7f43d41f88a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:48:51.496 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:51.508+0000 7f43d3400640 1 -- 172.21.15.44:0/2198556478 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f43d4071ac0 msgr2=0x7f43d414f3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:48:51.496 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:51.508+0000 7f43d3400640 1 --2- 172.21.15.44:0/2198556478 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f43d4071ac0 0x7f43d414f3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:48:51.497 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:51.508+0000 7f43d3400640 1 -- 172.21.15.44:0/2198556478 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f43d40cc430 con 0x7f43d40716b0 2024-04-17T19:48:51.497 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:51.508+0000 7f43d3400640 1 --2- 172.21.15.44:0/2198556478 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f43d40716b0 0x7f43d40cbef0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f43c40ae040 tx=0x7f43c4019240 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:48:51.497 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:51.508+0000 7f43cb400640 1 -- 172.21.15.44:0/2198556478 <== mon.1 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43c40b0040 con 0x7f43d40716b0 2024-04-17T19:48:51.497 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:51.508+0000 7f43d9000640 1 -- 172.21.15.44:0/2198556478 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f43d414f8e0 con 0x7f43d40716b0 2024-04-17T19:48:51.497 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:51.508+0000 7f43cb400640 1 -- 172.21.15.44:0/2198556478 <== mon.1 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f43c40ab400 con 0x7f43d40716b0 2024-04-17T19:48:51.497 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:51.508+0000 7f43cb400640 1 -- 172.21.15.44:0/2198556478 <== mon.1 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43c40abbc0 con 0x7f43d40716b0 2024-04-17T19:48:51.497 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:51.508+0000 7f43d9000640 1 -- 172.21.15.44:0/2198556478 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f43d406c540 con 0x7f43d40716b0 2024-04-17T19:48:51.497 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:51.508+0000 7f43d9000640 1 --2- 172.21.15.44:0/2198556478 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f43d41f8de0 0x7f43d414e2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:48:51.498 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:51.508+0000 7f43d9000640 1 -- 172.21.15.44:0/2198556478 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7f43d414e7f0 con 0x7f43d41f8de0 2024-04-17T19:48:51.498 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:51.508+0000 7f43d2a00640 1 --2- 172.21.15.44:0/2198556478 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f43d41f8de0 0x7f43d414e2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:48:51.498 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:51.512+0000 7f43d2a00640 1 -- 172.21.15.44:0/2198556478 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f43d404fea0 con 0x7f43d41f8de0 2024-04-17T19:48:51.499 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:51.512+0000 7f43cb400640 1 -- 172.21.15.44:0/2198556478 <== mon.1 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f43c40bd020 con 0x7f43d40716b0 2024-04-17T19:48:51.499 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:51.512+0000 7f43d2a00640 1 --2- 172.21.15.44:0/2198556478 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f43d41f8de0 0x7f43d414e2b0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f43d41495f0 tx=0x7f43c000fc00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:48:51.500 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:51.512+0000 7f43cb400640 1 --2- 172.21.15.44:0/2198556478 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f43b40683b0 0x7f43b406a8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:48:51.500 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:51.512+0000 7f43cb400640 1 -- 172.21.15.44:0/2198556478 <== mon.1 v2:172.21.15.62:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6619+0+0 (secure 0 0 0) 0x7f43c4120740 con 0x7f43d40716b0 2024-04-17T19:48:51.500 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:51.512+0000 7f43cb400640 1 -- 172.21.15.44:0/2198556478 <== mon.2 v2:172.21.15.62:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43c00050d0 con 0x7f43d41f8de0 2024-04-17T19:48:51.500 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:51.512+0000 7f43d3e00640 1 --2- 172.21.15.44:0/2198556478 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f43b40683b0 0x7f43b406a8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:48:51.500 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:51.512+0000 7f43cb400640 1 -- 172.21.15.44:0/2198556478 <== mon.2 v2:172.21.15.62:3301/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f43c00050d0 con 0x7f43d41f8de0 2024-04-17T19:48:51.500 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:51.512+0000 7f43cb400640 1 -- 172.21.15.44:0/2198556478 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f43d41f8de0 msgr2=0x7f43d414e2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:48:51.501 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:51.512+0000 7f43cb400640 1 --2- 172.21.15.44:0/2198556478 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f43d41f8de0 0x7f43d414e2b0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f43d41495f0 tx=0x7f43c000fc00 comp rx=0 tx=0).stop 2024-04-17T19:48:51.501 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:51.512+0000 7f43cb400640 1 -- 172.21.15.44:0/2198556478 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f43d41f8de0 msgr2=0x7f43d414e2b0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-04-17T19:48:51.501 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:51.512+0000 7f43cb400640 1 --2- 172.21.15.44:0/2198556478 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f43d41f8de0 0x7f43d414e2b0 secure :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f43d41495f0 tx=0x7f43c000fc00 comp rx=0 tx=0).stop 2024-04-17T19:48:51.501 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:51.512+0000 7f43d3e00640 1 --2- 172.21.15.44:0/2198556478 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f43b40683b0 0x7f43b406a8c0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f43d4157920 tx=0x7f43cc001980 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:48:51.512 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:51.524+0000 7f43d9000640 1 --2- 172.21.15.44:0/2198556478 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f43d40cc600 0x7f43d41568d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:48:51.513 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:51.524+0000 7f43d9000640 1 -- 172.21.15.44:0/2198556478 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7f43d41f9320 con 0x7f43d40cc600 2024-04-17T19:48:51.513 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:51.524+0000 7f43d2a00640 1 --2- 172.21.15.44:0/2198556478 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f43d40cc600 0x7f43d41568d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:48:51.514 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:51.524+0000 7f43d2a00640 1 -- 172.21.15.44:0/2198556478 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f43d41532a0 con 0x7f43d40cc600 2024-04-17T19:48:51.514 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:51.528+0000 7f43d2a00640 1 --2- 172.21.15.44:0/2198556478 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f43d40cc600 0x7f43d41568d0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f43c0000c10 tx=0x7f43c0000ee0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:48:51.514 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:51.528+0000 7f43cb400640 1 -- 172.21.15.44:0/2198556478 <== mon.2 v2:172.21.15.62:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43c0007670 con 0x7f43d40cc600 2024-04-17T19:48:51.515 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:51.528+0000 7f43cb400640 1 -- 172.21.15.44:0/2198556478 <== mon.2 v2:172.21.15.62:3301/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4546 (secure 0 0 0) 0x7f43c00069d0 con 0x7f43d40cc600 2024-04-17T19:48:51.516 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:51.528+0000 7f43cb400640 1 -- 172.21.15.44:0/2198556478 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f43d40cc600 msgr2=0x7f43d41568d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:48:51.516 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:51.528+0000 7f43cb400640 1 --2- 172.21.15.44:0/2198556478 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f43d40cc600 0x7f43d41568d0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f43c0000c10 tx=0x7f43c0000ee0 comp rx=0 tx=0).stop 2024-04-17T19:48:51.516 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:51.528+0000 7f43cb400640 1 -- 172.21.15.44:0/2198556478 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f43d40cc600 msgr2=0x7f43d41568d0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-17T19:48:51.516 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:51.528+0000 7f43cb400640 1 --2- 172.21.15.44:0/2198556478 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f43d40cc600 0x7f43d41568d0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:48:51.516 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2024-04-17T19:48:51.516 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "c", 2024-04-17T19:48:51.516 INFO:teuthology.orchestra.run.smithi044.stdout: "rank": 2, 2024-04-17T19:48:51.516 INFO:teuthology.orchestra.run.smithi044.stdout: "state": "peon", 2024-04-17T19:48:51.516 INFO:teuthology.orchestra.run.smithi044.stdout: "election_epoch": 14, 2024-04-17T19:48:51.516 INFO:teuthology.orchestra.run.smithi044.stdout: "uptime": 15971, 2024-04-17T19:48:51.517 INFO:teuthology.orchestra.run.smithi044.stdout: "quorum": [ 2024-04-17T19:48:51.517 INFO:teuthology.orchestra.run.smithi044.stdout: 0, 2024-04-17T19:48:51.517 INFO:teuthology.orchestra.run.smithi044.stdout: 1, 2024-04-17T19:48:51.517 INFO:teuthology.orchestra.run.smithi044.stdout: 2 2024-04-17T19:48:51.517 INFO:teuthology.orchestra.run.smithi044.stdout: ], 2024-04-17T19:48:51.517 INFO:teuthology.orchestra.run.smithi044.stdout: "quorum_age": 1, 2024-04-17T19:48:51.517 INFO:teuthology.orchestra.run.smithi044.stdout: "features": { 2024-04-17T19:48:51.517 INFO:teuthology.orchestra.run.smithi044.stdout: "required_con": "2450521708007866372", 2024-04-17T19:48:51.517 INFO:teuthology.orchestra.run.smithi044.stdout: "required_mon": [ 2024-04-17T19:48:51.517 INFO:teuthology.orchestra.run.smithi044.stdout: "kraken", 2024-04-17T19:48:51.517 INFO:teuthology.orchestra.run.smithi044.stdout: "luminous", 2024-04-17T19:48:51.517 INFO:teuthology.orchestra.run.smithi044.stdout: "mimic", 2024-04-17T19:48:51.517 INFO:teuthology.orchestra.run.smithi044.stdout: "osdmap-prune", 2024-04-17T19:48:51.517 INFO:teuthology.orchestra.run.smithi044.stdout: "nautilus", 2024-04-17T19:48:51.517 INFO:teuthology.orchestra.run.smithi044.stdout: "octopus", 2024-04-17T19:48:51.518 INFO:teuthology.orchestra.run.smithi044.stdout: "pacific", 2024-04-17T19:48:51.518 INFO:teuthology.orchestra.run.smithi044.stdout: "elector-pinging", 2024-04-17T19:48:51.518 INFO:teuthology.orchestra.run.smithi044.stdout: "quincy", 2024-04-17T19:48:51.518 INFO:teuthology.orchestra.run.smithi044.stdout: "reef", 2024-04-17T19:48:51.518 INFO:teuthology.orchestra.run.smithi044.stdout: "squid" 2024-04-17T19:48:51.518 INFO:teuthology.orchestra.run.smithi044.stdout: ], 2024-04-17T19:48:51.518 INFO:teuthology.orchestra.run.smithi044.stdout: "quorum_con": "4540701547738038271", 2024-04-17T19:48:51.518 INFO:teuthology.orchestra.run.smithi044.stdout: "quorum_mon": [ 2024-04-17T19:48:51.518 INFO:teuthology.orchestra.run.smithi044.stdout: "kraken", 2024-04-17T19:48:51.518 INFO:teuthology.orchestra.run.smithi044.stdout: "luminous", 2024-04-17T19:48:51.518 INFO:teuthology.orchestra.run.smithi044.stdout: "mimic", 2024-04-17T19:48:51.518 INFO:teuthology.orchestra.run.smithi044.stdout: "osdmap-prune", 2024-04-17T19:48:51.518 INFO:teuthology.orchestra.run.smithi044.stdout: "nautilus", 2024-04-17T19:48:51.518 INFO:teuthology.orchestra.run.smithi044.stdout: "octopus", 2024-04-17T19:48:51.518 INFO:teuthology.orchestra.run.smithi044.stdout: "pacific", 2024-04-17T19:48:51.519 INFO:teuthology.orchestra.run.smithi044.stdout: "elector-pinging", 2024-04-17T19:48:51.519 INFO:teuthology.orchestra.run.smithi044.stdout: "quincy", 2024-04-17T19:48:51.519 INFO:teuthology.orchestra.run.smithi044.stdout: "reef", 2024-04-17T19:48:51.519 INFO:teuthology.orchestra.run.smithi044.stdout: "squid" 2024-04-17T19:48:51.519 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T19:48:51.519 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T19:48:51.519 INFO:teuthology.orchestra.run.smithi044.stdout: "outside_quorum": [], 2024-04-17T19:48:51.519 INFO:teuthology.orchestra.run.smithi044.stdout: "extra_probe_peers": [], 2024-04-17T19:48:51.519 INFO:teuthology.orchestra.run.smithi044.stdout: "sync_provider": [], 2024-04-17T19:48:51.519 INFO:teuthology.orchestra.run.smithi044.stdout: "monmap": { 2024-04-17T19:48:51.519 INFO:teuthology.orchestra.run.smithi044.stdout: "epoch": 1, 2024-04-17T19:48:51.519 INFO:teuthology.orchestra.run.smithi044.stdout: "fsid": "703f77ca-79c6-4a66-b576-62c526cb1021", 2024-04-17T19:48:51.519 INFO:teuthology.orchestra.run.smithi044.stdout: "modified": "2024-04-17T19:45:55.379749Z", 2024-04-17T19:48:51.519 INFO:teuthology.orchestra.run.smithi044.stdout: "created": "2024-04-17T19:45:55.379749Z", 2024-04-17T19:48:51.519 INFO:teuthology.orchestra.run.smithi044.stdout: "min_mon_release": 19, 2024-04-17T19:48:51.519 INFO:teuthology.orchestra.run.smithi044.stdout: "min_mon_release_name": "squid", 2024-04-17T19:48:51.520 INFO:teuthology.orchestra.run.smithi044.stdout: "election_strategy": 1, 2024-04-17T19:48:51.520 INFO:teuthology.orchestra.run.smithi044.stdout: "disallowed_leaders: ": "", 2024-04-17T19:48:51.520 INFO:teuthology.orchestra.run.smithi044.stdout: "stretch_mode": false, 2024-04-17T19:48:51.520 INFO:teuthology.orchestra.run.smithi044.stdout: "tiebreaker_mon": "", 2024-04-17T19:48:51.520 INFO:teuthology.orchestra.run.smithi044.stdout: "removed_ranks: ": "", 2024-04-17T19:48:51.520 INFO:teuthology.orchestra.run.smithi044.stdout: "features": { 2024-04-17T19:48:51.520 INFO:teuthology.orchestra.run.smithi044.stdout: "persistent": [ 2024-04-17T19:48:51.520 INFO:teuthology.orchestra.run.smithi044.stdout: "kraken", 2024-04-17T19:48:51.520 INFO:teuthology.orchestra.run.smithi044.stdout: "luminous", 2024-04-17T19:48:51.520 INFO:teuthology.orchestra.run.smithi044.stdout: "mimic", 2024-04-17T19:48:51.520 INFO:teuthology.orchestra.run.smithi044.stdout: "osdmap-prune", 2024-04-17T19:48:51.520 INFO:teuthology.orchestra.run.smithi044.stdout: "nautilus", 2024-04-17T19:48:51.520 INFO:teuthology.orchestra.run.smithi044.stdout: "octopus", 2024-04-17T19:48:51.520 INFO:teuthology.orchestra.run.smithi044.stdout: "pacific", 2024-04-17T19:48:51.520 INFO:teuthology.orchestra.run.smithi044.stdout: "elector-pinging", 2024-04-17T19:48:51.520 INFO:teuthology.orchestra.run.smithi044.stdout: "quincy", 2024-04-17T19:48:51.521 INFO:teuthology.orchestra.run.smithi044.stdout: "reef", 2024-04-17T19:48:51.521 INFO:teuthology.orchestra.run.smithi044.stdout: "squid" 2024-04-17T19:48:51.521 INFO:teuthology.orchestra.run.smithi044.stdout: ], 2024-04-17T19:48:51.521 INFO:teuthology.orchestra.run.smithi044.stdout: "optional": [] 2024-04-17T19:48:51.521 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T19:48:51.521 INFO:teuthology.orchestra.run.smithi044.stdout: "mons": [ 2024-04-17T19:48:51.521 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T19:48:51.521 INFO:teuthology.orchestra.run.smithi044.stdout: "rank": 0, 2024-04-17T19:48:51.521 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "a", 2024-04-17T19:48:51.521 INFO:teuthology.orchestra.run.smithi044.stdout: "public_addrs": { 2024-04-17T19:48:51.521 INFO:teuthology.orchestra.run.smithi044.stdout: "addrvec": [ 2024-04-17T19:48:51.521 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T19:48:51.521 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "v2", 2024-04-17T19:48:51.522 INFO:teuthology.orchestra.run.smithi044.stdout: "addr": "172.21.15.44:3300", 2024-04-17T19:48:51.522 INFO:teuthology.orchestra.run.smithi044.stdout: "nonce": 0 2024-04-17T19:48:51.522 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T19:48:51.522 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T19:48:51.522 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "v1", 2024-04-17T19:48:51.522 INFO:teuthology.orchestra.run.smithi044.stdout: "addr": "172.21.15.44:6789", 2024-04-17T19:48:51.522 INFO:teuthology.orchestra.run.smithi044.stdout: "nonce": 0 2024-04-17T19:48:51.522 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T19:48:51.522 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T19:48:51.522 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T19:48:51.522 INFO:teuthology.orchestra.run.smithi044.stdout: "addr": "172.21.15.44:6789/0", 2024-04-17T19:48:51.522 INFO:teuthology.orchestra.run.smithi044.stdout: "public_addr": "172.21.15.44:6789/0", 2024-04-17T19:48:51.522 INFO:teuthology.orchestra.run.smithi044.stdout: "priority": 0, 2024-04-17T19:48:51.522 INFO:teuthology.orchestra.run.smithi044.stdout: "weight": 0, 2024-04-17T19:48:51.523 INFO:teuthology.orchestra.run.smithi044.stdout: "crush_location": "{}" 2024-04-17T19:48:51.523 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T19:48:51.523 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T19:48:51.523 INFO:teuthology.orchestra.run.smithi044.stdout: "rank": 1, 2024-04-17T19:48:51.523 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "b", 2024-04-17T19:48:51.523 INFO:teuthology.orchestra.run.smithi044.stdout: "public_addrs": { 2024-04-17T19:48:51.523 INFO:teuthology.orchestra.run.smithi044.stdout: "addrvec": [ 2024-04-17T19:48:51.523 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T19:48:51.523 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "v2", 2024-04-17T19:48:51.523 INFO:teuthology.orchestra.run.smithi044.stdout: "addr": "172.21.15.62:3300", 2024-04-17T19:48:51.523 INFO:teuthology.orchestra.run.smithi044.stdout: "nonce": 0 2024-04-17T19:48:51.523 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T19:48:51.523 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T19:48:51.523 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "v1", 2024-04-17T19:48:51.523 INFO:teuthology.orchestra.run.smithi044.stdout: "addr": "172.21.15.62:6789", 2024-04-17T19:48:51.524 INFO:teuthology.orchestra.run.smithi044.stdout: "nonce": 0 2024-04-17T19:48:51.524 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T19:48:51.524 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T19:48:51.524 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T19:48:51.524 INFO:teuthology.orchestra.run.smithi044.stdout: "addr": "172.21.15.62:6789/0", 2024-04-17T19:48:51.524 INFO:teuthology.orchestra.run.smithi044.stdout: "public_addr": "172.21.15.62:6789/0", 2024-04-17T19:48:51.524 INFO:teuthology.orchestra.run.smithi044.stdout: "priority": 0, 2024-04-17T19:48:51.524 INFO:teuthology.orchestra.run.smithi044.stdout: "weight": 0, 2024-04-17T19:48:51.524 INFO:teuthology.orchestra.run.smithi044.stdout: "crush_location": "{}" 2024-04-17T19:48:51.524 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T19:48:51.524 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T19:48:51.524 INFO:teuthology.orchestra.run.smithi044.stdout: "rank": 2, 2024-04-17T19:48:51.524 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "c", 2024-04-17T19:48:51.524 INFO:teuthology.orchestra.run.smithi044.stdout: "public_addrs": { 2024-04-17T19:48:51.524 INFO:teuthology.orchestra.run.smithi044.stdout: "addrvec": [ 2024-04-17T19:48:51.524 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T19:48:51.525 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "v2", 2024-04-17T19:48:51.525 INFO:teuthology.orchestra.run.smithi044.stdout: "addr": "172.21.15.62:3301", 2024-04-17T19:48:51.525 INFO:teuthology.orchestra.run.smithi044.stdout: "nonce": 0 2024-04-17T19:48:51.525 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T19:48:51.525 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T19:48:51.525 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "v1", 2024-04-17T19:48:51.525 INFO:teuthology.orchestra.run.smithi044.stdout: "addr": "172.21.15.62:6790", 2024-04-17T19:48:51.525 INFO:teuthology.orchestra.run.smithi044.stdout: "nonce": 0 2024-04-17T19:48:51.525 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T19:48:51.525 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T19:48:51.525 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T19:48:51.525 INFO:teuthology.orchestra.run.smithi044.stdout: "addr": "172.21.15.62:6790/0", 2024-04-17T19:48:51.525 INFO:teuthology.orchestra.run.smithi044.stdout: "public_addr": "172.21.15.62:6790/0", 2024-04-17T19:48:51.525 INFO:teuthology.orchestra.run.smithi044.stdout: "priority": 0, 2024-04-17T19:48:51.526 INFO:teuthology.orchestra.run.smithi044.stdout: "weight": 0, 2024-04-17T19:48:51.526 INFO:teuthology.orchestra.run.smithi044.stdout: "crush_location": "{}" 2024-04-17T19:48:51.526 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T19:48:51.526 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T19:48:51.526 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T19:48:51.526 INFO:teuthology.orchestra.run.smithi044.stdout: "feature_map": { 2024-04-17T19:48:51.526 INFO:teuthology.orchestra.run.smithi044.stdout: "mon": [ 2024-04-17T19:48:51.526 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T19:48:51.526 INFO:teuthology.orchestra.run.smithi044.stdout: "features": "0x3f03cffffffdffff", 2024-04-17T19:48:51.526 INFO:teuthology.orchestra.run.smithi044.stdout: "release": "luminous", 2024-04-17T19:48:51.526 INFO:teuthology.orchestra.run.smithi044.stdout: "num": 1 2024-04-17T19:48:51.526 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T19:48:51.526 INFO:teuthology.orchestra.run.smithi044.stdout: ], 2024-04-17T19:48:51.526 INFO:teuthology.orchestra.run.smithi044.stdout: "client": [ 2024-04-17T19:48:51.527 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T19:48:51.527 INFO:teuthology.orchestra.run.smithi044.stdout: "features": "0x3f03cffffffdffff", 2024-04-17T19:48:51.527 INFO:teuthology.orchestra.run.smithi044.stdout: "release": "luminous", 2024-04-17T19:48:51.527 INFO:teuthology.orchestra.run.smithi044.stdout: "num": 1 2024-04-17T19:48:51.527 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T19:48:51.527 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T19:48:51.527 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T19:48:51.527 INFO:teuthology.orchestra.run.smithi044.stdout: "stretch_mode": false 2024-04-17T19:48:51.527 INFO:teuthology.orchestra.run.smithi044.stdout:} 2024-04-17T19:48:51.528 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:51.528+0000 7f43d9000640 1 -- 172.21.15.44:0/2198556478 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f43b40683b0 msgr2=0x7f43b406a8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:48:51.528 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:51.528+0000 7f43d9000640 1 --2- 172.21.15.44:0/2198556478 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f43b40683b0 0x7f43b406a8c0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f43d4157920 tx=0x7f43cc001980 comp rx=0 tx=0).stop 2024-04-17T19:48:51.528 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:51.528+0000 7f43d9000640 1 -- 172.21.15.44:0/2198556478 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f43d40716b0 msgr2=0x7f43d40cbef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:48:51.528 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:51.528+0000 7f43d9000640 1 --2- 172.21.15.44:0/2198556478 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f43d40716b0 0x7f43d40cbef0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f43c40ae040 tx=0x7f43c4019240 comp rx=0 tx=0).stop 2024-04-17T19:48:51.528 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:51.528+0000 7f43d3e00640 1 -- 172.21.15.44:0/2198556478 reap_dead start 2024-04-17T19:48:51.528 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:51.528+0000 7f43d9000640 1 -- 172.21.15.44:0/2198556478 shutdown_connections 2024-04-17T19:48:51.528 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:51.528+0000 7f43d9000640 1 --2- 172.21.15.44:0/2198556478 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f43d40716b0 0x7f43d40cbef0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:48:51.528 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:51.528+0000 7f43d9000640 1 -- 172.21.15.44:0/2198556478 >> 172.21.15.44:0/2198556478 conn(0x7f43d406f5f0 msgr2=0x7f43d4152560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:48:51.528 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:51.528+0000 7f43d9000640 1 -- 172.21.15.44:0/2198556478 shutdown_connections 2024-04-17T19:48:51.528 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:51.528+0000 7f43d9000640 1 -- 172.21.15.44:0/2198556478 wait complete. 2024-04-17T19:48:51.544 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-04-17T19:48:51.544 INFO:tasks.mon_thrash.mon_thrasher:triggering scrub 2024-04-17T19:48:51.544 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mon scrub 2024-04-17T19:48:51.708 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:51.720+0000 7fa8a0200640 1 Processor -- start 2024-04-17T19:48:51.708 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:51.720+0000 7fa8a0200640 1 -- start start 2024-04-17T19:48:51.709 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:51.720+0000 7fa8a0200640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fa89815c6b0 0x7fa8980c8cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:48:51.710 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:51.720+0000 7fa8a0200640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fa8980c3b70 0x7fa8980c3f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:48:51.710 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:51.720+0000 7fa8a0200640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa89815f200 con 0x7fa8980c91f0 2024-04-17T19:48:51.710 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:51.720+0000 7fa8a0200640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 -- 0x7fa89815fe10 con 0x7fa89815c6b0 2024-04-17T19:48:51.710 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:51.720+0000 7fa8a0200640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 -- 0x7fa89815f4e0 con 0x7fa8980c3b70 2024-04-17T19:48:51.711 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:51.724+0000 7fa89ce00640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7fa8980c91f0 0x7fa8980ca550 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:47368/0 (socket says 172.21.15.44:47368) 2024-04-17T19:48:51.711 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:51.724+0000 7fa89ce00640 1 -- 172.21.15.44:0/2902025459 learned_addr learned my addr 172.21.15.44:0/2902025459 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-04-17T19:48:51.711 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:51.724+0000 7fa89d800640 1 --2- 172.21.15.44:0/2902025459 >> v2:172.21.15.44:3300/0 conn(0x7fa89815c6b0 0x7fa8980c8cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:48:51.711 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:51.724+0000 7fa89e200640 1 --2- 172.21.15.44:0/2902025459 >> v2:172.21.15.62:3300/0 conn(0x7fa8980c3b70 0x7fa8980c3f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:48:51.711 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:51.724+0000 7fa897e00640 1 -- 172.21.15.44:0/2902025459 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1296330950 0 0) 0x7fa89815f200 con 0x7fa8980c91f0 2024-04-17T19:48:51.711 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:51.724+0000 7fa897e00640 1 -- 172.21.15.44:0/2902025459 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa880003530 con 0x7fa8980c91f0 2024-04-17T19:48:51.711 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:51.724+0000 7fa89d800640 1 -- 172.21.15.44:0/2902025459 >> v2:172.21.15.62:3300/0 conn(0x7fa8980c3b70 msgr2=0x7fa8980c3f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T19:48:51.711 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:51.724+0000 7fa89d800640 1 --2- 172.21.15.44:0/2902025459 >> v2:172.21.15.62:3300/0 conn(0x7fa8980c3b70 0x7fa8980c3f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:48:51.712 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:51.724+0000 7fa89d800640 1 -- 172.21.15.44:0/2902025459 >> v1:172.21.15.44:6789/0 conn(0x7fa8980c91f0 legacy=0x7fa8980ca550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:48:51.712 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:51.724+0000 7fa89d800640 1 -- 172.21.15.44:0/2902025459 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa89815f7c0 con 0x7fa89815c6b0 2024-04-17T19:48:51.716 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:51.728+0000 7fa89d800640 1 --2- 172.21.15.44:0/2902025459 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa89815c6b0 0x7fa8980c8cb0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7fa898070500 tx=0x7fa88c01ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a852dc4d8eb210c0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:48:51.716 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:51.728+0000 7fa897e00640 1 -- 172.21.15.44:0/2902025459 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa88c0b5070 con 0x7fa89815c6b0 2024-04-17T19:48:51.716 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:51.728+0000 7fa897e00640 1 -- 172.21.15.44:0/2902025459 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa88c0a8970 con 0x7fa89815c6b0 2024-04-17T19:48:51.716 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:51.728+0000 7fa897e00640 1 -- 172.21.15.44:0/2902025459 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa88c0a8d40 con 0x7fa89815c6b0 2024-04-17T19:48:51.717 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:51.728+0000 7fa8a0200640 1 -- 172.21.15.44:0/2902025459 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa89815c6b0 msgr2=0x7fa8980c8cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:48:51.718 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:51.728+0000 7fa8a0200640 1 --2- 172.21.15.44:0/2902025459 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa89815c6b0 0x7fa8980c8cb0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7fa898070500 tx=0x7fa88c01ec70 comp rx=0 tx=0).stop 2024-04-17T19:48:51.718 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:51.728+0000 7fa8a0200640 1 -- 172.21.15.44:0/2902025459 shutdown_connections 2024-04-17T19:48:51.718 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:51.728+0000 7fa8a0200640 1 --2- 172.21.15.44:0/2902025459 >> v2:172.21.15.62:3300/0 conn(0x7fa8980c3b70 0x7fa8980c3f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:48:51.718 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:51.728+0000 7fa8a0200640 1 --2- 172.21.15.44:0/2902025459 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa89815c6b0 0x7fa8980c8cb0 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:48:51.718 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:51.728+0000 7fa8a0200640 1 -- 172.21.15.44:0/2902025459 >> 172.21.15.44:0/2902025459 conn(0x7fa898073650 msgr2=0x7fa898073a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:48:51.718 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:51.728+0000 7fa8a0200640 1 -- 172.21.15.44:0/2902025459 shutdown_connections 2024-04-17T19:48:51.718 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:51.728+0000 7fa8a0200640 1 -- 172.21.15.44:0/2902025459 wait complete. 2024-04-17T19:48:51.721 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:51.732+0000 7fa8a0200640 1 Processor -- start 2024-04-17T19:48:51.721 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:51.732+0000 7fa8a0200640 1 -- start start 2024-04-17T19:48:51.724 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:51.736+0000 7fa8a0200640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fa8980c3b70 0x7fa89815cd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:48:51.724 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:51.736+0000 7fa8a0200640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa8980c91f0 0x7fa898154790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:48:51.724 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:51.736+0000 7fa8a0200640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa89815c6b0 0x7fa898148490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:48:51.724 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:51.736+0000 7fa8a0200640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fa8980cac60 con 0x7fa8980c91f0 2024-04-17T19:48:51.725 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:51.736+0000 7fa8a0200640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7fa8980c44c0 con 0x7fa89815c6b0 2024-04-17T19:48:51.725 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:51.736+0000 7fa8a0200640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7fa8980cade0 con 0x7fa8980c3b70 2024-04-17T19:48:51.725 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:51.736+0000 7fa89ce00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa8980c91f0 0x7fa898154790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:48:51.725 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:51.736+0000 7fa89ce00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa8980c91f0 0x7fa898154790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:32872/0 (socket says 172.21.15.44:32872) 2024-04-17T19:48:51.725 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:51.736+0000 7fa89ce00640 1 -- 172.21.15.44:0/3650086108 learned_addr learned my addr 172.21.15.44:0/3650086108 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-04-17T19:48:51.725 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:51.736+0000 7fa89d800640 1 --2- 172.21.15.44:0/3650086108 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fa8980c3b70 0x7fa89815cd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:48:51.725 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:51.736+0000 7fa89e200640 1 --2- 172.21.15.44:0/3650086108 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa89815c6b0 0x7fa898148490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:48:51.726 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:51.736+0000 7fa89ce00640 1 -- 172.21.15.44:0/3650086108 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fa8980c3b70 msgr2=0x7fa89815cd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:48:51.727 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:51.736+0000 7fa89ce00640 1 --2- 172.21.15.44:0/3650086108 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fa8980c3b70 0x7fa89815cd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:48:51.727 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:51.736+0000 7fa89ce00640 1 -- 172.21.15.44:0/3650086108 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa89815c6b0 msgr2=0x7fa898148490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:48:51.727 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:51.736+0000 7fa89ce00640 1 --2- 172.21.15.44:0/3650086108 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa89815c6b0 0x7fa898148490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:48:51.727 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:51.736+0000 7fa89ce00640 1 -- 172.21.15.44:0/3650086108 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa8981e62f0 con 0x7fa8980c91f0 2024-04-17T19:48:51.727 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:51.736+0000 7fa89e200640 1 --2- 172.21.15.44:0/3650086108 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa89815c6b0 0x7fa898148490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-17T19:48:51.727 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:51.736+0000 7fa89ce00640 1 --2- 172.21.15.44:0/3650086108 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa8980c91f0 0x7fa898154790 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7fa88400c390 tx=0x7fa88400c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:48:51.727 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:51.736+0000 7fa895600640 1 -- 172.21.15.44:0/3650086108 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa884017070 con 0x7fa8980c91f0 2024-04-17T19:48:51.727 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:51.736+0000 7fa895600640 1 -- 172.21.15.44:0/3650086108 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa884005d10 con 0x7fa8980c91f0 2024-04-17T19:48:51.727 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:51.736+0000 7fa8a0200640 1 -- 172.21.15.44:0/3650086108 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa8981e65d0 con 0x7fa8980c91f0 2024-04-17T19:48:51.727 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:51.736+0000 7fa8a0200640 1 -- 172.21.15.44:0/3650086108 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa8981e6b90 con 0x7fa8980c91f0 2024-04-17T19:48:51.727 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:51.736+0000 7fa895600640 1 -- 172.21.15.44:0/3650086108 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa884007310 con 0x7fa8980c91f0 2024-04-17T19:48:51.728 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:51.740+0000 7fa8a0200640 1 -- 172.21.15.44:0/3650086108 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa8740052a0 con 0x7fa8980c91f0 2024-04-17T19:48:51.728 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:51.740+0000 7fa895600640 1 -- 172.21.15.44:0/3650086108 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fa88401a070 con 0x7fa8980c91f0 2024-04-17T19:48:51.729 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:51.740+0000 7fa895600640 1 --2- 172.21.15.44:0/3650086108 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7fa8780683b0 0x7fa87806a8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:48:51.730 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:51.740+0000 7fa895600640 1 -- 172.21.15.44:0/3650086108 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6619+0+0 (secure 0 0 0) 0x7fa884085f80 con 0x7fa8980c91f0 2024-04-17T19:48:51.730 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:51.740+0000 7fa89d800640 1 --2- 172.21.15.44:0/3650086108 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7fa8780683b0 0x7fa87806a8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:48:51.731 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:51.744+0000 7fa89d800640 1 --2- 172.21.15.44:0/3650086108 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7fa8780683b0 0x7fa87806a8c0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fa88c0b2000 tx=0x7fa88c008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:48:51.738 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:51.748+0000 7fa895600640 1 -- 172.21.15.44:0/3650086108 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fa884055cb0 con 0x7fa8980c91f0 2024-04-17T19:48:52.059 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:52.072+0000 7fa8a0200640 1 -- 172.21.15.44:0/3650086108 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "mon scrub"} v 0) -- 0x7fa874005860 con 0x7fa8980c91f0 2024-04-17T19:48:52.060 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:52.072+0000 7fa895600640 1 -- 172.21.15.44:0/3650086108 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "mon scrub"}]=0 v0) ==== 57+0+0 (secure 0 0 0) 0x7fa884059fb0 con 0x7fa8980c91f0 2024-04-17T19:48:52.063 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:52.076+0000 7fa8a0200640 1 -- 172.21.15.44:0/3650086108 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7fa8780683b0 msgr2=0x7fa87806a8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:48:52.063 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:52.076+0000 7fa8a0200640 1 --2- 172.21.15.44:0/3650086108 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7fa8780683b0 0x7fa87806a8c0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fa88c0b2000 tx=0x7fa88c008040 comp rx=0 tx=0).stop 2024-04-17T19:48:52.063 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:52.076+0000 7fa8a0200640 1 -- 172.21.15.44:0/3650086108 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa8980c91f0 msgr2=0x7fa898154790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:48:52.063 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:52.076+0000 7fa8a0200640 1 --2- 172.21.15.44:0/3650086108 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa8980c91f0 0x7fa898154790 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7fa88400c390 tx=0x7fa88400c850 comp rx=0 tx=0).stop 2024-04-17T19:48:52.063 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:52.076+0000 7fa8a0200640 1 -- 172.21.15.44:0/3650086108 shutdown_connections 2024-04-17T19:48:52.063 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:52.076+0000 7fa8a0200640 1 --2- 172.21.15.44:0/3650086108 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7fa8780683b0 0x7fa87806a8c0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:48:52.063 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:52.076+0000 7fa8a0200640 1 --2- 172.21.15.44:0/3650086108 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa89815c6b0 0x7fa898148490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:48:52.063 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:52.076+0000 7fa8a0200640 1 --2- 172.21.15.44:0/3650086108 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa8980c91f0 0x7fa898154790 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:48:52.063 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:52.076+0000 7fa8a0200640 1 --2- 172.21.15.44:0/3650086108 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fa8980c3b70 0x7fa89815cd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:48:52.063 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:52.076+0000 7fa8a0200640 1 -- 172.21.15.44:0/3650086108 >> 172.21.15.44:0/3650086108 conn(0x7fa898073650 msgr2=0x7fa8980cc6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:48:52.063 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:52.076+0000 7fa8a0200640 1 -- 172.21.15.44:0/3650086108 shutdown_connections 2024-04-17T19:48:52.063 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:48:52.076+0000 7fa8a0200640 1 -- 172.21.15.44:0/3650086108 wait complete. 2024-04-17T19:48:52.094 INFO:tasks.mon_thrash.mon_thrasher:waiting for 10.0 secs before continuing thrashing 2024-04-17T19:48:53.971 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T19:48:53.975 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T19:49:02.095 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2024-04-17T19:49:02.095 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-04-17T19:49:02.343 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:02.356+0000 7f2066e00640 1 Processor -- start 2024-04-17T19:49:02.344 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:02.356+0000 7f2066e00640 1 -- start start 2024-04-17T19:49:02.347 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:02.360+0000 7f2066e00640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f20600cad10 0x7f206015f680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:49:02.347 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:02.360+0000 7f2066e00640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f206015fbc0 0x7f20600c94f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:49:02.347 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:02.360+0000 7f2066e00640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f20600c9a30 0x7f20600cb530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:49:02.347 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:02.360+0000 7f2066e00640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 -- 0x7f206015f1f0 con 0x7f20600cad10 2024-04-17T19:49:02.347 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:02.360+0000 7f2066e00640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 -- 0x7f206015bea0 con 0x7f20600c9a30 2024-04-17T19:49:02.347 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:02.360+0000 7f2066e00640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7f206015c180 con 0x7f206015fbc0 2024-04-17T19:49:02.347 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:02.360+0000 7f2065a00640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f20600cad10 0x7f206015f680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:49:02.348 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:02.360+0000 7f2065a00640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f20600cad10 0x7f206015f680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:41594/0 (socket says 172.21.15.44:41594) 2024-04-17T19:49:02.348 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:02.360+0000 7f2065a00640 1 -- 172.21.15.44:0/2890879880 learned_addr learned my addr 172.21.15.44:0/2890879880 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-04-17T19:49:02.348 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:02.360+0000 7f2065000640 1 --2- 172.21.15.44:0/2890879880 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f206015fbc0 0x7f20600c94f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:49:02.348 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:02.360+0000 7f2066400640 1 --2- 172.21.15.44:0/2890879880 >> v2:172.21.15.62:3300/0 conn(0x7f20600c9a30 0x7f20600cb530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:49:02.348 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:02.360+0000 7f2065a00640 1 -- 172.21.15.44:0/2890879880 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f206015fbc0 msgr2=0x7f20600c94f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T19:49:02.348 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:02.360+0000 7f2065a00640 1 --2- 172.21.15.44:0/2890879880 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f206015fbc0 0x7f20600c94f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:49:02.348 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:02.360+0000 7f2065a00640 1 -- 172.21.15.44:0/2890879880 >> v2:172.21.15.62:3300/0 conn(0x7f20600c9a30 msgr2=0x7f20600cb530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T19:49:02.348 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:02.360+0000 7f2065a00640 1 --2- 172.21.15.44:0/2890879880 >> v2:172.21.15.62:3300/0 conn(0x7f20600c9a30 0x7f20600cb530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:49:02.348 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:02.360+0000 7f2065a00640 1 -- 172.21.15.44:0/2890879880 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f206015c460 con 0x7f20600cad10 2024-04-17T19:49:02.353 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:02.364+0000 7f2065a00640 1 --2- 172.21.15.44:0/2890879880 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f20600cad10 0x7f206015f680 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f2060071430 tx=0x7f205401c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d22c5ba3f3bad17b server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:49:02.353 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:02.364+0000 7f205fe00640 1 -- 172.21.15.44:0/2890879880 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20540b0070 con 0x7f20600cad10 2024-04-17T19:49:02.353 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:02.364+0000 7f205fe00640 1 -- 172.21.15.44:0/2890879880 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f20540ab600 con 0x7f20600cad10 2024-04-17T19:49:02.353 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:02.364+0000 7f205fe00640 1 -- 172.21.15.44:0/2890879880 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20540ab9d0 con 0x7f20600cad10 2024-04-17T19:49:02.355 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:02.368+0000 7f2066e00640 1 -- 172.21.15.44:0/2890879880 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f20600cad10 msgr2=0x7f206015f680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:49:02.355 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:02.368+0000 7f2066e00640 1 --2- 172.21.15.44:0/2890879880 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f20600cad10 0x7f206015f680 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f2060071430 tx=0x7f205401c520 comp rx=0 tx=0).stop 2024-04-17T19:49:02.355 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:02.368+0000 7f2066e00640 1 -- 172.21.15.44:0/2890879880 shutdown_connections 2024-04-17T19:49:02.355 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:02.368+0000 7f2066e00640 1 --2- 172.21.15.44:0/2890879880 >> v2:172.21.15.62:3300/0 conn(0x7f20600c9a30 0x7f20600cb530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:49:02.355 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:02.368+0000 7f2066e00640 1 --2- 172.21.15.44:0/2890879880 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f206015fbc0 0x7f20600c94f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:49:02.355 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:02.368+0000 7f2066e00640 1 --2- 172.21.15.44:0/2890879880 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f20600cad10 0x7f206015f680 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:49:02.355 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:02.368+0000 7f2066e00640 1 -- 172.21.15.44:0/2890879880 >> 172.21.15.44:0/2890879880 conn(0x7f2060072150 msgr2=0x7f2060072560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:49:02.355 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:02.368+0000 7f2066e00640 1 -- 172.21.15.44:0/2890879880 shutdown_connections 2024-04-17T19:49:02.356 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:02.368+0000 7f2066e00640 1 -- 172.21.15.44:0/2890879880 wait complete. 2024-04-17T19:49:02.358 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:02.372+0000 7f2066e00640 1 Processor -- start 2024-04-17T19:49:02.359 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:02.372+0000 7f2066e00640 1 -- start start 2024-04-17T19:49:02.361 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:02.372+0000 7f2066e00640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f20600c9a30 0x7f206014dc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:49:02.361 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:02.372+0000 7f2066e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f20600cad10 0x7f20600c6fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:49:02.362 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:02.372+0000 7f2066e00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f206015fbc0 0x7f206014c3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:49:02.362 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:02.372+0000 7f2066e00640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f20600cb120 con 0x7f20600cad10 2024-04-17T19:49:02.362 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:02.372+0000 7f2066e00640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f20600ca1e0 con 0x7f206015fbc0 2024-04-17T19:49:02.362 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:02.372+0000 7f2066e00640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7f206014e680 con 0x7f20600c9a30 2024-04-17T19:49:02.362 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:02.372+0000 7f2065a00640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f20600c9a30 0x7f206014dc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:49:02.362 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:02.372+0000 7f2065000640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f20600cad10 0x7f20600c6fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:49:02.362 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:02.372+0000 7f2065a00640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f20600c9a30 0x7f206014dc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3301/0 says I am v2:172.21.15.44:57498/0 (socket says 172.21.15.44:57498) 2024-04-17T19:49:02.362 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:02.372+0000 7f2065a00640 1 -- 172.21.15.44:0/3480871414 learned_addr learned my addr 172.21.15.44:0/3480871414 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-04-17T19:49:02.362 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:02.372+0000 7f2066400640 1 --2- 172.21.15.44:0/3480871414 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f206015fbc0 0x7f206014c3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:49:02.363 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:02.376+0000 7f2066400640 1 -- 172.21.15.44:0/3480871414 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f20600c9a30 msgr2=0x7f206014dc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:49:02.363 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:02.376+0000 7f2066400640 1 --2- 172.21.15.44:0/3480871414 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f20600c9a30 0x7f206014dc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:49:02.363 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:02.376+0000 7f2066400640 1 -- 172.21.15.44:0/3480871414 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f20600cad10 msgr2=0x7f20600c6fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:49:02.363 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:02.376+0000 7f2066400640 1 --2- 172.21.15.44:0/3480871414 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f20600cad10 0x7f20600c6fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:49:02.363 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:02.376+0000 7f2066400640 1 -- 172.21.15.44:0/3480871414 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f206014e1b0 con 0x7f206015fbc0 2024-04-17T19:49:02.363 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:02.376+0000 7f2065a00640 1 --2- 172.21.15.44:0/3480871414 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f20600c9a30 0x7f206014dc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-17T19:49:02.364 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:02.376+0000 7f2066400640 1 --2- 172.21.15.44:0/3480871414 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f206015fbc0 0x7f206014c3e0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f205800ea80 tx=0x7f205800ef40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:49:02.364 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:02.376+0000 7f205d600640 1 -- 172.21.15.44:0/3480871414 <== mon.1 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2058018020 con 0x7f206015fbc0 2024-04-17T19:49:02.364 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:02.376+0000 7f205d600640 1 -- 172.21.15.44:0/3480871414 <== mon.1 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f205800bc00 con 0x7f206015fbc0 2024-04-17T19:49:02.364 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:02.376+0000 7f205d600640 1 -- 172.21.15.44:0/3480871414 <== mon.1 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2058014400 con 0x7f206015fbc0 2024-04-17T19:49:02.364 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:02.376+0000 7f2066e00640 1 -- 172.21.15.44:0/3480871414 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f20600c7ee0 con 0x7f206015fbc0 2024-04-17T19:49:02.364 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:02.376+0000 7f2066e00640 1 -- 172.21.15.44:0/3480871414 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f20600c8460 con 0x7f206015fbc0 2024-04-17T19:49:02.365 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:02.376+0000 7f2066e00640 1 -- 172.21.15.44:0/3480871414 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f206004fea0 con 0x7f206015fbc0 2024-04-17T19:49:02.368 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:02.380+0000 7f205d600640 1 -- 172.21.15.44:0/3480871414 <== mon.1 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f205801b020 con 0x7f206015fbc0 2024-04-17T19:49:02.369 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:02.380+0000 7f205d600640 1 --2- 172.21.15.44:0/3480871414 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f2040068380 0x7f204006a890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:49:02.369 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:02.380+0000 7f205d600640 1 -- 172.21.15.44:0/3480871414 <== mon.1 v2:172.21.15.62:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6619+0+0 (secure 0 0 0) 0x7f20580878a0 con 0x7f206015fbc0 2024-04-17T19:49:02.370 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:02.380+0000 7f2065a00640 1 --2- 172.21.15.44:0/3480871414 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f2040068380 0x7f204006a890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:49:02.371 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:02.384+0000 7f2065a00640 1 --2- 172.21.15.44:0/3480871414 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f2040068380 0x7f204006a890 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f205401abd0 tx=0x7f2054008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:49:02.382 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:02.392+0000 7f205d600640 1 -- 172.21.15.44:0/3480871414 <== mon.1 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f2058022070 con 0x7f206015fbc0 2024-04-17T19:49:02.840 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:02.852+0000 7f2066e00640 1 -- 172.21.15.44:0/3480871414 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f206006d2e0 con 0x7f206015fbc0 2024-04-17T19:49:02.841 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:02.852+0000 7f205d600640 1 -- 172.21.15.44:0/3480871414 <== mon.1 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1557 (secure 0 0 0) 0x7f20580574f0 con 0x7f206015fbc0 2024-04-17T19:49:02.841 INFO:teuthology.orchestra.run.smithi044.stdout:{"election_epoch":14,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":12,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"703f77ca-79c6-4a66-b576-62c526cb1021","modified":"2024-04-17T19:45:55.379749Z","created":"2024-04-17T19:45:55.379749Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:3300","nonce":0},{"type":"v1","addr":"172.21.15.44:6789","nonce":0}]},"addr":"172.21.15.44:6789/0","public_addr":"172.21.15.44:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:3300","nonce":0},{"type":"v1","addr":"172.21.15.62:6789","nonce":0}]},"addr":"172.21.15.62:6789/0","public_addr":"172.21.15.62:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:3301","nonce":0},{"type":"v1","addr":"172.21.15.62:6790","nonce":0}]},"addr":"172.21.15.62:6790/0","public_addr":"172.21.15.62:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-04-17T19:49:02.844 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:02.856+0000 7f2066e00640 1 -- 172.21.15.44:0/3480871414 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f2040068380 msgr2=0x7f204006a890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:49:02.844 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:02.856+0000 7f2066e00640 1 --2- 172.21.15.44:0/3480871414 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f2040068380 0x7f204006a890 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f205401abd0 tx=0x7f2054008040 comp rx=0 tx=0).stop 2024-04-17T19:49:02.844 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:02.856+0000 7f2066e00640 1 -- 172.21.15.44:0/3480871414 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f206015fbc0 msgr2=0x7f206014c3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:49:02.844 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:02.856+0000 7f2066e00640 1 --2- 172.21.15.44:0/3480871414 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f206015fbc0 0x7f206014c3e0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f205800ea80 tx=0x7f205800ef40 comp rx=0 tx=0).stop 2024-04-17T19:49:02.844 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:02.856+0000 7f2066e00640 1 -- 172.21.15.44:0/3480871414 shutdown_connections 2024-04-17T19:49:02.845 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:02.856+0000 7f2066e00640 1 --2- 172.21.15.44:0/3480871414 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f2040068380 0x7f204006a890 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:49:02.845 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:02.856+0000 7f2066e00640 1 --2- 172.21.15.44:0/3480871414 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f206015fbc0 0x7f206014c3e0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:49:02.845 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:02.856+0000 7f2066e00640 1 --2- 172.21.15.44:0/3480871414 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f20600cad10 0x7f20600c6fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:49:02.845 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:02.856+0000 7f2066e00640 1 --2- 172.21.15.44:0/3480871414 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f20600c9a30 0x7f206014dc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:49:02.845 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:02.856+0000 7f2066e00640 1 -- 172.21.15.44:0/3480871414 >> 172.21.15.44:0/3480871414 conn(0x7f2060072150 msgr2=0x7f2060072560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:49:02.845 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:02.856+0000 7f2066e00640 1 -- 172.21.15.44:0/3480871414 shutdown_connections 2024-04-17T19:49:02.845 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:02.856+0000 7f2066e00640 1 -- 172.21.15.44:0/3480871414 wait complete. 2024-04-17T19:49:02.874 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2024-04-17T19:49:02.874 INFO:tasks.mon_thrash.mon_thrasher:making sure all monitors are in the quorum 2024-04-17T19:49:02.874 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon a 2024-04-17T19:49:02.875 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2024-04-17T19:49:03.125 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:03.136+0000 7fe9fd200640 1 Processor -- start 2024-04-17T19:49:03.125 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:03.136+0000 7fe9fd200640 1 -- start start 2024-04-17T19:49:03.128 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:03.140+0000 7fe9fd200640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fe9f8163060 0x7fe9f8165480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:49:03.128 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:03.140+0000 7fe9fd200640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe9f80ca3e0 con 0x7fe9f80c41b0 2024-04-17T19:49:03.128 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:03.140+0000 7fe9fd200640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe9f815a640 con 0x7fe9f8153a00 2024-04-17T19:49:03.128 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:03.140+0000 7fe9fd200640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 -- 0x7fe9f8153e10 con 0x7fe9f8163060 2024-04-17T19:49:03.128 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:03.140+0000 7fe9f7400640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7fe9f80c41b0 0x7fe9f8159f30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:37752/0 (socket says 172.21.15.44:37752) 2024-04-17T19:49:03.128 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:03.140+0000 7fe9f7400640 1 -- 172.21.15.44:0/3892453772 learned_addr learned my addr 172.21.15.44:0/3892453772 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-04-17T19:49:03.128 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:03.140+0000 7fe9f7e00640 1 --2- 172.21.15.44:0/3892453772 >> v2:172.21.15.62:3300/0 conn(0x7fe9f8163060 0x7fe9f8165480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:49:03.129 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:03.140+0000 7fe9f6000640 1 -- 172.21.15.44:0/3892453772 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1805580972 0 0) 0x7fe9f80ca3e0 con 0x7fe9f80c41b0 2024-04-17T19:49:03.129 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:03.140+0000 7fe9f6000640 1 -- 172.21.15.44:0/3892453772 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe9dc003530 con 0x7fe9f80c41b0 2024-04-17T19:49:03.129 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:03.140+0000 7fe9f7e00640 1 -- 172.21.15.44:0/3892453772 >> v1:172.21.15.62:6789/0 conn(0x7fe9f8153a00 legacy=0x7fe9f80cb9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:49:03.129 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:03.140+0000 7fe9f7e00640 1 -- 172.21.15.44:0/3892453772 >> v1:172.21.15.44:6789/0 conn(0x7fe9f80c41b0 legacy=0x7fe9f8159f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:49:03.130 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:03.140+0000 7fe9f7e00640 1 -- 172.21.15.44:0/3892453772 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe9f80ca650 con 0x7fe9f8163060 2024-04-17T19:49:03.134 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:03.144+0000 7fe9f7e00640 1 --2- 172.21.15.44:0/3892453772 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe9f8163060 0x7fe9f8165480 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fe9f0009d90 tx=0x7fe9f001f150 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9005c62816141ed6 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:49:03.134 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:03.148+0000 7fe9f6000640 1 -- 172.21.15.44:0/3892453772 <== mon.1 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9f00b4070 con 0x7fe9f8163060 2024-04-17T19:49:03.134 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:03.148+0000 7fe9f6000640 1 -- 172.21.15.44:0/3892453772 <== mon.1 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe9f00af600 con 0x7fe9f8163060 2024-04-17T19:49:03.134 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:03.148+0000 7fe9f6000640 1 -- 172.21.15.44:0/3892453772 <== mon.1 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9f00af9b0 con 0x7fe9f8163060 2024-04-17T19:49:03.136 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:03.148+0000 7fe9fd200640 1 -- 172.21.15.44:0/3892453772 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe9f8163060 msgr2=0x7fe9f8165480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:49:03.136 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:03.148+0000 7fe9fd200640 1 --2- 172.21.15.44:0/3892453772 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe9f8163060 0x7fe9f8165480 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fe9f0009d90 tx=0x7fe9f001f150 comp rx=0 tx=0).stop 2024-04-17T19:49:03.136 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:03.148+0000 7fe9fd200640 1 -- 172.21.15.44:0/3892453772 shutdown_connections 2024-04-17T19:49:03.136 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:03.148+0000 7fe9fd200640 1 --2- 172.21.15.44:0/3892453772 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe9f8163060 0x7fe9f8165480 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:49:03.136 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:03.148+0000 7fe9fd200640 1 -- 172.21.15.44:0/3892453772 >> 172.21.15.44:0/3892453772 conn(0x7fe9f8072320 msgr2=0x7fe9f8072730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:49:03.136 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:03.148+0000 7fe9fd200640 1 -- 172.21.15.44:0/3892453772 shutdown_connections 2024-04-17T19:49:03.137 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:03.148+0000 7fe9fd200640 1 -- 172.21.15.44:0/3892453772 wait complete. 2024-04-17T19:49:03.139 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:03.152+0000 7fe9fd200640 1 Processor -- start 2024-04-17T19:49:03.139 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:03.152+0000 7fe9fd200640 1 -- start start 2024-04-17T19:49:03.143 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:03.152+0000 7fe9fd200640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe9f80c41b0 0x7fe9f814ec50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:49:03.143 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:03.152+0000 7fe9fd200640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe9f8153a00 0x7fe9f8151e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:49:03.143 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:03.152+0000 7fe9fd200640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fe9f8163060 0x7fe9f8145bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:49:03.143 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:03.152+0000 7fe9fd200640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fe9f815dbb0 con 0x7fe9f80c41b0 2024-04-17T19:49:03.143 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:03.152+0000 7fe9fd200640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7fe9f8159a10 con 0x7fe9f8153a00 2024-04-17T19:49:03.143 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:03.152+0000 7fe9fd200640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7fe9f81596e0 con 0x7fe9f8163060 2024-04-17T19:49:03.143 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:03.156+0000 7fe9f7400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe9f80c41b0 0x7fe9f814ec50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:49:03.143 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:03.156+0000 7fe9f7400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe9f80c41b0 0x7fe9f814ec50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:41622/0 (socket says 172.21.15.44:41622) 2024-04-17T19:49:03.143 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:03.156+0000 7fe9f7400640 1 -- 172.21.15.44:0/2169219972 learned_addr learned my addr 172.21.15.44:0/2169219972 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-04-17T19:49:03.143 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:03.156+0000 7fe9f6a00640 1 --2- 172.21.15.44:0/2169219972 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe9f8153a00 0x7fe9f8151e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:49:03.143 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:03.156+0000 7fe9f7e00640 1 --2- 172.21.15.44:0/2169219972 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fe9f8163060 0x7fe9f8145bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:49:03.144 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:03.156+0000 7fe9f7400640 1 -- 172.21.15.44:0/2169219972 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fe9f8163060 msgr2=0x7fe9f8145bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:49:03.145 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:03.156+0000 7fe9f7400640 1 --2- 172.21.15.44:0/2169219972 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fe9f8163060 0x7fe9f8145bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:49:03.145 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:03.156+0000 7fe9f7400640 1 -- 172.21.15.44:0/2169219972 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe9f8153a00 msgr2=0x7fe9f8151e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:49:03.145 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:03.156+0000 7fe9f7400640 1 --2- 172.21.15.44:0/2169219972 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe9f8153a00 0x7fe9f8151e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:49:03.145 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:03.156+0000 7fe9f7400640 1 -- 172.21.15.44:0/2169219972 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe9f81460f0 con 0x7fe9f80c41b0 2024-04-17T19:49:03.145 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:03.156+0000 7fe9f7e00640 1 --2- 172.21.15.44:0/2169219972 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fe9f8163060 0x7fe9f8145bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-17T19:49:03.145 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:03.156+0000 7fe9f7400640 1 --2- 172.21.15.44:0/2169219972 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe9f80c41b0 0x7fe9f814ec50 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7fe9e800c420 tx=0x7fe9e800c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:49:03.145 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:03.156+0000 7fe9ef400640 1 -- 172.21.15.44:0/2169219972 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9e8017070 con 0x7fe9f80c41b0 2024-04-17T19:49:03.145 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:03.156+0000 7fe9ef400640 1 -- 172.21.15.44:0/2169219972 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe9e8005cf0 con 0x7fe9f80c41b0 2024-04-17T19:49:03.145 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:03.156+0000 7fe9ef400640 1 -- 172.21.15.44:0/2169219972 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9e80072d0 con 0x7fe9f80c41b0 2024-04-17T19:49:03.145 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:03.156+0000 7fe9fd200640 1 -- 172.21.15.44:0/2169219972 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe9f8149ff0 con 0x7fe9f80c41b0 2024-04-17T19:49:03.145 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:03.156+0000 7fe9fd200640 1 -- 172.21.15.44:0/2169219972 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe9f81f0010 con 0x7fe9f80c41b0 2024-04-17T19:49:03.146 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:03.156+0000 7fe9fd200640 1 --2- 172.21.15.44:0/2169219972 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe9f81f0810 0x7fe9f814d060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:49:03.146 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:03.156+0000 7fe9fd200640 1 -- 172.21.15.44:0/2169219972 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fe9f8149da0 con 0x7fe9f81f0810 2024-04-17T19:49:03.146 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:03.156+0000 7fe9f6a00640 1 --2- 172.21.15.44:0/2169219972 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe9f81f0810 0x7fe9f814d060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:49:03.147 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:03.160+0000 7fe9f6a00640 1 -- 172.21.15.44:0/2169219972 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fe9f81efb20 con 0x7fe9f81f0810 2024-04-17T19:49:03.147 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:03.160+0000 7fe9f6a00640 1 --2- 172.21.15.44:0/2169219972 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe9f81f0810 0x7fe9f814d060 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7fe9e400f470 tx=0x7fe9e400f930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:49:03.148 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:03.160+0000 7fe9ef400640 1 -- 172.21.15.44:0/2169219972 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fe9e801a070 con 0x7fe9f80c41b0 2024-04-17T19:49:03.150 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:03.160+0000 7fe9ef400640 1 --2- 172.21.15.44:0/2169219972 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7fe9d8068380 0x7fe9d806a890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:49:03.150 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:03.160+0000 7fe9ef400640 1 -- 172.21.15.44:0/2169219972 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9e4019070 con 0x7fe9f81f0810 2024-04-17T19:49:03.150 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:03.160+0000 7fe9ef400640 1 -- 172.21.15.44:0/2169219972 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6619+0+0 (secure 0 0 0) 0x7fe9e80861c0 con 0x7fe9f80c41b0 2024-04-17T19:49:03.150 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:03.164+0000 7fe9ef400640 1 -- 172.21.15.44:0/2169219972 <== mon.0 v2:172.21.15.44:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7fe9e4005320 con 0x7fe9f81f0810 2024-04-17T19:49:03.151 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:03.164+0000 7fe9ef400640 1 -- 172.21.15.44:0/2169219972 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe9f81f0810 msgr2=0x7fe9f814d060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:49:03.151 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:03.164+0000 7fe9ef400640 1 --2- 172.21.15.44:0/2169219972 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe9f81f0810 0x7fe9f814d060 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7fe9e400f470 tx=0x7fe9e400f930 comp rx=0 tx=0).stop 2024-04-17T19:49:03.151 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:03.164+0000 7fe9ef400640 1 -- 172.21.15.44:0/2169219972 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe9f81f0810 msgr2=0x7fe9f814d060 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-04-17T19:49:03.151 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:03.164+0000 7fe9ef400640 1 --2- 172.21.15.44:0/2169219972 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe9f81f0810 0x7fe9f814d060 secure :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7fe9e400f470 tx=0x7fe9e400f930 comp rx=0 tx=0).stop 2024-04-17T19:49:03.151 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:03.164+0000 7fe9f7e00640 1 --2- 172.21.15.44:0/2169219972 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7fe9d8068380 0x7fe9d806a890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:49:03.152 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:03.164+0000 7fe9f7e00640 1 --2- 172.21.15.44:0/2169219972 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7fe9d8068380 0x7fe9d806a890 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fe9f00b1000 tx=0x7fe9f00aa000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:49:03.162 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:03.176+0000 7fe9fd200640 1 --2- 172.21.15.44:0/2169219972 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe9f8157c10 0x7fe9f8158020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:49:03.162 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:03.176+0000 7fe9fd200640 1 -- 172.21.15.44:0/2169219972 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fe9f8158560 con 0x7fe9f8157c10 2024-04-17T19:49:03.163 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:03.176+0000 7fe9f6a00640 1 --2- 172.21.15.44:0/2169219972 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe9f8157c10 0x7fe9f8158020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:49:03.163 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:03.176+0000 7fe9f6a00640 1 -- 172.21.15.44:0/2169219972 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fe9f8157160 con 0x7fe9f8157c10 2024-04-17T19:49:03.164 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:03.176+0000 7fe9f6a00640 1 --2- 172.21.15.44:0/2169219972 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe9f8157c10 0x7fe9f8158020 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7fe9e400f470 tx=0x7fe9e4007f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:49:03.164 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:03.176+0000 7fe9ef400640 1 -- 172.21.15.44:0/2169219972 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9e4019030 con 0x7fe9f8157c10 2024-04-17T19:49:03.165 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:03.176+0000 7fe9ef400640 1 -- 172.21.15.44:0/2169219972 <== mon.0 v2:172.21.15.44:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+5203 (secure 0 0 0) 0x7fe9e4007320 con 0x7fe9f8157c10 2024-04-17T19:49:03.165 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:03.176+0000 7fe9ef400640 1 -- 172.21.15.44:0/2169219972 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe9f8157c10 msgr2=0x7fe9f8158020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:49:03.165 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:03.176+0000 7fe9ef400640 1 --2- 172.21.15.44:0/2169219972 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe9f8157c10 0x7fe9f8158020 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7fe9e400f470 tx=0x7fe9e4007f90 comp rx=0 tx=0).stop 2024-04-17T19:49:03.165 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:03.176+0000 7fe9ef400640 1 -- 172.21.15.44:0/2169219972 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe9f8157c10 msgr2=0x7fe9f8158020 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-04-17T19:49:03.165 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:03.176+0000 7fe9ef400640 1 --2- 172.21.15.44:0/2169219972 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe9f8157c10 0x7fe9f8158020 secure :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7fe9e400f470 tx=0x7fe9e4007f90 comp rx=0 tx=0).stop 2024-04-17T19:49:03.165 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2024-04-17T19:49:03.166 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "a", 2024-04-17T19:49:03.166 INFO:teuthology.orchestra.run.smithi044.stdout: "rank": 0, 2024-04-17T19:49:03.166 INFO:teuthology.orchestra.run.smithi044.stdout: "state": "leader", 2024-04-17T19:49:03.166 INFO:teuthology.orchestra.run.smithi044.stdout: "election_epoch": 14, 2024-04-17T19:49:03.166 INFO:teuthology.orchestra.run.smithi044.stdout: "uptime": 152637, 2024-04-17T19:49:03.166 INFO:teuthology.orchestra.run.smithi044.stdout: "quorum": [ 2024-04-17T19:49:03.166 INFO:teuthology.orchestra.run.smithi044.stdout: 0, 2024-04-17T19:49:03.166 INFO:teuthology.orchestra.run.smithi044.stdout: 1, 2024-04-17T19:49:03.166 INFO:teuthology.orchestra.run.smithi044.stdout: 2 2024-04-17T19:49:03.166 INFO:teuthology.orchestra.run.smithi044.stdout: ], 2024-04-17T19:49:03.166 INFO:teuthology.orchestra.run.smithi044.stdout: "quorum_age": 12, 2024-04-17T19:49:03.166 INFO:teuthology.orchestra.run.smithi044.stdout: "features": { 2024-04-17T19:49:03.166 INFO:teuthology.orchestra.run.smithi044.stdout: "required_con": "2450521708007866372", 2024-04-17T19:49:03.167 INFO:teuthology.orchestra.run.smithi044.stdout: "required_mon": [ 2024-04-17T19:49:03.167 INFO:teuthology.orchestra.run.smithi044.stdout: "kraken", 2024-04-17T19:49:03.167 INFO:teuthology.orchestra.run.smithi044.stdout: "luminous", 2024-04-17T19:49:03.167 INFO:teuthology.orchestra.run.smithi044.stdout: "mimic", 2024-04-17T19:49:03.167 INFO:teuthology.orchestra.run.smithi044.stdout: "osdmap-prune", 2024-04-17T19:49:03.167 INFO:teuthology.orchestra.run.smithi044.stdout: "nautilus", 2024-04-17T19:49:03.167 INFO:teuthology.orchestra.run.smithi044.stdout: "octopus", 2024-04-17T19:49:03.167 INFO:teuthology.orchestra.run.smithi044.stdout: "pacific", 2024-04-17T19:49:03.167 INFO:teuthology.orchestra.run.smithi044.stdout: "elector-pinging", 2024-04-17T19:49:03.167 INFO:teuthology.orchestra.run.smithi044.stdout: "quincy", 2024-04-17T19:49:03.167 INFO:teuthology.orchestra.run.smithi044.stdout: "reef", 2024-04-17T19:49:03.167 INFO:teuthology.orchestra.run.smithi044.stdout: "squid" 2024-04-17T19:49:03.167 INFO:teuthology.orchestra.run.smithi044.stdout: ], 2024-04-17T19:49:03.167 INFO:teuthology.orchestra.run.smithi044.stdout: "quorum_con": "4540701547738038271", 2024-04-17T19:49:03.167 INFO:teuthology.orchestra.run.smithi044.stdout: "quorum_mon": [ 2024-04-17T19:49:03.168 INFO:teuthology.orchestra.run.smithi044.stdout: "kraken", 2024-04-17T19:49:03.168 INFO:teuthology.orchestra.run.smithi044.stdout: "luminous", 2024-04-17T19:49:03.168 INFO:teuthology.orchestra.run.smithi044.stdout: "mimic", 2024-04-17T19:49:03.168 INFO:teuthology.orchestra.run.smithi044.stdout: "osdmap-prune", 2024-04-17T19:49:03.168 INFO:teuthology.orchestra.run.smithi044.stdout: "nautilus", 2024-04-17T19:49:03.168 INFO:teuthology.orchestra.run.smithi044.stdout: "octopus", 2024-04-17T19:49:03.168 INFO:teuthology.orchestra.run.smithi044.stdout: "pacific", 2024-04-17T19:49:03.168 INFO:teuthology.orchestra.run.smithi044.stdout: "elector-pinging", 2024-04-17T19:49:03.168 INFO:teuthology.orchestra.run.smithi044.stdout: "quincy", 2024-04-17T19:49:03.168 INFO:teuthology.orchestra.run.smithi044.stdout: "reef", 2024-04-17T19:49:03.168 INFO:teuthology.orchestra.run.smithi044.stdout: "squid" 2024-04-17T19:49:03.168 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T19:49:03.168 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T19:49:03.168 INFO:teuthology.orchestra.run.smithi044.stdout: "outside_quorum": [], 2024-04-17T19:49:03.168 INFO:teuthology.orchestra.run.smithi044.stdout: "extra_probe_peers": [], 2024-04-17T19:49:03.169 INFO:teuthology.orchestra.run.smithi044.stdout: "sync_provider": [], 2024-04-17T19:49:03.169 INFO:teuthology.orchestra.run.smithi044.stdout: "monmap": { 2024-04-17T19:49:03.169 INFO:teuthology.orchestra.run.smithi044.stdout: "epoch": 1, 2024-04-17T19:49:03.169 INFO:teuthology.orchestra.run.smithi044.stdout: "fsid": "703f77ca-79c6-4a66-b576-62c526cb1021", 2024-04-17T19:49:03.169 INFO:teuthology.orchestra.run.smithi044.stdout: "modified": "2024-04-17T19:45:55.379749Z", 2024-04-17T19:49:03.169 INFO:teuthology.orchestra.run.smithi044.stdout: "created": "2024-04-17T19:45:55.379749Z", 2024-04-17T19:49:03.169 INFO:teuthology.orchestra.run.smithi044.stdout: "min_mon_release": 19, 2024-04-17T19:49:03.169 INFO:teuthology.orchestra.run.smithi044.stdout: "min_mon_release_name": "squid", 2024-04-17T19:49:03.169 INFO:teuthology.orchestra.run.smithi044.stdout: "election_strategy": 1, 2024-04-17T19:49:03.169 INFO:teuthology.orchestra.run.smithi044.stdout: "disallowed_leaders: ": "", 2024-04-17T19:49:03.169 INFO:teuthology.orchestra.run.smithi044.stdout: "stretch_mode": false, 2024-04-17T19:49:03.169 INFO:teuthology.orchestra.run.smithi044.stdout: "tiebreaker_mon": "", 2024-04-17T19:49:03.169 INFO:teuthology.orchestra.run.smithi044.stdout: "removed_ranks: ": "", 2024-04-17T19:49:03.169 INFO:teuthology.orchestra.run.smithi044.stdout: "features": { 2024-04-17T19:49:03.169 INFO:teuthology.orchestra.run.smithi044.stdout: "persistent": [ 2024-04-17T19:49:03.169 INFO:teuthology.orchestra.run.smithi044.stdout: "kraken", 2024-04-17T19:49:03.170 INFO:teuthology.orchestra.run.smithi044.stdout: "luminous", 2024-04-17T19:49:03.170 INFO:teuthology.orchestra.run.smithi044.stdout: "mimic", 2024-04-17T19:49:03.170 INFO:teuthology.orchestra.run.smithi044.stdout: "osdmap-prune", 2024-04-17T19:49:03.170 INFO:teuthology.orchestra.run.smithi044.stdout: "nautilus", 2024-04-17T19:49:03.170 INFO:teuthology.orchestra.run.smithi044.stdout: "octopus", 2024-04-17T19:49:03.170 INFO:teuthology.orchestra.run.smithi044.stdout: "pacific", 2024-04-17T19:49:03.170 INFO:teuthology.orchestra.run.smithi044.stdout: "elector-pinging", 2024-04-17T19:49:03.170 INFO:teuthology.orchestra.run.smithi044.stdout: "quincy", 2024-04-17T19:49:03.170 INFO:teuthology.orchestra.run.smithi044.stdout: "reef", 2024-04-17T19:49:03.170 INFO:teuthology.orchestra.run.smithi044.stdout: "squid" 2024-04-17T19:49:03.170 INFO:teuthology.orchestra.run.smithi044.stdout: ], 2024-04-17T19:49:03.170 INFO:teuthology.orchestra.run.smithi044.stdout: "optional": [] 2024-04-17T19:49:03.170 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T19:49:03.170 INFO:teuthology.orchestra.run.smithi044.stdout: "mons": [ 2024-04-17T19:49:03.171 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T19:49:03.171 INFO:teuthology.orchestra.run.smithi044.stdout: "rank": 0, 2024-04-17T19:49:03.171 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "a", 2024-04-17T19:49:03.171 INFO:teuthology.orchestra.run.smithi044.stdout: "public_addrs": { 2024-04-17T19:49:03.171 INFO:teuthology.orchestra.run.smithi044.stdout: "addrvec": [ 2024-04-17T19:49:03.171 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T19:49:03.171 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "v2", 2024-04-17T19:49:03.171 INFO:teuthology.orchestra.run.smithi044.stdout: "addr": "172.21.15.44:3300", 2024-04-17T19:49:03.171 INFO:teuthology.orchestra.run.smithi044.stdout: "nonce": 0 2024-04-17T19:49:03.171 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T19:49:03.171 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T19:49:03.171 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "v1", 2024-04-17T19:49:03.171 INFO:teuthology.orchestra.run.smithi044.stdout: "addr": "172.21.15.44:6789", 2024-04-17T19:49:03.171 INFO:teuthology.orchestra.run.smithi044.stdout: "nonce": 0 2024-04-17T19:49:03.171 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T19:49:03.172 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T19:49:03.172 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T19:49:03.172 INFO:teuthology.orchestra.run.smithi044.stdout: "addr": "172.21.15.44:6789/0", 2024-04-17T19:49:03.172 INFO:teuthology.orchestra.run.smithi044.stdout: "public_addr": "172.21.15.44:6789/0", 2024-04-17T19:49:03.172 INFO:teuthology.orchestra.run.smithi044.stdout: "priority": 0, 2024-04-17T19:49:03.172 INFO:teuthology.orchestra.run.smithi044.stdout: "weight": 0, 2024-04-17T19:49:03.172 INFO:teuthology.orchestra.run.smithi044.stdout: "crush_location": "{}" 2024-04-17T19:49:03.172 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T19:49:03.172 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T19:49:03.172 INFO:teuthology.orchestra.run.smithi044.stdout: "rank": 1, 2024-04-17T19:49:03.172 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "b", 2024-04-17T19:49:03.172 INFO:teuthology.orchestra.run.smithi044.stdout: "public_addrs": { 2024-04-17T19:49:03.172 INFO:teuthology.orchestra.run.smithi044.stdout: "addrvec": [ 2024-04-17T19:49:03.172 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T19:49:03.172 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "v2", 2024-04-17T19:49:03.173 INFO:teuthology.orchestra.run.smithi044.stdout: "addr": "172.21.15.62:3300", 2024-04-17T19:49:03.173 INFO:teuthology.orchestra.run.smithi044.stdout: "nonce": 0 2024-04-17T19:49:03.173 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T19:49:03.173 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T19:49:03.173 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "v1", 2024-04-17T19:49:03.173 INFO:teuthology.orchestra.run.smithi044.stdout: "addr": "172.21.15.62:6789", 2024-04-17T19:49:03.173 INFO:teuthology.orchestra.run.smithi044.stdout: "nonce": 0 2024-04-17T19:49:03.173 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T19:49:03.173 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T19:49:03.173 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T19:49:03.173 INFO:teuthology.orchestra.run.smithi044.stdout: "addr": "172.21.15.62:6789/0", 2024-04-17T19:49:03.173 INFO:teuthology.orchestra.run.smithi044.stdout: "public_addr": "172.21.15.62:6789/0", 2024-04-17T19:49:03.173 INFO:teuthology.orchestra.run.smithi044.stdout: "priority": 0, 2024-04-17T19:49:03.173 INFO:teuthology.orchestra.run.smithi044.stdout: "weight": 0, 2024-04-17T19:49:03.173 INFO:teuthology.orchestra.run.smithi044.stdout: "crush_location": "{}" 2024-04-17T19:49:03.174 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T19:49:03.174 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T19:49:03.174 INFO:teuthology.orchestra.run.smithi044.stdout: "rank": 2, 2024-04-17T19:49:03.174 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "c", 2024-04-17T19:49:03.174 INFO:teuthology.orchestra.run.smithi044.stdout: "public_addrs": { 2024-04-17T19:49:03.174 INFO:teuthology.orchestra.run.smithi044.stdout: "addrvec": [ 2024-04-17T19:49:03.174 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T19:49:03.174 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "v2", 2024-04-17T19:49:03.174 INFO:teuthology.orchestra.run.smithi044.stdout: "addr": "172.21.15.62:3301", 2024-04-17T19:49:03.174 INFO:teuthology.orchestra.run.smithi044.stdout: "nonce": 0 2024-04-17T19:49:03.174 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T19:49:03.174 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T19:49:03.174 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "v1", 2024-04-17T19:49:03.174 INFO:teuthology.orchestra.run.smithi044.stdout: "addr": "172.21.15.62:6790", 2024-04-17T19:49:03.174 INFO:teuthology.orchestra.run.smithi044.stdout: "nonce": 0 2024-04-17T19:49:03.175 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T19:49:03.175 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T19:49:03.175 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T19:49:03.175 INFO:teuthology.orchestra.run.smithi044.stdout: "addr": "172.21.15.62:6790/0", 2024-04-17T19:49:03.175 INFO:teuthology.orchestra.run.smithi044.stdout: "public_addr": "172.21.15.62:6790/0", 2024-04-17T19:49:03.175 INFO:teuthology.orchestra.run.smithi044.stdout: "priority": 0, 2024-04-17T19:49:03.175 INFO:teuthology.orchestra.run.smithi044.stdout: "weight": 0, 2024-04-17T19:49:03.175 INFO:teuthology.orchestra.run.smithi044.stdout: "crush_location": "{}" 2024-04-17T19:49:03.175 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T19:49:03.175 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T19:49:03.175 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T19:49:03.175 INFO:teuthology.orchestra.run.smithi044.stdout: "feature_map": { 2024-04-17T19:49:03.175 INFO:teuthology.orchestra.run.smithi044.stdout: "mon": [ 2024-04-17T19:49:03.175 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T19:49:03.175 INFO:teuthology.orchestra.run.smithi044.stdout: "features": "0x3f03cffffffdffff", 2024-04-17T19:49:03.176 INFO:teuthology.orchestra.run.smithi044.stdout: "release": "luminous", 2024-04-17T19:49:03.176 INFO:teuthology.orchestra.run.smithi044.stdout: "num": 1 2024-04-17T19:49:03.176 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T19:49:03.176 INFO:teuthology.orchestra.run.smithi044.stdout: ], 2024-04-17T19:49:03.176 INFO:teuthology.orchestra.run.smithi044.stdout: "mds": [ 2024-04-17T19:49:03.176 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T19:49:03.176 INFO:teuthology.orchestra.run.smithi044.stdout: "features": "0x3f03cffffffdffff", 2024-04-17T19:49:03.176 INFO:teuthology.orchestra.run.smithi044.stdout: "release": "luminous", 2024-04-17T19:49:03.176 INFO:teuthology.orchestra.run.smithi044.stdout: "num": 4 2024-04-17T19:49:03.176 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T19:49:03.176 INFO:teuthology.orchestra.run.smithi044.stdout: ], 2024-04-17T19:49:03.176 INFO:teuthology.orchestra.run.smithi044.stdout: "osd": [ 2024-04-17T19:49:03.176 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T19:49:03.176 INFO:teuthology.orchestra.run.smithi044.stdout: "features": "0x3f03cffffffdffff", 2024-04-17T19:49:03.176 INFO:teuthology.orchestra.run.smithi044.stdout: "release": "luminous", 2024-04-17T19:49:03.176 INFO:teuthology.orchestra.run.smithi044.stdout: "num": 4 2024-04-17T19:49:03.177 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T19:49:03.177 INFO:teuthology.orchestra.run.smithi044.stdout: ], 2024-04-17T19:49:03.177 INFO:teuthology.orchestra.run.smithi044.stdout: "client": [ 2024-04-17T19:49:03.177 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T19:49:03.177 INFO:teuthology.orchestra.run.smithi044.stdout: "features": "0x2f018fb87aa4aafe", 2024-04-17T19:49:03.177 INFO:teuthology.orchestra.run.smithi044.stdout: "release": "luminous", 2024-04-17T19:49:03.177 INFO:teuthology.orchestra.run.smithi044.stdout: "num": 1 2024-04-17T19:49:03.177 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T19:49:03.177 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T19:49:03.177 INFO:teuthology.orchestra.run.smithi044.stdout: "features": "0x3f03cffffffdffff", 2024-04-17T19:49:03.177 INFO:teuthology.orchestra.run.smithi044.stdout: "release": "luminous", 2024-04-17T19:49:03.177 INFO:teuthology.orchestra.run.smithi044.stdout: "num": 3 2024-04-17T19:49:03.177 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T19:49:03.177 INFO:teuthology.orchestra.run.smithi044.stdout: ], 2024-04-17T19:49:03.177 INFO:teuthology.orchestra.run.smithi044.stdout: "mgr": [ 2024-04-17T19:49:03.177 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T19:49:03.178 INFO:teuthology.orchestra.run.smithi044.stdout: "features": "0x3f03cffffffdffff", 2024-04-17T19:49:03.178 INFO:teuthology.orchestra.run.smithi044.stdout: "release": "luminous", 2024-04-17T19:49:03.178 INFO:teuthology.orchestra.run.smithi044.stdout: "num": 1 2024-04-17T19:49:03.178 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T19:49:03.178 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T19:49:03.178 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T19:49:03.178 INFO:teuthology.orchestra.run.smithi044.stdout: "stretch_mode": false 2024-04-17T19:49:03.178 INFO:teuthology.orchestra.run.smithi044.stdout:} 2024-04-17T19:49:03.178 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:03.176+0000 7fe9fd200640 1 -- 172.21.15.44:0/2169219972 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7fe9d8068380 msgr2=0x7fe9d806a890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:49:03.178 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:03.176+0000 7fe9fd200640 1 --2- 172.21.15.44:0/2169219972 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7fe9d8068380 0x7fe9d806a890 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fe9f00b1000 tx=0x7fe9f00aa000 comp rx=0 tx=0).stop 2024-04-17T19:49:03.179 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:03.176+0000 7fe9fd200640 1 -- 172.21.15.44:0/2169219972 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe9f80c41b0 msgr2=0x7fe9f814ec50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:49:03.179 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:03.176+0000 7fe9fd200640 1 --2- 172.21.15.44:0/2169219972 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe9f80c41b0 0x7fe9f814ec50 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7fe9e800c420 tx=0x7fe9e800c8e0 comp rx=0 tx=0).stop 2024-04-17T19:49:03.179 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:03.176+0000 7fe9f7e00640 1 -- 172.21.15.44:0/2169219972 reap_dead start 2024-04-17T19:49:03.179 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:03.176+0000 7fe9f7e00640 1 -- 172.21.15.44:0/2169219972 reap_dead start 2024-04-17T19:49:03.179 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:03.176+0000 7fe9fd200640 1 -- 172.21.15.44:0/2169219972 shutdown_connections 2024-04-17T19:49:03.179 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:03.176+0000 7fe9fd200640 1 -- 172.21.15.44:0/2169219972 >> 172.21.15.44:0/2169219972 conn(0x7fe9f8072320 msgr2=0x7fe9f8070960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:49:03.179 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:03.176+0000 7fe9fd200640 1 -- 172.21.15.44:0/2169219972 shutdown_connections 2024-04-17T19:49:03.179 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:03.176+0000 7fe9fd200640 1 -- 172.21.15.44:0/2169219972 wait complete. 2024-04-17T19:49:03.196 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-04-17T19:49:03.196 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon b 2024-04-17T19:49:03.196 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2024-04-17T19:49:03.448 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:03.460+0000 7f6ab9a00640 1 Processor -- start 2024-04-17T19:49:03.448 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:03.460+0000 7f6ab9a00640 1 -- start start 2024-04-17T19:49:03.451 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:03.464+0000 7f6ab9a00640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f6ab4153a00 0x7f6ab40cb9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:49:03.451 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:03.464+0000 7f6ab9a00640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6ab40ca3e0 con 0x7f6ab40cbef0 2024-04-17T19:49:03.451 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:03.464+0000 7f6ab9a00640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6ab415a640 con 0x7f6ab40c41b0 2024-04-17T19:49:03.451 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:03.464+0000 7f6ab9a00640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7f6ab4153e10 con 0x7f6ab4153a00 2024-04-17T19:49:03.452 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:03.464+0000 7f6ab3e00640 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f6ab40c41b0 0x7f6ab4159f30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.44:45870/0 (socket says 172.21.15.44:45870) 2024-04-17T19:49:03.452 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:03.464+0000 7f6ab3e00640 1 -- 172.21.15.44:0/2047063965 learned_addr learned my addr 172.21.15.44:0/2047063965 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-04-17T19:49:03.452 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:03.464+0000 7f6ab3400640 1 --2- 172.21.15.44:0/2047063965 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f6ab4153a00 0x7f6ab40cb9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:49:03.452 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:03.464+0000 7f6ab9000640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f6ab40cbef0 0x7f6ab4164060 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:37756/0 (socket says 172.21.15.44:37756) 2024-04-17T19:49:03.453 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:03.464+0000 7f6ab2a00640 1 -- 172.21.15.44:0/2047063965 <== mon.1 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2168287205 0 0) 0x7f6ab415a640 con 0x7f6ab40c41b0 2024-04-17T19:49:03.453 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:03.464+0000 7f6ab2a00640 1 -- 172.21.15.44:0/2047063965 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6a98003530 con 0x7f6ab40c41b0 2024-04-17T19:49:03.453 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:03.464+0000 7f6ab2a00640 1 -- 172.21.15.44:0/2047063965 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3506279908 0 0) 0x7f6ab40ca3e0 con 0x7f6ab40cbef0 2024-04-17T19:49:03.453 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:03.464+0000 7f6ab2a00640 1 -- 172.21.15.44:0/2047063965 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6ab415a640 con 0x7f6ab40cbef0 2024-04-17T19:49:03.453 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:03.464+0000 7f6ab3400640 1 -- 172.21.15.44:0/2047063965 >> v1:172.21.15.62:6789/0 conn(0x7f6ab40c41b0 legacy=0x7f6ab4159f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:49:03.453 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:03.464+0000 7f6ab3400640 1 -- 172.21.15.44:0/2047063965 >> v1:172.21.15.44:6789/0 conn(0x7f6ab40cbef0 legacy=0x7f6ab4164060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:49:03.453 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:03.464+0000 7f6ab3400640 1 -- 172.21.15.44:0/2047063965 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6ab40ca650 con 0x7f6ab4153a00 2024-04-17T19:49:03.457 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:03.468+0000 7f6ab3400640 1 --2- 172.21.15.44:0/2047063965 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f6ab4153a00 0x7f6ab40cb9b0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f6aa00097f0 tx=0x7f6aa001ecf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9babdd9ef218d82f server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:49:03.458 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:03.468+0000 7f6ab2a00640 1 -- 172.21.15.44:0/2047063965 <== mon.2 v2:172.21.15.62:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6aa00b5070 con 0x7f6ab4153a00 2024-04-17T19:49:03.458 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:03.468+0000 7f6ab2a00640 1 -- 172.21.15.44:0/2047063965 <== mon.2 v2:172.21.15.62:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6aa00a89d0 con 0x7f6ab4153a00 2024-04-17T19:49:03.459 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:03.472+0000 7f6ab9a00640 1 -- 172.21.15.44:0/2047063965 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f6ab4153a00 msgr2=0x7f6ab40cb9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:49:03.459 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:03.472+0000 7f6ab9a00640 1 --2- 172.21.15.44:0/2047063965 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f6ab4153a00 0x7f6ab40cb9b0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f6aa00097f0 tx=0x7f6aa001ecf0 comp rx=0 tx=0).stop 2024-04-17T19:49:03.459 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:03.472+0000 7f6ab9a00640 1 -- 172.21.15.44:0/2047063965 shutdown_connections 2024-04-17T19:49:03.459 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:03.472+0000 7f6ab9a00640 1 --2- 172.21.15.44:0/2047063965 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f6ab4153a00 0x7f6ab40cb9b0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:49:03.459 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:03.472+0000 7f6ab9a00640 1 -- 172.21.15.44:0/2047063965 >> 172.21.15.44:0/2047063965 conn(0x7f6ab4072320 msgr2=0x7f6ab4072730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:49:03.459 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:03.472+0000 7f6ab9a00640 1 -- 172.21.15.44:0/2047063965 shutdown_connections 2024-04-17T19:49:03.459 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:03.472+0000 7f6ab9a00640 1 -- 172.21.15.44:0/2047063965 wait complete. 2024-04-17T19:49:03.463 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:03.476+0000 7f6ab9a00640 1 Processor -- start 2024-04-17T19:49:03.463 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:03.476+0000 7f6ab9a00640 1 -- start start 2024-04-17T19:49:03.466 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:03.476+0000 7f6ab9a00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6ab40c41b0 0x7f6ab40cddc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:49:03.466 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:03.476+0000 7f6ab9a00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6ab40cbef0 0x7f6ab4150220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:49:03.466 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:03.476+0000 7f6ab9a00640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f6ab4153a00 0x7f6ab4150760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:49:03.466 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:03.476+0000 7f6ab9a00640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f6ab415dbb0 con 0x7f6ab40cbef0 2024-04-17T19:49:03.466 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:03.476+0000 7f6ab9a00640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f6ab4159a10 con 0x7f6ab40c41b0 2024-04-17T19:49:03.466 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:03.476+0000 7f6ab9a00640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7f6ab41596e0 con 0x7f6ab4153a00 2024-04-17T19:49:03.467 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:03.476+0000 7f6ab3400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6ab40cbef0 0x7f6ab4150220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:49:03.467 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:03.476+0000 7f6ab3e00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6ab40c41b0 0x7f6ab40cddc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:49:03.467 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:03.476+0000 7f6ab3400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6ab40cbef0 0x7f6ab4150220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:41658/0 (socket says 172.21.15.44:41658) 2024-04-17T19:49:03.467 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:03.476+0000 7f6ab3400640 1 -- 172.21.15.44:0/631435975 learned_addr learned my addr 172.21.15.44:0/631435975 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-04-17T19:49:03.467 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:03.480+0000 7f6ab9000640 1 --2- 172.21.15.44:0/631435975 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f6ab4153a00 0x7f6ab4150760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:49:03.468 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:03.480+0000 7f6ab3400640 1 -- 172.21.15.44:0/631435975 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f6ab4153a00 msgr2=0x7f6ab4150760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:49:03.468 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:03.480+0000 7f6ab3400640 1 --2- 172.21.15.44:0/631435975 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f6ab4153a00 0x7f6ab4150760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:49:03.468 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:03.480+0000 7f6ab3400640 1 -- 172.21.15.44:0/631435975 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6ab40c41b0 msgr2=0x7f6ab40cddc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:49:03.468 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:03.480+0000 7f6ab3400640 1 --2- 172.21.15.44:0/631435975 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6ab40c41b0 0x7f6ab40cddc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:49:03.468 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:03.480+0000 7f6ab3400640 1 -- 172.21.15.44:0/631435975 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6ab41f5d80 con 0x7f6ab40cbef0 2024-04-17T19:49:03.468 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:03.480+0000 7f6ab3400640 1 --2- 172.21.15.44:0/631435975 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6ab40cbef0 0x7f6ab4150220 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f6aa0000c10 tx=0x7f6aa001ba90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:49:03.468 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:03.480+0000 7f6aabe00640 1 -- 172.21.15.44:0/631435975 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6aa00b5040 con 0x7f6ab40cbef0 2024-04-17T19:49:03.468 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:03.480+0000 7f6aabe00640 1 -- 172.21.15.44:0/631435975 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6aa00c0070 con 0x7f6ab40cbef0 2024-04-17T19:49:03.468 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:03.480+0000 7f6ab9a00640 1 -- 172.21.15.44:0/631435975 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6ab415c090 con 0x7f6ab40cbef0 2024-04-17T19:49:03.468 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:03.480+0000 7f6aabe00640 1 -- 172.21.15.44:0/631435975 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6aa0006e20 con 0x7f6ab40cbef0 2024-04-17T19:49:03.468 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:03.480+0000 7f6ab9a00640 1 -- 172.21.15.44:0/631435975 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6ab415a8a0 con 0x7f6ab40cbef0 2024-04-17T19:49:03.469 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:03.480+0000 7f6aa9600640 1 --2- 172.21.15.44:0/631435975 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6ab415c850 0x7f6ab41e32f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:49:03.469 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:03.480+0000 7f6aa9600640 1 -- 172.21.15.44:0/631435975 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f6ab41f1f70 con 0x7f6ab415c850 2024-04-17T19:49:03.470 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:03.480+0000 7f6ab3e00640 1 --2- 172.21.15.44:0/631435975 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6ab415c850 0x7f6ab41e32f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:49:03.470 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:03.484+0000 7f6ab3e00640 1 -- 172.21.15.44:0/631435975 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f6ab4152910 con 0x7f6ab415c850 2024-04-17T19:49:03.471 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:03.484+0000 7f6ab3e00640 1 --2- 172.21.15.44:0/631435975 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6ab415c850 0x7f6ab41e32f0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f6aa4007fd0 tx=0x7f6aa400fc00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:49:03.471 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:03.484+0000 7f6aabe00640 1 -- 172.21.15.44:0/631435975 <== mon.1 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6aa40058c0 con 0x7f6ab415c850 2024-04-17T19:49:03.471 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:03.484+0000 7f6aabe00640 1 -- 172.21.15.44:0/631435975 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f6aa00a89d0 con 0x7f6ab40cbef0 2024-04-17T19:49:03.473 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:03.484+0000 7f6aabe00640 1 --2- 172.21.15.44:0/631435975 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f6a94068280 0x7f6a9406a790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:49:03.473 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:03.484+0000 7f6aabe00640 1 -- 172.21.15.44:0/631435975 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6619+0+0 (secure 0 0 0) 0x7f6aa0123f90 con 0x7f6ab40cbef0 2024-04-17T19:49:03.473 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:03.484+0000 7f6aabe00640 1 -- 172.21.15.44:0/631435975 <== mon.1 v2:172.21.15.62:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f6aa4018070 con 0x7f6ab415c850 2024-04-17T19:49:03.474 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:03.484+0000 7f6aabe00640 1 -- 172.21.15.44:0/631435975 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6ab415c850 msgr2=0x7f6ab41e32f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:49:03.474 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:03.484+0000 7f6aabe00640 1 --2- 172.21.15.44:0/631435975 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6ab415c850 0x7f6ab41e32f0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f6aa4007fd0 tx=0x7f6aa400fc00 comp rx=0 tx=0).stop 2024-04-17T19:49:03.474 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:03.484+0000 7f6aabe00640 1 -- 172.21.15.44:0/631435975 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6ab415c850 msgr2=0x7f6ab41e32f0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-04-17T19:49:03.474 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:03.484+0000 7f6aabe00640 1 --2- 172.21.15.44:0/631435975 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6ab415c850 0x7f6ab41e32f0 secure :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f6aa4007fd0 tx=0x7f6aa400fc00 comp rx=0 tx=0).stop 2024-04-17T19:49:03.474 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:03.484+0000 7f6ab9000640 1 --2- 172.21.15.44:0/631435975 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f6a94068280 0x7f6a9406a790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:49:03.474 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:03.488+0000 7f6ab9000640 1 --2- 172.21.15.44:0/631435975 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f6a94068280 0x7f6a9406a790 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f6aac0012f0 tx=0x7f6aac0015c0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:49:03.486 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:03.496+0000 7f6aa9600640 1 --2- 172.21.15.44:0/631435975 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6ab4152160 0x7f6ab40cca70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:49:03.486 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:03.496+0000 7f6aa9600640 1 -- 172.21.15.44:0/631435975 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f6ab404fea0 con 0x7f6ab4152160 2024-04-17T19:49:03.486 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:03.500+0000 7f6ab3e00640 1 --2- 172.21.15.44:0/631435975 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6ab4152160 0x7f6ab40cca70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:49:03.487 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:03.500+0000 7f6ab3e00640 1 -- 172.21.15.44:0/631435975 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f6ab40cb040 con 0x7f6ab4152160 2024-04-17T19:49:03.487 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:03.500+0000 7f6ab3e00640 1 --2- 172.21.15.44:0/631435975 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6ab4152160 0x7f6ab40cca70 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f6aa4017000 tx=0x7f6aa4000ee0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:49:03.488 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:03.500+0000 7f6aabe00640 1 -- 172.21.15.44:0/631435975 <== mon.1 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6aa40070d0 con 0x7f6ab4152160 2024-04-17T19:49:03.489 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:03.500+0000 7f6aabe00640 1 -- 172.21.15.44:0/631435975 <== mon.1 v2:172.21.15.62:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+5058 (secure 0 0 0) 0x7f6aa40070d0 con 0x7f6ab4152160 2024-04-17T19:49:03.489 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:03.500+0000 7f6aabe00640 1 -- 172.21.15.44:0/631435975 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6ab4152160 msgr2=0x7f6ab40cca70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:49:03.489 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:03.500+0000 7f6aabe00640 1 --2- 172.21.15.44:0/631435975 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6ab4152160 0x7f6ab40cca70 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f6aa4017000 tx=0x7f6aa4000ee0 comp rx=0 tx=0).stop 2024-04-17T19:49:03.489 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:03.500+0000 7f6aabe00640 1 -- 172.21.15.44:0/631435975 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6ab4152160 msgr2=0x7f6ab40cca70 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-04-17T19:49:03.489 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:03.500+0000 7f6aabe00640 1 --2- 172.21.15.44:0/631435975 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6ab4152160 0x7f6ab40cca70 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:49:03.489 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2024-04-17T19:49:03.489 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "b", 2024-04-17T19:49:03.490 INFO:teuthology.orchestra.run.smithi044.stdout: "rank": 1, 2024-04-17T19:49:03.490 INFO:teuthology.orchestra.run.smithi044.stdout: "state": "peon", 2024-04-17T19:49:03.490 INFO:teuthology.orchestra.run.smithi044.stdout: "election_epoch": 14, 2024-04-17T19:49:03.490 INFO:teuthology.orchestra.run.smithi044.stdout: "uptime": 152933, 2024-04-17T19:49:03.490 INFO:teuthology.orchestra.run.smithi044.stdout: "quorum": [ 2024-04-17T19:49:03.490 INFO:teuthology.orchestra.run.smithi044.stdout: 0, 2024-04-17T19:49:03.490 INFO:teuthology.orchestra.run.smithi044.stdout: 1, 2024-04-17T19:49:03.490 INFO:teuthology.orchestra.run.smithi044.stdout: 2 2024-04-17T19:49:03.490 INFO:teuthology.orchestra.run.smithi044.stdout: ], 2024-04-17T19:49:03.490 INFO:teuthology.orchestra.run.smithi044.stdout: "quorum_age": 13, 2024-04-17T19:49:03.490 INFO:teuthology.orchestra.run.smithi044.stdout: "features": { 2024-04-17T19:49:03.490 INFO:teuthology.orchestra.run.smithi044.stdout: "required_con": "2450521708007866372", 2024-04-17T19:49:03.490 INFO:teuthology.orchestra.run.smithi044.stdout: "required_mon": [ 2024-04-17T19:49:03.491 INFO:teuthology.orchestra.run.smithi044.stdout: "kraken", 2024-04-17T19:49:03.491 INFO:teuthology.orchestra.run.smithi044.stdout: "luminous", 2024-04-17T19:49:03.491 INFO:teuthology.orchestra.run.smithi044.stdout: "mimic", 2024-04-17T19:49:03.491 INFO:teuthology.orchestra.run.smithi044.stdout: "osdmap-prune", 2024-04-17T19:49:03.491 INFO:teuthology.orchestra.run.smithi044.stdout: "nautilus", 2024-04-17T19:49:03.491 INFO:teuthology.orchestra.run.smithi044.stdout: "octopus", 2024-04-17T19:49:03.491 INFO:teuthology.orchestra.run.smithi044.stdout: "pacific", 2024-04-17T19:49:03.491 INFO:teuthology.orchestra.run.smithi044.stdout: "elector-pinging", 2024-04-17T19:49:03.491 INFO:teuthology.orchestra.run.smithi044.stdout: "quincy", 2024-04-17T19:49:03.491 INFO:teuthology.orchestra.run.smithi044.stdout: "reef", 2024-04-17T19:49:03.491 INFO:teuthology.orchestra.run.smithi044.stdout: "squid" 2024-04-17T19:49:03.491 INFO:teuthology.orchestra.run.smithi044.stdout: ], 2024-04-17T19:49:03.491 INFO:teuthology.orchestra.run.smithi044.stdout: "quorum_con": "4540701547738038271", 2024-04-17T19:49:03.491 INFO:teuthology.orchestra.run.smithi044.stdout: "quorum_mon": [ 2024-04-17T19:49:03.491 INFO:teuthology.orchestra.run.smithi044.stdout: "kraken", 2024-04-17T19:49:03.491 INFO:teuthology.orchestra.run.smithi044.stdout: "luminous", 2024-04-17T19:49:03.492 INFO:teuthology.orchestra.run.smithi044.stdout: "mimic", 2024-04-17T19:49:03.492 INFO:teuthology.orchestra.run.smithi044.stdout: "osdmap-prune", 2024-04-17T19:49:03.492 INFO:teuthology.orchestra.run.smithi044.stdout: "nautilus", 2024-04-17T19:49:03.492 INFO:teuthology.orchestra.run.smithi044.stdout: "octopus", 2024-04-17T19:49:03.492 INFO:teuthology.orchestra.run.smithi044.stdout: "pacific", 2024-04-17T19:49:03.492 INFO:teuthology.orchestra.run.smithi044.stdout: "elector-pinging", 2024-04-17T19:49:03.492 INFO:teuthology.orchestra.run.smithi044.stdout: "quincy", 2024-04-17T19:49:03.492 INFO:teuthology.orchestra.run.smithi044.stdout: "reef", 2024-04-17T19:49:03.492 INFO:teuthology.orchestra.run.smithi044.stdout: "squid" 2024-04-17T19:49:03.492 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T19:49:03.492 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T19:49:03.492 INFO:teuthology.orchestra.run.smithi044.stdout: "outside_quorum": [], 2024-04-17T19:49:03.492 INFO:teuthology.orchestra.run.smithi044.stdout: "extra_probe_peers": [], 2024-04-17T19:49:03.492 INFO:teuthology.orchestra.run.smithi044.stdout: "sync_provider": [], 2024-04-17T19:49:03.492 INFO:teuthology.orchestra.run.smithi044.stdout: "monmap": { 2024-04-17T19:49:03.492 INFO:teuthology.orchestra.run.smithi044.stdout: "epoch": 1, 2024-04-17T19:49:03.492 INFO:teuthology.orchestra.run.smithi044.stdout: "fsid": "703f77ca-79c6-4a66-b576-62c526cb1021", 2024-04-17T19:49:03.493 INFO:teuthology.orchestra.run.smithi044.stdout: "modified": "2024-04-17T19:45:55.379749Z", 2024-04-17T19:49:03.493 INFO:teuthology.orchestra.run.smithi044.stdout: "created": "2024-04-17T19:45:55.379749Z", 2024-04-17T19:49:03.493 INFO:teuthology.orchestra.run.smithi044.stdout: "min_mon_release": 19, 2024-04-17T19:49:03.493 INFO:teuthology.orchestra.run.smithi044.stdout: "min_mon_release_name": "squid", 2024-04-17T19:49:03.493 INFO:teuthology.orchestra.run.smithi044.stdout: "election_strategy": 1, 2024-04-17T19:49:03.493 INFO:teuthology.orchestra.run.smithi044.stdout: "disallowed_leaders: ": "", 2024-04-17T19:49:03.493 INFO:teuthology.orchestra.run.smithi044.stdout: "stretch_mode": false, 2024-04-17T19:49:03.493 INFO:teuthology.orchestra.run.smithi044.stdout: "tiebreaker_mon": "", 2024-04-17T19:49:03.493 INFO:teuthology.orchestra.run.smithi044.stdout: "removed_ranks: ": "", 2024-04-17T19:49:03.493 INFO:teuthology.orchestra.run.smithi044.stdout: "features": { 2024-04-17T19:49:03.493 INFO:teuthology.orchestra.run.smithi044.stdout: "persistent": [ 2024-04-17T19:49:03.493 INFO:teuthology.orchestra.run.smithi044.stdout: "kraken", 2024-04-17T19:49:03.493 INFO:teuthology.orchestra.run.smithi044.stdout: "luminous", 2024-04-17T19:49:03.493 INFO:teuthology.orchestra.run.smithi044.stdout: "mimic", 2024-04-17T19:49:03.494 INFO:teuthology.orchestra.run.smithi044.stdout: "osdmap-prune", 2024-04-17T19:49:03.494 INFO:teuthology.orchestra.run.smithi044.stdout: "nautilus", 2024-04-17T19:49:03.494 INFO:teuthology.orchestra.run.smithi044.stdout: "octopus", 2024-04-17T19:49:03.494 INFO:teuthology.orchestra.run.smithi044.stdout: "pacific", 2024-04-17T19:49:03.494 INFO:teuthology.orchestra.run.smithi044.stdout: "elector-pinging", 2024-04-17T19:49:03.494 INFO:teuthology.orchestra.run.smithi044.stdout: "quincy", 2024-04-17T19:49:03.494 INFO:teuthology.orchestra.run.smithi044.stdout: "reef", 2024-04-17T19:49:03.494 INFO:teuthology.orchestra.run.smithi044.stdout: "squid" 2024-04-17T19:49:03.494 INFO:teuthology.orchestra.run.smithi044.stdout: ], 2024-04-17T19:49:03.494 INFO:teuthology.orchestra.run.smithi044.stdout: "optional": [] 2024-04-17T19:49:03.494 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T19:49:03.494 INFO:teuthology.orchestra.run.smithi044.stdout: "mons": [ 2024-04-17T19:49:03.494 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T19:49:03.494 INFO:teuthology.orchestra.run.smithi044.stdout: "rank": 0, 2024-04-17T19:49:03.494 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "a", 2024-04-17T19:49:03.494 INFO:teuthology.orchestra.run.smithi044.stdout: "public_addrs": { 2024-04-17T19:49:03.495 INFO:teuthology.orchestra.run.smithi044.stdout: "addrvec": [ 2024-04-17T19:49:03.495 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T19:49:03.495 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "v2", 2024-04-17T19:49:03.495 INFO:teuthology.orchestra.run.smithi044.stdout: "addr": "172.21.15.44:3300", 2024-04-17T19:49:03.495 INFO:teuthology.orchestra.run.smithi044.stdout: "nonce": 0 2024-04-17T19:49:03.495 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T19:49:03.495 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T19:49:03.495 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "v1", 2024-04-17T19:49:03.495 INFO:teuthology.orchestra.run.smithi044.stdout: "addr": "172.21.15.44:6789", 2024-04-17T19:49:03.495 INFO:teuthology.orchestra.run.smithi044.stdout: "nonce": 0 2024-04-17T19:49:03.495 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T19:49:03.495 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T19:49:03.495 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T19:49:03.495 INFO:teuthology.orchestra.run.smithi044.stdout: "addr": "172.21.15.44:6789/0", 2024-04-17T19:49:03.495 INFO:teuthology.orchestra.run.smithi044.stdout: "public_addr": "172.21.15.44:6789/0", 2024-04-17T19:49:03.495 INFO:teuthology.orchestra.run.smithi044.stdout: "priority": 0, 2024-04-17T19:49:03.496 INFO:teuthology.orchestra.run.smithi044.stdout: "weight": 0, 2024-04-17T19:49:03.496 INFO:teuthology.orchestra.run.smithi044.stdout: "crush_location": "{}" 2024-04-17T19:49:03.496 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T19:49:03.496 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T19:49:03.496 INFO:teuthology.orchestra.run.smithi044.stdout: "rank": 1, 2024-04-17T19:49:03.496 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "b", 2024-04-17T19:49:03.496 INFO:teuthology.orchestra.run.smithi044.stdout: "public_addrs": { 2024-04-17T19:49:03.496 INFO:teuthology.orchestra.run.smithi044.stdout: "addrvec": [ 2024-04-17T19:49:03.496 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T19:49:03.496 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "v2", 2024-04-17T19:49:03.496 INFO:teuthology.orchestra.run.smithi044.stdout: "addr": "172.21.15.62:3300", 2024-04-17T19:49:03.496 INFO:teuthology.orchestra.run.smithi044.stdout: "nonce": 0 2024-04-17T19:49:03.496 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T19:49:03.496 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T19:49:03.496 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "v1", 2024-04-17T19:49:03.497 INFO:teuthology.orchestra.run.smithi044.stdout: "addr": "172.21.15.62:6789", 2024-04-17T19:49:03.497 INFO:teuthology.orchestra.run.smithi044.stdout: "nonce": 0 2024-04-17T19:49:03.497 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T19:49:03.497 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T19:49:03.497 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T19:49:03.497 INFO:teuthology.orchestra.run.smithi044.stdout: "addr": "172.21.15.62:6789/0", 2024-04-17T19:49:03.497 INFO:teuthology.orchestra.run.smithi044.stdout: "public_addr": "172.21.15.62:6789/0", 2024-04-17T19:49:03.497 INFO:teuthology.orchestra.run.smithi044.stdout: "priority": 0, 2024-04-17T19:49:03.497 INFO:teuthology.orchestra.run.smithi044.stdout: "weight": 0, 2024-04-17T19:49:03.497 INFO:teuthology.orchestra.run.smithi044.stdout: "crush_location": "{}" 2024-04-17T19:49:03.497 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T19:49:03.497 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T19:49:03.497 INFO:teuthology.orchestra.run.smithi044.stdout: "rank": 2, 2024-04-17T19:49:03.497 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "c", 2024-04-17T19:49:03.497 INFO:teuthology.orchestra.run.smithi044.stdout: "public_addrs": { 2024-04-17T19:49:03.497 INFO:teuthology.orchestra.run.smithi044.stdout: "addrvec": [ 2024-04-17T19:49:03.498 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T19:49:03.498 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "v2", 2024-04-17T19:49:03.498 INFO:teuthology.orchestra.run.smithi044.stdout: "addr": "172.21.15.62:3301", 2024-04-17T19:49:03.498 INFO:teuthology.orchestra.run.smithi044.stdout: "nonce": 0 2024-04-17T19:49:03.498 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T19:49:03.498 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T19:49:03.498 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "v1", 2024-04-17T19:49:03.498 INFO:teuthology.orchestra.run.smithi044.stdout: "addr": "172.21.15.62:6790", 2024-04-17T19:49:03.498 INFO:teuthology.orchestra.run.smithi044.stdout: "nonce": 0 2024-04-17T19:49:03.498 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T19:49:03.498 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T19:49:03.498 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T19:49:03.498 INFO:teuthology.orchestra.run.smithi044.stdout: "addr": "172.21.15.62:6790/0", 2024-04-17T19:49:03.498 INFO:teuthology.orchestra.run.smithi044.stdout: "public_addr": "172.21.15.62:6790/0", 2024-04-17T19:49:03.498 INFO:teuthology.orchestra.run.smithi044.stdout: "priority": 0, 2024-04-17T19:49:03.499 INFO:teuthology.orchestra.run.smithi044.stdout: "weight": 0, 2024-04-17T19:49:03.499 INFO:teuthology.orchestra.run.smithi044.stdout: "crush_location": "{}" 2024-04-17T19:49:03.499 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T19:49:03.499 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T19:49:03.499 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T19:49:03.499 INFO:teuthology.orchestra.run.smithi044.stdout: "feature_map": { 2024-04-17T19:49:03.499 INFO:teuthology.orchestra.run.smithi044.stdout: "mon": [ 2024-04-17T19:49:03.499 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T19:49:03.499 INFO:teuthology.orchestra.run.smithi044.stdout: "features": "0x3f03cffffffdffff", 2024-04-17T19:49:03.499 INFO:teuthology.orchestra.run.smithi044.stdout: "release": "luminous", 2024-04-17T19:49:03.499 INFO:teuthology.orchestra.run.smithi044.stdout: "num": 1 2024-04-17T19:49:03.499 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T19:49:03.499 INFO:teuthology.orchestra.run.smithi044.stdout: ], 2024-04-17T19:49:03.499 INFO:teuthology.orchestra.run.smithi044.stdout: "mds": [ 2024-04-17T19:49:03.499 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T19:49:03.500 INFO:teuthology.orchestra.run.smithi044.stdout: "features": "0x3f03cffffffdffff", 2024-04-17T19:49:03.500 INFO:teuthology.orchestra.run.smithi044.stdout: "release": "luminous", 2024-04-17T19:49:03.500 INFO:teuthology.orchestra.run.smithi044.stdout: "num": 2 2024-04-17T19:49:03.500 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T19:49:03.500 INFO:teuthology.orchestra.run.smithi044.stdout: ], 2024-04-17T19:49:03.500 INFO:teuthology.orchestra.run.smithi044.stdout: "osd": [ 2024-04-17T19:49:03.500 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T19:49:03.500 INFO:teuthology.orchestra.run.smithi044.stdout: "features": "0x3f03cffffffdffff", 2024-04-17T19:49:03.500 INFO:teuthology.orchestra.run.smithi044.stdout: "release": "luminous", 2024-04-17T19:49:03.500 INFO:teuthology.orchestra.run.smithi044.stdout: "num": 4 2024-04-17T19:49:03.500 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T19:49:03.500 INFO:teuthology.orchestra.run.smithi044.stdout: ], 2024-04-17T19:49:03.500 INFO:teuthology.orchestra.run.smithi044.stdout: "client": [ 2024-04-17T19:49:03.500 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T19:49:03.500 INFO:teuthology.orchestra.run.smithi044.stdout: "features": "0x3f03cffffffdffff", 2024-04-17T19:49:03.501 INFO:teuthology.orchestra.run.smithi044.stdout: "release": "luminous", 2024-04-17T19:49:03.501 INFO:teuthology.orchestra.run.smithi044.stdout: "num": 4 2024-04-17T19:49:03.501 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T19:49:03.501 INFO:teuthology.orchestra.run.smithi044.stdout: ], 2024-04-17T19:49:03.501 INFO:teuthology.orchestra.run.smithi044.stdout: "mgr": [ 2024-04-17T19:49:03.501 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T19:49:03.501 INFO:teuthology.orchestra.run.smithi044.stdout: "features": "0x3f03cffffffdffff", 2024-04-17T19:49:03.501 INFO:teuthology.orchestra.run.smithi044.stdout: "release": "luminous", 2024-04-17T19:49:03.501 INFO:teuthology.orchestra.run.smithi044.stdout: "num": 1 2024-04-17T19:49:03.501 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T19:49:03.501 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T19:49:03.501 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T19:49:03.501 INFO:teuthology.orchestra.run.smithi044.stdout: "stretch_mode": false 2024-04-17T19:49:03.501 INFO:teuthology.orchestra.run.smithi044.stdout:} 2024-04-17T19:49:03.502 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:03.500+0000 7f6aa9600640 1 -- 172.21.15.44:0/631435975 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f6a94068280 msgr2=0x7f6a9406a790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:49:03.502 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:03.500+0000 7f6aa9600640 1 --2- 172.21.15.44:0/631435975 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f6a94068280 0x7f6a9406a790 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f6aac0012f0 tx=0x7f6aac0015c0 comp rx=0 tx=0).stop 2024-04-17T19:49:03.502 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:03.500+0000 7f6aa9600640 1 -- 172.21.15.44:0/631435975 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6ab40cbef0 msgr2=0x7f6ab4150220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:49:03.502 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:03.500+0000 7f6aa9600640 1 --2- 172.21.15.44:0/631435975 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6ab40cbef0 0x7f6ab4150220 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f6aa0000c10 tx=0x7f6aa001ba90 comp rx=0 tx=0).stop 2024-04-17T19:49:03.502 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:03.500+0000 7f6ab9000640 1 -- 172.21.15.44:0/631435975 reap_dead start 2024-04-17T19:49:03.503 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:03.500+0000 7f6ab9000640 1 -- 172.21.15.44:0/631435975 reap_dead start 2024-04-17T19:49:03.503 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:03.500+0000 7f6aa9600640 1 -- 172.21.15.44:0/631435975 shutdown_connections 2024-04-17T19:49:03.503 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:03.500+0000 7f6aa9600640 1 -- 172.21.15.44:0/631435975 >> 172.21.15.44:0/631435975 conn(0x7f6ab4072320 msgr2=0x7f6ab4157320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:49:03.503 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:03.500+0000 7f6aa9600640 1 -- 172.21.15.44:0/631435975 shutdown_connections 2024-04-17T19:49:03.503 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:03.500+0000 7f6aa9600640 1 -- 172.21.15.44:0/631435975 wait complete. 2024-04-17T19:49:03.519 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-04-17T19:49:03.519 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon c 2024-04-17T19:49:03.520 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2024-04-17T19:49:03.771 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:03.784+0000 7f0390c00640 1 Processor -- start 2024-04-17T19:49:03.771 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:03.784+0000 7f0390c00640 1 -- start start 2024-04-17T19:49:03.774 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:03.784+0000 7f0390c00640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f038c0c7770 0x7f038c15d0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:49:03.774 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:03.784+0000 7f0390c00640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f038c071ac0 0x7f038c15d5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:49:03.774 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:03.784+0000 7f0390c00640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f038c1598d0 con 0x7f038c0716b0 2024-04-17T19:49:03.774 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:03.784+0000 7f0390c00640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 -- 0x7f038c159bb0 con 0x7f038c0c7770 2024-04-17T19:49:03.774 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:03.784+0000 7f0390c00640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7f038c159e90 con 0x7f038c071ac0 2024-04-17T19:49:03.774 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:03.788+0000 7f038be00640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f038c071ac0 0x7f038c15d5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:49:03.775 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:03.788+0000 7f0383e00640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f038c0c7770 0x7f038c15d0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:49:03.775 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:03.788+0000 7f038b400640 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f038c0716b0 0x7f038c0c7060 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.44:45874/0 (socket says 172.21.15.44:45874) 2024-04-17T19:49:03.775 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:03.788+0000 7f038b400640 1 -- 172.21.15.44:0/239439641 learned_addr learned my addr 172.21.15.44:0/239439641 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-04-17T19:49:03.775 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:03.788+0000 7f0383e00640 1 -- 172.21.15.44:0/239439641 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f038c071ac0 msgr2=0x7f038c15d5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T19:49:03.775 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:03.788+0000 7f0383e00640 1 --2- 172.21.15.44:0/239439641 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f038c071ac0 0x7f038c15d5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:49:03.776 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:03.788+0000 7f0383e00640 1 -- 172.21.15.44:0/239439641 >> v1:172.21.15.62:6789/0 conn(0x7f038c0716b0 legacy=0x7f038c0c7060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:49:03.776 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:03.788+0000 7f0383e00640 1 -- 172.21.15.44:0/239439641 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f038c15a170 con 0x7f038c0c7770 2024-04-17T19:49:03.776 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:03.788+0000 7f038be00640 1 --2- 172.21.15.44:0/239439641 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f038c071ac0 0x7f038c15d5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-17T19:49:03.780 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:03.792+0000 7f0383e00640 1 --2- 172.21.15.44:0/239439641 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f038c0c7770 0x7f038c15d0b0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f03740097c0 tx=0x7f037401c330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=150e289b54dfa6b3 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:49:03.780 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:03.792+0000 7f038aa00640 1 -- 172.21.15.44:0/239439641 <== mon.1 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03740b0070 con 0x7f038c0c7770 2024-04-17T19:49:03.780 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:03.792+0000 7f038aa00640 1 -- 172.21.15.44:0/239439641 <== mon.1 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f03740ab600 con 0x7f038c0c7770 2024-04-17T19:49:03.780 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:03.792+0000 7f038aa00640 1 -- 172.21.15.44:0/239439641 <== mon.1 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03740ab9d0 con 0x7f038c0c7770 2024-04-17T19:49:03.782 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:03.792+0000 7f0390c00640 1 -- 172.21.15.44:0/239439641 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f038c0c7770 msgr2=0x7f038c15d0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:49:03.782 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:03.792+0000 7f0390c00640 1 --2- 172.21.15.44:0/239439641 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f038c0c7770 0x7f038c15d0b0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f03740097c0 tx=0x7f037401c330 comp rx=0 tx=0).stop 2024-04-17T19:49:03.782 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:03.792+0000 7f0390c00640 1 -- 172.21.15.44:0/239439641 shutdown_connections 2024-04-17T19:49:03.782 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:03.792+0000 7f0390c00640 1 --2- 172.21.15.44:0/239439641 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f038c071ac0 0x7f038c15d5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:49:03.782 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:03.792+0000 7f0390c00640 1 --2- 172.21.15.44:0/239439641 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f038c0c7770 0x7f038c15d0b0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:49:03.782 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:03.792+0000 7f0390c00640 1 -- 172.21.15.44:0/239439641 >> 172.21.15.44:0/239439641 conn(0x7f038c06f5f0 msgr2=0x7f038c0cda50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:49:03.782 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:03.792+0000 7f0390c00640 1 -- 172.21.15.44:0/239439641 shutdown_connections 2024-04-17T19:49:03.782 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:03.792+0000 7f0390c00640 1 -- 172.21.15.44:0/239439641 wait complete. 2024-04-17T19:49:03.786 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:03.796+0000 7f0390c00640 1 Processor -- start 2024-04-17T19:49:03.786 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:03.796+0000 7f0390c00640 1 -- start start 2024-04-17T19:49:03.788 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:03.800+0000 7f0390c00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f038c0716b0 0x7f038c0c6840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:49:03.788 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:03.800+0000 7f0390c00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f038c071ac0 0x7f038c144b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:49:03.789 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:03.800+0000 7f0390c00640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f038c0c4ec0 0x7f038c1413e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:49:03.789 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:03.800+0000 7f0390c00640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f038c1660e0 con 0x7f038c0716b0 2024-04-17T19:49:03.789 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:03.800+0000 7f0390c00640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f038c153b40 con 0x7f038c071ac0 2024-04-17T19:49:03.789 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:03.800+0000 7f0390c00640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7f038c166260 con 0x7f038c0c4ec0 2024-04-17T19:49:03.789 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:03.800+0000 7f038b400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f038c0716b0 0x7f038c0c6840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:49:03.790 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:03.800+0000 7f038b400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f038c0716b0 0x7f038c0c6840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:41672/0 (socket says 172.21.15.44:41672) 2024-04-17T19:49:03.790 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:03.800+0000 7f038b400640 1 -- 172.21.15.44:0/3233237601 learned_addr learned my addr 172.21.15.44:0/3233237601 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-04-17T19:49:03.790 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:03.800+0000 7f038be00640 1 --2- 172.21.15.44:0/3233237601 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f038c0c4ec0 0x7f038c1413e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:49:03.790 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:03.800+0000 7f0383e00640 1 --2- 172.21.15.44:0/3233237601 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f038c071ac0 0x7f038c144b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:49:03.790 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:03.800+0000 7f038b400640 1 -- 172.21.15.44:0/3233237601 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f038c0c4ec0 msgr2=0x7f038c1413e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:49:03.790 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:03.800+0000 7f038b400640 1 --2- 172.21.15.44:0/3233237601 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f038c0c4ec0 0x7f038c1413e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:49:03.790 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:03.800+0000 7f038b400640 1 -- 172.21.15.44:0/3233237601 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f038c071ac0 msgr2=0x7f038c144b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:49:03.790 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:03.800+0000 7f038b400640 1 --2- 172.21.15.44:0/3233237601 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f038c071ac0 0x7f038c144b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:49:03.790 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:03.800+0000 7f038b400640 1 -- 172.21.15.44:0/3233237601 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f038c15c450 con 0x7f038c0716b0 2024-04-17T19:49:03.791 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:03.800+0000 7f038b400640 1 --2- 172.21.15.44:0/3233237601 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f038c0716b0 0x7f038c0c6840 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f037c00c780 tx=0x7f037c00cb80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:49:03.791 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:03.804+0000 7f0383400640 1 -- 172.21.15.44:0/3233237601 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f037c018070 con 0x7f038c0716b0 2024-04-17T19:49:03.791 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:03.804+0000 7f0383400640 1 -- 172.21.15.44:0/3233237601 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f037c0072d0 con 0x7f038c0716b0 2024-04-17T19:49:03.791 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:03.804+0000 7f0383400640 1 -- 172.21.15.44:0/3233237601 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f037c0047f0 con 0x7f038c0716b0 2024-04-17T19:49:03.791 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:03.804+0000 7f0390c00640 1 -- 172.21.15.44:0/3233237601 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f038c15c730 con 0x7f038c0716b0 2024-04-17T19:49:03.791 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:03.804+0000 7f0390c00640 1 -- 172.21.15.44:0/3233237601 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f038c0c6d80 con 0x7f038c0716b0 2024-04-17T19:49:03.792 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:03.804+0000 7f0390c00640 1 --2- 172.21.15.44:0/3233237601 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f038c156bd0 0x7f038c141920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:49:03.792 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:03.804+0000 7f0390c00640 1 -- 172.21.15.44:0/3233237601 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7f038c15b4b0 con 0x7f038c156bd0 2024-04-17T19:49:03.794 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:03.804+0000 7f0383400640 1 -- 172.21.15.44:0/3233237601 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f037c01b070 con 0x7f038c0716b0 2024-04-17T19:49:03.794 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:03.808+0000 7f0383e00640 1 --2- 172.21.15.44:0/3233237601 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f038c156bd0 0x7f038c141920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:49:03.795 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:03.808+0000 7f0383e00640 1 -- 172.21.15.44:0/3233237601 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f038c04fea0 con 0x7f038c156bd0 2024-04-17T19:49:03.795 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:03.808+0000 7f0383400640 1 --2- 172.21.15.44:0/3233237601 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f03680683d0 0x7f036806a8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:49:03.796 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:03.808+0000 7f0383400640 1 -- 172.21.15.44:0/3233237601 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6619+0+0 (secure 0 0 0) 0x7f037c0861d0 con 0x7f038c0716b0 2024-04-17T19:49:03.796 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:03.808+0000 7f0383e00640 1 --2- 172.21.15.44:0/3233237601 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f038c156bd0 0x7f038c141920 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f038c0c7d90 tx=0x7f03740190d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:49:03.796 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:03.808+0000 7f038be00640 1 --2- 172.21.15.44:0/3233237601 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f03680683d0 0x7f036806a8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:49:03.796 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:03.808+0000 7f0383400640 1 -- 172.21.15.44:0/3233237601 <== mon.2 v2:172.21.15.62:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03740bb070 con 0x7f038c156bd0 2024-04-17T19:49:03.797 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:03.808+0000 7f0383400640 1 -- 172.21.15.44:0/3233237601 <== mon.2 v2:172.21.15.62:3301/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f03740bf410 con 0x7f038c156bd0 2024-04-17T19:49:03.797 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:03.808+0000 7f0383400640 1 -- 172.21.15.44:0/3233237601 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f038c156bd0 msgr2=0x7f038c141920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:49:03.797 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:03.808+0000 7f0383400640 1 --2- 172.21.15.44:0/3233237601 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f038c156bd0 0x7f038c141920 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f038c0c7d90 tx=0x7f03740190d0 comp rx=0 tx=0).stop 2024-04-17T19:49:03.798 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:03.808+0000 7f0383400640 1 -- 172.21.15.44:0/3233237601 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f038c156bd0 msgr2=0x7f038c141920 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-04-17T19:49:03.798 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:03.808+0000 7f0383400640 1 --2- 172.21.15.44:0/3233237601 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f038c156bd0 0x7f038c141920 secure :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f038c0c7d90 tx=0x7f03740190d0 comp rx=0 tx=0).stop 2024-04-17T19:49:03.798 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:03.808+0000 7f038be00640 1 --2- 172.21.15.44:0/3233237601 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f03680683d0 0x7f036806a8e0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f0384009c10 tx=0x7f038400b040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:49:03.809 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:03.820+0000 7f0390c00640 1 --2- 172.21.15.44:0/3233237601 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f038c1f8a10 0x7f038c1fbf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:49:03.810 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:03.820+0000 7f0390c00640 1 -- 172.21.15.44:0/3233237601 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7f038c163eb0 con 0x7f038c1f8a10 2024-04-17T19:49:03.810 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:03.820+0000 7f0383e00640 1 --2- 172.21.15.44:0/3233237601 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f038c1f8a10 0x7f038c1fbf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:49:03.810 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:03.824+0000 7f0383e00640 1 -- 172.21.15.44:0/3233237601 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f038c0741d0 con 0x7f038c1f8a10 2024-04-17T19:49:03.811 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:03.824+0000 7f0383e00640 1 --2- 172.21.15.44:0/3233237601 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f038c1f8a10 0x7f038c1fbf80 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f037401cbd0 tx=0x7f03740a8000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:49:03.811 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:03.824+0000 7f0383400640 1 -- 172.21.15.44:0/3233237601 <== mon.2 v2:172.21.15.62:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03740b0040 con 0x7f038c1f8a10 2024-04-17T19:49:03.812 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:03.824+0000 7f0383400640 1 -- 172.21.15.44:0/3233237601 <== mon.2 v2:172.21.15.62:3301/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4547 (secure 0 0 0) 0x7f03740038f0 con 0x7f038c1f8a10 2024-04-17T19:49:03.812 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:03.824+0000 7f0383400640 1 -- 172.21.15.44:0/3233237601 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f038c1f8a10 msgr2=0x7f038c1fbf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:49:03.812 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:03.824+0000 7f0383400640 1 --2- 172.21.15.44:0/3233237601 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f038c1f8a10 0x7f038c1fbf80 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f037401cbd0 tx=0x7f03740a8000 comp rx=0 tx=0).stop 2024-04-17T19:49:03.812 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:03.824+0000 7f0383400640 1 -- 172.21.15.44:0/3233237601 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f038c1f8a10 msgr2=0x7f038c1fbf80 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-04-17T19:49:03.813 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:03.824+0000 7f0383400640 1 --2- 172.21.15.44:0/3233237601 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f038c1f8a10 0x7f038c1fbf80 secure :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f037401cbd0 tx=0x7f03740a8000 comp rx=0 tx=0).stop 2024-04-17T19:49:03.813 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2024-04-17T19:49:03.813 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "c", 2024-04-17T19:49:03.813 INFO:teuthology.orchestra.run.smithi044.stdout: "rank": 2, 2024-04-17T19:49:03.813 INFO:teuthology.orchestra.run.smithi044.stdout: "state": "peon", 2024-04-17T19:49:03.813 INFO:teuthology.orchestra.run.smithi044.stdout: "election_epoch": 14, 2024-04-17T19:49:03.813 INFO:teuthology.orchestra.run.smithi044.stdout: "uptime": 28271, 2024-04-17T19:49:03.813 INFO:teuthology.orchestra.run.smithi044.stdout: "quorum": [ 2024-04-17T19:49:03.813 INFO:teuthology.orchestra.run.smithi044.stdout: 0, 2024-04-17T19:49:03.814 INFO:teuthology.orchestra.run.smithi044.stdout: 1, 2024-04-17T19:49:03.814 INFO:teuthology.orchestra.run.smithi044.stdout: 2 2024-04-17T19:49:03.814 INFO:teuthology.orchestra.run.smithi044.stdout: ], 2024-04-17T19:49:03.814 INFO:teuthology.orchestra.run.smithi044.stdout: "quorum_age": 13, 2024-04-17T19:49:03.814 INFO:teuthology.orchestra.run.smithi044.stdout: "features": { 2024-04-17T19:49:03.814 INFO:teuthology.orchestra.run.smithi044.stdout: "required_con": "2450521708007866372", 2024-04-17T19:49:03.814 INFO:teuthology.orchestra.run.smithi044.stdout: "required_mon": [ 2024-04-17T19:49:03.814 INFO:teuthology.orchestra.run.smithi044.stdout: "kraken", 2024-04-17T19:49:03.814 INFO:teuthology.orchestra.run.smithi044.stdout: "luminous", 2024-04-17T19:49:03.814 INFO:teuthology.orchestra.run.smithi044.stdout: "mimic", 2024-04-17T19:49:03.814 INFO:teuthology.orchestra.run.smithi044.stdout: "osdmap-prune", 2024-04-17T19:49:03.814 INFO:teuthology.orchestra.run.smithi044.stdout: "nautilus", 2024-04-17T19:49:03.814 INFO:teuthology.orchestra.run.smithi044.stdout: "octopus", 2024-04-17T19:49:03.814 INFO:teuthology.orchestra.run.smithi044.stdout: "pacific", 2024-04-17T19:49:03.814 INFO:teuthology.orchestra.run.smithi044.stdout: "elector-pinging", 2024-04-17T19:49:03.815 INFO:teuthology.orchestra.run.smithi044.stdout: "quincy", 2024-04-17T19:49:03.815 INFO:teuthology.orchestra.run.smithi044.stdout: "reef", 2024-04-17T19:49:03.815 INFO:teuthology.orchestra.run.smithi044.stdout: "squid" 2024-04-17T19:49:03.815 INFO:teuthology.orchestra.run.smithi044.stdout: ], 2024-04-17T19:49:03.815 INFO:teuthology.orchestra.run.smithi044.stdout: "quorum_con": "4540701547738038271", 2024-04-17T19:49:03.815 INFO:teuthology.orchestra.run.smithi044.stdout: "quorum_mon": [ 2024-04-17T19:49:03.815 INFO:teuthology.orchestra.run.smithi044.stdout: "kraken", 2024-04-17T19:49:03.815 INFO:teuthology.orchestra.run.smithi044.stdout: "luminous", 2024-04-17T19:49:03.815 INFO:teuthology.orchestra.run.smithi044.stdout: "mimic", 2024-04-17T19:49:03.815 INFO:teuthology.orchestra.run.smithi044.stdout: "osdmap-prune", 2024-04-17T19:49:03.815 INFO:teuthology.orchestra.run.smithi044.stdout: "nautilus", 2024-04-17T19:49:03.815 INFO:teuthology.orchestra.run.smithi044.stdout: "octopus", 2024-04-17T19:49:03.815 INFO:teuthology.orchestra.run.smithi044.stdout: "pacific", 2024-04-17T19:49:03.815 INFO:teuthology.orchestra.run.smithi044.stdout: "elector-pinging", 2024-04-17T19:49:03.815 INFO:teuthology.orchestra.run.smithi044.stdout: "quincy", 2024-04-17T19:49:03.815 INFO:teuthology.orchestra.run.smithi044.stdout: "reef", 2024-04-17T19:49:03.816 INFO:teuthology.orchestra.run.smithi044.stdout: "squid" 2024-04-17T19:49:03.816 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T19:49:03.816 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T19:49:03.816 INFO:teuthology.orchestra.run.smithi044.stdout: "outside_quorum": [], 2024-04-17T19:49:03.816 INFO:teuthology.orchestra.run.smithi044.stdout: "extra_probe_peers": [], 2024-04-17T19:49:03.816 INFO:teuthology.orchestra.run.smithi044.stdout: "sync_provider": [], 2024-04-17T19:49:03.816 INFO:teuthology.orchestra.run.smithi044.stdout: "monmap": { 2024-04-17T19:49:03.816 INFO:teuthology.orchestra.run.smithi044.stdout: "epoch": 1, 2024-04-17T19:49:03.816 INFO:teuthology.orchestra.run.smithi044.stdout: "fsid": "703f77ca-79c6-4a66-b576-62c526cb1021", 2024-04-17T19:49:03.816 INFO:teuthology.orchestra.run.smithi044.stdout: "modified": "2024-04-17T19:45:55.379749Z", 2024-04-17T19:49:03.816 INFO:teuthology.orchestra.run.smithi044.stdout: "created": "2024-04-17T19:45:55.379749Z", 2024-04-17T19:49:03.816 INFO:teuthology.orchestra.run.smithi044.stdout: "min_mon_release": 19, 2024-04-17T19:49:03.816 INFO:teuthology.orchestra.run.smithi044.stdout: "min_mon_release_name": "squid", 2024-04-17T19:49:03.816 INFO:teuthology.orchestra.run.smithi044.stdout: "election_strategy": 1, 2024-04-17T19:49:03.816 INFO:teuthology.orchestra.run.smithi044.stdout: "disallowed_leaders: ": "", 2024-04-17T19:49:03.816 INFO:teuthology.orchestra.run.smithi044.stdout: "stretch_mode": false, 2024-04-17T19:49:03.816 INFO:teuthology.orchestra.run.smithi044.stdout: "tiebreaker_mon": "", 2024-04-17T19:49:03.817 INFO:teuthology.orchestra.run.smithi044.stdout: "removed_ranks: ": "", 2024-04-17T19:49:03.817 INFO:teuthology.orchestra.run.smithi044.stdout: "features": { 2024-04-17T19:49:03.817 INFO:teuthology.orchestra.run.smithi044.stdout: "persistent": [ 2024-04-17T19:49:03.817 INFO:teuthology.orchestra.run.smithi044.stdout: "kraken", 2024-04-17T19:49:03.817 INFO:teuthology.orchestra.run.smithi044.stdout: "luminous", 2024-04-17T19:49:03.817 INFO:teuthology.orchestra.run.smithi044.stdout: "mimic", 2024-04-17T19:49:03.817 INFO:teuthology.orchestra.run.smithi044.stdout: "osdmap-prune", 2024-04-17T19:49:03.817 INFO:teuthology.orchestra.run.smithi044.stdout: "nautilus", 2024-04-17T19:49:03.817 INFO:teuthology.orchestra.run.smithi044.stdout: "octopus", 2024-04-17T19:49:03.817 INFO:teuthology.orchestra.run.smithi044.stdout: "pacific", 2024-04-17T19:49:03.817 INFO:teuthology.orchestra.run.smithi044.stdout: "elector-pinging", 2024-04-17T19:49:03.817 INFO:teuthology.orchestra.run.smithi044.stdout: "quincy", 2024-04-17T19:49:03.817 INFO:teuthology.orchestra.run.smithi044.stdout: "reef", 2024-04-17T19:49:03.817 INFO:teuthology.orchestra.run.smithi044.stdout: "squid" 2024-04-17T19:49:03.817 INFO:teuthology.orchestra.run.smithi044.stdout: ], 2024-04-17T19:49:03.817 INFO:teuthology.orchestra.run.smithi044.stdout: "optional": [] 2024-04-17T19:49:03.818 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T19:49:03.818 INFO:teuthology.orchestra.run.smithi044.stdout: "mons": [ 2024-04-17T19:49:03.818 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T19:49:03.818 INFO:teuthology.orchestra.run.smithi044.stdout: "rank": 0, 2024-04-17T19:49:03.818 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "a", 2024-04-17T19:49:03.818 INFO:teuthology.orchestra.run.smithi044.stdout: "public_addrs": { 2024-04-17T19:49:03.818 INFO:teuthology.orchestra.run.smithi044.stdout: "addrvec": [ 2024-04-17T19:49:03.818 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T19:49:03.818 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "v2", 2024-04-17T19:49:03.818 INFO:teuthology.orchestra.run.smithi044.stdout: "addr": "172.21.15.44:3300", 2024-04-17T19:49:03.818 INFO:teuthology.orchestra.run.smithi044.stdout: "nonce": 0 2024-04-17T19:49:03.818 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T19:49:03.818 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T19:49:03.818 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "v1", 2024-04-17T19:49:03.819 INFO:teuthology.orchestra.run.smithi044.stdout: "addr": "172.21.15.44:6789", 2024-04-17T19:49:03.819 INFO:teuthology.orchestra.run.smithi044.stdout: "nonce": 0 2024-04-17T19:49:03.819 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T19:49:03.819 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T19:49:03.819 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T19:49:03.819 INFO:teuthology.orchestra.run.smithi044.stdout: "addr": "172.21.15.44:6789/0", 2024-04-17T19:49:03.819 INFO:teuthology.orchestra.run.smithi044.stdout: "public_addr": "172.21.15.44:6789/0", 2024-04-17T19:49:03.819 INFO:teuthology.orchestra.run.smithi044.stdout: "priority": 0, 2024-04-17T19:49:03.819 INFO:teuthology.orchestra.run.smithi044.stdout: "weight": 0, 2024-04-17T19:49:03.819 INFO:teuthology.orchestra.run.smithi044.stdout: "crush_location": "{}" 2024-04-17T19:49:03.819 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T19:49:03.819 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T19:49:03.819 INFO:teuthology.orchestra.run.smithi044.stdout: "rank": 1, 2024-04-17T19:49:03.819 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "b", 2024-04-17T19:49:03.819 INFO:teuthology.orchestra.run.smithi044.stdout: "public_addrs": { 2024-04-17T19:49:03.819 INFO:teuthology.orchestra.run.smithi044.stdout: "addrvec": [ 2024-04-17T19:49:03.820 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T19:49:03.820 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "v2", 2024-04-17T19:49:03.820 INFO:teuthology.orchestra.run.smithi044.stdout: "addr": "172.21.15.62:3300", 2024-04-17T19:49:03.820 INFO:teuthology.orchestra.run.smithi044.stdout: "nonce": 0 2024-04-17T19:49:03.820 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T19:49:03.820 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T19:49:03.820 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "v1", 2024-04-17T19:49:03.820 INFO:teuthology.orchestra.run.smithi044.stdout: "addr": "172.21.15.62:6789", 2024-04-17T19:49:03.820 INFO:teuthology.orchestra.run.smithi044.stdout: "nonce": 0 2024-04-17T19:49:03.820 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T19:49:03.820 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T19:49:03.820 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T19:49:03.820 INFO:teuthology.orchestra.run.smithi044.stdout: "addr": "172.21.15.62:6789/0", 2024-04-17T19:49:03.820 INFO:teuthology.orchestra.run.smithi044.stdout: "public_addr": "172.21.15.62:6789/0", 2024-04-17T19:49:03.820 INFO:teuthology.orchestra.run.smithi044.stdout: "priority": 0, 2024-04-17T19:49:03.820 INFO:teuthology.orchestra.run.smithi044.stdout: "weight": 0, 2024-04-17T19:49:03.820 INFO:teuthology.orchestra.run.smithi044.stdout: "crush_location": "{}" 2024-04-17T19:49:03.821 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T19:49:03.821 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T19:49:03.821 INFO:teuthology.orchestra.run.smithi044.stdout: "rank": 2, 2024-04-17T19:49:03.821 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "c", 2024-04-17T19:49:03.821 INFO:teuthology.orchestra.run.smithi044.stdout: "public_addrs": { 2024-04-17T19:49:03.821 INFO:teuthology.orchestra.run.smithi044.stdout: "addrvec": [ 2024-04-17T19:49:03.821 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T19:49:03.821 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "v2", 2024-04-17T19:49:03.821 INFO:teuthology.orchestra.run.smithi044.stdout: "addr": "172.21.15.62:3301", 2024-04-17T19:49:03.821 INFO:teuthology.orchestra.run.smithi044.stdout: "nonce": 0 2024-04-17T19:49:03.821 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T19:49:03.821 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T19:49:03.821 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "v1", 2024-04-17T19:49:03.821 INFO:teuthology.orchestra.run.smithi044.stdout: "addr": "172.21.15.62:6790", 2024-04-17T19:49:03.821 INFO:teuthology.orchestra.run.smithi044.stdout: "nonce": 0 2024-04-17T19:49:03.822 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T19:49:03.822 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T19:49:03.822 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T19:49:03.822 INFO:teuthology.orchestra.run.smithi044.stdout: "addr": "172.21.15.62:6790/0", 2024-04-17T19:49:03.822 INFO:teuthology.orchestra.run.smithi044.stdout: "public_addr": "172.21.15.62:6790/0", 2024-04-17T19:49:03.822 INFO:teuthology.orchestra.run.smithi044.stdout: "priority": 0, 2024-04-17T19:49:03.822 INFO:teuthology.orchestra.run.smithi044.stdout: "weight": 0, 2024-04-17T19:49:03.822 INFO:teuthology.orchestra.run.smithi044.stdout: "crush_location": "{}" 2024-04-17T19:49:03.822 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T19:49:03.822 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T19:49:03.822 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T19:49:03.822 INFO:teuthology.orchestra.run.smithi044.stdout: "feature_map": { 2024-04-17T19:49:03.822 INFO:teuthology.orchestra.run.smithi044.stdout: "mon": [ 2024-04-17T19:49:03.822 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T19:49:03.822 INFO:teuthology.orchestra.run.smithi044.stdout: "features": "0x3f03cffffffdffff", 2024-04-17T19:49:03.822 INFO:teuthology.orchestra.run.smithi044.stdout: "release": "luminous", 2024-04-17T19:49:03.823 INFO:teuthology.orchestra.run.smithi044.stdout: "num": 1 2024-04-17T19:49:03.823 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T19:49:03.823 INFO:teuthology.orchestra.run.smithi044.stdout: ], 2024-04-17T19:49:03.823 INFO:teuthology.orchestra.run.smithi044.stdout: "client": [ 2024-04-17T19:49:03.823 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T19:49:03.823 INFO:teuthology.orchestra.run.smithi044.stdout: "features": "0x3f03cffffffdffff", 2024-04-17T19:49:03.823 INFO:teuthology.orchestra.run.smithi044.stdout: "release": "luminous", 2024-04-17T19:49:03.823 INFO:teuthology.orchestra.run.smithi044.stdout: "num": 1 2024-04-17T19:49:03.823 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T19:49:03.823 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T19:49:03.823 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T19:49:03.823 INFO:teuthology.orchestra.run.smithi044.stdout: "stretch_mode": false 2024-04-17T19:49:03.823 INFO:teuthology.orchestra.run.smithi044.stdout:} 2024-04-17T19:49:03.824 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:03.824+0000 7f0390c00640 1 -- 172.21.15.44:0/3233237601 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f03680683d0 msgr2=0x7f036806a8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:49:03.824 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:03.824+0000 7f0390c00640 1 --2- 172.21.15.44:0/3233237601 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f03680683d0 0x7f036806a8e0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f0384009c10 tx=0x7f038400b040 comp rx=0 tx=0).stop 2024-04-17T19:49:03.824 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:03.824+0000 7f0390c00640 1 -- 172.21.15.44:0/3233237601 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f038c0716b0 msgr2=0x7f038c0c6840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:49:03.824 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:03.824+0000 7f0390c00640 1 --2- 172.21.15.44:0/3233237601 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f038c0716b0 0x7f038c0c6840 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f037c00c780 tx=0x7f037c00cb80 comp rx=0 tx=0).stop 2024-04-17T19:49:03.824 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:03.824+0000 7f038be00640 1 -- 172.21.15.44:0/3233237601 reap_dead start 2024-04-17T19:49:03.824 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:03.824+0000 7f038be00640 1 -- 172.21.15.44:0/3233237601 reap_dead start 2024-04-17T19:49:03.824 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:03.824+0000 7f0390c00640 1 -- 172.21.15.44:0/3233237601 shutdown_connections 2024-04-17T19:49:03.824 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:03.824+0000 7f0390c00640 1 -- 172.21.15.44:0/3233237601 >> 172.21.15.44:0/3233237601 conn(0x7f038c06f5f0 msgr2=0x7f038c0c85f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:49:03.824 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:03.824+0000 7f0390c00640 1 -- 172.21.15.44:0/3233237601 shutdown_connections 2024-04-17T19:49:03.824 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:03.824+0000 7f0390c00640 1 -- 172.21.15.44:0/3233237601 wait complete. 2024-04-17T19:49:03.842 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-04-17T19:49:03.842 INFO:tasks.mon_thrash.mon_thrasher:monitors to thrash: ['b'] 2024-04-17T19:49:03.843 INFO:tasks.mon_thrash.mon_thrasher:monitors to freeze: ['c'] 2024-04-17T19:49:03.843 INFO:tasks.mon_thrash.mon_thrasher:thrashing mon.b 2024-04-17T19:49:03.843 INFO:tasks.mon_thrash.mon_thrasher:killing mon.b 2024-04-17T19:49:03.843 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2024-04-17T19:49:03.843 INFO:teuthology.orchestra.run:waiting for 300 2024-04-17T19:49:03.883 INFO:tasks.ceph.mon.b:Stopped 2024-04-17T19:49:03.883 INFO:tasks.mon_thrash:Sending STOP to mon c 2024-04-17T19:49:03.883 INFO:tasks.ceph.mon.c:Sent signal 19 2024-04-17T19:49:03.883 INFO:tasks.mon_thrash.mon_thrasher:waiting for 15.0 secs to unfreeze mons 2024-04-17T19:49:18.482 INFO:tasks.workunit.client.0.smithi044.stderr:Updating files: 64% (7855/12271) Updating files: 65% (7977/12271) Updating files: 66% (8099/12271) Updating files: 67% (8222/12271) Updating files: 68% (8345/12271) Updating files: 69% (8467/12271) Updating files: 70% (8590/12271) Updating files: 71% (8713/12271) Updating files: 72% (8836/12271) Updating files: 73% (8958/12271) Updating files: 74% (9081/12271) Updating files: 75% (9204/12271) Updating files: 76% (9326/12271) Updating files: 77% (9449/12271) Updating files: 78% (9572/12271) Updating files: 79% (9695/12271) Updating files: 80% (9817/12271) Updating files: 81% (9940/12271) Updating files: 82% (10063/12271) Updating files: 83% (10185/12271) Updating files: 84% (10308/12271) Updating files: 85% (10431/12271) Updating files: 86% (10554/12271) Updating files: 87% (10676/12271) Updating files: 88% (10799/12271) Updating files: 89% (10922/12271) Updating files: 90% (11044/12271) Updating files: 91% (11167/12271) Updating files: 92% (11290/12271) Updating files: 93% (11413/12271) Updating files: 94% (11535/12271) Updating files: 95% (11658/12271) Updating files: 96% (11781/12271) Updating files: 97% (11903/12271) Updating files: 98% (12026/12271) Updating files: 99% (12149/12271) Updating files: 100% (12271/12271) Updating files: 100% (12271/12271), done. 2024-04-17T19:49:18.884 INFO:tasks.mon_thrash:Sending CONT to mon c 2024-04-17T19:49:18.885 INFO:tasks.ceph.mon.c:Sent signal 18 2024-04-17T19:49:18.885 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 2 2024-04-17T19:49:18.885 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-04-17T19:49:19.039 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:19.052+0000 7fc3e6600640 1 Processor -- start 2024-04-17T19:49:19.039 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:19.052+0000 7fc3e6600640 1 -- start start 2024-04-17T19:49:19.041 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:19.052+0000 7fc3e6600640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fc3e00c5ae0 0x7fc3e015b9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:49:19.041 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:19.052+0000 7fc3e6600640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fc3e015bf30 0x7fc3e0166370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:49:19.042 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:19.052+0000 7fc3e6600640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc3e00cb6a0 con 0x7fc3e0155be0 2024-04-17T19:49:19.042 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:19.052+0000 7fc3e6600640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 -- 0x7fc3e006cfe0 con 0x7fc3e015bf30 2024-04-17T19:49:19.042 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:19.052+0000 7fc3e6600640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7fc3e00cc240 con 0x7fc3e00c5ae0 2024-04-17T19:49:19.042 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:19.052+0000 7fc3dfe00640 1 -- >> v2:172.21.15.62:3300/0 conn(0x7fc3e015bf30 msgr2=0x7fc3e0166370 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.62:3300/0 2024-04-17T19:49:19.042 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:19.052+0000 7fc3df400640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7fc3e0155be0 0x7fc3e00725a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:53032/0 (socket says 172.21.15.44:53032) 2024-04-17T19:49:19.042 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:19.052+0000 7fc3df400640 1 -- 172.21.15.44:0/1282705941 learned_addr learned my addr 172.21.15.44:0/1282705941 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-04-17T19:49:19.042 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:19.052+0000 7fc3dfe00640 1 --2- 172.21.15.44:0/1282705941 >> v2:172.21.15.62:3300/0 conn(0x7fc3e015bf30 0x7fc3e0166370 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-17T19:49:19.042 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:19.052+0000 7fc3d6a00640 1 --2- 172.21.15.44:0/1282705941 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fc3e00c5ae0 0x7fc3e015b9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:49:19.042 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:19.052+0000 7fc3d6a00640 1 -- 172.21.15.44:0/1282705941 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fc3e00c5ae0 msgr2=0x7fc3e015b9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-04-17T19:49:19.042 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:19.052+0000 7fc3d6a00640 1 -- 172.21.15.44:0/1282705941 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fc3e00c5ae0 msgr2=0x7fc3e015b9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-17T19:49:19.042 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:19.052+0000 7fc3d6a00640 1 --2- 172.21.15.44:0/1282705941 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fc3e00c5ae0 0x7fc3e015b9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-17T19:49:19.042 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:19.052+0000 7fc3d6a00640 1 --2- 172.21.15.44:0/1282705941 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fc3e00c5ae0 0x7fc3e015b9f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-17T19:49:19.243 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:19.256+0000 7fc3dfe00640 1 -- 172.21.15.44:0/1282705941 >> v2:172.21.15.62:3300/0 conn(0x7fc3e015bf30 msgr2=0x7fc3e0166370 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.62:3300/0 2024-04-17T19:49:19.243 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:19.256+0000 7fc3dfe00640 1 --2- 172.21.15.44:0/1282705941 >> v2:172.21.15.62:3300/0 conn(0x7fc3e015bf30 0x7fc3e0166370 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-17T19:49:19.243 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:19.256+0000 7fc3d6a00640 1 --2- 172.21.15.44:0/1282705941 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fc3e00c5ae0 0x7fc3e015b9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:49:19.244 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:19.256+0000 7fc3d6a00640 1 -- 172.21.15.44:0/1282705941 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fc3e00c5ae0 msgr2=0x7fc3e015b9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-04-17T19:49:19.244 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:19.256+0000 7fc3d6a00640 1 -- 172.21.15.44:0/1282705941 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fc3e00c5ae0 msgr2=0x7fc3e015b9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-17T19:49:19.244 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:19.256+0000 7fc3d6a00640 1 --2- 172.21.15.44:0/1282705941 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fc3e00c5ae0 0x7fc3e015b9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-17T19:49:19.244 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:19.256+0000 7fc3d6a00640 1 --2- 172.21.15.44:0/1282705941 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fc3e00c5ae0 0x7fc3e015b9f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-17T19:49:19.292 INFO:tasks.workunit.client.0.smithi044.stderr:Note: switching to 'f3a98d3f110319c567ec86bf70955c141495ccf6'. 2024-04-17T19:49:19.292 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-04-17T19:49:19.292 INFO:tasks.workunit.client.0.smithi044.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-04-17T19:49:19.292 INFO:tasks.workunit.client.0.smithi044.stderr:changes and commit them, and you can discard any commits you make in this 2024-04-17T19:49:19.292 INFO:tasks.workunit.client.0.smithi044.stderr:state without impacting any branches by switching back to a branch. 2024-04-17T19:49:19.292 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-04-17T19:49:19.292 INFO:tasks.workunit.client.0.smithi044.stderr:If you want to create a new branch to retain commits you create, you may 2024-04-17T19:49:19.292 INFO:tasks.workunit.client.0.smithi044.stderr:do so (now or later) by using -c with the switch command. Example: 2024-04-17T19:49:19.292 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-04-17T19:49:19.292 INFO:tasks.workunit.client.0.smithi044.stderr: git switch -c 2024-04-17T19:49:19.293 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-04-17T19:49:19.293 INFO:tasks.workunit.client.0.smithi044.stderr:Or undo this operation with: 2024-04-17T19:49:19.293 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-04-17T19:49:19.293 INFO:tasks.workunit.client.0.smithi044.stderr: git switch - 2024-04-17T19:49:19.293 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-04-17T19:49:19.293 INFO:tasks.workunit.client.0.smithi044.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-04-17T19:49:19.293 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-04-17T19:49:19.293 INFO:tasks.workunit.client.0.smithi044.stderr:HEAD is now at f3a98d3f110 Merge PR #54067 into wip-pdonnell-testing-20240417.021458-debug 2024-04-17T19:49:19.305 DEBUG:teuthology.orchestra.run.smithi044:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-04-17T19:49:19.314 INFO:tasks.workunit.client.0.smithi044.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-04-17T19:49:19.317 INFO:tasks.workunit.client.0.smithi044.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-04-17T19:49:19.317 INFO:tasks.workunit.client.0.smithi044.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-04-17T19:49:19.647 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:19.660+0000 7fc3dfe00640 1 -- 172.21.15.44:0/1282705941 >> v2:172.21.15.62:3300/0 conn(0x7fc3e015bf30 msgr2=0x7fc3e0166370 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.62:3300/0 2024-04-17T19:49:19.647 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:19.660+0000 7fc3dfe00640 1 --2- 172.21.15.44:0/1282705941 >> v2:172.21.15.62:3300/0 conn(0x7fc3e015bf30 0x7fc3e0166370 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-17T19:49:19.647 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:19.660+0000 7fc3d6a00640 1 --2- 172.21.15.44:0/1282705941 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fc3e00c5ae0 0x7fc3e015b9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:49:19.648 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:19.660+0000 7fc3d6a00640 1 -- 172.21.15.44:0/1282705941 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fc3e00c5ae0 msgr2=0x7fc3e015b9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-04-17T19:49:19.648 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:19.660+0000 7fc3d6a00640 1 -- 172.21.15.44:0/1282705941 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fc3e00c5ae0 msgr2=0x7fc3e015b9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-17T19:49:19.648 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:19.660+0000 7fc3d6a00640 1 --2- 172.21.15.44:0/1282705941 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fc3e00c5ae0 0x7fc3e015b9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-17T19:49:19.648 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:19.660+0000 7fc3d6a00640 1 --2- 172.21.15.44:0/1282705941 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fc3e00c5ae0 0x7fc3e015b9f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-17T19:49:20.051 INFO:tasks.workunit.client.0.smithi044.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-04-17T19:49:20.155 INFO:tasks.workunit.client.0.smithi044.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-04-17T19:49:20.211 INFO:tasks.workunit.client.0.smithi044.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-04-17T19:49:20.213 INFO:tasks.workunit.client.0.smithi044.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-04-17T19:49:20.213 INFO:tasks.workunit.client.0.smithi044.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-04-17T19:49:20.268 INFO:tasks.workunit.client.0.smithi044.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-04-17T19:49:20.274 DEBUG:teuthology.orchestra.run.smithi044:> set -ex 2024-04-17T19:49:20.274 DEBUG:teuthology.orchestra.run.smithi044:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-04-17T19:49:20.324 INFO:tasks.workunit:Running workunits matching fs/misc/trivial_sync.sh on client.0... 2024-04-17T19:49:20.325 INFO:tasks.workunit:Running workunit fs/misc/trivial_sync.sh... 2024-04-17T19:49:20.325 DEBUG:teuthology.orchestra.run.smithi044:workunit test fs/misc/trivial_sync.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=f3a98d3f110319c567ec86bf70955c141495ccf6 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/fs/misc/trivial_sync.sh 2024-04-17T19:49:20.451 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:20.464+0000 7fc3dfe00640 1 -- 172.21.15.44:0/1282705941 >> v2:172.21.15.62:3300/0 conn(0x7fc3e015bf30 msgr2=0x7fc3e0166370 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.62:3300/0 2024-04-17T19:49:20.451 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:20.464+0000 7fc3dfe00640 1 --2- 172.21.15.44:0/1282705941 >> v2:172.21.15.62:3300/0 conn(0x7fc3e015bf30 0x7fc3e0166370 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-17T19:49:20.452 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:20.464+0000 7fc3d6a00640 1 --2- 172.21.15.44:0/1282705941 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fc3e00c5ae0 0x7fc3e015b9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:49:20.452 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:20.464+0000 7fc3d6a00640 1 -- 172.21.15.44:0/1282705941 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fc3e00c5ae0 msgr2=0x7fc3e015b9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-04-17T19:49:20.452 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:20.464+0000 7fc3d6a00640 1 -- 172.21.15.44:0/1282705941 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fc3e00c5ae0 msgr2=0x7fc3e015b9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-17T19:49:20.452 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:20.464+0000 7fc3d6a00640 1 --2- 172.21.15.44:0/1282705941 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fc3e00c5ae0 0x7fc3e015b9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-17T19:49:20.452 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:20.464+0000 7fc3d6a00640 1 --2- 172.21.15.44:0/1282705941 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fc3e00c5ae0 0x7fc3e015b9f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-17T19:49:22.042 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:22.052+0000 7fc3dd600640 1 -- 172.21.15.44:0/1282705941 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fc3e00c5ae0 msgr2=0x7fc3e015b9f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-17T19:49:22.042 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:22.052+0000 7fc3dd600640 1 --2- 172.21.15.44:0/1282705941 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fc3e00c5ae0 0x7fc3e015b9f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:49:22.042 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:22.052+0000 7fc3dd600640 1 -- 172.21.15.44:0/1282705941 >> v2:172.21.15.62:3300/0 conn(0x7fc3e015bf30 msgr2=0x7fc3e0166370 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-17T19:49:22.042 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:22.052+0000 7fc3dd600640 1 --2- 172.21.15.44:0/1282705941 >> v2:172.21.15.62:3300/0 conn(0x7fc3e015bf30 0x7fc3e0166370 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:49:22.042 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:22.052+0000 7fc3dd600640 1 -- 172.21.15.44:0/1282705941 >> v1:172.21.15.44:6789/0 conn(0x7fc3e0155be0 legacy=0x7fc3e00725a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:49:22.042 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:22.052+0000 7fc3dd600640 1 --2- 172.21.15.44:0/1282705941 >> v2:172.21.15.44:3300/0 conn(0x7fc3bc007460 0x7fc3bc009970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:49:22.042 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:22.052+0000 7fc3dd600640 1 -- 172.21.15.44:0/1282705941 --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc3e00cb910 con 0x7fc3bc0036d0 2024-04-17T19:49:22.042 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:22.052+0000 7fc3dd600640 1 -- 172.21.15.44:0/1282705941 --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 -- 0x7fc3e006cfe0 con 0x7fc3bc007460 2024-04-17T19:49:22.042 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:22.052+0000 7fc3df400640 1 -- 172.21.15.44:0/1282705941 >> v1:172.21.15.62:6789/0 conn(0x7fc3bc0036d0 legacy=0x7fc3bc005ba0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.62:6789/0 2024-04-17T19:49:22.042 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:22.052+0000 7fc3d6a00640 1 --2- 172.21.15.44:0/1282705941 >> v2:172.21.15.44:3300/0 conn(0x7fc3bc007460 0x7fc3bc009970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:49:22.043 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:22.052+0000 7fc3d6a00640 1 -- 172.21.15.44:0/1282705941 >> v2:172.21.15.44:3300/0 conn(0x7fc3bc007460 msgr2=0x7fc3bc009970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-04-17T19:49:22.043 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:22.052+0000 7fc3d6a00640 1 -- 172.21.15.44:0/1282705941 >> v2:172.21.15.44:3300/0 conn(0x7fc3bc007460 msgr2=0x7fc3bc009970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-17T19:49:22.043 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:22.052+0000 7fc3d6a00640 1 --2- 172.21.15.44:0/1282705941 >> v2:172.21.15.44:3300/0 conn(0x7fc3bc007460 0x7fc3bc009970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-17T19:49:22.043 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:22.052+0000 7fc3d6a00640 1 --2- 172.21.15.44:0/1282705941 >> v2:172.21.15.44:3300/0 conn(0x7fc3bc007460 0x7fc3bc009970 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-17T19:49:22.243 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:22.256+0000 7fc3df400640 1 -- 172.21.15.44:0/1282705941 >> v1:172.21.15.62:6789/0 conn(0x7fc3bc0036d0 legacy=0x7fc3bc005ba0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.62:6789/0 2024-04-17T19:49:22.244 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:22.256+0000 7fc3d6a00640 1 --2- 172.21.15.44:0/1282705941 >> v2:172.21.15.44:3300/0 conn(0x7fc3bc007460 0x7fc3bc009970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:49:22.244 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:22.256+0000 7fc3d6a00640 1 -- 172.21.15.44:0/1282705941 >> v2:172.21.15.44:3300/0 conn(0x7fc3bc007460 msgr2=0x7fc3bc009970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-04-17T19:49:22.244 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:22.256+0000 7fc3d6a00640 1 -- 172.21.15.44:0/1282705941 >> v2:172.21.15.44:3300/0 conn(0x7fc3bc007460 msgr2=0x7fc3bc009970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-17T19:49:22.244 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:22.256+0000 7fc3d6a00640 1 --2- 172.21.15.44:0/1282705941 >> v2:172.21.15.44:3300/0 conn(0x7fc3bc007460 0x7fc3bc009970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-17T19:49:22.244 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:22.256+0000 7fc3d6a00640 1 --2- 172.21.15.44:0/1282705941 >> v2:172.21.15.44:3300/0 conn(0x7fc3bc007460 0x7fc3bc009970 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-17T19:49:22.484 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-04-17T19:49:22.484 DEBUG:teuthology.orchestra.run.smithi044:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-04-17T19:49:22.647 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:22.660+0000 7fc3df400640 1 -- 172.21.15.44:0/1282705941 >> v1:172.21.15.62:6789/0 conn(0x7fc3bc0036d0 legacy=0x7fc3bc005ba0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.62:6789/0 2024-04-17T19:49:22.648 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:22.660+0000 7fc3d6a00640 1 --2- 172.21.15.44:0/1282705941 >> v2:172.21.15.44:3300/0 conn(0x7fc3bc007460 0x7fc3bc009970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:49:22.648 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:22.660+0000 7fc3d6a00640 1 -- 172.21.15.44:0/1282705941 >> v2:172.21.15.44:3300/0 conn(0x7fc3bc007460 msgr2=0x7fc3bc009970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-04-17T19:49:22.648 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:22.660+0000 7fc3d6a00640 1 -- 172.21.15.44:0/1282705941 >> v2:172.21.15.44:3300/0 conn(0x7fc3bc007460 msgr2=0x7fc3bc009970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-17T19:49:22.648 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:22.660+0000 7fc3d6a00640 1 --2- 172.21.15.44:0/1282705941 >> v2:172.21.15.44:3300/0 conn(0x7fc3bc007460 0x7fc3bc009970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-17T19:49:22.648 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:22.660+0000 7fc3d6a00640 1 --2- 172.21.15.44:0/1282705941 >> v2:172.21.15.44:3300/0 conn(0x7fc3bc007460 0x7fc3bc009970 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-17T19:49:23.451 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:23.464+0000 7fc3df400640 1 -- 172.21.15.44:0/1282705941 >> v1:172.21.15.62:6789/0 conn(0x7fc3bc0036d0 legacy=0x7fc3bc005ba0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.62:6789/0 2024-04-17T19:49:23.451 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:23.464+0000 7fc3d6a00640 1 --2- 172.21.15.44:0/1282705941 >> v2:172.21.15.44:3300/0 conn(0x7fc3bc007460 0x7fc3bc009970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:49:23.451 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:23.464+0000 7fc3d6a00640 1 -- 172.21.15.44:0/1282705941 >> v2:172.21.15.44:3300/0 conn(0x7fc3bc007460 msgr2=0x7fc3bc009970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-04-17T19:49:23.451 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:23.464+0000 7fc3d6a00640 1 -- 172.21.15.44:0/1282705941 >> v2:172.21.15.44:3300/0 conn(0x7fc3bc007460 msgr2=0x7fc3bc009970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-17T19:49:23.452 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:23.464+0000 7fc3d6a00640 1 --2- 172.21.15.44:0/1282705941 >> v2:172.21.15.44:3300/0 conn(0x7fc3bc007460 0x7fc3bc009970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-17T19:49:23.452 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:23.464+0000 7fc3d6a00640 1 --2- 172.21.15.44:0/1282705941 >> v2:172.21.15.44:3300/0 conn(0x7fc3bc007460 0x7fc3bc009970 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-17T19:49:24.026 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T19:49:24.030 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T19:49:25.042 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:25.052+0000 7fc3dd600640 1 -- 172.21.15.44:0/1282705941 >> v2:172.21.15.44:3300/0 conn(0x7fc3bc007460 msgr2=0x7fc3bc009970 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-17T19:49:25.042 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:25.052+0000 7fc3dd600640 1 --2- 172.21.15.44:0/1282705941 >> v2:172.21.15.44:3300/0 conn(0x7fc3bc007460 0x7fc3bc009970 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:49:25.042 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:25.052+0000 7fc3dd600640 1 -- 172.21.15.44:0/1282705941 >> v1:172.21.15.62:6789/0 conn(0x7fc3bc0036d0 legacy=0x7fc3bc005ba0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-17T19:49:25.042 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:25.052+0000 7fc3dfe00640 1 -- 172.21.15.44:0/1282705941 reap_dead start 2024-04-17T19:49:25.042 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:25.052+0000 7fc3dd600640 1 --2- 172.21.15.44:0/1282705941 >> v2:172.21.15.62:3300/0 conn(0x7fc3e015bf30 0x7fc3bc00a020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:49:25.042 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:25.052+0000 7fc3dd600640 1 --2- 172.21.15.44:0/1282705941 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fc3e00c5ae0 0x7fc3bc00a560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:49:25.042 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:25.052+0000 7fc3dd600640 1 -- 172.21.15.44:0/1282705941 --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc3bc00b0d0 con 0x7fc3bc0036d0 2024-04-17T19:49:25.043 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:25.052+0000 7fc3dd600640 1 -- 172.21.15.44:0/1282705941 --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 -- 0x7fc3e006cfe0 con 0x7fc3e015bf30 2024-04-17T19:49:25.043 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:25.052+0000 7fc3dd600640 1 -- 172.21.15.44:0/1282705941 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7fc3e00cc240 con 0x7fc3e00c5ae0 2024-04-17T19:49:25.043 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:25.052+0000 7fc3df400640 1 -- 172.21.15.44:0/1282705941 >> v2:172.21.15.62:3300/0 conn(0x7fc3e015bf30 msgr2=0x7fc3bc00a020 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.62:3300/0 2024-04-17T19:49:25.043 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:25.052+0000 7fc3dfe00640 1 -- 172.21.15.44:0/1282705941 >> v1:172.21.15.62:6789/0 conn(0x7fc3bc0036d0 legacy=0x7fc3bc005ba0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.62:6789/0 2024-04-17T19:49:25.043 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:25.052+0000 7fc3df400640 1 --2- 172.21.15.44:0/1282705941 >> v2:172.21.15.62:3300/0 conn(0x7fc3e015bf30 0x7fc3bc00a020 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-17T19:49:25.043 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:25.052+0000 7fc3d6a00640 1 --2- 172.21.15.44:0/1282705941 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fc3e00c5ae0 0x7fc3bc00a560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:49:25.043 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:25.052+0000 7fc3d6a00640 1 -- 172.21.15.44:0/1282705941 >> v2:172.21.15.62:3300/0 conn(0x7fc3e015bf30 msgr2=0x7fc3bc00a020 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-17T19:49:25.043 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:25.052+0000 7fc3d6a00640 1 --2- 172.21.15.44:0/1282705941 >> v2:172.21.15.62:3300/0 conn(0x7fc3e015bf30 0x7fc3bc00a020 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:49:25.044 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:25.052+0000 7fc3d6a00640 1 -- 172.21.15.44:0/1282705941 >> v1:172.21.15.62:6789/0 conn(0x7fc3bc0036d0 legacy=0x7fc3bc005ba0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-17T19:49:25.044 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:25.056+0000 7fc3d6a00640 1 -- 172.21.15.44:0/1282705941 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc3e00cb910 con 0x7fc3e00c5ae0 2024-04-17T19:49:25.046 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:25.056+0000 7fc3d6a00640 1 --2- 172.21.15.44:0/1282705941 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fc3e00c5ae0 0x7fc3bc00a560 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fc3c8009610 tx=0x7fc3c801e830 comp rx=0 tx=0).ready entity=mon.2 client_cookie=185e3dce44dee3d7 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:49:25.046 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:25.056+0000 7fc3dea00640 1 -- 172.21.15.44:0/1282705941 <== mon.2 v2:172.21.15.62:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3c80b4070 con 0x7fc3e00c5ae0 2024-04-17T19:49:25.046 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:25.056+0000 7fc3dea00640 1 -- 172.21.15.44:0/1282705941 <== mon.2 v2:172.21.15.62:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc3bc00ae50 con 0x7fc3e00c5ae0 2024-04-17T19:49:25.046 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:25.056+0000 7fc3dea00640 1 -- 172.21.15.44:0/1282705941 <== mon.2 v2:172.21.15.62:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3c80af890 con 0x7fc3e00c5ae0 2024-04-17T19:49:25.048 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:25.060+0000 7fc3e6600640 1 -- 172.21.15.44:0/1282705941 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fc3e00c5ae0 msgr2=0x7fc3bc00a560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:49:25.048 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:25.060+0000 7fc3e6600640 1 --2- 172.21.15.44:0/1282705941 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fc3e00c5ae0 0x7fc3bc00a560 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fc3c8009610 tx=0x7fc3c801e830 comp rx=0 tx=0).stop 2024-04-17T19:49:25.048 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:25.060+0000 7fc3e6600640 1 -- 172.21.15.44:0/1282705941 shutdown_connections 2024-04-17T19:49:25.048 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:25.060+0000 7fc3e6600640 1 --2- 172.21.15.44:0/1282705941 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fc3e00c5ae0 0x7fc3bc00a560 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:49:25.048 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:25.060+0000 7fc3e6600640 1 --2- 172.21.15.44:0/1282705941 >> v2:172.21.15.62:3300/0 conn(0x7fc3e015bf30 0x7fc3bc00a020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:49:25.048 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:25.060+0000 7fc3e6600640 1 -- 172.21.15.44:0/1282705941 >> 172.21.15.44:0/1282705941 conn(0x7fc3e0067eb0 msgr2=0x7fc3e00682c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:49:25.048 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:25.060+0000 7fc3e6600640 1 -- 172.21.15.44:0/1282705941 shutdown_connections 2024-04-17T19:49:25.048 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:25.060+0000 7fc3e6600640 1 -- 172.21.15.44:0/1282705941 wait complete. 2024-04-17T19:49:25.050 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:25.060+0000 7fc3e6600640 1 Processor -- start 2024-04-17T19:49:25.051 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:25.060+0000 7fc3e6600640 1 -- start start 2024-04-17T19:49:25.053 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:25.064+0000 7fc3e6600640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fc3bc0036d0 0x7fc3e01f5dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:49:25.053 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:25.064+0000 7fc3e6600640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc3e00c5ae0 0x7fc3e015aab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:49:25.053 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:25.064+0000 7fc3e6600640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc3e015bf30 0x7fc3e0148480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:49:25.053 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:25.064+0000 7fc3e6600640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fc3e015c340 con 0x7fc3e00c5ae0 2024-04-17T19:49:25.053 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:25.064+0000 7fc3e6600640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7fc3e00cbed0 con 0x7fc3e015bf30 2024-04-17T19:49:25.053 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:25.064+0000 7fc3e6600640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7fc3e00ca790 con 0x7fc3bc0036d0 2024-04-17T19:49:25.053 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:25.064+0000 7fc3dfe00640 1 -- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc3e015bf30 msgr2=0x7fc3e0148480 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.62:3300/0 2024-04-17T19:49:25.053 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:25.064+0000 7fc3d6a00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc3e00c5ae0 0x7fc3e015aab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:49:25.053 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:25.064+0000 7fc3dfe00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc3e015bf30 0x7fc3e0148480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-17T19:49:25.053 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:25.064+0000 7fc3d6a00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc3e00c5ae0 0x7fc3e015aab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:56846/0 (socket says 172.21.15.44:56846) 2024-04-17T19:49:25.053 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:25.064+0000 7fc3d6a00640 1 -- 172.21.15.44:0/589989056 learned_addr learned my addr 172.21.15.44:0/589989056 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-04-17T19:49:25.053 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:25.064+0000 7fc3df400640 1 --2- 172.21.15.44:0/589989056 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fc3bc0036d0 0x7fc3e01f5dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:49:25.055 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:25.064+0000 7fc3d6a00640 1 -- 172.21.15.44:0/589989056 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fc3bc0036d0 msgr2=0x7fc3e01f5dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:49:25.055 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:25.064+0000 7fc3d6a00640 1 --2- 172.21.15.44:0/589989056 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fc3bc0036d0 0x7fc3e01f5dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:49:25.055 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:25.064+0000 7fc3d6a00640 1 -- 172.21.15.44:0/589989056 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc3e015bf30 msgr2=0x7fc3e0148480 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-17T19:49:25.055 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:25.064+0000 7fc3d6a00640 1 --2- 172.21.15.44:0/589989056 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc3e015bf30 0x7fc3e0148480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:49:25.055 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:25.064+0000 7fc3d6a00640 1 -- 172.21.15.44:0/589989056 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc3e01f6300 con 0x7fc3e00c5ae0 2024-04-17T19:49:25.055 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:25.064+0000 7fc3d6a00640 1 --2- 172.21.15.44:0/589989056 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc3e00c5ae0 0x7fc3e015aab0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7fc3c8000f90 tx=0x7fc3c800a5b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:49:25.055 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:25.064+0000 7fc3d7e00640 1 -- 172.21.15.44:0/589989056 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3c80bf070 con 0x7fc3e00c5ae0 2024-04-17T19:49:25.055 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:25.064+0000 7fc3d7e00640 1 -- 172.21.15.44:0/589989056 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc3c80afe50 con 0x7fc3e00c5ae0 2024-04-17T19:49:25.055 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:25.064+0000 7fc3d7e00640 1 -- 172.21.15.44:0/589989056 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3c80b4040 con 0x7fc3e00c5ae0 2024-04-17T19:49:25.055 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:25.064+0000 7fc3e6600640 1 -- 172.21.15.44:0/589989056 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc3e00cfa90 con 0x7fc3e00c5ae0 2024-04-17T19:49:25.055 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:25.064+0000 7fc3e6600640 1 -- 172.21.15.44:0/589989056 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc3e0151490 con 0x7fc3e00c5ae0 2024-04-17T19:49:25.056 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:25.068+0000 7fc3e6600640 1 -- 172.21.15.44:0/589989056 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc3e004ff10 con 0x7fc3e00c5ae0 2024-04-17T19:49:25.057 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:25.068+0000 7fc3d7e00640 1 -- 172.21.15.44:0/589989056 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fc3c80c2070 con 0x7fc3e00c5ae0 2024-04-17T19:49:25.057 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:25.068+0000 7fc3d7e00640 1 --2- 172.21.15.44:0/589989056 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7fc3bc06c200 0x7fc3bc06e710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:49:25.058 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:25.068+0000 7fc3d7e00640 1 -- 172.21.15.44:0/589989056 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6619+0+0 (secure 0 0 0) 0x7fc3c8123730 con 0x7fc3e00c5ae0 2024-04-17T19:49:25.058 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:25.068+0000 7fc3df400640 1 --2- 172.21.15.44:0/589989056 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7fc3bc06c200 0x7fc3bc06e710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:49:25.059 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:25.072+0000 7fc3df400640 1 --2- 172.21.15.44:0/589989056 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7fc3bc06c200 0x7fc3bc06e710 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fc3d0000f70 tx=0x7fc3d0009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:49:25.063 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:25.076+0000 7fc3d7e00640 1 -- 172.21.15.44:0/589989056 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fc3c8010040 con 0x7fc3e00c5ae0 2024-04-17T19:49:25.291 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:25.304+0000 7fc3e6600640 1 -- 172.21.15.44:0/589989056 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7fc3e0150c30 con 0x7fc3e00c5ae0 2024-04-17T19:49:25.291 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:25.304+0000 7fc3d7e00640 1 -- 172.21.15.44:0/589989056 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1550 (secure 0 0 0) 0x7fc3c80f3310 con 0x7fc3e00c5ae0 2024-04-17T19:49:25.292 INFO:teuthology.orchestra.run.smithi044.stdout:{"election_epoch":16,"quorum":[0,2],"quorum_names":["a","c"],"quorum_leader_name":"a","quorum_age":1,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"703f77ca-79c6-4a66-b576-62c526cb1021","modified":"2024-04-17T19:45:55.379749Z","created":"2024-04-17T19:45:55.379749Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:3300","nonce":0},{"type":"v1","addr":"172.21.15.44:6789","nonce":0}]},"addr":"172.21.15.44:6789/0","public_addr":"172.21.15.44:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:3300","nonce":0},{"type":"v1","addr":"172.21.15.62:6789","nonce":0}]},"addr":"172.21.15.62:6789/0","public_addr":"172.21.15.62:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:3301","nonce":0},{"type":"v1","addr":"172.21.15.62:6790","nonce":0}]},"addr":"172.21.15.62:6790/0","public_addr":"172.21.15.62:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-04-17T19:49:25.294 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:25.304+0000 7fc3e6600640 1 -- 172.21.15.44:0/589989056 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7fc3bc06c200 msgr2=0x7fc3bc06e710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:49:25.294 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:25.304+0000 7fc3e6600640 1 --2- 172.21.15.44:0/589989056 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7fc3bc06c200 0x7fc3bc06e710 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fc3d0000f70 tx=0x7fc3d0009040 comp rx=0 tx=0).stop 2024-04-17T19:49:25.294 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:25.304+0000 7fc3e6600640 1 -- 172.21.15.44:0/589989056 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc3e00c5ae0 msgr2=0x7fc3e015aab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:49:25.294 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:25.304+0000 7fc3e6600640 1 --2- 172.21.15.44:0/589989056 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc3e00c5ae0 0x7fc3e015aab0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7fc3c8000f90 tx=0x7fc3c800a5b0 comp rx=0 tx=0).stop 2024-04-17T19:49:25.294 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:25.304+0000 7fc3e6600640 1 -- 172.21.15.44:0/589989056 shutdown_connections 2024-04-17T19:49:25.295 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:25.304+0000 7fc3e6600640 1 --2- 172.21.15.44:0/589989056 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7fc3bc06c200 0x7fc3bc06e710 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:49:25.295 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:25.304+0000 7fc3e6600640 1 --2- 172.21.15.44:0/589989056 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc3e015bf30 0x7fc3e0148480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:49:25.295 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:25.304+0000 7fc3e6600640 1 --2- 172.21.15.44:0/589989056 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc3e00c5ae0 0x7fc3e015aab0 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:49:25.295 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:25.304+0000 7fc3e6600640 1 --2- 172.21.15.44:0/589989056 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fc3bc0036d0 0x7fc3e01f5dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:49:25.295 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:25.304+0000 7fc3e6600640 1 -- 172.21.15.44:0/589989056 >> 172.21.15.44:0/589989056 conn(0x7fc3e0067eb0 msgr2=0x7fc3e014a720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:49:25.295 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:25.304+0000 7fc3e6600640 1 -- 172.21.15.44:0/589989056 shutdown_connections 2024-04-17T19:49:25.295 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:25.304+0000 7fc3e6600640 1 -- 172.21.15.44:0/589989056 wait complete. 2024-04-17T19:49:25.314 INFO:tasks.mon_thrash.ceph_manager:quorum is size 2 2024-04-17T19:49:25.314 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 2 for mon a 2024-04-17T19:49:25.314 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2024-04-17T19:49:25.467 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:25.480+0000 7f2771600640 1 Processor -- start 2024-04-17T19:49:25.468 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:25.480+0000 7f2771600640 1 -- start start 2024-04-17T19:49:25.470 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:25.480+0000 7f2771600640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f276c0c80a0 0x7f276c0c84b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:49:25.470 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:25.480+0000 7f2771600640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f276c0c89f0 con 0x7f276c152860 2024-04-17T19:49:25.470 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:25.480+0000 7f2771600640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f276c0c4000 con 0x7f276c0c68b0 2024-04-17T19:49:25.470 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:25.480+0000 7f2771600640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 -- 0x7f276c0c6eb0 con 0x7f276c0c80a0 2024-04-17T19:49:25.470 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:25.480+0000 7f276b400640 1 -- >> v2:172.21.15.62:3300/0 conn(0x7f276c0c80a0 msgr2=0x7f276c0c84b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.62:3300/0 2024-04-17T19:49:25.470 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:25.480+0000 7f2763e00640 1 -- >> v1:172.21.15.62:6789/0 conn(0x7f276c0c68b0 legacy=0x7f276c0c47e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.62:6789/0 2024-04-17T19:49:25.470 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:25.480+0000 7f276b400640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f276c0c80a0 0x7f276c0c84b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-17T19:49:25.470 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:25.480+0000 7f276aa00640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f276c152860 0x7f276c159140 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:36604/0 (socket says 172.21.15.44:36604) 2024-04-17T19:49:25.470 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:25.480+0000 7f276aa00640 1 -- 172.21.15.44:0/3200298941 learned_addr learned my addr 172.21.15.44:0/3200298941 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-04-17T19:49:25.472 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:25.480+0000 7f276a000640 1 -- 172.21.15.44:0/3200298941 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1154212048 0 0) 0x7f275c001120 con 0x7f276c152860 2024-04-17T19:49:25.472 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:25.480+0000 7f276a000640 1 -- 172.21.15.44:0/3200298941 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2750003530 con 0x7f276c152860 2024-04-17T19:49:25.472 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:25.480+0000 7f276a000640 1 -- 172.21.15.44:0/3200298941 <== mon.0 v1:172.21.15.44:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2147434324 0 0) 0x7f2750003530 con 0x7f276c152860 2024-04-17T19:49:25.472 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:25.480+0000 7f276a000640 1 -- 172.21.15.44:0/3200298941 >> v2:172.21.15.62:3300/0 conn(0x7f276c0c80a0 msgr2=0x7f276c0c84b0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-17T19:49:25.472 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:25.480+0000 7f276a000640 1 --2- 172.21.15.44:0/3200298941 >> v2:172.21.15.62:3300/0 conn(0x7f276c0c80a0 0x7f276c0c84b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:49:25.472 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:25.480+0000 7f276a000640 1 -- 172.21.15.44:0/3200298941 >> v1:172.21.15.62:6789/0 conn(0x7f276c0c68b0 legacy=0x7f276c0c47e0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-17T19:49:25.472 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:25.480+0000 7f276a000640 1 -- 172.21.15.44:0/3200298941 --> v1:172.21.15.44:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f276c0c42e0 con 0x7f276c152860 2024-04-17T19:49:25.472 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:25.480+0000 7f276a000640 1 -- 172.21.15.44:0/3200298941 <== mon.0 v1:172.21.15.44:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1863569991 0 0) 0x7f275c001850 con 0x7f276c152860 2024-04-17T19:49:25.472 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:25.480+0000 7f276a000640 1 -- 172.21.15.44:0/3200298941 >> v1:172.21.15.44:6789/0 conn(0x7f276c152860 legacy=0x7f276c159140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:49:25.472 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:25.480+0000 7f276a000640 1 --2- 172.21.15.44:0/3200298941 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f27500039c0 0x7f2750003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:49:25.473 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:25.480+0000 7f276a000640 1 --2- 172.21.15.44:0/3200298941 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2750004810 0x7f2750004c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:49:25.473 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:25.480+0000 7f276a000640 1 --2- 172.21.15.44:0/3200298941 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f27500053b0 0x7f275000ba30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:49:25.473 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:25.480+0000 7f276a000640 1 -- 172.21.15.44:0/3200298941 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f276c0c6eb0 con 0x7f2750004810 2024-04-17T19:49:25.473 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:25.480+0000 7f276a000640 1 -- 172.21.15.44:0/3200298941 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f275000c310 con 0x7f27500039c0 2024-04-17T19:49:25.473 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:25.484+0000 7f276a000640 1 -- 172.21.15.44:0/3200298941 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7f275000e720 con 0x7f27500053b0 2024-04-17T19:49:25.473 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:25.484+0000 7f276aa00640 1 -- 172.21.15.44:0/3200298941 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f27500039c0 msgr2=0x7f2750003e10 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.62:3300/0 2024-04-17T19:49:25.473 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:25.484+0000 7f276aa00640 1 --2- 172.21.15.44:0/3200298941 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f27500039c0 0x7f2750003e10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-17T19:49:25.473 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:25.484+0000 7f2763e00640 1 --2- 172.21.15.44:0/3200298941 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2750004810 0x7f2750004c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:49:25.473 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:25.484+0000 7f276b400640 1 --2- 172.21.15.44:0/3200298941 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f27500053b0 0x7f275000ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:49:25.473 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:25.484+0000 7f2763e00640 1 -- 172.21.15.44:0/3200298941 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f27500053b0 msgr2=0x7f275000ba30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T19:49:25.473 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:25.484+0000 7f2763e00640 1 --2- 172.21.15.44:0/3200298941 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f27500053b0 0x7f275000ba30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:49:25.473 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:25.484+0000 7f2763e00640 1 -- 172.21.15.44:0/3200298941 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f27500039c0 msgr2=0x7f2750003e10 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-17T19:49:25.473 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:25.484+0000 7f2763e00640 1 --2- 172.21.15.44:0/3200298941 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f27500039c0 0x7f2750003e10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:49:25.473 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:25.484+0000 7f2763e00640 1 -- 172.21.15.44:0/3200298941 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2750003530 con 0x7f2750004810 2024-04-17T19:49:25.473 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:25.484+0000 7f276b400640 1 -- 172.21.15.44:0/3200298941 reap_dead start 2024-04-17T19:49:25.474 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:25.484+0000 7f2763e00640 1 --2- 172.21.15.44:0/3200298941 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2750004810 0x7f2750004c20 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f27540038c0 tx=0x7f275401c360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c9140b6ee1a879d5 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:49:25.474 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:25.484+0000 7f276a000640 1 -- 172.21.15.44:0/3200298941 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2754009470 con 0x7f2750004810 2024-04-17T19:49:25.474 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:25.484+0000 7f276a000640 1 -- 172.21.15.44:0/3200298941 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2754003af0 con 0x7f2750004810 2024-04-17T19:49:25.474 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:25.484+0000 7f276a000640 1 -- 172.21.15.44:0/3200298941 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27540050d0 con 0x7f2750004810 2024-04-17T19:49:25.475 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:25.488+0000 7f2771600640 1 -- 172.21.15.44:0/3200298941 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2750004810 msgr2=0x7f2750004c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:49:25.475 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:25.488+0000 7f2771600640 1 --2- 172.21.15.44:0/3200298941 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2750004810 0x7f2750004c20 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f27540038c0 tx=0x7f275401c360 comp rx=0 tx=0).stop 2024-04-17T19:49:25.475 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:25.488+0000 7f2771600640 1 -- 172.21.15.44:0/3200298941 shutdown_connections 2024-04-17T19:49:25.475 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:25.488+0000 7f2771600640 1 --2- 172.21.15.44:0/3200298941 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2750004810 0x7f2750004c20 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:49:25.475 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:25.488+0000 7f2771600640 1 -- 172.21.15.44:0/3200298941 >> 172.21.15.44:0/3200298941 conn(0x7f276c06c380 msgr2=0x7f276c070080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:49:25.475 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:25.488+0000 7f2771600640 1 -- 172.21.15.44:0/3200298941 shutdown_connections 2024-04-17T19:49:25.476 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:25.488+0000 7f2771600640 1 -- 172.21.15.44:0/3200298941 wait complete. 2024-04-17T19:49:25.477 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:25.488+0000 7f2771600640 1 Processor -- start 2024-04-17T19:49:25.478 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:25.488+0000 7f2771600640 1 -- start start 2024-04-17T19:49:25.479 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:25.492+0000 7f2771600640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2750004810 0x7f276c1f1620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:49:25.480 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:25.492+0000 7f2771600640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f276c069120 0x7f276c159910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:49:25.480 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:25.492+0000 7f2771600640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f276c1e6000 0x7f276c0cb9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:49:25.480 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:25.492+0000 7f2771600640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f276c15bcb0 con 0x7f2750004810 2024-04-17T19:49:25.480 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:25.492+0000 7f2771600640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f276c0c78e0 con 0x7f276c1e6000 2024-04-17T19:49:25.480 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:25.492+0000 7f2771600640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7f276c15be30 con 0x7f276c069120 2024-04-17T19:49:25.480 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:25.492+0000 7f276aa00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2750004810 0x7f276c1f1620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:49:25.480 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:25.492+0000 7f276b400640 1 -- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f276c1e6000 msgr2=0x7f276c0cb9d0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.62:3300/0 2024-04-17T19:49:25.480 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:25.492+0000 7f276b400640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f276c1e6000 0x7f276c0cb9d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-17T19:49:25.480 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:25.492+0000 7f276aa00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2750004810 0x7f276c1f1620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:54900/0 (socket says 172.21.15.44:54900) 2024-04-17T19:49:25.480 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:25.492+0000 7f276aa00640 1 -- 172.21.15.44:0/2508073357 learned_addr learned my addr 172.21.15.44:0/2508073357 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-04-17T19:49:25.480 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:25.492+0000 7f2763e00640 1 --2- 172.21.15.44:0/2508073357 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f276c069120 0x7f276c159910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:49:25.480 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:25.492+0000 7f276aa00640 1 -- 172.21.15.44:0/2508073357 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f276c069120 msgr2=0x7f276c159910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:49:25.480 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:25.492+0000 7f276aa00640 1 --2- 172.21.15.44:0/2508073357 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f276c069120 0x7f276c159910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:49:25.480 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:25.492+0000 7f276aa00640 1 -- 172.21.15.44:0/2508073357 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f276c1e6000 msgr2=0x7f276c0cb9d0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-17T19:49:25.481 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:25.492+0000 7f276aa00640 1 --2- 172.21.15.44:0/2508073357 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f276c1e6000 0x7f276c0cb9d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:49:25.481 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:25.492+0000 7f276aa00640 1 -- 172.21.15.44:0/2508073357 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f276c073550 con 0x7f2750004810 2024-04-17T19:49:25.482 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:25.492+0000 7f276aa00640 1 --2- 172.21.15.44:0/2508073357 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2750004810 0x7f276c1f1620 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f275c00c760 tx=0x7f275c00cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:49:25.482 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:25.492+0000 7f2762a00640 1 -- 172.21.15.44:0/2508073357 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f275c018070 con 0x7f2750004810 2024-04-17T19:49:25.482 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:25.492+0000 7f2762a00640 1 -- 172.21.15.44:0/2508073357 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f275c0074e0 con 0x7f2750004810 2024-04-17T19:49:25.482 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:25.492+0000 7f2762a00640 1 -- 172.21.15.44:0/2508073357 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f275c004a30 con 0x7f2750004810 2024-04-17T19:49:25.482 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:25.492+0000 7f2771600640 1 -- 172.21.15.44:0/2508073357 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f276c159e50 con 0x7f2750004810 2024-04-17T19:49:25.482 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:25.492+0000 7f2771600640 1 -- 172.21.15.44:0/2508073357 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f276c15b690 con 0x7f2750004810 2024-04-17T19:49:25.482 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:25.492+0000 7f2771600640 1 --2- 172.21.15.44:0/2508073357 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f276c15a020 0x7f276c0cbf10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:49:25.482 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:25.492+0000 7f2771600640 1 -- 172.21.15.44:0/2508073357 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f276c15b440 con 0x7f276c15a020 2024-04-17T19:49:25.482 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:25.492+0000 7f2763e00640 1 --2- 172.21.15.44:0/2508073357 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f276c15a020 0x7f276c0cbf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:49:25.482 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:25.492+0000 7f2763e00640 1 -- 172.21.15.44:0/2508073357 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f276c04ff10 con 0x7f276c15a020 2024-04-17T19:49:25.483 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:25.492+0000 7f2763e00640 1 --2- 172.21.15.44:0/2508073357 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f276c15a020 0x7f276c0cbf10 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f2754006fd0 tx=0x7f2754019100 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:49:25.484 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:25.492+0000 7f2762a00640 1 -- 172.21.15.44:0/2508073357 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f275c004bd0 con 0x7f2750004810 2024-04-17T19:49:25.484 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:25.496+0000 7f2762a00640 1 --2- 172.21.15.44:0/2508073357 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f2748068330 0x7f274806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:49:25.484 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:25.496+0000 7f2762a00640 1 -- 172.21.15.44:0/2508073357 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6619+0+0 (secure 0 0 0) 0x7f275c086290 con 0x7f2750004810 2024-04-17T19:49:25.484 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:25.496+0000 7f2762a00640 1 -- 172.21.15.44:0/2508073357 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27540b1040 con 0x7f276c15a020 2024-04-17T19:49:25.484 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:25.496+0000 7f2762a00640 1 -- 172.21.15.44:0/2508073357 <== mon.0 v2:172.21.15.44:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f27540050d0 con 0x7f276c15a020 2024-04-17T19:49:25.484 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:25.496+0000 7f2762a00640 1 -- 172.21.15.44:0/2508073357 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f276c15a020 msgr2=0x7f276c0cbf10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:49:25.484 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:25.496+0000 7f2762a00640 1 --2- 172.21.15.44:0/2508073357 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f276c15a020 0x7f276c0cbf10 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f2754006fd0 tx=0x7f2754019100 comp rx=0 tx=0).stop 2024-04-17T19:49:25.484 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:25.496+0000 7f2762a00640 1 -- 172.21.15.44:0/2508073357 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f276c15a020 msgr2=0x7f276c0cbf10 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-04-17T19:49:25.484 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:25.496+0000 7f2762a00640 1 --2- 172.21.15.44:0/2508073357 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f276c15a020 0x7f276c0cbf10 secure :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f2754006fd0 tx=0x7f2754019100 comp rx=0 tx=0).stop 2024-04-17T19:49:25.484 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:25.496+0000 7f276b400640 1 --2- 172.21.15.44:0/2508073357 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f2748068330 0x7f274806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:49:25.484 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:25.496+0000 7f276b400640 1 --2- 172.21.15.44:0/2508073357 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f2748068330 0x7f274806a840 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f276c06cbf0 tx=0x7f2764003b40 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:49:25.490 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:25.500+0000 7f2771600640 1 --2- 172.21.15.44:0/2508073357 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f276c156530 0x7f276c1f4190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:49:25.490 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:25.500+0000 7f2771600640 1 -- 172.21.15.44:0/2508073357 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f276c156940 con 0x7f276c156530 2024-04-17T19:49:25.490 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:25.500+0000 7f2763e00640 1 --2- 172.21.15.44:0/2508073357 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f276c156530 0x7f276c1f4190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:49:25.490 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:25.500+0000 7f2763e00640 1 -- 172.21.15.44:0/2508073357 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f276c15b0f0 con 0x7f276c156530 2024-04-17T19:49:25.491 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:25.500+0000 7f2763e00640 1 --2- 172.21.15.44:0/2508073357 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f276c156530 0x7f276c1f4190 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f276c067c70 tx=0x7f2750005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:49:25.491 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:25.500+0000 7f2762a00640 1 -- 172.21.15.44:0/2508073357 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27540c1e40 con 0x7f276c156530 2024-04-17T19:49:25.491 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:25.504+0000 7f2762a00640 1 -- 172.21.15.44:0/2508073357 <== mon.0 v2:172.21.15.44:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+5191 (secure 0 0 0) 0x7f27540c1e40 con 0x7f276c156530 2024-04-17T19:49:25.491 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:25.504+0000 7f2762a00640 1 -- 172.21.15.44:0/2508073357 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f276c156530 msgr2=0x7f276c1f4190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:49:25.491 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:25.504+0000 7f2762a00640 1 --2- 172.21.15.44:0/2508073357 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f276c156530 0x7f276c1f4190 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f276c067c70 tx=0x7f2750005840 comp rx=0 tx=0).stop 2024-04-17T19:49:25.491 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:25.504+0000 7f2762a00640 1 -- 172.21.15.44:0/2508073357 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f276c156530 msgr2=0x7f276c1f4190 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-04-17T19:49:25.492 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:25.504+0000 7f2762a00640 1 --2- 172.21.15.44:0/2508073357 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f276c156530 0x7f276c1f4190 secure :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f276c067c70 tx=0x7f2750005840 comp rx=0 tx=0).stop 2024-04-17T19:49:25.492 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2024-04-17T19:49:25.492 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "a", 2024-04-17T19:49:25.492 INFO:teuthology.orchestra.run.smithi044.stdout: "rank": 0, 2024-04-17T19:49:25.492 INFO:teuthology.orchestra.run.smithi044.stdout: "state": "leader", 2024-04-17T19:49:25.492 INFO:teuthology.orchestra.run.smithi044.stdout: "election_epoch": 16, 2024-04-17T19:49:25.492 INFO:teuthology.orchestra.run.smithi044.stdout: "uptime": 174961, 2024-04-17T19:49:25.492 INFO:teuthology.orchestra.run.smithi044.stdout: "quorum": [ 2024-04-17T19:49:25.492 INFO:teuthology.orchestra.run.smithi044.stdout: 0, 2024-04-17T19:49:25.492 INFO:teuthology.orchestra.run.smithi044.stdout: 2 2024-04-17T19:49:25.492 INFO:teuthology.orchestra.run.smithi044.stdout: ], 2024-04-17T19:49:25.492 INFO:teuthology.orchestra.run.smithi044.stdout: "quorum_age": 1, 2024-04-17T19:49:25.492 INFO:teuthology.orchestra.run.smithi044.stdout: "features": { 2024-04-17T19:49:25.493 INFO:teuthology.orchestra.run.smithi044.stdout: "required_con": "2450521708007866372", 2024-04-17T19:49:25.493 INFO:teuthology.orchestra.run.smithi044.stdout: "required_mon": [ 2024-04-17T19:49:25.493 INFO:teuthology.orchestra.run.smithi044.stdout: "kraken", 2024-04-17T19:49:25.493 INFO:teuthology.orchestra.run.smithi044.stdout: "luminous", 2024-04-17T19:49:25.493 INFO:teuthology.orchestra.run.smithi044.stdout: "mimic", 2024-04-17T19:49:25.493 INFO:teuthology.orchestra.run.smithi044.stdout: "osdmap-prune", 2024-04-17T19:49:25.493 INFO:teuthology.orchestra.run.smithi044.stdout: "nautilus", 2024-04-17T19:49:25.493 INFO:teuthology.orchestra.run.smithi044.stdout: "octopus", 2024-04-17T19:49:25.493 INFO:teuthology.orchestra.run.smithi044.stdout: "pacific", 2024-04-17T19:49:25.493 INFO:teuthology.orchestra.run.smithi044.stdout: "elector-pinging", 2024-04-17T19:49:25.493 INFO:teuthology.orchestra.run.smithi044.stdout: "quincy", 2024-04-17T19:49:25.493 INFO:teuthology.orchestra.run.smithi044.stdout: "reef", 2024-04-17T19:49:25.493 INFO:teuthology.orchestra.run.smithi044.stdout: "squid" 2024-04-17T19:49:25.493 INFO:teuthology.orchestra.run.smithi044.stdout: ], 2024-04-17T19:49:25.494 INFO:teuthology.orchestra.run.smithi044.stdout: "quorum_con": "4540701547738038271", 2024-04-17T19:49:25.494 INFO:teuthology.orchestra.run.smithi044.stdout: "quorum_mon": [ 2024-04-17T19:49:25.494 INFO:teuthology.orchestra.run.smithi044.stdout: "kraken", 2024-04-17T19:49:25.494 INFO:teuthology.orchestra.run.smithi044.stdout: "luminous", 2024-04-17T19:49:25.494 INFO:teuthology.orchestra.run.smithi044.stdout: "mimic", 2024-04-17T19:49:25.494 INFO:teuthology.orchestra.run.smithi044.stdout: "osdmap-prune", 2024-04-17T19:49:25.494 INFO:teuthology.orchestra.run.smithi044.stdout: "nautilus", 2024-04-17T19:49:25.494 INFO:teuthology.orchestra.run.smithi044.stdout: "octopus", 2024-04-17T19:49:25.494 INFO:teuthology.orchestra.run.smithi044.stdout: "pacific", 2024-04-17T19:49:25.494 INFO:teuthology.orchestra.run.smithi044.stdout: "elector-pinging", 2024-04-17T19:49:25.494 INFO:teuthology.orchestra.run.smithi044.stdout: "quincy", 2024-04-17T19:49:25.494 INFO:teuthology.orchestra.run.smithi044.stdout: "reef", 2024-04-17T19:49:25.494 INFO:teuthology.orchestra.run.smithi044.stdout: "squid" 2024-04-17T19:49:25.494 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T19:49:25.495 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T19:49:25.495 INFO:teuthology.orchestra.run.smithi044.stdout: "outside_quorum": [], 2024-04-17T19:49:25.495 INFO:teuthology.orchestra.run.smithi044.stdout: "extra_probe_peers": [], 2024-04-17T19:49:25.495 INFO:teuthology.orchestra.run.smithi044.stdout: "sync_provider": [], 2024-04-17T19:49:25.495 INFO:teuthology.orchestra.run.smithi044.stdout: "monmap": { 2024-04-17T19:49:25.495 INFO:teuthology.orchestra.run.smithi044.stdout: "epoch": 1, 2024-04-17T19:49:25.495 INFO:teuthology.orchestra.run.smithi044.stdout: "fsid": "703f77ca-79c6-4a66-b576-62c526cb1021", 2024-04-17T19:49:25.495 INFO:teuthology.orchestra.run.smithi044.stdout: "modified": "2024-04-17T19:45:55.379749Z", 2024-04-17T19:49:25.495 INFO:teuthology.orchestra.run.smithi044.stdout: "created": "2024-04-17T19:45:55.379749Z", 2024-04-17T19:49:25.495 INFO:teuthology.orchestra.run.smithi044.stdout: "min_mon_release": 19, 2024-04-17T19:49:25.495 INFO:teuthology.orchestra.run.smithi044.stdout: "min_mon_release_name": "squid", 2024-04-17T19:49:25.495 INFO:teuthology.orchestra.run.smithi044.stdout: "election_strategy": 1, 2024-04-17T19:49:25.495 INFO:teuthology.orchestra.run.smithi044.stdout: "disallowed_leaders: ": "", 2024-04-17T19:49:25.495 INFO:teuthology.orchestra.run.smithi044.stdout: "stretch_mode": false, 2024-04-17T19:49:25.495 INFO:teuthology.orchestra.run.smithi044.stdout: "tiebreaker_mon": "", 2024-04-17T19:49:25.495 INFO:teuthology.orchestra.run.smithi044.stdout: "removed_ranks: ": "", 2024-04-17T19:49:25.496 INFO:teuthology.orchestra.run.smithi044.stdout: "features": { 2024-04-17T19:49:25.496 INFO:teuthology.orchestra.run.smithi044.stdout: "persistent": [ 2024-04-17T19:49:25.496 INFO:teuthology.orchestra.run.smithi044.stdout: "kraken", 2024-04-17T19:49:25.496 INFO:teuthology.orchestra.run.smithi044.stdout: "luminous", 2024-04-17T19:49:25.496 INFO:teuthology.orchestra.run.smithi044.stdout: "mimic", 2024-04-17T19:49:25.496 INFO:teuthology.orchestra.run.smithi044.stdout: "osdmap-prune", 2024-04-17T19:49:25.496 INFO:teuthology.orchestra.run.smithi044.stdout: "nautilus", 2024-04-17T19:49:25.496 INFO:teuthology.orchestra.run.smithi044.stdout: "octopus", 2024-04-17T19:49:25.496 INFO:teuthology.orchestra.run.smithi044.stdout: "pacific", 2024-04-17T19:49:25.496 INFO:teuthology.orchestra.run.smithi044.stdout: "elector-pinging", 2024-04-17T19:49:25.496 INFO:teuthology.orchestra.run.smithi044.stdout: "quincy", 2024-04-17T19:49:25.496 INFO:teuthology.orchestra.run.smithi044.stdout: "reef", 2024-04-17T19:49:25.496 INFO:teuthology.orchestra.run.smithi044.stdout: "squid" 2024-04-17T19:49:25.496 INFO:teuthology.orchestra.run.smithi044.stdout: ], 2024-04-17T19:49:25.496 INFO:teuthology.orchestra.run.smithi044.stdout: "optional": [] 2024-04-17T19:49:25.497 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T19:49:25.497 INFO:teuthology.orchestra.run.smithi044.stdout: "mons": [ 2024-04-17T19:49:25.497 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T19:49:25.497 INFO:teuthology.orchestra.run.smithi044.stdout: "rank": 0, 2024-04-17T19:49:25.497 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "a", 2024-04-17T19:49:25.497 INFO:teuthology.orchestra.run.smithi044.stdout: "public_addrs": { 2024-04-17T19:49:25.497 INFO:teuthology.orchestra.run.smithi044.stdout: "addrvec": [ 2024-04-17T19:49:25.497 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T19:49:25.497 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "v2", 2024-04-17T19:49:25.497 INFO:teuthology.orchestra.run.smithi044.stdout: "addr": "172.21.15.44:3300", 2024-04-17T19:49:25.497 INFO:teuthology.orchestra.run.smithi044.stdout: "nonce": 0 2024-04-17T19:49:25.497 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T19:49:25.497 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T19:49:25.497 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "v1", 2024-04-17T19:49:25.497 INFO:teuthology.orchestra.run.smithi044.stdout: "addr": "172.21.15.44:6789", 2024-04-17T19:49:25.497 INFO:teuthology.orchestra.run.smithi044.stdout: "nonce": 0 2024-04-17T19:49:25.498 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T19:49:25.498 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T19:49:25.498 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T19:49:25.498 INFO:teuthology.orchestra.run.smithi044.stdout: "addr": "172.21.15.44:6789/0", 2024-04-17T19:49:25.498 INFO:teuthology.orchestra.run.smithi044.stdout: "public_addr": "172.21.15.44:6789/0", 2024-04-17T19:49:25.498 INFO:teuthology.orchestra.run.smithi044.stdout: "priority": 0, 2024-04-17T19:49:25.498 INFO:teuthology.orchestra.run.smithi044.stdout: "weight": 0, 2024-04-17T19:49:25.498 INFO:teuthology.orchestra.run.smithi044.stdout: "crush_location": "{}" 2024-04-17T19:49:25.498 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T19:49:25.498 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T19:49:25.498 INFO:teuthology.orchestra.run.smithi044.stdout: "rank": 1, 2024-04-17T19:49:25.498 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "b", 2024-04-17T19:49:25.498 INFO:teuthology.orchestra.run.smithi044.stdout: "public_addrs": { 2024-04-17T19:49:25.499 INFO:teuthology.orchestra.run.smithi044.stdout: "addrvec": [ 2024-04-17T19:49:25.499 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T19:49:25.499 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "v2", 2024-04-17T19:49:25.499 INFO:teuthology.orchestra.run.smithi044.stdout: "addr": "172.21.15.62:3300", 2024-04-17T19:49:25.499 INFO:teuthology.orchestra.run.smithi044.stdout: "nonce": 0 2024-04-17T19:49:25.499 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T19:49:25.499 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T19:49:25.499 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "v1", 2024-04-17T19:49:25.499 INFO:teuthology.orchestra.run.smithi044.stdout: "addr": "172.21.15.62:6789", 2024-04-17T19:49:25.499 INFO:teuthology.orchestra.run.smithi044.stdout: "nonce": 0 2024-04-17T19:49:25.499 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T19:49:25.499 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T19:49:25.499 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T19:49:25.499 INFO:teuthology.orchestra.run.smithi044.stdout: "addr": "172.21.15.62:6789/0", 2024-04-17T19:49:25.499 INFO:teuthology.orchestra.run.smithi044.stdout: "public_addr": "172.21.15.62:6789/0", 2024-04-17T19:49:25.499 INFO:teuthology.orchestra.run.smithi044.stdout: "priority": 0, 2024-04-17T19:49:25.499 INFO:teuthology.orchestra.run.smithi044.stdout: "weight": 0, 2024-04-17T19:49:25.500 INFO:teuthology.orchestra.run.smithi044.stdout: "crush_location": "{}" 2024-04-17T19:49:25.500 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T19:49:25.500 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T19:49:25.500 INFO:teuthology.orchestra.run.smithi044.stdout: "rank": 2, 2024-04-17T19:49:25.500 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "c", 2024-04-17T19:49:25.500 INFO:teuthology.orchestra.run.smithi044.stdout: "public_addrs": { 2024-04-17T19:49:25.500 INFO:teuthology.orchestra.run.smithi044.stdout: "addrvec": [ 2024-04-17T19:49:25.500 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T19:49:25.500 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "v2", 2024-04-17T19:49:25.500 INFO:teuthology.orchestra.run.smithi044.stdout: "addr": "172.21.15.62:3301", 2024-04-17T19:49:25.500 INFO:teuthology.orchestra.run.smithi044.stdout: "nonce": 0 2024-04-17T19:49:25.500 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T19:49:25.500 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T19:49:25.500 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "v1", 2024-04-17T19:49:25.500 INFO:teuthology.orchestra.run.smithi044.stdout: "addr": "172.21.15.62:6790", 2024-04-17T19:49:25.501 INFO:teuthology.orchestra.run.smithi044.stdout: "nonce": 0 2024-04-17T19:49:25.501 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T19:49:25.501 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T19:49:25.501 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T19:49:25.501 INFO:teuthology.orchestra.run.smithi044.stdout: "addr": "172.21.15.62:6790/0", 2024-04-17T19:49:25.501 INFO:teuthology.orchestra.run.smithi044.stdout: "public_addr": "172.21.15.62:6790/0", 2024-04-17T19:49:25.501 INFO:teuthology.orchestra.run.smithi044.stdout: "priority": 0, 2024-04-17T19:49:25.501 INFO:teuthology.orchestra.run.smithi044.stdout: "weight": 0, 2024-04-17T19:49:25.501 INFO:teuthology.orchestra.run.smithi044.stdout: "crush_location": "{}" 2024-04-17T19:49:25.501 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T19:49:25.501 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T19:49:25.501 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T19:49:25.501 INFO:teuthology.orchestra.run.smithi044.stdout: "feature_map": { 2024-04-17T19:49:25.501 INFO:teuthology.orchestra.run.smithi044.stdout: "mon": [ 2024-04-17T19:49:25.501 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T19:49:25.502 INFO:teuthology.orchestra.run.smithi044.stdout: "features": "0x3f03cffffffdffff", 2024-04-17T19:49:25.502 INFO:teuthology.orchestra.run.smithi044.stdout: "release": "luminous", 2024-04-17T19:49:25.502 INFO:teuthology.orchestra.run.smithi044.stdout: "num": 1 2024-04-17T19:49:25.502 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T19:49:25.502 INFO:teuthology.orchestra.run.smithi044.stdout: ], 2024-04-17T19:49:25.502 INFO:teuthology.orchestra.run.smithi044.stdout: "mds": [ 2024-04-17T19:49:25.502 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T19:49:25.502 INFO:teuthology.orchestra.run.smithi044.stdout: "features": "0x3f03cffffffdffff", 2024-04-17T19:49:25.502 INFO:teuthology.orchestra.run.smithi044.stdout: "release": "luminous", 2024-04-17T19:49:25.502 INFO:teuthology.orchestra.run.smithi044.stdout: "num": 6 2024-04-17T19:49:25.502 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T19:49:25.502 INFO:teuthology.orchestra.run.smithi044.stdout: ], 2024-04-17T19:49:25.502 INFO:teuthology.orchestra.run.smithi044.stdout: "osd": [ 2024-04-17T19:49:25.502 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T19:49:25.502 INFO:teuthology.orchestra.run.smithi044.stdout: "features": "0x3f03cffffffdffff", 2024-04-17T19:49:25.503 INFO:teuthology.orchestra.run.smithi044.stdout: "release": "luminous", 2024-04-17T19:49:25.503 INFO:teuthology.orchestra.run.smithi044.stdout: "num": 8 2024-04-17T19:49:25.503 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T19:49:25.503 INFO:teuthology.orchestra.run.smithi044.stdout: ], 2024-04-17T19:49:25.503 INFO:teuthology.orchestra.run.smithi044.stdout: "client": [ 2024-04-17T19:49:25.503 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T19:49:25.503 INFO:teuthology.orchestra.run.smithi044.stdout: "features": "0x2f018fb87aa4aafe", 2024-04-17T19:49:25.503 INFO:teuthology.orchestra.run.smithi044.stdout: "release": "luminous", 2024-04-17T19:49:25.503 INFO:teuthology.orchestra.run.smithi044.stdout: "num": 1 2024-04-17T19:49:25.503 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T19:49:25.503 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T19:49:25.503 INFO:teuthology.orchestra.run.smithi044.stdout: "features": "0x3f03cffffffdffff", 2024-04-17T19:49:25.503 INFO:teuthology.orchestra.run.smithi044.stdout: "release": "luminous", 2024-04-17T19:49:25.503 INFO:teuthology.orchestra.run.smithi044.stdout: "num": 6 2024-04-17T19:49:25.503 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T19:49:25.503 INFO:teuthology.orchestra.run.smithi044.stdout: ], 2024-04-17T19:49:25.503 INFO:teuthology.orchestra.run.smithi044.stdout: "mgr": [ 2024-04-17T19:49:25.504 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T19:49:25.504 INFO:teuthology.orchestra.run.smithi044.stdout: "features": "0x3f03cffffffdffff", 2024-04-17T19:49:25.504 INFO:teuthology.orchestra.run.smithi044.stdout: "release": "luminous", 2024-04-17T19:49:25.504 INFO:teuthology.orchestra.run.smithi044.stdout: "num": 2 2024-04-17T19:49:25.504 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T19:49:25.504 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T19:49:25.504 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T19:49:25.504 INFO:teuthology.orchestra.run.smithi044.stdout: "stretch_mode": false 2024-04-17T19:49:25.504 INFO:teuthology.orchestra.run.smithi044.stdout:} 2024-04-17T19:49:25.505 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:25.504+0000 7f2771600640 1 -- 172.21.15.44:0/2508073357 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f2748068330 msgr2=0x7f274806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:49:25.505 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:25.504+0000 7f2771600640 1 --2- 172.21.15.44:0/2508073357 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f2748068330 0x7f274806a840 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f276c06cbf0 tx=0x7f2764003b40 comp rx=0 tx=0).stop 2024-04-17T19:49:25.505 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:25.504+0000 7f2771600640 1 -- 172.21.15.44:0/2508073357 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2750004810 msgr2=0x7f276c1f1620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:49:25.505 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:25.504+0000 7f2771600640 1 --2- 172.21.15.44:0/2508073357 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2750004810 0x7f276c1f1620 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f275c00c760 tx=0x7f275c00cc20 comp rx=0 tx=0).stop 2024-04-17T19:49:25.505 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:25.504+0000 7f276b400640 1 -- 172.21.15.44:0/2508073357 reap_dead start 2024-04-17T19:49:25.505 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:25.504+0000 7f2771600640 1 -- 172.21.15.44:0/2508073357 shutdown_connections 2024-04-17T19:49:25.505 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:25.504+0000 7f2771600640 1 --2- 172.21.15.44:0/2508073357 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2750004810 0x7f276c1f1620 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:49:25.505 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:25.504+0000 7f2771600640 1 -- 172.21.15.44:0/2508073357 >> 172.21.15.44:0/2508073357 conn(0x7f276c06c380 msgr2=0x7f276c0725b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:49:25.505 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:25.504+0000 7f2771600640 1 -- 172.21.15.44:0/2508073357 shutdown_connections 2024-04-17T19:49:25.505 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:25.504+0000 7f2771600640 1 -- 172.21.15.44:0/2508073357 wait complete. 2024-04-17T19:49:25.510 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 2 2024-04-17T19:49:25.511 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 2 for mon c 2024-04-17T19:49:25.511 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2024-04-17T19:49:25.664 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:25.676+0000 7f9512c00640 1 Processor -- start 2024-04-17T19:49:25.664 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:25.676+0000 7f9512c00640 1 -- start start 2024-04-17T19:49:25.666 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:25.676+0000 7f9512c00640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f950c073f10 0x7f950c1588d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:49:25.666 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:25.676+0000 7f9512c00640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f950c0c7530 0x7f950c0c7940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:49:25.666 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:25.676+0000 7f9512c00640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f950c157e50 con 0x7f950c152310 2024-04-17T19:49:25.666 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:25.676+0000 7f9512c00640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 -- 0x7f950c0c7e80 con 0x7f950c073f10 2024-04-17T19:49:25.666 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:25.676+0000 7f9512c00640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7f950c158e10 con 0x7f950c0c7530 2024-04-17T19:49:25.667 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:25.676+0000 7f950be00640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f950c073f10 0x7f950c1588d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:49:25.667 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:25.676+0000 7f950be00640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f950c073f10 0x7f950c1588d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:54910/0 (socket says 172.21.15.44:54910) 2024-04-17T19:49:25.667 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:25.676+0000 7f950be00640 1 -- 172.21.15.44:0/4221025268 learned_addr learned my addr 172.21.15.44:0/4221025268 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-04-17T19:49:25.667 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:25.676+0000 7f9503e00640 1 --1- 172.21.15.44:0/4221025268 >> v1:172.21.15.44:6789/0 conn(0x7f950c152310 0x7f950c15be50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:36620/0 (socket says 172.21.15.44:36620) 2024-04-17T19:49:25.667 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:25.676+0000 7f9510c00640 1 --2- 172.21.15.44:0/4221025268 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f950c0c7530 0x7f950c0c7940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:49:25.667 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:25.676+0000 7f950be00640 1 -- 172.21.15.44:0/4221025268 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f950c0c7530 msgr2=0x7f950c0c7940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T19:49:25.667 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:25.676+0000 7f950be00640 1 --2- 172.21.15.44:0/4221025268 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f950c0c7530 0x7f950c0c7940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:49:25.667 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:25.676+0000 7f950be00640 1 -- 172.21.15.44:0/4221025268 >> v1:172.21.15.44:6789/0 conn(0x7f950c152310 legacy=0x7f950c15be50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:49:25.667 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:25.676+0000 7f950be00640 1 -- 172.21.15.44:0/4221025268 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f950c0c4310 con 0x7f950c073f10 2024-04-17T19:49:25.667 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:25.676+0000 7f950b400640 1 -- 172.21.15.44:0/4221025268 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2305270928 0 0) 0x7f94f4001120 con 0x7f950c152310 2024-04-17T19:49:25.669 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:25.680+0000 7f950be00640 1 --2- 172.21.15.44:0/4221025268 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f950c073f10 0x7f950c1588d0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f94fc009870 tx=0x7f94fc01c560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d560d204b978afcf server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:49:25.669 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:25.680+0000 7f950b400640 1 -- 172.21.15.44:0/4221025268 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94fc0b0070 con 0x7f950c073f10 2024-04-17T19:49:25.669 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:25.680+0000 7f950b400640 1 -- 172.21.15.44:0/4221025268 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f94fc0ab600 con 0x7f950c073f10 2024-04-17T19:49:25.669 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:25.680+0000 7f950b400640 1 -- 172.21.15.44:0/4221025268 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94fc0ab9d0 con 0x7f950c073f10 2024-04-17T19:49:25.670 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:25.680+0000 7f9512c00640 1 -- 172.21.15.44:0/4221025268 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f950c073f10 msgr2=0x7f950c1588d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:49:25.670 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:25.680+0000 7f9512c00640 1 --2- 172.21.15.44:0/4221025268 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f950c073f10 0x7f950c1588d0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f94fc009870 tx=0x7f94fc01c560 comp rx=0 tx=0).stop 2024-04-17T19:49:25.670 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:25.680+0000 7f9512c00640 1 -- 172.21.15.44:0/4221025268 shutdown_connections 2024-04-17T19:49:25.670 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:25.680+0000 7f9512c00640 1 --2- 172.21.15.44:0/4221025268 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f950c0c7530 0x7f950c0c7940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:49:25.670 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:25.680+0000 7f9512c00640 1 --2- 172.21.15.44:0/4221025268 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f950c073f10 0x7f950c1588d0 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:49:25.670 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:25.680+0000 7f9512c00640 1 -- 172.21.15.44:0/4221025268 >> 172.21.15.44:0/4221025268 conn(0x7f950c06c380 msgr2=0x7f950c070080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:49:25.671 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:25.680+0000 7f9512c00640 1 -- 172.21.15.44:0/4221025268 shutdown_connections 2024-04-17T19:49:25.671 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:25.680+0000 7f9512c00640 1 -- 172.21.15.44:0/4221025268 wait complete. 2024-04-17T19:49:25.672 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:25.684+0000 7f9512c00640 1 Processor -- start 2024-04-17T19:49:25.672 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:25.684+0000 7f9512c00640 1 -- start start 2024-04-17T19:49:25.675 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:25.684+0000 7f9512c00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f950c073f10 0x7f950c161960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:49:25.675 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:25.684+0000 7f9512c00640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f950c0c7530 0x7f950c15b950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:49:25.675 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:25.684+0000 7f9512c00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f950c152310 0x7f950c14d210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:49:25.675 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:25.684+0000 7f9512c00640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f950c0c3ed0 con 0x7f950c073f10 2024-04-17T19:49:25.675 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:25.684+0000 7f9512c00640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f950c1583b0 con 0x7f950c152310 2024-04-17T19:49:25.676 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:25.684+0000 7f9512c00640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7f950c0c4050 con 0x7f950c0c7530 2024-04-17T19:49:25.676 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:25.684+0000 7f950be00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f950c073f10 0x7f950c161960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:49:25.676 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:25.684+0000 7f9510c00640 1 -- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f950c152310 msgr2=0x7f950c14d210 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.62:3300/0 2024-04-17T19:49:25.676 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:25.684+0000 7f950be00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f950c073f10 0x7f950c161960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:54924/0 (socket says 172.21.15.44:54924) 2024-04-17T19:49:25.676 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:25.684+0000 7f950be00640 1 -- 172.21.15.44:0/2810751012 learned_addr learned my addr 172.21.15.44:0/2810751012 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-04-17T19:49:25.676 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:25.684+0000 7f9510c00640 1 --2- 172.21.15.44:0/2810751012 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f950c152310 0x7f950c14d210 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-17T19:49:25.676 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:25.684+0000 7f9503e00640 1 --2- 172.21.15.44:0/2810751012 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f950c0c7530 0x7f950c15b950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:49:25.676 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:25.684+0000 7f950be00640 1 -- 172.21.15.44:0/2810751012 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f950c0c7530 msgr2=0x7f950c15b950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:49:25.676 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:25.684+0000 7f950be00640 1 --2- 172.21.15.44:0/2810751012 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f950c0c7530 0x7f950c15b950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:49:25.676 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:25.684+0000 7f950be00640 1 -- 172.21.15.44:0/2810751012 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f950c152310 msgr2=0x7f950c14d210 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-17T19:49:25.676 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:25.684+0000 7f950be00640 1 --2- 172.21.15.44:0/2810751012 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f950c152310 0x7f950c14d210 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:49:25.676 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:25.684+0000 7f950be00640 1 -- 172.21.15.44:0/2810751012 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f950c0c7940 con 0x7f950c073f10 2024-04-17T19:49:25.676 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:25.684+0000 7f950be00640 1 --2- 172.21.15.44:0/2810751012 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f950c073f10 0x7f950c161960 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f94fc0ae040 tx=0x7f94fc019300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:49:25.676 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:25.688+0000 7f9508c00640 1 -- 172.21.15.44:0/2810751012 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94fc0ba070 con 0x7f950c073f10 2024-04-17T19:49:25.676 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:25.688+0000 7f9508c00640 1 -- 172.21.15.44:0/2810751012 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f94fc0b4640 con 0x7f950c073f10 2024-04-17T19:49:25.677 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:25.688+0000 7f9508c00640 1 -- 172.21.15.44:0/2810751012 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94fc0b0040 con 0x7f950c073f10 2024-04-17T19:49:25.677 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:25.688+0000 7f9512c00640 1 -- 172.21.15.44:0/2810751012 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f950c161ea0 con 0x7f950c073f10 2024-04-17T19:49:25.677 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:25.688+0000 7f9512c00640 1 -- 172.21.15.44:0/2810751012 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f950c1f5310 con 0x7f950c073f10 2024-04-17T19:49:25.678 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:25.688+0000 7f9512c00640 1 --2- 172.21.15.44:0/2810751012 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f950c1f8570 0x7f950c161160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:49:25.678 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:25.688+0000 7f9512c00640 1 -- 172.21.15.44:0/2810751012 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7f950c1f5660 con 0x7f950c1f8570 2024-04-17T19:49:25.678 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:25.688+0000 7f9503e00640 1 --2- 172.21.15.44:0/2810751012 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f950c1f8570 0x7f950c161160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:49:25.678 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:25.688+0000 7f9503e00640 1 -- 172.21.15.44:0/2810751012 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f950c04ff10 con 0x7f950c1f8570 2024-04-17T19:49:25.678 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:25.688+0000 7f9508c00640 1 -- 172.21.15.44:0/2810751012 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f94fc0bd070 con 0x7f950c073f10 2024-04-17T19:49:25.678 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:25.688+0000 7f9503e00640 1 --2- 172.21.15.44:0/2810751012 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f950c1f8570 0x7f950c161160 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f94f4000f70 tx=0x7f94f4001820 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:49:25.678 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:25.688+0000 7f9508c00640 1 --2- 172.21.15.44:0/2810751012 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f94e8068360 0x7f94e806a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:49:25.678 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:25.688+0000 7f9508c00640 1 -- 172.21.15.44:0/2810751012 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6619+0+0 (secure 0 0 0) 0x7f94fc11fe20 con 0x7f950c073f10 2024-04-17T19:49:25.678 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:25.688+0000 7f9508c00640 1 -- 172.21.15.44:0/2810751012 <== mon.2 v2:172.21.15.62:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94f4019070 con 0x7f950c1f8570 2024-04-17T19:49:25.679 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:25.688+0000 7f9508c00640 1 -- 172.21.15.44:0/2810751012 <== mon.2 v2:172.21.15.62:3301/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f94f4010510 con 0x7f950c1f8570 2024-04-17T19:49:25.679 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:25.688+0000 7f9510c00640 1 --2- 172.21.15.44:0/2810751012 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f94e8068360 0x7f94e806a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:49:25.679 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:25.688+0000 7f9508c00640 1 -- 172.21.15.44:0/2810751012 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f950c1f8570 msgr2=0x7f950c161160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:49:25.679 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:25.688+0000 7f9508c00640 1 --2- 172.21.15.44:0/2810751012 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f950c1f8570 0x7f950c161160 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f94f4000f70 tx=0x7f94f4001820 comp rx=0 tx=0).stop 2024-04-17T19:49:25.679 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:25.688+0000 7f9508c00640 1 -- 172.21.15.44:0/2810751012 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f950c1f8570 msgr2=0x7f950c161160 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-04-17T19:49:25.679 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:25.688+0000 7f9508c00640 1 --2- 172.21.15.44:0/2810751012 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f950c1f8570 0x7f950c161160 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:49:25.679 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:25.692+0000 7f9510c00640 1 --2- 172.21.15.44:0/2810751012 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f94e8068360 0x7f94e806a870 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f950c06cc50 tx=0x7f950400b040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:49:25.685 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:25.696+0000 7f9512c00640 1 --2- 172.21.15.44:0/2810751012 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f950c14d750 0x7f950c1f58b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:49:25.685 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:25.696+0000 7f9512c00640 1 -- 172.21.15.44:0/2810751012 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7f950c0c8810 con 0x7f950c14d750 2024-04-17T19:49:25.685 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:25.696+0000 7f9503e00640 1 --2- 172.21.15.44:0/2810751012 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f950c14d750 0x7f950c1f58b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:49:25.685 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:25.696+0000 7f9503e00640 1 -- 172.21.15.44:0/2810751012 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f950c151010 con 0x7f950c14d750 2024-04-17T19:49:25.686 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:25.696+0000 7f9503e00640 1 --2- 172.21.15.44:0/2810751012 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f950c14d750 0x7f950c1f58b0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f94f4016000 tx=0x7f94f4001090 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:49:25.686 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:25.696+0000 7f9508c00640 1 -- 172.21.15.44:0/2810751012 <== mon.2 v2:172.21.15.62:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94f4019070 con 0x7f950c14d750 2024-04-17T19:49:25.687 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:25.696+0000 7f9508c00640 1 -- 172.21.15.44:0/2810751012 <== mon.2 v2:172.21.15.62:3301/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4535 (secure 0 0 0) 0x7f94f401a040 con 0x7f950c14d750 2024-04-17T19:49:25.687 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:25.700+0000 7f9508c00640 1 -- 172.21.15.44:0/2810751012 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f950c14d750 msgr2=0x7f950c1f58b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:49:25.687 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:25.700+0000 7f9508c00640 1 --2- 172.21.15.44:0/2810751012 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f950c14d750 0x7f950c1f58b0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f94f4016000 tx=0x7f94f4001090 comp rx=0 tx=0).stop 2024-04-17T19:49:25.687 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:25.700+0000 7f9508c00640 1 -- 172.21.15.44:0/2810751012 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f950c14d750 msgr2=0x7f950c1f58b0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-04-17T19:49:25.687 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:25.700+0000 7f9508c00640 1 --2- 172.21.15.44:0/2810751012 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f950c14d750 0x7f950c1f58b0 secure :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f94f4016000 tx=0x7f94f4001090 comp rx=0 tx=0).stop 2024-04-17T19:49:25.688 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2024-04-17T19:49:25.688 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "c", 2024-04-17T19:49:25.688 INFO:teuthology.orchestra.run.smithi044.stdout: "rank": 2, 2024-04-17T19:49:25.688 INFO:teuthology.orchestra.run.smithi044.stdout: "state": "peon", 2024-04-17T19:49:25.688 INFO:teuthology.orchestra.run.smithi044.stdout: "election_epoch": 16, 2024-04-17T19:49:25.688 INFO:teuthology.orchestra.run.smithi044.stdout: "uptime": 50143, 2024-04-17T19:49:25.688 INFO:teuthology.orchestra.run.smithi044.stdout: "quorum": [ 2024-04-17T19:49:25.688 INFO:teuthology.orchestra.run.smithi044.stdout: 0, 2024-04-17T19:49:25.689 INFO:teuthology.orchestra.run.smithi044.stdout: 2 2024-04-17T19:49:25.689 INFO:teuthology.orchestra.run.smithi044.stdout: ], 2024-04-17T19:49:25.689 INFO:teuthology.orchestra.run.smithi044.stdout: "quorum_age": 1, 2024-04-17T19:49:25.689 INFO:teuthology.orchestra.run.smithi044.stdout: "features": { 2024-04-17T19:49:25.689 INFO:teuthology.orchestra.run.smithi044.stdout: "required_con": "2450521708007866372", 2024-04-17T19:49:25.689 INFO:teuthology.orchestra.run.smithi044.stdout: "required_mon": [ 2024-04-17T19:49:25.689 INFO:teuthology.orchestra.run.smithi044.stdout: "kraken", 2024-04-17T19:49:25.689 INFO:teuthology.orchestra.run.smithi044.stdout: "luminous", 2024-04-17T19:49:25.689 INFO:teuthology.orchestra.run.smithi044.stdout: "mimic", 2024-04-17T19:49:25.689 INFO:teuthology.orchestra.run.smithi044.stdout: "osdmap-prune", 2024-04-17T19:49:25.689 INFO:teuthology.orchestra.run.smithi044.stdout: "nautilus", 2024-04-17T19:49:25.689 INFO:teuthology.orchestra.run.smithi044.stdout: "octopus", 2024-04-17T19:49:25.689 INFO:teuthology.orchestra.run.smithi044.stdout: "pacific", 2024-04-17T19:49:25.690 INFO:teuthology.orchestra.run.smithi044.stdout: "elector-pinging", 2024-04-17T19:49:25.690 INFO:teuthology.orchestra.run.smithi044.stdout: "quincy", 2024-04-17T19:49:25.690 INFO:teuthology.orchestra.run.smithi044.stdout: "reef", 2024-04-17T19:49:25.690 INFO:teuthology.orchestra.run.smithi044.stdout: "squid" 2024-04-17T19:49:25.690 INFO:teuthology.orchestra.run.smithi044.stdout: ], 2024-04-17T19:49:25.690 INFO:teuthology.orchestra.run.smithi044.stdout: "quorum_con": "4540701547738038271", 2024-04-17T19:49:25.690 INFO:teuthology.orchestra.run.smithi044.stdout: "quorum_mon": [ 2024-04-17T19:49:25.690 INFO:teuthology.orchestra.run.smithi044.stdout: "kraken", 2024-04-17T19:49:25.690 INFO:teuthology.orchestra.run.smithi044.stdout: "luminous", 2024-04-17T19:49:25.690 INFO:teuthology.orchestra.run.smithi044.stdout: "mimic", 2024-04-17T19:49:25.690 INFO:teuthology.orchestra.run.smithi044.stdout: "osdmap-prune", 2024-04-17T19:49:25.690 INFO:teuthology.orchestra.run.smithi044.stdout: "nautilus", 2024-04-17T19:49:25.690 INFO:teuthology.orchestra.run.smithi044.stdout: "octopus", 2024-04-17T19:49:25.690 INFO:teuthology.orchestra.run.smithi044.stdout: "pacific", 2024-04-17T19:49:25.691 INFO:teuthology.orchestra.run.smithi044.stdout: "elector-pinging", 2024-04-17T19:49:25.691 INFO:teuthology.orchestra.run.smithi044.stdout: "quincy", 2024-04-17T19:49:25.691 INFO:teuthology.orchestra.run.smithi044.stdout: "reef", 2024-04-17T19:49:25.691 INFO:teuthology.orchestra.run.smithi044.stdout: "squid" 2024-04-17T19:49:25.691 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T19:49:25.691 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T19:49:25.691 INFO:teuthology.orchestra.run.smithi044.stdout: "outside_quorum": [], 2024-04-17T19:49:25.691 INFO:teuthology.orchestra.run.smithi044.stdout: "extra_probe_peers": [], 2024-04-17T19:49:25.691 INFO:teuthology.orchestra.run.smithi044.stdout: "sync_provider": [], 2024-04-17T19:49:25.691 INFO:teuthology.orchestra.run.smithi044.stdout: "monmap": { 2024-04-17T19:49:25.691 INFO:teuthology.orchestra.run.smithi044.stdout: "epoch": 1, 2024-04-17T19:49:25.691 INFO:teuthology.orchestra.run.smithi044.stdout: "fsid": "703f77ca-79c6-4a66-b576-62c526cb1021", 2024-04-17T19:49:25.691 INFO:teuthology.orchestra.run.smithi044.stdout: "modified": "2024-04-17T19:45:55.379749Z", 2024-04-17T19:49:25.692 INFO:teuthology.orchestra.run.smithi044.stdout: "created": "2024-04-17T19:45:55.379749Z", 2024-04-17T19:49:25.692 INFO:teuthology.orchestra.run.smithi044.stdout: "min_mon_release": 19, 2024-04-17T19:49:25.692 INFO:teuthology.orchestra.run.smithi044.stdout: "min_mon_release_name": "squid", 2024-04-17T19:49:25.692 INFO:teuthology.orchestra.run.smithi044.stdout: "election_strategy": 1, 2024-04-17T19:49:25.692 INFO:teuthology.orchestra.run.smithi044.stdout: "disallowed_leaders: ": "", 2024-04-17T19:49:25.692 INFO:teuthology.orchestra.run.smithi044.stdout: "stretch_mode": false, 2024-04-17T19:49:25.692 INFO:teuthology.orchestra.run.smithi044.stdout: "tiebreaker_mon": "", 2024-04-17T19:49:25.692 INFO:teuthology.orchestra.run.smithi044.stdout: "removed_ranks: ": "", 2024-04-17T19:49:25.692 INFO:teuthology.orchestra.run.smithi044.stdout: "features": { 2024-04-17T19:49:25.692 INFO:teuthology.orchestra.run.smithi044.stdout: "persistent": [ 2024-04-17T19:49:25.692 INFO:teuthology.orchestra.run.smithi044.stdout: "kraken", 2024-04-17T19:49:25.692 INFO:teuthology.orchestra.run.smithi044.stdout: "luminous", 2024-04-17T19:49:25.692 INFO:teuthology.orchestra.run.smithi044.stdout: "mimic", 2024-04-17T19:49:25.692 INFO:teuthology.orchestra.run.smithi044.stdout: "osdmap-prune", 2024-04-17T19:49:25.693 INFO:teuthology.orchestra.run.smithi044.stdout: "nautilus", 2024-04-17T19:49:25.693 INFO:teuthology.orchestra.run.smithi044.stdout: "octopus", 2024-04-17T19:49:25.693 INFO:teuthology.orchestra.run.smithi044.stdout: "pacific", 2024-04-17T19:49:25.693 INFO:teuthology.orchestra.run.smithi044.stdout: "elector-pinging", 2024-04-17T19:49:25.693 INFO:teuthology.orchestra.run.smithi044.stdout: "quincy", 2024-04-17T19:49:25.693 INFO:teuthology.orchestra.run.smithi044.stdout: "reef", 2024-04-17T19:49:25.693 INFO:teuthology.orchestra.run.smithi044.stdout: "squid" 2024-04-17T19:49:25.693 INFO:teuthology.orchestra.run.smithi044.stdout: ], 2024-04-17T19:49:25.693 INFO:teuthology.orchestra.run.smithi044.stdout: "optional": [] 2024-04-17T19:49:25.693 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T19:49:25.693 INFO:teuthology.orchestra.run.smithi044.stdout: "mons": [ 2024-04-17T19:49:25.693 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T19:49:25.693 INFO:teuthology.orchestra.run.smithi044.stdout: "rank": 0, 2024-04-17T19:49:25.693 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "a", 2024-04-17T19:49:25.694 INFO:teuthology.orchestra.run.smithi044.stdout: "public_addrs": { 2024-04-17T19:49:25.694 INFO:teuthology.orchestra.run.smithi044.stdout: "addrvec": [ 2024-04-17T19:49:25.694 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T19:49:25.694 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "v2", 2024-04-17T19:49:25.694 INFO:teuthology.orchestra.run.smithi044.stdout: "addr": "172.21.15.44:3300", 2024-04-17T19:49:25.694 INFO:teuthology.orchestra.run.smithi044.stdout: "nonce": 0 2024-04-17T19:49:25.694 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T19:49:25.694 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T19:49:25.694 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "v1", 2024-04-17T19:49:25.694 INFO:teuthology.orchestra.run.smithi044.stdout: "addr": "172.21.15.44:6789", 2024-04-17T19:49:25.694 INFO:teuthology.orchestra.run.smithi044.stdout: "nonce": 0 2024-04-17T19:49:25.694 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T19:49:25.694 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T19:49:25.694 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T19:49:25.695 INFO:teuthology.orchestra.run.smithi044.stdout: "addr": "172.21.15.44:6789/0", 2024-04-17T19:49:25.695 INFO:teuthology.orchestra.run.smithi044.stdout: "public_addr": "172.21.15.44:6789/0", 2024-04-17T19:49:25.695 INFO:teuthology.orchestra.run.smithi044.stdout: "priority": 0, 2024-04-17T19:49:25.695 INFO:teuthology.orchestra.run.smithi044.stdout: "weight": 0, 2024-04-17T19:49:25.695 INFO:teuthology.orchestra.run.smithi044.stdout: "crush_location": "{}" 2024-04-17T19:49:25.695 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T19:49:25.695 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T19:49:25.695 INFO:teuthology.orchestra.run.smithi044.stdout: "rank": 1, 2024-04-17T19:49:25.695 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "b", 2024-04-17T19:49:25.695 INFO:teuthology.orchestra.run.smithi044.stdout: "public_addrs": { 2024-04-17T19:49:25.695 INFO:teuthology.orchestra.run.smithi044.stdout: "addrvec": [ 2024-04-17T19:49:25.695 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T19:49:25.695 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "v2", 2024-04-17T19:49:25.695 INFO:teuthology.orchestra.run.smithi044.stdout: "addr": "172.21.15.62:3300", 2024-04-17T19:49:25.696 INFO:teuthology.orchestra.run.smithi044.stdout: "nonce": 0 2024-04-17T19:49:25.696 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T19:49:25.696 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T19:49:25.696 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "v1", 2024-04-17T19:49:25.696 INFO:teuthology.orchestra.run.smithi044.stdout: "addr": "172.21.15.62:6789", 2024-04-17T19:49:25.696 INFO:teuthology.orchestra.run.smithi044.stdout: "nonce": 0 2024-04-17T19:49:25.696 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T19:49:25.696 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T19:49:25.696 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T19:49:25.696 INFO:teuthology.orchestra.run.smithi044.stdout: "addr": "172.21.15.62:6789/0", 2024-04-17T19:49:25.696 INFO:teuthology.orchestra.run.smithi044.stdout: "public_addr": "172.21.15.62:6789/0", 2024-04-17T19:49:25.696 INFO:teuthology.orchestra.run.smithi044.stdout: "priority": 0, 2024-04-17T19:49:25.696 INFO:teuthology.orchestra.run.smithi044.stdout: "weight": 0, 2024-04-17T19:49:25.696 INFO:teuthology.orchestra.run.smithi044.stdout: "crush_location": "{}" 2024-04-17T19:49:25.696 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T19:49:25.697 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T19:49:25.697 INFO:teuthology.orchestra.run.smithi044.stdout: "rank": 2, 2024-04-17T19:49:25.697 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "c", 2024-04-17T19:49:25.697 INFO:teuthology.orchestra.run.smithi044.stdout: "public_addrs": { 2024-04-17T19:49:25.697 INFO:teuthology.orchestra.run.smithi044.stdout: "addrvec": [ 2024-04-17T19:49:25.697 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T19:49:25.697 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "v2", 2024-04-17T19:49:25.697 INFO:teuthology.orchestra.run.smithi044.stdout: "addr": "172.21.15.62:3301", 2024-04-17T19:49:25.697 INFO:teuthology.orchestra.run.smithi044.stdout: "nonce": 0 2024-04-17T19:49:25.697 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T19:49:25.697 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T19:49:25.697 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "v1", 2024-04-17T19:49:25.697 INFO:teuthology.orchestra.run.smithi044.stdout: "addr": "172.21.15.62:6790", 2024-04-17T19:49:25.697 INFO:teuthology.orchestra.run.smithi044.stdout: "nonce": 0 2024-04-17T19:49:25.698 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T19:49:25.698 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T19:49:25.698 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T19:49:25.698 INFO:teuthology.orchestra.run.smithi044.stdout: "addr": "172.21.15.62:6790/0", 2024-04-17T19:49:25.698 INFO:teuthology.orchestra.run.smithi044.stdout: "public_addr": "172.21.15.62:6790/0", 2024-04-17T19:49:25.698 INFO:teuthology.orchestra.run.smithi044.stdout: "priority": 0, 2024-04-17T19:49:25.698 INFO:teuthology.orchestra.run.smithi044.stdout: "weight": 0, 2024-04-17T19:49:25.698 INFO:teuthology.orchestra.run.smithi044.stdout: "crush_location": "{}" 2024-04-17T19:49:25.698 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T19:49:25.698 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T19:49:25.698 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T19:49:25.698 INFO:teuthology.orchestra.run.smithi044.stdout: "feature_map": { 2024-04-17T19:49:25.698 INFO:teuthology.orchestra.run.smithi044.stdout: "mon": [ 2024-04-17T19:49:25.698 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T19:49:25.699 INFO:teuthology.orchestra.run.smithi044.stdout: "features": "0x3f03cffffffdffff", 2024-04-17T19:49:25.699 INFO:teuthology.orchestra.run.smithi044.stdout: "release": "luminous", 2024-04-17T19:49:25.699 INFO:teuthology.orchestra.run.smithi044.stdout: "num": 1 2024-04-17T19:49:25.699 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T19:49:25.699 INFO:teuthology.orchestra.run.smithi044.stdout: ], 2024-04-17T19:49:25.699 INFO:teuthology.orchestra.run.smithi044.stdout: "client": [ 2024-04-17T19:49:25.699 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T19:49:25.699 INFO:teuthology.orchestra.run.smithi044.stdout: "features": "0x3f03cffffffdffff", 2024-04-17T19:49:25.699 INFO:teuthology.orchestra.run.smithi044.stdout: "release": "luminous", 2024-04-17T19:49:25.699 INFO:teuthology.orchestra.run.smithi044.stdout: "num": 1 2024-04-17T19:49:25.699 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T19:49:25.699 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T19:49:25.699 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T19:49:25.699 INFO:teuthology.orchestra.run.smithi044.stdout: "stretch_mode": false 2024-04-17T19:49:25.699 INFO:teuthology.orchestra.run.smithi044.stdout:} 2024-04-17T19:49:25.700 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:25.700+0000 7f9512c00640 1 -- 172.21.15.44:0/2810751012 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f94e8068360 msgr2=0x7f94e806a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:49:25.700 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:25.700+0000 7f9512c00640 1 --2- 172.21.15.44:0/2810751012 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f94e8068360 0x7f94e806a870 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f950c06cc50 tx=0x7f950400b040 comp rx=0 tx=0).stop 2024-04-17T19:49:25.700 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:25.700+0000 7f9512c00640 1 -- 172.21.15.44:0/2810751012 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f950c073f10 msgr2=0x7f950c161960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:49:25.700 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:25.700+0000 7f9512c00640 1 --2- 172.21.15.44:0/2810751012 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f950c073f10 0x7f950c161960 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f94fc0ae040 tx=0x7f94fc019300 comp rx=0 tx=0).stop 2024-04-17T19:49:25.701 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:25.700+0000 7f9510c00640 1 -- 172.21.15.44:0/2810751012 reap_dead start 2024-04-17T19:49:25.701 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:25.700+0000 7f9510c00640 1 -- 172.21.15.44:0/2810751012 reap_dead start 2024-04-17T19:49:25.701 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:25.700+0000 7f9512c00640 1 -- 172.21.15.44:0/2810751012 shutdown_connections 2024-04-17T19:49:25.701 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:25.700+0000 7f9512c00640 1 -- 172.21.15.44:0/2810751012 >> 172.21.15.44:0/2810751012 conn(0x7f950c06c380 msgr2=0x7f950c0c8000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:49:25.701 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:25.700+0000 7f9512c00640 1 -- 172.21.15.44:0/2810751012 shutdown_connections 2024-04-17T19:49:25.701 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:49:25.700+0000 7f9512c00640 1 -- 172.21.15.44:0/2810751012 wait complete. 2024-04-17T19:49:25.706 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 2 2024-04-17T19:49:25.706 INFO:tasks.mon_thrash.mon_thrasher:waiting for 20.0 secs before reviving monitors 2024-04-17T19:49:26.746 INFO:tasks.workunit:Stopping ['fs/misc/trivial_sync.sh'] on client.0... 2024-04-17T19:49:26.746 DEBUG:teuthology.orchestra.run.smithi044:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-04-17T19:49:27.698 DEBUG:teuthology.parallel:result is None 2024-04-17T19:49:27.698 DEBUG:teuthology.orchestra.run.smithi044:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-04-17T19:49:27.736 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-04-17T19:49:27.737 DEBUG:teuthology.run_tasks:Unwinding manager mon_thrash 2024-04-17T19:49:27.752 INFO:tasks.mon_thrash:joining mon_thrasher 2024-04-17T19:49:45.707 INFO:tasks.mon_thrash.mon_thrasher:killing mon.b 2024-04-17T19:49:45.707 INFO:tasks.mon_thrash.mon_thrasher:reviving mon.b 2024-04-17T19:49:45.707 INFO:tasks.ceph.mon.b:Restarting daemon 2024-04-17T19:49:45.708 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2024-04-17T19:49:45.711 INFO:tasks.ceph.mon.b:Started 2024-04-17T19:49:45.711 INFO:tasks.mon_thrash:Sending STOP to mon c 2024-04-17T19:49:45.711 INFO:tasks.ceph.mon.c:Sent signal 19 2024-04-17T19:49:45.711 INFO:tasks.mon_thrash.mon_thrasher:waiting for 15.0 secs to unfreeze mons 2024-04-17T19:49:54.082 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T19:49:54.086 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T19:50:00.711 INFO:tasks.mon_thrash:Sending CONT to mon c 2024-04-17T19:50:00.712 INFO:tasks.ceph.mon.c:Sent signal 18 2024-04-17T19:50:00.712 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2024-04-17T19:50:00.712 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-04-17T19:50:00.873 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:00.883+0000 7f54e4200640 1 Processor -- start 2024-04-17T19:50:00.873 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:00.883+0000 7f54e4200640 1 -- start start 2024-04-17T19:50:00.875 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:00.883+0000 7f54e4200640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f54dc0c5b50 0x7f54dc15fb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:50:00.875 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:00.883+0000 7f54e4200640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f54dc155be0 0x7f54dc166310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:50:00.875 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:00.883+0000 7f54e4200640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f54dc0ca450 con 0x7f54dc15b990 2024-04-17T19:50:00.875 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:00.883+0000 7f54e4200640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 -- 0x7f54dc0ca200 con 0x7f54dc155be0 2024-04-17T19:50:00.875 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:00.883+0000 7f54e4200640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 -- 0x7f54dc15f020 con 0x7f54dc0c5b50 2024-04-17T19:50:00.876 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:00.883+0000 7f54e2200640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f54dc155be0 0x7f54dc166310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:50:00.876 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:00.883+0000 7f54e2200640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f54dc155be0 0x7f54dc166310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:45780/0 (socket says 172.21.15.44:45780) 2024-04-17T19:50:00.876 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:00.883+0000 7f54e2200640 1 -- 172.21.15.44:0/1867944293 learned_addr learned my addr 172.21.15.44:0/1867944293 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-04-17T19:50:00.876 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:00.883+0000 7f54e1800640 1 --2- 172.21.15.44:0/1867944293 >> v2:172.21.15.62:3300/0 conn(0x7f54dc0c5b50 0x7f54dc15fb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:50:00.876 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:00.883+0000 7f54e2200640 1 -- 172.21.15.44:0/1867944293 >> v2:172.21.15.62:3300/0 conn(0x7f54dc0c5b50 msgr2=0x7f54dc15fb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T19:50:00.876 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:00.883+0000 7f54e2200640 1 --2- 172.21.15.44:0/1867944293 >> v2:172.21.15.62:3300/0 conn(0x7f54dc0c5b50 0x7f54dc15fb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:50:00.876 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:00.883+0000 7f54e2200640 1 -- 172.21.15.44:0/1867944293 >> v1:172.21.15.62:6789/0 conn(0x7f54dc15b990 legacy=0x7f54dc0725e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:50:00.876 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:00.883+0000 7f54e2200640 1 -- 172.21.15.44:0/1867944293 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f54dc15f300 con 0x7f54dc155be0 2024-04-17T19:50:00.878 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:00.887+0000 7f54e2200640 1 --2- 172.21.15.44:0/1867944293 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f54dc155be0 0x7f54dc166310 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f54dc0cc7a0 tx=0x7f54d401c400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9b98f31d3ea0ca2d server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:50:00.878 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:00.887+0000 7f54dbe00640 1 -- 172.21.15.44:0/1867944293 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54d40b1070 con 0x7f54dc155be0 2024-04-17T19:50:00.879 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:00.887+0000 7f54dbe00640 1 -- 172.21.15.44:0/1867944293 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f54d40a8050 con 0x7f54dc155be0 2024-04-17T19:50:00.879 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:00.887+0000 7f54dbe00640 1 -- 172.21.15.44:0/1867944293 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54d40ac860 con 0x7f54dc155be0 2024-04-17T19:50:00.879 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:00.887+0000 7f54e4200640 1 -- 172.21.15.44:0/1867944293 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f54dc155be0 msgr2=0x7f54dc166310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:50:00.879 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:00.887+0000 7f54e4200640 1 --2- 172.21.15.44:0/1867944293 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f54dc155be0 0x7f54dc166310 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f54dc0cc7a0 tx=0x7f54d401c400 comp rx=0 tx=0).stop 2024-04-17T19:50:00.880 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:00.887+0000 7f54e4200640 1 -- 172.21.15.44:0/1867944293 shutdown_connections 2024-04-17T19:50:00.880 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:00.887+0000 7f54e4200640 1 --2- 172.21.15.44:0/1867944293 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f54dc155be0 0x7f54dc166310 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:50:00.880 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:00.887+0000 7f54e4200640 1 --2- 172.21.15.44:0/1867944293 >> v2:172.21.15.62:3300/0 conn(0x7f54dc0c5b50 0x7f54dc15fb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:50:00.880 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:00.887+0000 7f54e4200640 1 -- 172.21.15.44:0/1867944293 >> 172.21.15.44:0/1867944293 conn(0x7f54dc067eb0 msgr2=0x7f54dc0682c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:50:00.880 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:00.887+0000 7f54e4200640 1 -- 172.21.15.44:0/1867944293 shutdown_connections 2024-04-17T19:50:00.880 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:00.887+0000 7f54e4200640 1 -- 172.21.15.44:0/1867944293 wait complete. 2024-04-17T19:50:00.881 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:00.891+0000 7f54e4200640 1 Processor -- start 2024-04-17T19:50:00.881 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:00.891+0000 7f54e4200640 1 -- start start 2024-04-17T19:50:00.884 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:00.891+0000 7f54e4200640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f54dc0c5b50 0x7f54dc1f9380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:50:00.884 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:00.891+0000 7f54e4200640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f54dc155be0 0x7f54dc1f5e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:50:00.884 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:00.891+0000 7f54e4200640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f54dc15b990 0x7f54dc15e5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:50:00.884 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:00.891+0000 7f54e4200640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f54dc0caa70 con 0x7f54dc15b990 2024-04-17T19:50:00.884 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:00.891+0000 7f54e4200640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f54dc0ca730 con 0x7f54dc0c5b50 2024-04-17T19:50:00.884 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:00.891+0000 7f54e4200640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7f54dc0c8370 con 0x7f54dc155be0 2024-04-17T19:50:00.885 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:00.891+0000 7f54e2200640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f54dc15b990 0x7f54dc15e5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:50:00.885 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:00.891+0000 7f54e2200640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f54dc15b990 0x7f54dc15e5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:45794/0 (socket says 172.21.15.44:45794) 2024-04-17T19:50:00.885 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:00.891+0000 7f54e2200640 1 -- 172.21.15.44:0/1666799583 learned_addr learned my addr 172.21.15.44:0/1666799583 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-04-17T19:50:00.885 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:00.891+0000 7f54e1800640 1 --2- 172.21.15.44:0/1666799583 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f54dc0c5b50 0x7f54dc1f9380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:50:00.885 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:00.891+0000 7f54e0e00640 1 --2- 172.21.15.44:0/1666799583 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f54dc155be0 0x7f54dc1f5e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:50:00.885 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:00.891+0000 7f54e2200640 1 -- 172.21.15.44:0/1666799583 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f54dc155be0 msgr2=0x7f54dc1f5e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:50:00.885 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:00.891+0000 7f54e2200640 1 --2- 172.21.15.44:0/1666799583 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f54dc155be0 0x7f54dc1f5e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:50:00.885 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:00.891+0000 7f54e2200640 1 -- 172.21.15.44:0/1666799583 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f54dc0c5b50 msgr2=0x7f54dc1f9380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:50:00.885 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:00.891+0000 7f54e2200640 1 --2- 172.21.15.44:0/1666799583 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f54dc0c5b50 0x7f54dc1f9380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:50:00.885 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:00.891+0000 7f54e2200640 1 -- 172.21.15.44:0/1666799583 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f54dc1f98c0 con 0x7f54dc15b990 2024-04-17T19:50:00.885 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:00.895+0000 7f54e2200640 1 --2- 172.21.15.44:0/1666799583 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f54dc15b990 0x7f54dc15e5b0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f54d401a030 tx=0x7f54d401ac40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:50:00.885 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:00.895+0000 7f54d9600640 1 -- 172.21.15.44:0/1666799583 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54d40b1040 con 0x7f54dc15b990 2024-04-17T19:50:00.885 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:00.895+0000 7f54d9600640 1 -- 172.21.15.44:0/1666799583 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f54d40bc070 con 0x7f54dc15b990 2024-04-17T19:50:00.885 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:00.895+0000 7f54e4200640 1 -- 172.21.15.44:0/1666799583 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f54dc1f6380 con 0x7f54dc15b990 2024-04-17T19:50:00.885 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:00.895+0000 7f54d9600640 1 -- 172.21.15.44:0/1666799583 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54d40b7450 con 0x7f54dc15b990 2024-04-17T19:50:00.886 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:00.895+0000 7f54e4200640 1 -- 172.21.15.44:0/1666799583 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f54dc0cd1a0 con 0x7f54dc15b990 2024-04-17T19:50:00.886 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:00.895+0000 7f54e4200640 1 -- 172.21.15.44:0/1666799583 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f54dc04ff10 con 0x7f54dc15b990 2024-04-17T19:50:00.886 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:00.895+0000 7f54d9600640 1 -- 172.21.15.44:0/1666799583 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f54d40b7610 con 0x7f54dc15b990 2024-04-17T19:50:00.887 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:00.895+0000 7f54d9600640 1 --2- 172.21.15.44:0/1666799583 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f54bc068380 0x7f54bc06a890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:50:00.887 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:00.895+0000 7f54d9600640 1 -- 172.21.15.44:0/1666799583 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6619+0+0 (secure 0 0 0) 0x7f54d4120e20 con 0x7f54dc15b990 2024-04-17T19:50:00.887 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:00.895+0000 7f54e1800640 1 --2- 172.21.15.44:0/1666799583 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f54bc068380 0x7f54bc06a890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:50:00.888 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:00.899+0000 7f54e1800640 1 --2- 172.21.15.44:0/1666799583 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f54bc068380 0x7f54bc06a890 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f54dc0cb250 tx=0x7f54d000b040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:50:00.892 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:00.903+0000 7f54d9600640 1 -- 172.21.15.44:0/1666799583 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f54d4016110 con 0x7f54dc15b990 2024-04-17T19:50:01.120 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:01.131+0000 7f54e4200640 1 -- 172.21.15.44:0/1666799583 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f54dc0692b0 con 0x7f54dc15b990 2024-04-17T19:50:01.121 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:01.131+0000 7f54d9600640 1 -- 172.21.15.44:0/1666799583 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1556 (secure 0 0 0) 0x7f54d40f10d0 con 0x7f54dc15b990 2024-04-17T19:50:01.121 INFO:teuthology.orchestra.run.smithi044.stdout:{"election_epoch":20,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":0,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"703f77ca-79c6-4a66-b576-62c526cb1021","modified":"2024-04-17T19:45:55.379749Z","created":"2024-04-17T19:45:55.379749Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:3300","nonce":0},{"type":"v1","addr":"172.21.15.44:6789","nonce":0}]},"addr":"172.21.15.44:6789/0","public_addr":"172.21.15.44:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:3300","nonce":0},{"type":"v1","addr":"172.21.15.62:6789","nonce":0}]},"addr":"172.21.15.62:6789/0","public_addr":"172.21.15.62:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:3301","nonce":0},{"type":"v1","addr":"172.21.15.62:6790","nonce":0}]},"addr":"172.21.15.62:6790/0","public_addr":"172.21.15.62:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-04-17T19:50:01.123 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:01.131+0000 7f54e4200640 1 -- 172.21.15.44:0/1666799583 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f54bc068380 msgr2=0x7f54bc06a890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:50:01.123 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:01.131+0000 7f54e4200640 1 --2- 172.21.15.44:0/1666799583 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f54bc068380 0x7f54bc06a890 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f54dc0cb250 tx=0x7f54d000b040 comp rx=0 tx=0).stop 2024-04-17T19:50:01.123 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:01.131+0000 7f54e4200640 1 -- 172.21.15.44:0/1666799583 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f54dc15b990 msgr2=0x7f54dc15e5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:50:01.123 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:01.131+0000 7f54e4200640 1 --2- 172.21.15.44:0/1666799583 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f54dc15b990 0x7f54dc15e5b0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f54d401a030 tx=0x7f54d401ac40 comp rx=0 tx=0).stop 2024-04-17T19:50:01.123 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:01.131+0000 7f54e4200640 1 -- 172.21.15.44:0/1666799583 shutdown_connections 2024-04-17T19:50:01.123 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:01.131+0000 7f54e4200640 1 --2- 172.21.15.44:0/1666799583 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f54bc068380 0x7f54bc06a890 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:50:01.123 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:01.131+0000 7f54e4200640 1 --2- 172.21.15.44:0/1666799583 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f54dc155be0 0x7f54dc1f5e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:50:01.123 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:01.131+0000 7f54e4200640 1 --2- 172.21.15.44:0/1666799583 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f54dc15b990 0x7f54dc15e5b0 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:50:01.123 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:01.131+0000 7f54e4200640 1 --2- 172.21.15.44:0/1666799583 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f54dc0c5b50 0x7f54dc1f9380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:50:01.123 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:01.131+0000 7f54e4200640 1 -- 172.21.15.44:0/1666799583 >> 172.21.15.44:0/1666799583 conn(0x7f54dc067eb0 msgr2=0x7f54dc159740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:50:01.124 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:01.131+0000 7f54e4200640 1 -- 172.21.15.44:0/1666799583 shutdown_connections 2024-04-17T19:50:01.124 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:01.131+0000 7f54e4200640 1 -- 172.21.15.44:0/1666799583 wait complete. 2024-04-17T19:50:01.141 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2024-04-17T19:50:01.141 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon a 2024-04-17T19:50:01.141 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2024-04-17T19:50:01.294 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:01.303+0000 7fbcdc000640 1 Processor -- start 2024-04-17T19:50:01.294 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:01.303+0000 7fbcdc000640 1 -- start start 2024-04-17T19:50:01.296 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:01.303+0000 7fbcdc000640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fbcd4072700 0x7fbcd4153a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:50:01.296 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:01.303+0000 7fbcdc000640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbcd4072d60 con 0x7fbcd40c60e0 2024-04-17T19:50:01.296 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:01.303+0000 7fbcdc000640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbcd4073810 con 0x7fbcd415a4f0 2024-04-17T19:50:01.296 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:01.303+0000 7fbcdc000640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 -- 0x7fbcd4072b10 con 0x7fbcd4072700 2024-04-17T19:50:01.296 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:01.307+0000 7fbcd9600640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fbcd4072700 0x7fbcd4153a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:50:01.296 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:01.307+0000 7fbcd8c00640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7fbcd40c60e0 0x7fbcd4159de0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:45198/0 (socket says 172.21.15.44:45198) 2024-04-17T19:50:01.296 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:01.307+0000 7fbcd8c00640 1 -- 172.21.15.44:0/691197850 learned_addr learned my addr 172.21.15.44:0/691197850 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-04-17T19:50:01.297 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:01.307+0000 7fbcd3e00640 1 -- 172.21.15.44:0/691197850 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3872026453 0 0) 0x7fbcd4072d60 con 0x7fbcd40c60e0 2024-04-17T19:50:01.297 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:01.307+0000 7fbcd3e00640 1 -- 172.21.15.44:0/691197850 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbcbc003530 con 0x7fbcd40c60e0 2024-04-17T19:50:01.297 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:01.307+0000 7fbcd9600640 1 -- 172.21.15.44:0/691197850 >> v1:172.21.15.62:6789/0 conn(0x7fbcd415a4f0 legacy=0x7fbcd4164130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:50:01.297 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:01.307+0000 7fbcd9600640 1 -- 172.21.15.44:0/691197850 >> v1:172.21.15.44:6789/0 conn(0x7fbcd40c60e0 legacy=0x7fbcd4159de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:50:01.297 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:01.307+0000 7fbcd9600640 1 -- 172.21.15.44:0/691197850 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbcd4073af0 con 0x7fbcd4072700 2024-04-17T19:50:01.299 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:01.307+0000 7fbcd9600640 1 --2- 172.21.15.44:0/691197850 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbcd4072700 0x7fbcd4153a00 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7fbcc80097c0 tx=0x7fbcc801ec90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f75d5558c3ab0699 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:50:01.299 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:01.307+0000 7fbcd3e00640 1 -- 172.21.15.44:0/691197850 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbcc80b5070 con 0x7fbcd4072700 2024-04-17T19:50:01.299 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:01.307+0000 7fbcd3e00640 1 -- 172.21.15.44:0/691197850 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbcc80a8990 con 0x7fbcd4072700 2024-04-17T19:50:01.300 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:01.307+0000 7fbcd3e00640 1 -- 172.21.15.44:0/691197850 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbcc80a8d40 con 0x7fbcd4072700 2024-04-17T19:50:01.300 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:01.311+0000 7fbcdc000640 1 -- 172.21.15.44:0/691197850 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbcd4072700 msgr2=0x7fbcd4153a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:50:01.301 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:01.311+0000 7fbcdc000640 1 --2- 172.21.15.44:0/691197850 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbcd4072700 0x7fbcd4153a00 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7fbcc80097c0 tx=0x7fbcc801ec90 comp rx=0 tx=0).stop 2024-04-17T19:50:01.301 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:01.311+0000 7fbcdc000640 1 -- 172.21.15.44:0/691197850 shutdown_connections 2024-04-17T19:50:01.301 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:01.311+0000 7fbcdc000640 1 --2- 172.21.15.44:0/691197850 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbcd4072700 0x7fbcd4153a00 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:50:01.301 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:01.311+0000 7fbcdc000640 1 -- 172.21.15.44:0/691197850 >> 172.21.15.44:0/691197850 conn(0x7fbcd406c380 msgr2=0x7fbcd4070080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:50:01.301 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:01.311+0000 7fbcdc000640 1 -- 172.21.15.44:0/691197850 shutdown_connections 2024-04-17T19:50:01.301 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:01.311+0000 7fbcdc000640 1 -- 172.21.15.44:0/691197850 wait complete. 2024-04-17T19:50:01.302 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:01.311+0000 7fbcdc000640 1 Processor -- start 2024-04-17T19:50:01.303 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:01.311+0000 7fbcdc000640 1 -- start start 2024-04-17T19:50:01.305 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:01.315+0000 7fbcdc000640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbcd4072700 0x7fbcd415b7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:50:01.305 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:01.315+0000 7fbcdc000640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fbcd40c60e0 0x7fbcd41e5600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:50:01.306 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:01.315+0000 7fbcdc000640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbcd40c5c10 0x7fbcd40cbba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:50:01.306 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:01.315+0000 7fbcdc000640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fbcd4074390 con 0x7fbcd40c5c10 2024-04-17T19:50:01.306 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:01.315+0000 7fbcdc000640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7fbcd40740b0 con 0x7fbcd4072700 2024-04-17T19:50:01.306 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:01.315+0000 7fbcdc000640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7fbcd41598c0 con 0x7fbcd40c60e0 2024-04-17T19:50:01.306 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:01.315+0000 7fbcda000640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbcd40c5c10 0x7fbcd40cbba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:50:01.306 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:01.315+0000 7fbcda000640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbcd40c5c10 0x7fbcd40cbba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:45814/0 (socket says 172.21.15.44:45814) 2024-04-17T19:50:01.306 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:01.315+0000 7fbcda000640 1 -- 172.21.15.44:0/798300510 learned_addr learned my addr 172.21.15.44:0/798300510 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-04-17T19:50:01.306 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:01.315+0000 7fbcd9600640 1 --2- 172.21.15.44:0/798300510 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbcd4072700 0x7fbcd415b7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:50:01.306 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:01.315+0000 7fbcd8c00640 1 --2- 172.21.15.44:0/798300510 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fbcd40c60e0 0x7fbcd41e5600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:50:01.306 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:01.315+0000 7fbcda000640 1 -- 172.21.15.44:0/798300510 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fbcd40c60e0 msgr2=0x7fbcd41e5600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:50:01.306 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:01.315+0000 7fbcda000640 1 --2- 172.21.15.44:0/798300510 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fbcd40c60e0 0x7fbcd41e5600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:50:01.306 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:01.315+0000 7fbcda000640 1 -- 172.21.15.44:0/798300510 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbcd4072700 msgr2=0x7fbcd415b7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:50:01.307 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:01.315+0000 7fbcda000640 1 --2- 172.21.15.44:0/798300510 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbcd4072700 0x7fbcd415b7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:50:01.307 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:01.315+0000 7fbcda000640 1 -- 172.21.15.44:0/798300510 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbcd41e3950 con 0x7fbcd40c5c10 2024-04-17T19:50:01.307 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:01.315+0000 7fbcda000640 1 --2- 172.21.15.44:0/798300510 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbcd40c5c10 0x7fbcd40cbba0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7fbccc00c730 tx=0x7fbccc00cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:50:01.307 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:01.315+0000 7fbcd1600640 1 -- 172.21.15.44:0/798300510 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbccc003b80 con 0x7fbcd40c5c10 2024-04-17T19:50:01.307 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:01.315+0000 7fbcd1600640 1 -- 172.21.15.44:0/798300510 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbccc003d20 con 0x7fbcd40c5c10 2024-04-17T19:50:01.307 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:01.315+0000 7fbcdc000640 1 -- 172.21.15.44:0/798300510 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbcd41e3c30 con 0x7fbcd40c5c10 2024-04-17T19:50:01.307 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:01.315+0000 7fbcd1600640 1 -- 172.21.15.44:0/798300510 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbccc005310 con 0x7fbcd40c5c10 2024-04-17T19:50:01.307 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:01.315+0000 7fbcdc000640 1 -- 172.21.15.44:0/798300510 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbcd41e50e0 con 0x7fbcd40c5c10 2024-04-17T19:50:01.308 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:01.315+0000 7fbcdc000640 1 --2- 172.21.15.44:0/798300510 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbcd415c240 0x7fbcd40c3ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:50:01.308 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:01.315+0000 7fbcdc000640 1 -- 172.21.15.44:0/798300510 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fbcd41e52b0 con 0x7fbcd415c240 2024-04-17T19:50:01.308 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:01.315+0000 7fbcd9600640 1 --2- 172.21.15.44:0/798300510 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbcd415c240 0x7fbcd40c3ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:50:01.308 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:01.315+0000 7fbcd9600640 1 -- 172.21.15.44:0/798300510 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fbcd415abb0 con 0x7fbcd415c240 2024-04-17T19:50:01.308 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:01.315+0000 7fbcd9600640 1 --2- 172.21.15.44:0/798300510 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbcd415c240 0x7fbcd40c3ed0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7fbcd406cd70 tx=0x7fbcc801ba30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:50:01.308 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:01.319+0000 7fbcd1600640 1 -- 172.21.15.44:0/798300510 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbcc80bf030 con 0x7fbcd415c240 2024-04-17T19:50:01.309 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:01.319+0000 7fbcd1600640 1 -- 172.21.15.44:0/798300510 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fbccc0056c0 con 0x7fbcd40c5c10 2024-04-17T19:50:01.310 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:01.319+0000 7fbcd1600640 1 --2- 172.21.15.44:0/798300510 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7fbcb4068280 0x7fbcb406a790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:50:01.310 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:01.319+0000 7fbcd1600640 1 -- 172.21.15.44:0/798300510 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6619+0+0 (secure 0 0 0) 0x7fbccc086d40 con 0x7fbcd40c5c10 2024-04-17T19:50:01.310 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:01.319+0000 7fbcd1600640 1 -- 172.21.15.44:0/798300510 <== mon.0 v2:172.21.15.44:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7fbcc80a8790 con 0x7fbcd415c240 2024-04-17T19:50:01.310 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:01.319+0000 7fbcd1600640 1 -- 172.21.15.44:0/798300510 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbcd415c240 msgr2=0x7fbcd40c3ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:50:01.310 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:01.319+0000 7fbcd1600640 1 --2- 172.21.15.44:0/798300510 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbcd415c240 0x7fbcd40c3ed0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7fbcd406cd70 tx=0x7fbcc801ba30 comp rx=0 tx=0).stop 2024-04-17T19:50:01.310 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:01.319+0000 7fbcd1600640 1 -- 172.21.15.44:0/798300510 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbcd415c240 msgr2=0x7fbcd40c3ed0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-04-17T19:50:01.310 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:01.319+0000 7fbcd1600640 1 --2- 172.21.15.44:0/798300510 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbcd415c240 0x7fbcd40c3ed0 secure :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7fbcd406cd70 tx=0x7fbcc801ba30 comp rx=0 tx=0).stop 2024-04-17T19:50:01.310 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:01.319+0000 7fbcd8c00640 1 --2- 172.21.15.44:0/798300510 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7fbcb4068280 0x7fbcb406a790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:50:01.310 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:01.319+0000 7fbcd8c00640 1 --2- 172.21.15.44:0/798300510 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7fbcb4068280 0x7fbcb406a790 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fbcc0005890 tx=0x7fbcc0009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:50:01.315 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:01.323+0000 7fbcdc000640 1 --2- 172.21.15.44:0/798300510 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbcd40c4410 0x7fbcd40c4820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:50:01.315 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:01.323+0000 7fbcdc000640 1 -- 172.21.15.44:0/798300510 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fbcd40c4d60 con 0x7fbcd40c4410 2024-04-17T19:50:01.315 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:01.323+0000 7fbcd9600640 1 --2- 172.21.15.44:0/798300510 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbcd40c4410 0x7fbcd40c4820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:50:01.316 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:01.323+0000 7fbcd9600640 1 -- 172.21.15.44:0/798300510 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fbcd41e4ed0 con 0x7fbcd40c4410 2024-04-17T19:50:01.316 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:01.327+0000 7fbcd9600640 1 --2- 172.21.15.44:0/798300510 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbcd40c4410 0x7fbcd40c4820 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7fbcc801c8c0 tx=0x7fbcc80aa000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:50:01.316 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:01.327+0000 7fbcd1600640 1 -- 172.21.15.44:0/798300510 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbcc80b5040 con 0x7fbcd40c4410 2024-04-17T19:50:01.317 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:01.327+0000 7fbcd1600640 1 -- 172.21.15.44:0/798300510 <== mon.0 v2:172.21.15.44:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+5202 (secure 0 0 0) 0x7fbcc8003a30 con 0x7fbcd40c4410 2024-04-17T19:50:01.317 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:01.327+0000 7fbcd1600640 1 -- 172.21.15.44:0/798300510 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbcd40c4410 msgr2=0x7fbcd40c4820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:50:01.317 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:01.327+0000 7fbcd1600640 1 --2- 172.21.15.44:0/798300510 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbcd40c4410 0x7fbcd40c4820 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7fbcc801c8c0 tx=0x7fbcc80aa000 comp rx=0 tx=0).stop 2024-04-17T19:50:01.317 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:01.327+0000 7fbcd1600640 1 -- 172.21.15.44:0/798300510 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbcd40c4410 msgr2=0x7fbcd40c4820 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-04-17T19:50:01.317 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:01.327+0000 7fbcd1600640 1 --2- 172.21.15.44:0/798300510 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbcd40c4410 0x7fbcd40c4820 secure :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7fbcc801c8c0 tx=0x7fbcc80aa000 comp rx=0 tx=0).stop 2024-04-17T19:50:01.317 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2024-04-17T19:50:01.317 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "a", 2024-04-17T19:50:01.317 INFO:teuthology.orchestra.run.smithi044.stdout: "rank": 0, 2024-04-17T19:50:01.317 INFO:teuthology.orchestra.run.smithi044.stdout: "state": "leader", 2024-04-17T19:50:01.318 INFO:teuthology.orchestra.run.smithi044.stdout: "election_epoch": 20, 2024-04-17T19:50:01.318 INFO:teuthology.orchestra.run.smithi044.stdout: "uptime": 210788, 2024-04-17T19:50:01.318 INFO:teuthology.orchestra.run.smithi044.stdout: "quorum": [ 2024-04-17T19:50:01.318 INFO:teuthology.orchestra.run.smithi044.stdout: 0, 2024-04-17T19:50:01.318 INFO:teuthology.orchestra.run.smithi044.stdout: 1, 2024-04-17T19:50:01.318 INFO:teuthology.orchestra.run.smithi044.stdout: 2 2024-04-17T19:50:01.318 INFO:teuthology.orchestra.run.smithi044.stdout: ], 2024-04-17T19:50:01.318 INFO:teuthology.orchestra.run.smithi044.stdout: "quorum_age": 0, 2024-04-17T19:50:01.318 INFO:teuthology.orchestra.run.smithi044.stdout: "features": { 2024-04-17T19:50:01.318 INFO:teuthology.orchestra.run.smithi044.stdout: "required_con": "2450521708007866372", 2024-04-17T19:50:01.318 INFO:teuthology.orchestra.run.smithi044.stdout: "required_mon": [ 2024-04-17T19:50:01.318 INFO:teuthology.orchestra.run.smithi044.stdout: "kraken", 2024-04-17T19:50:01.318 INFO:teuthology.orchestra.run.smithi044.stdout: "luminous", 2024-04-17T19:50:01.319 INFO:teuthology.orchestra.run.smithi044.stdout: "mimic", 2024-04-17T19:50:01.319 INFO:teuthology.orchestra.run.smithi044.stdout: "osdmap-prune", 2024-04-17T19:50:01.319 INFO:teuthology.orchestra.run.smithi044.stdout: "nautilus", 2024-04-17T19:50:01.319 INFO:teuthology.orchestra.run.smithi044.stdout: "octopus", 2024-04-17T19:50:01.319 INFO:teuthology.orchestra.run.smithi044.stdout: "pacific", 2024-04-17T19:50:01.319 INFO:teuthology.orchestra.run.smithi044.stdout: "elector-pinging", 2024-04-17T19:50:01.319 INFO:teuthology.orchestra.run.smithi044.stdout: "quincy", 2024-04-17T19:50:01.319 INFO:teuthology.orchestra.run.smithi044.stdout: "reef", 2024-04-17T19:50:01.319 INFO:teuthology.orchestra.run.smithi044.stdout: "squid" 2024-04-17T19:50:01.319 INFO:teuthology.orchestra.run.smithi044.stdout: ], 2024-04-17T19:50:01.319 INFO:teuthology.orchestra.run.smithi044.stdout: "quorum_con": "4540701547738038271", 2024-04-17T19:50:01.319 INFO:teuthology.orchestra.run.smithi044.stdout: "quorum_mon": [ 2024-04-17T19:50:01.319 INFO:teuthology.orchestra.run.smithi044.stdout: "kraken", 2024-04-17T19:50:01.319 INFO:teuthology.orchestra.run.smithi044.stdout: "luminous", 2024-04-17T19:50:01.320 INFO:teuthology.orchestra.run.smithi044.stdout: "mimic", 2024-04-17T19:50:01.320 INFO:teuthology.orchestra.run.smithi044.stdout: "osdmap-prune", 2024-04-17T19:50:01.320 INFO:teuthology.orchestra.run.smithi044.stdout: "nautilus", 2024-04-17T19:50:01.320 INFO:teuthology.orchestra.run.smithi044.stdout: "octopus", 2024-04-17T19:50:01.320 INFO:teuthology.orchestra.run.smithi044.stdout: "pacific", 2024-04-17T19:50:01.320 INFO:teuthology.orchestra.run.smithi044.stdout: "elector-pinging", 2024-04-17T19:50:01.320 INFO:teuthology.orchestra.run.smithi044.stdout: "quincy", 2024-04-17T19:50:01.320 INFO:teuthology.orchestra.run.smithi044.stdout: "reef", 2024-04-17T19:50:01.320 INFO:teuthology.orchestra.run.smithi044.stdout: "squid" 2024-04-17T19:50:01.320 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T19:50:01.320 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T19:50:01.320 INFO:teuthology.orchestra.run.smithi044.stdout: "outside_quorum": [], 2024-04-17T19:50:01.320 INFO:teuthology.orchestra.run.smithi044.stdout: "extra_probe_peers": [], 2024-04-17T19:50:01.320 INFO:teuthology.orchestra.run.smithi044.stdout: "sync_provider": [], 2024-04-17T19:50:01.321 INFO:teuthology.orchestra.run.smithi044.stdout: "monmap": { 2024-04-17T19:50:01.321 INFO:teuthology.orchestra.run.smithi044.stdout: "epoch": 1, 2024-04-17T19:50:01.321 INFO:teuthology.orchestra.run.smithi044.stdout: "fsid": "703f77ca-79c6-4a66-b576-62c526cb1021", 2024-04-17T19:50:01.321 INFO:teuthology.orchestra.run.smithi044.stdout: "modified": "2024-04-17T19:45:55.379749Z", 2024-04-17T19:50:01.321 INFO:teuthology.orchestra.run.smithi044.stdout: "created": "2024-04-17T19:45:55.379749Z", 2024-04-17T19:50:01.321 INFO:teuthology.orchestra.run.smithi044.stdout: "min_mon_release": 19, 2024-04-17T19:50:01.321 INFO:teuthology.orchestra.run.smithi044.stdout: "min_mon_release_name": "squid", 2024-04-17T19:50:01.321 INFO:teuthology.orchestra.run.smithi044.stdout: "election_strategy": 1, 2024-04-17T19:50:01.321 INFO:teuthology.orchestra.run.smithi044.stdout: "disallowed_leaders: ": "", 2024-04-17T19:50:01.321 INFO:teuthology.orchestra.run.smithi044.stdout: "stretch_mode": false, 2024-04-17T19:50:01.321 INFO:teuthology.orchestra.run.smithi044.stdout: "tiebreaker_mon": "", 2024-04-17T19:50:01.321 INFO:teuthology.orchestra.run.smithi044.stdout: "removed_ranks: ": "", 2024-04-17T19:50:01.321 INFO:teuthology.orchestra.run.smithi044.stdout: "features": { 2024-04-17T19:50:01.321 INFO:teuthology.orchestra.run.smithi044.stdout: "persistent": [ 2024-04-17T19:50:01.322 INFO:teuthology.orchestra.run.smithi044.stdout: "kraken", 2024-04-17T19:50:01.322 INFO:teuthology.orchestra.run.smithi044.stdout: "luminous", 2024-04-17T19:50:01.322 INFO:teuthology.orchestra.run.smithi044.stdout: "mimic", 2024-04-17T19:50:01.322 INFO:teuthology.orchestra.run.smithi044.stdout: "osdmap-prune", 2024-04-17T19:50:01.322 INFO:teuthology.orchestra.run.smithi044.stdout: "nautilus", 2024-04-17T19:50:01.322 INFO:teuthology.orchestra.run.smithi044.stdout: "octopus", 2024-04-17T19:50:01.322 INFO:teuthology.orchestra.run.smithi044.stdout: "pacific", 2024-04-17T19:50:01.322 INFO:teuthology.orchestra.run.smithi044.stdout: "elector-pinging", 2024-04-17T19:50:01.322 INFO:teuthology.orchestra.run.smithi044.stdout: "quincy", 2024-04-17T19:50:01.322 INFO:teuthology.orchestra.run.smithi044.stdout: "reef", 2024-04-17T19:50:01.322 INFO:teuthology.orchestra.run.smithi044.stdout: "squid" 2024-04-17T19:50:01.322 INFO:teuthology.orchestra.run.smithi044.stdout: ], 2024-04-17T19:50:01.322 INFO:teuthology.orchestra.run.smithi044.stdout: "optional": [] 2024-04-17T19:50:01.322 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T19:50:01.322 INFO:teuthology.orchestra.run.smithi044.stdout: "mons": [ 2024-04-17T19:50:01.323 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T19:50:01.323 INFO:teuthology.orchestra.run.smithi044.stdout: "rank": 0, 2024-04-17T19:50:01.323 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "a", 2024-04-17T19:50:01.323 INFO:teuthology.orchestra.run.smithi044.stdout: "public_addrs": { 2024-04-17T19:50:01.323 INFO:teuthology.orchestra.run.smithi044.stdout: "addrvec": [ 2024-04-17T19:50:01.323 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T19:50:01.323 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "v2", 2024-04-17T19:50:01.323 INFO:teuthology.orchestra.run.smithi044.stdout: "addr": "172.21.15.44:3300", 2024-04-17T19:50:01.323 INFO:teuthology.orchestra.run.smithi044.stdout: "nonce": 0 2024-04-17T19:50:01.323 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T19:50:01.323 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T19:50:01.323 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "v1", 2024-04-17T19:50:01.323 INFO:teuthology.orchestra.run.smithi044.stdout: "addr": "172.21.15.44:6789", 2024-04-17T19:50:01.323 INFO:teuthology.orchestra.run.smithi044.stdout: "nonce": 0 2024-04-17T19:50:01.324 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T19:50:01.324 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T19:50:01.324 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T19:50:01.324 INFO:teuthology.orchestra.run.smithi044.stdout: "addr": "172.21.15.44:6789/0", 2024-04-17T19:50:01.324 INFO:teuthology.orchestra.run.smithi044.stdout: "public_addr": "172.21.15.44:6789/0", 2024-04-17T19:50:01.324 INFO:teuthology.orchestra.run.smithi044.stdout: "priority": 0, 2024-04-17T19:50:01.324 INFO:teuthology.orchestra.run.smithi044.stdout: "weight": 0, 2024-04-17T19:50:01.324 INFO:teuthology.orchestra.run.smithi044.stdout: "crush_location": "{}" 2024-04-17T19:50:01.324 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T19:50:01.324 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T19:50:01.324 INFO:teuthology.orchestra.run.smithi044.stdout: "rank": 1, 2024-04-17T19:50:01.324 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "b", 2024-04-17T19:50:01.324 INFO:teuthology.orchestra.run.smithi044.stdout: "public_addrs": { 2024-04-17T19:50:01.324 INFO:teuthology.orchestra.run.smithi044.stdout: "addrvec": [ 2024-04-17T19:50:01.324 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T19:50:01.325 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "v2", 2024-04-17T19:50:01.325 INFO:teuthology.orchestra.run.smithi044.stdout: "addr": "172.21.15.62:3300", 2024-04-17T19:50:01.325 INFO:teuthology.orchestra.run.smithi044.stdout: "nonce": 0 2024-04-17T19:50:01.325 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T19:50:01.325 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T19:50:01.325 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "v1", 2024-04-17T19:50:01.325 INFO:teuthology.orchestra.run.smithi044.stdout: "addr": "172.21.15.62:6789", 2024-04-17T19:50:01.325 INFO:teuthology.orchestra.run.smithi044.stdout: "nonce": 0 2024-04-17T19:50:01.325 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T19:50:01.325 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T19:50:01.325 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T19:50:01.325 INFO:teuthology.orchestra.run.smithi044.stdout: "addr": "172.21.15.62:6789/0", 2024-04-17T19:50:01.325 INFO:teuthology.orchestra.run.smithi044.stdout: "public_addr": "172.21.15.62:6789/0", 2024-04-17T19:50:01.325 INFO:teuthology.orchestra.run.smithi044.stdout: "priority": 0, 2024-04-17T19:50:01.325 INFO:teuthology.orchestra.run.smithi044.stdout: "weight": 0, 2024-04-17T19:50:01.326 INFO:teuthology.orchestra.run.smithi044.stdout: "crush_location": "{}" 2024-04-17T19:50:01.326 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T19:50:01.326 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T19:50:01.326 INFO:teuthology.orchestra.run.smithi044.stdout: "rank": 2, 2024-04-17T19:50:01.326 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "c", 2024-04-17T19:50:01.326 INFO:teuthology.orchestra.run.smithi044.stdout: "public_addrs": { 2024-04-17T19:50:01.326 INFO:teuthology.orchestra.run.smithi044.stdout: "addrvec": [ 2024-04-17T19:50:01.326 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T19:50:01.326 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "v2", 2024-04-17T19:50:01.326 INFO:teuthology.orchestra.run.smithi044.stdout: "addr": "172.21.15.62:3301", 2024-04-17T19:50:01.326 INFO:teuthology.orchestra.run.smithi044.stdout: "nonce": 0 2024-04-17T19:50:01.326 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T19:50:01.326 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T19:50:01.326 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "v1", 2024-04-17T19:50:01.326 INFO:teuthology.orchestra.run.smithi044.stdout: "addr": "172.21.15.62:6790", 2024-04-17T19:50:01.327 INFO:teuthology.orchestra.run.smithi044.stdout: "nonce": 0 2024-04-17T19:50:01.327 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T19:50:01.327 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T19:50:01.327 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T19:50:01.327 INFO:teuthology.orchestra.run.smithi044.stdout: "addr": "172.21.15.62:6790/0", 2024-04-17T19:50:01.327 INFO:teuthology.orchestra.run.smithi044.stdout: "public_addr": "172.21.15.62:6790/0", 2024-04-17T19:50:01.327 INFO:teuthology.orchestra.run.smithi044.stdout: "priority": 0, 2024-04-17T19:50:01.327 INFO:teuthology.orchestra.run.smithi044.stdout: "weight": 0, 2024-04-17T19:50:01.327 INFO:teuthology.orchestra.run.smithi044.stdout: "crush_location": "{}" 2024-04-17T19:50:01.327 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T19:50:01.327 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T19:50:01.327 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T19:50:01.327 INFO:teuthology.orchestra.run.smithi044.stdout: "feature_map": { 2024-04-17T19:50:01.327 INFO:teuthology.orchestra.run.smithi044.stdout: "mon": [ 2024-04-17T19:50:01.328 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T19:50:01.328 INFO:teuthology.orchestra.run.smithi044.stdout: "features": "0x3f03cffffffdffff", 2024-04-17T19:50:01.328 INFO:teuthology.orchestra.run.smithi044.stdout: "release": "luminous", 2024-04-17T19:50:01.328 INFO:teuthology.orchestra.run.smithi044.stdout: "num": 1 2024-04-17T19:50:01.328 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T19:50:01.328 INFO:teuthology.orchestra.run.smithi044.stdout: ], 2024-04-17T19:50:01.328 INFO:teuthology.orchestra.run.smithi044.stdout: "mds": [ 2024-04-17T19:50:01.328 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T19:50:01.328 INFO:teuthology.orchestra.run.smithi044.stdout: "features": "0x3f03cffffffdffff", 2024-04-17T19:50:01.328 INFO:teuthology.orchestra.run.smithi044.stdout: "release": "luminous", 2024-04-17T19:50:01.328 INFO:teuthology.orchestra.run.smithi044.stdout: "num": 6 2024-04-17T19:50:01.328 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T19:50:01.328 INFO:teuthology.orchestra.run.smithi044.stdout: ], 2024-04-17T19:50:01.329 INFO:teuthology.orchestra.run.smithi044.stdout: "osd": [ 2024-04-17T19:50:01.329 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T19:50:01.329 INFO:teuthology.orchestra.run.smithi044.stdout: "features": "0x3f03cffffffdffff", 2024-04-17T19:50:01.329 INFO:teuthology.orchestra.run.smithi044.stdout: "release": "luminous", 2024-04-17T19:50:01.329 INFO:teuthology.orchestra.run.smithi044.stdout: "num": 8 2024-04-17T19:50:01.329 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T19:50:01.329 INFO:teuthology.orchestra.run.smithi044.stdout: ], 2024-04-17T19:50:01.329 INFO:teuthology.orchestra.run.smithi044.stdout: "client": [ 2024-04-17T19:50:01.329 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T19:50:01.329 INFO:teuthology.orchestra.run.smithi044.stdout: "features": "0x2f018fb87aa4aafe", 2024-04-17T19:50:01.329 INFO:teuthology.orchestra.run.smithi044.stdout: "release": "luminous", 2024-04-17T19:50:01.329 INFO:teuthology.orchestra.run.smithi044.stdout: "num": 1 2024-04-17T19:50:01.329 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T19:50:01.329 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T19:50:01.330 INFO:teuthology.orchestra.run.smithi044.stdout: "features": "0x3f03cffffffdffff", 2024-04-17T19:50:01.330 INFO:teuthology.orchestra.run.smithi044.stdout: "release": "luminous", 2024-04-17T19:50:01.330 INFO:teuthology.orchestra.run.smithi044.stdout: "num": 6 2024-04-17T19:50:01.330 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T19:50:01.330 INFO:teuthology.orchestra.run.smithi044.stdout: ], 2024-04-17T19:50:01.330 INFO:teuthology.orchestra.run.smithi044.stdout: "mgr": [ 2024-04-17T19:50:01.330 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T19:50:01.330 INFO:teuthology.orchestra.run.smithi044.stdout: "features": "0x3f03cffffffdffff", 2024-04-17T19:50:01.330 INFO:teuthology.orchestra.run.smithi044.stdout: "release": "luminous", 2024-04-17T19:50:01.330 INFO:teuthology.orchestra.run.smithi044.stdout: "num": 2 2024-04-17T19:50:01.330 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T19:50:01.330 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T19:50:01.330 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T19:50:01.330 INFO:teuthology.orchestra.run.smithi044.stdout: "stretch_mode": false 2024-04-17T19:50:01.330 INFO:teuthology.orchestra.run.smithi044.stdout:} 2024-04-17T19:50:01.331 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:01.327+0000 7fbcdc000640 1 -- 172.21.15.44:0/798300510 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7fbcb4068280 msgr2=0x7fbcb406a790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:50:01.331 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:01.327+0000 7fbcdc000640 1 --2- 172.21.15.44:0/798300510 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7fbcb4068280 0x7fbcb406a790 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fbcc0005890 tx=0x7fbcc0009040 comp rx=0 tx=0).stop 2024-04-17T19:50:01.331 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:01.327+0000 7fbcdc000640 1 -- 172.21.15.44:0/798300510 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbcd40c5c10 msgr2=0x7fbcd40cbba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:50:01.331 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:01.327+0000 7fbcdc000640 1 --2- 172.21.15.44:0/798300510 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbcd40c5c10 0x7fbcd40cbba0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7fbccc00c730 tx=0x7fbccc00cbf0 comp rx=0 tx=0).stop 2024-04-17T19:50:01.332 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:01.327+0000 7fbcda000640 1 -- 172.21.15.44:0/798300510 reap_dead start 2024-04-17T19:50:01.332 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:01.327+0000 7fbcda000640 1 -- 172.21.15.44:0/798300510 reap_dead start 2024-04-17T19:50:01.332 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:01.327+0000 7fbcdc000640 1 -- 172.21.15.44:0/798300510 shutdown_connections 2024-04-17T19:50:01.332 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:01.327+0000 7fbcdc000640 1 -- 172.21.15.44:0/798300510 >> 172.21.15.44:0/798300510 conn(0x7fbcd406c380 msgr2=0x7fbcd4157620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:50:01.332 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:01.327+0000 7fbcdc000640 1 -- 172.21.15.44:0/798300510 shutdown_connections 2024-04-17T19:50:01.332 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:01.327+0000 7fbcdc000640 1 -- 172.21.15.44:0/798300510 wait complete. 2024-04-17T19:50:01.336 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-04-17T19:50:01.336 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon b 2024-04-17T19:50:01.337 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2024-04-17T19:50:01.489 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:01.499+0000 7f9443800640 1 Processor -- start 2024-04-17T19:50:01.489 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:01.499+0000 7f9443800640 1 -- start start 2024-04-17T19:50:01.491 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:01.499+0000 7f9443800640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f943c152310 0x7f943c15be50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:50:01.491 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:01.499+0000 7f9443800640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f943c157e50 con 0x7f943c0c7530 2024-04-17T19:50:01.491 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:01.499+0000 7f9443800640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f943c15c390 con 0x7f943c073f10 2024-04-17T19:50:01.491 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:01.499+0000 7f9443800640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 -- 0x7f943c0c4310 con 0x7f943c152310 2024-04-17T19:50:01.491 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:01.499+0000 7f9433e00640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f943c152310 0x7f943c15be50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:50:01.491 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:01.499+0000 7f9441800640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f943c0c7530 0x7f943c1627d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:45208/0 (socket says 172.21.15.44:45208) 2024-04-17T19:50:01.491 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:01.499+0000 7f9441800640 1 -- 172.21.15.44:0/217876136 learned_addr learned my addr 172.21.15.44:0/217876136 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-04-17T19:50:01.492 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:01.499+0000 7f943be00640 1 -- 172.21.15.44:0/217876136 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 130127370 0 0) 0x7f94340014a0 con 0x7f943c0c7530 2024-04-17T19:50:01.492 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:01.503+0000 7f943be00640 1 -- 172.21.15.44:0/217876136 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9420003530 con 0x7f943c0c7530 2024-04-17T19:50:01.492 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:01.503+0000 7f9433e00640 1 -- 172.21.15.44:0/217876136 >> v1:172.21.15.62:6789/0 conn(0x7f943c073f10 legacy=0x7f943c1588d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:50:01.492 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:01.503+0000 7f9433e00640 1 -- 172.21.15.44:0/217876136 >> v1:172.21.15.44:6789/0 conn(0x7f943c0c7530 legacy=0x7f943c1627d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:50:01.492 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:01.503+0000 7f9433e00640 1 -- 172.21.15.44:0/217876136 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f943c0c45f0 con 0x7f943c152310 2024-04-17T19:50:01.494 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:01.503+0000 7f9433e00640 1 --2- 172.21.15.44:0/217876136 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f943c152310 0x7f943c15be50 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f942400a960 tx=0x7f942401d870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=77457f6f0a4e65ac server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:50:01.495 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:01.503+0000 7f943be00640 1 -- 172.21.15.44:0/217876136 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f942400b040 con 0x7f943c152310 2024-04-17T19:50:01.495 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:01.503+0000 7f943be00640 1 -- 172.21.15.44:0/217876136 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f94240a76d0 con 0x7f943c152310 2024-04-17T19:50:01.495 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:01.503+0000 7f943be00640 1 -- 172.21.15.44:0/217876136 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94240a7aa0 con 0x7f943c152310 2024-04-17T19:50:01.496 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:01.503+0000 7f9443800640 1 -- 172.21.15.44:0/217876136 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f943c152310 msgr2=0x7f943c15be50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:50:01.496 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:01.503+0000 7f9443800640 1 --2- 172.21.15.44:0/217876136 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f943c152310 0x7f943c15be50 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f942400a960 tx=0x7f942401d870 comp rx=0 tx=0).stop 2024-04-17T19:50:01.496 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:01.503+0000 7f9443800640 1 -- 172.21.15.44:0/217876136 shutdown_connections 2024-04-17T19:50:01.496 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:01.503+0000 7f9443800640 1 --2- 172.21.15.44:0/217876136 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f943c152310 0x7f943c15be50 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:50:01.496 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:01.503+0000 7f9443800640 1 -- 172.21.15.44:0/217876136 >> 172.21.15.44:0/217876136 conn(0x7f943c06c380 msgr2=0x7f943c070080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:50:01.496 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:01.507+0000 7f9443800640 1 -- 172.21.15.44:0/217876136 shutdown_connections 2024-04-17T19:50:01.496 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:01.507+0000 7f9443800640 1 -- 172.21.15.44:0/217876136 wait complete. 2024-04-17T19:50:01.498 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:01.507+0000 7f9443800640 1 Processor -- start 2024-04-17T19:50:01.498 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:01.507+0000 7f9443800640 1 -- start start 2024-04-17T19:50:01.501 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:01.507+0000 7f9443800640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f943c073f10 0x7f943c1f56f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:50:01.501 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:01.507+0000 7f9443800640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f943c0c7530 0x7f943c1f9500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:50:01.501 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:01.507+0000 7f9443800640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f943c152310 0x7f943c0cb300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:50:01.501 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:01.507+0000 7f9443800640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f943c0c3ed0 con 0x7f943c073f10 2024-04-17T19:50:01.501 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:01.507+0000 7f9443800640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f943c0c7d50 con 0x7f943c0c7530 2024-04-17T19:50:01.501 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:01.507+0000 7f9443800640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7f943c0c4050 con 0x7f943c152310 2024-04-17T19:50:01.501 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:01.507+0000 7f9440e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f943c073f10 0x7f943c1f56f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:50:01.501 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:01.507+0000 7f9440e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f943c073f10 0x7f943c1f56f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:45854/0 (socket says 172.21.15.44:45854) 2024-04-17T19:50:01.501 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:01.507+0000 7f9440e00640 1 -- 172.21.15.44:0/253445355 learned_addr learned my addr 172.21.15.44:0/253445355 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-04-17T19:50:01.501 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:01.511+0000 7f9433e00640 1 --2- 172.21.15.44:0/253445355 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f943c0c7530 0x7f943c1f9500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:50:01.501 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:01.511+0000 7f9441800640 1 --2- 172.21.15.44:0/253445355 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f943c152310 0x7f943c0cb300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:50:01.502 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:01.511+0000 7f9440e00640 1 -- 172.21.15.44:0/253445355 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f943c152310 msgr2=0x7f943c0cb300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:50:01.502 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:01.511+0000 7f9440e00640 1 --2- 172.21.15.44:0/253445355 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f943c152310 0x7f943c0cb300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:50:01.502 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:01.511+0000 7f9440e00640 1 -- 172.21.15.44:0/253445355 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f943c0c7530 msgr2=0x7f943c1f9500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:50:01.502 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:01.511+0000 7f9440e00640 1 --2- 172.21.15.44:0/253445355 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f943c0c7530 0x7f943c1f9500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:50:01.502 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:01.511+0000 7f9440e00640 1 -- 172.21.15.44:0/253445355 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f943c1f9a40 con 0x7f943c073f10 2024-04-17T19:50:01.502 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:01.511+0000 7f9440e00640 1 --2- 172.21.15.44:0/253445355 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f943c073f10 0x7f943c1f56f0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f942c00c3a0 tx=0x7f942c00c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:50:01.502 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:01.511+0000 7f9439600640 1 -- 172.21.15.44:0/253445355 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f942c0052d0 con 0x7f943c073f10 2024-04-17T19:50:01.502 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:01.511+0000 7f9439600640 1 -- 172.21.15.44:0/253445355 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f942c005470 con 0x7f943c073f10 2024-04-17T19:50:01.502 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:01.511+0000 7f9439600640 1 -- 172.21.15.44:0/253445355 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f942c007260 con 0x7f943c073f10 2024-04-17T19:50:01.502 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:01.511+0000 7f9443800640 1 -- 172.21.15.44:0/253445355 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f943c1f5ff0 con 0x7f943c073f10 2024-04-17T19:50:01.502 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:01.511+0000 7f9443800640 1 -- 172.21.15.44:0/253445355 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f943c1f8d00 con 0x7f943c073f10 2024-04-17T19:50:01.503 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:01.511+0000 7f9443800640 1 --2- 172.21.15.44:0/253445355 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f943c1f8ed0 0x7f943c14d210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:50:01.503 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:01.511+0000 7f9443800640 1 -- 172.21.15.44:0/253445355 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f943c1512d0 con 0x7f943c1f8ed0 2024-04-17T19:50:01.503 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:01.511+0000 7f9433e00640 1 --2- 172.21.15.44:0/253445355 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f943c1f8ed0 0x7f943c14d210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:50:01.503 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:01.511+0000 7f9439600640 1 -- 172.21.15.44:0/253445355 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f942c007400 con 0x7f943c073f10 2024-04-17T19:50:01.503 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:01.511+0000 7f9433e00640 1 -- 172.21.15.44:0/253445355 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f943c04ff10 con 0x7f943c1f8ed0 2024-04-17T19:50:01.503 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:01.511+0000 7f9433e00640 1 --2- 172.21.15.44:0/253445355 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f943c1f8ed0 0x7f943c14d210 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f943c06dcd0 tx=0x7f942401c0b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:50:01.504 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:01.511+0000 7f9439600640 1 --2- 172.21.15.44:0/253445355 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f9418068380 0x7f941806a890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:50:01.504 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:01.515+0000 7f9439600640 1 -- 172.21.15.44:0/253445355 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6619+0+0 (secure 0 0 0) 0x7f942c086280 con 0x7f943c073f10 2024-04-17T19:50:01.505 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:01.515+0000 7f9439600640 1 -- 172.21.15.44:0/253445355 <== mon.1 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94240bd070 con 0x7f943c1f8ed0 2024-04-17T19:50:01.505 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:01.515+0000 7f9441800640 1 --2- 172.21.15.44:0/253445355 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f9418068380 0x7f941806a890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:50:01.505 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:01.515+0000 7f9439600640 1 -- 172.21.15.44:0/253445355 <== mon.1 v2:172.21.15.62:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f94240af620 con 0x7f943c1f8ed0 2024-04-17T19:50:01.505 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:01.515+0000 7f9439600640 1 -- 172.21.15.44:0/253445355 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f943c1f8ed0 msgr2=0x7f943c14d210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:50:01.505 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:01.515+0000 7f9439600640 1 --2- 172.21.15.44:0/253445355 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f943c1f8ed0 0x7f943c14d210 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f943c06dcd0 tx=0x7f942401c0b0 comp rx=0 tx=0).stop 2024-04-17T19:50:01.505 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:01.515+0000 7f9439600640 1 -- 172.21.15.44:0/253445355 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f943c1f8ed0 msgr2=0x7f943c14d210 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-04-17T19:50:01.505 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:01.515+0000 7f9439600640 1 --2- 172.21.15.44:0/253445355 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f943c1f8ed0 0x7f943c14d210 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:50:01.505 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:01.515+0000 7f9441800640 1 --2- 172.21.15.44:0/253445355 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f9418068380 0x7f941806a890 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f943c1514b0 tx=0x7f9434009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:50:01.510 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:01.519+0000 7f9443800640 1 --2- 172.21.15.44:0/253445355 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f943c153f60 0x7f943c14d750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:50:01.511 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:01.519+0000 7f9443800640 1 -- 172.21.15.44:0/253445355 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f943c1f5da0 con 0x7f943c153f60 2024-04-17T19:50:01.511 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:01.519+0000 7f9433e00640 1 --2- 172.21.15.44:0/253445355 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f943c153f60 0x7f943c14d750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:50:01.512 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:01.523+0000 7f9433e00640 1 -- 172.21.15.44:0/253445355 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f943c0cc5d0 con 0x7f943c153f60 2024-04-17T19:50:01.512 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:01.523+0000 7f9433e00640 1 --2- 172.21.15.44:0/253445355 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f943c153f60 0x7f943c14d750 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f94240b1040 tx=0x7f942401a610 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:50:01.513 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:01.523+0000 7f9439600640 1 -- 172.21.15.44:0/253445355 <== mon.1 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94240bd070 con 0x7f943c153f60 2024-04-17T19:50:01.514 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:01.523+0000 7f9439600640 1 -- 172.21.15.44:0/253445355 <== mon.1 v2:172.21.15.62:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4546 (secure 0 0 0) 0x7f9424003a30 con 0x7f943c153f60 2024-04-17T19:50:01.514 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:01.523+0000 7f9439600640 1 -- 172.21.15.44:0/253445355 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f943c153f60 msgr2=0x7f943c14d750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:50:01.514 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:01.523+0000 7f9439600640 1 --2- 172.21.15.44:0/253445355 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f943c153f60 0x7f943c14d750 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f94240b1040 tx=0x7f942401a610 comp rx=0 tx=0).stop 2024-04-17T19:50:01.514 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:01.523+0000 7f9439600640 1 -- 172.21.15.44:0/253445355 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f943c153f60 msgr2=0x7f943c14d750 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-04-17T19:50:01.514 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:01.523+0000 7f9439600640 1 --2- 172.21.15.44:0/253445355 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f943c153f60 0x7f943c14d750 secure :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f94240b1040 tx=0x7f942401a610 comp rx=0 tx=0).stop 2024-04-17T19:50:01.514 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2024-04-17T19:50:01.514 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "b", 2024-04-17T19:50:01.515 INFO:teuthology.orchestra.run.smithi044.stdout: "rank": 1, 2024-04-17T19:50:01.515 INFO:teuthology.orchestra.run.smithi044.stdout: "state": "peon", 2024-04-17T19:50:01.515 INFO:teuthology.orchestra.run.smithi044.stdout: "election_epoch": 20, 2024-04-17T19:50:01.515 INFO:teuthology.orchestra.run.smithi044.stdout: "uptime": 15675, 2024-04-17T19:50:01.515 INFO:teuthology.orchestra.run.smithi044.stdout: "quorum": [ 2024-04-17T19:50:01.515 INFO:teuthology.orchestra.run.smithi044.stdout: 0, 2024-04-17T19:50:01.515 INFO:teuthology.orchestra.run.smithi044.stdout: 1, 2024-04-17T19:50:01.515 INFO:teuthology.orchestra.run.smithi044.stdout: 2 2024-04-17T19:50:01.515 INFO:teuthology.orchestra.run.smithi044.stdout: ], 2024-04-17T19:50:01.515 INFO:teuthology.orchestra.run.smithi044.stdout: "quorum_age": 0, 2024-04-17T19:50:01.515 INFO:teuthology.orchestra.run.smithi044.stdout: "features": { 2024-04-17T19:50:01.515 INFO:teuthology.orchestra.run.smithi044.stdout: "required_con": "2450521708007866372", 2024-04-17T19:50:01.515 INFO:teuthology.orchestra.run.smithi044.stdout: "required_mon": [ 2024-04-17T19:50:01.515 INFO:teuthology.orchestra.run.smithi044.stdout: "kraken", 2024-04-17T19:50:01.516 INFO:teuthology.orchestra.run.smithi044.stdout: "luminous", 2024-04-17T19:50:01.516 INFO:teuthology.orchestra.run.smithi044.stdout: "mimic", 2024-04-17T19:50:01.516 INFO:teuthology.orchestra.run.smithi044.stdout: "osdmap-prune", 2024-04-17T19:50:01.516 INFO:teuthology.orchestra.run.smithi044.stdout: "nautilus", 2024-04-17T19:50:01.516 INFO:teuthology.orchestra.run.smithi044.stdout: "octopus", 2024-04-17T19:50:01.516 INFO:teuthology.orchestra.run.smithi044.stdout: "pacific", 2024-04-17T19:50:01.516 INFO:teuthology.orchestra.run.smithi044.stdout: "elector-pinging", 2024-04-17T19:50:01.516 INFO:teuthology.orchestra.run.smithi044.stdout: "quincy", 2024-04-17T19:50:01.516 INFO:teuthology.orchestra.run.smithi044.stdout: "reef", 2024-04-17T19:50:01.516 INFO:teuthology.orchestra.run.smithi044.stdout: "squid" 2024-04-17T19:50:01.516 INFO:teuthology.orchestra.run.smithi044.stdout: ], 2024-04-17T19:50:01.516 INFO:teuthology.orchestra.run.smithi044.stdout: "quorum_con": "4540701547738038271", 2024-04-17T19:50:01.516 INFO:teuthology.orchestra.run.smithi044.stdout: "quorum_mon": [ 2024-04-17T19:50:01.516 INFO:teuthology.orchestra.run.smithi044.stdout: "kraken", 2024-04-17T19:50:01.516 INFO:teuthology.orchestra.run.smithi044.stdout: "luminous", 2024-04-17T19:50:01.517 INFO:teuthology.orchestra.run.smithi044.stdout: "mimic", 2024-04-17T19:50:01.517 INFO:teuthology.orchestra.run.smithi044.stdout: "osdmap-prune", 2024-04-17T19:50:01.517 INFO:teuthology.orchestra.run.smithi044.stdout: "nautilus", 2024-04-17T19:50:01.517 INFO:teuthology.orchestra.run.smithi044.stdout: "octopus", 2024-04-17T19:50:01.517 INFO:teuthology.orchestra.run.smithi044.stdout: "pacific", 2024-04-17T19:50:01.517 INFO:teuthology.orchestra.run.smithi044.stdout: "elector-pinging", 2024-04-17T19:50:01.517 INFO:teuthology.orchestra.run.smithi044.stdout: "quincy", 2024-04-17T19:50:01.517 INFO:teuthology.orchestra.run.smithi044.stdout: "reef", 2024-04-17T19:50:01.517 INFO:teuthology.orchestra.run.smithi044.stdout: "squid" 2024-04-17T19:50:01.517 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T19:50:01.517 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T19:50:01.517 INFO:teuthology.orchestra.run.smithi044.stdout: "outside_quorum": [], 2024-04-17T19:50:01.517 INFO:teuthology.orchestra.run.smithi044.stdout: "extra_probe_peers": [], 2024-04-17T19:50:01.517 INFO:teuthology.orchestra.run.smithi044.stdout: "sync_provider": [], 2024-04-17T19:50:01.517 INFO:teuthology.orchestra.run.smithi044.stdout: "monmap": { 2024-04-17T19:50:01.518 INFO:teuthology.orchestra.run.smithi044.stdout: "epoch": 1, 2024-04-17T19:50:01.518 INFO:teuthology.orchestra.run.smithi044.stdout: "fsid": "703f77ca-79c6-4a66-b576-62c526cb1021", 2024-04-17T19:50:01.518 INFO:teuthology.orchestra.run.smithi044.stdout: "modified": "2024-04-17T19:45:55.379749Z", 2024-04-17T19:50:01.518 INFO:teuthology.orchestra.run.smithi044.stdout: "created": "2024-04-17T19:45:55.379749Z", 2024-04-17T19:50:01.518 INFO:teuthology.orchestra.run.smithi044.stdout: "min_mon_release": 19, 2024-04-17T19:50:01.518 INFO:teuthology.orchestra.run.smithi044.stdout: "min_mon_release_name": "squid", 2024-04-17T19:50:01.518 INFO:teuthology.orchestra.run.smithi044.stdout: "election_strategy": 1, 2024-04-17T19:50:01.518 INFO:teuthology.orchestra.run.smithi044.stdout: "disallowed_leaders: ": "", 2024-04-17T19:50:01.518 INFO:teuthology.orchestra.run.smithi044.stdout: "stretch_mode": false, 2024-04-17T19:50:01.518 INFO:teuthology.orchestra.run.smithi044.stdout: "tiebreaker_mon": "", 2024-04-17T19:50:01.518 INFO:teuthology.orchestra.run.smithi044.stdout: "removed_ranks: ": "", 2024-04-17T19:50:01.518 INFO:teuthology.orchestra.run.smithi044.stdout: "features": { 2024-04-17T19:50:01.518 INFO:teuthology.orchestra.run.smithi044.stdout: "persistent": [ 2024-04-17T19:50:01.519 INFO:teuthology.orchestra.run.smithi044.stdout: "kraken", 2024-04-17T19:50:01.519 INFO:teuthology.orchestra.run.smithi044.stdout: "luminous", 2024-04-17T19:50:01.519 INFO:teuthology.orchestra.run.smithi044.stdout: "mimic", 2024-04-17T19:50:01.519 INFO:teuthology.orchestra.run.smithi044.stdout: "osdmap-prune", 2024-04-17T19:50:01.519 INFO:teuthology.orchestra.run.smithi044.stdout: "nautilus", 2024-04-17T19:50:01.519 INFO:teuthology.orchestra.run.smithi044.stdout: "octopus", 2024-04-17T19:50:01.519 INFO:teuthology.orchestra.run.smithi044.stdout: "pacific", 2024-04-17T19:50:01.519 INFO:teuthology.orchestra.run.smithi044.stdout: "elector-pinging", 2024-04-17T19:50:01.519 INFO:teuthology.orchestra.run.smithi044.stdout: "quincy", 2024-04-17T19:50:01.519 INFO:teuthology.orchestra.run.smithi044.stdout: "reef", 2024-04-17T19:50:01.519 INFO:teuthology.orchestra.run.smithi044.stdout: "squid" 2024-04-17T19:50:01.519 INFO:teuthology.orchestra.run.smithi044.stdout: ], 2024-04-17T19:50:01.519 INFO:teuthology.orchestra.run.smithi044.stdout: "optional": [] 2024-04-17T19:50:01.519 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T19:50:01.519 INFO:teuthology.orchestra.run.smithi044.stdout: "mons": [ 2024-04-17T19:50:01.520 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T19:50:01.520 INFO:teuthology.orchestra.run.smithi044.stdout: "rank": 0, 2024-04-17T19:50:01.520 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "a", 2024-04-17T19:50:01.520 INFO:teuthology.orchestra.run.smithi044.stdout: "public_addrs": { 2024-04-17T19:50:01.520 INFO:teuthology.orchestra.run.smithi044.stdout: "addrvec": [ 2024-04-17T19:50:01.520 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T19:50:01.520 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "v2", 2024-04-17T19:50:01.520 INFO:teuthology.orchestra.run.smithi044.stdout: "addr": "172.21.15.44:3300", 2024-04-17T19:50:01.520 INFO:teuthology.orchestra.run.smithi044.stdout: "nonce": 0 2024-04-17T19:50:01.520 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T19:50:01.520 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T19:50:01.520 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "v1", 2024-04-17T19:50:01.520 INFO:teuthology.orchestra.run.smithi044.stdout: "addr": "172.21.15.44:6789", 2024-04-17T19:50:01.521 INFO:teuthology.orchestra.run.smithi044.stdout: "nonce": 0 2024-04-17T19:50:01.521 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T19:50:01.521 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T19:50:01.521 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T19:50:01.521 INFO:teuthology.orchestra.run.smithi044.stdout: "addr": "172.21.15.44:6789/0", 2024-04-17T19:50:01.521 INFO:teuthology.orchestra.run.smithi044.stdout: "public_addr": "172.21.15.44:6789/0", 2024-04-17T19:50:01.521 INFO:teuthology.orchestra.run.smithi044.stdout: "priority": 0, 2024-04-17T19:50:01.521 INFO:teuthology.orchestra.run.smithi044.stdout: "weight": 0, 2024-04-17T19:50:01.521 INFO:teuthology.orchestra.run.smithi044.stdout: "crush_location": "{}" 2024-04-17T19:50:01.521 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T19:50:01.521 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T19:50:01.521 INFO:teuthology.orchestra.run.smithi044.stdout: "rank": 1, 2024-04-17T19:50:01.522 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "b", 2024-04-17T19:50:01.522 INFO:teuthology.orchestra.run.smithi044.stdout: "public_addrs": { 2024-04-17T19:50:01.522 INFO:teuthology.orchestra.run.smithi044.stdout: "addrvec": [ 2024-04-17T19:50:01.522 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T19:50:01.522 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "v2", 2024-04-17T19:50:01.522 INFO:teuthology.orchestra.run.smithi044.stdout: "addr": "172.21.15.62:3300", 2024-04-17T19:50:01.522 INFO:teuthology.orchestra.run.smithi044.stdout: "nonce": 0 2024-04-17T19:50:01.522 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T19:50:01.522 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T19:50:01.522 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "v1", 2024-04-17T19:50:01.522 INFO:teuthology.orchestra.run.smithi044.stdout: "addr": "172.21.15.62:6789", 2024-04-17T19:50:01.522 INFO:teuthology.orchestra.run.smithi044.stdout: "nonce": 0 2024-04-17T19:50:01.523 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T19:50:01.523 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T19:50:01.523 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T19:50:01.523 INFO:teuthology.orchestra.run.smithi044.stdout: "addr": "172.21.15.62:6789/0", 2024-04-17T19:50:01.523 INFO:teuthology.orchestra.run.smithi044.stdout: "public_addr": "172.21.15.62:6789/0", 2024-04-17T19:50:01.523 INFO:teuthology.orchestra.run.smithi044.stdout: "priority": 0, 2024-04-17T19:50:01.523 INFO:teuthology.orchestra.run.smithi044.stdout: "weight": 0, 2024-04-17T19:50:01.523 INFO:teuthology.orchestra.run.smithi044.stdout: "crush_location": "{}" 2024-04-17T19:50:01.523 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T19:50:01.523 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T19:50:01.523 INFO:teuthology.orchestra.run.smithi044.stdout: "rank": 2, 2024-04-17T19:50:01.523 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "c", 2024-04-17T19:50:01.523 INFO:teuthology.orchestra.run.smithi044.stdout: "public_addrs": { 2024-04-17T19:50:01.523 INFO:teuthology.orchestra.run.smithi044.stdout: "addrvec": [ 2024-04-17T19:50:01.524 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T19:50:01.524 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "v2", 2024-04-17T19:50:01.524 INFO:teuthology.orchestra.run.smithi044.stdout: "addr": "172.21.15.62:3301", 2024-04-17T19:50:01.524 INFO:teuthology.orchestra.run.smithi044.stdout: "nonce": 0 2024-04-17T19:50:01.524 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T19:50:01.524 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T19:50:01.524 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "v1", 2024-04-17T19:50:01.524 INFO:teuthology.orchestra.run.smithi044.stdout: "addr": "172.21.15.62:6790", 2024-04-17T19:50:01.524 INFO:teuthology.orchestra.run.smithi044.stdout: "nonce": 0 2024-04-17T19:50:01.524 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T19:50:01.524 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T19:50:01.524 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T19:50:01.524 INFO:teuthology.orchestra.run.smithi044.stdout: "addr": "172.21.15.62:6790/0", 2024-04-17T19:50:01.524 INFO:teuthology.orchestra.run.smithi044.stdout: "public_addr": "172.21.15.62:6790/0", 2024-04-17T19:50:01.525 INFO:teuthology.orchestra.run.smithi044.stdout: "priority": 0, 2024-04-17T19:50:01.525 INFO:teuthology.orchestra.run.smithi044.stdout: "weight": 0, 2024-04-17T19:50:01.525 INFO:teuthology.orchestra.run.smithi044.stdout: "crush_location": "{}" 2024-04-17T19:50:01.525 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T19:50:01.525 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T19:50:01.525 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T19:50:01.525 INFO:teuthology.orchestra.run.smithi044.stdout: "feature_map": { 2024-04-17T19:50:01.525 INFO:teuthology.orchestra.run.smithi044.stdout: "mon": [ 2024-04-17T19:50:01.525 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T19:50:01.525 INFO:teuthology.orchestra.run.smithi044.stdout: "features": "0x3f03cffffffdffff", 2024-04-17T19:50:01.525 INFO:teuthology.orchestra.run.smithi044.stdout: "release": "luminous", 2024-04-17T19:50:01.525 INFO:teuthology.orchestra.run.smithi044.stdout: "num": 1 2024-04-17T19:50:01.525 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T19:50:01.525 INFO:teuthology.orchestra.run.smithi044.stdout: ], 2024-04-17T19:50:01.525 INFO:teuthology.orchestra.run.smithi044.stdout: "client": [ 2024-04-17T19:50:01.526 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T19:50:01.526 INFO:teuthology.orchestra.run.smithi044.stdout: "features": "0x3f03cffffffdffff", 2024-04-17T19:50:01.526 INFO:teuthology.orchestra.run.smithi044.stdout: "release": "luminous", 2024-04-17T19:50:01.526 INFO:teuthology.orchestra.run.smithi044.stdout: "num": 1 2024-04-17T19:50:01.526 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T19:50:01.526 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T19:50:01.526 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T19:50:01.526 INFO:teuthology.orchestra.run.smithi044.stdout: "stretch_mode": false 2024-04-17T19:50:01.526 INFO:teuthology.orchestra.run.smithi044.stdout:} 2024-04-17T19:50:01.527 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:01.523+0000 7f9443800640 1 -- 172.21.15.44:0/253445355 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f9418068380 msgr2=0x7f941806a890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:50:01.527 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:01.523+0000 7f9443800640 1 --2- 172.21.15.44:0/253445355 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f9418068380 0x7f941806a890 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f943c1514b0 tx=0x7f9434009040 comp rx=0 tx=0).stop 2024-04-17T19:50:01.527 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:01.523+0000 7f9443800640 1 -- 172.21.15.44:0/253445355 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f943c073f10 msgr2=0x7f943c1f56f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:50:01.527 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:01.523+0000 7f9443800640 1 --2- 172.21.15.44:0/253445355 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f943c073f10 0x7f943c1f56f0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f942c00c3a0 tx=0x7f942c00c860 comp rx=0 tx=0).stop 2024-04-17T19:50:01.527 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:01.523+0000 7f9441800640 1 -- 172.21.15.44:0/253445355 reap_dead start 2024-04-17T19:50:01.527 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:01.523+0000 7f9441800640 1 -- 172.21.15.44:0/253445355 reap_dead start 2024-04-17T19:50:01.527 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:01.523+0000 7f9443800640 1 -- 172.21.15.44:0/253445355 shutdown_connections 2024-04-17T19:50:01.527 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:01.523+0000 7f9443800640 1 -- 172.21.15.44:0/253445355 >> 172.21.15.44:0/253445355 conn(0x7f943c06c380 msgr2=0x7f943c156350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:50:01.527 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:01.523+0000 7f9443800640 1 -- 172.21.15.44:0/253445355 shutdown_connections 2024-04-17T19:50:01.527 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:01.523+0000 7f9443800640 1 -- 172.21.15.44:0/253445355 wait complete. 2024-04-17T19:50:01.534 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-04-17T19:50:01.534 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon c 2024-04-17T19:50:01.534 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2024-04-17T19:50:01.687 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:01.695+0000 7f5635c00640 1 Processor -- start 2024-04-17T19:50:01.687 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:01.695+0000 7f5635c00640 1 -- start start 2024-04-17T19:50:01.689 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:01.699+0000 7f5635c00640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f5630073f10 0x7f56301588d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:50:01.690 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:01.699+0000 7f5635c00640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f5630152310 0x7f563015be50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:50:01.690 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:01.699+0000 7f5635c00640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5630157e50 con 0x7f56300c7530 2024-04-17T19:50:01.690 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:01.699+0000 7f5635c00640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 -- 0x7f5630158e10 con 0x7f5630152310 2024-04-17T19:50:01.690 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:01.699+0000 7f5635c00640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7f563015c390 con 0x7f5630073f10 2024-04-17T19:50:01.690 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:01.699+0000 7f562ea00640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f5630073f10 0x7f56301588d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:50:01.690 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:01.699+0000 7f562e000640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f5630152310 0x7f563015be50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:50:01.690 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:01.699+0000 7f562f400640 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f56300c7530 0x7f56300c6060 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.44:33928/0 (socket says 172.21.15.44:33928) 2024-04-17T19:50:01.690 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:01.699+0000 7f562f400640 1 -- 172.21.15.44:0/3348677145 learned_addr learned my addr 172.21.15.44:0/3348677145 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-04-17T19:50:01.690 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:01.699+0000 7f562ea00640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f5630073f10 0x7f56301588d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3301/0 says I am v2:172.21.15.44:41054/0 (socket says 172.21.15.44:41054) 2024-04-17T19:50:01.691 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:01.699+0000 7f562e000640 1 -- 172.21.15.44:0/3348677145 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f5630073f10 msgr2=0x7f56301588d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T19:50:01.691 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:01.699+0000 7f562e000640 1 --2- 172.21.15.44:0/3348677145 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f5630073f10 0x7f56301588d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:50:01.691 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:01.699+0000 7f562e000640 1 -- 172.21.15.44:0/3348677145 >> v1:172.21.15.62:6789/0 conn(0x7f56300c7530 legacy=0x7f56300c6060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:50:01.691 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:01.699+0000 7f562e000640 1 -- 172.21.15.44:0/3348677145 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f56300c4310 con 0x7f5630152310 2024-04-17T19:50:01.693 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:01.703+0000 7f562e000640 1 --2- 172.21.15.44:0/3348677145 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5630152310 0x7f563015be50 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f561c0097c0 tx=0x7f561c01c4a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9425729a7c7a93aa server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:50:01.694 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:01.703+0000 7f562d600640 1 -- 172.21.15.44:0/3348677145 <== mon.1 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f561c0b0070 con 0x7f5630152310 2024-04-17T19:50:01.694 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:01.703+0000 7f562d600640 1 -- 172.21.15.44:0/3348677145 <== mon.1 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f561c0ab600 con 0x7f5630152310 2024-04-17T19:50:01.694 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:01.703+0000 7f562d600640 1 -- 172.21.15.44:0/3348677145 <== mon.1 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f561c0ab9d0 con 0x7f5630152310 2024-04-17T19:50:01.695 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:01.703+0000 7f5635c00640 1 -- 172.21.15.44:0/3348677145 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5630152310 msgr2=0x7f563015be50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:50:01.695 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:01.703+0000 7f5635c00640 1 --2- 172.21.15.44:0/3348677145 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5630152310 0x7f563015be50 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f561c0097c0 tx=0x7f561c01c4a0 comp rx=0 tx=0).stop 2024-04-17T19:50:01.695 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:01.703+0000 7f5635c00640 1 -- 172.21.15.44:0/3348677145 shutdown_connections 2024-04-17T19:50:01.695 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:01.703+0000 7f5635c00640 1 --2- 172.21.15.44:0/3348677145 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5630152310 0x7f563015be50 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:50:01.695 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:01.703+0000 7f5635c00640 1 --2- 172.21.15.44:0/3348677145 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f5630073f10 0x7f56301588d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:50:01.695 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:01.703+0000 7f5635c00640 1 -- 172.21.15.44:0/3348677145 >> 172.21.15.44:0/3348677145 conn(0x7f563006c380 msgr2=0x7f5630070080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:50:01.695 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:01.703+0000 7f5635c00640 1 -- 172.21.15.44:0/3348677145 shutdown_connections 2024-04-17T19:50:01.695 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:01.703+0000 7f5635c00640 1 -- 172.21.15.44:0/3348677145 wait complete. 2024-04-17T19:50:01.697 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:01.707+0000 7f5635c00640 1 Processor -- start 2024-04-17T19:50:01.697 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:01.707+0000 7f5635c00640 1 -- start start 2024-04-17T19:50:01.699 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:01.707+0000 7f5635c00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5630073f10 0x7f56301f8ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:50:01.700 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:01.707+0000 7f5635c00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f56300c7530 0x7f56301f5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:50:01.700 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:01.707+0000 7f5635c00640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f5630152310 0x7f563014c9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:50:01.700 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:01.707+0000 7f5635c00640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f56300c7d50 con 0x7f56300c7530 2024-04-17T19:50:01.700 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:01.707+0000 7f5635c00640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f56301583b0 con 0x7f5630073f10 2024-04-17T19:50:01.700 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:01.707+0000 7f5635c00640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7f56300c3ed0 con 0x7f5630152310 2024-04-17T19:50:01.700 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:01.707+0000 7f562e000640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f56300c7530 0x7f56301f5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:50:01.700 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:01.707+0000 7f562e000640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f56300c7530 0x7f56301f5870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:45860/0 (socket says 172.21.15.44:45860) 2024-04-17T19:50:01.700 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:01.707+0000 7f562e000640 1 -- 172.21.15.44:0/3213482711 learned_addr learned my addr 172.21.15.44:0/3213482711 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-04-17T19:50:01.700 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:01.707+0000 7f562ea00640 1 --2- 172.21.15.44:0/3213482711 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5630073f10 0x7f56301f8ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:50:01.700 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:01.707+0000 7f562f400640 1 --2- 172.21.15.44:0/3213482711 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f5630152310 0x7f563014c9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:50:01.700 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:01.707+0000 7f562e000640 1 -- 172.21.15.44:0/3213482711 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f5630152310 msgr2=0x7f563014c9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:50:01.700 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:01.707+0000 7f562e000640 1 --2- 172.21.15.44:0/3213482711 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f5630152310 0x7f563014c9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:50:01.700 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:01.707+0000 7f562e000640 1 -- 172.21.15.44:0/3213482711 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5630073f10 msgr2=0x7f56301f8ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:50:01.700 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:01.707+0000 7f562e000640 1 --2- 172.21.15.44:0/3213482711 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5630073f10 0x7f56301f8ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:50:01.701 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:01.707+0000 7f562e000640 1 -- 172.21.15.44:0/3213482711 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f56301f8440 con 0x7f56300c7530 2024-04-17T19:50:01.701 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:01.707+0000 7f562f400640 1 --2- 172.21.15.44:0/3213482711 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f5630152310 0x7f563014c9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-17T19:50:01.701 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:01.711+0000 7f562e000640 1 --2- 172.21.15.44:0/3213482711 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f56300c7530 0x7f56301f5870 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f561c01a0d0 tx=0x7f561c019240 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:50:01.702 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:01.711+0000 7f5626a00640 1 -- 172.21.15.44:0/3213482711 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f561c0b0040 con 0x7f56300c7530 2024-04-17T19:50:01.702 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:01.711+0000 7f5626a00640 1 -- 172.21.15.44:0/3213482711 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f561c0bb070 con 0x7f56300c7530 2024-04-17T19:50:01.702 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:01.711+0000 7f5626a00640 1 -- 172.21.15.44:0/3213482711 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f561c0b6630 con 0x7f56300c7530 2024-04-17T19:50:01.702 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:01.711+0000 7f5635c00640 1 -- 172.21.15.44:0/3213482711 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5630151be0 con 0x7f56300c7530 2024-04-17T19:50:01.702 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:01.711+0000 7f5635c00640 1 -- 172.21.15.44:0/3213482711 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f56301f89c0 con 0x7f56300c7530 2024-04-17T19:50:01.702 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:01.711+0000 7f5635c00640 1 --2- 172.21.15.44:0/3213482711 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f5630146570 0x7f563015b3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:50:01.702 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:01.711+0000 7f5635c00640 1 -- 172.21.15.44:0/3213482711 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7f563015c1c0 con 0x7f5630146570 2024-04-17T19:50:01.702 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:01.711+0000 7f562ea00640 1 --2- 172.21.15.44:0/3213482711 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f5630146570 0x7f563015b3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:50:01.703 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:01.711+0000 7f562ea00640 1 -- 172.21.15.44:0/3213482711 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f563004ff10 con 0x7f5630146570 2024-04-17T19:50:01.703 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:01.711+0000 7f5626a00640 1 -- 172.21.15.44:0/3213482711 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f561c0b3070 con 0x7f56300c7530 2024-04-17T19:50:01.703 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:01.711+0000 7f562ea00640 1 --2- 172.21.15.44:0/3213482711 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f5630146570 0x7f563015b3f0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f5620011900 tx=0x7f5620011dc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:50:01.703 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:01.711+0000 7f5626a00640 1 --2- 172.21.15.44:0/3213482711 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f56100683b0 0x7f561006a8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:50:01.704 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:01.711+0000 7f5626a00640 1 -- 172.21.15.44:0/3213482711 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6619+0+0 (secure 0 0 0) 0x7f561c1209a0 con 0x7f56300c7530 2024-04-17T19:50:01.704 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:01.711+0000 7f5626a00640 1 -- 172.21.15.44:0/3213482711 <== mon.2 v2:172.21.15.62:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5620019070 con 0x7f5630146570 2024-04-17T19:50:01.704 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:01.715+0000 7f562f400640 1 --2- 172.21.15.44:0/3213482711 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f56100683b0 0x7f561006a8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:50:01.704 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:01.715+0000 7f5626a00640 1 -- 172.21.15.44:0/3213482711 <== mon.2 v2:172.21.15.62:3301/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f5620004300 con 0x7f5630146570 2024-04-17T19:50:01.704 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:01.715+0000 7f5626a00640 1 -- 172.21.15.44:0/3213482711 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f5630146570 msgr2=0x7f563015b3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:50:01.705 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:01.715+0000 7f5626a00640 1 --2- 172.21.15.44:0/3213482711 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f5630146570 0x7f563015b3f0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f5620011900 tx=0x7f5620011dc0 comp rx=0 tx=0).stop 2024-04-17T19:50:01.705 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:01.715+0000 7f5626a00640 1 -- 172.21.15.44:0/3213482711 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f5630146570 msgr2=0x7f563015b3f0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-04-17T19:50:01.705 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:01.715+0000 7f5626a00640 1 --2- 172.21.15.44:0/3213482711 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f5630146570 0x7f563015b3f0 secure :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f5620011900 tx=0x7f5620011dc0 comp rx=0 tx=0).stop 2024-04-17T19:50:01.705 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:01.715+0000 7f562f400640 1 --2- 172.21.15.44:0/3213482711 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f56100683b0 0x7f561006a8c0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f5630147990 tx=0x7f5628009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:50:01.710 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:01.719+0000 7f5635c00640 1 --2- 172.21.15.44:0/3213482711 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f5630146980 0x7f563015b930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:50:01.710 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:01.719+0000 7f5635c00640 1 -- 172.21.15.44:0/3213482711 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7f563014b5b0 con 0x7f5630146980 2024-04-17T19:50:01.710 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:01.719+0000 7f562ea00640 1 --2- 172.21.15.44:0/3213482711 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f5630146980 0x7f563015b930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:50:01.711 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:01.719+0000 7f562ea00640 1 -- 172.21.15.44:0/3213482711 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f563014cf30 con 0x7f5630146980 2024-04-17T19:50:01.711 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:01.723+0000 7f562ea00640 1 --2- 172.21.15.44:0/3213482711 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f5630146980 0x7f563015b930 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f5620011900 tx=0x7f56200046d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:50:01.712 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:01.723+0000 7f5626a00640 1 -- 172.21.15.44:0/3213482711 <== mon.2 v2:172.21.15.62:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5620019040 con 0x7f5630146980 2024-04-17T19:50:01.713 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:01.723+0000 7f5626a00640 1 -- 172.21.15.44:0/3213482711 <== mon.2 v2:172.21.15.62:3301/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4546 (secure 0 0 0) 0x7f5620003c20 con 0x7f5630146980 2024-04-17T19:50:01.713 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:01.723+0000 7f5626a00640 1 -- 172.21.15.44:0/3213482711 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f5630146980 msgr2=0x7f563015b930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:50:01.713 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:01.723+0000 7f5626a00640 1 --2- 172.21.15.44:0/3213482711 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f5630146980 0x7f563015b930 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f5620011900 tx=0x7f56200046d0 comp rx=0 tx=0).stop 2024-04-17T19:50:01.713 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:01.723+0000 7f5626a00640 1 -- 172.21.15.44:0/3213482711 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f5630146980 msgr2=0x7f563015b930 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-04-17T19:50:01.713 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:01.723+0000 7f5626a00640 1 --2- 172.21.15.44:0/3213482711 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f5630146980 0x7f563015b930 secure :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f5620011900 tx=0x7f56200046d0 comp rx=0 tx=0).stop 2024-04-17T19:50:01.713 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2024-04-17T19:50:01.713 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "c", 2024-04-17T19:50:01.713 INFO:teuthology.orchestra.run.smithi044.stdout: "rank": 2, 2024-04-17T19:50:01.714 INFO:teuthology.orchestra.run.smithi044.stdout: "state": "peon", 2024-04-17T19:50:01.714 INFO:teuthology.orchestra.run.smithi044.stdout: "election_epoch": 20, 2024-04-17T19:50:01.714 INFO:teuthology.orchestra.run.smithi044.stdout: "uptime": 86167, 2024-04-17T19:50:01.714 INFO:teuthology.orchestra.run.smithi044.stdout: "quorum": [ 2024-04-17T19:50:01.714 INFO:teuthology.orchestra.run.smithi044.stdout: 0, 2024-04-17T19:50:01.714 INFO:teuthology.orchestra.run.smithi044.stdout: 1, 2024-04-17T19:50:01.714 INFO:teuthology.orchestra.run.smithi044.stdout: 2 2024-04-17T19:50:01.714 INFO:teuthology.orchestra.run.smithi044.stdout: ], 2024-04-17T19:50:01.714 INFO:teuthology.orchestra.run.smithi044.stdout: "quorum_age": 0, 2024-04-17T19:50:01.714 INFO:teuthology.orchestra.run.smithi044.stdout: "features": { 2024-04-17T19:50:01.714 INFO:teuthology.orchestra.run.smithi044.stdout: "required_con": "2450521708007866372", 2024-04-17T19:50:01.714 INFO:teuthology.orchestra.run.smithi044.stdout: "required_mon": [ 2024-04-17T19:50:01.714 INFO:teuthology.orchestra.run.smithi044.stdout: "kraken", 2024-04-17T19:50:01.714 INFO:teuthology.orchestra.run.smithi044.stdout: "luminous", 2024-04-17T19:50:01.714 INFO:teuthology.orchestra.run.smithi044.stdout: "mimic", 2024-04-17T19:50:01.715 INFO:teuthology.orchestra.run.smithi044.stdout: "osdmap-prune", 2024-04-17T19:50:01.715 INFO:teuthology.orchestra.run.smithi044.stdout: "nautilus", 2024-04-17T19:50:01.715 INFO:teuthology.orchestra.run.smithi044.stdout: "octopus", 2024-04-17T19:50:01.715 INFO:teuthology.orchestra.run.smithi044.stdout: "pacific", 2024-04-17T19:50:01.715 INFO:teuthology.orchestra.run.smithi044.stdout: "elector-pinging", 2024-04-17T19:50:01.715 INFO:teuthology.orchestra.run.smithi044.stdout: "quincy", 2024-04-17T19:50:01.715 INFO:teuthology.orchestra.run.smithi044.stdout: "reef", 2024-04-17T19:50:01.715 INFO:teuthology.orchestra.run.smithi044.stdout: "squid" 2024-04-17T19:50:01.715 INFO:teuthology.orchestra.run.smithi044.stdout: ], 2024-04-17T19:50:01.715 INFO:teuthology.orchestra.run.smithi044.stdout: "quorum_con": "4540701547738038271", 2024-04-17T19:50:01.715 INFO:teuthology.orchestra.run.smithi044.stdout: "quorum_mon": [ 2024-04-17T19:50:01.715 INFO:teuthology.orchestra.run.smithi044.stdout: "kraken", 2024-04-17T19:50:01.715 INFO:teuthology.orchestra.run.smithi044.stdout: "luminous", 2024-04-17T19:50:01.715 INFO:teuthology.orchestra.run.smithi044.stdout: "mimic", 2024-04-17T19:50:01.715 INFO:teuthology.orchestra.run.smithi044.stdout: "osdmap-prune", 2024-04-17T19:50:01.715 INFO:teuthology.orchestra.run.smithi044.stdout: "nautilus", 2024-04-17T19:50:01.716 INFO:teuthology.orchestra.run.smithi044.stdout: "octopus", 2024-04-17T19:50:01.716 INFO:teuthology.orchestra.run.smithi044.stdout: "pacific", 2024-04-17T19:50:01.716 INFO:teuthology.orchestra.run.smithi044.stdout: "elector-pinging", 2024-04-17T19:50:01.716 INFO:teuthology.orchestra.run.smithi044.stdout: "quincy", 2024-04-17T19:50:01.716 INFO:teuthology.orchestra.run.smithi044.stdout: "reef", 2024-04-17T19:50:01.716 INFO:teuthology.orchestra.run.smithi044.stdout: "squid" 2024-04-17T19:50:01.716 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T19:50:01.716 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T19:50:01.716 INFO:teuthology.orchestra.run.smithi044.stdout: "outside_quorum": [], 2024-04-17T19:50:01.716 INFO:teuthology.orchestra.run.smithi044.stdout: "extra_probe_peers": [], 2024-04-17T19:50:01.716 INFO:teuthology.orchestra.run.smithi044.stdout: "sync_provider": [], 2024-04-17T19:50:01.716 INFO:teuthology.orchestra.run.smithi044.stdout: "monmap": { 2024-04-17T19:50:01.716 INFO:teuthology.orchestra.run.smithi044.stdout: "epoch": 1, 2024-04-17T19:50:01.717 INFO:teuthology.orchestra.run.smithi044.stdout: "fsid": "703f77ca-79c6-4a66-b576-62c526cb1021", 2024-04-17T19:50:01.717 INFO:teuthology.orchestra.run.smithi044.stdout: "modified": "2024-04-17T19:45:55.379749Z", 2024-04-17T19:50:01.717 INFO:teuthology.orchestra.run.smithi044.stdout: "created": "2024-04-17T19:45:55.379749Z", 2024-04-17T19:50:01.717 INFO:teuthology.orchestra.run.smithi044.stdout: "min_mon_release": 19, 2024-04-17T19:50:01.717 INFO:teuthology.orchestra.run.smithi044.stdout: "min_mon_release_name": "squid", 2024-04-17T19:50:01.717 INFO:teuthology.orchestra.run.smithi044.stdout: "election_strategy": 1, 2024-04-17T19:50:01.717 INFO:teuthology.orchestra.run.smithi044.stdout: "disallowed_leaders: ": "", 2024-04-17T19:50:01.717 INFO:teuthology.orchestra.run.smithi044.stdout: "stretch_mode": false, 2024-04-17T19:50:01.717 INFO:teuthology.orchestra.run.smithi044.stdout: "tiebreaker_mon": "", 2024-04-17T19:50:01.717 INFO:teuthology.orchestra.run.smithi044.stdout: "removed_ranks: ": "", 2024-04-17T19:50:01.717 INFO:teuthology.orchestra.run.smithi044.stdout: "features": { 2024-04-17T19:50:01.717 INFO:teuthology.orchestra.run.smithi044.stdout: "persistent": [ 2024-04-17T19:50:01.717 INFO:teuthology.orchestra.run.smithi044.stdout: "kraken", 2024-04-17T19:50:01.717 INFO:teuthology.orchestra.run.smithi044.stdout: "luminous", 2024-04-17T19:50:01.718 INFO:teuthology.orchestra.run.smithi044.stdout: "mimic", 2024-04-17T19:50:01.718 INFO:teuthology.orchestra.run.smithi044.stdout: "osdmap-prune", 2024-04-17T19:50:01.718 INFO:teuthology.orchestra.run.smithi044.stdout: "nautilus", 2024-04-17T19:50:01.718 INFO:teuthology.orchestra.run.smithi044.stdout: "octopus", 2024-04-17T19:50:01.718 INFO:teuthology.orchestra.run.smithi044.stdout: "pacific", 2024-04-17T19:50:01.718 INFO:teuthology.orchestra.run.smithi044.stdout: "elector-pinging", 2024-04-17T19:50:01.718 INFO:teuthology.orchestra.run.smithi044.stdout: "quincy", 2024-04-17T19:50:01.718 INFO:teuthology.orchestra.run.smithi044.stdout: "reef", 2024-04-17T19:50:01.718 INFO:teuthology.orchestra.run.smithi044.stdout: "squid" 2024-04-17T19:50:01.718 INFO:teuthology.orchestra.run.smithi044.stdout: ], 2024-04-17T19:50:01.718 INFO:teuthology.orchestra.run.smithi044.stdout: "optional": [] 2024-04-17T19:50:01.718 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T19:50:01.718 INFO:teuthology.orchestra.run.smithi044.stdout: "mons": [ 2024-04-17T19:50:01.718 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T19:50:01.719 INFO:teuthology.orchestra.run.smithi044.stdout: "rank": 0, 2024-04-17T19:50:01.719 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "a", 2024-04-17T19:50:01.719 INFO:teuthology.orchestra.run.smithi044.stdout: "public_addrs": { 2024-04-17T19:50:01.719 INFO:teuthology.orchestra.run.smithi044.stdout: "addrvec": [ 2024-04-17T19:50:01.719 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T19:50:01.719 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "v2", 2024-04-17T19:50:01.719 INFO:teuthology.orchestra.run.smithi044.stdout: "addr": "172.21.15.44:3300", 2024-04-17T19:50:01.719 INFO:teuthology.orchestra.run.smithi044.stdout: "nonce": 0 2024-04-17T19:50:01.719 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T19:50:01.719 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T19:50:01.719 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "v1", 2024-04-17T19:50:01.719 INFO:teuthology.orchestra.run.smithi044.stdout: "addr": "172.21.15.44:6789", 2024-04-17T19:50:01.719 INFO:teuthology.orchestra.run.smithi044.stdout: "nonce": 0 2024-04-17T19:50:01.719 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T19:50:01.719 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T19:50:01.719 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T19:50:01.720 INFO:teuthology.orchestra.run.smithi044.stdout: "addr": "172.21.15.44:6789/0", 2024-04-17T19:50:01.720 INFO:teuthology.orchestra.run.smithi044.stdout: "public_addr": "172.21.15.44:6789/0", 2024-04-17T19:50:01.720 INFO:teuthology.orchestra.run.smithi044.stdout: "priority": 0, 2024-04-17T19:50:01.720 INFO:teuthology.orchestra.run.smithi044.stdout: "weight": 0, 2024-04-17T19:50:01.720 INFO:teuthology.orchestra.run.smithi044.stdout: "crush_location": "{}" 2024-04-17T19:50:01.720 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T19:50:01.720 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T19:50:01.720 INFO:teuthology.orchestra.run.smithi044.stdout: "rank": 1, 2024-04-17T19:50:01.720 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "b", 2024-04-17T19:50:01.720 INFO:teuthology.orchestra.run.smithi044.stdout: "public_addrs": { 2024-04-17T19:50:01.720 INFO:teuthology.orchestra.run.smithi044.stdout: "addrvec": [ 2024-04-17T19:50:01.720 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T19:50:01.720 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "v2", 2024-04-17T19:50:01.720 INFO:teuthology.orchestra.run.smithi044.stdout: "addr": "172.21.15.62:3300", 2024-04-17T19:50:01.720 INFO:teuthology.orchestra.run.smithi044.stdout: "nonce": 0 2024-04-17T19:50:01.721 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T19:50:01.721 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T19:50:01.721 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "v1", 2024-04-17T19:50:01.721 INFO:teuthology.orchestra.run.smithi044.stdout: "addr": "172.21.15.62:6789", 2024-04-17T19:50:01.721 INFO:teuthology.orchestra.run.smithi044.stdout: "nonce": 0 2024-04-17T19:50:01.721 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T19:50:01.721 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T19:50:01.721 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T19:50:01.721 INFO:teuthology.orchestra.run.smithi044.stdout: "addr": "172.21.15.62:6789/0", 2024-04-17T19:50:01.721 INFO:teuthology.orchestra.run.smithi044.stdout: "public_addr": "172.21.15.62:6789/0", 2024-04-17T19:50:01.721 INFO:teuthology.orchestra.run.smithi044.stdout: "priority": 0, 2024-04-17T19:50:01.721 INFO:teuthology.orchestra.run.smithi044.stdout: "weight": 0, 2024-04-17T19:50:01.721 INFO:teuthology.orchestra.run.smithi044.stdout: "crush_location": "{}" 2024-04-17T19:50:01.721 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T19:50:01.722 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T19:50:01.722 INFO:teuthology.orchestra.run.smithi044.stdout: "rank": 2, 2024-04-17T19:50:01.722 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "c", 2024-04-17T19:50:01.722 INFO:teuthology.orchestra.run.smithi044.stdout: "public_addrs": { 2024-04-17T19:50:01.722 INFO:teuthology.orchestra.run.smithi044.stdout: "addrvec": [ 2024-04-17T19:50:01.722 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T19:50:01.722 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "v2", 2024-04-17T19:50:01.722 INFO:teuthology.orchestra.run.smithi044.stdout: "addr": "172.21.15.62:3301", 2024-04-17T19:50:01.722 INFO:teuthology.orchestra.run.smithi044.stdout: "nonce": 0 2024-04-17T19:50:01.722 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T19:50:01.722 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T19:50:01.722 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "v1", 2024-04-17T19:50:01.722 INFO:teuthology.orchestra.run.smithi044.stdout: "addr": "172.21.15.62:6790", 2024-04-17T19:50:01.722 INFO:teuthology.orchestra.run.smithi044.stdout: "nonce": 0 2024-04-17T19:50:01.722 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T19:50:01.723 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T19:50:01.723 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T19:50:01.723 INFO:teuthology.orchestra.run.smithi044.stdout: "addr": "172.21.15.62:6790/0", 2024-04-17T19:50:01.723 INFO:teuthology.orchestra.run.smithi044.stdout: "public_addr": "172.21.15.62:6790/0", 2024-04-17T19:50:01.723 INFO:teuthology.orchestra.run.smithi044.stdout: "priority": 0, 2024-04-17T19:50:01.723 INFO:teuthology.orchestra.run.smithi044.stdout: "weight": 0, 2024-04-17T19:50:01.723 INFO:teuthology.orchestra.run.smithi044.stdout: "crush_location": "{}" 2024-04-17T19:50:01.723 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T19:50:01.723 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T19:50:01.723 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T19:50:01.723 INFO:teuthology.orchestra.run.smithi044.stdout: "feature_map": { 2024-04-17T19:50:01.723 INFO:teuthology.orchestra.run.smithi044.stdout: "mon": [ 2024-04-17T19:50:01.723 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T19:50:01.723 INFO:teuthology.orchestra.run.smithi044.stdout: "features": "0x3f03cffffffdffff", 2024-04-17T19:50:01.723 INFO:teuthology.orchestra.run.smithi044.stdout: "release": "luminous", 2024-04-17T19:50:01.723 INFO:teuthology.orchestra.run.smithi044.stdout: "num": 1 2024-04-17T19:50:01.724 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T19:50:01.724 INFO:teuthology.orchestra.run.smithi044.stdout: ], 2024-04-17T19:50:01.724 INFO:teuthology.orchestra.run.smithi044.stdout: "client": [ 2024-04-17T19:50:01.724 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T19:50:01.724 INFO:teuthology.orchestra.run.smithi044.stdout: "features": "0x3f03cffffffdffff", 2024-04-17T19:50:01.724 INFO:teuthology.orchestra.run.smithi044.stdout: "release": "luminous", 2024-04-17T19:50:01.724 INFO:teuthology.orchestra.run.smithi044.stdout: "num": 1 2024-04-17T19:50:01.724 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T19:50:01.724 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T19:50:01.724 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T19:50:01.724 INFO:teuthology.orchestra.run.smithi044.stdout: "stretch_mode": false 2024-04-17T19:50:01.724 INFO:teuthology.orchestra.run.smithi044.stdout:} 2024-04-17T19:50:01.725 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:01.723+0000 7f5635c00640 1 -- 172.21.15.44:0/3213482711 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f56100683b0 msgr2=0x7f561006a8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:50:01.725 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:01.723+0000 7f5635c00640 1 --2- 172.21.15.44:0/3213482711 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f56100683b0 0x7f561006a8c0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f5630147990 tx=0x7f5628009040 comp rx=0 tx=0).stop 2024-04-17T19:50:01.725 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:01.723+0000 7f5635c00640 1 -- 172.21.15.44:0/3213482711 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f56300c7530 msgr2=0x7f56301f5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:50:01.725 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:01.723+0000 7f5635c00640 1 --2- 172.21.15.44:0/3213482711 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f56300c7530 0x7f56301f5870 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f561c01a0d0 tx=0x7f561c019240 comp rx=0 tx=0).stop 2024-04-17T19:50:01.725 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:01.723+0000 7f562f400640 1 -- 172.21.15.44:0/3213482711 reap_dead start 2024-04-17T19:50:01.725 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:01.723+0000 7f562f400640 1 -- 172.21.15.44:0/3213482711 reap_dead start 2024-04-17T19:50:01.725 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:01.723+0000 7f5635c00640 1 -- 172.21.15.44:0/3213482711 shutdown_connections 2024-04-17T19:50:01.726 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:01.723+0000 7f5635c00640 1 -- 172.21.15.44:0/3213482711 >> 172.21.15.44:0/3213482711 conn(0x7f563006c380 msgr2=0x7f56300cb2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:50:01.726 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:01.723+0000 7f5635c00640 1 -- 172.21.15.44:0/3213482711 shutdown_connections 2024-04-17T19:50:01.726 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:01.723+0000 7f5635c00640 1 -- 172.21.15.44:0/3213482711 wait complete. 2024-04-17T19:50:01.732 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-04-17T19:50:01.732 INFO:tasks.mon_thrash.mon_thrasher:triggering scrub 2024-04-17T19:50:01.733 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mon scrub 2024-04-17T19:50:01.884 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:01.895+0000 7f147d400640 1 Processor -- start 2024-04-17T19:50:01.885 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:01.895+0000 7f147d400640 1 -- start start 2024-04-17T19:50:01.887 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:01.895+0000 7f147d400640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f14780c9130 0x7f147806bd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:50:01.887 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:01.895+0000 7f147d400640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f1478071c90 0x7f147806c2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:50:01.887 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:01.895+0000 7f147d400640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f14780c8f40 con 0x7f14780c6800 2024-04-17T19:50:01.887 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:01.895+0000 7f147d400640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 -- 0x7f14780c50b0 con 0x7f14780c9130 2024-04-17T19:50:01.887 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:01.895+0000 7f147d400640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 -- 0x7f14780c8c60 con 0x7f1478071c90 2024-04-17T19:50:01.887 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:01.895+0000 7f1476800640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f14780c9130 0x7f147806bd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:50:01.887 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:01.895+0000 7f1476800640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f14780c9130 0x7f147806bd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:45874/0 (socket says 172.21.15.44:45874) 2024-04-17T19:50:01.887 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:01.895+0000 7f1476800640 1 -- 172.21.15.44:0/2508940724 learned_addr learned my addr 172.21.15.44:0/2508940724 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-04-17T19:50:01.887 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:01.895+0000 7f146fe00640 1 --2- 172.21.15.44:0/2508940724 >> v2:172.21.15.62:3300/0 conn(0x7f1478071c90 0x7f147806c2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:50:01.888 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:01.895+0000 7f1476800640 1 -- 172.21.15.44:0/2508940724 >> v2:172.21.15.62:3300/0 conn(0x7f1478071c90 msgr2=0x7f147806c2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T19:50:01.888 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:01.895+0000 7f1476800640 1 --2- 172.21.15.44:0/2508940724 >> v2:172.21.15.62:3300/0 conn(0x7f1478071c90 0x7f147806c2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:50:01.888 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:01.895+0000 7f1476800640 1 -- 172.21.15.44:0/2508940724 >> v1:172.21.15.62:6789/0 conn(0x7f14780c6800 legacy=0x7f14780c6c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:50:01.888 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:01.895+0000 7f1476800640 1 -- 172.21.15.44:0/2508940724 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f14780c76e0 con 0x7f14780c9130 2024-04-17T19:50:01.890 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:01.899+0000 7f1476800640 1 --2- 172.21.15.44:0/2508940724 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f14780c9130 0x7f147806bd80 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f14780c4890 tx=0x7f146801ed10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=51b2c58398c0bce9 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:50:01.890 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:01.899+0000 7f1475e00640 1 -- 172.21.15.44:0/2508940724 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14680b5070 con 0x7f14780c9130 2024-04-17T19:50:01.890 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:01.899+0000 7f1475e00640 1 -- 172.21.15.44:0/2508940724 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f14680a8a10 con 0x7f14780c9130 2024-04-17T19:50:01.890 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:01.899+0000 7f1475e00640 1 -- 172.21.15.44:0/2508940724 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14680a8de0 con 0x7f14780c9130 2024-04-17T19:50:01.891 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:01.899+0000 7f147d400640 1 -- 172.21.15.44:0/2508940724 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f14780c9130 msgr2=0x7f147806bd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:50:01.891 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:01.899+0000 7f147d400640 1 --2- 172.21.15.44:0/2508940724 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f14780c9130 0x7f147806bd80 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f14780c4890 tx=0x7f146801ed10 comp rx=0 tx=0).stop 2024-04-17T19:50:01.891 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:01.899+0000 7f147d400640 1 -- 172.21.15.44:0/2508940724 shutdown_connections 2024-04-17T19:50:01.891 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:01.899+0000 7f147d400640 1 --2- 172.21.15.44:0/2508940724 >> v2:172.21.15.62:3300/0 conn(0x7f1478071c90 0x7f147806c2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:50:01.891 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:01.899+0000 7f147d400640 1 --2- 172.21.15.44:0/2508940724 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f14780c9130 0x7f147806bd80 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:50:01.891 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:01.899+0000 7f147d400640 1 -- 172.21.15.44:0/2508940724 >> 172.21.15.44:0/2508940724 conn(0x7f1478073bb0 msgr2=0x7f147806ce90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:50:01.892 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:01.899+0000 7f147d400640 1 -- 172.21.15.44:0/2508940724 shutdown_connections 2024-04-17T19:50:01.892 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:01.899+0000 7f147d400640 1 -- 172.21.15.44:0/2508940724 wait complete. 2024-04-17T19:50:01.893 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:01.903+0000 7f147d400640 1 Processor -- start 2024-04-17T19:50:01.893 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:01.903+0000 7f147d400640 1 -- start start 2024-04-17T19:50:01.896 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:01.903+0000 7f147d400640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1478071c90 0x7f14780cc3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:50:01.896 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:01.903+0000 7f147d400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f14780c6800 0x7f14781f5a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:50:01.896 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:01.903+0000 7f147d400640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f14780c9130 0x7f147814d210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:50:01.896 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:01.903+0000 7f147d400640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f1478155ff0 con 0x7f14780c6800 2024-04-17T19:50:01.896 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:01.903+0000 7f147d400640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f14780c7ca0 con 0x7f1478071c90 2024-04-17T19:50:01.896 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:01.903+0000 7f147d400640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7f1478156170 con 0x7f14780c9130 2024-04-17T19:50:01.896 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:01.903+0000 7f146fe00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f14780c6800 0x7f14781f5a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:50:01.896 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:01.903+0000 7f146fe00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f14780c6800 0x7f14781f5a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:45880/0 (socket says 172.21.15.44:45880) 2024-04-17T19:50:01.896 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:01.903+0000 7f146fe00640 1 -- 172.21.15.44:0/3993125528 learned_addr learned my addr 172.21.15.44:0/3993125528 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-04-17T19:50:01.896 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:01.903+0000 7f1476800640 1 --2- 172.21.15.44:0/3993125528 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1478071c90 0x7f14780cc3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:50:01.897 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:01.903+0000 7f1477200640 1 --2- 172.21.15.44:0/3993125528 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f14780c9130 0x7f147814d210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:50:01.897 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:01.907+0000 7f146fe00640 1 -- 172.21.15.44:0/3993125528 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f14780c9130 msgr2=0x7f147814d210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:50:01.897 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:01.907+0000 7f146fe00640 1 --2- 172.21.15.44:0/3993125528 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f14780c9130 0x7f147814d210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:50:01.897 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:01.907+0000 7f146fe00640 1 -- 172.21.15.44:0/3993125528 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1478071c90 msgr2=0x7f14780cc3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:50:01.897 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:01.907+0000 7f146fe00640 1 --2- 172.21.15.44:0/3993125528 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1478071c90 0x7f14780cc3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:50:01.897 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:01.907+0000 7f146fe00640 1 -- 172.21.15.44:0/3993125528 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f14781f5f80 con 0x7f14780c6800 2024-04-17T19:50:01.897 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:01.907+0000 7f146fe00640 1 --2- 172.21.15.44:0/3993125528 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f14780c6800 0x7f14781f5a40 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f146000d620 tx=0x7f146000dae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:50:01.898 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:01.907+0000 7f146ea00640 1 -- 172.21.15.44:0/3993125528 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f146000b620 con 0x7f14780c6800 2024-04-17T19:50:01.898 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:01.907+0000 7f146ea00640 1 -- 172.21.15.44:0/3993125528 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1460019070 con 0x7f14780c6800 2024-04-17T19:50:01.898 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:01.907+0000 7f146ea00640 1 -- 172.21.15.44:0/3993125528 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f146000ba20 con 0x7f14780c6800 2024-04-17T19:50:01.898 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:01.907+0000 7f147d400640 1 -- 172.21.15.44:0/3993125528 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f14780ce1f0 con 0x7f14780c6800 2024-04-17T19:50:01.898 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:01.907+0000 7f147d400640 1 -- 172.21.15.44:0/3993125528 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f14780ce7b0 con 0x7f14780c6800 2024-04-17T19:50:01.898 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:01.907+0000 7f147d400640 1 -- 172.21.15.44:0/3993125528 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f147804ff10 con 0x7f14780c6800 2024-04-17T19:50:01.898 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:01.907+0000 7f146ea00640 1 -- 172.21.15.44:0/3993125528 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f146000bbc0 con 0x7f14780c6800 2024-04-17T19:50:01.900 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:01.911+0000 7f146ea00640 1 --2- 172.21.15.44:0/3993125528 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f1454068380 0x7f145406a890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:50:01.900 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:01.911+0000 7f146ea00640 1 -- 172.21.15.44:0/3993125528 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6619+0+0 (secure 0 0 0) 0x7f14600871b0 con 0x7f14780c6800 2024-04-17T19:50:01.900 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:01.911+0000 7f1476800640 1 --2- 172.21.15.44:0/3993125528 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f1454068380 0x7f145406a890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:50:01.901 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:01.911+0000 7f1476800640 1 --2- 172.21.15.44:0/3993125528 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f1454068380 0x7f145406a890 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f14680b2000 tx=0x7f1468009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:50:01.904 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:01.915+0000 7f146ea00640 1 -- 172.21.15.44:0/3993125528 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f1460056c60 con 0x7f14780c6800 2024-04-17T19:50:02.128 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:02.139+0000 7f147d400640 1 -- 172.21.15.44:0/3993125528 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "mon scrub"} v 0) -- 0x7f14780ce980 con 0x7f14780c6800 2024-04-17T19:50:02.129 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:02.139+0000 7f146ea00640 1 -- 172.21.15.44:0/3993125528 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "mon scrub"}]=0 v0) ==== 57+0+0 (secure 0 0 0) 0x7f146005af60 con 0x7f14780c6800 2024-04-17T19:50:02.132 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:02.139+0000 7f147d400640 1 -- 172.21.15.44:0/3993125528 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f1454068380 msgr2=0x7f145406a890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:50:02.132 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:02.139+0000 7f147d400640 1 --2- 172.21.15.44:0/3993125528 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f1454068380 0x7f145406a890 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f14680b2000 tx=0x7f1468009040 comp rx=0 tx=0).stop 2024-04-17T19:50:02.132 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:02.139+0000 7f147d400640 1 -- 172.21.15.44:0/3993125528 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f14780c6800 msgr2=0x7f14781f5a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:50:02.132 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:02.139+0000 7f147d400640 1 --2- 172.21.15.44:0/3993125528 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f14780c6800 0x7f14781f5a40 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f146000d620 tx=0x7f146000dae0 comp rx=0 tx=0).stop 2024-04-17T19:50:02.132 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:02.139+0000 7f147d400640 1 -- 172.21.15.44:0/3993125528 shutdown_connections 2024-04-17T19:50:02.132 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:02.139+0000 7f147d400640 1 --2- 172.21.15.44:0/3993125528 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f1454068380 0x7f145406a890 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:50:02.132 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:02.139+0000 7f147d400640 1 --2- 172.21.15.44:0/3993125528 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f14780c9130 0x7f147814d210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:50:02.132 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:02.139+0000 7f147d400640 1 --2- 172.21.15.44:0/3993125528 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f14780c6800 0x7f14781f5a40 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:50:02.132 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:02.139+0000 7f147d400640 1 --2- 172.21.15.44:0/3993125528 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1478071c90 0x7f14780cc3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:50:02.132 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:02.139+0000 7f147d400640 1 -- 172.21.15.44:0/3993125528 >> 172.21.15.44:0/3993125528 conn(0x7f1478073bb0 msgr2=0x7f1478154e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:50:02.132 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:02.139+0000 7f147d400640 1 -- 172.21.15.44:0/3993125528 shutdown_connections 2024-04-17T19:50:02.132 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:02.139+0000 7f147d400640 1 -- 172.21.15.44:0/3993125528 wait complete. 2024-04-17T19:50:02.152 INFO:tasks.mon_thrash.mon_thrasher:waiting for 10.0 secs before continuing thrashing 2024-04-17T19:50:12.153 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-17T19:50:12.319 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:12.327+0000 7f9dabe00640 1 Processor -- start 2024-04-17T19:50:12.319 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:12.327+0000 7f9dabe00640 1 -- start start 2024-04-17T19:50:12.322 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:12.331+0000 7f9dabe00640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f9da40b1a80 0x7f9da40cba20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:50:12.322 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:12.331+0000 7f9dabe00640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f9da40cbf60 0x7f9da4164170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:50:12.322 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:12.331+0000 7f9dabe00640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9da415a600 con 0x7f9da40caf70 2024-04-17T19:50:12.322 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:12.331+0000 7f9dabe00640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 -- 0x7f9da40cb380 con 0x7f9da40b1a80 2024-04-17T19:50:12.322 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:12.331+0000 7f9dabe00640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7f9da415dd90 con 0x7f9da40cbf60 2024-04-17T19:50:12.322 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:12.331+0000 7f9da9400640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f9da40caf70 0x7f9da415d680 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:48618/0 (socket says 172.21.15.44:48618) 2024-04-17T19:50:12.322 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:12.331+0000 7f9da9400640 1 -- 172.21.15.44:0/1485005205 learned_addr learned my addr 172.21.15.44:0/1485005205 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-04-17T19:50:12.322 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:12.331+0000 7f9da8a00640 1 --2- 172.21.15.44:0/1485005205 >> v2:172.21.15.44:3300/0 conn(0x7f9da40b1a80 0x7f9da40cba20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:50:12.322 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:12.331+0000 7f9da9e00640 1 --2- 172.21.15.44:0/1485005205 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f9da40cbf60 0x7f9da4164170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:50:12.322 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:12.331+0000 7f9da3e00640 1 -- 172.21.15.44:0/1485005205 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2188001454 0 0) 0x7f9da415a600 con 0x7f9da40caf70 2024-04-17T19:50:12.323 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:12.331+0000 7f9da3e00640 1 -- 172.21.15.44:0/1485005205 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9d8c003530 con 0x7f9da40caf70 2024-04-17T19:50:12.323 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:12.331+0000 7f9da8a00640 1 -- 172.21.15.44:0/1485005205 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f9da40cbf60 msgr2=0x7f9da4164170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T19:50:12.323 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:12.331+0000 7f9da8a00640 1 --2- 172.21.15.44:0/1485005205 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f9da40cbf60 0x7f9da4164170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:50:12.323 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:12.331+0000 7f9da8a00640 1 -- 172.21.15.44:0/1485005205 >> v1:172.21.15.44:6789/0 conn(0x7f9da40caf70 legacy=0x7f9da415d680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:50:12.323 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:12.331+0000 7f9da8a00640 1 -- 172.21.15.44:0/1485005205 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9da40ca3b0 con 0x7f9da40b1a80 2024-04-17T19:50:12.325 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:12.335+0000 7f9da8a00640 1 --2- 172.21.15.44:0/1485005205 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9da40b1a80 0x7f9da40cba20 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f9d900097c0 tx=0x7f9d9001c410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=17c76ef96d701aaa server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:50:12.325 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:12.335+0000 7f9da3e00640 1 -- 172.21.15.44:0/1485005205 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d900b0070 con 0x7f9da40b1a80 2024-04-17T19:50:12.325 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:12.335+0000 7f9da3e00640 1 -- 172.21.15.44:0/1485005205 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9d900ab600 con 0x7f9da40b1a80 2024-04-17T19:50:12.325 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:12.335+0000 7f9da3e00640 1 -- 172.21.15.44:0/1485005205 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d900ab9d0 con 0x7f9da40b1a80 2024-04-17T19:50:12.326 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:12.335+0000 7f9dabe00640 1 -- 172.21.15.44:0/1485005205 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9da40b1a80 msgr2=0x7f9da40cba20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:50:12.326 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:12.335+0000 7f9dabe00640 1 --2- 172.21.15.44:0/1485005205 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9da40b1a80 0x7f9da40cba20 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f9d900097c0 tx=0x7f9d9001c410 comp rx=0 tx=0).stop 2024-04-17T19:50:12.326 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:12.335+0000 7f9dabe00640 1 -- 172.21.15.44:0/1485005205 shutdown_connections 2024-04-17T19:50:12.326 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:12.335+0000 7f9dabe00640 1 --2- 172.21.15.44:0/1485005205 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f9da40cbf60 0x7f9da4164170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:50:12.326 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:12.335+0000 7f9dabe00640 1 --2- 172.21.15.44:0/1485005205 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9da40b1a80 0x7f9da40cba20 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:50:12.326 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:12.335+0000 7f9dabe00640 1 -- 172.21.15.44:0/1485005205 >> 172.21.15.44:0/1485005205 conn(0x7f9da4067eb0 msgr2=0x7f9da40682c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:50:12.326 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:12.335+0000 7f9dabe00640 1 -- 172.21.15.44:0/1485005205 shutdown_connections 2024-04-17T19:50:12.326 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:12.335+0000 7f9dabe00640 1 -- 172.21.15.44:0/1485005205 wait complete. 2024-04-17T19:50:12.328 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:12.335+0000 7f9dabe00640 1 Processor -- start 2024-04-17T19:50:12.328 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:12.339+0000 7f9dabe00640 1 -- start start 2024-04-17T19:50:12.332 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:12.339+0000 7f9dabe00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9da40b1a80 0x7f9da406dba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:50:12.332 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:12.339+0000 7f9dabe00640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f9da40caf70 0x7f9da41471b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:50:12.332 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:12.339+0000 7f9dabe00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9da40cbf60 0x7f9da406e610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:50:12.332 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:12.339+0000 7f9dabe00640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f9da40ca690 con 0x7f9da40b1a80 2024-04-17T19:50:12.332 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:12.339+0000 7f9dabe00640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f9da40b1e90 con 0x7f9da40cbf60 2024-04-17T19:50:12.332 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:12.339+0000 7f9dabe00640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7f9da415a270 con 0x7f9da40caf70 2024-04-17T19:50:12.332 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:12.339+0000 7f9da9400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9da40b1a80 0x7f9da406dba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:50:12.332 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:12.339+0000 7f9da9400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9da40b1a80 0x7f9da406dba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:41046/0 (socket says 172.21.15.44:41046) 2024-04-17T19:50:12.332 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:12.339+0000 7f9da9400640 1 -- 172.21.15.44:0/158200448 learned_addr learned my addr 172.21.15.44:0/158200448 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-04-17T19:50:12.332 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:12.339+0000 7f9da8a00640 1 --2- 172.21.15.44:0/158200448 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f9da40caf70 0x7f9da41471b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:50:12.333 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:12.339+0000 7f9da9e00640 1 --2- 172.21.15.44:0/158200448 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9da40cbf60 0x7f9da406e610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:50:12.333 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:12.339+0000 7f9da9400640 1 -- 172.21.15.44:0/158200448 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f9da40caf70 msgr2=0x7f9da41471b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:50:12.333 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:12.339+0000 7f9da9400640 1 --2- 172.21.15.44:0/158200448 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f9da40caf70 0x7f9da41471b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:50:12.333 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:12.339+0000 7f9da9400640 1 -- 172.21.15.44:0/158200448 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9da40cbf60 msgr2=0x7f9da406e610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:50:12.333 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:12.339+0000 7f9da9400640 1 --2- 172.21.15.44:0/158200448 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9da40cbf60 0x7f9da406e610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:50:12.333 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:12.339+0000 7f9da9400640 1 -- 172.21.15.44:0/158200448 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9da41476f0 con 0x7f9da40b1a80 2024-04-17T19:50:12.333 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:12.339+0000 7f9da9400640 1 --2- 172.21.15.44:0/158200448 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9da40b1a80 0x7f9da406dba0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f9d9800c3c0 tx=0x7f9d9800c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:50:12.333 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:12.339+0000 7f9da1600640 1 -- 172.21.15.44:0/158200448 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d98017070 con 0x7f9da40b1a80 2024-04-17T19:50:12.333 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:12.339+0000 7f9da1600640 1 -- 172.21.15.44:0/158200448 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9d98005cf0 con 0x7f9da40b1a80 2024-04-17T19:50:12.333 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:12.339+0000 7f9da1600640 1 -- 172.21.15.44:0/158200448 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d980072f0 con 0x7f9da40b1a80 2024-04-17T19:50:12.333 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:12.339+0000 7f9dabe00640 1 -- 172.21.15.44:0/158200448 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9da4159650 con 0x7f9da40b1a80 2024-04-17T19:50:12.333 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:12.339+0000 7f9dabe00640 1 -- 172.21.15.44:0/158200448 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9da414aae0 con 0x7f9da40b1a80 2024-04-17T19:50:12.333 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:12.339+0000 7f9dabe00640 1 -- 172.21.15.44:0/158200448 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9da404ff10 con 0x7f9da40b1a80 2024-04-17T19:50:12.334 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:12.343+0000 7f9da1600640 1 -- 172.21.15.44:0/158200448 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f9d9801a070 con 0x7f9da40b1a80 2024-04-17T19:50:12.334 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:12.343+0000 7f9da1600640 1 --2- 172.21.15.44:0/158200448 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f9d84068380 0x7f9d8406a890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:50:12.334 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:12.343+0000 7f9da1600640 1 -- 172.21.15.44:0/158200448 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6619+0+0 (secure 0 0 0) 0x7f9d98086170 con 0x7f9da40b1a80 2024-04-17T19:50:12.334 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:12.343+0000 7f9da8a00640 1 --2- 172.21.15.44:0/158200448 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f9d84068380 0x7f9d8406a890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:50:12.335 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:12.343+0000 7f9da8a00640 1 --2- 172.21.15.44:0/158200448 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f9d84068380 0x7f9d8406a890 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f9d900ad000 tx=0x7f9d90008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:50:12.339 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:12.347+0000 7f9da1600640 1 -- 172.21.15.44:0/158200448 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f9d98056390 con 0x7f9da40b1a80 2024-04-17T19:50:12.538 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:12.547+0000 7f9dabe00640 1 -- 172.21.15.44:0/158200448 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f9da40cad50 con 0x7f9da40b1a80 2024-04-17T19:50:12.539 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:12.547+0000 7f9da1600640 1 -- 172.21.15.44:0/158200448 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 18 v18) ==== 94+0+6911 (secure 0 0 0) 0x7f9d98055c90 con 0x7f9da40b1a80 2024-04-17T19:50:12.540 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-04-17T19:50:12.540 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":18,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4263,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.44:6835/1724891996","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6832","nonce":1724891996},{"type":"v1","addr":"172.21.15.44:6835","nonce":1724891996}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":18,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-17T19:46:56.083202+0000","modified":"2024-04-17T19:47:39.954509+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":4306,"mds_1":4294,"mds_2":4269,"mds_3":4268,"mds_4":4266},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4266":{"gid":4266,"name":"c","rank":4,"incarnation":17,"state":"up:active","state_seq":14,"addr":"172.21.15.44:6836/2201911513","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6833","nonce":2201911513},{"type":"v1","addr":"172.21.15.44:6836","nonce":2201911513}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4268":{"gid":4268,"name":"f","rank":3,"incarnation":15,"state":"up:active","state_seq":13,"addr":"172.21.15.62:6837/3085335335","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6836","nonce":3085335335},{"type":"v1","addr":"172.21.15.62:6837","nonce":3085335335}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4269":{"gid":4269,"name":"e","rank":2,"incarnation":13,"state":"up:active","state_seq":11,"addr":"172.21.15.44:6837/4073536070","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6834","nonce":4073536070},{"type":"v1","addr":"172.21.15.44:6837","nonce":4073536070}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4294":{"gid":4294,"name":"d","rank":1,"incarnation":9,"state":"up:active","state_seq":10,"addr":"172.21.15.62:6835/2585862759","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6834","nonce":2585862759},{"type":"v1","addr":"172.21.15.62:6835","nonce":2585862759}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4306":{"gid":4306,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":5,"addr":"172.21.15.62:6839/1537667111","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6838","nonce":1537667111},{"type":"v1","addr":"172.21.15.62:6839","nonce":1537667111}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4306,"qdb_cluster":[4266,4268,4294,4269,4306]},"id":1}]} 2024-04-17T19:50:12.540 INFO:teuthology.orchestra.run.smithi044.stderr:dumped fsmap epoch 18 2024-04-17T19:50:12.541 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:12.551+0000 7f9dabe00640 1 -- 172.21.15.44:0/158200448 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f9d84068380 msgr2=0x7f9d8406a890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:50:12.541 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:12.551+0000 7f9dabe00640 1 --2- 172.21.15.44:0/158200448 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f9d84068380 0x7f9d8406a890 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f9d900ad000 tx=0x7f9d90008040 comp rx=0 tx=0).stop 2024-04-17T19:50:12.541 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:12.551+0000 7f9dabe00640 1 -- 172.21.15.44:0/158200448 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9da40b1a80 msgr2=0x7f9da406dba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:50:12.541 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:12.551+0000 7f9dabe00640 1 --2- 172.21.15.44:0/158200448 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9da40b1a80 0x7f9da406dba0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f9d9800c3c0 tx=0x7f9d9800c880 comp rx=0 tx=0).stop 2024-04-17T19:50:12.541 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:12.551+0000 7f9dabe00640 1 -- 172.21.15.44:0/158200448 shutdown_connections 2024-04-17T19:50:12.542 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:12.551+0000 7f9dabe00640 1 --2- 172.21.15.44:0/158200448 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f9d84068380 0x7f9d8406a890 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:50:12.542 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:12.551+0000 7f9dabe00640 1 --2- 172.21.15.44:0/158200448 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f9da40caf70 0x7f9da41471b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:50:12.542 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:12.551+0000 7f9dabe00640 1 --2- 172.21.15.44:0/158200448 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9da40cbf60 0x7f9da406e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:50:12.542 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:12.551+0000 7f9dabe00640 1 --2- 172.21.15.44:0/158200448 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9da40b1a80 0x7f9da406dba0 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:50:12.542 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:12.551+0000 7f9dabe00640 1 -- 172.21.15.44:0/158200448 >> 172.21.15.44:0/158200448 conn(0x7f9da4067eb0 msgr2=0x7f9da40c4d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:50:12.542 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:12.551+0000 7f9dabe00640 1 -- 172.21.15.44:0/158200448 shutdown_connections 2024-04-17T19:50:12.542 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:12.551+0000 7f9dabe00640 1 -- 172.21.15.44:0/158200448 wait complete. 2024-04-17T19:50:12.562 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2024-04-17T19:50:12.562 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-04-17T19:50:12.713 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:12.723+0000 7f2e4a400640 1 Processor -- start 2024-04-17T19:50:12.713 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:12.723+0000 7f2e4a400640 1 -- start start 2024-04-17T19:50:12.714 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:12.723+0000 7f2e4a400640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f2e440c6510 0x7f2e440c5d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:50:12.714 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:12.723+0000 7f2e4a400640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2e4415b980 con 0x7f2e4415be80 2024-04-17T19:50:12.715 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:12.723+0000 7f2e4a400640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2e4415fc60 con 0x7f2e440c6ae0 2024-04-17T19:50:12.715 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:12.723+0000 7f2e4a400640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7f2e440c6ef0 con 0x7f2e440c6510 2024-04-17T19:50:12.716 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:12.723+0000 7f2e43e00640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f2e4415be80 0x7f2e4415c290 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:48632/0 (socket says 172.21.15.44:48632) 2024-04-17T19:50:12.716 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:12.723+0000 7f2e43e00640 1 -- 172.21.15.44:0/3610354504 learned_addr learned my addr 172.21.15.44:0/3610354504 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-04-17T19:50:12.716 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:12.723+0000 7f2e43400640 1 --2- 172.21.15.44:0/3610354504 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f2e440c6510 0x7f2e440c5d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:50:12.716 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:12.723+0000 7f2e42a00640 1 -- 172.21.15.44:0/3610354504 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 855487864 0 0) 0x7f2e4415b980 con 0x7f2e4415be80 2024-04-17T19:50:12.716 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:12.723+0000 7f2e42a00640 1 -- 172.21.15.44:0/3610354504 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2e28003530 con 0x7f2e4415be80 2024-04-17T19:50:12.716 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:12.723+0000 7f2e42a00640 1 -- 172.21.15.44:0/3610354504 <== mon.1 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2114533485 0 0) 0x7f2e4415fc60 con 0x7f2e440c6ae0 2024-04-17T19:50:12.716 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:12.723+0000 7f2e43400640 1 -- 172.21.15.44:0/3610354504 >> v1:172.21.15.62:6789/0 conn(0x7f2e440c6ae0 legacy=0x7f2e440d11e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:50:12.716 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:12.723+0000 7f2e43400640 1 -- 172.21.15.44:0/3610354504 >> v1:172.21.15.44:6789/0 conn(0x7f2e4415be80 legacy=0x7f2e4415c290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:50:12.716 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:12.723+0000 7f2e43400640 1 -- 172.21.15.44:0/3610354504 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2e440cc950 con 0x7f2e440c6510 2024-04-17T19:50:12.719 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:12.727+0000 7f2e43400640 1 --2- 172.21.15.44:0/3610354504 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f2e440c6510 0x7f2e440c5d60 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f2e340097f0 tx=0x7f2e3401ec10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c8c92f1f7d481c0d server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:50:12.719 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:12.727+0000 7f2e42a00640 1 -- 172.21.15.44:0/3610354504 <== mon.2 v2:172.21.15.62:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e340b5070 con 0x7f2e440c6510 2024-04-17T19:50:12.719 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:12.727+0000 7f2e42a00640 1 -- 172.21.15.44:0/3610354504 <== mon.2 v2:172.21.15.62:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2e340a8890 con 0x7f2e440c6510 2024-04-17T19:50:12.719 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:12.727+0000 7f2e42a00640 1 -- 172.21.15.44:0/3610354504 <== mon.2 v2:172.21.15.62:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e340a8c60 con 0x7f2e440c6510 2024-04-17T19:50:12.720 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:12.731+0000 7f2e4a400640 1 -- 172.21.15.44:0/3610354504 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f2e440c6510 msgr2=0x7f2e440c5d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:50:12.720 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:12.731+0000 7f2e4a400640 1 --2- 172.21.15.44:0/3610354504 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f2e440c6510 0x7f2e440c5d60 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f2e340097f0 tx=0x7f2e3401ec10 comp rx=0 tx=0).stop 2024-04-17T19:50:12.720 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:12.731+0000 7f2e4a400640 1 -- 172.21.15.44:0/3610354504 shutdown_connections 2024-04-17T19:50:12.720 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:12.731+0000 7f2e4a400640 1 --2- 172.21.15.44:0/3610354504 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f2e440c6510 0x7f2e440c5d60 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:50:12.720 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:12.731+0000 7f2e4a400640 1 -- 172.21.15.44:0/3610354504 >> 172.21.15.44:0/3610354504 conn(0x7f2e4406d250 msgr2=0x7f2e4406d660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:50:12.720 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:12.731+0000 7f2e4a400640 1 -- 172.21.15.44:0/3610354504 shutdown_connections 2024-04-17T19:50:12.720 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:12.731+0000 7f2e4a400640 1 -- 172.21.15.44:0/3610354504 wait complete. 2024-04-17T19:50:12.722 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:12.731+0000 7f2e4a400640 1 Processor -- start 2024-04-17T19:50:12.722 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:12.731+0000 7f2e4a400640 1 -- start start 2024-04-17T19:50:12.725 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:12.731+0000 7f2e4a400640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2e440c6510 0x7f2e441f2a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:50:12.725 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:12.731+0000 7f2e4a400640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f2e440c6ae0 0x7f2e44067eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:50:12.725 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:12.731+0000 7f2e4a400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2e4415be80 0x7f2e441f5540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:50:12.725 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:12.731+0000 7f2e4a400640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f2e4415f950 con 0x7f2e4415be80 2024-04-17T19:50:12.725 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:12.731+0000 7f2e4a400640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f2e440cc700 con 0x7f2e440c6510 2024-04-17T19:50:12.725 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:12.731+0000 7f2e4a400640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7f2e440d18f0 con 0x7f2e440c6ae0 2024-04-17T19:50:12.725 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:12.735+0000 7f2e43e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2e4415be80 0x7f2e441f5540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:50:12.726 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:12.735+0000 7f2e43e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2e4415be80 0x7f2e441f5540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:41062/0 (socket says 172.21.15.44:41062) 2024-04-17T19:50:12.726 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:12.735+0000 7f2e43e00640 1 -- 172.21.15.44:0/1454181787 learned_addr learned my addr 172.21.15.44:0/1454181787 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-04-17T19:50:12.726 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:12.735+0000 7f2e43400640 1 --2- 172.21.15.44:0/1454181787 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2e440c6510 0x7f2e441f2a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:50:12.726 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:12.735+0000 7f2e3aa00640 1 --2- 172.21.15.44:0/1454181787 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f2e440c6ae0 0x7f2e44067eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:50:12.726 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:12.735+0000 7f2e43e00640 1 -- 172.21.15.44:0/1454181787 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f2e440c6ae0 msgr2=0x7f2e44067eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:50:12.726 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:12.735+0000 7f2e43e00640 1 --2- 172.21.15.44:0/1454181787 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f2e440c6ae0 0x7f2e44067eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:50:12.726 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:12.735+0000 7f2e43e00640 1 -- 172.21.15.44:0/1454181787 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2e440c6510 msgr2=0x7f2e441f2a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:50:12.726 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:12.735+0000 7f2e43e00640 1 --2- 172.21.15.44:0/1454181787 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2e440c6510 0x7f2e441f2a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:50:12.726 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:12.735+0000 7f2e43e00640 1 -- 172.21.15.44:0/1454181787 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2e441f1fd0 con 0x7f2e4415be80 2024-04-17T19:50:12.726 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:12.735+0000 7f2e43e00640 1 --2- 172.21.15.44:0/1454181787 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2e4415be80 0x7f2e441f5540 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f2e3c001fd0 tx=0x7f2e3c00a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:50:12.726 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:12.735+0000 7f2e3be00640 1 -- 172.21.15.44:0/1454181787 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e3c012400 con 0x7f2e4415be80 2024-04-17T19:50:12.726 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:12.735+0000 7f2e3be00640 1 -- 172.21.15.44:0/1454181787 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2e3c0125a0 con 0x7f2e4415be80 2024-04-17T19:50:12.726 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:12.735+0000 7f2e3be00640 1 -- 172.21.15.44:0/1454181787 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e3c012970 con 0x7f2e4415be80 2024-04-17T19:50:12.726 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:12.735+0000 7f2e4a400640 1 -- 172.21.15.44:0/1454181787 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2e44151d50 con 0x7f2e4415be80 2024-04-17T19:50:12.726 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:12.735+0000 7f2e4a400640 1 -- 172.21.15.44:0/1454181787 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2e441e7e00 con 0x7f2e4415be80 2024-04-17T19:50:12.727 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:12.735+0000 7f2e4a400640 1 -- 172.21.15.44:0/1454181787 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2e4404ff10 con 0x7f2e4415be80 2024-04-17T19:50:12.727 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:12.735+0000 7f2e3be00640 1 -- 172.21.15.44:0/1454181787 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f2e3c012b10 con 0x7f2e4415be80 2024-04-17T19:50:12.729 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:12.739+0000 7f2e3be00640 1 --2- 172.21.15.44:0/1454181787 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f2e20068380 0x7f2e2006a890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:50:12.729 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:12.739+0000 7f2e3be00640 1 -- 172.21.15.44:0/1454181787 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6619+0+0 (secure 0 0 0) 0x7f2e3c087640 con 0x7f2e4415be80 2024-04-17T19:50:12.729 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:12.739+0000 7f2e43400640 1 --2- 172.21.15.44:0/1454181787 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f2e20068380 0x7f2e2006a890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:50:12.730 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:12.739+0000 7f2e43400640 1 --2- 172.21.15.44:0/1454181787 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f2e20068380 0x7f2e2006a890 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f2e340b2000 tx=0x7f2e34008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:50:12.733 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:12.743+0000 7f2e3be00640 1 -- 172.21.15.44:0/1454181787 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f2e441f1fd0 con 0x7f2e4415be80 2024-04-17T19:50:12.962 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:12.971+0000 7f2e4a400640 1 -- 172.21.15.44:0/1454181787 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f2e440ccfb0 con 0x7f2e4415be80 2024-04-17T19:50:12.962 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:12.971+0000 7f2e3be00640 1 -- 172.21.15.44:0/1454181787 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1557 (secure 0 0 0) 0x7f2e3c0570f0 con 0x7f2e4415be80 2024-04-17T19:50:12.963 INFO:teuthology.orchestra.run.smithi044.stdout:{"election_epoch":20,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":12,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"703f77ca-79c6-4a66-b576-62c526cb1021","modified":"2024-04-17T19:45:55.379749Z","created":"2024-04-17T19:45:55.379749Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:3300","nonce":0},{"type":"v1","addr":"172.21.15.44:6789","nonce":0}]},"addr":"172.21.15.44:6789/0","public_addr":"172.21.15.44:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:3300","nonce":0},{"type":"v1","addr":"172.21.15.62:6789","nonce":0}]},"addr":"172.21.15.62:6789/0","public_addr":"172.21.15.62:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:3301","nonce":0},{"type":"v1","addr":"172.21.15.62:6790","nonce":0}]},"addr":"172.21.15.62:6790/0","public_addr":"172.21.15.62:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-04-17T19:50:12.965 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:12.975+0000 7f2e4a400640 1 -- 172.21.15.44:0/1454181787 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f2e20068380 msgr2=0x7f2e2006a890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:50:12.965 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:12.975+0000 7f2e4a400640 1 --2- 172.21.15.44:0/1454181787 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f2e20068380 0x7f2e2006a890 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f2e340b2000 tx=0x7f2e34008040 comp rx=0 tx=0).stop 2024-04-17T19:50:12.965 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:12.975+0000 7f2e4a400640 1 -- 172.21.15.44:0/1454181787 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2e4415be80 msgr2=0x7f2e441f5540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:50:12.965 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:12.975+0000 7f2e4a400640 1 --2- 172.21.15.44:0/1454181787 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2e4415be80 0x7f2e441f5540 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f2e3c001fd0 tx=0x7f2e3c00a430 comp rx=0 tx=0).stop 2024-04-17T19:50:12.965 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:12.975+0000 7f2e4a400640 1 -- 172.21.15.44:0/1454181787 shutdown_connections 2024-04-17T19:50:12.965 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:12.975+0000 7f2e4a400640 1 --2- 172.21.15.44:0/1454181787 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f2e20068380 0x7f2e2006a890 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:50:12.965 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:12.975+0000 7f2e4a400640 1 --2- 172.21.15.44:0/1454181787 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f2e440c6ae0 0x7f2e44067eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:50:12.965 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:12.975+0000 7f2e4a400640 1 --2- 172.21.15.44:0/1454181787 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2e4415be80 0x7f2e441f5540 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:50:12.966 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:12.975+0000 7f2e4a400640 1 --2- 172.21.15.44:0/1454181787 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2e440c6510 0x7f2e441f2a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:50:12.966 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:12.975+0000 7f2e4a400640 1 -- 172.21.15.44:0/1454181787 >> 172.21.15.44:0/1454181787 conn(0x7f2e4406d250 msgr2=0x7f2e440ce1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:50:12.966 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:12.975+0000 7f2e4a400640 1 -- 172.21.15.44:0/1454181787 shutdown_connections 2024-04-17T19:50:12.966 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:12.975+0000 7f2e4a400640 1 -- 172.21.15.44:0/1454181787 wait complete. 2024-04-17T19:50:12.985 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2024-04-17T19:50:12.986 DEBUG:teuthology.run_tasks:Unwinding manager kclient 2024-04-17T19:50:12.996 INFO:tasks.kclient:Unmounting kernel clients... 2024-04-17T19:50:12.996 DEBUG:teuthology.orchestra.run.smithi044:> set -ex 2024-04-17T19:50:12.996 DEBUG:teuthology.orchestra.run.smithi044:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-17T19:50:13.005 DEBUG:teuthology.orchestra.run.smithi044:> set -ex 2024-04-17T19:50:13.005 DEBUG:teuthology.orchestra.run.smithi044:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-17T19:50:13.056 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-17T19:50:13.250 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:13.259+0000 7f588c800640 1 Processor -- start 2024-04-17T19:50:13.250 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:13.259+0000 7f588c800640 1 -- start start 2024-04-17T19:50:13.253 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:13.263+0000 7f588c800640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f5884158eb0 0x7f58841592c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:50:13.253 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:13.263+0000 7f588c800640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f58840c47c0 0x7f58840c4bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:50:13.253 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:13.263+0000 7f588c800640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5884152e70 con 0x7f5884152a60 2024-04-17T19:50:13.253 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:13.263+0000 7f588c800640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 -- 0x7f58840c52c0 con 0x7f5884158eb0 2024-04-17T19:50:13.253 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:13.263+0000 7f588c800640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 -- 0x7f58840c8840 con 0x7f58840c47c0 2024-04-17T19:50:13.253 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:13.263+0000 7f5889400640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f5884158eb0 0x7f58841592c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:50:13.253 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:13.263+0000 7f5889400640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f5884158eb0 0x7f58841592c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:41074/0 (socket says 172.21.15.44:41074) 2024-04-17T19:50:13.254 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:13.263+0000 7f5889400640 1 -- 172.21.15.44:0/3216538604 learned_addr learned my addr 172.21.15.44:0/3216538604 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-04-17T19:50:13.254 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:13.263+0000 7f588a800640 1 --2- 172.21.15.44:0/3216538604 >> v2:172.21.15.62:3300/0 conn(0x7f58840c47c0 0x7f58840c4bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:50:13.254 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:13.263+0000 7f5889400640 1 -- 172.21.15.44:0/3216538604 >> v2:172.21.15.62:3300/0 conn(0x7f58840c47c0 msgr2=0x7f58840c4bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T19:50:13.254 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:13.263+0000 7f5889400640 1 --2- 172.21.15.44:0/3216538604 >> v2:172.21.15.62:3300/0 conn(0x7f58840c47c0 0x7f58840c4bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:50:13.254 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:13.263+0000 7f5889400640 1 -- 172.21.15.44:0/3216538604 >> v1:172.21.15.44:6789/0 conn(0x7f5884152a60 legacy=0x7f58840c6920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:50:13.254 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:13.263+0000 7f5889400640 1 -- 172.21.15.44:0/3216538604 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f58840c8b20 con 0x7f5884158eb0 2024-04-17T19:50:13.256 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:13.263+0000 7f5889400640 1 --2- 172.21.15.44:0/3216538604 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5884158eb0 0x7f58841592c0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f588406ccd0 tx=0x7f587401c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3852d7b32c53f176 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:50:13.256 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:13.267+0000 7f5888a00640 1 -- 172.21.15.44:0/3216538604 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58740b0070 con 0x7f5884158eb0 2024-04-17T19:50:13.256 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:13.267+0000 7f5888a00640 1 -- 172.21.15.44:0/3216538604 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f58740ab600 con 0x7f5884158eb0 2024-04-17T19:50:13.256 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:13.267+0000 7f5888a00640 1 -- 172.21.15.44:0/3216538604 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58740ab9d0 con 0x7f5884158eb0 2024-04-17T19:50:13.257 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:13.267+0000 7f588c800640 1 -- 172.21.15.44:0/3216538604 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5884158eb0 msgr2=0x7f58841592c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:50:13.257 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:13.267+0000 7f588c800640 1 --2- 172.21.15.44:0/3216538604 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5884158eb0 0x7f58841592c0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f588406ccd0 tx=0x7f587401c520 comp rx=0 tx=0).stop 2024-04-17T19:50:13.257 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:13.267+0000 7f588c800640 1 -- 172.21.15.44:0/3216538604 shutdown_connections 2024-04-17T19:50:13.257 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:13.267+0000 7f588c800640 1 --2- 172.21.15.44:0/3216538604 >> v2:172.21.15.62:3300/0 conn(0x7f58840c47c0 0x7f58840c4bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:50:13.257 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:13.267+0000 7f588c800640 1 --2- 172.21.15.44:0/3216538604 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5884158eb0 0x7f58841592c0 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:50:13.257 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:13.267+0000 7f588c800640 1 -- 172.21.15.44:0/3216538604 >> 172.21.15.44:0/3216538604 conn(0x7f588406c380 msgr2=0x7f5884070080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:50:13.257 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:13.267+0000 7f588c800640 1 -- 172.21.15.44:0/3216538604 shutdown_connections 2024-04-17T19:50:13.257 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:13.267+0000 7f588c800640 1 -- 172.21.15.44:0/3216538604 wait complete. 2024-04-17T19:50:13.259 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:13.267+0000 7f588c800640 1 Processor -- start 2024-04-17T19:50:13.259 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:13.267+0000 7f588c800640 1 -- start start 2024-04-17T19:50:13.263 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:13.271+0000 7f588c800640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f58840c47c0 0x7f5884143c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:50:13.263 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:13.271+0000 7f588c800640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f5884152a60 0x7f588414bdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:50:13.263 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:13.271+0000 7f588c800640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5884158eb0 0x7f588413e220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:50:13.263 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:13.271+0000 7f588c800640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f5884165aa0 con 0x7f5884158eb0 2024-04-17T19:50:13.263 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:13.271+0000 7f588c800640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f5884165920 con 0x7f58840c47c0 2024-04-17T19:50:13.263 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:13.271+0000 7f588c800640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7f5884165c20 con 0x7f5884152a60 2024-04-17T19:50:13.263 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:13.271+0000 7f588a800640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5884158eb0 0x7f588413e220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:50:13.263 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:13.271+0000 7f588a800640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5884158eb0 0x7f588413e220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:41084/0 (socket says 172.21.15.44:41084) 2024-04-17T19:50:13.263 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:13.271+0000 7f588a800640 1 -- 172.21.15.44:0/4163852990 learned_addr learned my addr 172.21.15.44:0/4163852990 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-04-17T19:50:13.264 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:13.271+0000 7f5889e00640 1 --2- 172.21.15.44:0/4163852990 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f58840c47c0 0x7f5884143c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:50:13.264 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:13.271+0000 7f5889400640 1 --2- 172.21.15.44:0/4163852990 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f5884152a60 0x7f588414bdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:50:13.264 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:13.271+0000 7f588a800640 1 -- 172.21.15.44:0/4163852990 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f5884152a60 msgr2=0x7f588414bdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:50:13.264 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:13.271+0000 7f588a800640 1 --2- 172.21.15.44:0/4163852990 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f5884152a60 0x7f588414bdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:50:13.264 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:13.271+0000 7f588a800640 1 -- 172.21.15.44:0/4163852990 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f58840c47c0 msgr2=0x7f5884143c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:50:13.264 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:13.271+0000 7f588a800640 1 --2- 172.21.15.44:0/4163852990 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f58840c47c0 0x7f5884143c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:50:13.264 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:13.271+0000 7f588a800640 1 -- 172.21.15.44:0/4163852990 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5884141b40 con 0x7f5884158eb0 2024-04-17T19:50:13.264 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:13.271+0000 7f588a800640 1 --2- 172.21.15.44:0/4163852990 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5884158eb0 0x7f588413e220 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f5880007d80 tx=0x7f588000e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:50:13.264 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:13.271+0000 7f587e000640 1 -- 172.21.15.44:0/4163852990 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5880014420 con 0x7f5884158eb0 2024-04-17T19:50:13.265 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:13.271+0000 7f587e000640 1 -- 172.21.15.44:0/4163852990 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5880019070 con 0x7f5884158eb0 2024-04-17T19:50:13.265 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:13.271+0000 7f587e000640 1 -- 172.21.15.44:0/4163852990 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5880014800 con 0x7f5884158eb0 2024-04-17T19:50:13.265 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:13.271+0000 7f588c800640 1 -- 172.21.15.44:0/4163852990 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5884143330 con 0x7f5884158eb0 2024-04-17T19:50:13.265 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:13.271+0000 7f588c800640 1 -- 172.21.15.44:0/4163852990 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5884141e00 con 0x7f5884158eb0 2024-04-17T19:50:13.265 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:13.271+0000 7f588c800640 1 -- 172.21.15.44:0/4163852990 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f588404ff10 con 0x7f5884158eb0 2024-04-17T19:50:13.266 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:13.275+0000 7f587e000640 1 -- 172.21.15.44:0/4163852990 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f58800149a0 con 0x7f5884158eb0 2024-04-17T19:50:13.266 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:13.275+0000 7f587e000640 1 --2- 172.21.15.44:0/4163852990 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f5868068380 0x7f586806a890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:50:13.266 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:13.275+0000 7f587e000640 1 -- 172.21.15.44:0/4163852990 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6619+0+0 (secure 0 0 0) 0x7f5880087440 con 0x7f5884158eb0 2024-04-17T19:50:13.266 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:13.275+0000 7f5889e00640 1 --2- 172.21.15.44:0/4163852990 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f5868068380 0x7f586806a890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:50:13.266 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:13.275+0000 7f5889e00640 1 --2- 172.21.15.44:0/4163852990 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f5868068380 0x7f586806a890 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f5878001770 tx=0x7f5878009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:50:13.269 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:13.279+0000 7f587e000640 1 -- 172.21.15.44:0/4163852990 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f5880057010 con 0x7f5884158eb0 2024-04-17T19:50:13.438 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:13.447+0000 7f588c800640 1 -- 172.21.15.44:0/4163852990 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f5884162ee0 con 0x7f5884158eb0 2024-04-17T19:50:13.440 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:13.447+0000 7f587e000640 1 -- 172.21.15.44:0/4163852990 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) ==== 74+0+18623 (secure 0 0 0) 0x7f588005b310 con 0x7f5884158eb0 2024-04-17T19:50:13.440 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-04-17T19:50:13.440 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":27,"fsid":"703f77ca-79c6-4a66-b576-62c526cb1021","created":"2024-04-17T19:46:30.831994+0000","modified":"2024-04-17T19:47:37.943331+0000","last_up_change":"2024-04-17T19:46:41.988197+0000","last_in_change":"2024-04-17T19:46:33.407430+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-17T19:46:41.940380+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-17T19:46:54.222150+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-17T19:46:55.031694+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-17T19:46:58.707529+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"30520dc6-eea6-43d4-ab60-3ca9e92329dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6800","nonce":1018735925},{"type":"v1","addr":"172.21.15.44:6801","nonce":1018735925}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6802","nonce":1018735925},{"type":"v1","addr":"172.21.15.44:6803","nonce":1018735925}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6806","nonce":1018735925},{"type":"v1","addr":"172.21.15.44:6807","nonce":1018735925}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6804","nonce":1018735925},{"type":"v1","addr":"172.21.15.44:6805","nonce":1018735925}]},"public_addr":"172.21.15.44:6801/1018735925","cluster_addr":"172.21.15.44:6803/1018735925","heartbeat_back_addr":"172.21.15.44:6807/1018735925","heartbeat_front_addr":"172.21.15.44:6805/1018735925","state":["exists","up"]},{"osd":1,"uuid":"079bd511-b6ce-449b-8f11-17b311b12f7c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6817","nonce":1452577434},{"type":"v1","addr":"172.21.15.44:6820","nonce":1452577434}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6823","nonce":1452577434},{"type":"v1","addr":"172.21.15.44:6825","nonce":1452577434}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6830","nonce":1452577434},{"type":"v1","addr":"172.21.15.44:6831","nonce":1452577434}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6828","nonce":1452577434},{"type":"v1","addr":"172.21.15.44:6829","nonce":1452577434}]},"public_addr":"172.21.15.44:6820/1452577434","cluster_addr":"172.21.15.44:6825/1452577434","heartbeat_back_addr":"172.21.15.44:6831/1452577434","heartbeat_front_addr":"172.21.15.44:6829/1452577434","state":["exists","up"]},{"osd":2,"uuid":"34f0b9ab-b1d2-4ee9-841c-f15afbb6bec5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6816","nonce":1160071918},{"type":"v1","addr":"172.21.15.44:6818","nonce":1160071918}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6819","nonce":1160071918},{"type":"v1","addr":"172.21.15.44:6821","nonce":1160071918}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6826","nonce":1160071918},{"type":"v1","addr":"172.21.15.44:6827","nonce":1160071918}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6822","nonce":1160071918},{"type":"v1","addr":"172.21.15.44:6824","nonce":1160071918}]},"public_addr":"172.21.15.44:6818/1160071918","cluster_addr":"172.21.15.44:6821/1160071918","heartbeat_back_addr":"172.21.15.44:6827/1160071918","heartbeat_front_addr":"172.21.15.44:6824/1160071918","state":["exists","up"]},{"osd":3,"uuid":"4740032d-fe34-4b1b-bb85-f430896fc3c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6808","nonce":4236454921},{"type":"v1","addr":"172.21.15.44:6809","nonce":4236454921}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6810","nonce":4236454921},{"type":"v1","addr":"172.21.15.44:6811","nonce":4236454921}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6814","nonce":4236454921},{"type":"v1","addr":"172.21.15.44:6815","nonce":4236454921}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6812","nonce":4236454921},{"type":"v1","addr":"172.21.15.44:6813","nonce":4236454921}]},"public_addr":"172.21.15.44:6809/4236454921","cluster_addr":"172.21.15.44:6811/4236454921","heartbeat_back_addr":"172.21.15.44:6815/4236454921","heartbeat_front_addr":"172.21.15.44:6813/4236454921","state":["exists","up"]},{"osd":4,"uuid":"7dbedb00-302d-4d52-810c-e18839254da1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6800","nonce":2293251376},{"type":"v1","addr":"172.21.15.62:6801","nonce":2293251376}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6802","nonce":2293251376},{"type":"v1","addr":"172.21.15.62:6803","nonce":2293251376}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6806","nonce":2293251376},{"type":"v1","addr":"172.21.15.62:6807","nonce":2293251376}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6804","nonce":2293251376},{"type":"v1","addr":"172.21.15.62:6805","nonce":2293251376}]},"public_addr":"172.21.15.62:6801/2293251376","cluster_addr":"172.21.15.62:6803/2293251376","heartbeat_back_addr":"172.21.15.62:6807/2293251376","heartbeat_front_addr":"172.21.15.62:6805/2293251376","state":["exists","up"]},{"osd":5,"uuid":"38c1e8d9-393d-4f33-a97a-3295cf5c5b07","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6808","nonce":1551020300},{"type":"v1","addr":"172.21.15.62:6809","nonce":1551020300}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6810","nonce":1551020300},{"type":"v1","addr":"172.21.15.62:6811","nonce":1551020300}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6814","nonce":1551020300},{"type":"v1","addr":"172.21.15.62:6815","nonce":1551020300}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6812","nonce":1551020300},{"type":"v1","addr":"172.21.15.62:6813","nonce":1551020300}]},"public_addr":"172.21.15.62:6809/1551020300","cluster_addr":"172.21.15.62:6811/1551020300","heartbeat_back_addr":"172.21.15.62:6815/1551020300","heartbeat_front_addr":"172.21.15.62:6813/1551020300","state":["exists","up"]},{"osd":6,"uuid":"f6ff81c6-f14d-4477-88e3-9116cc5a2992","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6824","nonce":2602310256},{"type":"v1","addr":"172.21.15.62:6825","nonce":2602310256}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6826","nonce":2602310256},{"type":"v1","addr":"172.21.15.62:6827","nonce":2602310256}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6830","nonce":2602310256},{"type":"v1","addr":"172.21.15.62:6831","nonce":2602310256}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6828","nonce":2602310256},{"type":"v1","addr":"172.21.15.62:6829","nonce":2602310256}]},"public_addr":"172.21.15.62:6825/2602310256","cluster_addr":"172.21.15.62:6827/2602310256","heartbeat_back_addr":"172.21.15.62:6831/2602310256","heartbeat_front_addr":"172.21.15.62:6829/2602310256","state":["exists","up"]},{"osd":7,"uuid":"ce395bc3-bcb5-4b94-a523-5bb9df491eca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6816","nonce":2912738359},{"type":"v1","addr":"172.21.15.62:6817","nonce":2912738359}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6818","nonce":2912738359},{"type":"v1","addr":"172.21.15.62:6819","nonce":2912738359}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6822","nonce":2912738359},{"type":"v1","addr":"172.21.15.62:6823","nonce":2912738359}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6820","nonce":2912738359},{"type":"v1","addr":"172.21.15.62:6821","nonce":2912738359}]},"public_addr":"172.21.15.62:6817/2912738359","cluster_addr":"172.21.15.62:6819/2912738359","heartbeat_back_addr":"172.21.15.62:6823/2912738359","heartbeat_front_addr":"172.21.15.62:6821/2912738359","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T19:46:39.302883+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T19:46:39.177705+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T19:46:39.188894+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T19:46:39.313009+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T19:46:38.870508+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T19:46:38.790900+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T19:46:38.979163+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T19:46:38.992348+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.c","mappings":[{"from":0,"to":4}]},{"pgid":"3.15","mappings":[{"from":0,"to":7}]},{"pgid":"4.f","mappings":[{"from":7,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-17T19:50:13.442 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:13.451+0000 7f588c800640 1 -- 172.21.15.44:0/4163852990 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f5868068380 msgr2=0x7f586806a890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:50:13.442 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:13.451+0000 7f588c800640 1 --2- 172.21.15.44:0/4163852990 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f5868068380 0x7f586806a890 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f5878001770 tx=0x7f5878009040 comp rx=0 tx=0).stop 2024-04-17T19:50:13.442 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:13.451+0000 7f588c800640 1 -- 172.21.15.44:0/4163852990 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5884158eb0 msgr2=0x7f588413e220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:50:13.443 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:13.451+0000 7f588c800640 1 --2- 172.21.15.44:0/4163852990 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5884158eb0 0x7f588413e220 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f5880007d80 tx=0x7f588000e4b0 comp rx=0 tx=0).stop 2024-04-17T19:50:13.443 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:13.451+0000 7f588c800640 1 -- 172.21.15.44:0/4163852990 shutdown_connections 2024-04-17T19:50:13.443 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:13.451+0000 7f588c800640 1 --2- 172.21.15.44:0/4163852990 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f5868068380 0x7f586806a890 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:50:13.443 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:13.451+0000 7f588c800640 1 --2- 172.21.15.44:0/4163852990 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f5884152a60 0x7f588414bdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:50:13.443 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:13.451+0000 7f588c800640 1 --2- 172.21.15.44:0/4163852990 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5884158eb0 0x7f588413e220 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:50:13.443 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:13.451+0000 7f588c800640 1 --2- 172.21.15.44:0/4163852990 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f58840c47c0 0x7f5884143c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:50:13.443 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:13.451+0000 7f588c800640 1 -- 172.21.15.44:0/4163852990 >> 172.21.15.44:0/4163852990 conn(0x7f588406c380 msgr2=0x7f58841458c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:50:13.443 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:13.451+0000 7f588c800640 1 -- 172.21.15.44:0/4163852990 shutdown_connections 2024-04-17T19:50:13.444 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:13.451+0000 7f588c800640 1 -- 172.21.15.44:0/4163852990 wait complete. 2024-04-17T19:50:13.462 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-17T19:46:41.940380+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-17T19:46:54.222150+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-17T19:46:55.031694+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-04-17T19:46:58.707529+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-04-17T19:50:13.463 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-17T19:50:13.618 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:13.627+0000 7f3eb5600640 1 Processor -- start 2024-04-17T19:50:13.618 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:13.627+0000 7f3eb5600640 1 -- start start 2024-04-17T19:50:13.620 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:13.627+0000 7f3eb5600640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f3eb00c68b0 0x7f3eb00c47e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:50:13.620 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:13.627+0000 7f3eb5600640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f3eb00c4d20 0x7f3eb00c80a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:50:13.620 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:13.627+0000 7f3eb5600640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3eb00c4000 con 0x7f3eb0152860 2024-04-17T19:50:13.620 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:13.627+0000 7f3eb5600640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 -- 0x7f3eb00c6eb0 con 0x7f3eb00c68b0 2024-04-17T19:50:13.620 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:13.627+0000 7f3eb5600640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 -- 0x7f3eb00c78e0 con 0x7f3eb00c4d20 2024-04-17T19:50:13.620 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:13.627+0000 7f3ea7e00640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f3eb00c68b0 0x7f3eb00c47e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:50:13.620 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:13.627+0000 7f3ea7e00640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f3eb00c68b0 0x7f3eb00c47e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:41088/0 (socket says 172.21.15.44:41088) 2024-04-17T19:50:13.621 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:13.627+0000 7f3ea7e00640 1 -- 172.21.15.44:0/4178089642 learned_addr learned my addr 172.21.15.44:0/4178089642 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-04-17T19:50:13.621 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:13.631+0000 7f3eaf400640 1 --2- 172.21.15.44:0/4178089642 >> v2:172.21.15.62:3300/0 conn(0x7f3eb00c4d20 0x7f3eb00c80a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:50:13.621 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:13.631+0000 7f3ea7e00640 1 -- 172.21.15.44:0/4178089642 >> v2:172.21.15.62:3300/0 conn(0x7f3eb00c4d20 msgr2=0x7f3eb00c80a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T19:50:13.621 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:13.631+0000 7f3ea7e00640 1 --2- 172.21.15.44:0/4178089642 >> v2:172.21.15.62:3300/0 conn(0x7f3eb00c4d20 0x7f3eb00c80a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:50:13.621 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:13.631+0000 7f3ea7e00640 1 -- 172.21.15.44:0/4178089642 >> v1:172.21.15.44:6789/0 conn(0x7f3eb0152860 legacy=0x7f3eb0159140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:50:13.621 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:13.631+0000 7f3ea7e00640 1 -- 172.21.15.44:0/4178089642 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3eb00c42e0 con 0x7f3eb00c68b0 2024-04-17T19:50:13.623 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:13.631+0000 7f3ea7e00640 1 --2- 172.21.15.44:0/4178089642 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3eb00c68b0 0x7f3eb00c47e0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f3eb006f6b0 tx=0x7f3e9801c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1ca1473ace122713 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:50:13.623 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:13.631+0000 7f3eae000640 1 -- 172.21.15.44:0/4178089642 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e980b0070 con 0x7f3eb00c68b0 2024-04-17T19:50:13.623 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:13.631+0000 7f3eae000640 1 -- 172.21.15.44:0/4178089642 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3e980ab600 con 0x7f3eb00c68b0 2024-04-17T19:50:13.623 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:13.631+0000 7f3eae000640 1 -- 172.21.15.44:0/4178089642 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e980ab9d0 con 0x7f3eb00c68b0 2024-04-17T19:50:13.624 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:13.635+0000 7f3eb5600640 1 -- 172.21.15.44:0/4178089642 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3eb00c68b0 msgr2=0x7f3eb00c47e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:50:13.624 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:13.635+0000 7f3eb5600640 1 --2- 172.21.15.44:0/4178089642 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3eb00c68b0 0x7f3eb00c47e0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f3eb006f6b0 tx=0x7f3e9801c490 comp rx=0 tx=0).stop 2024-04-17T19:50:13.625 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:13.635+0000 7f3eb5600640 1 -- 172.21.15.44:0/4178089642 shutdown_connections 2024-04-17T19:50:13.625 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:13.635+0000 7f3eb5600640 1 --2- 172.21.15.44:0/4178089642 >> v2:172.21.15.62:3300/0 conn(0x7f3eb00c4d20 0x7f3eb00c80a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:50:13.625 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:13.635+0000 7f3eb5600640 1 --2- 172.21.15.44:0/4178089642 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3eb00c68b0 0x7f3eb00c47e0 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:50:13.625 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:13.635+0000 7f3eb5600640 1 -- 172.21.15.44:0/4178089642 >> 172.21.15.44:0/4178089642 conn(0x7f3eb006c380 msgr2=0x7f3eb0070080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:50:13.625 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:13.635+0000 7f3eb5600640 1 -- 172.21.15.44:0/4178089642 shutdown_connections 2024-04-17T19:50:13.625 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:13.635+0000 7f3eb5600640 1 -- 172.21.15.44:0/4178089642 wait complete. 2024-04-17T19:50:13.626 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:13.635+0000 7f3eb5600640 1 Processor -- start 2024-04-17T19:50:13.626 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:13.635+0000 7f3eb5600640 1 -- start start 2024-04-17T19:50:13.628 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:13.639+0000 7f3eb5600640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3eb00c4d20 0x7f3eb014e9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:50:13.629 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:13.639+0000 7f3eb5600640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f3eb00c68b0 0x7f3eb0147530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:50:13.629 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:13.639+0000 7f3eb5600640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3eb0152860 0x7f3eb01f8410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:50:13.629 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:13.639+0000 7f3eb5600640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f3eb00c89f0 con 0x7f3eb0152860 2024-04-17T19:50:13.629 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:13.639+0000 7f3eb5600640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f3eb00c5130 con 0x7f3eb00c4d20 2024-04-17T19:50:13.629 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:13.639+0000 7f3eb5600640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7f3eb0165a70 con 0x7f3eb00c68b0 2024-04-17T19:50:13.629 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:13.639+0000 7f3eaf400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3eb0152860 0x7f3eb01f8410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:50:13.629 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:13.639+0000 7f3eaf400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3eb0152860 0x7f3eb01f8410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:41090/0 (socket says 172.21.15.44:41090) 2024-04-17T19:50:13.629 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:13.639+0000 7f3eaf400640 1 -- 172.21.15.44:0/3943478052 learned_addr learned my addr 172.21.15.44:0/3943478052 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-04-17T19:50:13.629 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:13.639+0000 7f3ea7e00640 1 --2- 172.21.15.44:0/3943478052 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f3eb00c68b0 0x7f3eb0147530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:50:13.629 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:13.639+0000 7f3eaea00640 1 --2- 172.21.15.44:0/3943478052 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3eb00c4d20 0x7f3eb014e9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:50:13.629 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:13.639+0000 7f3eaf400640 1 -- 172.21.15.44:0/3943478052 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f3eb00c68b0 msgr2=0x7f3eb0147530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:50:13.629 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:13.639+0000 7f3eaf400640 1 --2- 172.21.15.44:0/3943478052 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f3eb00c68b0 0x7f3eb0147530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:50:13.629 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:13.639+0000 7f3eaf400640 1 -- 172.21.15.44:0/3943478052 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3eb00c4d20 msgr2=0x7f3eb014e9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:50:13.630 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:13.639+0000 7f3eaf400640 1 --2- 172.21.15.44:0/3943478052 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3eb00c4d20 0x7f3eb014e9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:50:13.630 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:13.639+0000 7f3eaf400640 1 -- 172.21.15.44:0/3943478052 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3eb0147a70 con 0x7f3eb0152860 2024-04-17T19:50:13.630 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:13.639+0000 7f3eaf400640 1 --2- 172.21.15.44:0/3943478052 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3eb0152860 0x7f3eb01f8410 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f3ea8009fd0 tx=0x7f3ea800e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:50:13.631 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:13.639+0000 7f3ea6a00640 1 -- 172.21.15.44:0/3943478052 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ea8014420 con 0x7f3eb0152860 2024-04-17T19:50:13.631 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:13.639+0000 7f3ea6a00640 1 -- 172.21.15.44:0/3943478052 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3ea8019070 con 0x7f3eb0152860 2024-04-17T19:50:13.631 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:13.639+0000 7f3eb5600640 1 -- 172.21.15.44:0/3943478052 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3eb014e2e0 con 0x7f3eb0152860 2024-04-17T19:50:13.631 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:13.639+0000 7f3ea6a00640 1 -- 172.21.15.44:0/3943478052 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ea8014800 con 0x7f3eb0152860 2024-04-17T19:50:13.631 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:13.639+0000 7f3eb5600640 1 -- 172.21.15.44:0/3943478052 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3eb0146a50 con 0x7f3eb0152860 2024-04-17T19:50:13.631 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:13.639+0000 7f3eb5600640 1 -- 172.21.15.44:0/3943478052 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3eb004ff10 con 0x7f3eb0152860 2024-04-17T19:50:13.632 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:13.639+0000 7f3ea6a00640 1 -- 172.21.15.44:0/3943478052 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f3ea80149a0 con 0x7f3eb0152860 2024-04-17T19:50:13.632 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:13.643+0000 7f3ea6a00640 1 --2- 172.21.15.44:0/3943478052 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f3e8c068380 0x7f3e8c06a890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:50:13.632 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:13.643+0000 7f3ea6a00640 1 -- 172.21.15.44:0/3943478052 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6619+0+0 (secure 0 0 0) 0x7f3ea80874b0 con 0x7f3eb0152860 2024-04-17T19:50:13.633 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:13.643+0000 7f3eaea00640 1 --2- 172.21.15.44:0/3943478052 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f3e8c068380 0x7f3e8c06a890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:50:13.634 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:13.643+0000 7f3eaea00640 1 --2- 172.21.15.44:0/3943478052 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f3e8c068380 0x7f3e8c06a890 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f3eb00c3410 tx=0x7f3ea0009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:50:13.636 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:13.647+0000 7f3ea6a00640 1 -- 172.21.15.44:0/3943478052 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f3ea8011260 con 0x7f3eb0152860 2024-04-17T19:50:13.800 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:13.811+0000 7f3eb5600640 1 -- 172.21.15.44:0/3943478052 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f3eb00c7e80 con 0x7f3eb0152860 2024-04-17T19:50:13.801 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:13.811+0000 7f3ea6a00640 1 -- 172.21.15.44:0/3943478052 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v27) ==== 93+0+10 (secure 0 0 0) 0x7f3ea8057770 con 0x7f3eb0152860 2024-04-17T19:50:13.801 INFO:teuthology.orchestra.run.smithi044.stdout:pg_num: 1 2024-04-17T19:50:13.803 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:13.811+0000 7f3eb5600640 1 -- 172.21.15.44:0/3943478052 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f3e8c068380 msgr2=0x7f3e8c06a890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:50:13.803 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:13.811+0000 7f3eb5600640 1 --2- 172.21.15.44:0/3943478052 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f3e8c068380 0x7f3e8c06a890 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f3eb00c3410 tx=0x7f3ea0009040 comp rx=0 tx=0).stop 2024-04-17T19:50:13.803 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:13.811+0000 7f3eb5600640 1 -- 172.21.15.44:0/3943478052 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3eb0152860 msgr2=0x7f3eb01f8410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:50:13.803 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:13.811+0000 7f3eb5600640 1 --2- 172.21.15.44:0/3943478052 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3eb0152860 0x7f3eb01f8410 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f3ea8009fd0 tx=0x7f3ea800e4b0 comp rx=0 tx=0).stop 2024-04-17T19:50:13.803 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:13.811+0000 7f3eb5600640 1 -- 172.21.15.44:0/3943478052 shutdown_connections 2024-04-17T19:50:13.803 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:13.811+0000 7f3eb5600640 1 --2- 172.21.15.44:0/3943478052 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f3e8c068380 0x7f3e8c06a890 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:50:13.803 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:13.811+0000 7f3eb5600640 1 --2- 172.21.15.44:0/3943478052 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f3eb00c68b0 0x7f3eb0147530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:50:13.804 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:13.811+0000 7f3eb5600640 1 --2- 172.21.15.44:0/3943478052 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3eb0152860 0x7f3eb01f8410 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:50:13.804 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:13.811+0000 7f3eb5600640 1 --2- 172.21.15.44:0/3943478052 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3eb00c4d20 0x7f3eb014e9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:50:13.804 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:13.811+0000 7f3eb5600640 1 -- 172.21.15.44:0/3943478052 >> 172.21.15.44:0/3943478052 conn(0x7f3eb006c380 msgr2=0x7f3eb0151950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:50:13.804 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:13.811+0000 7f3eb5600640 1 -- 172.21.15.44:0/3943478052 shutdown_connections 2024-04-17T19:50:13.804 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:13.811+0000 7f3eb5600640 1 -- 172.21.15.44:0/3943478052 wait complete. 2024-04-17T19:50:13.823 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-17T19:50:13.979 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:13.987+0000 7ffa2bc00640 1 Processor -- start 2024-04-17T19:50:13.980 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:13.987+0000 7ffa2bc00640 1 -- start start 2024-04-17T19:50:13.982 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:13.991+0000 7ffa2bc00640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7ffa240c7cc0 0x7ffa24072e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:50:13.982 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:13.991+0000 7ffa2bc00640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7ffa240c47c0 0x7ffa240733c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:50:13.982 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:13.991+0000 7ffa2bc00640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ffa24073f90 con 0x7ffa240c8740 2024-04-17T19:50:13.982 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:13.991+0000 7ffa2bc00640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 -- 0x7ffa24074270 con 0x7ffa240c47c0 2024-04-17T19:50:13.982 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:13.991+0000 7ffa2bc00640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7ffa240c94d0 con 0x7ffa240c7cc0 2024-04-17T19:50:13.982 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:13.991+0000 7ffa23e00640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7ffa240c47c0 0x7ffa240733c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:50:13.983 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:13.991+0000 7ffa23e00640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7ffa240c47c0 0x7ffa240733c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:41092/0 (socket says 172.21.15.44:41092) 2024-04-17T19:50:13.983 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:13.991+0000 7ffa23e00640 1 -- 172.21.15.44:0/2998611414 learned_addr learned my addr 172.21.15.44:0/2998611414 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-04-17T19:50:13.983 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:13.991+0000 7ffa29200640 1 --2- 172.21.15.44:0/2998611414 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7ffa240c7cc0 0x7ffa24072e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:50:13.983 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:13.991+0000 7ffa23e00640 1 -- 172.21.15.44:0/2998611414 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7ffa240c7cc0 msgr2=0x7ffa24072e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T19:50:13.983 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:13.991+0000 7ffa23e00640 1 --2- 172.21.15.44:0/2998611414 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7ffa240c7cc0 0x7ffa24072e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:50:13.983 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:13.991+0000 7ffa23e00640 1 -- 172.21.15.44:0/2998611414 >> v1:172.21.15.62:6789/0 conn(0x7ffa240c8740 legacy=0x7ffa240c8b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:50:13.983 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:13.991+0000 7ffa23e00640 1 -- 172.21.15.44:0/2998611414 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffa240c97b0 con 0x7ffa240c47c0 2024-04-17T19:50:13.985 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:13.995+0000 7ffa23e00640 1 --2- 172.21.15.44:0/2998611414 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ffa240c47c0 0x7ffa240733c0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7ffa10009870 tx=0x7ffa1001c560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=516f4e507f412ee6 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:50:13.985 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:13.995+0000 7ffa23400640 1 -- 172.21.15.44:0/2998611414 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa100b2070 con 0x7ffa240c47c0 2024-04-17T19:50:13.985 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:13.995+0000 7ffa23400640 1 -- 172.21.15.44:0/2998611414 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffa100a9070 con 0x7ffa240c47c0 2024-04-17T19:50:13.985 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:13.995+0000 7ffa23400640 1 -- 172.21.15.44:0/2998611414 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa100ad880 con 0x7ffa240c47c0 2024-04-17T19:50:13.986 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:13.995+0000 7ffa2bc00640 1 -- 172.21.15.44:0/2998611414 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ffa240c47c0 msgr2=0x7ffa240733c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:50:13.986 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:13.995+0000 7ffa2bc00640 1 --2- 172.21.15.44:0/2998611414 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ffa240c47c0 0x7ffa240733c0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7ffa10009870 tx=0x7ffa1001c560 comp rx=0 tx=0).stop 2024-04-17T19:50:13.986 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:13.995+0000 7ffa2bc00640 1 -- 172.21.15.44:0/2998611414 shutdown_connections 2024-04-17T19:50:13.986 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:13.995+0000 7ffa2bc00640 1 --2- 172.21.15.44:0/2998611414 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ffa240c47c0 0x7ffa240733c0 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:50:13.986 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:13.995+0000 7ffa2bc00640 1 --2- 172.21.15.44:0/2998611414 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7ffa240c7cc0 0x7ffa24072e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:50:13.986 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:13.995+0000 7ffa2bc00640 1 -- 172.21.15.44:0/2998611414 >> 172.21.15.44:0/2998611414 conn(0x7ffa240c9dc0 msgr2=0x7ffa240ca1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:50:13.986 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:13.995+0000 7ffa2bc00640 1 -- 172.21.15.44:0/2998611414 shutdown_connections 2024-04-17T19:50:13.986 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:13.995+0000 7ffa2bc00640 1 -- 172.21.15.44:0/2998611414 wait complete. 2024-04-17T19:50:13.988 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:13.999+0000 7ffa2bc00640 1 Processor -- start 2024-04-17T19:50:13.988 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:13.999+0000 7ffa2bc00640 1 -- start start 2024-04-17T19:50:13.990 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:13.999+0000 7ffa2bc00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ffa240c47c0 0x7ffa24142b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:50:13.991 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:13.999+0000 7ffa2bc00640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7ffa240c7cc0 0x7ffa2415d0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:50:13.991 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:13.999+0000 7ffa2bc00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ffa240c8740 0x7ffa2415da90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:50:13.991 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:13.999+0000 7ffa2bc00640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7ffa24168ef0 con 0x7ffa240c8740 2024-04-17T19:50:13.991 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:13.999+0000 7ffa2bc00640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7ffa24168d70 con 0x7ffa240c47c0 2024-04-17T19:50:13.991 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:13.999+0000 7ffa2bc00640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7ffa24169070 con 0x7ffa240c7cc0 2024-04-17T19:50:13.991 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:13.999+0000 7ffa29c00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ffa240c8740 0x7ffa2415da90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:50:13.991 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:13.999+0000 7ffa29c00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ffa240c8740 0x7ffa2415da90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:41094/0 (socket says 172.21.15.44:41094) 2024-04-17T19:50:13.991 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:13.999+0000 7ffa29c00640 1 -- 172.21.15.44:0/2270149953 learned_addr learned my addr 172.21.15.44:0/2270149953 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-04-17T19:50:13.991 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:13.999+0000 7ffa29200640 1 --2- 172.21.15.44:0/2270149953 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ffa240c47c0 0x7ffa24142b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:50:13.991 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:13.999+0000 7ffa23e00640 1 --2- 172.21.15.44:0/2270149953 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7ffa240c7cc0 0x7ffa2415d0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:50:13.991 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:13.999+0000 7ffa29c00640 1 -- 172.21.15.44:0/2270149953 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7ffa240c7cc0 msgr2=0x7ffa2415d0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:50:13.991 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:13.999+0000 7ffa29c00640 1 --2- 172.21.15.44:0/2270149953 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7ffa240c7cc0 0x7ffa2415d0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:50:13.991 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:13.999+0000 7ffa29c00640 1 -- 172.21.15.44:0/2270149953 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ffa240c47c0 msgr2=0x7ffa24142b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:50:13.992 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:13.999+0000 7ffa29c00640 1 --2- 172.21.15.44:0/2270149953 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ffa240c47c0 0x7ffa24142b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:50:13.992 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:13.999+0000 7ffa29c00640 1 -- 172.21.15.44:0/2270149953 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffa241573f0 con 0x7ffa240c8740 2024-04-17T19:50:13.992 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:13.999+0000 7ffa29c00640 1 --2- 172.21.15.44:0/2270149953 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ffa240c8740 0x7ffa2415da90 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7ffa1c00c730 tx=0x7ffa1c00cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:50:13.993 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:13.999+0000 7ffa20c00640 1 -- 172.21.15.44:0/2270149953 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa1c003b80 con 0x7ffa240c8740 2024-04-17T19:50:13.993 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:13.999+0000 7ffa20c00640 1 -- 172.21.15.44:0/2270149953 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffa1c003d20 con 0x7ffa240c8740 2024-04-17T19:50:13.993 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:13.999+0000 7ffa20c00640 1 -- 172.21.15.44:0/2270149953 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa1c005310 con 0x7ffa240c8740 2024-04-17T19:50:13.993 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:13.999+0000 7ffa2bc00640 1 -- 172.21.15.44:0/2270149953 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffa24156350 con 0x7ffa240c8740 2024-04-17T19:50:13.993 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:13.999+0000 7ffa2bc00640 1 -- 172.21.15.44:0/2270149953 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffa24156910 con 0x7ffa240c8740 2024-04-17T19:50:13.993 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:14.003+0000 7ffa2bc00640 1 -- 172.21.15.44:0/2270149953 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffa2404ff10 con 0x7ffa240c8740 2024-04-17T19:50:13.993 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:14.003+0000 7ffa20c00640 1 -- 172.21.15.44:0/2270149953 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7ffa1c0056c0 con 0x7ffa240c8740 2024-04-17T19:50:13.994 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:14.003+0000 7ffa20c00640 1 --2- 172.21.15.44:0/2270149953 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7ffa040683b0 0x7ffa0406a8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:50:13.994 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:14.003+0000 7ffa20c00640 1 -- 172.21.15.44:0/2270149953 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6619+0+0 (secure 0 0 0) 0x7ffa1c086d00 con 0x7ffa240c8740 2024-04-17T19:50:13.995 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:14.003+0000 7ffa29200640 1 --2- 172.21.15.44:0/2270149953 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7ffa040683b0 0x7ffa0406a8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:50:13.996 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:14.003+0000 7ffa29200640 1 --2- 172.21.15.44:0/2270149953 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7ffa040683b0 0x7ffa0406a8c0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7ffa180079c0 tx=0x7ffa18008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:50:13.999 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:14.007+0000 7ffa20c00640 1 -- 172.21.15.44:0/2270149953 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7ffa1c056840 con 0x7ffa240c8740 2024-04-17T19:50:14.161 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:14.171+0000 7ffa2bc00640 1 -- 172.21.15.44:0/2270149953 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7ffa2415ceb0 con 0x7ffa240c8740 2024-04-17T19:50:14.161 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:14.171+0000 7ffa20c00640 1 -- 172.21.15.44:0/2270149953 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v27) ==== 104+0+11 (secure 0 0 0) 0x7ffa1c05ab40 con 0x7ffa240c8740 2024-04-17T19:50:14.162 INFO:teuthology.orchestra.run.smithi044.stdout:pg_num: 32 2024-04-17T19:50:14.164 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:14.171+0000 7ffa2bc00640 1 -- 172.21.15.44:0/2270149953 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7ffa040683b0 msgr2=0x7ffa0406a8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:50:14.164 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:14.171+0000 7ffa2bc00640 1 --2- 172.21.15.44:0/2270149953 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7ffa040683b0 0x7ffa0406a8c0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7ffa180079c0 tx=0x7ffa18008040 comp rx=0 tx=0).stop 2024-04-17T19:50:14.164 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:14.171+0000 7ffa2bc00640 1 -- 172.21.15.44:0/2270149953 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ffa240c8740 msgr2=0x7ffa2415da90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:50:14.165 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:14.171+0000 7ffa2bc00640 1 --2- 172.21.15.44:0/2270149953 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ffa240c8740 0x7ffa2415da90 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7ffa1c00c730 tx=0x7ffa1c00cbf0 comp rx=0 tx=0).stop 2024-04-17T19:50:14.165 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:14.171+0000 7ffa2bc00640 1 -- 172.21.15.44:0/2270149953 shutdown_connections 2024-04-17T19:50:14.165 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:14.171+0000 7ffa2bc00640 1 --2- 172.21.15.44:0/2270149953 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7ffa040683b0 0x7ffa0406a8c0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:50:14.165 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:14.171+0000 7ffa2bc00640 1 --2- 172.21.15.44:0/2270149953 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7ffa240c7cc0 0x7ffa2415d0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:50:14.165 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:14.171+0000 7ffa2bc00640 1 --2- 172.21.15.44:0/2270149953 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ffa240c8740 0x7ffa2415da90 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:50:14.165 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:14.171+0000 7ffa2bc00640 1 --2- 172.21.15.44:0/2270149953 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ffa240c47c0 0x7ffa24142b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:50:14.165 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:14.171+0000 7ffa2bc00640 1 -- 172.21.15.44:0/2270149953 >> 172.21.15.44:0/2270149953 conn(0x7ffa240c9dc0 msgr2=0x7ffa24153740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:50:14.166 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:14.171+0000 7ffa2bc00640 1 -- 172.21.15.44:0/2270149953 shutdown_connections 2024-04-17T19:50:14.166 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:14.171+0000 7ffa2bc00640 1 -- 172.21.15.44:0/2270149953 wait complete. 2024-04-17T19:50:14.184 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-17T19:50:14.339 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:14.347+0000 7fc487e00640 1 Processor -- start 2024-04-17T19:50:14.339 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:14.347+0000 7fc487e00640 1 -- start start 2024-04-17T19:50:14.341 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:14.351+0000 7fc487e00640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fc4880ca2b0 0x7fc488155cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:50:14.341 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:14.351+0000 7fc487e00640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc4880ca890 con 0x7fc4880cefe0 2024-04-17T19:50:14.342 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:14.351+0000 7fc487e00640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc48815bb40 con 0x7fc4880cbee0 2024-04-17T19:50:14.342 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:14.351+0000 7fc487e00640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 -- 0x7fc48815c710 con 0x7fc4880ca2b0 2024-04-17T19:50:14.342 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:14.351+0000 7fc486a00640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fc4880ca2b0 0x7fc488155cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:50:14.342 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:14.351+0000 7fc486a00640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fc4880ca2b0 0x7fc488155cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:41104/0 (socket says 172.21.15.44:41104) 2024-04-17T19:50:14.342 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:14.351+0000 7fc486a00640 1 -- 172.21.15.44:0/3883928662 learned_addr learned my addr 172.21.15.44:0/3883928662 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-04-17T19:50:14.342 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:14.351+0000 7fc47e000640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7fc4880cefe0 0x7fc4880cb7d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:48662/0 (socket says 172.21.15.44:48662) 2024-04-17T19:50:14.342 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:14.351+0000 7fc486a00640 1 -- 172.21.15.44:0/3883928662 >> v1:172.21.15.62:6789/0 conn(0x7fc4880cbee0 legacy=0x7fc488166260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:50:14.342 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:14.351+0000 7fc486a00640 1 -- 172.21.15.44:0/3883928662 >> v1:172.21.15.44:6789/0 conn(0x7fc4880cefe0 legacy=0x7fc4880cb7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:50:14.342 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:14.351+0000 7fc486a00640 1 -- 172.21.15.44:0/3883928662 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc48815bde0 con 0x7fc4880ca2b0 2024-04-17T19:50:14.345 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:14.355+0000 7fc486a00640 1 --2- 172.21.15.44:0/3883928662 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc4880ca2b0 0x7fc488155cb0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7fc478009870 tx=0x7fc47801c560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b4662cc16e72baab server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:50:14.345 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:14.355+0000 7fc486000640 1 -- 172.21.15.44:0/3883928662 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4780a7070 con 0x7fc4880ca2b0 2024-04-17T19:50:14.345 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:14.355+0000 7fc486000640 1 -- 172.21.15.44:0/3883928662 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc4780b0070 con 0x7fc4880ca2b0 2024-04-17T19:50:14.345 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:14.355+0000 7fc486000640 1 -- 172.21.15.44:0/3883928662 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4780ab890 con 0x7fc4880ca2b0 2024-04-17T19:50:14.346 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:14.355+0000 7fc487e00640 1 -- 172.21.15.44:0/3883928662 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc4880ca2b0 msgr2=0x7fc488155cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:50:14.346 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:14.355+0000 7fc487e00640 1 --2- 172.21.15.44:0/3883928662 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc4880ca2b0 0x7fc488155cb0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7fc478009870 tx=0x7fc47801c560 comp rx=0 tx=0).stop 2024-04-17T19:50:14.346 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:14.355+0000 7fc487e00640 1 -- 172.21.15.44:0/3883928662 shutdown_connections 2024-04-17T19:50:14.346 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:14.355+0000 7fc487e00640 1 --2- 172.21.15.44:0/3883928662 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc4880ca2b0 0x7fc488155cb0 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:50:14.346 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:14.355+0000 7fc487e00640 1 -- 172.21.15.44:0/3883928662 >> 172.21.15.44:0/3883928662 conn(0x7fc488072410 msgr2=0x7fc488072820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:50:14.347 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:14.355+0000 7fc487e00640 1 -- 172.21.15.44:0/3883928662 shutdown_connections 2024-04-17T19:50:14.347 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:14.355+0000 7fc487e00640 1 -- 172.21.15.44:0/3883928662 wait complete. 2024-04-17T19:50:14.348 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:14.359+0000 7fc487e00640 1 Processor -- start 2024-04-17T19:50:14.348 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:14.359+0000 7fc487e00640 1 -- start start 2024-04-17T19:50:14.351 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:14.359+0000 7fc487e00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc4880ca2b0 0x7fc4880c6ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:50:14.352 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:14.359+0000 7fc487e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc4880cbee0 0x7fc48814d940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:50:14.352 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:14.359+0000 7fc487e00640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fc4880cefe0 0x7fc4881464e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:50:14.352 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:14.359+0000 7fc487e00640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fc4880cb030 con 0x7fc4880cbee0 2024-04-17T19:50:14.352 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:14.359+0000 7fc487e00640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7fc4880cf800 con 0x7fc4880ca2b0 2024-04-17T19:50:14.352 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:14.359+0000 7fc487e00640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7fc4880cb1b0 con 0x7fc4880cefe0 2024-04-17T19:50:14.352 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:14.359+0000 7fc47e000640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc4880cbee0 0x7fc48814d940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:50:14.352 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:14.359+0000 7fc47e000640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc4880cbee0 0x7fc48814d940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:41110/0 (socket says 172.21.15.44:41110) 2024-04-17T19:50:14.352 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:14.359+0000 7fc47e000640 1 -- 172.21.15.44:0/1597292007 learned_addr learned my addr 172.21.15.44:0/1597292007 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-04-17T19:50:14.352 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:14.359+0000 7fc486a00640 1 --2- 172.21.15.44:0/1597292007 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc4880ca2b0 0x7fc4880c6ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:50:14.352 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:14.359+0000 7fc487400640 1 --2- 172.21.15.44:0/1597292007 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fc4880cefe0 0x7fc4881464e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:50:14.352 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:14.359+0000 7fc47e000640 1 -- 172.21.15.44:0/1597292007 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fc4880cefe0 msgr2=0x7fc4881464e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:50:14.352 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:14.359+0000 7fc47e000640 1 --2- 172.21.15.44:0/1597292007 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fc4880cefe0 0x7fc4881464e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:50:14.352 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:14.359+0000 7fc47e000640 1 -- 172.21.15.44:0/1597292007 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc4880ca2b0 msgr2=0x7fc4880c6ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:50:14.352 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:14.359+0000 7fc47e000640 1 --2- 172.21.15.44:0/1597292007 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc4880ca2b0 0x7fc4880c6ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:50:14.353 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:14.359+0000 7fc47e000640 1 -- 172.21.15.44:0/1597292007 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc4880b4d70 con 0x7fc4880cbee0 2024-04-17T19:50:14.353 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:14.359+0000 7fc47e000640 1 --2- 172.21.15.44:0/1597292007 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc4880cbee0 0x7fc48814d940 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7fc47000c430 tx=0x7fc47000c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:50:14.353 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:14.359+0000 7fc47f400640 1 -- 172.21.15.44:0/1597292007 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4700074e0 con 0x7fc4880cbee0 2024-04-17T19:50:14.353 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:14.359+0000 7fc47f400640 1 -- 172.21.15.44:0/1597292007 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc470007680 con 0x7fc4880cbee0 2024-04-17T19:50:14.353 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:14.359+0000 7fc47f400640 1 -- 172.21.15.44:0/1597292007 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc470004a10 con 0x7fc4880cbee0 2024-04-17T19:50:14.353 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:14.359+0000 7fc487e00640 1 -- 172.21.15.44:0/1597292007 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc4880b5030 con 0x7fc4880cbee0 2024-04-17T19:50:14.353 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:14.359+0000 7fc487e00640 1 -- 172.21.15.44:0/1597292007 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc488146200 con 0x7fc4880cbee0 2024-04-17T19:50:14.353 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:14.363+0000 7fc487e00640 1 -- 172.21.15.44:0/1597292007 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc48804fea0 con 0x7fc4880cbee0 2024-04-17T19:50:14.354 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:14.363+0000 7fc47f400640 1 -- 172.21.15.44:0/1597292007 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fc47001a020 con 0x7fc4880cbee0 2024-04-17T19:50:14.355 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:14.363+0000 7fc47f400640 1 --2- 172.21.15.44:0/1597292007 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7fc4640683b0 0x7fc46406a8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:50:14.355 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:14.363+0000 7fc47f400640 1 -- 172.21.15.44:0/1597292007 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6619+0+0 (secure 0 0 0) 0x7fc470086570 con 0x7fc4880cbee0 2024-04-17T19:50:14.355 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:14.363+0000 7fc486a00640 1 --2- 172.21.15.44:0/1597292007 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7fc4640683b0 0x7fc46406a8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:50:14.356 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:14.367+0000 7fc486a00640 1 --2- 172.21.15.44:0/1597292007 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7fc4640683b0 0x7fc46406a8c0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fc4780af000 tx=0x7fc4780a7000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:50:14.359 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:14.367+0000 7fc47f400640 1 -- 172.21.15.44:0/1597292007 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fc470056670 con 0x7fc4880cbee0 2024-04-17T19:50:14.522 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:14.531+0000 7fc487e00640 1 -- 172.21.15.44:0/1597292007 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7fc48814bf80 con 0x7fc4880cbee0 2024-04-17T19:50:14.522 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:14.531+0000 7fc47f400640 1 -- 172.21.15.44:0/1597292007 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v27) ==== 100+0+11 (secure 0 0 0) 0x7fc470055f70 con 0x7fc4880cbee0 2024-04-17T19:50:14.523 INFO:teuthology.orchestra.run.smithi044.stdout:pg_num: 64 2024-04-17T19:50:14.525 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:14.535+0000 7fc487e00640 1 -- 172.21.15.44:0/1597292007 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7fc4640683b0 msgr2=0x7fc46406a8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:50:14.525 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:14.535+0000 7fc487e00640 1 --2- 172.21.15.44:0/1597292007 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7fc4640683b0 0x7fc46406a8c0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fc4780af000 tx=0x7fc4780a7000 comp rx=0 tx=0).stop 2024-04-17T19:50:14.525 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:14.535+0000 7fc487e00640 1 -- 172.21.15.44:0/1597292007 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc4880cbee0 msgr2=0x7fc48814d940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:50:14.525 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:14.535+0000 7fc487e00640 1 --2- 172.21.15.44:0/1597292007 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc4880cbee0 0x7fc48814d940 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7fc47000c430 tx=0x7fc47000c8f0 comp rx=0 tx=0).stop 2024-04-17T19:50:14.525 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:14.535+0000 7fc487e00640 1 -- 172.21.15.44:0/1597292007 shutdown_connections 2024-04-17T19:50:14.525 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:14.535+0000 7fc487e00640 1 --2- 172.21.15.44:0/1597292007 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7fc4640683b0 0x7fc46406a8c0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:50:14.525 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:14.535+0000 7fc487e00640 1 --2- 172.21.15.44:0/1597292007 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fc4880cefe0 0x7fc4881464e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:50:14.525 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:14.535+0000 7fc487e00640 1 --2- 172.21.15.44:0/1597292007 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc4880cbee0 0x7fc48814d940 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:50:14.525 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:14.535+0000 7fc487e00640 1 --2- 172.21.15.44:0/1597292007 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc4880ca2b0 0x7fc4880c6ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:50:14.525 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:14.535+0000 7fc487e00640 1 -- 172.21.15.44:0/1597292007 >> 172.21.15.44:0/1597292007 conn(0x7fc488072410 msgr2=0x7fc48806e900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:50:14.525 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:14.535+0000 7fc487e00640 1 -- 172.21.15.44:0/1597292007 shutdown_connections 2024-04-17T19:50:14.525 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:14.535+0000 7fc487e00640 1 -- 172.21.15.44:0/1597292007 wait complete. 2024-04-17T19:50:14.546 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-04-17T19:50:14.701 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:14.711+0000 7fc7d1a00640 1 Processor -- start 2024-04-17T19:50:14.702 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:14.711+0000 7fc7d1a00640 1 -- start start 2024-04-17T19:50:14.704 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:14.711+0000 7fc7d1a00640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fc7cc159850 0x7fc7cc0ca4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:50:14.704 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:14.711+0000 7fc7d1a00640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fc7cc0ca9e0 0x7fc7cc0c9720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:50:14.704 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:14.711+0000 7fc7d1a00640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc7cc0c5170 con 0x7fc7cc0c9c60 2024-04-17T19:50:14.704 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:14.711+0000 7fc7d1a00640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 -- 0x7fc7cc070540 con 0x7fc7cc159850 2024-04-17T19:50:14.704 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:14.711+0000 7fc7d1a00640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7fc7cc159d00 con 0x7fc7cc0ca9e0 2024-04-17T19:50:14.704 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:14.711+0000 7fc7caa00640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fc7cc159850 0x7fc7cc0ca4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:50:14.704 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:14.711+0000 7fc7cb400640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7fc7cc0c9c60 0x7fc7cc0709d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:48664/0 (socket says 172.21.15.44:48664) 2024-04-17T19:50:14.704 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:14.711+0000 7fc7cb400640 1 -- 172.21.15.44:0/4096285273 learned_addr learned my addr 172.21.15.44:0/4096285273 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-04-17T19:50:14.704 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:14.711+0000 7fc7c3e00640 1 --2- 172.21.15.44:0/4096285273 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fc7cc0ca9e0 0x7fc7cc0c9720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:50:14.705 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:14.715+0000 7fc7caa00640 1 -- 172.21.15.44:0/4096285273 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fc7cc0ca9e0 msgr2=0x7fc7cc0c9720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T19:50:14.705 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:14.715+0000 7fc7caa00640 1 --2- 172.21.15.44:0/4096285273 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fc7cc0ca9e0 0x7fc7cc0c9720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:50:14.705 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:14.715+0000 7fc7caa00640 1 -- 172.21.15.44:0/4096285273 >> v1:172.21.15.44:6789/0 conn(0x7fc7cc0c9c60 legacy=0x7fc7cc0709d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:50:14.705 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:14.715+0000 7fc7ca000640 1 -- 172.21.15.44:0/4096285273 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1930785050 0 0) 0x7fc7cc0c5170 con 0x7fc7cc0c9c60 2024-04-17T19:50:14.705 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:14.715+0000 7fc7caa00640 1 -- 172.21.15.44:0/4096285273 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc7cc159fe0 con 0x7fc7cc159850 2024-04-17T19:50:14.707 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:14.715+0000 7fc7caa00640 1 --2- 172.21.15.44:0/4096285273 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc7cc159850 0x7fc7cc0ca4a0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7fc7bc0097c0 tx=0x7fc7bc01c4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6b6569507036592d server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:50:14.707 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:14.715+0000 7fc7ca000640 1 -- 172.21.15.44:0/4096285273 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7bc0b0070 con 0x7fc7cc159850 2024-04-17T19:50:14.707 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:14.715+0000 7fc7ca000640 1 -- 172.21.15.44:0/4096285273 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc7bc0ab600 con 0x7fc7cc159850 2024-04-17T19:50:14.707 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:14.715+0000 7fc7ca000640 1 -- 172.21.15.44:0/4096285273 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7bc0ab9d0 con 0x7fc7cc159850 2024-04-17T19:50:14.708 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:14.719+0000 7fc7d1a00640 1 -- 172.21.15.44:0/4096285273 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc7cc159850 msgr2=0x7fc7cc0ca4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:50:14.708 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:14.719+0000 7fc7d1a00640 1 --2- 172.21.15.44:0/4096285273 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc7cc159850 0x7fc7cc0ca4a0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7fc7bc0097c0 tx=0x7fc7bc01c4a0 comp rx=0 tx=0).stop 2024-04-17T19:50:14.708 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:14.719+0000 7fc7d1a00640 1 -- 172.21.15.44:0/4096285273 shutdown_connections 2024-04-17T19:50:14.708 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:14.719+0000 7fc7d1a00640 1 --2- 172.21.15.44:0/4096285273 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fc7cc0ca9e0 0x7fc7cc0c9720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:50:14.708 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:14.719+0000 7fc7d1a00640 1 --2- 172.21.15.44:0/4096285273 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc7cc159850 0x7fc7cc0ca4a0 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:50:14.708 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:14.719+0000 7fc7d1a00640 1 -- 172.21.15.44:0/4096285273 >> 172.21.15.44:0/4096285273 conn(0x7fc7cc0722e0 msgr2=0x7fc7cc072720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:50:14.708 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:14.719+0000 7fc7d1a00640 1 -- 172.21.15.44:0/4096285273 shutdown_connections 2024-04-17T19:50:14.709 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:14.719+0000 7fc7d1a00640 1 -- 172.21.15.44:0/4096285273 wait complete. 2024-04-17T19:50:14.710 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:14.719+0000 7fc7d1a00640 1 Processor -- start 2024-04-17T19:50:14.710 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:14.719+0000 7fc7d1a00640 1 -- start start 2024-04-17T19:50:14.713 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:14.719+0000 7fc7d1a00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc7cc0c9c60 0x7fc7cc152ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:50:14.713 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:14.719+0000 7fc7d1a00640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fc7cc0ca9e0 0x7fc7cc14c0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:50:14.713 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:14.719+0000 7fc7d1a00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc7cc159850 0x7fc7cc06ce90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:50:14.713 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:14.719+0000 7fc7d1a00640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fc7cc166b70 con 0x7fc7cc0c9c60 2024-04-17T19:50:14.713 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:14.719+0000 7fc7d1a00640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7fc7cc1669f0 con 0x7fc7cc159850 2024-04-17T19:50:14.713 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:14.719+0000 7fc7d1a00640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7fc7cc166cf0 con 0x7fc7cc0ca9e0 2024-04-17T19:50:14.713 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:14.723+0000 7fc7caa00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc7cc0c9c60 0x7fc7cc152ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:50:14.713 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:14.723+0000 7fc7caa00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc7cc0c9c60 0x7fc7cc152ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:41124/0 (socket says 172.21.15.44:41124) 2024-04-17T19:50:14.713 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:14.723+0000 7fc7caa00640 1 -- 172.21.15.44:0/2665282062 learned_addr learned my addr 172.21.15.44:0/2665282062 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-04-17T19:50:14.713 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:14.723+0000 7fc7cb400640 1 --2- 172.21.15.44:0/2665282062 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc7cc159850 0x7fc7cc06ce90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:50:14.713 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:14.723+0000 7fc7c3e00640 1 --2- 172.21.15.44:0/2665282062 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fc7cc0ca9e0 0x7fc7cc14c0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:50:14.713 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:14.723+0000 7fc7caa00640 1 -- 172.21.15.44:0/2665282062 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fc7cc0ca9e0 msgr2=0x7fc7cc14c0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:50:14.713 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:14.723+0000 7fc7caa00640 1 --2- 172.21.15.44:0/2665282062 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fc7cc0ca9e0 0x7fc7cc14c0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:50:14.713 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:14.723+0000 7fc7caa00640 1 -- 172.21.15.44:0/2665282062 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc7cc159850 msgr2=0x7fc7cc06ce90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:50:14.714 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:14.723+0000 7fc7caa00640 1 --2- 172.21.15.44:0/2665282062 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc7cc159850 0x7fc7cc06ce90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:50:14.714 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:14.723+0000 7fc7caa00640 1 -- 172.21.15.44:0/2665282062 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc7cc151eb0 con 0x7fc7cc0c9c60 2024-04-17T19:50:14.714 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:14.723+0000 7fc7caa00640 1 --2- 172.21.15.44:0/2665282062 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc7cc0c9c60 0x7fc7cc152ca0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7fc7bc0ae040 tx=0x7fc7bc01ace0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:50:14.714 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:14.723+0000 7fc7c2a00640 1 -- 172.21.15.44:0/2665282062 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7bc0b0040 con 0x7fc7cc0c9c60 2024-04-17T19:50:14.715 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:14.723+0000 7fc7c2a00640 1 -- 172.21.15.44:0/2665282062 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc7bc004020 con 0x7fc7cc0c9c60 2024-04-17T19:50:14.715 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:14.723+0000 7fc7c2a00640 1 -- 172.21.15.44:0/2665282062 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7bc006e20 con 0x7fc7cc0c9c60 2024-04-17T19:50:14.715 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:14.723+0000 7fc7d1a00640 1 -- 172.21.15.44:0/2665282062 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc7cc06e8b0 con 0x7fc7cc0c9c60 2024-04-17T19:50:14.715 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:14.723+0000 7fc7d1a00640 1 -- 172.21.15.44:0/2665282062 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc7cc1570f0 con 0x7fc7cc0c9c60 2024-04-17T19:50:14.715 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:14.723+0000 7fc7d1a00640 1 -- 172.21.15.44:0/2665282062 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc7cc04ff10 con 0x7fc7cc0c9c60 2024-04-17T19:50:14.715 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:14.723+0000 7fc7c2a00640 1 -- 172.21.15.44:0/2665282062 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fc7bc0bf060 con 0x7fc7cc0c9c60 2024-04-17T19:50:14.716 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:14.727+0000 7fc7c2a00640 1 --2- 172.21.15.44:0/2665282062 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7fc7a8068380 0x7fc7a806a890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:50:14.716 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:14.727+0000 7fc7c2a00640 1 -- 172.21.15.44:0/2665282062 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6619+0+0 (secure 0 0 0) 0x7fc7bc1208d0 con 0x7fc7cc0c9c60 2024-04-17T19:50:14.717 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:14.727+0000 7fc7c3e00640 1 --2- 172.21.15.44:0/2665282062 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7fc7a8068380 0x7fc7a806a890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:50:14.717 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:14.727+0000 7fc7c3e00640 1 --2- 172.21.15.44:0/2665282062 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7fc7a8068380 0x7fc7a806a890 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fc7cc1f2ca0 tx=0x7fc7b4008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:50:14.721 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:14.731+0000 7fc7c2a00640 1 -- 172.21.15.44:0/2665282062 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fc7bc016090 con 0x7fc7cc0c9c60 2024-04-17T19:50:14.885 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:14.895+0000 7fc7d1a00640 1 -- 172.21.15.44:0/2665282062 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) -- 0x7fc7cc152620 con 0x7fc7cc0c9c60 2024-04-17T19:50:14.885 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:14.895+0000 7fc7c2a00640 1 -- 172.21.15.44:0/2665282062 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v27) ==== 103+0+11 (secure 0 0 0) 0x7fc7bc0f09d0 con 0x7fc7cc0c9c60 2024-04-17T19:50:14.885 INFO:teuthology.orchestra.run.smithi044.stdout:pg_num: 32 2024-04-17T19:50:14.887 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:14.895+0000 7fc7d1a00640 1 -- 172.21.15.44:0/2665282062 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7fc7a8068380 msgr2=0x7fc7a806a890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:50:14.887 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:14.895+0000 7fc7d1a00640 1 --2- 172.21.15.44:0/2665282062 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7fc7a8068380 0x7fc7a806a890 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fc7cc1f2ca0 tx=0x7fc7b4008040 comp rx=0 tx=0).stop 2024-04-17T19:50:14.887 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:14.895+0000 7fc7d1a00640 1 -- 172.21.15.44:0/2665282062 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc7cc0c9c60 msgr2=0x7fc7cc152ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:50:14.887 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:14.895+0000 7fc7d1a00640 1 --2- 172.21.15.44:0/2665282062 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc7cc0c9c60 0x7fc7cc152ca0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7fc7bc0ae040 tx=0x7fc7bc01ace0 comp rx=0 tx=0).stop 2024-04-17T19:50:14.887 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:14.895+0000 7fc7d1a00640 1 -- 172.21.15.44:0/2665282062 shutdown_connections 2024-04-17T19:50:14.887 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:14.895+0000 7fc7d1a00640 1 --2- 172.21.15.44:0/2665282062 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7fc7a8068380 0x7fc7a806a890 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:50:14.887 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:14.895+0000 7fc7d1a00640 1 --2- 172.21.15.44:0/2665282062 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fc7cc0ca9e0 0x7fc7cc14c0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:50:14.887 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:14.895+0000 7fc7d1a00640 1 --2- 172.21.15.44:0/2665282062 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc7cc159850 0x7fc7cc06ce90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:50:14.887 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:14.895+0000 7fc7d1a00640 1 --2- 172.21.15.44:0/2665282062 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc7cc0c9c60 0x7fc7cc152ca0 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:50:14.887 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:14.895+0000 7fc7d1a00640 1 -- 172.21.15.44:0/2665282062 >> 172.21.15.44:0/2665282062 conn(0x7fc7cc0722e0 msgr2=0x7fc7cc162380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:50:14.888 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:14.895+0000 7fc7d1a00640 1 -- 172.21.15.44:0/2665282062 shutdown_connections 2024-04-17T19:50:14.888 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:14.895+0000 7fc7d1a00640 1 -- 172.21.15.44:0/2665282062 wait complete. 2024-04-17T19:50:14.907 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-17T19:50:15.061 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:15.071+0000 7feef6400640 1 Processor -- start 2024-04-17T19:50:15.061 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:15.071+0000 7feef6400640 1 -- start start 2024-04-17T19:50:15.063 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:15.071+0000 7feef6400640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7feef0153bc0 0x7feef015d540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:50:15.063 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:15.071+0000 7feef6400640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7feef015da80 0x7feef00ca2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:50:15.063 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:15.071+0000 7feef6400640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7feef00b1f30 con 0x7feef00cb030 2024-04-17T19:50:15.063 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:15.071+0000 7feef6400640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 -- 0x7feef015cdd0 con 0x7feef015da80 2024-04-17T19:50:15.063 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:15.071+0000 7feef6400640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7feef015d0b0 con 0x7feef0153bc0 2024-04-17T19:50:15.063 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:15.071+0000 7feee6a00640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7feef015da80 0x7feef00ca2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:50:15.063 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:15.071+0000 7feee6a00640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7feef015da80 0x7feef00ca2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:41130/0 (socket says 172.21.15.44:41130) 2024-04-17T19:50:15.063 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:15.071+0000 7feeefe00640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7feef00cb030 0x7feef00cb6e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:48668/0 (socket says 172.21.15.44:48668) 2024-04-17T19:50:15.064 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:15.071+0000 7feee6a00640 1 -- 172.21.15.44:0/203526556 learned_addr learned my addr 172.21.15.44:0/203526556 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-04-17T19:50:15.064 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:15.071+0000 7feeef400640 1 --2- 172.21.15.44:0/203526556 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7feef0153bc0 0x7feef015d540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:50:15.064 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:15.071+0000 7feee6a00640 1 -- 172.21.15.44:0/203526556 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7feef0153bc0 msgr2=0x7feef015d540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T19:50:15.064 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:15.071+0000 7feee6a00640 1 --2- 172.21.15.44:0/203526556 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7feef0153bc0 0x7feef015d540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:50:15.064 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:15.071+0000 7feee6a00640 1 -- 172.21.15.44:0/203526556 >> v1:172.21.15.44:6789/0 conn(0x7feef00cb030 legacy=0x7feef00cb6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:50:15.064 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:15.071+0000 7feee6a00640 1 -- 172.21.15.44:0/203526556 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feef00c43b0 con 0x7feef015da80 2024-04-17T19:50:15.064 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:15.071+0000 7feeef400640 1 --2- 172.21.15.44:0/203526556 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7feef0153bc0 0x7feef015d540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-17T19:50:15.065 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:15.071+0000 7feeeea00640 1 -- 172.21.15.44:0/203526556 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3200488482 0 0) 0x7feef00b1f30 con 0x7feef00cb030 2024-04-17T19:50:15.067 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:15.075+0000 7feee6a00640 1 --2- 172.21.15.44:0/203526556 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7feef015da80 0x7feef00ca2a0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7feef015cf50 tx=0x7feed801c4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1d472a8e61599860 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:50:15.067 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:15.075+0000 7feeeea00640 1 -- 172.21.15.44:0/203526556 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feed80b1070 con 0x7feef015da80 2024-04-17T19:50:15.067 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:15.075+0000 7feeeea00640 1 -- 172.21.15.44:0/203526556 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feed80ac620 con 0x7feef015da80 2024-04-17T19:50:15.067 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:15.075+0000 7feeeea00640 1 -- 172.21.15.44:0/203526556 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feed80ac9f0 con 0x7feef015da80 2024-04-17T19:50:15.067 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:15.075+0000 7feef6400640 1 -- 172.21.15.44:0/203526556 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7feef015da80 msgr2=0x7feef00ca2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:50:15.067 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:15.075+0000 7feef6400640 1 --2- 172.21.15.44:0/203526556 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7feef015da80 0x7feef00ca2a0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7feef015cf50 tx=0x7feed801c4b0 comp rx=0 tx=0).stop 2024-04-17T19:50:15.068 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:15.075+0000 7feef6400640 1 -- 172.21.15.44:0/203526556 shutdown_connections 2024-04-17T19:50:15.068 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:15.075+0000 7feef6400640 1 --2- 172.21.15.44:0/203526556 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7feef015da80 0x7feef00ca2a0 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:50:15.068 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:15.075+0000 7feef6400640 1 --2- 172.21.15.44:0/203526556 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7feef0153bc0 0x7feef015d540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:50:15.068 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:15.075+0000 7feef6400640 1 -- 172.21.15.44:0/203526556 >> 172.21.15.44:0/203526556 conn(0x7feef0067eb0 msgr2=0x7feef00682c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:50:15.068 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:15.075+0000 7feef6400640 1 -- 172.21.15.44:0/203526556 shutdown_connections 2024-04-17T19:50:15.068 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:15.075+0000 7feef6400640 1 -- 172.21.15.44:0/203526556 wait complete. 2024-04-17T19:50:15.070 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:15.079+0000 7feef6400640 1 Processor -- start 2024-04-17T19:50:15.070 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:15.079+0000 7feef6400640 1 -- start start 2024-04-17T19:50:15.072 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:15.079+0000 7feef6400640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7feef00cb030 0x7feef014b700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:50:15.072 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:15.079+0000 7feef6400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7feef0153bc0 0x7feef015b7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:50:15.072 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:15.079+0000 7feef6400640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7feef015da80 0x7feef00cdaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:50:15.072 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:15.079+0000 7feef6400640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7feef0167180 con 0x7feef0153bc0 2024-04-17T19:50:15.072 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:15.079+0000 7feef6400640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7feef015a610 con 0x7feef015da80 2024-04-17T19:50:15.072 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:15.079+0000 7feef6400640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7feef0167300 con 0x7feef00cb030 2024-04-17T19:50:15.072 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:15.079+0000 7feee6a00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7feef0153bc0 0x7feef015b7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:50:15.072 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:15.079+0000 7feee6a00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7feef0153bc0 0x7feef015b7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:41142/0 (socket says 172.21.15.44:41142) 2024-04-17T19:50:15.072 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:15.079+0000 7feee6a00640 1 -- 172.21.15.44:0/2884394737 learned_addr learned my addr 172.21.15.44:0/2884394737 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-04-17T19:50:15.073 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:15.079+0000 7feeef400640 1 --2- 172.21.15.44:0/2884394737 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7feef00cb030 0x7feef014b700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:50:15.073 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:15.079+0000 7feeefe00640 1 --2- 172.21.15.44:0/2884394737 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7feef015da80 0x7feef00cdaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:50:15.073 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:15.083+0000 7feee6a00640 1 -- 172.21.15.44:0/2884394737 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7feef00cb030 msgr2=0x7feef014b700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:50:15.073 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:15.083+0000 7feee6a00640 1 --2- 172.21.15.44:0/2884394737 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7feef00cb030 0x7feef014b700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:50:15.073 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:15.083+0000 7feee6a00640 1 -- 172.21.15.44:0/2884394737 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7feef015da80 msgr2=0x7feef00cdaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:50:15.073 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:15.083+0000 7feee6a00640 1 --2- 172.21.15.44:0/2884394737 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7feef015da80 0x7feef00cdaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:50:15.073 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:15.083+0000 7feee6a00640 1 -- 172.21.15.44:0/2884394737 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feef01506e0 con 0x7feef0153bc0 2024-04-17T19:50:15.073 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:15.083+0000 7feeef400640 1 --2- 172.21.15.44:0/2884394737 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7feef00cb030 0x7feef014b700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-17T19:50:15.073 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:15.083+0000 7feee6a00640 1 --2- 172.21.15.44:0/2884394737 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7feef0153bc0 0x7feef015b7e0 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7feed801c990 tx=0x7feed8019250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:50:15.074 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:15.083+0000 7feee7e00640 1 -- 172.21.15.44:0/2884394737 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feed80b1040 con 0x7feef0153bc0 2024-04-17T19:50:15.074 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:15.083+0000 7feee7e00640 1 -- 172.21.15.44:0/2884394737 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feed80ba070 con 0x7feef0153bc0 2024-04-17T19:50:15.074 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:15.083+0000 7feee7e00640 1 -- 172.21.15.44:0/2884394737 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feed80b5640 con 0x7feef0153bc0 2024-04-17T19:50:15.074 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:15.083+0000 7feef6400640 1 -- 172.21.15.44:0/2884394737 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feef014bc40 con 0x7feef0153bc0 2024-04-17T19:50:15.074 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:15.083+0000 7feef6400640 1 -- 172.21.15.44:0/2884394737 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feef015ace0 con 0x7feef0153bc0 2024-04-17T19:50:15.074 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:15.083+0000 7feef6400640 1 -- 172.21.15.44:0/2884394737 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7feef004ff10 con 0x7feef0153bc0 2024-04-17T19:50:15.074 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:15.083+0000 7feee7e00640 1 -- 172.21.15.44:0/2884394737 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7feed80b57e0 con 0x7feef0153bc0 2024-04-17T19:50:15.076 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:15.083+0000 7feee7e00640 1 --2- 172.21.15.44:0/2884394737 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7feecc068380 0x7feecc06a890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:50:15.076 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:15.083+0000 7feee7e00640 1 -- 172.21.15.44:0/2884394737 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6619+0+0 (secure 0 0 0) 0x7feed8120a30 con 0x7feef0153bc0 2024-04-17T19:50:15.076 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:15.083+0000 7feeef400640 1 --2- 172.21.15.44:0/2884394737 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7feecc068380 0x7feecc06a890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:50:15.076 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:15.087+0000 7feeef400640 1 --2- 172.21.15.44:0/2884394737 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7feecc068380 0x7feecc06a890 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7feee00079d0 tx=0x7feee0008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:50:15.079 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:15.087+0000 7feee7e00640 1 -- 172.21.15.44:0/2884394737 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7feed8016130 con 0x7feef0153bc0 2024-04-17T19:50:15.256 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:15.263+0000 7feef6400640 1 -- 172.21.15.44:0/2884394737 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7feef00b4c20 con 0x7feef0153bc0 2024-04-17T19:50:15.256 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:15.267+0000 7feee7e00640 1 -- 172.21.15.44:0/2884394737 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v27) ==== 80+0+0 (secure 0 0 0) 0x7feed80f0d70 con 0x7feef0153bc0 2024-04-17T19:50:15.256 INFO:teuthology.orchestra.run.smithi044.stderr:listed 0 entries 2024-04-17T19:50:15.259 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:15.267+0000 7feef6400640 1 -- 172.21.15.44:0/2884394737 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7feecc068380 msgr2=0x7feecc06a890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:50:15.259 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:15.267+0000 7feef6400640 1 --2- 172.21.15.44:0/2884394737 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7feecc068380 0x7feecc06a890 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7feee00079d0 tx=0x7feee0008040 comp rx=0 tx=0).stop 2024-04-17T19:50:15.259 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:15.267+0000 7feef6400640 1 -- 172.21.15.44:0/2884394737 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7feef0153bc0 msgr2=0x7feef015b7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:50:15.259 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:15.267+0000 7feef6400640 1 --2- 172.21.15.44:0/2884394737 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7feef0153bc0 0x7feef015b7e0 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7feed801c990 tx=0x7feed8019250 comp rx=0 tx=0).stop 2024-04-17T19:50:15.259 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:15.267+0000 7feef6400640 1 -- 172.21.15.44:0/2884394737 shutdown_connections 2024-04-17T19:50:15.259 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:15.267+0000 7feef6400640 1 --2- 172.21.15.44:0/2884394737 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7feecc068380 0x7feecc06a890 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:50:15.259 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:15.267+0000 7feef6400640 1 --2- 172.21.15.44:0/2884394737 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7feef015da80 0x7feef00cdaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:50:15.259 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:15.267+0000 7feef6400640 1 --2- 172.21.15.44:0/2884394737 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7feef0153bc0 0x7feef015b7e0 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:50:15.259 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:15.267+0000 7feef6400640 1 --2- 172.21.15.44:0/2884394737 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7feef00cb030 0x7feef014b700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:50:15.259 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:15.267+0000 7feef6400640 1 -- 172.21.15.44:0/2884394737 >> 172.21.15.44:0/2884394737 conn(0x7feef0067eb0 msgr2=0x7feef00682c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:50:15.259 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:15.267+0000 7feef6400640 1 -- 172.21.15.44:0/2884394737 shutdown_connections 2024-04-17T19:50:15.259 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:15.267+0000 7feef6400640 1 -- 172.21.15.44:0/2884394737 wait complete. 2024-04-17T19:50:15.279 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-04-17T19:50:15.279 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-17T19:50:15.279 DEBUG:teuthology.orchestra.run.smithi044:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-04-17T19:50:15.411 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi044.front.sepia.ceph.com 2024-04-17T19:50:15.412 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-17T19:50:15.412 DEBUG:teuthology.orchestra.run.smithi044:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-04-17T19:50:15.422 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-17T19:50:15.422 DEBUG:teuthology.orchestra.run.smithi044:> ip netns list 2024-04-17T19:50:15.472 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-04-17T19:50:15.472 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-17T19:50:15.472 DEBUG:teuthology.orchestra.run.smithi044:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-17T19:50:15.540 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-17T19:50:15.540 DEBUG:teuthology.orchestra.run.smithi044:> sudo ip link delete ceph-brx 2024-04-17T19:50:15.706 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2024-04-17T19:50:15.716 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-04-17T19:50:15.716 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-17T19:50:15.867 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:15.875+0000 7fd5e9a00640 1 Processor -- start 2024-04-17T19:50:15.867 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:15.875+0000 7fd5e9a00640 1 -- start start 2024-04-17T19:50:15.869 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:15.879+0000 7fd5e9a00640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fd5e4073ca0 0x7fd5e40c6ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:50:15.869 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:15.879+0000 7fd5e9a00640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fd5e4157f10 0x7fd5e40c9430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:50:15.870 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:15.879+0000 7fd5e9a00640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd5e40c6060 con 0x7fd5e40c73f0 2024-04-17T19:50:15.870 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:15.879+0000 7fd5e9a00640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 -- 0x7fd5e40c4aa0 con 0x7fd5e4073ca0 2024-04-17T19:50:15.870 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:15.879+0000 7fd5e9a00640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7fd5e4158320 con 0x7fd5e4157f10 2024-04-17T19:50:15.870 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:15.879+0000 7fd5e2a00640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fd5e4073ca0 0x7fd5e40c6ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:50:15.870 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:15.879+0000 7fd5dbe00640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7fd5e40c73f0 0x7fd5e41520c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:58966/0 (socket says 172.21.15.44:58966) 2024-04-17T19:50:15.870 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:15.879+0000 7fd5dbe00640 1 -- 172.21.15.44:0/707261943 learned_addr learned my addr 172.21.15.44:0/707261943 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-04-17T19:50:15.870 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:15.879+0000 7fd5e3400640 1 --2- 172.21.15.44:0/707261943 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fd5e4157f10 0x7fd5e40c9430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:50:15.870 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:15.879+0000 7fd5e2a00640 1 -- 172.21.15.44:0/707261943 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fd5e4157f10 msgr2=0x7fd5e40c9430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T19:50:15.870 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:15.879+0000 7fd5e2a00640 1 --2- 172.21.15.44:0/707261943 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fd5e4157f10 0x7fd5e40c9430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:50:15.870 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:15.879+0000 7fd5e2a00640 1 -- 172.21.15.44:0/707261943 >> v1:172.21.15.44:6789/0 conn(0x7fd5e40c73f0 legacy=0x7fd5e41520c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:50:15.870 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:15.879+0000 7fd5e2a00640 1 -- 172.21.15.44:0/707261943 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd5e40c79c0 con 0x7fd5e4073ca0 2024-04-17T19:50:15.870 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:15.879+0000 7fd5e2000640 1 -- 172.21.15.44:0/707261943 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 293408251 0 0) 0x7fd5e40c6060 con 0x7fd5e40c73f0 2024-04-17T19:50:15.872 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:15.883+0000 7fd5e2a00640 1 --2- 172.21.15.44:0/707261943 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd5e4073ca0 0x7fd5e40c6ad0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7fd5d40097c0 tx=0x7fd5d401d6d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=233e88452fcf5a65 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:50:15.872 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:15.883+0000 7fd5e2000640 1 -- 172.21.15.44:0/707261943 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5d40ad070 con 0x7fd5e4073ca0 2024-04-17T19:50:15.872 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:15.883+0000 7fd5e2000640 1 -- 172.21.15.44:0/707261943 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd5d40a7640 con 0x7fd5e4073ca0 2024-04-17T19:50:15.873 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:15.883+0000 7fd5e2000640 1 -- 172.21.15.44:0/707261943 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5d40a7a10 con 0x7fd5e4073ca0 2024-04-17T19:50:15.873 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:15.883+0000 7fd5e9a00640 1 -- 172.21.15.44:0/707261943 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd5e4073ca0 msgr2=0x7fd5e40c6ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:50:15.873 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:15.883+0000 7fd5e9a00640 1 --2- 172.21.15.44:0/707261943 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd5e4073ca0 0x7fd5e40c6ad0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7fd5d40097c0 tx=0x7fd5d401d6d0 comp rx=0 tx=0).stop 2024-04-17T19:50:15.873 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:15.883+0000 7fd5e9a00640 1 -- 172.21.15.44:0/707261943 shutdown_connections 2024-04-17T19:50:15.873 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:15.883+0000 7fd5e9a00640 1 --2- 172.21.15.44:0/707261943 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fd5e4157f10 0x7fd5e40c9430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:50:15.874 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:15.883+0000 7fd5e9a00640 1 --2- 172.21.15.44:0/707261943 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd5e4073ca0 0x7fd5e40c6ad0 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:50:15.874 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:15.883+0000 7fd5e9a00640 1 -- 172.21.15.44:0/707261943 >> 172.21.15.44:0/707261943 conn(0x7fd5e406c380 msgr2=0x7fd5e4070080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:50:15.874 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:15.883+0000 7fd5e9a00640 1 -- 172.21.15.44:0/707261943 shutdown_connections 2024-04-17T19:50:15.874 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:15.883+0000 7fd5e9a00640 1 -- 172.21.15.44:0/707261943 wait complete. 2024-04-17T19:50:15.875 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:15.883+0000 7fd5e9a00640 1 Processor -- start 2024-04-17T19:50:15.876 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:15.883+0000 7fd5e9a00640 1 -- start start 2024-04-17T19:50:15.879 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:15.887+0000 7fd5e9a00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd5e4073ca0 0x7fd5e41ea880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:50:15.879 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:15.887+0000 7fd5e9a00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd5e40c73f0 0x7fd5e40cbfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:50:15.879 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:15.887+0000 7fd5e9a00640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fd5e4157f10 0x7fd5e414f760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:50:15.879 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:15.887+0000 7fd5e9a00640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fd5e41648a0 con 0x7fd5e40c73f0 2024-04-17T19:50:15.879 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:15.887+0000 7fd5e9a00640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7fd5e40c9d80 con 0x7fd5e4073ca0 2024-04-17T19:50:15.879 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:15.887+0000 7fd5e9a00640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7fd5e4164a20 con 0x7fd5e4157f10 2024-04-17T19:50:15.879 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:15.887+0000 7fd5dbe00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd5e40c73f0 0x7fd5e40cbfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:50:15.879 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:15.887+0000 7fd5dbe00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd5e40c73f0 0x7fd5e40cbfd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:46876/0 (socket says 172.21.15.44:46876) 2024-04-17T19:50:15.879 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:15.887+0000 7fd5dbe00640 1 -- 172.21.15.44:0/3352640540 learned_addr learned my addr 172.21.15.44:0/3352640540 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-04-17T19:50:15.879 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:15.887+0000 7fd5e3400640 1 --2- 172.21.15.44:0/3352640540 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fd5e4157f10 0x7fd5e414f760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:50:15.879 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:15.887+0000 7fd5e2a00640 1 --2- 172.21.15.44:0/3352640540 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd5e4073ca0 0x7fd5e41ea880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:50:15.879 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:15.887+0000 7fd5dbe00640 1 -- 172.21.15.44:0/3352640540 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fd5e4157f10 msgr2=0x7fd5e414f760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:50:15.879 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:15.887+0000 7fd5dbe00640 1 --2- 172.21.15.44:0/3352640540 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fd5e4157f10 0x7fd5e414f760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:50:15.880 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:15.887+0000 7fd5dbe00640 1 -- 172.21.15.44:0/3352640540 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd5e4073ca0 msgr2=0x7fd5e41ea880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:50:15.880 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:15.887+0000 7fd5dbe00640 1 --2- 172.21.15.44:0/3352640540 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd5e4073ca0 0x7fd5e41ea880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:50:15.880 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:15.887+0000 7fd5dbe00640 1 -- 172.21.15.44:0/3352640540 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd5e4153f30 con 0x7fd5e40c73f0 2024-04-17T19:50:15.880 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:15.887+0000 7fd5e3400640 1 --2- 172.21.15.44:0/3352640540 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fd5e4157f10 0x7fd5e414f760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-17T19:50:15.880 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:15.887+0000 7fd5e2a00640 1 --2- 172.21.15.44:0/3352640540 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd5e4073ca0 0x7fd5e41ea880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-17T19:50:15.880 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:15.887+0000 7fd5dbe00640 1 --2- 172.21.15.44:0/3352640540 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd5e40c73f0 0x7fd5e40cbfd0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7fd5cc00c3e0 tx=0x7fd5cc00c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:50:15.880 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:15.887+0000 7fd5daa00640 1 -- 172.21.15.44:0/3352640540 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5cc0074e0 con 0x7fd5e40c73f0 2024-04-17T19:50:15.880 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:15.887+0000 7fd5daa00640 1 -- 172.21.15.44:0/3352640540 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd5cc0047f0 con 0x7fd5e40c73f0 2024-04-17T19:50:15.880 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:15.887+0000 7fd5daa00640 1 -- 172.21.15.44:0/3352640540 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5cc004be0 con 0x7fd5e40c73f0 2024-04-17T19:50:15.880 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:15.887+0000 7fd5e9a00640 1 -- 172.21.15.44:0/3352640540 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd5e41eadc0 con 0x7fd5e40c73f0 2024-04-17T19:50:15.880 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:15.887+0000 7fd5e9a00640 1 -- 172.21.15.44:0/3352640540 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd5e41ebe60 con 0x7fd5e40c73f0 2024-04-17T19:50:15.881 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:15.887+0000 7fd5e9a00640 1 -- 172.21.15.44:0/3352640540 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd5e404ff10 con 0x7fd5e40c73f0 2024-04-17T19:50:15.881 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:15.891+0000 7fd5daa00640 1 -- 172.21.15.44:0/3352640540 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fd5cc011070 con 0x7fd5e40c73f0 2024-04-17T19:50:15.881 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:15.891+0000 7fd5daa00640 1 --2- 172.21.15.44:0/3352640540 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7fd5c0068380 0x7fd5c006a890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:50:15.882 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:15.891+0000 7fd5daa00640 1 -- 172.21.15.44:0/3352640540 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6619+0+0 (secure 0 0 0) 0x7fd5cc086a80 con 0x7fd5e40c73f0 2024-04-17T19:50:15.882 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:15.891+0000 7fd5e2a00640 1 --2- 172.21.15.44:0/3352640540 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7fd5c0068380 0x7fd5c006a890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:50:15.883 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:15.891+0000 7fd5e2a00640 1 --2- 172.21.15.44:0/3352640540 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7fd5c0068380 0x7fd5c006a890 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fd5d40af000 tx=0x7fd5d40a8000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:50:15.886 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:15.895+0000 7fd5daa00640 1 -- 172.21.15.44:0/3352640540 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fd5cc088e20 con 0x7fd5e40c73f0 2024-04-17T19:50:16.052 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:16.063+0000 7fd5e9a00640 1 -- 172.21.15.44:0/3352640540 --> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fd5e4155930 con 0x7fd5c0068380 2024-04-17T19:50:16.078 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:16.087+0000 7fd5daa00640 1 -- 172.21.15.44:0/3352640540 <== mgr.4102 v2:172.21.15.62:6832/1020159798 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+332714 (secure 0 0 0) 0x7fd5e4155930 con 0x7fd5c0068380 2024-04-17T19:50:16.082 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-04-17T19:50:16.084 INFO:teuthology.orchestra.run.smithi044.stderr:dumped all 2024-04-17T19:50:16.085 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:16.091+0000 7fd5e9a00640 1 -- 172.21.15.44:0/3352640540 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7fd5c0068380 msgr2=0x7fd5c006a890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:50:16.085 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:16.091+0000 7fd5e9a00640 1 --2- 172.21.15.44:0/3352640540 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7fd5c0068380 0x7fd5c006a890 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fd5d40af000 tx=0x7fd5d40a8000 comp rx=0 tx=0).stop 2024-04-17T19:50:16.085 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:16.091+0000 7fd5e9a00640 1 -- 172.21.15.44:0/3352640540 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd5e40c73f0 msgr2=0x7fd5e40cbfd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:50:16.086 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:16.091+0000 7fd5e9a00640 1 --2- 172.21.15.44:0/3352640540 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd5e40c73f0 0x7fd5e40cbfd0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7fd5cc00c3e0 tx=0x7fd5cc00c8a0 comp rx=0 tx=0).stop 2024-04-17T19:50:16.086 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:16.091+0000 7fd5e9a00640 1 -- 172.21.15.44:0/3352640540 shutdown_connections 2024-04-17T19:50:16.086 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:16.091+0000 7fd5e9a00640 1 --2- 172.21.15.44:0/3352640540 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7fd5c0068380 0x7fd5c006a890 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:50:16.086 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:16.091+0000 7fd5e9a00640 1 --2- 172.21.15.44:0/3352640540 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fd5e4157f10 0x7fd5e414f760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:50:16.086 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:16.091+0000 7fd5e9a00640 1 --2- 172.21.15.44:0/3352640540 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd5e40c73f0 0x7fd5e40cbfd0 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:50:16.086 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:16.091+0000 7fd5e9a00640 1 --2- 172.21.15.44:0/3352640540 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd5e4073ca0 0x7fd5e41ea880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:50:16.086 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:16.091+0000 7fd5e9a00640 1 -- 172.21.15.44:0/3352640540 >> 172.21.15.44:0/3352640540 conn(0x7fd5e406c380 msgr2=0x7fd5e40c3dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:50:16.086 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:16.091+0000 7fd5e9a00640 1 -- 172.21.15.44:0/3352640540 shutdown_connections 2024-04-17T19:50:16.086 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:16.091+0000 7fd5e9a00640 1 -- 172.21.15.44:0/3352640540 wait complete. 2024-04-17T19:50:16.102 INFO:teuthology.orchestra.run.smithi044.stdout:{"pg_ready":true,"pg_map":{"version":128,"stamp":"2024-04-17T19:50:15.986738+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":634796,"num_objects":101,"num_object_clones":0,"num_object_copies":202,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":101,"num_whiteouts":0,"num_read":118,"num_read_kb":102,"num_write":413,"num_write_kb":2540,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":343,"ondisk_log_size":343,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":218792,"kb_used_data":2664,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755928,"statfs":{"total":773094113280,"available":772870070272,"internally_reserved":0,"allocated":2727936,"data_stored":2194440,"data_compressed":66496,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":12751,"internal_metadata":221236785},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005888"},"pg_stats":[{"pgid":"2.1f","version":"27'13","reported_seq":40,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:39.943777+0000","last_change":"2024-04-17T19:46:55.688623+0000","last_active":"2024-04-17T19:47:39.943777+0000","last_peered":"2024-04-17T19:47:39.943777+0000","last_clean":"2024-04-17T19:47:39.943777+0000","last_became_active":"2024-04-17T19:46:55.687455+0000","last_became_peered":"2024-04-17T19:46:55.687455+0000","last_unstale":"2024-04-17T19:47:39.943777+0000","last_undegraded":"2024-04-17T19:47:39.943777+0000","last_fullsized":"2024-04-17T19:47:39.943777+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:54.640133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:54.640133+0000","last_clean_scrub_stamp":"2024-04-17T19:46:54.640133+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:02:52.057635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:38.681457+0000","last_change":"2024-04-17T19:46:56.683770+0000","last_active":"2024-04-17T19:47:38.681457+0000","last_peered":"2024-04-17T19:47:38.681457+0000","last_clean":"2024-04-17T19:47:38.681457+0000","last_became_active":"2024-04-17T19:46:56.683111+0000","last_became_peered":"2024-04-17T19:46:56.683111+0000","last_unstale":"2024-04-17T19:47:38.681457+0000","last_undegraded":"2024-04-17T19:47:38.681457+0000","last_fullsized":"2024-04-17T19:47:38.681457+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_clean_scrub_stamp":"2024-04-17T19:46:55.648649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T22:25:59.135091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:37.965849+0000","last_change":"2024-04-17T19:47:00.788461+0000","last_active":"2024-04-17T19:47:37.965849+0000","last_peered":"2024-04-17T19:47:37.965849+0000","last_clean":"2024-04-17T19:47:37.965849+0000","last_became_active":"2024-04-17T19:47:00.787654+0000","last_became_peered":"2024-04-17T19:47:00.787654+0000","last_unstale":"2024-04-17T19:47:37.965849+0000","last_undegraded":"2024-04-17T19:47:37.965849+0000","last_fullsized":"2024-04-17T19:47:37.965849+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_clean_scrub_stamp":"2024-04-17T19:46:59.695482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T07:28:34.234670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4,1],"acting":[7,6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1e","version":"25'2","reported_seq":29,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:38.681382+0000","last_change":"2024-04-17T19:46:55.703749+0000","last_active":"2024-04-17T19:47:38.681382+0000","last_peered":"2024-04-17T19:47:38.681382+0000","last_clean":"2024-04-17T19:47:38.681382+0000","last_became_active":"2024-04-17T19:46:55.695191+0000","last_became_peered":"2024-04-17T19:46:55.695191+0000","last_unstale":"2024-04-17T19:47:38.681382+0000","last_undegraded":"2024-04-17T19:47:38.681382+0000","last_fullsized":"2024-04-17T19:47:38.681382+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:54.640133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:54.640133+0000","last_clean_scrub_stamp":"2024-04-17T19:46:54.640133+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:24:42.573542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:38.681668+0000","last_change":"2024-04-17T19:46:56.684814+0000","last_active":"2024-04-17T19:47:38.681668+0000","last_peered":"2024-04-17T19:47:38.681668+0000","last_clean":"2024-04-17T19:47:38.681668+0000","last_became_active":"2024-04-17T19:46:56.684475+0000","last_became_peered":"2024-04-17T19:46:56.684475+0000","last_unstale":"2024-04-17T19:47:38.681668+0000","last_undegraded":"2024-04-17T19:47:38.681668+0000","last_fullsized":"2024-04-17T19:47:38.681668+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_clean_scrub_stamp":"2024-04-17T19:46:55.648649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T05:38:55.394025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:37.955108+0000","last_change":"2024-04-17T19:47:00.769813+0000","last_active":"2024-04-17T19:47:37.955108+0000","last_peered":"2024-04-17T19:47:37.955108+0000","last_clean":"2024-04-17T19:47:37.955108+0000","last_became_active":"2024-04-17T19:47:00.769370+0000","last_became_peered":"2024-04-17T19:47:00.769370+0000","last_unstale":"2024-04-17T19:47:37.955108+0000","last_undegraded":"2024-04-17T19:47:37.955108+0000","last_fullsized":"2024-04-17T19:47:37.955108+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_clean_scrub_stamp":"2024-04-17T19:46:59.695482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:23:20.430751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,4,6],"acting":[2,7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1d","version":"27'13","reported_seq":40,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:49:27.988193+0000","last_change":"2024-04-17T19:46:55.695159+0000","last_active":"2024-04-17T19:49:27.988193+0000","last_peered":"2024-04-17T19:49:27.988193+0000","last_clean":"2024-04-17T19:49:27.988193+0000","last_became_active":"2024-04-17T19:46:55.694285+0000","last_became_peered":"2024-04-17T19:46:55.694285+0000","last_unstale":"2024-04-17T19:49:27.988193+0000","last_undegraded":"2024-04-17T19:49:27.988193+0000","last_fullsized":"2024-04-17T19:49:27.988193+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:54.640133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:54.640133+0000","last_clean_scrub_stamp":"2024-04-17T19:46:54.640133+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T04:52:16.008572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:38.680518+0000","last_change":"2024-04-17T19:46:56.700734+0000","last_active":"2024-04-17T19:47:38.680518+0000","last_peered":"2024-04-17T19:47:38.680518+0000","last_clean":"2024-04-17T19:47:38.680518+0000","last_became_active":"2024-04-17T19:46:56.700413+0000","last_became_peered":"2024-04-17T19:46:56.700413+0000","last_unstale":"2024-04-17T19:47:38.680518+0000","last_undegraded":"2024-04-17T19:47:38.680518+0000","last_fullsized":"2024-04-17T19:47:38.680518+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_clean_scrub_stamp":"2024-04-17T19:46:55.648649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:57:40.700986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:37.955549+0000","last_change":"2024-04-17T19:47:00.772341+0000","last_active":"2024-04-17T19:47:37.955549+0000","last_peered":"2024-04-17T19:47:37.955549+0000","last_clean":"2024-04-17T19:47:37.955549+0000","last_became_active":"2024-04-17T19:47:00.771578+0000","last_became_peered":"2024-04-17T19:47:00.771578+0000","last_unstale":"2024-04-17T19:47:37.955549+0000","last_undegraded":"2024-04-17T19:47:37.955549+0000","last_fullsized":"2024-04-17T19:47:37.955549+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_clean_scrub_stamp":"2024-04-17T19:46:59.695482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:51:07.602172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,3,6],"acting":[2,5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1c","version":"27'5","reported_seq":32,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:39.944815+0000","last_change":"2024-04-17T19:46:55.687607+0000","last_active":"2024-04-17T19:47:39.944815+0000","last_peered":"2024-04-17T19:47:39.944815+0000","last_clean":"2024-04-17T19:47:39.944815+0000","last_became_active":"2024-04-17T19:46:55.687282+0000","last_became_peered":"2024-04-17T19:46:55.687282+0000","last_unstale":"2024-04-17T19:47:39.944815+0000","last_undegraded":"2024-04-17T19:47:39.944815+0000","last_fullsized":"2024-04-17T19:47:39.944815+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:54.640133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:54.640133+0000","last_clean_scrub_stamp":"2024-04-17T19:46:54.640133+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T05:52:32.550876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:38.473780+0000","last_change":"2024-04-17T19:46:56.690268+0000","last_active":"2024-04-17T19:47:38.473780+0000","last_peered":"2024-04-17T19:47:38.473780+0000","last_clean":"2024-04-17T19:47:38.473780+0000","last_became_active":"2024-04-17T19:46:56.689988+0000","last_became_peered":"2024-04-17T19:46:56.689988+0000","last_unstale":"2024-04-17T19:47:38.473780+0000","last_undegraded":"2024-04-17T19:47:38.473780+0000","last_fullsized":"2024-04-17T19:47:38.473780+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_clean_scrub_stamp":"2024-04-17T19:46:55.648649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T01:29:59.423734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:37.955298+0000","last_change":"2024-04-17T19:47:00.759608+0000","last_active":"2024-04-17T19:47:37.955298+0000","last_peered":"2024-04-17T19:47:37.955298+0000","last_clean":"2024-04-17T19:47:37.955298+0000","last_became_active":"2024-04-17T19:47:00.759059+0000","last_became_peered":"2024-04-17T19:47:00.759059+0000","last_unstale":"2024-04-17T19:47:37.955298+0000","last_undegraded":"2024-04-17T19:47:37.955298+0000","last_fullsized":"2024-04-17T19:47:37.955298+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_clean_scrub_stamp":"2024-04-17T19:46:59.695482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:22:37.460235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,5,7],"acting":[2,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:38.473032+0000","last_change":"2024-04-17T19:46:56.688273+0000","last_active":"2024-04-17T19:47:38.473032+0000","last_peered":"2024-04-17T19:47:38.473032+0000","last_clean":"2024-04-17T19:47:38.473032+0000","last_became_active":"2024-04-17T19:46:56.687662+0000","last_became_peered":"2024-04-17T19:46:56.687662+0000","last_unstale":"2024-04-17T19:47:38.473032+0000","last_undegraded":"2024-04-17T19:47:38.473032+0000","last_fullsized":"2024-04-17T19:47:38.473032+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_clean_scrub_stamp":"2024-04-17T19:46:55.648649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:51:46.684685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"27'5","reported_seq":32,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:49:12.983636+0000","last_change":"2024-04-17T19:46:55.692833+0000","last_active":"2024-04-17T19:49:12.983636+0000","last_peered":"2024-04-17T19:49:12.983636+0000","last_clean":"2024-04-17T19:49:12.983636+0000","last_became_active":"2024-04-17T19:46:55.689006+0000","last_became_peered":"2024-04-17T19:46:55.689006+0000","last_unstale":"2024-04-17T19:49:12.983636+0000","last_undegraded":"2024-04-17T19:49:12.983636+0000","last_fullsized":"2024-04-17T19:49:12.983636+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:54.640133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:54.640133+0000","last_clean_scrub_stamp":"2024-04-17T19:46:54.640133+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:57:39.692470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:38.473658+0000","last_change":"2024-04-17T19:47:00.757063+0000","last_active":"2024-04-17T19:47:38.473658+0000","last_peered":"2024-04-17T19:47:38.473658+0000","last_clean":"2024-04-17T19:47:38.473658+0000","last_became_active":"2024-04-17T19:47:00.756456+0000","last_became_peered":"2024-04-17T19:47:00.756456+0000","last_unstale":"2024-04-17T19:47:38.473658+0000","last_undegraded":"2024-04-17T19:47:38.473658+0000","last_fullsized":"2024-04-17T19:47:38.473658+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_clean_scrub_stamp":"2024-04-17T19:46:59.695482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T02:52:51.655611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,5],"acting":[3,1,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:37.966870+0000","last_change":"2024-04-17T19:46:56.691544+0000","last_active":"2024-04-17T19:47:37.966870+0000","last_peered":"2024-04-17T19:47:37.966870+0000","last_clean":"2024-04-17T19:47:37.966870+0000","last_became_active":"2024-04-17T19:46:56.690828+0000","last_became_peered":"2024-04-17T19:46:56.690828+0000","last_unstale":"2024-04-17T19:47:37.966870+0000","last_undegraded":"2024-04-17T19:47:37.966870+0000","last_fullsized":"2024-04-17T19:47:37.966870+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_clean_scrub_stamp":"2024-04-17T19:46:55.648649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:11:01.745657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.a","version":"27'4","reported_seq":31,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:53.926051+0000","last_change":"2024-04-17T19:46:55.715857+0000","last_active":"2024-04-17T19:47:53.926051+0000","last_peered":"2024-04-17T19:47:53.926051+0000","last_clean":"2024-04-17T19:47:53.926051+0000","last_became_active":"2024-04-17T19:46:55.715197+0000","last_became_peered":"2024-04-17T19:46:55.715197+0000","last_unstale":"2024-04-17T19:47:53.926051+0000","last_undegraded":"2024-04-17T19:47:53.926051+0000","last_fullsized":"2024-04-17T19:47:53.926051+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:54.640133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:54.640133+0000","last_clean_scrub_stamp":"2024-04-17T19:46:54.640133+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:25:07.379181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:37.958909+0000","last_change":"2024-04-17T19:47:00.773528+0000","last_active":"2024-04-17T19:47:37.958909+0000","last_peered":"2024-04-17T19:47:37.958909+0000","last_clean":"2024-04-17T19:47:37.958909+0000","last_became_active":"2024-04-17T19:47:00.773077+0000","last_became_peered":"2024-04-17T19:47:00.773077+0000","last_unstale":"2024-04-17T19:47:37.958909+0000","last_undegraded":"2024-04-17T19:47:37.958909+0000","last_fullsized":"2024-04-17T19:47:37.958909+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_clean_scrub_stamp":"2024-04-17T19:46:59.695482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T02:53:18.654740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,6,1],"acting":[0,4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:37.956343+0000","last_change":"2024-04-17T19:46:56.695617+0000","last_active":"2024-04-17T19:47:37.956343+0000","last_peered":"2024-04-17T19:47:37.956343+0000","last_clean":"2024-04-17T19:47:37.956343+0000","last_became_active":"2024-04-17T19:46:56.695205+0000","last_became_peered":"2024-04-17T19:46:56.695205+0000","last_unstale":"2024-04-17T19:47:37.956343+0000","last_undegraded":"2024-04-17T19:47:37.956343+0000","last_fullsized":"2024-04-17T19:47:37.956343+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_clean_scrub_stamp":"2024-04-17T19:46:55.648649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T05:05:36.718886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"27'7","reported_seq":34,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:39.942448+0000","last_change":"2024-04-17T19:46:55.686220+0000","last_active":"2024-04-17T19:47:39.942448+0000","last_peered":"2024-04-17T19:47:39.942448+0000","last_clean":"2024-04-17T19:47:39.942448+0000","last_became_active":"2024-04-17T19:46:55.684782+0000","last_became_peered":"2024-04-17T19:46:55.684782+0000","last_unstale":"2024-04-17T19:47:39.942448+0000","last_undegraded":"2024-04-17T19:47:39.942448+0000","last_fullsized":"2024-04-17T19:47:39.942448+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:54.640133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:54.640133+0000","last_clean_scrub_stamp":"2024-04-17T19:46:54.640133+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:57:31.750325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:38.475895+0000","last_change":"2024-04-17T19:47:38.474847+0000","last_active":"2024-04-17T19:47:38.475895+0000","last_peered":"2024-04-17T19:47:38.475895+0000","last_clean":"2024-04-17T19:47:38.475895+0000","last_became_active":"2024-04-17T19:47:38.474208+0000","last_became_peered":"2024-04-17T19:47:38.474208+0000","last_unstale":"2024-04-17T19:47:38.475895+0000","last_undegraded":"2024-04-17T19:47:38.475895+0000","last_fullsized":"2024-04-17T19:47:38.475895+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_clean_scrub_stamp":"2024-04-17T19:46:59.695482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T05:15:30.939022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2,3],"acting":[0,4,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:38.472711+0000","last_change":"2024-04-17T19:46:56.700069+0000","last_active":"2024-04-17T19:47:38.472711+0000","last_peered":"2024-04-17T19:47:38.472711+0000","last_clean":"2024-04-17T19:47:38.472711+0000","last_became_active":"2024-04-17T19:46:56.699525+0000","last_became_peered":"2024-04-17T19:46:56.699525+0000","last_unstale":"2024-04-17T19:47:38.472711+0000","last_undegraded":"2024-04-17T19:47:38.472711+0000","last_fullsized":"2024-04-17T19:47:38.472711+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_clean_scrub_stamp":"2024-04-17T19:46:55.648649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T00:28:36.944531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.8","version":"25'2","reported_seq":29,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:37.958712+0000","last_change":"2024-04-17T19:46:55.684594+0000","last_active":"2024-04-17T19:47:37.958712+0000","last_peered":"2024-04-17T19:47:37.958712+0000","last_clean":"2024-04-17T19:47:37.958712+0000","last_became_active":"2024-04-17T19:46:55.683145+0000","last_became_peered":"2024-04-17T19:46:55.683145+0000","last_unstale":"2024-04-17T19:47:37.958712+0000","last_undegraded":"2024-04-17T19:47:37.958712+0000","last_fullsized":"2024-04-17T19:47:37.958712+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:54.640133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:54.640133+0000","last_clean_scrub_stamp":"2024-04-17T19:46:54.640133+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T02:39:08.241534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:37.956151+0000","last_change":"2024-04-17T19:47:00.768781+0000","last_active":"2024-04-17T19:47:37.956151+0000","last_peered":"2024-04-17T19:47:37.956151+0000","last_clean":"2024-04-17T19:47:37.956151+0000","last_became_active":"2024-04-17T19:47:00.768277+0000","last_became_peered":"2024-04-17T19:47:00.768277+0000","last_unstale":"2024-04-17T19:47:37.956151+0000","last_undegraded":"2024-04-17T19:47:37.956151+0000","last_fullsized":"2024-04-17T19:47:37.956151+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_clean_scrub_stamp":"2024-04-17T19:46:59.695482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:07:00.936098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,7],"acting":[2,1,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:37.959525+0000","last_change":"2024-04-17T19:46:56.695528+0000","last_active":"2024-04-17T19:47:37.959525+0000","last_peered":"2024-04-17T19:47:37.959525+0000","last_clean":"2024-04-17T19:47:37.959525+0000","last_became_active":"2024-04-17T19:46:56.694993+0000","last_became_peered":"2024-04-17T19:46:56.694993+0000","last_unstale":"2024-04-17T19:47:37.959525+0000","last_undegraded":"2024-04-17T19:47:37.959525+0000","last_fullsized":"2024-04-17T19:47:37.959525+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_clean_scrub_stamp":"2024-04-17T19:46:55.648649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:08:14.848448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"27'8","reported_seq":35,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:49:07.983053+0000","last_change":"2024-04-17T19:46:55.688859+0000","last_active":"2024-04-17T19:49:07.983053+0000","last_peered":"2024-04-17T19:49:07.983053+0000","last_clean":"2024-04-17T19:49:07.983053+0000","last_became_active":"2024-04-17T19:46:55.688507+0000","last_became_peered":"2024-04-17T19:46:55.688507+0000","last_unstale":"2024-04-17T19:49:07.983053+0000","last_undegraded":"2024-04-17T19:49:07.983053+0000","last_fullsized":"2024-04-17T19:49:07.983053+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:54.640133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:54.640133+0000","last_clean_scrub_stamp":"2024-04-17T19:46:54.640133+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T01:53:38.377482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:37.955200+0000","last_change":"2024-04-17T19:47:00.781482+0000","last_active":"2024-04-17T19:47:37.955200+0000","last_peered":"2024-04-17T19:47:37.955200+0000","last_clean":"2024-04-17T19:47:37.955200+0000","last_became_active":"2024-04-17T19:47:00.780994+0000","last_became_peered":"2024-04-17T19:47:00.780994+0000","last_unstale":"2024-04-17T19:47:37.955200+0000","last_undegraded":"2024-04-17T19:47:37.955200+0000","last_fullsized":"2024-04-17T19:47:37.955200+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_clean_scrub_stamp":"2024-04-17T19:46:59.695482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T01:46:40.550031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,3,1],"acting":[2,6,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:37.962898+0000","last_change":"2024-04-17T19:46:56.695874+0000","last_active":"2024-04-17T19:47:37.962898+0000","last_peered":"2024-04-17T19:47:37.962898+0000","last_clean":"2024-04-17T19:47:37.962898+0000","last_became_active":"2024-04-17T19:46:56.694650+0000","last_became_peered":"2024-04-17T19:46:56.694650+0000","last_unstale":"2024-04-17T19:47:37.962898+0000","last_undegraded":"2024-04-17T19:47:37.962898+0000","last_fullsized":"2024-04-17T19:47:37.962898+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_clean_scrub_stamp":"2024-04-17T19:46:55.648649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:44:38.787541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"27'17","reported_seq":44,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:49:31.753195+0000","last_change":"2024-04-17T19:46:55.684490+0000","last_active":"2024-04-17T19:49:31.753195+0000","last_peered":"2024-04-17T19:49:31.753195+0000","last_clean":"2024-04-17T19:49:31.753195+0000","last_became_active":"2024-04-17T19:46:55.680100+0000","last_became_peered":"2024-04-17T19:46:55.680100+0000","last_unstale":"2024-04-17T19:49:31.753195+0000","last_undegraded":"2024-04-17T19:49:31.753195+0000","last_fullsized":"2024-04-17T19:49:31.753195+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:54.640133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:54.640133+0000","last_clean_scrub_stamp":"2024-04-17T19:46:54.640133+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:27:38.256174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":31,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:37.956231+0000","last_change":"2024-04-17T19:47:00.777588+0000","last_active":"2024-04-17T19:47:37.956231+0000","last_peered":"2024-04-17T19:47:37.956231+0000","last_clean":"2024-04-17T19:47:37.956231+0000","last_became_active":"2024-04-17T19:47:00.776873+0000","last_became_peered":"2024-04-17T19:47:00.776873+0000","last_unstale":"2024-04-17T19:47:37.956231+0000","last_undegraded":"2024-04-17T19:47:37.956231+0000","last_fullsized":"2024-04-17T19:47:37.956231+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_clean_scrub_stamp":"2024-04-17T19:46:59.695482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T02:52:42.471996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,6,3],"acting":[4,1,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:37.961616+0000","last_change":"2024-04-17T19:46:56.681681+0000","last_active":"2024-04-17T19:47:37.961616+0000","last_peered":"2024-04-17T19:47:37.961616+0000","last_clean":"2024-04-17T19:47:37.961616+0000","last_became_active":"2024-04-17T19:46:56.681316+0000","last_became_peered":"2024-04-17T19:46:56.681316+0000","last_unstale":"2024-04-17T19:47:37.961616+0000","last_undegraded":"2024-04-17T19:47:37.961616+0000","last_fullsized":"2024-04-17T19:47:37.961616+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_clean_scrub_stamp":"2024-04-17T19:46:55.648649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T07:28:30.187837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"27'4","reported_seq":31,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:39.945209+0000","last_change":"2024-04-17T19:46:55.692826+0000","last_active":"2024-04-17T19:47:39.945209+0000","last_peered":"2024-04-17T19:47:39.945209+0000","last_clean":"2024-04-17T19:47:39.945209+0000","last_became_active":"2024-04-17T19:46:55.691031+0000","last_became_peered":"2024-04-17T19:46:55.691031+0000","last_unstale":"2024-04-17T19:47:39.945209+0000","last_undegraded":"2024-04-17T19:47:39.945209+0000","last_fullsized":"2024-04-17T19:47:39.945209+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:54.640133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:54.640133+0000","last_clean_scrub_stamp":"2024-04-17T19:46:54.640133+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T05:52:32.550876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:37.959626+0000","last_change":"2024-04-17T19:47:00.777416+0000","last_active":"2024-04-17T19:47:37.959626+0000","last_peered":"2024-04-17T19:47:37.959626+0000","last_clean":"2024-04-17T19:47:37.959626+0000","last_became_active":"2024-04-17T19:47:00.771531+0000","last_became_peered":"2024-04-17T19:47:00.771531+0000","last_unstale":"2024-04-17T19:47:37.959626+0000","last_undegraded":"2024-04-17T19:47:37.959626+0000","last_fullsized":"2024-04-17T19:47:37.959626+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_clean_scrub_stamp":"2024-04-17T19:46:59.695482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:30:31.288100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,2,7],"acting":[6,0,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:37.955833+0000","last_change":"2024-04-17T19:46:56.692250+0000","last_active":"2024-04-17T19:47:37.955833+0000","last_peered":"2024-04-17T19:47:37.955833+0000","last_clean":"2024-04-17T19:47:37.955833+0000","last_became_active":"2024-04-17T19:46:56.691801+0000","last_became_peered":"2024-04-17T19:46:56.691801+0000","last_unstale":"2024-04-17T19:47:37.955833+0000","last_undegraded":"2024-04-17T19:47:37.955833+0000","last_fullsized":"2024-04-17T19:47:37.955833+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_clean_scrub_stamp":"2024-04-17T19:46:55.648649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T01:53:39.385998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"25'1","reported_seq":28,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:38.681129+0000","last_change":"2024-04-17T19:46:55.713556+0000","last_active":"2024-04-17T19:47:38.681129+0000","last_peered":"2024-04-17T19:47:38.681129+0000","last_clean":"2024-04-17T19:47:38.681129+0000","last_became_active":"2024-04-17T19:46:55.712908+0000","last_became_peered":"2024-04-17T19:46:55.712908+0000","last_unstale":"2024-04-17T19:47:38.681129+0000","last_undegraded":"2024-04-17T19:47:38.681129+0000","last_fullsized":"2024-04-17T19:47:38.681129+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:54.640133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:54.640133+0000","last_clean_scrub_stamp":"2024-04-17T19:46:54.640133+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:57:31.750325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:37.959269+0000","last_change":"2024-04-17T19:47:00.776868+0000","last_active":"2024-04-17T19:47:37.959269+0000","last_peered":"2024-04-17T19:47:37.959269+0000","last_clean":"2024-04-17T19:47:37.959269+0000","last_became_active":"2024-04-17T19:47:00.771385+0000","last_became_peered":"2024-04-17T19:47:00.771385+0000","last_unstale":"2024-04-17T19:47:37.959269+0000","last_undegraded":"2024-04-17T19:47:37.959269+0000","last_fullsized":"2024-04-17T19:47:37.959269+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_clean_scrub_stamp":"2024-04-17T19:46:59.695482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T01:46:40.550031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5,7],"acting":[6,3,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:37.959134+0000","last_change":"2024-04-17T19:46:56.709288+0000","last_active":"2024-04-17T19:47:37.959134+0000","last_peered":"2024-04-17T19:47:37.959134+0000","last_clean":"2024-04-17T19:47:37.959134+0000","last_became_active":"2024-04-17T19:46:56.708572+0000","last_became_peered":"2024-04-17T19:46:56.708572+0000","last_unstale":"2024-04-17T19:47:37.959134+0000","last_undegraded":"2024-04-17T19:47:37.959134+0000","last_fullsized":"2024-04-17T19:47:37.959134+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_clean_scrub_stamp":"2024-04-17T19:46:55.648649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:51:03.555339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"27'5","reported_seq":32,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:39.947236+0000","last_change":"2024-04-17T19:46:55.708506+0000","last_active":"2024-04-17T19:47:39.947236+0000","last_peered":"2024-04-17T19:47:39.947236+0000","last_clean":"2024-04-17T19:47:39.947236+0000","last_became_active":"2024-04-17T19:46:55.708175+0000","last_became_peered":"2024-04-17T19:46:55.708175+0000","last_unstale":"2024-04-17T19:47:39.947236+0000","last_undegraded":"2024-04-17T19:47:39.947236+0000","last_fullsized":"2024-04-17T19:47:39.947236+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:54.640133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:54.640133+0000","last_clean_scrub_stamp":"2024-04-17T19:46:54.640133+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T22:25:04.163982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:37.961174+0000","last_change":"2024-04-17T19:47:00.786657+0000","last_active":"2024-04-17T19:47:37.961174+0000","last_peered":"2024-04-17T19:47:37.961174+0000","last_clean":"2024-04-17T19:47:37.961174+0000","last_became_active":"2024-04-17T19:47:00.780743+0000","last_became_peered":"2024-04-17T19:47:00.780743+0000","last_unstale":"2024-04-17T19:47:37.961174+0000","last_undegraded":"2024-04-17T19:47:37.961174+0000","last_fullsized":"2024-04-17T19:47:37.961174+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_clean_scrub_stamp":"2024-04-17T19:46:59.695482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:07:00.936098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0,3],"acting":[6,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:38.680188+0000","last_change":"2024-04-17T19:46:56.679752+0000","last_active":"2024-04-17T19:47:38.680188+0000","last_peered":"2024-04-17T19:47:38.680188+0000","last_clean":"2024-04-17T19:47:38.680188+0000","last_became_active":"2024-04-17T19:46:56.679230+0000","last_became_peered":"2024-04-17T19:46:56.679230+0000","last_unstale":"2024-04-17T19:47:38.680188+0000","last_undegraded":"2024-04-17T19:47:38.680188+0000","last_fullsized":"2024-04-17T19:47:38.680188+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_clean_scrub_stamp":"2024-04-17T19:46:55.648649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:08:14.848448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"27'8","reported_seq":37,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:49:33.857429+0000","last_change":"2024-04-17T19:46:55.715967+0000","last_active":"2024-04-17T19:49:33.857429+0000","last_peered":"2024-04-17T19:49:33.857429+0000","last_clean":"2024-04-17T19:49:33.857429+0000","last_became_active":"2024-04-17T19:46:55.715247+0000","last_became_peered":"2024-04-17T19:46:55.715247+0000","last_unstale":"2024-04-17T19:49:33.857429+0000","last_undegraded":"2024-04-17T19:49:33.857429+0000","last_fullsized":"2024-04-17T19:49:33.857429+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:54.640133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:54.640133+0000","last_clean_scrub_stamp":"2024-04-17T19:46:54.640133+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T00:40:58.757373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":524,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:37.963876+0000","last_change":"2024-04-17T19:47:00.769901+0000","last_active":"2024-04-17T19:47:37.963876+0000","last_peered":"2024-04-17T19:47:37.963876+0000","last_clean":"2024-04-17T19:47:37.963876+0000","last_became_active":"2024-04-17T19:47:00.768634+0000","last_became_peered":"2024-04-17T19:47:00.768634+0000","last_unstale":"2024-04-17T19:47:37.963876+0000","last_undegraded":"2024-04-17T19:47:37.963876+0000","last_fullsized":"2024-04-17T19:47:37.963876+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_clean_scrub_stamp":"2024-04-17T19:46:59.695482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T04:48:47.816818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,7],"acting":[6,0,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:37.959374+0000","last_change":"2024-04-17T19:46:56.703467+0000","last_active":"2024-04-17T19:47:37.959374+0000","last_peered":"2024-04-17T19:47:37.959374+0000","last_clean":"2024-04-17T19:47:37.959374+0000","last_became_active":"2024-04-17T19:46:56.703148+0000","last_became_peered":"2024-04-17T19:46:56.703148+0000","last_unstale":"2024-04-17T19:47:37.959374+0000","last_undegraded":"2024-04-17T19:47:37.959374+0000","last_fullsized":"2024-04-17T19:47:37.959374+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_clean_scrub_stamp":"2024-04-17T19:46:55.648649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T22:01:49.863892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"27'4","reported_seq":31,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:39.945540+0000","last_change":"2024-04-17T19:46:55.715941+0000","last_active":"2024-04-17T19:47:39.945540+0000","last_peered":"2024-04-17T19:47:39.945540+0000","last_clean":"2024-04-17T19:47:39.945540+0000","last_became_active":"2024-04-17T19:46:55.715527+0000","last_became_peered":"2024-04-17T19:46:55.715527+0000","last_unstale":"2024-04-17T19:47:39.945540+0000","last_undegraded":"2024-04-17T19:47:39.945540+0000","last_fullsized":"2024-04-17T19:47:39.945540+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:54.640133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:54.640133+0000","last_clean_scrub_stamp":"2024-04-17T19:46:54.640133+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:11:00.737141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:38.681030+0000","last_change":"2024-04-17T19:47:00.784031+0000","last_active":"2024-04-17T19:47:38.681030+0000","last_peered":"2024-04-17T19:47:38.681030+0000","last_clean":"2024-04-17T19:47:38.681030+0000","last_became_active":"2024-04-17T19:47:00.783386+0000","last_became_peered":"2024-04-17T19:47:00.783386+0000","last_unstale":"2024-04-17T19:47:38.681030+0000","last_undegraded":"2024-04-17T19:47:38.681030+0000","last_fullsized":"2024-04-17T19:47:38.681030+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_clean_scrub_stamp":"2024-04-17T19:46:59.695482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:00:44.689926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6,1],"acting":[5,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:37.957437+0000","last_change":"2024-04-17T19:46:56.692287+0000","last_active":"2024-04-17T19:47:37.957437+0000","last_peered":"2024-04-17T19:47:37.957437+0000","last_clean":"2024-04-17T19:47:37.957437+0000","last_became_active":"2024-04-17T19:46:56.691917+0000","last_became_peered":"2024-04-17T19:46:56.691917+0000","last_unstale":"2024-04-17T19:47:37.957437+0000","last_undegraded":"2024-04-17T19:47:37.957437+0000","last_fullsized":"2024-04-17T19:47:37.957437+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_clean_scrub_stamp":"2024-04-17T19:46:55.648649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T07:37:05.790432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.3","version":"27'6","reported_seq":33,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:39.945478+0000","last_change":"2024-04-17T19:46:55.686031+0000","last_active":"2024-04-17T19:47:39.945478+0000","last_peered":"2024-04-17T19:47:39.945478+0000","last_clean":"2024-04-17T19:47:39.945478+0000","last_became_active":"2024-04-17T19:46:55.685599+0000","last_became_peered":"2024-04-17T19:46:55.685599+0000","last_unstale":"2024-04-17T19:47:39.945478+0000","last_undegraded":"2024-04-17T19:47:39.945478+0000","last_fullsized":"2024-04-17T19:47:39.945478+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:54.640133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:54.640133+0000","last_clean_scrub_stamp":"2024-04-17T19:46:54.640133+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T01:39:32.586696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":183,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:38.680085+0000","last_change":"2024-04-17T19:46:43.000943+0000","last_active":"2024-04-17T19:47:38.680085+0000","last_peered":"2024-04-17T19:47:38.680085+0000","last_clean":"2024-04-17T19:47:38.680085+0000","last_became_active":"2024-04-17T19:46:43.000652+0000","last_became_peered":"2024-04-17T19:46:43.000652+0000","last_unstale":"2024-04-17T19:47:38.680085+0000","last_undegraded":"2024-04-17T19:47:38.680085+0000","last_fullsized":"2024-04-17T19:47:38.680085+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:41.988197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:41.988197+0000","last_clean_scrub_stamp":"2024-04-17T19:46:41.988197+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T19:53:52.845547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:38.473896+0000","last_change":"2024-04-17T19:47:00.731680+0000","last_active":"2024-04-17T19:47:38.473896+0000","last_peered":"2024-04-17T19:47:38.473896+0000","last_clean":"2024-04-17T19:47:38.473896+0000","last_became_active":"2024-04-17T19:47:00.731093+0000","last_became_peered":"2024-04-17T19:47:00.731093+0000","last_unstale":"2024-04-17T19:47:38.473896+0000","last_undegraded":"2024-04-17T19:47:38.473896+0000","last_fullsized":"2024-04-17T19:47:38.473896+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_clean_scrub_stamp":"2024-04-17T19:46:59.695482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T04:59:23.336626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:38.473836+0000","last_change":"2024-04-17T19:46:56.692443+0000","last_active":"2024-04-17T19:47:38.473836+0000","last_peered":"2024-04-17T19:47:38.473836+0000","last_clean":"2024-04-17T19:47:38.473836+0000","last_became_active":"2024-04-17T19:46:56.692106+0000","last_became_peered":"2024-04-17T19:46:56.692106+0000","last_unstale":"2024-04-17T19:47:38.473836+0000","last_undegraded":"2024-04-17T19:47:38.473836+0000","last_fullsized":"2024-04-17T19:47:38.473836+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_clean_scrub_stamp":"2024-04-17T19:46:55.648649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T04:07:54.102221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.c","version":"27'6","reported_seq":33,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:48.269381+0000","last_change":"2024-04-17T19:46:55.689884+0000","last_active":"2024-04-17T19:47:48.269381+0000","last_peered":"2024-04-17T19:47:48.269381+0000","last_clean":"2024-04-17T19:47:48.269381+0000","last_became_active":"2024-04-17T19:46:55.689059+0000","last_became_peered":"2024-04-17T19:46:55.689059+0000","last_unstale":"2024-04-17T19:47:48.269381+0000","last_undegraded":"2024-04-17T19:47:48.269381+0000","last_fullsized":"2024-04-17T19:47:48.269381+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:54.640133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:54.640133+0000","last_clean_scrub_stamp":"2024-04-17T19:46:54.640133+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T04:52:16.008572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1428,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:37.955343+0000","last_change":"2024-04-17T19:47:00.760432+0000","last_active":"2024-04-17T19:47:37.955343+0000","last_peered":"2024-04-17T19:47:37.955343+0000","last_clean":"2024-04-17T19:47:37.955343+0000","last_became_active":"2024-04-17T19:47:00.759946+0000","last_became_peered":"2024-04-17T19:47:00.759946+0000","last_unstale":"2024-04-17T19:47:37.955343+0000","last_undegraded":"2024-04-17T19:47:37.955343+0000","last_fullsized":"2024-04-17T19:47:37.955343+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_clean_scrub_stamp":"2024-04-17T19:46:59.695482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:30:31.288100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,7,4],"acting":[2,3,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":11,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:39.979736+0000","last_change":"2024-04-17T19:47:37.967945+0000","last_active":"2024-04-17T19:47:39.979736+0000","last_peered":"2024-04-17T19:47:39.979736+0000","last_clean":"2024-04-17T19:47:39.979736+0000","last_became_active":"2024-04-17T19:47:37.967613+0000","last_became_peered":"2024-04-17T19:47:37.967613+0000","last_unstale":"2024-04-17T19:47:39.979736+0000","last_undegraded":"2024-04-17T19:47:39.979736+0000","last_fullsized":"2024-04-17T19:47:39.979736+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_clean_scrub_stamp":"2024-04-17T19:46:55.648649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:31:43.713056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.d","version":"27'3","reported_seq":30,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:39.940688+0000","last_change":"2024-04-17T19:46:55.704346+0000","last_active":"2024-04-17T19:47:39.940688+0000","last_peered":"2024-04-17T19:47:39.940688+0000","last_clean":"2024-04-17T19:47:39.940688+0000","last_became_active":"2024-04-17T19:46:55.703334+0000","last_became_peered":"2024-04-17T19:46:55.703334+0000","last_unstale":"2024-04-17T19:47:39.940688+0000","last_undegraded":"2024-04-17T19:47:39.940688+0000","last_fullsized":"2024-04-17T19:47:39.940688+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:54.640133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:54.640133+0000","last_clean_scrub_stamp":"2024-04-17T19:46:54.640133+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:01:11.327106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:38.680778+0000","last_change":"2024-04-17T19:47:00.745450+0000","last_active":"2024-04-17T19:47:38.680778+0000","last_peered":"2024-04-17T19:47:38.680778+0000","last_clean":"2024-04-17T19:47:38.680778+0000","last_became_active":"2024-04-17T19:47:00.744227+0000","last_became_peered":"2024-04-17T19:47:00.744227+0000","last_unstale":"2024-04-17T19:47:38.680778+0000","last_undegraded":"2024-04-17T19:47:38.680778+0000","last_fullsized":"2024-04-17T19:47:38.680778+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_clean_scrub_stamp":"2024-04-17T19:46:59.695482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:52:15.523817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1,3],"acting":[5,4,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:37.960517+0000","last_change":"2024-04-17T19:46:56.687926+0000","last_active":"2024-04-17T19:47:37.960517+0000","last_peered":"2024-04-17T19:47:37.960517+0000","last_clean":"2024-04-17T19:47:37.960517+0000","last_became_active":"2024-04-17T19:46:56.687352+0000","last_became_peered":"2024-04-17T19:46:56.687352+0000","last_unstale":"2024-04-17T19:47:37.960517+0000","last_undegraded":"2024-04-17T19:47:37.960517+0000","last_fullsized":"2024-04-17T19:47:37.960517+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_clean_scrub_stamp":"2024-04-17T19:46:55.648649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T01:32:52.608291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.e","version":"27'5","reported_seq":32,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:39.943637+0000","last_change":"2024-04-17T19:46:55.716397+0000","last_active":"2024-04-17T19:47:39.943637+0000","last_peered":"2024-04-17T19:47:39.943637+0000","last_clean":"2024-04-17T19:47:39.943637+0000","last_became_active":"2024-04-17T19:46:55.715196+0000","last_became_peered":"2024-04-17T19:46:55.715196+0000","last_unstale":"2024-04-17T19:47:39.943637+0000","last_undegraded":"2024-04-17T19:47:39.943637+0000","last_fullsized":"2024-04-17T19:47:39.943637+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:54.640133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:54.640133+0000","last_clean_scrub_stamp":"2024-04-17T19:46:54.640133+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:24:42.573542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:38.472509+0000","last_change":"2024-04-17T19:47:00.735608+0000","last_active":"2024-04-17T19:47:38.472509+0000","last_peered":"2024-04-17T19:47:38.472509+0000","last_clean":"2024-04-17T19:47:38.472509+0000","last_became_active":"2024-04-17T19:47:00.735120+0000","last_became_peered":"2024-04-17T19:47:00.735120+0000","last_unstale":"2024-04-17T19:47:38.472509+0000","last_undegraded":"2024-04-17T19:47:38.472509+0000","last_fullsized":"2024-04-17T19:47:38.472509+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_clean_scrub_stamp":"2024-04-17T19:46:59.695482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T04:40:43.846198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:37.956507+0000","last_change":"2024-04-17T19:46:56.706026+0000","last_active":"2024-04-17T19:47:37.956507+0000","last_peered":"2024-04-17T19:47:37.956507+0000","last_clean":"2024-04-17T19:47:37.956507+0000","last_became_active":"2024-04-17T19:46:56.704786+0000","last_became_peered":"2024-04-17T19:46:56.704786+0000","last_unstale":"2024-04-17T19:47:37.956507+0000","last_undegraded":"2024-04-17T19:47:37.956507+0000","last_fullsized":"2024-04-17T19:47:37.956507+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_clean_scrub_stamp":"2024-04-17T19:46:55.648649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:59:17.441539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.f","version":"25'2","reported_seq":29,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:37.960572+0000","last_change":"2024-04-17T19:46:55.707082+0000","last_active":"2024-04-17T19:47:37.960572+0000","last_peered":"2024-04-17T19:47:37.960572+0000","last_clean":"2024-04-17T19:47:37.960572+0000","last_became_active":"2024-04-17T19:46:55.706729+0000","last_became_peered":"2024-04-17T19:46:55.706729+0000","last_unstale":"2024-04-17T19:47:37.960572+0000","last_undegraded":"2024-04-17T19:47:37.960572+0000","last_fullsized":"2024-04-17T19:47:37.960572+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:54.640133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:54.640133+0000","last_clean_scrub_stamp":"2024-04-17T19:46:54.640133+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:11:00.737141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:38.680082+0000","last_change":"2024-04-17T19:47:00.744054+0000","last_active":"2024-04-17T19:47:38.680082+0000","last_peered":"2024-04-17T19:47:38.680082+0000","last_clean":"2024-04-17T19:47:38.680082+0000","last_became_active":"2024-04-17T19:47:00.743582+0000","last_became_peered":"2024-04-17T19:47:00.743582+0000","last_unstale":"2024-04-17T19:47:38.680082+0000","last_undegraded":"2024-04-17T19:47:38.680082+0000","last_fullsized":"2024-04-17T19:47:38.680082+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_clean_scrub_stamp":"2024-04-17T19:46:59.695482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T22:25:09.219331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,2],"acting":[1,5,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:38.472716+0000","last_change":"2024-04-17T19:46:56.692435+0000","last_active":"2024-04-17T19:47:38.472716+0000","last_peered":"2024-04-17T19:47:38.472716+0000","last_clean":"2024-04-17T19:47:38.472716+0000","last_became_active":"2024-04-17T19:46:56.692038+0000","last_became_peered":"2024-04-17T19:46:56.692038+0000","last_unstale":"2024-04-17T19:47:38.472716+0000","last_undegraded":"2024-04-17T19:47:38.472716+0000","last_fullsized":"2024-04-17T19:47:38.472716+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_clean_scrub_stamp":"2024-04-17T19:46:55.648649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:06:56.889266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.10","version":"27'18","reported_seq":45,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:49:14.997636+0000","last_change":"2024-04-17T19:46:55.692188+0000","last_active":"2024-04-17T19:49:14.997636+0000","last_peered":"2024-04-17T19:49:14.997636+0000","last_clean":"2024-04-17T19:49:14.997636+0000","last_became_active":"2024-04-17T19:46:55.691286+0000","last_became_peered":"2024-04-17T19:46:55.691286+0000","last_unstale":"2024-04-17T19:49:14.997636+0000","last_undegraded":"2024-04-17T19:49:14.997636+0000","last_fullsized":"2024-04-17T19:49:14.997636+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:54.640133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:54.640133+0000","last_clean_scrub_stamp":"2024-04-17T19:46:54.640133+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:01:11.327106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:38.681258+0000","last_change":"2024-04-17T19:47:00.781167+0000","last_active":"2024-04-17T19:47:38.681258+0000","last_peered":"2024-04-17T19:47:38.681258+0000","last_clean":"2024-04-17T19:47:38.681258+0000","last_became_active":"2024-04-17T19:47:00.780167+0000","last_became_peered":"2024-04-17T19:47:00.780167+0000","last_unstale":"2024-04-17T19:47:38.681258+0000","last_undegraded":"2024-04-17T19:47:38.681258+0000","last_fullsized":"2024-04-17T19:47:38.681258+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_clean_scrub_stamp":"2024-04-17T19:46:59.695482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T00:07:51.831352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1,6],"acting":[5,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:38.679978+0000","last_change":"2024-04-17T19:46:56.676150+0000","last_active":"2024-04-17T19:47:38.679978+0000","last_peered":"2024-04-17T19:47:38.679978+0000","last_clean":"2024-04-17T19:47:38.679978+0000","last_became_active":"2024-04-17T19:46:56.675826+0000","last_became_peered":"2024-04-17T19:46:56.675826+0000","last_unstale":"2024-04-17T19:47:38.679978+0000","last_undegraded":"2024-04-17T19:47:38.679978+0000","last_fullsized":"2024-04-17T19:47:38.679978+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_clean_scrub_stamp":"2024-04-17T19:46:55.648649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T04:52:17.017088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.11","version":"25'5","reported_seq":32,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:37.958901+0000","last_change":"2024-04-17T19:46:55.682001+0000","last_active":"2024-04-17T19:47:37.958901+0000","last_peered":"2024-04-17T19:47:37.958901+0000","last_clean":"2024-04-17T19:47:37.958901+0000","last_became_active":"2024-04-17T19:46:55.681607+0000","last_became_peered":"2024-04-17T19:46:55.681607+0000","last_unstale":"2024-04-17T19:47:37.958901+0000","last_undegraded":"2024-04-17T19:47:37.958901+0000","last_fullsized":"2024-04-17T19:47:37.958901+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:54.640133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:54.640133+0000","last_clean_scrub_stamp":"2024-04-17T19:46:54.640133+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T04:43:37.994081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:38.681616+0000","last_change":"2024-04-17T19:47:00.756396+0000","last_active":"2024-04-17T19:47:38.681616+0000","last_peered":"2024-04-17T19:47:38.681616+0000","last_clean":"2024-04-17T19:47:38.681616+0000","last_became_active":"2024-04-17T19:47:00.755282+0000","last_became_peered":"2024-04-17T19:47:00.755282+0000","last_unstale":"2024-04-17T19:47:38.681616+0000","last_undegraded":"2024-04-17T19:47:38.681616+0000","last_fullsized":"2024-04-17T19:47:38.681616+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_clean_scrub_stamp":"2024-04-17T19:46:59.695482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:08:25.082826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6,4],"acting":[5,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:38.473123+0000","last_change":"2024-04-17T19:46:56.694764+0000","last_active":"2024-04-17T19:47:38.473123+0000","last_peered":"2024-04-17T19:47:38.473123+0000","last_clean":"2024-04-17T19:47:38.473123+0000","last_became_active":"2024-04-17T19:46:56.694449+0000","last_became_peered":"2024-04-17T19:46:56.694449+0000","last_unstale":"2024-04-17T19:47:38.473123+0000","last_undegraded":"2024-04-17T19:47:38.473123+0000","last_fullsized":"2024-04-17T19:47:38.473123+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_clean_scrub_stamp":"2024-04-17T19:46:55.648649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T02:53:14.607908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.12","version":"27'6","reported_seq":33,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:49:17.984148+0000","last_change":"2024-04-17T19:46:55.689900+0000","last_active":"2024-04-17T19:49:17.984148+0000","last_peered":"2024-04-17T19:49:17.984148+0000","last_clean":"2024-04-17T19:49:17.984148+0000","last_became_active":"2024-04-17T19:46:55.689607+0000","last_became_peered":"2024-04-17T19:46:55.689607+0000","last_unstale":"2024-04-17T19:49:17.984148+0000","last_undegraded":"2024-04-17T19:49:17.984148+0000","last_fullsized":"2024-04-17T19:49:17.984148+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:54.640133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:54.640133+0000","last_clean_scrub_stamp":"2024-04-17T19:46:54.640133+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:59:16.433023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:37.960971+0000","last_change":"2024-04-17T19:47:00.786434+0000","last_active":"2024-04-17T19:47:37.960971+0000","last_peered":"2024-04-17T19:47:37.960971+0000","last_clean":"2024-04-17T19:47:37.960971+0000","last_became_active":"2024-04-17T19:47:00.781025+0000","last_became_peered":"2024-04-17T19:47:00.781025+0000","last_unstale":"2024-04-17T19:47:37.960971+0000","last_undegraded":"2024-04-17T19:47:37.960971+0000","last_fullsized":"2024-04-17T19:47:37.960971+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_clean_scrub_stamp":"2024-04-17T19:46:59.695482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:51:07.602172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0,7],"acting":[6,4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:37.959911+0000","last_change":"2024-04-17T19:46:56.693555+0000","last_active":"2024-04-17T19:47:37.959911+0000","last_peered":"2024-04-17T19:47:37.959911+0000","last_clean":"2024-04-17T19:47:37.959911+0000","last_became_active":"2024-04-17T19:46:56.687385+0000","last_became_peered":"2024-04-17T19:46:56.687385+0000","last_unstale":"2024-04-17T19:47:37.959911+0000","last_undegraded":"2024-04-17T19:47:37.959911+0000","last_fullsized":"2024-04-17T19:47:37.959911+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_clean_scrub_stamp":"2024-04-17T19:46:55.648649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T05:52:33.559392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"27'9","reported_seq":36,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:39.942294+0000","last_change":"2024-04-17T19:46:55.700010+0000","last_active":"2024-04-17T19:47:39.942294+0000","last_peered":"2024-04-17T19:47:39.942294+0000","last_clean":"2024-04-17T19:47:39.942294+0000","last_became_active":"2024-04-17T19:46:55.698962+0000","last_became_peered":"2024-04-17T19:46:55.698962+0000","last_unstale":"2024-04-17T19:47:39.942294+0000","last_undegraded":"2024-04-17T19:47:39.942294+0000","last_fullsized":"2024-04-17T19:47:39.942294+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:54.640133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:54.640133+0000","last_clean_scrub_stamp":"2024-04-17T19:46:54.640133+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T01:25:12.780134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:38.473724+0000","last_change":"2024-04-17T19:47:00.760341+0000","last_active":"2024-04-17T19:47:38.473724+0000","last_peered":"2024-04-17T19:47:38.473724+0000","last_clean":"2024-04-17T19:47:38.473724+0000","last_became_active":"2024-04-17T19:47:00.759892+0000","last_became_peered":"2024-04-17T19:47:00.759892+0000","last_unstale":"2024-04-17T19:47:38.473724+0000","last_undegraded":"2024-04-17T19:47:38.473724+0000","last_fullsized":"2024-04-17T19:47:38.473724+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_clean_scrub_stamp":"2024-04-17T19:46:59.695482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T05:15:30.939022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5,6],"acting":[3,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":11,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:37.970878+0000","last_change":"2024-04-17T19:47:37.969333+0000","last_active":"2024-04-17T19:47:37.970878+0000","last_peered":"2024-04-17T19:47:37.970878+0000","last_clean":"2024-04-17T19:47:37.970878+0000","last_became_active":"2024-04-17T19:47:37.968623+0000","last_became_peered":"2024-04-17T19:47:37.968623+0000","last_unstale":"2024-04-17T19:47:37.970878+0000","last_undegraded":"2024-04-17T19:47:37.970878+0000","last_fullsized":"2024-04-17T19:47:37.970878+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_clean_scrub_stamp":"2024-04-17T19:46:55.648649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T04:48:43.769985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"27'29","reported_seq":56,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:49:36.735787+0000","last_change":"2024-04-17T19:46:55.697242+0000","last_active":"2024-04-17T19:49:36.735787+0000","last_peered":"2024-04-17T19:49:36.735787+0000","last_clean":"2024-04-17T19:49:36.735787+0000","last_became_active":"2024-04-17T19:46:55.696876+0000","last_became_peered":"2024-04-17T19:46:55.696876+0000","last_unstale":"2024-04-17T19:49:36.735787+0000","last_undegraded":"2024-04-17T19:49:36.735787+0000","last_fullsized":"2024-04-17T19:49:36.735787+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:54.640133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:54.640133+0000","last_clean_scrub_stamp":"2024-04-17T19:46:54.640133+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:24:28.029324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":37336,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":30,"num_write_kb":49,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"27'3","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:49:20.435531+0000","last_change":"2024-04-17T19:47:00.743810+0000","last_active":"2024-04-17T19:49:20.435531+0000","last_peered":"2024-04-17T19:49:20.435531+0000","last_clean":"2024-04-17T19:49:20.435531+0000","last_became_active":"2024-04-17T19:47:00.742290+0000","last_became_peered":"2024-04-17T19:47:00.742290+0000","last_unstale":"2024-04-17T19:49:20.435531+0000","last_undegraded":"2024-04-17T19:49:20.435531+0000","last_fullsized":"2024-04-17T19:49:20.435531+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_clean_scrub_stamp":"2024-04-17T19:46:59.695482+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T04:20:00.039224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,5,0],"acting":[4,3,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:38.473595+0000","last_change":"2024-04-17T19:46:56.680527+0000","last_active":"2024-04-17T19:47:38.473595+0000","last_peered":"2024-04-17T19:47:38.473595+0000","last_clean":"2024-04-17T19:47:38.473595+0000","last_became_active":"2024-04-17T19:46:56.680171+0000","last_became_peered":"2024-04-17T19:46:56.680171+0000","last_unstale":"2024-04-17T19:47:38.473595+0000","last_undegraded":"2024-04-17T19:47:38.473595+0000","last_fullsized":"2024-04-17T19:47:38.473595+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_clean_scrub_stamp":"2024-04-17T19:46:55.648649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T07:11:10.748292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.15","version":"27'8","reported_seq":35,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:49:28.868607+0000","last_change":"2024-04-17T19:46:55.707717+0000","last_active":"2024-04-17T19:49:28.868607+0000","last_peered":"2024-04-17T19:49:28.868607+0000","last_clean":"2024-04-17T19:49:28.868607+0000","last_became_active":"2024-04-17T19:46:55.706967+0000","last_became_peered":"2024-04-17T19:46:55.706967+0000","last_unstale":"2024-04-17T19:49:28.868607+0000","last_undegraded":"2024-04-17T19:49:28.868607+0000","last_fullsized":"2024-04-17T19:49:28.868607+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:54.640133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:54.640133+0000","last_clean_scrub_stamp":"2024-04-17T19:46:54.640133+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T05:10:04.380307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:37.955851+0000","last_change":"2024-04-17T19:47:00.758723+0000","last_active":"2024-04-17T19:47:37.955851+0000","last_peered":"2024-04-17T19:47:37.955851+0000","last_clean":"2024-04-17T19:47:37.955851+0000","last_became_active":"2024-04-17T19:47:00.758209+0000","last_became_peered":"2024-04-17T19:47:00.758209+0000","last_unstale":"2024-04-17T19:47:37.955851+0000","last_undegraded":"2024-04-17T19:47:37.955851+0000","last_fullsized":"2024-04-17T19:47:37.955851+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_clean_scrub_stamp":"2024-04-17T19:46:59.695482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T04:48:47.816818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1,7],"acting":[2,3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:38.681917+0000","last_change":"2024-04-17T19:46:56.684067+0000","last_active":"2024-04-17T19:47:38.681917+0000","last_peered":"2024-04-17T19:47:38.681917+0000","last_clean":"2024-04-17T19:47:38.681917+0000","last_became_active":"2024-04-17T19:46:56.683685+0000","last_became_peered":"2024-04-17T19:46:56.683685+0000","last_unstale":"2024-04-17T19:47:38.681917+0000","last_undegraded":"2024-04-17T19:47:38.681917+0000","last_fullsized":"2024-04-17T19:47:38.681917+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_clean_scrub_stamp":"2024-04-17T19:46:55.648649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T02:52:38.425163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"27'4","reported_seq":31,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:39.942230+0000","last_change":"2024-04-17T19:46:55.687311+0000","last_active":"2024-04-17T19:47:39.942230+0000","last_peered":"2024-04-17T19:47:39.942230+0000","last_clean":"2024-04-17T19:47:39.942230+0000","last_became_active":"2024-04-17T19:46:55.687019+0000","last_became_peered":"2024-04-17T19:46:55.687019+0000","last_unstale":"2024-04-17T19:47:39.942230+0000","last_undegraded":"2024-04-17T19:47:39.942230+0000","last_fullsized":"2024-04-17T19:47:39.942230+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:54.640133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:54.640133+0000","last_clean_scrub_stamp":"2024-04-17T19:46:54.640133+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T01:53:38.377482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:37.965677+0000","last_change":"2024-04-17T19:47:00.780072+0000","last_active":"2024-04-17T19:47:37.965677+0000","last_peered":"2024-04-17T19:47:37.965677+0000","last_clean":"2024-04-17T19:47:37.965677+0000","last_became_active":"2024-04-17T19:47:00.777053+0000","last_became_peered":"2024-04-17T19:47:00.777053+0000","last_unstale":"2024-04-17T19:47:37.965677+0000","last_undegraded":"2024-04-17T19:47:37.965677+0000","last_fullsized":"2024-04-17T19:47:37.965677+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_clean_scrub_stamp":"2024-04-17T19:46:59.695482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T22:01:53.910725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,3,2],"acting":[7,1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:37.956396+0000","last_change":"2024-04-17T19:46:56.692985+0000","last_active":"2024-04-17T19:47:37.956396+0000","last_peered":"2024-04-17T19:47:37.956396+0000","last_clean":"2024-04-17T19:47:37.956396+0000","last_became_active":"2024-04-17T19:46:56.692287+0000","last_became_peered":"2024-04-17T19:46:56.692287+0000","last_unstale":"2024-04-17T19:47:37.956396+0000","last_undegraded":"2024-04-17T19:47:37.956396+0000","last_fullsized":"2024-04-17T19:47:37.956396+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_clean_scrub_stamp":"2024-04-17T19:46:55.648649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:20:50.341776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.17","version":"27'5","reported_seq":32,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:49:22.983650+0000","last_change":"2024-04-17T19:46:55.691681+0000","last_active":"2024-04-17T19:49:22.983650+0000","last_peered":"2024-04-17T19:49:22.983650+0000","last_clean":"2024-04-17T19:49:22.983650+0000","last_became_active":"2024-04-17T19:46:55.691354+0000","last_became_peered":"2024-04-17T19:46:55.691354+0000","last_unstale":"2024-04-17T19:49:22.983650+0000","last_undegraded":"2024-04-17T19:49:22.983650+0000","last_fullsized":"2024-04-17T19:49:22.983650+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:54.640133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:54.640133+0000","last_clean_scrub_stamp":"2024-04-17T19:46:54.640133+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T00:40:58.757373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:37.957709+0000","last_change":"2024-04-17T19:47:00.764854+0000","last_active":"2024-04-17T19:47:37.957709+0000","last_peered":"2024-04-17T19:47:37.957709+0000","last_clean":"2024-04-17T19:47:37.957709+0000","last_became_active":"2024-04-17T19:47:00.763550+0000","last_became_peered":"2024-04-17T19:47:00.763550+0000","last_unstale":"2024-04-17T19:47:37.957709+0000","last_undegraded":"2024-04-17T19:47:37.957709+0000","last_fullsized":"2024-04-17T19:47:37.957709+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_clean_scrub_stamp":"2024-04-17T19:46:59.695482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T04:26:38.527427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,3,7],"acting":[4,0,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:37.959252+0000","last_change":"2024-04-17T19:47:00.746028+0000","last_active":"2024-04-17T19:47:37.959252+0000","last_peered":"2024-04-17T19:47:37.959252+0000","last_clean":"2024-04-17T19:47:37.959252+0000","last_became_active":"2024-04-17T19:47:00.744828+0000","last_became_peered":"2024-04-17T19:47:00.744828+0000","last_unstale":"2024-04-17T19:47:37.959252+0000","last_undegraded":"2024-04-17T19:47:37.959252+0000","last_fullsized":"2024-04-17T19:47:37.959252+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_clean_scrub_stamp":"2024-04-17T19:46:59.695482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T22:37:58.836823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,5,3],"acting":[4,1,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:37.957762+0000","last_change":"2024-04-17T19:46:56.691650+0000","last_active":"2024-04-17T19:47:37.957762+0000","last_peered":"2024-04-17T19:47:37.957762+0000","last_clean":"2024-04-17T19:47:37.957762+0000","last_became_active":"2024-04-17T19:46:56.690810+0000","last_became_peered":"2024-04-17T19:46:56.690810+0000","last_unstale":"2024-04-17T19:47:37.957762+0000","last_undegraded":"2024-04-17T19:47:37.957762+0000","last_fullsized":"2024-04-17T19:47:37.957762+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_clean_scrub_stamp":"2024-04-17T19:46:55.648649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T04:25:07.123916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.18","version":"27'3","reported_seq":30,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:39.944726+0000","last_change":"2024-04-17T19:46:55.691871+0000","last_active":"2024-04-17T19:47:39.944726+0000","last_peered":"2024-04-17T19:47:39.944726+0000","last_clean":"2024-04-17T19:47:39.944726+0000","last_became_active":"2024-04-17T19:46:55.690539+0000","last_became_peered":"2024-04-17T19:46:55.690539+0000","last_unstale":"2024-04-17T19:47:39.944726+0000","last_undegraded":"2024-04-17T19:47:39.944726+0000","last_fullsized":"2024-04-17T19:47:39.944726+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:54.640133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:54.640133+0000","last_clean_scrub_stamp":"2024-04-17T19:46:54.640133+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T04:52:16.008572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:38.474111+0000","last_change":"2024-04-17T19:47:00.749616+0000","last_active":"2024-04-17T19:47:38.474111+0000","last_peered":"2024-04-17T19:47:38.474111+0000","last_clean":"2024-04-17T19:47:38.474111+0000","last_became_active":"2024-04-17T19:47:00.749061+0000","last_became_peered":"2024-04-17T19:47:00.749061+0000","last_unstale":"2024-04-17T19:47:38.474111+0000","last_undegraded":"2024-04-17T19:47:38.474111+0000","last_fullsized":"2024-04-17T19:47:38.474111+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_clean_scrub_stamp":"2024-04-17T19:46:59.695482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:33:36.676817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5,1],"acting":[3,2,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:38.680110+0000","last_change":"2024-04-17T19:46:56.692190+0000","last_active":"2024-04-17T19:47:38.680110+0000","last_peered":"2024-04-17T19:47:38.680110+0000","last_clean":"2024-04-17T19:47:38.680110+0000","last_became_active":"2024-04-17T19:46:56.691524+0000","last_became_peered":"2024-04-17T19:46:56.691524+0000","last_unstale":"2024-04-17T19:47:38.680110+0000","last_undegraded":"2024-04-17T19:47:38.680110+0000","last_fullsized":"2024-04-17T19:47:38.680110+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_clean_scrub_stamp":"2024-04-17T19:46:55.648649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:44:38.787541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"27'3","reported_seq":30,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:39.942240+0000","last_change":"2024-04-17T19:46:55.700265+0000","last_active":"2024-04-17T19:47:39.942240+0000","last_peered":"2024-04-17T19:47:39.942240+0000","last_clean":"2024-04-17T19:47:39.942240+0000","last_became_active":"2024-04-17T19:46:55.699166+0000","last_became_peered":"2024-04-17T19:46:55.699166+0000","last_unstale":"2024-04-17T19:47:39.942240+0000","last_undegraded":"2024-04-17T19:47:39.942240+0000","last_fullsized":"2024-04-17T19:47:39.942240+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:54.640133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:54.640133+0000","last_clean_scrub_stamp":"2024-04-17T19:46:54.640133+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T02:39:08.241534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"25'7","reported_seq":34,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:38.473233+0000","last_change":"2024-04-17T19:46:55.687779+0000","last_active":"2024-04-17T19:47:38.473233+0000","last_peered":"2024-04-17T19:47:38.473233+0000","last_clean":"2024-04-17T19:47:38.473233+0000","last_became_active":"2024-04-17T19:46:55.687401+0000","last_became_peered":"2024-04-17T19:46:55.687401+0000","last_unstale":"2024-04-17T19:47:38.473233+0000","last_undegraded":"2024-04-17T19:47:38.473233+0000","last_fullsized":"2024-04-17T19:47:38.473233+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:54.640133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:54.640133+0000","last_clean_scrub_stamp":"2024-04-17T19:46:54.640133+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:20:49.333260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:37.956708+0000","last_change":"2024-04-17T19:46:56.691635+0000","last_active":"2024-04-17T19:47:37.956708+0000","last_peered":"2024-04-17T19:47:37.956708+0000","last_clean":"2024-04-17T19:47:37.956708+0000","last_became_active":"2024-04-17T19:46:56.691199+0000","last_became_peered":"2024-04-17T19:46:56.691199+0000","last_unstale":"2024-04-17T19:47:37.956708+0000","last_undegraded":"2024-04-17T19:47:37.956708+0000","last_fullsized":"2024-04-17T19:47:37.956708+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_clean_scrub_stamp":"2024-04-17T19:46:55.648649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:00:10.859769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:37.960909+0000","last_change":"2024-04-17T19:47:00.776142+0000","last_active":"2024-04-17T19:47:37.960909+0000","last_peered":"2024-04-17T19:47:37.960909+0000","last_clean":"2024-04-17T19:47:37.960909+0000","last_became_active":"2024-04-17T19:47:00.774592+0000","last_became_peered":"2024-04-17T19:47:00.774592+0000","last_unstale":"2024-04-17T19:47:37.960909+0000","last_undegraded":"2024-04-17T19:47:37.960909+0000","last_fullsized":"2024-04-17T19:47:37.960909+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_clean_scrub_stamp":"2024-04-17T19:46:59.695482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:04:03.656402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,7],"acting":[4,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"25'5","reported_seq":32,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:38.680757+0000","last_change":"2024-04-17T19:46:55.713656+0000","last_active":"2024-04-17T19:47:38.680757+0000","last_peered":"2024-04-17T19:47:38.680757+0000","last_clean":"2024-04-17T19:47:38.680757+0000","last_became_active":"2024-04-17T19:46:55.712982+0000","last_became_peered":"2024-04-17T19:46:55.712982+0000","last_unstale":"2024-04-17T19:47:38.680757+0000","last_undegraded":"2024-04-17T19:47:38.680757+0000","last_fullsized":"2024-04-17T19:47:38.680757+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:54.640133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:54.640133+0000","last_clean_scrub_stamp":"2024-04-17T19:46:54.640133+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:02:52.057635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:38.680240+0000","last_change":"2024-04-17T19:46:56.681984+0000","last_active":"2024-04-17T19:47:38.680240+0000","last_peered":"2024-04-17T19:47:38.680240+0000","last_clean":"2024-04-17T19:47:38.680240+0000","last_became_active":"2024-04-17T19:46:56.679830+0000","last_became_peered":"2024-04-17T19:46:56.679830+0000","last_unstale":"2024-04-17T19:47:38.680240+0000","last_undegraded":"2024-04-17T19:47:38.680240+0000","last_fullsized":"2024-04-17T19:47:38.680240+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_clean_scrub_stamp":"2024-04-17T19:46:55.648649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:11:01.745657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:37.967233+0000","last_change":"2024-04-17T19:47:00.777411+0000","last_active":"2024-04-17T19:47:37.967233+0000","last_peered":"2024-04-17T19:47:37.967233+0000","last_clean":"2024-04-17T19:47:37.967233+0000","last_became_active":"2024-04-17T19:47:00.776357+0000","last_became_peered":"2024-04-17T19:47:00.776357+0000","last_unstale":"2024-04-17T19:47:37.967233+0000","last_undegraded":"2024-04-17T19:47:37.967233+0000","last_fullsized":"2024-04-17T19:47:37.967233+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_clean_scrub_stamp":"2024-04-17T19:46:59.695482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:41:22.030097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,1,0],"acting":[7,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:37.955184+0000","last_change":"2024-04-17T19:46:56.706021+0000","last_active":"2024-04-17T19:47:37.955184+0000","last_peered":"2024-04-17T19:47:37.955184+0000","last_clean":"2024-04-17T19:47:37.955184+0000","last_became_active":"2024-04-17T19:46:56.702724+0000","last_became_peered":"2024-04-17T19:46:56.702724+0000","last_unstale":"2024-04-17T19:47:37.955184+0000","last_undegraded":"2024-04-17T19:47:37.955184+0000","last_fullsized":"2024-04-17T19:47:37.955184+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_clean_scrub_stamp":"2024-04-17T19:46:55.648649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:11:01.745657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:37.966196+0000","last_change":"2024-04-17T19:46:56.685239+0000","last_active":"2024-04-17T19:47:37.966196+0000","last_peered":"2024-04-17T19:47:37.966196+0000","last_clean":"2024-04-17T19:47:37.966196+0000","last_became_active":"2024-04-17T19:46:56.684771+0000","last_became_peered":"2024-04-17T19:46:56.684771+0000","last_unstale":"2024-04-17T19:47:37.966196+0000","last_undegraded":"2024-04-17T19:47:37.966196+0000","last_fullsized":"2024-04-17T19:47:37.966196+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_clean_scrub_stamp":"2024-04-17T19:46:55.648649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T04:52:17.017088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:38.472926+0000","last_change":"2024-04-17T19:46:56.686238+0000","last_active":"2024-04-17T19:47:38.472926+0000","last_peered":"2024-04-17T19:47:38.472926+0000","last_clean":"2024-04-17T19:47:38.472926+0000","last_became_active":"2024-04-17T19:46:56.685745+0000","last_became_peered":"2024-04-17T19:46:56.685745+0000","last_unstale":"2024-04-17T19:47:38.472926+0000","last_undegraded":"2024-04-17T19:47:38.472926+0000","last_fullsized":"2024-04-17T19:47:38.472926+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_clean_scrub_stamp":"2024-04-17T19:46:55.648649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:01:01.006486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:38.680630+0000","last_change":"2024-04-17T19:46:56.675844+0000","last_active":"2024-04-17T19:47:38.680630+0000","last_peered":"2024-04-17T19:47:38.680630+0000","last_clean":"2024-04-17T19:47:38.680630+0000","last_became_active":"2024-04-17T19:46:56.675519+0000","last_became_peered":"2024-04-17T19:46:56.675519+0000","last_unstale":"2024-04-17T19:47:38.680630+0000","last_undegraded":"2024-04-17T19:47:38.680630+0000","last_fullsized":"2024-04-17T19:47:38.680630+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_clean_scrub_stamp":"2024-04-17T19:46:55.648649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T00:46:07.348168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:37.961362+0000","last_change":"2024-04-17T19:46:56.699663+0000","last_active":"2024-04-17T19:47:37.961362+0000","last_peered":"2024-04-17T19:47:37.961362+0000","last_clean":"2024-04-17T19:47:37.961362+0000","last_became_active":"2024-04-17T19:46:56.699293+0000","last_became_peered":"2024-04-17T19:46:56.699293+0000","last_unstale":"2024-04-17T19:47:37.961362+0000","last_undegraded":"2024-04-17T19:47:37.961362+0000","last_fullsized":"2024-04-17T19:47:37.961362+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_clean_scrub_stamp":"2024-04-17T19:46:55.648649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T22:25:05.172498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:37.963458+0000","last_change":"2024-04-17T19:46:56.684368+0000","last_active":"2024-04-17T19:47:37.963458+0000","last_peered":"2024-04-17T19:47:37.963458+0000","last_clean":"2024-04-17T19:47:37.963458+0000","last_became_active":"2024-04-17T19:46:56.683963+0000","last_became_peered":"2024-04-17T19:46:56.683963+0000","last_unstale":"2024-04-17T19:47:37.963458+0000","last_undegraded":"2024-04-17T19:47:37.963458+0000","last_fullsized":"2024-04-17T19:47:37.963458+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_clean_scrub_stamp":"2024-04-17T19:46:55.648649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:41:17.983264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:37.956294+0000","last_change":"2024-04-17T19:46:56.704924+0000","last_active":"2024-04-17T19:47:37.956294+0000","last_peered":"2024-04-17T19:47:37.956294+0000","last_clean":"2024-04-17T19:47:37.956294+0000","last_became_active":"2024-04-17T19:46:56.692688+0000","last_became_peered":"2024-04-17T19:46:56.692688+0000","last_unstale":"2024-04-17T19:47:37.956294+0000","last_undegraded":"2024-04-17T19:47:37.956294+0000","last_fullsized":"2024-04-17T19:47:37.956294+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_clean_scrub_stamp":"2024-04-17T19:46:55.648649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T01:39:33.595213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:38.681508+0000","last_change":"2024-04-17T19:46:56.685081+0000","last_active":"2024-04-17T19:47:38.681508+0000","last_peered":"2024-04-17T19:47:38.681508+0000","last_clean":"2024-04-17T19:47:38.681508+0000","last_became_active":"2024-04-17T19:46:56.684714+0000","last_became_peered":"2024-04-17T19:46:56.684714+0000","last_unstale":"2024-04-17T19:47:38.681508+0000","last_undegraded":"2024-04-17T19:47:38.681508+0000","last_fullsized":"2024-04-17T19:47:38.681508+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_clean_scrub_stamp":"2024-04-17T19:46:55.648649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T04:26:34.480594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:38.472779+0000","last_change":"2024-04-17T19:46:56.681089+0000","last_active":"2024-04-17T19:47:38.472779+0000","last_peered":"2024-04-17T19:47:38.472779+0000","last_clean":"2024-04-17T19:47:38.472779+0000","last_became_active":"2024-04-17T19:46:56.679818+0000","last_became_peered":"2024-04-17T19:46:56.679818+0000","last_unstale":"2024-04-17T19:47:38.472779+0000","last_undegraded":"2024-04-17T19:47:38.472779+0000","last_fullsized":"2024-04-17T19:47:38.472779+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_clean_scrub_stamp":"2024-04-17T19:46:55.648649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T01:32:52.608291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:38.680542+0000","last_change":"2024-04-17T19:46:56.674556+0000","last_active":"2024-04-17T19:47:38.680542+0000","last_peered":"2024-04-17T19:47:38.680542+0000","last_clean":"2024-04-17T19:47:38.680542+0000","last_became_active":"2024-04-17T19:46:56.674164+0000","last_became_peered":"2024-04-17T19:46:56.674164+0000","last_unstale":"2024-04-17T19:47:38.680542+0000","last_undegraded":"2024-04-17T19:47:38.680542+0000","last_fullsized":"2024-04-17T19:47:38.680542+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_clean_scrub_stamp":"2024-04-17T19:46:55.648649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T22:53:45.664676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:38.680145+0000","last_change":"2024-04-17T19:46:56.697359+0000","last_active":"2024-04-17T19:47:38.680145+0000","last_peered":"2024-04-17T19:47:38.680145+0000","last_clean":"2024-04-17T19:47:38.680145+0000","last_became_active":"2024-04-17T19:46:56.695255+0000","last_became_peered":"2024-04-17T19:46:56.695255+0000","last_unstale":"2024-04-17T19:47:38.680145+0000","last_undegraded":"2024-04-17T19:47:38.680145+0000","last_fullsized":"2024-04-17T19:47:38.680145+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_clean_scrub_stamp":"2024-04-17T19:46:55.648649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T01:53:39.385998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:37.956606+0000","last_change":"2024-04-17T19:46:56.692366+0000","last_active":"2024-04-17T19:47:37.956606+0000","last_peered":"2024-04-17T19:47:37.956606+0000","last_clean":"2024-04-17T19:47:37.956606+0000","last_became_active":"2024-04-17T19:46:56.691942+0000","last_became_peered":"2024-04-17T19:46:56.691942+0000","last_unstale":"2024-04-17T19:47:37.956606+0000","last_undegraded":"2024-04-17T19:47:37.956606+0000","last_fullsized":"2024-04-17T19:47:37.956606+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_clean_scrub_stamp":"2024-04-17T19:46:55.648649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T02:34:05.358659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:37.959208+0000","last_change":"2024-04-17T19:46:56.693507+0000","last_active":"2024-04-17T19:47:37.959208+0000","last_peered":"2024-04-17T19:47:37.959208+0000","last_clean":"2024-04-17T19:47:37.959208+0000","last_became_active":"2024-04-17T19:46:56.691938+0000","last_became_peered":"2024-04-17T19:46:56.691938+0000","last_unstale":"2024-04-17T19:47:37.959208+0000","last_undegraded":"2024-04-17T19:47:37.959208+0000","last_fullsized":"2024-04-17T19:47:37.959208+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_clean_scrub_stamp":"2024-04-17T19:46:55.648649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T04:48:43.769985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:38.473958+0000","last_change":"2024-04-17T19:46:56.700707+0000","last_active":"2024-04-17T19:47:38.473958+0000","last_peered":"2024-04-17T19:47:38.473958+0000","last_clean":"2024-04-17T19:47:38.473958+0000","last_became_active":"2024-04-17T19:46:56.700346+0000","last_became_peered":"2024-04-17T19:46:56.700346+0000","last_unstale":"2024-04-17T19:47:38.473958+0000","last_undegraded":"2024-04-17T19:47:38.473958+0000","last_fullsized":"2024-04-17T19:47:38.473958+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_clean_scrub_stamp":"2024-04-17T19:46:55.648649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:58:35.976326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:37.968012+0000","last_change":"2024-04-17T19:46:56.705410+0000","last_active":"2024-04-17T19:47:37.968012+0000","last_peered":"2024-04-17T19:47:37.968012+0000","last_clean":"2024-04-17T19:47:37.968012+0000","last_became_active":"2024-04-17T19:46:56.705076+0000","last_became_peered":"2024-04-17T19:46:56.705076+0000","last_unstale":"2024-04-17T19:47:37.968012+0000","last_undegraded":"2024-04-17T19:47:37.968012+0000","last_fullsized":"2024-04-17T19:47:37.968012+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_clean_scrub_stamp":"2024-04-17T19:46:55.648649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T01:53:39.385998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:38.474246+0000","last_change":"2024-04-17T19:46:56.697436+0000","last_active":"2024-04-17T19:47:38.474246+0000","last_peered":"2024-04-17T19:47:38.474246+0000","last_clean":"2024-04-17T19:47:38.474246+0000","last_became_active":"2024-04-17T19:46:56.696667+0000","last_became_peered":"2024-04-17T19:46:56.696667+0000","last_unstale":"2024-04-17T19:47:38.474246+0000","last_undegraded":"2024-04-17T19:47:38.474246+0000","last_fullsized":"2024-04-17T19:47:38.474246+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_clean_scrub_stamp":"2024-04-17T19:46:55.648649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:54:05.520742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:38.472663+0000","last_change":"2024-04-17T19:46:56.680847+0000","last_active":"2024-04-17T19:47:38.472663+0000","last_peered":"2024-04-17T19:47:38.472663+0000","last_clean":"2024-04-17T19:47:38.472663+0000","last_became_active":"2024-04-17T19:46:56.680224+0000","last_became_peered":"2024-04-17T19:46:56.680224+0000","last_unstale":"2024-04-17T19:47:38.472663+0000","last_undegraded":"2024-04-17T19:47:38.472663+0000","last_fullsized":"2024-04-17T19:47:38.472663+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_clean_scrub_stamp":"2024-04-17T19:46:55.648649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T04:48:43.769985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:38.680177+0000","last_change":"2024-04-17T19:46:56.688647+0000","last_active":"2024-04-17T19:47:38.680177+0000","last_peered":"2024-04-17T19:47:38.680177+0000","last_clean":"2024-04-17T19:47:38.680177+0000","last_became_active":"2024-04-17T19:46:56.688294+0000","last_became_peered":"2024-04-17T19:46:56.688294+0000","last_unstale":"2024-04-17T19:47:38.680177+0000","last_undegraded":"2024-04-17T19:47:38.680177+0000","last_fullsized":"2024-04-17T19:47:38.680177+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_clean_scrub_stamp":"2024-04-17T19:46:55.648649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T02:34:05.358659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.32","version":"27'1","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:49:17.990239+0000","last_change":"2024-04-17T19:46:56.686415+0000","last_active":"2024-04-17T19:49:17.990239+0000","last_peered":"2024-04-17T19:49:17.990239+0000","last_clean":"2024-04-17T19:49:17.990239+0000","last_became_active":"2024-04-17T19:46:56.684639+0000","last_became_peered":"2024-04-17T19:46:56.684639+0000","last_unstale":"2024-04-17T19:49:17.990239+0000","last_undegraded":"2024-04-17T19:49:17.990239+0000","last_fullsized":"2024-04-17T19:49:17.990239+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_clean_scrub_stamp":"2024-04-17T19:46:55.648649+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:20:50.341776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:37.960115+0000","last_change":"2024-04-17T19:46:56.694678+0000","last_active":"2024-04-17T19:47:37.960115+0000","last_peered":"2024-04-17T19:47:37.960115+0000","last_clean":"2024-04-17T19:47:37.960115+0000","last_became_active":"2024-04-17T19:46:56.694213+0000","last_became_peered":"2024-04-17T19:46:56.694213+0000","last_unstale":"2024-04-17T19:47:37.960115+0000","last_undegraded":"2024-04-17T19:47:37.960115+0000","last_fullsized":"2024-04-17T19:47:37.960115+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_clean_scrub_stamp":"2024-04-17T19:46:55.648649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:59:17.441539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:37.959176+0000","last_change":"2024-04-17T19:46:56.693810+0000","last_active":"2024-04-17T19:47:37.959176+0000","last_peered":"2024-04-17T19:47:37.959176+0000","last_clean":"2024-04-17T19:47:37.959176+0000","last_became_active":"2024-04-17T19:46:56.692874+0000","last_became_peered":"2024-04-17T19:46:56.692874+0000","last_unstale":"2024-04-17T19:47:37.959176+0000","last_undegraded":"2024-04-17T19:47:37.959176+0000","last_fullsized":"2024-04-17T19:47:37.959176+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_clean_scrub_stamp":"2024-04-17T19:46:55.648649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:30:27.241267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:37.959681+0000","last_change":"2024-04-17T19:46:56.700330+0000","last_active":"2024-04-17T19:47:37.959681+0000","last_peered":"2024-04-17T19:47:37.959681+0000","last_clean":"2024-04-17T19:47:37.959681+0000","last_became_active":"2024-04-17T19:46:56.700013+0000","last_became_peered":"2024-04-17T19:46:56.700013+0000","last_unstale":"2024-04-17T19:47:37.959681+0000","last_undegraded":"2024-04-17T19:47:37.959681+0000","last_fullsized":"2024-04-17T19:47:37.959681+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_clean_scrub_stamp":"2024-04-17T19:46:55.648649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:23:16.383918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:37.959828+0000","last_change":"2024-04-17T19:46:56.709400+0000","last_active":"2024-04-17T19:47:37.959828+0000","last_peered":"2024-04-17T19:47:37.959828+0000","last_clean":"2024-04-17T19:47:37.959828+0000","last_became_active":"2024-04-17T19:46:56.708606+0000","last_became_peered":"2024-04-17T19:46:56.708606+0000","last_unstale":"2024-04-17T19:47:37.959828+0000","last_undegraded":"2024-04-17T19:47:37.959828+0000","last_fullsized":"2024-04-17T19:47:37.959828+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_clean_scrub_stamp":"2024-04-17T19:46:55.648649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T01:46:36.503198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:38.680713+0000","last_change":"2024-04-17T19:46:56.681267+0000","last_active":"2024-04-17T19:47:38.680713+0000","last_peered":"2024-04-17T19:47:38.680713+0000","last_clean":"2024-04-17T19:47:38.680713+0000","last_became_active":"2024-04-17T19:46:56.680919+0000","last_became_peered":"2024-04-17T19:46:56.680919+0000","last_unstale":"2024-04-17T19:47:38.680713+0000","last_undegraded":"2024-04-17T19:47:38.680713+0000","last_fullsized":"2024-04-17T19:47:38.680713+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_clean_scrub_stamp":"2024-04-17T19:46:55.648649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T01:39:33.595213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:38.679990+0000","last_change":"2024-04-17T19:46:56.688682+0000","last_active":"2024-04-17T19:47:38.679990+0000","last_peered":"2024-04-17T19:47:38.679990+0000","last_clean":"2024-04-17T19:47:38.679990+0000","last_became_active":"2024-04-17T19:46:56.688320+0000","last_became_peered":"2024-04-17T19:46:56.688320+0000","last_unstale":"2024-04-17T19:47:38.679990+0000","last_undegraded":"2024-04-17T19:47:38.679990+0000","last_fullsized":"2024-04-17T19:47:38.679990+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_clean_scrub_stamp":"2024-04-17T19:46:55.648649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:00:10.859769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:37.958884+0000","last_change":"2024-04-17T19:46:56.699129+0000","last_active":"2024-04-17T19:47:37.958884+0000","last_peered":"2024-04-17T19:47:37.958884+0000","last_clean":"2024-04-17T19:47:37.958884+0000","last_became_active":"2024-04-17T19:46:56.698840+0000","last_became_peered":"2024-04-17T19:46:56.698840+0000","last_unstale":"2024-04-17T19:47:37.958884+0000","last_undegraded":"2024-04-17T19:47:37.958884+0000","last_fullsized":"2024-04-17T19:47:37.958884+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_clean_scrub_stamp":"2024-04-17T19:46:55.648649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T05:35:47.746622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:37.955456+0000","last_change":"2024-04-17T19:46:56.705903+0000","last_active":"2024-04-17T19:47:37.955456+0000","last_peered":"2024-04-17T19:47:37.955456+0000","last_clean":"2024-04-17T19:47:37.955456+0000","last_became_active":"2024-04-17T19:46:56.705539+0000","last_became_peered":"2024-04-17T19:46:56.705539+0000","last_unstale":"2024-04-17T19:47:37.955456+0000","last_undegraded":"2024-04-17T19:47:37.955456+0000","last_fullsized":"2024-04-17T19:47:37.955456+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_clean_scrub_stamp":"2024-04-17T19:46:55.648649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:57:40.700986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:37.959075+0000","last_change":"2024-04-17T19:46:56.694456+0000","last_active":"2024-04-17T19:47:37.959075+0000","last_peered":"2024-04-17T19:47:37.959075+0000","last_clean":"2024-04-17T19:47:37.959075+0000","last_became_active":"2024-04-17T19:46:56.693954+0000","last_became_peered":"2024-04-17T19:46:56.693954+0000","last_unstale":"2024-04-17T19:47:37.959075+0000","last_undegraded":"2024-04-17T19:47:37.959075+0000","last_fullsized":"2024-04-17T19:47:37.959075+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_clean_scrub_stamp":"2024-04-17T19:46:55.648649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:22:33.413402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:37.955652+0000","last_change":"2024-04-17T19:46:56.706411+0000","last_active":"2024-04-17T19:47:37.955652+0000","last_peered":"2024-04-17T19:47:37.955652+0000","last_clean":"2024-04-17T19:47:37.955652+0000","last_became_active":"2024-04-17T19:46:56.706021+0000","last_became_peered":"2024-04-17T19:46:56.706021+0000","last_unstale":"2024-04-17T19:47:37.955652+0000","last_undegraded":"2024-04-17T19:47:37.955652+0000","last_fullsized":"2024-04-17T19:47:37.955652+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_clean_scrub_stamp":"2024-04-17T19:46:55.648649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T05:52:33.559392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:38.681189+0000","last_change":"2024-04-17T19:46:56.696930+0000","last_active":"2024-04-17T19:47:38.681189+0000","last_peered":"2024-04-17T19:47:38.681189+0000","last_clean":"2024-04-17T19:47:38.681189+0000","last_became_active":"2024-04-17T19:46:56.696492+0000","last_became_peered":"2024-04-17T19:46:56.696492+0000","last_unstale":"2024-04-17T19:47:38.681189+0000","last_undegraded":"2024-04-17T19:47:38.681189+0000","last_fullsized":"2024-04-17T19:47:38.681189+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_clean_scrub_stamp":"2024-04-17T19:46:55.648649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:43:54.268148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:38.681148+0000","last_change":"2024-04-17T19:46:56.683448+0000","last_active":"2024-04-17T19:47:38.681148+0000","last_peered":"2024-04-17T19:47:38.681148+0000","last_clean":"2024-04-17T19:47:38.681148+0000","last_became_active":"2024-04-17T19:46:56.682772+0000","last_became_peered":"2024-04-17T19:46:56.682772+0000","last_unstale":"2024-04-17T19:47:38.681148+0000","last_undegraded":"2024-04-17T19:47:38.681148+0000","last_fullsized":"2024-04-17T19:47:38.681148+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_clean_scrub_stamp":"2024-04-17T19:46:55.648649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T22:39:31.496708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:37.960452+0000","last_change":"2024-04-17T19:46:56.695275+0000","last_active":"2024-04-17T19:47:37.960452+0000","last_peered":"2024-04-17T19:47:37.960452+0000","last_clean":"2024-04-17T19:47:37.960452+0000","last_became_active":"2024-04-17T19:46:56.694743+0000","last_became_peered":"2024-04-17T19:46:56.694743+0000","last_unstale":"2024-04-17T19:47:37.960452+0000","last_undegraded":"2024-04-17T19:47:37.960452+0000","last_fullsized":"2024-04-17T19:47:37.960452+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_clean_scrub_stamp":"2024-04-17T19:46:55.648649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:01:01.006486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1,"ondisk_log_size":1,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":44428,"num_objects":99,"num_object_clones":0,"num_object_copies":198,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":99,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":252,"num_write_kb":123,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":335872,"data_stored":88856,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":222,"ondisk_log_size":222,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":66496,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509485,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27332,"kb_used_data":316,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344508,"statfs":{"total":96636764160,"available":96608776192,"internally_reserved":0,"allocated":323584,"data_stored":117072,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509486,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27312,"kb_used_data":296,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344528,"statfs":{"total":96636764160,"available":96608796672,"internally_reserved":0,"allocated":303104,"data_stored":118244,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509486,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27336,"kb_used_data":320,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344504,"statfs":{"total":96636764160,"available":96608772096,"internally_reserved":0,"allocated":327680,"data_stored":118328,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509486,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27344,"kb_used_data":328,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344496,"statfs":{"total":96636764160,"available":96608763904,"internally_reserved":0,"allocated":335872,"data_stored":153010,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509485,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27376,"kb_used_data":360,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344464,"statfs":{"total":96636764160,"available":96608731136,"internally_reserved":0,"allocated":368640,"data_stored":707388,"data_compressed":33248,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509485,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27328,"kb_used_data":312,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344512,"statfs":{"total":96636764160,"available":96608780288,"internally_reserved":0,"allocated":319488,"data_stored":118406,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574894,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27384,"kb_used_data":368,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344456,"statfs":{"total":96636764160,"available":96608722944,"internally_reserved":0,"allocated":376832,"data_stored":707212,"data_compressed":33248,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574894,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27380,"kb_used_data":364,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344460,"statfs":{"total":96636764160,"available":96608727040,"internally_reserved":0,"allocated":372736,"data_stored":154780,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33248,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33248,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":2800,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1414,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":37404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":2722,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":90112,"data_stored":39174,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1238,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":1466,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-17T19:50:16.108 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-17T19:50:16.295 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:16.303+0000 7f4355200640 1 Processor -- start 2024-04-17T19:50:16.295 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:16.303+0000 7f4355200640 1 -- start start 2024-04-17T19:50:16.301 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:16.307+0000 7f4355200640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f43500c66d0 0x7f43501536a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:50:16.301 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:16.307+0000 7f4355200640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f4350073f30 0x7f43500725b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:50:16.301 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:16.307+0000 7f4355200640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4350153ff0 con 0x7f4350153be0 2024-04-17T19:50:16.301 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:16.307+0000 7f4355200640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 -- 0x7f4350159ad0 con 0x7f43500c66d0 2024-04-17T19:50:16.301 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:16.307+0000 7f4355200640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7f4350159db0 con 0x7f4350073f30 2024-04-17T19:50:16.301 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:16.307+0000 7f4347e00640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f4350153be0 0x7f4350073820 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:58978/0 (socket says 172.21.15.44:58978) 2024-04-17T19:50:16.301 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:16.307+0000 7f4347e00640 1 -- 172.21.15.44:0/4047139015 learned_addr learned my addr 172.21.15.44:0/4047139015 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-04-17T19:50:16.301 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:16.307+0000 7f434e800640 1 --2- 172.21.15.44:0/4047139015 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f4350073f30 0x7f43500725b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:50:16.301 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:16.307+0000 7f434de00640 1 --2- 172.21.15.44:0/4047139015 >> v2:172.21.15.62:3300/0 conn(0x7f43500c66d0 0x7f43501536a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:50:16.301 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:16.307+0000 7f434d400640 1 -- 172.21.15.44:0/4047139015 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4081493459 0 0) 0x7f4350153ff0 con 0x7f4350153be0 2024-04-17T19:50:16.302 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:16.307+0000 7f434d400640 1 -- 172.21.15.44:0/4047139015 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4334003530 con 0x7f4350153be0 2024-04-17T19:50:16.302 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:16.307+0000 7f434d400640 1 -- 172.21.15.44:0/4047139015 <== mon.0 v1:172.21.15.44:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1380824071 0 0) 0x7f4334003530 con 0x7f4350153be0 2024-04-17T19:50:16.302 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:16.307+0000 7f434d400640 1 -- 172.21.15.44:0/4047139015 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f4350073f30 msgr2=0x7f43500725b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T19:50:16.302 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:16.307+0000 7f434d400640 1 --2- 172.21.15.44:0/4047139015 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f4350073f30 0x7f43500725b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:50:16.302 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:16.307+0000 7f434d400640 1 -- 172.21.15.44:0/4047139015 >> v2:172.21.15.62:3300/0 conn(0x7f43500c66d0 msgr2=0x7f43501536a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T19:50:16.302 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:16.307+0000 7f434d400640 1 --2- 172.21.15.44:0/4047139015 >> v2:172.21.15.62:3300/0 conn(0x7f43500c66d0 0x7f43501536a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:50:16.302 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:16.307+0000 7f434d400640 1 -- 172.21.15.44:0/4047139015 --> v1:172.21.15.44:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f435015a090 con 0x7f4350153be0 2024-04-17T19:50:16.302 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:16.307+0000 7f434d400640 1 -- 172.21.15.44:0/4047139015 <== mon.0 v1:172.21.15.44:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1863569991 0 0) 0x7f43380016a0 con 0x7f4350153be0 2024-04-17T19:50:16.302 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:16.307+0000 7f434d400640 1 -- 172.21.15.44:0/4047139015 >> v1:172.21.15.44:6789/0 conn(0x7f4350153be0 legacy=0x7f4350073820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:50:16.302 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:16.307+0000 7f434d400640 1 --2- 172.21.15.44:0/4047139015 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f43340039c0 0x7f4334003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:50:16.302 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:16.307+0000 7f434d400640 1 --2- 172.21.15.44:0/4047139015 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4334004810 0x7f4334004c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:50:16.302 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:16.307+0000 7f434d400640 1 --2- 172.21.15.44:0/4047139015 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f4350073f30 0x7f4334005160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:50:16.302 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:16.307+0000 7f434d400640 1 -- 172.21.15.44:0/4047139015 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f4350159ad0 con 0x7f43340039c0 2024-04-17T19:50:16.302 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:16.307+0000 7f434d400640 1 -- 172.21.15.44:0/4047139015 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f4350159db0 con 0x7f4334004810 2024-04-17T19:50:16.303 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:16.307+0000 7f434d400640 1 -- 172.21.15.44:0/4047139015 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7f433400b9d0 con 0x7f4350073f30 2024-04-17T19:50:16.303 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:16.307+0000 7f434de00640 1 --2- 172.21.15.44:0/4047139015 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f43340039c0 0x7f4334003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:50:16.303 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:16.307+0000 7f4347e00640 1 --2- 172.21.15.44:0/4047139015 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4334004810 0x7f4334004c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:50:16.303 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:16.307+0000 7f434e800640 1 --2- 172.21.15.44:0/4047139015 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f4350073f30 0x7f4334005160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:50:16.303 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:16.307+0000 7f434de00640 1 -- 172.21.15.44:0/4047139015 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f4350073f30 msgr2=0x7f4334005160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T19:50:16.303 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:16.307+0000 7f434de00640 1 --2- 172.21.15.44:0/4047139015 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f4350073f30 0x7f4334005160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:50:16.303 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:16.307+0000 7f434de00640 1 -- 172.21.15.44:0/4047139015 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4334004810 msgr2=0x7f4334004c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T19:50:16.303 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:16.307+0000 7f434de00640 1 --2- 172.21.15.44:0/4047139015 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4334004810 0x7f4334004c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:50:16.303 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:16.307+0000 7f434de00640 1 -- 172.21.15.44:0/4047139015 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4334003530 con 0x7f43340039c0 2024-04-17T19:50:16.305 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:16.311+0000 7f434de00640 1 --2- 172.21.15.44:0/4047139015 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f43340039c0 0x7f4334003e30 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f4340009ae0 tx=0x7f434001cab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8149f48337820707 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:50:16.305 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:16.311+0000 7f434d400640 1 -- 172.21.15.44:0/4047139015 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43400b2070 con 0x7f43340039c0 2024-04-17T19:50:16.305 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:16.311+0000 7f434d400640 1 -- 172.21.15.44:0/4047139015 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f43400a5570 con 0x7f43340039c0 2024-04-17T19:50:16.306 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:16.311+0000 7f434d400640 1 -- 172.21.15.44:0/4047139015 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43400096b0 con 0x7f43340039c0 2024-04-17T19:50:16.306 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:16.311+0000 7f4355200640 1 -- 172.21.15.44:0/4047139015 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f43340039c0 msgr2=0x7f4334003e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:50:16.306 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:16.311+0000 7f4355200640 1 --2- 172.21.15.44:0/4047139015 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f43340039c0 0x7f4334003e30 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f4340009ae0 tx=0x7f434001cab0 comp rx=0 tx=0).stop 2024-04-17T19:50:16.306 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:16.311+0000 7f434e800640 1 -- 172.21.15.44:0/4047139015 reap_dead start 2024-04-17T19:50:16.306 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:16.311+0000 7f4355200640 1 -- 172.21.15.44:0/4047139015 shutdown_connections 2024-04-17T19:50:16.306 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:16.311+0000 7f4355200640 1 -- 172.21.15.44:0/4047139015 >> 172.21.15.44:0/4047139015 conn(0x7f435006c380 msgr2=0x7f4350070080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:50:16.306 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:16.311+0000 7f4355200640 1 -- 172.21.15.44:0/4047139015 shutdown_connections 2024-04-17T19:50:16.306 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:16.311+0000 7f4355200640 1 -- 172.21.15.44:0/4047139015 wait complete. 2024-04-17T19:50:16.306 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:16.315+0000 7f4355200640 1 Processor -- start 2024-04-17T19:50:16.306 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:16.315+0000 7f4355200640 1 -- start start 2024-04-17T19:50:16.308 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:16.315+0000 7f4355200640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f43340039c0 0x7f4350140870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:50:16.308 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:16.315+0000 7f4355200640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f435013f820 0x7f43500c7bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:50:16.308 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:16.315+0000 7f4355200640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f43501eb300 0x7f43501eb710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:50:16.308 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:16.315+0000 7f4355200640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f4350072f40 con 0x7f43501eb300 2024-04-17T19:50:16.308 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:16.315+0000 7f4355200640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f4350072dc0 con 0x7f43340039c0 2024-04-17T19:50:16.309 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:16.315+0000 7f4355200640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7f4350164260 con 0x7f435013f820 2024-04-17T19:50:16.309 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:16.315+0000 7f434e800640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f43501eb300 0x7f43501eb710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:50:16.309 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:16.315+0000 7f434e800640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f43501eb300 0x7f43501eb710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:46890/0 (socket says 172.21.15.44:46890) 2024-04-17T19:50:16.309 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:16.315+0000 7f434e800640 1 -- 172.21.15.44:0/3120399247 learned_addr learned my addr 172.21.15.44:0/3120399247 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-04-17T19:50:16.309 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:16.315+0000 7f4347e00640 1 --2- 172.21.15.44:0/3120399247 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f435013f820 0x7f43500c7bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:50:16.309 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:16.315+0000 7f434de00640 1 --2- 172.21.15.44:0/3120399247 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f43340039c0 0x7f4350140870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:50:16.309 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:16.315+0000 7f434e800640 1 -- 172.21.15.44:0/3120399247 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f435013f820 msgr2=0x7f43500c7bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:50:16.309 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:16.315+0000 7f434e800640 1 --2- 172.21.15.44:0/3120399247 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f435013f820 0x7f43500c7bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:50:16.309 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:16.315+0000 7f434e800640 1 -- 172.21.15.44:0/3120399247 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f43340039c0 msgr2=0x7f4350140870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:50:16.309 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:16.315+0000 7f434e800640 1 --2- 172.21.15.44:0/3120399247 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f43340039c0 0x7f4350140870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:50:16.309 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:16.315+0000 7f434e800640 1 -- 172.21.15.44:0/3120399247 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4350140db0 con 0x7f43501eb300 2024-04-17T19:50:16.309 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:16.315+0000 7f4347e00640 1 --2- 172.21.15.44:0/3120399247 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f435013f820 0x7f43500c7bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-17T19:50:16.309 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:16.315+0000 7f434de00640 1 --2- 172.21.15.44:0/3120399247 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f43340039c0 0x7f4350140870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-17T19:50:16.309 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:16.315+0000 7f434e800640 1 --2- 172.21.15.44:0/3120399247 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f43501eb300 0x7f43501eb710 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f435006cca0 tx=0x7f43480115a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:50:16.309 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:16.315+0000 7f4346000640 1 -- 172.21.15.44:0/3120399247 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4348011e40 con 0x7f43501eb300 2024-04-17T19:50:16.309 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:16.315+0000 7f4346000640 1 -- 172.21.15.44:0/3120399247 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f434801b070 con 0x7f43501eb300 2024-04-17T19:50:16.310 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:16.315+0000 7f4346000640 1 -- 172.21.15.44:0/3120399247 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43480039a0 con 0x7f43501eb300 2024-04-17T19:50:16.310 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:16.315+0000 7f4355200640 1 -- 172.21.15.44:0/3120399247 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4350141a00 con 0x7f43501eb300 2024-04-17T19:50:16.310 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:16.319+0000 7f4355200640 1 -- 172.21.15.44:0/3120399247 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f435014fd70 con 0x7f43501eb300 2024-04-17T19:50:16.310 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:16.319+0000 7f4355200640 1 -- 172.21.15.44:0/3120399247 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f435004ff10 con 0x7f43501eb300 2024-04-17T19:50:16.310 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:16.319+0000 7f4346000640 1 -- 172.21.15.44:0/3120399247 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f4348003b40 con 0x7f43501eb300 2024-04-17T19:50:16.311 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:16.319+0000 7f4346000640 1 --2- 172.21.15.44:0/3120399247 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f432c0683b0 0x7f432c06a8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:50:16.311 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:16.319+0000 7f4346000640 1 -- 172.21.15.44:0/3120399247 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6619+0+0 (secure 0 0 0) 0x7f4348087580 con 0x7f43501eb300 2024-04-17T19:50:16.311 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:16.319+0000 7f434de00640 1 --2- 172.21.15.44:0/3120399247 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f432c0683b0 0x7f432c06a8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:50:16.312 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:16.323+0000 7f434de00640 1 --2- 172.21.15.44:0/3120399247 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f432c0683b0 0x7f432c06a8c0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f43400af000 tx=0x7f43400046d0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:50:16.316 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:16.323+0000 7f4346000640 1 -- 172.21.15.44:0/3120399247 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f4348057680 con 0x7f43501eb300 2024-04-17T19:50:16.479 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:16.487+0000 7f4355200640 1 -- 172.21.15.44:0/3120399247 --> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f4350150f10 con 0x7f432c0683b0 2024-04-17T19:50:16.503 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:16.511+0000 7f4346000640 1 -- 172.21.15.44:0/3120399247 <== mgr.4102 v2:172.21.15.62:6832/1020159798 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+332714 (secure 0 0 0) 0x7f434010e3c0 con 0x7f432c0683b0 2024-04-17T19:50:16.507 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-04-17T19:50:16.508 INFO:teuthology.orchestra.run.smithi044.stderr:dumped all 2024-04-17T19:50:16.509 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:16.515+0000 7f4355200640 1 -- 172.21.15.44:0/3120399247 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f432c0683b0 msgr2=0x7f432c06a8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:50:16.509 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:16.515+0000 7f4355200640 1 --2- 172.21.15.44:0/3120399247 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f432c0683b0 0x7f432c06a8c0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f43400af000 tx=0x7f43400046d0 comp rx=0 tx=0).stop 2024-04-17T19:50:16.509 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:16.515+0000 7f4355200640 1 -- 172.21.15.44:0/3120399247 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f43501eb300 msgr2=0x7f43501eb710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:50:16.510 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:16.515+0000 7f4355200640 1 --2- 172.21.15.44:0/3120399247 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f43501eb300 0x7f43501eb710 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f435006cca0 tx=0x7f43480115a0 comp rx=0 tx=0).stop 2024-04-17T19:50:16.510 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:16.515+0000 7f4355200640 1 -- 172.21.15.44:0/3120399247 shutdown_connections 2024-04-17T19:50:16.510 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:16.515+0000 7f4355200640 1 --2- 172.21.15.44:0/3120399247 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f432c0683b0 0x7f432c06a8c0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:50:16.510 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:16.515+0000 7f4355200640 1 --2- 172.21.15.44:0/3120399247 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f435013f820 0x7f43500c7bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:50:16.510 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:16.515+0000 7f4355200640 1 --2- 172.21.15.44:0/3120399247 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f43501eb300 0x7f43501eb710 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:50:16.510 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:16.515+0000 7f4355200640 1 --2- 172.21.15.44:0/3120399247 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f43340039c0 0x7f4350140870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:50:16.510 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:16.515+0000 7f4355200640 1 -- 172.21.15.44:0/3120399247 >> 172.21.15.44:0/3120399247 conn(0x7f435006c380 msgr2=0x7f4350151c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:50:16.510 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:16.515+0000 7f4355200640 1 -- 172.21.15.44:0/3120399247 shutdown_connections 2024-04-17T19:50:16.510 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:16.515+0000 7f4355200640 1 -- 172.21.15.44:0/3120399247 wait complete. 2024-04-17T19:50:16.528 INFO:teuthology.orchestra.run.smithi044.stdout:{"pg_ready":true,"pg_map":{"version":128,"stamp":"2024-04-17T19:50:15.986738+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":634796,"num_objects":101,"num_object_clones":0,"num_object_copies":202,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":101,"num_whiteouts":0,"num_read":118,"num_read_kb":102,"num_write":413,"num_write_kb":2540,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":343,"ondisk_log_size":343,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":218792,"kb_used_data":2664,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755928,"statfs":{"total":773094113280,"available":772870070272,"internally_reserved":0,"allocated":2727936,"data_stored":2194440,"data_compressed":66496,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":12751,"internal_metadata":221236785},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005888"},"pg_stats":[{"pgid":"2.1f","version":"27'13","reported_seq":40,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:39.943777+0000","last_change":"2024-04-17T19:46:55.688623+0000","last_active":"2024-04-17T19:47:39.943777+0000","last_peered":"2024-04-17T19:47:39.943777+0000","last_clean":"2024-04-17T19:47:39.943777+0000","last_became_active":"2024-04-17T19:46:55.687455+0000","last_became_peered":"2024-04-17T19:46:55.687455+0000","last_unstale":"2024-04-17T19:47:39.943777+0000","last_undegraded":"2024-04-17T19:47:39.943777+0000","last_fullsized":"2024-04-17T19:47:39.943777+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:54.640133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:54.640133+0000","last_clean_scrub_stamp":"2024-04-17T19:46:54.640133+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:02:52.057635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:38.681457+0000","last_change":"2024-04-17T19:46:56.683770+0000","last_active":"2024-04-17T19:47:38.681457+0000","last_peered":"2024-04-17T19:47:38.681457+0000","last_clean":"2024-04-17T19:47:38.681457+0000","last_became_active":"2024-04-17T19:46:56.683111+0000","last_became_peered":"2024-04-17T19:46:56.683111+0000","last_unstale":"2024-04-17T19:47:38.681457+0000","last_undegraded":"2024-04-17T19:47:38.681457+0000","last_fullsized":"2024-04-17T19:47:38.681457+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_clean_scrub_stamp":"2024-04-17T19:46:55.648649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T22:25:59.135091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:37.965849+0000","last_change":"2024-04-17T19:47:00.788461+0000","last_active":"2024-04-17T19:47:37.965849+0000","last_peered":"2024-04-17T19:47:37.965849+0000","last_clean":"2024-04-17T19:47:37.965849+0000","last_became_active":"2024-04-17T19:47:00.787654+0000","last_became_peered":"2024-04-17T19:47:00.787654+0000","last_unstale":"2024-04-17T19:47:37.965849+0000","last_undegraded":"2024-04-17T19:47:37.965849+0000","last_fullsized":"2024-04-17T19:47:37.965849+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_clean_scrub_stamp":"2024-04-17T19:46:59.695482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T07:28:34.234670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4,1],"acting":[7,6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1e","version":"25'2","reported_seq":29,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:38.681382+0000","last_change":"2024-04-17T19:46:55.703749+0000","last_active":"2024-04-17T19:47:38.681382+0000","last_peered":"2024-04-17T19:47:38.681382+0000","last_clean":"2024-04-17T19:47:38.681382+0000","last_became_active":"2024-04-17T19:46:55.695191+0000","last_became_peered":"2024-04-17T19:46:55.695191+0000","last_unstale":"2024-04-17T19:47:38.681382+0000","last_undegraded":"2024-04-17T19:47:38.681382+0000","last_fullsized":"2024-04-17T19:47:38.681382+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:54.640133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:54.640133+0000","last_clean_scrub_stamp":"2024-04-17T19:46:54.640133+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:24:42.573542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:38.681668+0000","last_change":"2024-04-17T19:46:56.684814+0000","last_active":"2024-04-17T19:47:38.681668+0000","last_peered":"2024-04-17T19:47:38.681668+0000","last_clean":"2024-04-17T19:47:38.681668+0000","last_became_active":"2024-04-17T19:46:56.684475+0000","last_became_peered":"2024-04-17T19:46:56.684475+0000","last_unstale":"2024-04-17T19:47:38.681668+0000","last_undegraded":"2024-04-17T19:47:38.681668+0000","last_fullsized":"2024-04-17T19:47:38.681668+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_clean_scrub_stamp":"2024-04-17T19:46:55.648649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T05:38:55.394025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:37.955108+0000","last_change":"2024-04-17T19:47:00.769813+0000","last_active":"2024-04-17T19:47:37.955108+0000","last_peered":"2024-04-17T19:47:37.955108+0000","last_clean":"2024-04-17T19:47:37.955108+0000","last_became_active":"2024-04-17T19:47:00.769370+0000","last_became_peered":"2024-04-17T19:47:00.769370+0000","last_unstale":"2024-04-17T19:47:37.955108+0000","last_undegraded":"2024-04-17T19:47:37.955108+0000","last_fullsized":"2024-04-17T19:47:37.955108+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_clean_scrub_stamp":"2024-04-17T19:46:59.695482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:23:20.430751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,4,6],"acting":[2,7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1d","version":"27'13","reported_seq":40,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:49:27.988193+0000","last_change":"2024-04-17T19:46:55.695159+0000","last_active":"2024-04-17T19:49:27.988193+0000","last_peered":"2024-04-17T19:49:27.988193+0000","last_clean":"2024-04-17T19:49:27.988193+0000","last_became_active":"2024-04-17T19:46:55.694285+0000","last_became_peered":"2024-04-17T19:46:55.694285+0000","last_unstale":"2024-04-17T19:49:27.988193+0000","last_undegraded":"2024-04-17T19:49:27.988193+0000","last_fullsized":"2024-04-17T19:49:27.988193+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:54.640133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:54.640133+0000","last_clean_scrub_stamp":"2024-04-17T19:46:54.640133+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T04:52:16.008572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:38.680518+0000","last_change":"2024-04-17T19:46:56.700734+0000","last_active":"2024-04-17T19:47:38.680518+0000","last_peered":"2024-04-17T19:47:38.680518+0000","last_clean":"2024-04-17T19:47:38.680518+0000","last_became_active":"2024-04-17T19:46:56.700413+0000","last_became_peered":"2024-04-17T19:46:56.700413+0000","last_unstale":"2024-04-17T19:47:38.680518+0000","last_undegraded":"2024-04-17T19:47:38.680518+0000","last_fullsized":"2024-04-17T19:47:38.680518+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_clean_scrub_stamp":"2024-04-17T19:46:55.648649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:57:40.700986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:37.955549+0000","last_change":"2024-04-17T19:47:00.772341+0000","last_active":"2024-04-17T19:47:37.955549+0000","last_peered":"2024-04-17T19:47:37.955549+0000","last_clean":"2024-04-17T19:47:37.955549+0000","last_became_active":"2024-04-17T19:47:00.771578+0000","last_became_peered":"2024-04-17T19:47:00.771578+0000","last_unstale":"2024-04-17T19:47:37.955549+0000","last_undegraded":"2024-04-17T19:47:37.955549+0000","last_fullsized":"2024-04-17T19:47:37.955549+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_clean_scrub_stamp":"2024-04-17T19:46:59.695482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:51:07.602172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,3,6],"acting":[2,5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1c","version":"27'5","reported_seq":32,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:39.944815+0000","last_change":"2024-04-17T19:46:55.687607+0000","last_active":"2024-04-17T19:47:39.944815+0000","last_peered":"2024-04-17T19:47:39.944815+0000","last_clean":"2024-04-17T19:47:39.944815+0000","last_became_active":"2024-04-17T19:46:55.687282+0000","last_became_peered":"2024-04-17T19:46:55.687282+0000","last_unstale":"2024-04-17T19:47:39.944815+0000","last_undegraded":"2024-04-17T19:47:39.944815+0000","last_fullsized":"2024-04-17T19:47:39.944815+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:54.640133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:54.640133+0000","last_clean_scrub_stamp":"2024-04-17T19:46:54.640133+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T05:52:32.550876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:38.473780+0000","last_change":"2024-04-17T19:46:56.690268+0000","last_active":"2024-04-17T19:47:38.473780+0000","last_peered":"2024-04-17T19:47:38.473780+0000","last_clean":"2024-04-17T19:47:38.473780+0000","last_became_active":"2024-04-17T19:46:56.689988+0000","last_became_peered":"2024-04-17T19:46:56.689988+0000","last_unstale":"2024-04-17T19:47:38.473780+0000","last_undegraded":"2024-04-17T19:47:38.473780+0000","last_fullsized":"2024-04-17T19:47:38.473780+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_clean_scrub_stamp":"2024-04-17T19:46:55.648649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T01:29:59.423734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:37.955298+0000","last_change":"2024-04-17T19:47:00.759608+0000","last_active":"2024-04-17T19:47:37.955298+0000","last_peered":"2024-04-17T19:47:37.955298+0000","last_clean":"2024-04-17T19:47:37.955298+0000","last_became_active":"2024-04-17T19:47:00.759059+0000","last_became_peered":"2024-04-17T19:47:00.759059+0000","last_unstale":"2024-04-17T19:47:37.955298+0000","last_undegraded":"2024-04-17T19:47:37.955298+0000","last_fullsized":"2024-04-17T19:47:37.955298+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_clean_scrub_stamp":"2024-04-17T19:46:59.695482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:22:37.460235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,5,7],"acting":[2,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:38.473032+0000","last_change":"2024-04-17T19:46:56.688273+0000","last_active":"2024-04-17T19:47:38.473032+0000","last_peered":"2024-04-17T19:47:38.473032+0000","last_clean":"2024-04-17T19:47:38.473032+0000","last_became_active":"2024-04-17T19:46:56.687662+0000","last_became_peered":"2024-04-17T19:46:56.687662+0000","last_unstale":"2024-04-17T19:47:38.473032+0000","last_undegraded":"2024-04-17T19:47:38.473032+0000","last_fullsized":"2024-04-17T19:47:38.473032+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_clean_scrub_stamp":"2024-04-17T19:46:55.648649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:51:46.684685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"27'5","reported_seq":32,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:49:12.983636+0000","last_change":"2024-04-17T19:46:55.692833+0000","last_active":"2024-04-17T19:49:12.983636+0000","last_peered":"2024-04-17T19:49:12.983636+0000","last_clean":"2024-04-17T19:49:12.983636+0000","last_became_active":"2024-04-17T19:46:55.689006+0000","last_became_peered":"2024-04-17T19:46:55.689006+0000","last_unstale":"2024-04-17T19:49:12.983636+0000","last_undegraded":"2024-04-17T19:49:12.983636+0000","last_fullsized":"2024-04-17T19:49:12.983636+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:54.640133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:54.640133+0000","last_clean_scrub_stamp":"2024-04-17T19:46:54.640133+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:57:39.692470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:38.473658+0000","last_change":"2024-04-17T19:47:00.757063+0000","last_active":"2024-04-17T19:47:38.473658+0000","last_peered":"2024-04-17T19:47:38.473658+0000","last_clean":"2024-04-17T19:47:38.473658+0000","last_became_active":"2024-04-17T19:47:00.756456+0000","last_became_peered":"2024-04-17T19:47:00.756456+0000","last_unstale":"2024-04-17T19:47:38.473658+0000","last_undegraded":"2024-04-17T19:47:38.473658+0000","last_fullsized":"2024-04-17T19:47:38.473658+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_clean_scrub_stamp":"2024-04-17T19:46:59.695482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T02:52:51.655611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,5],"acting":[3,1,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:37.966870+0000","last_change":"2024-04-17T19:46:56.691544+0000","last_active":"2024-04-17T19:47:37.966870+0000","last_peered":"2024-04-17T19:47:37.966870+0000","last_clean":"2024-04-17T19:47:37.966870+0000","last_became_active":"2024-04-17T19:46:56.690828+0000","last_became_peered":"2024-04-17T19:46:56.690828+0000","last_unstale":"2024-04-17T19:47:37.966870+0000","last_undegraded":"2024-04-17T19:47:37.966870+0000","last_fullsized":"2024-04-17T19:47:37.966870+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_clean_scrub_stamp":"2024-04-17T19:46:55.648649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:11:01.745657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.a","version":"27'4","reported_seq":31,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:53.926051+0000","last_change":"2024-04-17T19:46:55.715857+0000","last_active":"2024-04-17T19:47:53.926051+0000","last_peered":"2024-04-17T19:47:53.926051+0000","last_clean":"2024-04-17T19:47:53.926051+0000","last_became_active":"2024-04-17T19:46:55.715197+0000","last_became_peered":"2024-04-17T19:46:55.715197+0000","last_unstale":"2024-04-17T19:47:53.926051+0000","last_undegraded":"2024-04-17T19:47:53.926051+0000","last_fullsized":"2024-04-17T19:47:53.926051+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:54.640133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:54.640133+0000","last_clean_scrub_stamp":"2024-04-17T19:46:54.640133+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:25:07.379181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:37.958909+0000","last_change":"2024-04-17T19:47:00.773528+0000","last_active":"2024-04-17T19:47:37.958909+0000","last_peered":"2024-04-17T19:47:37.958909+0000","last_clean":"2024-04-17T19:47:37.958909+0000","last_became_active":"2024-04-17T19:47:00.773077+0000","last_became_peered":"2024-04-17T19:47:00.773077+0000","last_unstale":"2024-04-17T19:47:37.958909+0000","last_undegraded":"2024-04-17T19:47:37.958909+0000","last_fullsized":"2024-04-17T19:47:37.958909+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_clean_scrub_stamp":"2024-04-17T19:46:59.695482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T02:53:18.654740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,6,1],"acting":[0,4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:37.956343+0000","last_change":"2024-04-17T19:46:56.695617+0000","last_active":"2024-04-17T19:47:37.956343+0000","last_peered":"2024-04-17T19:47:37.956343+0000","last_clean":"2024-04-17T19:47:37.956343+0000","last_became_active":"2024-04-17T19:46:56.695205+0000","last_became_peered":"2024-04-17T19:46:56.695205+0000","last_unstale":"2024-04-17T19:47:37.956343+0000","last_undegraded":"2024-04-17T19:47:37.956343+0000","last_fullsized":"2024-04-17T19:47:37.956343+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_clean_scrub_stamp":"2024-04-17T19:46:55.648649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T05:05:36.718886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"27'7","reported_seq":34,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:39.942448+0000","last_change":"2024-04-17T19:46:55.686220+0000","last_active":"2024-04-17T19:47:39.942448+0000","last_peered":"2024-04-17T19:47:39.942448+0000","last_clean":"2024-04-17T19:47:39.942448+0000","last_became_active":"2024-04-17T19:46:55.684782+0000","last_became_peered":"2024-04-17T19:46:55.684782+0000","last_unstale":"2024-04-17T19:47:39.942448+0000","last_undegraded":"2024-04-17T19:47:39.942448+0000","last_fullsized":"2024-04-17T19:47:39.942448+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:54.640133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:54.640133+0000","last_clean_scrub_stamp":"2024-04-17T19:46:54.640133+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:57:31.750325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:38.475895+0000","last_change":"2024-04-17T19:47:38.474847+0000","last_active":"2024-04-17T19:47:38.475895+0000","last_peered":"2024-04-17T19:47:38.475895+0000","last_clean":"2024-04-17T19:47:38.475895+0000","last_became_active":"2024-04-17T19:47:38.474208+0000","last_became_peered":"2024-04-17T19:47:38.474208+0000","last_unstale":"2024-04-17T19:47:38.475895+0000","last_undegraded":"2024-04-17T19:47:38.475895+0000","last_fullsized":"2024-04-17T19:47:38.475895+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_clean_scrub_stamp":"2024-04-17T19:46:59.695482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T05:15:30.939022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2,3],"acting":[0,4,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:38.472711+0000","last_change":"2024-04-17T19:46:56.700069+0000","last_active":"2024-04-17T19:47:38.472711+0000","last_peered":"2024-04-17T19:47:38.472711+0000","last_clean":"2024-04-17T19:47:38.472711+0000","last_became_active":"2024-04-17T19:46:56.699525+0000","last_became_peered":"2024-04-17T19:46:56.699525+0000","last_unstale":"2024-04-17T19:47:38.472711+0000","last_undegraded":"2024-04-17T19:47:38.472711+0000","last_fullsized":"2024-04-17T19:47:38.472711+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_clean_scrub_stamp":"2024-04-17T19:46:55.648649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T00:28:36.944531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.8","version":"25'2","reported_seq":29,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:37.958712+0000","last_change":"2024-04-17T19:46:55.684594+0000","last_active":"2024-04-17T19:47:37.958712+0000","last_peered":"2024-04-17T19:47:37.958712+0000","last_clean":"2024-04-17T19:47:37.958712+0000","last_became_active":"2024-04-17T19:46:55.683145+0000","last_became_peered":"2024-04-17T19:46:55.683145+0000","last_unstale":"2024-04-17T19:47:37.958712+0000","last_undegraded":"2024-04-17T19:47:37.958712+0000","last_fullsized":"2024-04-17T19:47:37.958712+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:54.640133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:54.640133+0000","last_clean_scrub_stamp":"2024-04-17T19:46:54.640133+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T02:39:08.241534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:37.956151+0000","last_change":"2024-04-17T19:47:00.768781+0000","last_active":"2024-04-17T19:47:37.956151+0000","last_peered":"2024-04-17T19:47:37.956151+0000","last_clean":"2024-04-17T19:47:37.956151+0000","last_became_active":"2024-04-17T19:47:00.768277+0000","last_became_peered":"2024-04-17T19:47:00.768277+0000","last_unstale":"2024-04-17T19:47:37.956151+0000","last_undegraded":"2024-04-17T19:47:37.956151+0000","last_fullsized":"2024-04-17T19:47:37.956151+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_clean_scrub_stamp":"2024-04-17T19:46:59.695482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:07:00.936098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,7],"acting":[2,1,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:37.959525+0000","last_change":"2024-04-17T19:46:56.695528+0000","last_active":"2024-04-17T19:47:37.959525+0000","last_peered":"2024-04-17T19:47:37.959525+0000","last_clean":"2024-04-17T19:47:37.959525+0000","last_became_active":"2024-04-17T19:46:56.694993+0000","last_became_peered":"2024-04-17T19:46:56.694993+0000","last_unstale":"2024-04-17T19:47:37.959525+0000","last_undegraded":"2024-04-17T19:47:37.959525+0000","last_fullsized":"2024-04-17T19:47:37.959525+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_clean_scrub_stamp":"2024-04-17T19:46:55.648649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:08:14.848448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"27'8","reported_seq":35,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:49:07.983053+0000","last_change":"2024-04-17T19:46:55.688859+0000","last_active":"2024-04-17T19:49:07.983053+0000","last_peered":"2024-04-17T19:49:07.983053+0000","last_clean":"2024-04-17T19:49:07.983053+0000","last_became_active":"2024-04-17T19:46:55.688507+0000","last_became_peered":"2024-04-17T19:46:55.688507+0000","last_unstale":"2024-04-17T19:49:07.983053+0000","last_undegraded":"2024-04-17T19:49:07.983053+0000","last_fullsized":"2024-04-17T19:49:07.983053+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:54.640133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:54.640133+0000","last_clean_scrub_stamp":"2024-04-17T19:46:54.640133+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T01:53:38.377482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:37.955200+0000","last_change":"2024-04-17T19:47:00.781482+0000","last_active":"2024-04-17T19:47:37.955200+0000","last_peered":"2024-04-17T19:47:37.955200+0000","last_clean":"2024-04-17T19:47:37.955200+0000","last_became_active":"2024-04-17T19:47:00.780994+0000","last_became_peered":"2024-04-17T19:47:00.780994+0000","last_unstale":"2024-04-17T19:47:37.955200+0000","last_undegraded":"2024-04-17T19:47:37.955200+0000","last_fullsized":"2024-04-17T19:47:37.955200+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_clean_scrub_stamp":"2024-04-17T19:46:59.695482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T01:46:40.550031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,3,1],"acting":[2,6,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:37.962898+0000","last_change":"2024-04-17T19:46:56.695874+0000","last_active":"2024-04-17T19:47:37.962898+0000","last_peered":"2024-04-17T19:47:37.962898+0000","last_clean":"2024-04-17T19:47:37.962898+0000","last_became_active":"2024-04-17T19:46:56.694650+0000","last_became_peered":"2024-04-17T19:46:56.694650+0000","last_unstale":"2024-04-17T19:47:37.962898+0000","last_undegraded":"2024-04-17T19:47:37.962898+0000","last_fullsized":"2024-04-17T19:47:37.962898+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_clean_scrub_stamp":"2024-04-17T19:46:55.648649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:44:38.787541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"27'17","reported_seq":44,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:49:31.753195+0000","last_change":"2024-04-17T19:46:55.684490+0000","last_active":"2024-04-17T19:49:31.753195+0000","last_peered":"2024-04-17T19:49:31.753195+0000","last_clean":"2024-04-17T19:49:31.753195+0000","last_became_active":"2024-04-17T19:46:55.680100+0000","last_became_peered":"2024-04-17T19:46:55.680100+0000","last_unstale":"2024-04-17T19:49:31.753195+0000","last_undegraded":"2024-04-17T19:49:31.753195+0000","last_fullsized":"2024-04-17T19:49:31.753195+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:54.640133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:54.640133+0000","last_clean_scrub_stamp":"2024-04-17T19:46:54.640133+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:27:38.256174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":31,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:37.956231+0000","last_change":"2024-04-17T19:47:00.777588+0000","last_active":"2024-04-17T19:47:37.956231+0000","last_peered":"2024-04-17T19:47:37.956231+0000","last_clean":"2024-04-17T19:47:37.956231+0000","last_became_active":"2024-04-17T19:47:00.776873+0000","last_became_peered":"2024-04-17T19:47:00.776873+0000","last_unstale":"2024-04-17T19:47:37.956231+0000","last_undegraded":"2024-04-17T19:47:37.956231+0000","last_fullsized":"2024-04-17T19:47:37.956231+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_clean_scrub_stamp":"2024-04-17T19:46:59.695482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T02:52:42.471996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,6,3],"acting":[4,1,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:37.961616+0000","last_change":"2024-04-17T19:46:56.681681+0000","last_active":"2024-04-17T19:47:37.961616+0000","last_peered":"2024-04-17T19:47:37.961616+0000","last_clean":"2024-04-17T19:47:37.961616+0000","last_became_active":"2024-04-17T19:46:56.681316+0000","last_became_peered":"2024-04-17T19:46:56.681316+0000","last_unstale":"2024-04-17T19:47:37.961616+0000","last_undegraded":"2024-04-17T19:47:37.961616+0000","last_fullsized":"2024-04-17T19:47:37.961616+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_clean_scrub_stamp":"2024-04-17T19:46:55.648649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T07:28:30.187837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"27'4","reported_seq":31,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:39.945209+0000","last_change":"2024-04-17T19:46:55.692826+0000","last_active":"2024-04-17T19:47:39.945209+0000","last_peered":"2024-04-17T19:47:39.945209+0000","last_clean":"2024-04-17T19:47:39.945209+0000","last_became_active":"2024-04-17T19:46:55.691031+0000","last_became_peered":"2024-04-17T19:46:55.691031+0000","last_unstale":"2024-04-17T19:47:39.945209+0000","last_undegraded":"2024-04-17T19:47:39.945209+0000","last_fullsized":"2024-04-17T19:47:39.945209+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:54.640133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:54.640133+0000","last_clean_scrub_stamp":"2024-04-17T19:46:54.640133+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T05:52:32.550876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:37.959626+0000","last_change":"2024-04-17T19:47:00.777416+0000","last_active":"2024-04-17T19:47:37.959626+0000","last_peered":"2024-04-17T19:47:37.959626+0000","last_clean":"2024-04-17T19:47:37.959626+0000","last_became_active":"2024-04-17T19:47:00.771531+0000","last_became_peered":"2024-04-17T19:47:00.771531+0000","last_unstale":"2024-04-17T19:47:37.959626+0000","last_undegraded":"2024-04-17T19:47:37.959626+0000","last_fullsized":"2024-04-17T19:47:37.959626+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_clean_scrub_stamp":"2024-04-17T19:46:59.695482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:30:31.288100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,2,7],"acting":[6,0,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:37.955833+0000","last_change":"2024-04-17T19:46:56.692250+0000","last_active":"2024-04-17T19:47:37.955833+0000","last_peered":"2024-04-17T19:47:37.955833+0000","last_clean":"2024-04-17T19:47:37.955833+0000","last_became_active":"2024-04-17T19:46:56.691801+0000","last_became_peered":"2024-04-17T19:46:56.691801+0000","last_unstale":"2024-04-17T19:47:37.955833+0000","last_undegraded":"2024-04-17T19:47:37.955833+0000","last_fullsized":"2024-04-17T19:47:37.955833+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_clean_scrub_stamp":"2024-04-17T19:46:55.648649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T01:53:39.385998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"25'1","reported_seq":28,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:38.681129+0000","last_change":"2024-04-17T19:46:55.713556+0000","last_active":"2024-04-17T19:47:38.681129+0000","last_peered":"2024-04-17T19:47:38.681129+0000","last_clean":"2024-04-17T19:47:38.681129+0000","last_became_active":"2024-04-17T19:46:55.712908+0000","last_became_peered":"2024-04-17T19:46:55.712908+0000","last_unstale":"2024-04-17T19:47:38.681129+0000","last_undegraded":"2024-04-17T19:47:38.681129+0000","last_fullsized":"2024-04-17T19:47:38.681129+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:54.640133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:54.640133+0000","last_clean_scrub_stamp":"2024-04-17T19:46:54.640133+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:57:31.750325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:37.959269+0000","last_change":"2024-04-17T19:47:00.776868+0000","last_active":"2024-04-17T19:47:37.959269+0000","last_peered":"2024-04-17T19:47:37.959269+0000","last_clean":"2024-04-17T19:47:37.959269+0000","last_became_active":"2024-04-17T19:47:00.771385+0000","last_became_peered":"2024-04-17T19:47:00.771385+0000","last_unstale":"2024-04-17T19:47:37.959269+0000","last_undegraded":"2024-04-17T19:47:37.959269+0000","last_fullsized":"2024-04-17T19:47:37.959269+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_clean_scrub_stamp":"2024-04-17T19:46:59.695482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T01:46:40.550031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5,7],"acting":[6,3,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:37.959134+0000","last_change":"2024-04-17T19:46:56.709288+0000","last_active":"2024-04-17T19:47:37.959134+0000","last_peered":"2024-04-17T19:47:37.959134+0000","last_clean":"2024-04-17T19:47:37.959134+0000","last_became_active":"2024-04-17T19:46:56.708572+0000","last_became_peered":"2024-04-17T19:46:56.708572+0000","last_unstale":"2024-04-17T19:47:37.959134+0000","last_undegraded":"2024-04-17T19:47:37.959134+0000","last_fullsized":"2024-04-17T19:47:37.959134+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_clean_scrub_stamp":"2024-04-17T19:46:55.648649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:51:03.555339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"27'5","reported_seq":32,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:39.947236+0000","last_change":"2024-04-17T19:46:55.708506+0000","last_active":"2024-04-17T19:47:39.947236+0000","last_peered":"2024-04-17T19:47:39.947236+0000","last_clean":"2024-04-17T19:47:39.947236+0000","last_became_active":"2024-04-17T19:46:55.708175+0000","last_became_peered":"2024-04-17T19:46:55.708175+0000","last_unstale":"2024-04-17T19:47:39.947236+0000","last_undegraded":"2024-04-17T19:47:39.947236+0000","last_fullsized":"2024-04-17T19:47:39.947236+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:54.640133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:54.640133+0000","last_clean_scrub_stamp":"2024-04-17T19:46:54.640133+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T22:25:04.163982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:37.961174+0000","last_change":"2024-04-17T19:47:00.786657+0000","last_active":"2024-04-17T19:47:37.961174+0000","last_peered":"2024-04-17T19:47:37.961174+0000","last_clean":"2024-04-17T19:47:37.961174+0000","last_became_active":"2024-04-17T19:47:00.780743+0000","last_became_peered":"2024-04-17T19:47:00.780743+0000","last_unstale":"2024-04-17T19:47:37.961174+0000","last_undegraded":"2024-04-17T19:47:37.961174+0000","last_fullsized":"2024-04-17T19:47:37.961174+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_clean_scrub_stamp":"2024-04-17T19:46:59.695482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:07:00.936098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0,3],"acting":[6,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:38.680188+0000","last_change":"2024-04-17T19:46:56.679752+0000","last_active":"2024-04-17T19:47:38.680188+0000","last_peered":"2024-04-17T19:47:38.680188+0000","last_clean":"2024-04-17T19:47:38.680188+0000","last_became_active":"2024-04-17T19:46:56.679230+0000","last_became_peered":"2024-04-17T19:46:56.679230+0000","last_unstale":"2024-04-17T19:47:38.680188+0000","last_undegraded":"2024-04-17T19:47:38.680188+0000","last_fullsized":"2024-04-17T19:47:38.680188+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_clean_scrub_stamp":"2024-04-17T19:46:55.648649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:08:14.848448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"27'8","reported_seq":37,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:49:33.857429+0000","last_change":"2024-04-17T19:46:55.715967+0000","last_active":"2024-04-17T19:49:33.857429+0000","last_peered":"2024-04-17T19:49:33.857429+0000","last_clean":"2024-04-17T19:49:33.857429+0000","last_became_active":"2024-04-17T19:46:55.715247+0000","last_became_peered":"2024-04-17T19:46:55.715247+0000","last_unstale":"2024-04-17T19:49:33.857429+0000","last_undegraded":"2024-04-17T19:49:33.857429+0000","last_fullsized":"2024-04-17T19:49:33.857429+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:54.640133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:54.640133+0000","last_clean_scrub_stamp":"2024-04-17T19:46:54.640133+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T00:40:58.757373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":524,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:37.963876+0000","last_change":"2024-04-17T19:47:00.769901+0000","last_active":"2024-04-17T19:47:37.963876+0000","last_peered":"2024-04-17T19:47:37.963876+0000","last_clean":"2024-04-17T19:47:37.963876+0000","last_became_active":"2024-04-17T19:47:00.768634+0000","last_became_peered":"2024-04-17T19:47:00.768634+0000","last_unstale":"2024-04-17T19:47:37.963876+0000","last_undegraded":"2024-04-17T19:47:37.963876+0000","last_fullsized":"2024-04-17T19:47:37.963876+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_clean_scrub_stamp":"2024-04-17T19:46:59.695482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T04:48:47.816818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,7],"acting":[6,0,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:37.959374+0000","last_change":"2024-04-17T19:46:56.703467+0000","last_active":"2024-04-17T19:47:37.959374+0000","last_peered":"2024-04-17T19:47:37.959374+0000","last_clean":"2024-04-17T19:47:37.959374+0000","last_became_active":"2024-04-17T19:46:56.703148+0000","last_became_peered":"2024-04-17T19:46:56.703148+0000","last_unstale":"2024-04-17T19:47:37.959374+0000","last_undegraded":"2024-04-17T19:47:37.959374+0000","last_fullsized":"2024-04-17T19:47:37.959374+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_clean_scrub_stamp":"2024-04-17T19:46:55.648649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T22:01:49.863892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"27'4","reported_seq":31,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:39.945540+0000","last_change":"2024-04-17T19:46:55.715941+0000","last_active":"2024-04-17T19:47:39.945540+0000","last_peered":"2024-04-17T19:47:39.945540+0000","last_clean":"2024-04-17T19:47:39.945540+0000","last_became_active":"2024-04-17T19:46:55.715527+0000","last_became_peered":"2024-04-17T19:46:55.715527+0000","last_unstale":"2024-04-17T19:47:39.945540+0000","last_undegraded":"2024-04-17T19:47:39.945540+0000","last_fullsized":"2024-04-17T19:47:39.945540+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:54.640133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:54.640133+0000","last_clean_scrub_stamp":"2024-04-17T19:46:54.640133+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:11:00.737141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:38.681030+0000","last_change":"2024-04-17T19:47:00.784031+0000","last_active":"2024-04-17T19:47:38.681030+0000","last_peered":"2024-04-17T19:47:38.681030+0000","last_clean":"2024-04-17T19:47:38.681030+0000","last_became_active":"2024-04-17T19:47:00.783386+0000","last_became_peered":"2024-04-17T19:47:00.783386+0000","last_unstale":"2024-04-17T19:47:38.681030+0000","last_undegraded":"2024-04-17T19:47:38.681030+0000","last_fullsized":"2024-04-17T19:47:38.681030+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_clean_scrub_stamp":"2024-04-17T19:46:59.695482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:00:44.689926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6,1],"acting":[5,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:37.957437+0000","last_change":"2024-04-17T19:46:56.692287+0000","last_active":"2024-04-17T19:47:37.957437+0000","last_peered":"2024-04-17T19:47:37.957437+0000","last_clean":"2024-04-17T19:47:37.957437+0000","last_became_active":"2024-04-17T19:46:56.691917+0000","last_became_peered":"2024-04-17T19:46:56.691917+0000","last_unstale":"2024-04-17T19:47:37.957437+0000","last_undegraded":"2024-04-17T19:47:37.957437+0000","last_fullsized":"2024-04-17T19:47:37.957437+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_clean_scrub_stamp":"2024-04-17T19:46:55.648649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T07:37:05.790432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.3","version":"27'6","reported_seq":33,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:39.945478+0000","last_change":"2024-04-17T19:46:55.686031+0000","last_active":"2024-04-17T19:47:39.945478+0000","last_peered":"2024-04-17T19:47:39.945478+0000","last_clean":"2024-04-17T19:47:39.945478+0000","last_became_active":"2024-04-17T19:46:55.685599+0000","last_became_peered":"2024-04-17T19:46:55.685599+0000","last_unstale":"2024-04-17T19:47:39.945478+0000","last_undegraded":"2024-04-17T19:47:39.945478+0000","last_fullsized":"2024-04-17T19:47:39.945478+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:54.640133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:54.640133+0000","last_clean_scrub_stamp":"2024-04-17T19:46:54.640133+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T01:39:32.586696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":183,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:38.680085+0000","last_change":"2024-04-17T19:46:43.000943+0000","last_active":"2024-04-17T19:47:38.680085+0000","last_peered":"2024-04-17T19:47:38.680085+0000","last_clean":"2024-04-17T19:47:38.680085+0000","last_became_active":"2024-04-17T19:46:43.000652+0000","last_became_peered":"2024-04-17T19:46:43.000652+0000","last_unstale":"2024-04-17T19:47:38.680085+0000","last_undegraded":"2024-04-17T19:47:38.680085+0000","last_fullsized":"2024-04-17T19:47:38.680085+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:41.988197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:41.988197+0000","last_clean_scrub_stamp":"2024-04-17T19:46:41.988197+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T19:53:52.845547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:38.473896+0000","last_change":"2024-04-17T19:47:00.731680+0000","last_active":"2024-04-17T19:47:38.473896+0000","last_peered":"2024-04-17T19:47:38.473896+0000","last_clean":"2024-04-17T19:47:38.473896+0000","last_became_active":"2024-04-17T19:47:00.731093+0000","last_became_peered":"2024-04-17T19:47:00.731093+0000","last_unstale":"2024-04-17T19:47:38.473896+0000","last_undegraded":"2024-04-17T19:47:38.473896+0000","last_fullsized":"2024-04-17T19:47:38.473896+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_clean_scrub_stamp":"2024-04-17T19:46:59.695482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T04:59:23.336626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:38.473836+0000","last_change":"2024-04-17T19:46:56.692443+0000","last_active":"2024-04-17T19:47:38.473836+0000","last_peered":"2024-04-17T19:47:38.473836+0000","last_clean":"2024-04-17T19:47:38.473836+0000","last_became_active":"2024-04-17T19:46:56.692106+0000","last_became_peered":"2024-04-17T19:46:56.692106+0000","last_unstale":"2024-04-17T19:47:38.473836+0000","last_undegraded":"2024-04-17T19:47:38.473836+0000","last_fullsized":"2024-04-17T19:47:38.473836+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_clean_scrub_stamp":"2024-04-17T19:46:55.648649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T04:07:54.102221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.c","version":"27'6","reported_seq":33,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:48.269381+0000","last_change":"2024-04-17T19:46:55.689884+0000","last_active":"2024-04-17T19:47:48.269381+0000","last_peered":"2024-04-17T19:47:48.269381+0000","last_clean":"2024-04-17T19:47:48.269381+0000","last_became_active":"2024-04-17T19:46:55.689059+0000","last_became_peered":"2024-04-17T19:46:55.689059+0000","last_unstale":"2024-04-17T19:47:48.269381+0000","last_undegraded":"2024-04-17T19:47:48.269381+0000","last_fullsized":"2024-04-17T19:47:48.269381+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:54.640133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:54.640133+0000","last_clean_scrub_stamp":"2024-04-17T19:46:54.640133+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T04:52:16.008572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1428,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:37.955343+0000","last_change":"2024-04-17T19:47:00.760432+0000","last_active":"2024-04-17T19:47:37.955343+0000","last_peered":"2024-04-17T19:47:37.955343+0000","last_clean":"2024-04-17T19:47:37.955343+0000","last_became_active":"2024-04-17T19:47:00.759946+0000","last_became_peered":"2024-04-17T19:47:00.759946+0000","last_unstale":"2024-04-17T19:47:37.955343+0000","last_undegraded":"2024-04-17T19:47:37.955343+0000","last_fullsized":"2024-04-17T19:47:37.955343+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_clean_scrub_stamp":"2024-04-17T19:46:59.695482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:30:31.288100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,7,4],"acting":[2,3,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":11,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:39.979736+0000","last_change":"2024-04-17T19:47:37.967945+0000","last_active":"2024-04-17T19:47:39.979736+0000","last_peered":"2024-04-17T19:47:39.979736+0000","last_clean":"2024-04-17T19:47:39.979736+0000","last_became_active":"2024-04-17T19:47:37.967613+0000","last_became_peered":"2024-04-17T19:47:37.967613+0000","last_unstale":"2024-04-17T19:47:39.979736+0000","last_undegraded":"2024-04-17T19:47:39.979736+0000","last_fullsized":"2024-04-17T19:47:39.979736+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_clean_scrub_stamp":"2024-04-17T19:46:55.648649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:31:43.713056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.d","version":"27'3","reported_seq":30,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:39.940688+0000","last_change":"2024-04-17T19:46:55.704346+0000","last_active":"2024-04-17T19:47:39.940688+0000","last_peered":"2024-04-17T19:47:39.940688+0000","last_clean":"2024-04-17T19:47:39.940688+0000","last_became_active":"2024-04-17T19:46:55.703334+0000","last_became_peered":"2024-04-17T19:46:55.703334+0000","last_unstale":"2024-04-17T19:47:39.940688+0000","last_undegraded":"2024-04-17T19:47:39.940688+0000","last_fullsized":"2024-04-17T19:47:39.940688+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:54.640133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:54.640133+0000","last_clean_scrub_stamp":"2024-04-17T19:46:54.640133+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:01:11.327106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:38.680778+0000","last_change":"2024-04-17T19:47:00.745450+0000","last_active":"2024-04-17T19:47:38.680778+0000","last_peered":"2024-04-17T19:47:38.680778+0000","last_clean":"2024-04-17T19:47:38.680778+0000","last_became_active":"2024-04-17T19:47:00.744227+0000","last_became_peered":"2024-04-17T19:47:00.744227+0000","last_unstale":"2024-04-17T19:47:38.680778+0000","last_undegraded":"2024-04-17T19:47:38.680778+0000","last_fullsized":"2024-04-17T19:47:38.680778+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_clean_scrub_stamp":"2024-04-17T19:46:59.695482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:52:15.523817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1,3],"acting":[5,4,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:37.960517+0000","last_change":"2024-04-17T19:46:56.687926+0000","last_active":"2024-04-17T19:47:37.960517+0000","last_peered":"2024-04-17T19:47:37.960517+0000","last_clean":"2024-04-17T19:47:37.960517+0000","last_became_active":"2024-04-17T19:46:56.687352+0000","last_became_peered":"2024-04-17T19:46:56.687352+0000","last_unstale":"2024-04-17T19:47:37.960517+0000","last_undegraded":"2024-04-17T19:47:37.960517+0000","last_fullsized":"2024-04-17T19:47:37.960517+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_clean_scrub_stamp":"2024-04-17T19:46:55.648649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T01:32:52.608291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.e","version":"27'5","reported_seq":32,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:39.943637+0000","last_change":"2024-04-17T19:46:55.716397+0000","last_active":"2024-04-17T19:47:39.943637+0000","last_peered":"2024-04-17T19:47:39.943637+0000","last_clean":"2024-04-17T19:47:39.943637+0000","last_became_active":"2024-04-17T19:46:55.715196+0000","last_became_peered":"2024-04-17T19:46:55.715196+0000","last_unstale":"2024-04-17T19:47:39.943637+0000","last_undegraded":"2024-04-17T19:47:39.943637+0000","last_fullsized":"2024-04-17T19:47:39.943637+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:54.640133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:54.640133+0000","last_clean_scrub_stamp":"2024-04-17T19:46:54.640133+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:24:42.573542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:38.472509+0000","last_change":"2024-04-17T19:47:00.735608+0000","last_active":"2024-04-17T19:47:38.472509+0000","last_peered":"2024-04-17T19:47:38.472509+0000","last_clean":"2024-04-17T19:47:38.472509+0000","last_became_active":"2024-04-17T19:47:00.735120+0000","last_became_peered":"2024-04-17T19:47:00.735120+0000","last_unstale":"2024-04-17T19:47:38.472509+0000","last_undegraded":"2024-04-17T19:47:38.472509+0000","last_fullsized":"2024-04-17T19:47:38.472509+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_clean_scrub_stamp":"2024-04-17T19:46:59.695482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T04:40:43.846198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:37.956507+0000","last_change":"2024-04-17T19:46:56.706026+0000","last_active":"2024-04-17T19:47:37.956507+0000","last_peered":"2024-04-17T19:47:37.956507+0000","last_clean":"2024-04-17T19:47:37.956507+0000","last_became_active":"2024-04-17T19:46:56.704786+0000","last_became_peered":"2024-04-17T19:46:56.704786+0000","last_unstale":"2024-04-17T19:47:37.956507+0000","last_undegraded":"2024-04-17T19:47:37.956507+0000","last_fullsized":"2024-04-17T19:47:37.956507+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_clean_scrub_stamp":"2024-04-17T19:46:55.648649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:59:17.441539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.f","version":"25'2","reported_seq":29,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:37.960572+0000","last_change":"2024-04-17T19:46:55.707082+0000","last_active":"2024-04-17T19:47:37.960572+0000","last_peered":"2024-04-17T19:47:37.960572+0000","last_clean":"2024-04-17T19:47:37.960572+0000","last_became_active":"2024-04-17T19:46:55.706729+0000","last_became_peered":"2024-04-17T19:46:55.706729+0000","last_unstale":"2024-04-17T19:47:37.960572+0000","last_undegraded":"2024-04-17T19:47:37.960572+0000","last_fullsized":"2024-04-17T19:47:37.960572+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:54.640133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:54.640133+0000","last_clean_scrub_stamp":"2024-04-17T19:46:54.640133+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:11:00.737141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:38.680082+0000","last_change":"2024-04-17T19:47:00.744054+0000","last_active":"2024-04-17T19:47:38.680082+0000","last_peered":"2024-04-17T19:47:38.680082+0000","last_clean":"2024-04-17T19:47:38.680082+0000","last_became_active":"2024-04-17T19:47:00.743582+0000","last_became_peered":"2024-04-17T19:47:00.743582+0000","last_unstale":"2024-04-17T19:47:38.680082+0000","last_undegraded":"2024-04-17T19:47:38.680082+0000","last_fullsized":"2024-04-17T19:47:38.680082+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_clean_scrub_stamp":"2024-04-17T19:46:59.695482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T22:25:09.219331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,2],"acting":[1,5,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:38.472716+0000","last_change":"2024-04-17T19:46:56.692435+0000","last_active":"2024-04-17T19:47:38.472716+0000","last_peered":"2024-04-17T19:47:38.472716+0000","last_clean":"2024-04-17T19:47:38.472716+0000","last_became_active":"2024-04-17T19:46:56.692038+0000","last_became_peered":"2024-04-17T19:46:56.692038+0000","last_unstale":"2024-04-17T19:47:38.472716+0000","last_undegraded":"2024-04-17T19:47:38.472716+0000","last_fullsized":"2024-04-17T19:47:38.472716+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_clean_scrub_stamp":"2024-04-17T19:46:55.648649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:06:56.889266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.10","version":"27'18","reported_seq":45,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:49:14.997636+0000","last_change":"2024-04-17T19:46:55.692188+0000","last_active":"2024-04-17T19:49:14.997636+0000","last_peered":"2024-04-17T19:49:14.997636+0000","last_clean":"2024-04-17T19:49:14.997636+0000","last_became_active":"2024-04-17T19:46:55.691286+0000","last_became_peered":"2024-04-17T19:46:55.691286+0000","last_unstale":"2024-04-17T19:49:14.997636+0000","last_undegraded":"2024-04-17T19:49:14.997636+0000","last_fullsized":"2024-04-17T19:49:14.997636+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:54.640133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:54.640133+0000","last_clean_scrub_stamp":"2024-04-17T19:46:54.640133+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:01:11.327106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:38.681258+0000","last_change":"2024-04-17T19:47:00.781167+0000","last_active":"2024-04-17T19:47:38.681258+0000","last_peered":"2024-04-17T19:47:38.681258+0000","last_clean":"2024-04-17T19:47:38.681258+0000","last_became_active":"2024-04-17T19:47:00.780167+0000","last_became_peered":"2024-04-17T19:47:00.780167+0000","last_unstale":"2024-04-17T19:47:38.681258+0000","last_undegraded":"2024-04-17T19:47:38.681258+0000","last_fullsized":"2024-04-17T19:47:38.681258+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_clean_scrub_stamp":"2024-04-17T19:46:59.695482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T00:07:51.831352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1,6],"acting":[5,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:38.679978+0000","last_change":"2024-04-17T19:46:56.676150+0000","last_active":"2024-04-17T19:47:38.679978+0000","last_peered":"2024-04-17T19:47:38.679978+0000","last_clean":"2024-04-17T19:47:38.679978+0000","last_became_active":"2024-04-17T19:46:56.675826+0000","last_became_peered":"2024-04-17T19:46:56.675826+0000","last_unstale":"2024-04-17T19:47:38.679978+0000","last_undegraded":"2024-04-17T19:47:38.679978+0000","last_fullsized":"2024-04-17T19:47:38.679978+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_clean_scrub_stamp":"2024-04-17T19:46:55.648649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T04:52:17.017088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.11","version":"25'5","reported_seq":32,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:37.958901+0000","last_change":"2024-04-17T19:46:55.682001+0000","last_active":"2024-04-17T19:47:37.958901+0000","last_peered":"2024-04-17T19:47:37.958901+0000","last_clean":"2024-04-17T19:47:37.958901+0000","last_became_active":"2024-04-17T19:46:55.681607+0000","last_became_peered":"2024-04-17T19:46:55.681607+0000","last_unstale":"2024-04-17T19:47:37.958901+0000","last_undegraded":"2024-04-17T19:47:37.958901+0000","last_fullsized":"2024-04-17T19:47:37.958901+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:54.640133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:54.640133+0000","last_clean_scrub_stamp":"2024-04-17T19:46:54.640133+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T04:43:37.994081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:38.681616+0000","last_change":"2024-04-17T19:47:00.756396+0000","last_active":"2024-04-17T19:47:38.681616+0000","last_peered":"2024-04-17T19:47:38.681616+0000","last_clean":"2024-04-17T19:47:38.681616+0000","last_became_active":"2024-04-17T19:47:00.755282+0000","last_became_peered":"2024-04-17T19:47:00.755282+0000","last_unstale":"2024-04-17T19:47:38.681616+0000","last_undegraded":"2024-04-17T19:47:38.681616+0000","last_fullsized":"2024-04-17T19:47:38.681616+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_clean_scrub_stamp":"2024-04-17T19:46:59.695482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:08:25.082826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6,4],"acting":[5,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:38.473123+0000","last_change":"2024-04-17T19:46:56.694764+0000","last_active":"2024-04-17T19:47:38.473123+0000","last_peered":"2024-04-17T19:47:38.473123+0000","last_clean":"2024-04-17T19:47:38.473123+0000","last_became_active":"2024-04-17T19:46:56.694449+0000","last_became_peered":"2024-04-17T19:46:56.694449+0000","last_unstale":"2024-04-17T19:47:38.473123+0000","last_undegraded":"2024-04-17T19:47:38.473123+0000","last_fullsized":"2024-04-17T19:47:38.473123+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_clean_scrub_stamp":"2024-04-17T19:46:55.648649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T02:53:14.607908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.12","version":"27'6","reported_seq":33,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:49:17.984148+0000","last_change":"2024-04-17T19:46:55.689900+0000","last_active":"2024-04-17T19:49:17.984148+0000","last_peered":"2024-04-17T19:49:17.984148+0000","last_clean":"2024-04-17T19:49:17.984148+0000","last_became_active":"2024-04-17T19:46:55.689607+0000","last_became_peered":"2024-04-17T19:46:55.689607+0000","last_unstale":"2024-04-17T19:49:17.984148+0000","last_undegraded":"2024-04-17T19:49:17.984148+0000","last_fullsized":"2024-04-17T19:49:17.984148+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:54.640133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:54.640133+0000","last_clean_scrub_stamp":"2024-04-17T19:46:54.640133+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:59:16.433023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:37.960971+0000","last_change":"2024-04-17T19:47:00.786434+0000","last_active":"2024-04-17T19:47:37.960971+0000","last_peered":"2024-04-17T19:47:37.960971+0000","last_clean":"2024-04-17T19:47:37.960971+0000","last_became_active":"2024-04-17T19:47:00.781025+0000","last_became_peered":"2024-04-17T19:47:00.781025+0000","last_unstale":"2024-04-17T19:47:37.960971+0000","last_undegraded":"2024-04-17T19:47:37.960971+0000","last_fullsized":"2024-04-17T19:47:37.960971+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_clean_scrub_stamp":"2024-04-17T19:46:59.695482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:51:07.602172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0,7],"acting":[6,4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:37.959911+0000","last_change":"2024-04-17T19:46:56.693555+0000","last_active":"2024-04-17T19:47:37.959911+0000","last_peered":"2024-04-17T19:47:37.959911+0000","last_clean":"2024-04-17T19:47:37.959911+0000","last_became_active":"2024-04-17T19:46:56.687385+0000","last_became_peered":"2024-04-17T19:46:56.687385+0000","last_unstale":"2024-04-17T19:47:37.959911+0000","last_undegraded":"2024-04-17T19:47:37.959911+0000","last_fullsized":"2024-04-17T19:47:37.959911+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_clean_scrub_stamp":"2024-04-17T19:46:55.648649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T05:52:33.559392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"27'9","reported_seq":36,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:39.942294+0000","last_change":"2024-04-17T19:46:55.700010+0000","last_active":"2024-04-17T19:47:39.942294+0000","last_peered":"2024-04-17T19:47:39.942294+0000","last_clean":"2024-04-17T19:47:39.942294+0000","last_became_active":"2024-04-17T19:46:55.698962+0000","last_became_peered":"2024-04-17T19:46:55.698962+0000","last_unstale":"2024-04-17T19:47:39.942294+0000","last_undegraded":"2024-04-17T19:47:39.942294+0000","last_fullsized":"2024-04-17T19:47:39.942294+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:54.640133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:54.640133+0000","last_clean_scrub_stamp":"2024-04-17T19:46:54.640133+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T01:25:12.780134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:38.473724+0000","last_change":"2024-04-17T19:47:00.760341+0000","last_active":"2024-04-17T19:47:38.473724+0000","last_peered":"2024-04-17T19:47:38.473724+0000","last_clean":"2024-04-17T19:47:38.473724+0000","last_became_active":"2024-04-17T19:47:00.759892+0000","last_became_peered":"2024-04-17T19:47:00.759892+0000","last_unstale":"2024-04-17T19:47:38.473724+0000","last_undegraded":"2024-04-17T19:47:38.473724+0000","last_fullsized":"2024-04-17T19:47:38.473724+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_clean_scrub_stamp":"2024-04-17T19:46:59.695482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T05:15:30.939022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5,6],"acting":[3,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":11,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:37.970878+0000","last_change":"2024-04-17T19:47:37.969333+0000","last_active":"2024-04-17T19:47:37.970878+0000","last_peered":"2024-04-17T19:47:37.970878+0000","last_clean":"2024-04-17T19:47:37.970878+0000","last_became_active":"2024-04-17T19:47:37.968623+0000","last_became_peered":"2024-04-17T19:47:37.968623+0000","last_unstale":"2024-04-17T19:47:37.970878+0000","last_undegraded":"2024-04-17T19:47:37.970878+0000","last_fullsized":"2024-04-17T19:47:37.970878+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_clean_scrub_stamp":"2024-04-17T19:46:55.648649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T04:48:43.769985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"27'29","reported_seq":56,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:49:36.735787+0000","last_change":"2024-04-17T19:46:55.697242+0000","last_active":"2024-04-17T19:49:36.735787+0000","last_peered":"2024-04-17T19:49:36.735787+0000","last_clean":"2024-04-17T19:49:36.735787+0000","last_became_active":"2024-04-17T19:46:55.696876+0000","last_became_peered":"2024-04-17T19:46:55.696876+0000","last_unstale":"2024-04-17T19:49:36.735787+0000","last_undegraded":"2024-04-17T19:49:36.735787+0000","last_fullsized":"2024-04-17T19:49:36.735787+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:54.640133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:54.640133+0000","last_clean_scrub_stamp":"2024-04-17T19:46:54.640133+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:24:28.029324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":37336,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":30,"num_write_kb":49,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"27'3","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:49:20.435531+0000","last_change":"2024-04-17T19:47:00.743810+0000","last_active":"2024-04-17T19:49:20.435531+0000","last_peered":"2024-04-17T19:49:20.435531+0000","last_clean":"2024-04-17T19:49:20.435531+0000","last_became_active":"2024-04-17T19:47:00.742290+0000","last_became_peered":"2024-04-17T19:47:00.742290+0000","last_unstale":"2024-04-17T19:49:20.435531+0000","last_undegraded":"2024-04-17T19:49:20.435531+0000","last_fullsized":"2024-04-17T19:49:20.435531+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_clean_scrub_stamp":"2024-04-17T19:46:59.695482+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T04:20:00.039224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,5,0],"acting":[4,3,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:38.473595+0000","last_change":"2024-04-17T19:46:56.680527+0000","last_active":"2024-04-17T19:47:38.473595+0000","last_peered":"2024-04-17T19:47:38.473595+0000","last_clean":"2024-04-17T19:47:38.473595+0000","last_became_active":"2024-04-17T19:46:56.680171+0000","last_became_peered":"2024-04-17T19:46:56.680171+0000","last_unstale":"2024-04-17T19:47:38.473595+0000","last_undegraded":"2024-04-17T19:47:38.473595+0000","last_fullsized":"2024-04-17T19:47:38.473595+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_clean_scrub_stamp":"2024-04-17T19:46:55.648649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T07:11:10.748292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.15","version":"27'8","reported_seq":35,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:49:28.868607+0000","last_change":"2024-04-17T19:46:55.707717+0000","last_active":"2024-04-17T19:49:28.868607+0000","last_peered":"2024-04-17T19:49:28.868607+0000","last_clean":"2024-04-17T19:49:28.868607+0000","last_became_active":"2024-04-17T19:46:55.706967+0000","last_became_peered":"2024-04-17T19:46:55.706967+0000","last_unstale":"2024-04-17T19:49:28.868607+0000","last_undegraded":"2024-04-17T19:49:28.868607+0000","last_fullsized":"2024-04-17T19:49:28.868607+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:54.640133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:54.640133+0000","last_clean_scrub_stamp":"2024-04-17T19:46:54.640133+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T05:10:04.380307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:37.955851+0000","last_change":"2024-04-17T19:47:00.758723+0000","last_active":"2024-04-17T19:47:37.955851+0000","last_peered":"2024-04-17T19:47:37.955851+0000","last_clean":"2024-04-17T19:47:37.955851+0000","last_became_active":"2024-04-17T19:47:00.758209+0000","last_became_peered":"2024-04-17T19:47:00.758209+0000","last_unstale":"2024-04-17T19:47:37.955851+0000","last_undegraded":"2024-04-17T19:47:37.955851+0000","last_fullsized":"2024-04-17T19:47:37.955851+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_clean_scrub_stamp":"2024-04-17T19:46:59.695482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T04:48:47.816818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1,7],"acting":[2,3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:38.681917+0000","last_change":"2024-04-17T19:46:56.684067+0000","last_active":"2024-04-17T19:47:38.681917+0000","last_peered":"2024-04-17T19:47:38.681917+0000","last_clean":"2024-04-17T19:47:38.681917+0000","last_became_active":"2024-04-17T19:46:56.683685+0000","last_became_peered":"2024-04-17T19:46:56.683685+0000","last_unstale":"2024-04-17T19:47:38.681917+0000","last_undegraded":"2024-04-17T19:47:38.681917+0000","last_fullsized":"2024-04-17T19:47:38.681917+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_clean_scrub_stamp":"2024-04-17T19:46:55.648649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T02:52:38.425163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"27'4","reported_seq":31,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:39.942230+0000","last_change":"2024-04-17T19:46:55.687311+0000","last_active":"2024-04-17T19:47:39.942230+0000","last_peered":"2024-04-17T19:47:39.942230+0000","last_clean":"2024-04-17T19:47:39.942230+0000","last_became_active":"2024-04-17T19:46:55.687019+0000","last_became_peered":"2024-04-17T19:46:55.687019+0000","last_unstale":"2024-04-17T19:47:39.942230+0000","last_undegraded":"2024-04-17T19:47:39.942230+0000","last_fullsized":"2024-04-17T19:47:39.942230+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:54.640133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:54.640133+0000","last_clean_scrub_stamp":"2024-04-17T19:46:54.640133+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T01:53:38.377482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:37.965677+0000","last_change":"2024-04-17T19:47:00.780072+0000","last_active":"2024-04-17T19:47:37.965677+0000","last_peered":"2024-04-17T19:47:37.965677+0000","last_clean":"2024-04-17T19:47:37.965677+0000","last_became_active":"2024-04-17T19:47:00.777053+0000","last_became_peered":"2024-04-17T19:47:00.777053+0000","last_unstale":"2024-04-17T19:47:37.965677+0000","last_undegraded":"2024-04-17T19:47:37.965677+0000","last_fullsized":"2024-04-17T19:47:37.965677+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_clean_scrub_stamp":"2024-04-17T19:46:59.695482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T22:01:53.910725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,3,2],"acting":[7,1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:37.956396+0000","last_change":"2024-04-17T19:46:56.692985+0000","last_active":"2024-04-17T19:47:37.956396+0000","last_peered":"2024-04-17T19:47:37.956396+0000","last_clean":"2024-04-17T19:47:37.956396+0000","last_became_active":"2024-04-17T19:46:56.692287+0000","last_became_peered":"2024-04-17T19:46:56.692287+0000","last_unstale":"2024-04-17T19:47:37.956396+0000","last_undegraded":"2024-04-17T19:47:37.956396+0000","last_fullsized":"2024-04-17T19:47:37.956396+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_clean_scrub_stamp":"2024-04-17T19:46:55.648649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:20:50.341776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.17","version":"27'5","reported_seq":32,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:49:22.983650+0000","last_change":"2024-04-17T19:46:55.691681+0000","last_active":"2024-04-17T19:49:22.983650+0000","last_peered":"2024-04-17T19:49:22.983650+0000","last_clean":"2024-04-17T19:49:22.983650+0000","last_became_active":"2024-04-17T19:46:55.691354+0000","last_became_peered":"2024-04-17T19:46:55.691354+0000","last_unstale":"2024-04-17T19:49:22.983650+0000","last_undegraded":"2024-04-17T19:49:22.983650+0000","last_fullsized":"2024-04-17T19:49:22.983650+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:54.640133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:54.640133+0000","last_clean_scrub_stamp":"2024-04-17T19:46:54.640133+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T00:40:58.757373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:37.957709+0000","last_change":"2024-04-17T19:47:00.764854+0000","last_active":"2024-04-17T19:47:37.957709+0000","last_peered":"2024-04-17T19:47:37.957709+0000","last_clean":"2024-04-17T19:47:37.957709+0000","last_became_active":"2024-04-17T19:47:00.763550+0000","last_became_peered":"2024-04-17T19:47:00.763550+0000","last_unstale":"2024-04-17T19:47:37.957709+0000","last_undegraded":"2024-04-17T19:47:37.957709+0000","last_fullsized":"2024-04-17T19:47:37.957709+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_clean_scrub_stamp":"2024-04-17T19:46:59.695482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T04:26:38.527427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,3,7],"acting":[4,0,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:37.959252+0000","last_change":"2024-04-17T19:47:00.746028+0000","last_active":"2024-04-17T19:47:37.959252+0000","last_peered":"2024-04-17T19:47:37.959252+0000","last_clean":"2024-04-17T19:47:37.959252+0000","last_became_active":"2024-04-17T19:47:00.744828+0000","last_became_peered":"2024-04-17T19:47:00.744828+0000","last_unstale":"2024-04-17T19:47:37.959252+0000","last_undegraded":"2024-04-17T19:47:37.959252+0000","last_fullsized":"2024-04-17T19:47:37.959252+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_clean_scrub_stamp":"2024-04-17T19:46:59.695482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T22:37:58.836823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,5,3],"acting":[4,1,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:37.957762+0000","last_change":"2024-04-17T19:46:56.691650+0000","last_active":"2024-04-17T19:47:37.957762+0000","last_peered":"2024-04-17T19:47:37.957762+0000","last_clean":"2024-04-17T19:47:37.957762+0000","last_became_active":"2024-04-17T19:46:56.690810+0000","last_became_peered":"2024-04-17T19:46:56.690810+0000","last_unstale":"2024-04-17T19:47:37.957762+0000","last_undegraded":"2024-04-17T19:47:37.957762+0000","last_fullsized":"2024-04-17T19:47:37.957762+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_clean_scrub_stamp":"2024-04-17T19:46:55.648649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T04:25:07.123916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.18","version":"27'3","reported_seq":30,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:39.944726+0000","last_change":"2024-04-17T19:46:55.691871+0000","last_active":"2024-04-17T19:47:39.944726+0000","last_peered":"2024-04-17T19:47:39.944726+0000","last_clean":"2024-04-17T19:47:39.944726+0000","last_became_active":"2024-04-17T19:46:55.690539+0000","last_became_peered":"2024-04-17T19:46:55.690539+0000","last_unstale":"2024-04-17T19:47:39.944726+0000","last_undegraded":"2024-04-17T19:47:39.944726+0000","last_fullsized":"2024-04-17T19:47:39.944726+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:54.640133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:54.640133+0000","last_clean_scrub_stamp":"2024-04-17T19:46:54.640133+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T04:52:16.008572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:38.474111+0000","last_change":"2024-04-17T19:47:00.749616+0000","last_active":"2024-04-17T19:47:38.474111+0000","last_peered":"2024-04-17T19:47:38.474111+0000","last_clean":"2024-04-17T19:47:38.474111+0000","last_became_active":"2024-04-17T19:47:00.749061+0000","last_became_peered":"2024-04-17T19:47:00.749061+0000","last_unstale":"2024-04-17T19:47:38.474111+0000","last_undegraded":"2024-04-17T19:47:38.474111+0000","last_fullsized":"2024-04-17T19:47:38.474111+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_clean_scrub_stamp":"2024-04-17T19:46:59.695482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:33:36.676817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5,1],"acting":[3,2,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:38.680110+0000","last_change":"2024-04-17T19:46:56.692190+0000","last_active":"2024-04-17T19:47:38.680110+0000","last_peered":"2024-04-17T19:47:38.680110+0000","last_clean":"2024-04-17T19:47:38.680110+0000","last_became_active":"2024-04-17T19:46:56.691524+0000","last_became_peered":"2024-04-17T19:46:56.691524+0000","last_unstale":"2024-04-17T19:47:38.680110+0000","last_undegraded":"2024-04-17T19:47:38.680110+0000","last_fullsized":"2024-04-17T19:47:38.680110+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_clean_scrub_stamp":"2024-04-17T19:46:55.648649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:44:38.787541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"27'3","reported_seq":30,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:39.942240+0000","last_change":"2024-04-17T19:46:55.700265+0000","last_active":"2024-04-17T19:47:39.942240+0000","last_peered":"2024-04-17T19:47:39.942240+0000","last_clean":"2024-04-17T19:47:39.942240+0000","last_became_active":"2024-04-17T19:46:55.699166+0000","last_became_peered":"2024-04-17T19:46:55.699166+0000","last_unstale":"2024-04-17T19:47:39.942240+0000","last_undegraded":"2024-04-17T19:47:39.942240+0000","last_fullsized":"2024-04-17T19:47:39.942240+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:54.640133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:54.640133+0000","last_clean_scrub_stamp":"2024-04-17T19:46:54.640133+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T02:39:08.241534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"25'7","reported_seq":34,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:38.473233+0000","last_change":"2024-04-17T19:46:55.687779+0000","last_active":"2024-04-17T19:47:38.473233+0000","last_peered":"2024-04-17T19:47:38.473233+0000","last_clean":"2024-04-17T19:47:38.473233+0000","last_became_active":"2024-04-17T19:46:55.687401+0000","last_became_peered":"2024-04-17T19:46:55.687401+0000","last_unstale":"2024-04-17T19:47:38.473233+0000","last_undegraded":"2024-04-17T19:47:38.473233+0000","last_fullsized":"2024-04-17T19:47:38.473233+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:54.640133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:54.640133+0000","last_clean_scrub_stamp":"2024-04-17T19:46:54.640133+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:20:49.333260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:37.956708+0000","last_change":"2024-04-17T19:46:56.691635+0000","last_active":"2024-04-17T19:47:37.956708+0000","last_peered":"2024-04-17T19:47:37.956708+0000","last_clean":"2024-04-17T19:47:37.956708+0000","last_became_active":"2024-04-17T19:46:56.691199+0000","last_became_peered":"2024-04-17T19:46:56.691199+0000","last_unstale":"2024-04-17T19:47:37.956708+0000","last_undegraded":"2024-04-17T19:47:37.956708+0000","last_fullsized":"2024-04-17T19:47:37.956708+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_clean_scrub_stamp":"2024-04-17T19:46:55.648649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:00:10.859769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:37.960909+0000","last_change":"2024-04-17T19:47:00.776142+0000","last_active":"2024-04-17T19:47:37.960909+0000","last_peered":"2024-04-17T19:47:37.960909+0000","last_clean":"2024-04-17T19:47:37.960909+0000","last_became_active":"2024-04-17T19:47:00.774592+0000","last_became_peered":"2024-04-17T19:47:00.774592+0000","last_unstale":"2024-04-17T19:47:37.960909+0000","last_undegraded":"2024-04-17T19:47:37.960909+0000","last_fullsized":"2024-04-17T19:47:37.960909+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_clean_scrub_stamp":"2024-04-17T19:46:59.695482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:04:03.656402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,7],"acting":[4,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"25'5","reported_seq":32,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:38.680757+0000","last_change":"2024-04-17T19:46:55.713656+0000","last_active":"2024-04-17T19:47:38.680757+0000","last_peered":"2024-04-17T19:47:38.680757+0000","last_clean":"2024-04-17T19:47:38.680757+0000","last_became_active":"2024-04-17T19:46:55.712982+0000","last_became_peered":"2024-04-17T19:46:55.712982+0000","last_unstale":"2024-04-17T19:47:38.680757+0000","last_undegraded":"2024-04-17T19:47:38.680757+0000","last_fullsized":"2024-04-17T19:47:38.680757+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:54.640133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:54.640133+0000","last_clean_scrub_stamp":"2024-04-17T19:46:54.640133+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:02:52.057635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:38.680240+0000","last_change":"2024-04-17T19:46:56.681984+0000","last_active":"2024-04-17T19:47:38.680240+0000","last_peered":"2024-04-17T19:47:38.680240+0000","last_clean":"2024-04-17T19:47:38.680240+0000","last_became_active":"2024-04-17T19:46:56.679830+0000","last_became_peered":"2024-04-17T19:46:56.679830+0000","last_unstale":"2024-04-17T19:47:38.680240+0000","last_undegraded":"2024-04-17T19:47:38.680240+0000","last_fullsized":"2024-04-17T19:47:38.680240+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_clean_scrub_stamp":"2024-04-17T19:46:55.648649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:11:01.745657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:37.967233+0000","last_change":"2024-04-17T19:47:00.777411+0000","last_active":"2024-04-17T19:47:37.967233+0000","last_peered":"2024-04-17T19:47:37.967233+0000","last_clean":"2024-04-17T19:47:37.967233+0000","last_became_active":"2024-04-17T19:47:00.776357+0000","last_became_peered":"2024-04-17T19:47:00.776357+0000","last_unstale":"2024-04-17T19:47:37.967233+0000","last_undegraded":"2024-04-17T19:47:37.967233+0000","last_fullsized":"2024-04-17T19:47:37.967233+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_clean_scrub_stamp":"2024-04-17T19:46:59.695482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:41:22.030097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,1,0],"acting":[7,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:37.955184+0000","last_change":"2024-04-17T19:46:56.706021+0000","last_active":"2024-04-17T19:47:37.955184+0000","last_peered":"2024-04-17T19:47:37.955184+0000","last_clean":"2024-04-17T19:47:37.955184+0000","last_became_active":"2024-04-17T19:46:56.702724+0000","last_became_peered":"2024-04-17T19:46:56.702724+0000","last_unstale":"2024-04-17T19:47:37.955184+0000","last_undegraded":"2024-04-17T19:47:37.955184+0000","last_fullsized":"2024-04-17T19:47:37.955184+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_clean_scrub_stamp":"2024-04-17T19:46:55.648649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:11:01.745657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:37.966196+0000","last_change":"2024-04-17T19:46:56.685239+0000","last_active":"2024-04-17T19:47:37.966196+0000","last_peered":"2024-04-17T19:47:37.966196+0000","last_clean":"2024-04-17T19:47:37.966196+0000","last_became_active":"2024-04-17T19:46:56.684771+0000","last_became_peered":"2024-04-17T19:46:56.684771+0000","last_unstale":"2024-04-17T19:47:37.966196+0000","last_undegraded":"2024-04-17T19:47:37.966196+0000","last_fullsized":"2024-04-17T19:47:37.966196+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_clean_scrub_stamp":"2024-04-17T19:46:55.648649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T04:52:17.017088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:38.472926+0000","last_change":"2024-04-17T19:46:56.686238+0000","last_active":"2024-04-17T19:47:38.472926+0000","last_peered":"2024-04-17T19:47:38.472926+0000","last_clean":"2024-04-17T19:47:38.472926+0000","last_became_active":"2024-04-17T19:46:56.685745+0000","last_became_peered":"2024-04-17T19:46:56.685745+0000","last_unstale":"2024-04-17T19:47:38.472926+0000","last_undegraded":"2024-04-17T19:47:38.472926+0000","last_fullsized":"2024-04-17T19:47:38.472926+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_clean_scrub_stamp":"2024-04-17T19:46:55.648649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:01:01.006486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:38.680630+0000","last_change":"2024-04-17T19:46:56.675844+0000","last_active":"2024-04-17T19:47:38.680630+0000","last_peered":"2024-04-17T19:47:38.680630+0000","last_clean":"2024-04-17T19:47:38.680630+0000","last_became_active":"2024-04-17T19:46:56.675519+0000","last_became_peered":"2024-04-17T19:46:56.675519+0000","last_unstale":"2024-04-17T19:47:38.680630+0000","last_undegraded":"2024-04-17T19:47:38.680630+0000","last_fullsized":"2024-04-17T19:47:38.680630+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_clean_scrub_stamp":"2024-04-17T19:46:55.648649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T00:46:07.348168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:37.961362+0000","last_change":"2024-04-17T19:46:56.699663+0000","last_active":"2024-04-17T19:47:37.961362+0000","last_peered":"2024-04-17T19:47:37.961362+0000","last_clean":"2024-04-17T19:47:37.961362+0000","last_became_active":"2024-04-17T19:46:56.699293+0000","last_became_peered":"2024-04-17T19:46:56.699293+0000","last_unstale":"2024-04-17T19:47:37.961362+0000","last_undegraded":"2024-04-17T19:47:37.961362+0000","last_fullsized":"2024-04-17T19:47:37.961362+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_clean_scrub_stamp":"2024-04-17T19:46:55.648649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T22:25:05.172498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:37.963458+0000","last_change":"2024-04-17T19:46:56.684368+0000","last_active":"2024-04-17T19:47:37.963458+0000","last_peered":"2024-04-17T19:47:37.963458+0000","last_clean":"2024-04-17T19:47:37.963458+0000","last_became_active":"2024-04-17T19:46:56.683963+0000","last_became_peered":"2024-04-17T19:46:56.683963+0000","last_unstale":"2024-04-17T19:47:37.963458+0000","last_undegraded":"2024-04-17T19:47:37.963458+0000","last_fullsized":"2024-04-17T19:47:37.963458+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_clean_scrub_stamp":"2024-04-17T19:46:55.648649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:41:17.983264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:37.956294+0000","last_change":"2024-04-17T19:46:56.704924+0000","last_active":"2024-04-17T19:47:37.956294+0000","last_peered":"2024-04-17T19:47:37.956294+0000","last_clean":"2024-04-17T19:47:37.956294+0000","last_became_active":"2024-04-17T19:46:56.692688+0000","last_became_peered":"2024-04-17T19:46:56.692688+0000","last_unstale":"2024-04-17T19:47:37.956294+0000","last_undegraded":"2024-04-17T19:47:37.956294+0000","last_fullsized":"2024-04-17T19:47:37.956294+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_clean_scrub_stamp":"2024-04-17T19:46:55.648649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T01:39:33.595213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:38.681508+0000","last_change":"2024-04-17T19:46:56.685081+0000","last_active":"2024-04-17T19:47:38.681508+0000","last_peered":"2024-04-17T19:47:38.681508+0000","last_clean":"2024-04-17T19:47:38.681508+0000","last_became_active":"2024-04-17T19:46:56.684714+0000","last_became_peered":"2024-04-17T19:46:56.684714+0000","last_unstale":"2024-04-17T19:47:38.681508+0000","last_undegraded":"2024-04-17T19:47:38.681508+0000","last_fullsized":"2024-04-17T19:47:38.681508+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_clean_scrub_stamp":"2024-04-17T19:46:55.648649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T04:26:34.480594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:38.472779+0000","last_change":"2024-04-17T19:46:56.681089+0000","last_active":"2024-04-17T19:47:38.472779+0000","last_peered":"2024-04-17T19:47:38.472779+0000","last_clean":"2024-04-17T19:47:38.472779+0000","last_became_active":"2024-04-17T19:46:56.679818+0000","last_became_peered":"2024-04-17T19:46:56.679818+0000","last_unstale":"2024-04-17T19:47:38.472779+0000","last_undegraded":"2024-04-17T19:47:38.472779+0000","last_fullsized":"2024-04-17T19:47:38.472779+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_clean_scrub_stamp":"2024-04-17T19:46:55.648649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T01:32:52.608291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:38.680542+0000","last_change":"2024-04-17T19:46:56.674556+0000","last_active":"2024-04-17T19:47:38.680542+0000","last_peered":"2024-04-17T19:47:38.680542+0000","last_clean":"2024-04-17T19:47:38.680542+0000","last_became_active":"2024-04-17T19:46:56.674164+0000","last_became_peered":"2024-04-17T19:46:56.674164+0000","last_unstale":"2024-04-17T19:47:38.680542+0000","last_undegraded":"2024-04-17T19:47:38.680542+0000","last_fullsized":"2024-04-17T19:47:38.680542+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_clean_scrub_stamp":"2024-04-17T19:46:55.648649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T22:53:45.664676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:38.680145+0000","last_change":"2024-04-17T19:46:56.697359+0000","last_active":"2024-04-17T19:47:38.680145+0000","last_peered":"2024-04-17T19:47:38.680145+0000","last_clean":"2024-04-17T19:47:38.680145+0000","last_became_active":"2024-04-17T19:46:56.695255+0000","last_became_peered":"2024-04-17T19:46:56.695255+0000","last_unstale":"2024-04-17T19:47:38.680145+0000","last_undegraded":"2024-04-17T19:47:38.680145+0000","last_fullsized":"2024-04-17T19:47:38.680145+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_clean_scrub_stamp":"2024-04-17T19:46:55.648649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T01:53:39.385998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:37.956606+0000","last_change":"2024-04-17T19:46:56.692366+0000","last_active":"2024-04-17T19:47:37.956606+0000","last_peered":"2024-04-17T19:47:37.956606+0000","last_clean":"2024-04-17T19:47:37.956606+0000","last_became_active":"2024-04-17T19:46:56.691942+0000","last_became_peered":"2024-04-17T19:46:56.691942+0000","last_unstale":"2024-04-17T19:47:37.956606+0000","last_undegraded":"2024-04-17T19:47:37.956606+0000","last_fullsized":"2024-04-17T19:47:37.956606+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_clean_scrub_stamp":"2024-04-17T19:46:55.648649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T02:34:05.358659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:37.959208+0000","last_change":"2024-04-17T19:46:56.693507+0000","last_active":"2024-04-17T19:47:37.959208+0000","last_peered":"2024-04-17T19:47:37.959208+0000","last_clean":"2024-04-17T19:47:37.959208+0000","last_became_active":"2024-04-17T19:46:56.691938+0000","last_became_peered":"2024-04-17T19:46:56.691938+0000","last_unstale":"2024-04-17T19:47:37.959208+0000","last_undegraded":"2024-04-17T19:47:37.959208+0000","last_fullsized":"2024-04-17T19:47:37.959208+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_clean_scrub_stamp":"2024-04-17T19:46:55.648649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T04:48:43.769985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:38.473958+0000","last_change":"2024-04-17T19:46:56.700707+0000","last_active":"2024-04-17T19:47:38.473958+0000","last_peered":"2024-04-17T19:47:38.473958+0000","last_clean":"2024-04-17T19:47:38.473958+0000","last_became_active":"2024-04-17T19:46:56.700346+0000","last_became_peered":"2024-04-17T19:46:56.700346+0000","last_unstale":"2024-04-17T19:47:38.473958+0000","last_undegraded":"2024-04-17T19:47:38.473958+0000","last_fullsized":"2024-04-17T19:47:38.473958+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_clean_scrub_stamp":"2024-04-17T19:46:55.648649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:58:35.976326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:37.968012+0000","last_change":"2024-04-17T19:46:56.705410+0000","last_active":"2024-04-17T19:47:37.968012+0000","last_peered":"2024-04-17T19:47:37.968012+0000","last_clean":"2024-04-17T19:47:37.968012+0000","last_became_active":"2024-04-17T19:46:56.705076+0000","last_became_peered":"2024-04-17T19:46:56.705076+0000","last_unstale":"2024-04-17T19:47:37.968012+0000","last_undegraded":"2024-04-17T19:47:37.968012+0000","last_fullsized":"2024-04-17T19:47:37.968012+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_clean_scrub_stamp":"2024-04-17T19:46:55.648649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T01:53:39.385998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:38.474246+0000","last_change":"2024-04-17T19:46:56.697436+0000","last_active":"2024-04-17T19:47:38.474246+0000","last_peered":"2024-04-17T19:47:38.474246+0000","last_clean":"2024-04-17T19:47:38.474246+0000","last_became_active":"2024-04-17T19:46:56.696667+0000","last_became_peered":"2024-04-17T19:46:56.696667+0000","last_unstale":"2024-04-17T19:47:38.474246+0000","last_undegraded":"2024-04-17T19:47:38.474246+0000","last_fullsized":"2024-04-17T19:47:38.474246+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_clean_scrub_stamp":"2024-04-17T19:46:55.648649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:54:05.520742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:38.472663+0000","last_change":"2024-04-17T19:46:56.680847+0000","last_active":"2024-04-17T19:47:38.472663+0000","last_peered":"2024-04-17T19:47:38.472663+0000","last_clean":"2024-04-17T19:47:38.472663+0000","last_became_active":"2024-04-17T19:46:56.680224+0000","last_became_peered":"2024-04-17T19:46:56.680224+0000","last_unstale":"2024-04-17T19:47:38.472663+0000","last_undegraded":"2024-04-17T19:47:38.472663+0000","last_fullsized":"2024-04-17T19:47:38.472663+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_clean_scrub_stamp":"2024-04-17T19:46:55.648649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T04:48:43.769985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:38.680177+0000","last_change":"2024-04-17T19:46:56.688647+0000","last_active":"2024-04-17T19:47:38.680177+0000","last_peered":"2024-04-17T19:47:38.680177+0000","last_clean":"2024-04-17T19:47:38.680177+0000","last_became_active":"2024-04-17T19:46:56.688294+0000","last_became_peered":"2024-04-17T19:46:56.688294+0000","last_unstale":"2024-04-17T19:47:38.680177+0000","last_undegraded":"2024-04-17T19:47:38.680177+0000","last_fullsized":"2024-04-17T19:47:38.680177+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_clean_scrub_stamp":"2024-04-17T19:46:55.648649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T02:34:05.358659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.32","version":"27'1","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:49:17.990239+0000","last_change":"2024-04-17T19:46:56.686415+0000","last_active":"2024-04-17T19:49:17.990239+0000","last_peered":"2024-04-17T19:49:17.990239+0000","last_clean":"2024-04-17T19:49:17.990239+0000","last_became_active":"2024-04-17T19:46:56.684639+0000","last_became_peered":"2024-04-17T19:46:56.684639+0000","last_unstale":"2024-04-17T19:49:17.990239+0000","last_undegraded":"2024-04-17T19:49:17.990239+0000","last_fullsized":"2024-04-17T19:49:17.990239+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_clean_scrub_stamp":"2024-04-17T19:46:55.648649+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:20:50.341776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:37.960115+0000","last_change":"2024-04-17T19:46:56.694678+0000","last_active":"2024-04-17T19:47:37.960115+0000","last_peered":"2024-04-17T19:47:37.960115+0000","last_clean":"2024-04-17T19:47:37.960115+0000","last_became_active":"2024-04-17T19:46:56.694213+0000","last_became_peered":"2024-04-17T19:46:56.694213+0000","last_unstale":"2024-04-17T19:47:37.960115+0000","last_undegraded":"2024-04-17T19:47:37.960115+0000","last_fullsized":"2024-04-17T19:47:37.960115+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_clean_scrub_stamp":"2024-04-17T19:46:55.648649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:59:17.441539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:37.959176+0000","last_change":"2024-04-17T19:46:56.693810+0000","last_active":"2024-04-17T19:47:37.959176+0000","last_peered":"2024-04-17T19:47:37.959176+0000","last_clean":"2024-04-17T19:47:37.959176+0000","last_became_active":"2024-04-17T19:46:56.692874+0000","last_became_peered":"2024-04-17T19:46:56.692874+0000","last_unstale":"2024-04-17T19:47:37.959176+0000","last_undegraded":"2024-04-17T19:47:37.959176+0000","last_fullsized":"2024-04-17T19:47:37.959176+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_clean_scrub_stamp":"2024-04-17T19:46:55.648649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:30:27.241267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:37.959681+0000","last_change":"2024-04-17T19:46:56.700330+0000","last_active":"2024-04-17T19:47:37.959681+0000","last_peered":"2024-04-17T19:47:37.959681+0000","last_clean":"2024-04-17T19:47:37.959681+0000","last_became_active":"2024-04-17T19:46:56.700013+0000","last_became_peered":"2024-04-17T19:46:56.700013+0000","last_unstale":"2024-04-17T19:47:37.959681+0000","last_undegraded":"2024-04-17T19:47:37.959681+0000","last_fullsized":"2024-04-17T19:47:37.959681+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_clean_scrub_stamp":"2024-04-17T19:46:55.648649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:23:16.383918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:37.959828+0000","last_change":"2024-04-17T19:46:56.709400+0000","last_active":"2024-04-17T19:47:37.959828+0000","last_peered":"2024-04-17T19:47:37.959828+0000","last_clean":"2024-04-17T19:47:37.959828+0000","last_became_active":"2024-04-17T19:46:56.708606+0000","last_became_peered":"2024-04-17T19:46:56.708606+0000","last_unstale":"2024-04-17T19:47:37.959828+0000","last_undegraded":"2024-04-17T19:47:37.959828+0000","last_fullsized":"2024-04-17T19:47:37.959828+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_clean_scrub_stamp":"2024-04-17T19:46:55.648649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T01:46:36.503198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:38.680713+0000","last_change":"2024-04-17T19:46:56.681267+0000","last_active":"2024-04-17T19:47:38.680713+0000","last_peered":"2024-04-17T19:47:38.680713+0000","last_clean":"2024-04-17T19:47:38.680713+0000","last_became_active":"2024-04-17T19:46:56.680919+0000","last_became_peered":"2024-04-17T19:46:56.680919+0000","last_unstale":"2024-04-17T19:47:38.680713+0000","last_undegraded":"2024-04-17T19:47:38.680713+0000","last_fullsized":"2024-04-17T19:47:38.680713+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_clean_scrub_stamp":"2024-04-17T19:46:55.648649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T01:39:33.595213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:38.679990+0000","last_change":"2024-04-17T19:46:56.688682+0000","last_active":"2024-04-17T19:47:38.679990+0000","last_peered":"2024-04-17T19:47:38.679990+0000","last_clean":"2024-04-17T19:47:38.679990+0000","last_became_active":"2024-04-17T19:46:56.688320+0000","last_became_peered":"2024-04-17T19:46:56.688320+0000","last_unstale":"2024-04-17T19:47:38.679990+0000","last_undegraded":"2024-04-17T19:47:38.679990+0000","last_fullsized":"2024-04-17T19:47:38.679990+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_clean_scrub_stamp":"2024-04-17T19:46:55.648649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:00:10.859769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:37.958884+0000","last_change":"2024-04-17T19:46:56.699129+0000","last_active":"2024-04-17T19:47:37.958884+0000","last_peered":"2024-04-17T19:47:37.958884+0000","last_clean":"2024-04-17T19:47:37.958884+0000","last_became_active":"2024-04-17T19:46:56.698840+0000","last_became_peered":"2024-04-17T19:46:56.698840+0000","last_unstale":"2024-04-17T19:47:37.958884+0000","last_undegraded":"2024-04-17T19:47:37.958884+0000","last_fullsized":"2024-04-17T19:47:37.958884+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_clean_scrub_stamp":"2024-04-17T19:46:55.648649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T05:35:47.746622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:37.955456+0000","last_change":"2024-04-17T19:46:56.705903+0000","last_active":"2024-04-17T19:47:37.955456+0000","last_peered":"2024-04-17T19:47:37.955456+0000","last_clean":"2024-04-17T19:47:37.955456+0000","last_became_active":"2024-04-17T19:46:56.705539+0000","last_became_peered":"2024-04-17T19:46:56.705539+0000","last_unstale":"2024-04-17T19:47:37.955456+0000","last_undegraded":"2024-04-17T19:47:37.955456+0000","last_fullsized":"2024-04-17T19:47:37.955456+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_clean_scrub_stamp":"2024-04-17T19:46:55.648649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:57:40.700986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:37.959075+0000","last_change":"2024-04-17T19:46:56.694456+0000","last_active":"2024-04-17T19:47:37.959075+0000","last_peered":"2024-04-17T19:47:37.959075+0000","last_clean":"2024-04-17T19:47:37.959075+0000","last_became_active":"2024-04-17T19:46:56.693954+0000","last_became_peered":"2024-04-17T19:46:56.693954+0000","last_unstale":"2024-04-17T19:47:37.959075+0000","last_undegraded":"2024-04-17T19:47:37.959075+0000","last_fullsized":"2024-04-17T19:47:37.959075+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_clean_scrub_stamp":"2024-04-17T19:46:55.648649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:22:33.413402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:37.955652+0000","last_change":"2024-04-17T19:46:56.706411+0000","last_active":"2024-04-17T19:47:37.955652+0000","last_peered":"2024-04-17T19:47:37.955652+0000","last_clean":"2024-04-17T19:47:37.955652+0000","last_became_active":"2024-04-17T19:46:56.706021+0000","last_became_peered":"2024-04-17T19:46:56.706021+0000","last_unstale":"2024-04-17T19:47:37.955652+0000","last_undegraded":"2024-04-17T19:47:37.955652+0000","last_fullsized":"2024-04-17T19:47:37.955652+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_clean_scrub_stamp":"2024-04-17T19:46:55.648649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T05:52:33.559392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:38.681189+0000","last_change":"2024-04-17T19:46:56.696930+0000","last_active":"2024-04-17T19:47:38.681189+0000","last_peered":"2024-04-17T19:47:38.681189+0000","last_clean":"2024-04-17T19:47:38.681189+0000","last_became_active":"2024-04-17T19:46:56.696492+0000","last_became_peered":"2024-04-17T19:46:56.696492+0000","last_unstale":"2024-04-17T19:47:38.681189+0000","last_undegraded":"2024-04-17T19:47:38.681189+0000","last_fullsized":"2024-04-17T19:47:38.681189+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_clean_scrub_stamp":"2024-04-17T19:46:55.648649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:43:54.268148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:38.681148+0000","last_change":"2024-04-17T19:46:56.683448+0000","last_active":"2024-04-17T19:47:38.681148+0000","last_peered":"2024-04-17T19:47:38.681148+0000","last_clean":"2024-04-17T19:47:38.681148+0000","last_became_active":"2024-04-17T19:46:56.682772+0000","last_became_peered":"2024-04-17T19:46:56.682772+0000","last_unstale":"2024-04-17T19:47:38.681148+0000","last_undegraded":"2024-04-17T19:47:38.681148+0000","last_fullsized":"2024-04-17T19:47:38.681148+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_clean_scrub_stamp":"2024-04-17T19:46:55.648649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T22:39:31.496708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:37.960452+0000","last_change":"2024-04-17T19:46:56.695275+0000","last_active":"2024-04-17T19:47:37.960452+0000","last_peered":"2024-04-17T19:47:37.960452+0000","last_clean":"2024-04-17T19:47:37.960452+0000","last_became_active":"2024-04-17T19:46:56.694743+0000","last_became_peered":"2024-04-17T19:46:56.694743+0000","last_unstale":"2024-04-17T19:47:37.960452+0000","last_undegraded":"2024-04-17T19:47:37.960452+0000","last_fullsized":"2024-04-17T19:47:37.960452+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_clean_scrub_stamp":"2024-04-17T19:46:55.648649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:01:01.006486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1,"ondisk_log_size":1,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":44428,"num_objects":99,"num_object_clones":0,"num_object_copies":198,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":99,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":252,"num_write_kb":123,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":335872,"data_stored":88856,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":222,"ondisk_log_size":222,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":66496,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509485,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27332,"kb_used_data":316,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344508,"statfs":{"total":96636764160,"available":96608776192,"internally_reserved":0,"allocated":323584,"data_stored":117072,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509486,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27312,"kb_used_data":296,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344528,"statfs":{"total":96636764160,"available":96608796672,"internally_reserved":0,"allocated":303104,"data_stored":118244,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509486,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27336,"kb_used_data":320,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344504,"statfs":{"total":96636764160,"available":96608772096,"internally_reserved":0,"allocated":327680,"data_stored":118328,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509486,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27344,"kb_used_data":328,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344496,"statfs":{"total":96636764160,"available":96608763904,"internally_reserved":0,"allocated":335872,"data_stored":153010,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509485,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27376,"kb_used_data":360,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344464,"statfs":{"total":96636764160,"available":96608731136,"internally_reserved":0,"allocated":368640,"data_stored":707388,"data_compressed":33248,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509485,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27328,"kb_used_data":312,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344512,"statfs":{"total":96636764160,"available":96608780288,"internally_reserved":0,"allocated":319488,"data_stored":118406,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574894,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27384,"kb_used_data":368,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344456,"statfs":{"total":96636764160,"available":96608722944,"internally_reserved":0,"allocated":376832,"data_stored":707212,"data_compressed":33248,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574894,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27380,"kb_used_data":364,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344460,"statfs":{"total":96636764160,"available":96608727040,"internally_reserved":0,"allocated":372736,"data_stored":154780,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33248,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33248,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":2800,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1414,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":37404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":2722,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":90112,"data_stored":39174,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1238,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":1466,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-17T19:50:16.532 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-04-17T19:50:16.533 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-17T19:50:16.729 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:16.739+0000 7f8ed5000640 1 Processor -- start 2024-04-17T19:50:16.729 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:16.739+0000 7f8ed5000640 1 -- start start 2024-04-17T19:50:16.732 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:16.739+0000 7f8ed5000640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f8ed00c8660 0x7f8ed006bd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:50:16.732 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:16.739+0000 7f8ed5000640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f8ed0159a90 0x7f8ed0159ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:50:16.732 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:16.739+0000 7f8ed5000640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8ed006c8a0 con 0x7f8ed01535d0 2024-04-17T19:50:16.732 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:16.739+0000 7f8ed5000640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 -- 0x7f8ed006c410 con 0x7f8ed0159a90 2024-04-17T19:50:16.732 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:16.739+0000 7f8ed5000640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7f8ed006cb40 con 0x7f8ed00c8660 2024-04-17T19:50:16.732 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:16.739+0000 7f8ecfe00640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f8ed0159a90 0x7f8ed0159ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:50:16.732 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:16.739+0000 7f8ecfe00640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f8ed0159a90 0x7f8ed0159ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:46906/0 (socket says 172.21.15.44:46906) 2024-04-17T19:50:16.732 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:16.739+0000 7f8ecfe00640 1 -- 172.21.15.44:0/3603839173 learned_addr learned my addr 172.21.15.44:0/3603839173 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-04-17T19:50:16.732 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:16.739+0000 7f8ecf400640 1 --2- 172.21.15.44:0/3603839173 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f8ed00c8660 0x7f8ed006bd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:50:16.733 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:16.739+0000 7f8ecfe00640 1 -- 172.21.15.44:0/3603839173 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f8ed00c8660 msgr2=0x7f8ed006bd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T19:50:16.733 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:16.739+0000 7f8ecfe00640 1 --2- 172.21.15.44:0/3603839173 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f8ed00c8660 0x7f8ed006bd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:50:16.733 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:16.739+0000 7f8ecfe00640 1 -- 172.21.15.44:0/3603839173 >> v1:172.21.15.62:6789/0 conn(0x7f8ed01535d0 legacy=0x7f8ed00c7330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:50:16.733 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:16.739+0000 7f8ecfe00640 1 -- 172.21.15.44:0/3603839173 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8ed006ce20 con 0x7f8ed0159a90 2024-04-17T19:50:16.734 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:16.743+0000 7f8ecfe00640 1 --2- 172.21.15.44:0/3603839173 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8ed0159a90 0x7f8ed0159ea0 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f8ec8009e50 tx=0x7f8ec801f210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5ac1f1937aafb2d4 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:50:16.735 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:16.743+0000 7f8ecea00640 1 -- 172.21.15.44:0/3603839173 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ec80b4070 con 0x7f8ed0159a90 2024-04-17T19:50:16.735 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:16.743+0000 7f8ecea00640 1 -- 172.21.15.44:0/3603839173 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8ec80af400 con 0x7f8ed0159a90 2024-04-17T19:50:16.735 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:16.743+0000 7f8ecea00640 1 -- 172.21.15.44:0/3603839173 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ec80af7d0 con 0x7f8ed0159a90 2024-04-17T19:50:16.736 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:16.743+0000 7f8ed5000640 1 -- 172.21.15.44:0/3603839173 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8ed0159a90 msgr2=0x7f8ed0159ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:50:16.736 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:16.743+0000 7f8ed5000640 1 --2- 172.21.15.44:0/3603839173 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8ed0159a90 0x7f8ed0159ea0 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f8ec8009e50 tx=0x7f8ec801f210 comp rx=0 tx=0).stop 2024-04-17T19:50:16.736 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:16.743+0000 7f8ed5000640 1 -- 172.21.15.44:0/3603839173 shutdown_connections 2024-04-17T19:50:16.736 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:16.743+0000 7f8ed5000640 1 --2- 172.21.15.44:0/3603839173 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8ed0159a90 0x7f8ed0159ea0 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:50:16.736 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:16.743+0000 7f8ed5000640 1 --2- 172.21.15.44:0/3603839173 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f8ed00c8660 0x7f8ed006bd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:50:16.736 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:16.743+0000 7f8ed5000640 1 -- 172.21.15.44:0/3603839173 >> 172.21.15.44:0/3603839173 conn(0x7f8ed00ce350 msgr2=0x7f8ed0070f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:50:16.736 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:16.743+0000 7f8ed5000640 1 -- 172.21.15.44:0/3603839173 shutdown_connections 2024-04-17T19:50:16.736 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:16.743+0000 7f8ed5000640 1 -- 172.21.15.44:0/3603839173 wait complete. 2024-04-17T19:50:16.738 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:16.747+0000 7f8ed5000640 1 Processor -- start 2024-04-17T19:50:16.738 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:16.747+0000 7f8ed5000640 1 -- start start 2024-04-17T19:50:16.741 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:16.747+0000 7f8ed5000640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8ed00c8660 0x7f8ed01f25d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:50:16.741 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:16.747+0000 7f8ed5000640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8ed01535d0 0x7f8ed0157560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:50:16.741 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:16.747+0000 7f8ed5000640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f8ed0159a90 0x7f8ed0158500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:50:16.741 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:16.747+0000 7f8ed5000640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f8ed01539e0 con 0x7f8ed00c8660 2024-04-17T19:50:16.741 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:16.747+0000 7f8ed5000640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f8ed015a3e0 con 0x7f8ed01535d0 2024-04-17T19:50:16.741 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:16.747+0000 7f8ed5000640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7f8ed0153b60 con 0x7f8ed0159a90 2024-04-17T19:50:16.741 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:16.747+0000 7f8ecf400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8ed00c8660 0x7f8ed01f25d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:50:16.741 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:16.747+0000 7f8ecf400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8ed00c8660 0x7f8ed01f25d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:46912/0 (socket says 172.21.15.44:46912) 2024-04-17T19:50:16.741 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:16.747+0000 7f8ecf400640 1 -- 172.21.15.44:0/994722501 learned_addr learned my addr 172.21.15.44:0/994722501 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-04-17T19:50:16.741 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:16.747+0000 7f8ecfe00640 1 --2- 172.21.15.44:0/994722501 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f8ed0159a90 0x7f8ed0158500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:50:16.741 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:16.751+0000 7f8ecf400640 1 -- 172.21.15.44:0/994722501 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f8ed0159a90 msgr2=0x7f8ed0158500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:50:16.742 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:16.751+0000 7f8ecf400640 1 --2- 172.21.15.44:0/994722501 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f8ed0159a90 0x7f8ed0158500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:50:16.742 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:16.751+0000 7f8ec7e00640 1 --2- 172.21.15.44:0/994722501 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8ed01535d0 0x7f8ed0157560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:50:16.742 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:16.751+0000 7f8ecf400640 1 -- 172.21.15.44:0/994722501 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8ed01535d0 msgr2=0x7f8ed0157560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:50:16.742 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:16.751+0000 7f8ecf400640 1 --2- 172.21.15.44:0/994722501 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8ed01535d0 0x7f8ed0157560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:50:16.742 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:16.751+0000 7f8ecf400640 1 -- 172.21.15.44:0/994722501 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8ed01f2b10 con 0x7f8ed00c8660 2024-04-17T19:50:16.742 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:16.751+0000 7f8ecfe00640 1 --2- 172.21.15.44:0/994722501 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f8ed0159a90 0x7f8ed0158500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-17T19:50:16.742 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:16.751+0000 7f8ec7e00640 1 --2- 172.21.15.44:0/994722501 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8ed01535d0 0x7f8ed0157560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-17T19:50:16.742 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:16.751+0000 7f8ecf400640 1 --2- 172.21.15.44:0/994722501 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8ed00c8660 0x7f8ed01f25d0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f8ec000e8a0 tx=0x7f8ec000eca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:50:16.742 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:16.751+0000 7f8ec7400640 1 -- 172.21.15.44:0/994722501 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ec0017070 con 0x7f8ed00c8660 2024-04-17T19:50:16.742 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:16.751+0000 7f8ec7400640 1 -- 172.21.15.44:0/994722501 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8ec000c8e0 con 0x7f8ed00c8660 2024-04-17T19:50:16.742 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:16.751+0000 7f8ec7400640 1 -- 172.21.15.44:0/994722501 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ec000cc90 con 0x7f8ed00c8660 2024-04-17T19:50:16.742 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:16.751+0000 7f8ed5000640 1 -- 172.21.15.44:0/994722501 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8ed00c5da0 con 0x7f8ed00c8660 2024-04-17T19:50:16.742 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:16.751+0000 7f8ed5000640 1 -- 172.21.15.44:0/994722501 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8ed01590c0 con 0x7f8ed00c8660 2024-04-17T19:50:16.743 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:16.751+0000 7f8ed5000640 1 -- 172.21.15.44:0/994722501 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8ed004fea0 con 0x7f8ed00c8660 2024-04-17T19:50:16.743 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:16.751+0000 7f8ec7400640 1 -- 172.21.15.44:0/994722501 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f8ec001a070 con 0x7f8ed00c8660 2024-04-17T19:50:16.743 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:16.751+0000 7f8ec7400640 1 --2- 172.21.15.44:0/994722501 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f8eac068380 0x7f8eac06a890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:50:16.743 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:16.751+0000 7f8ec7400640 1 -- 172.21.15.44:0/994722501 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6619+0+0 (secure 0 0 0) 0x7f8ec0086c50 con 0x7f8ed00c8660 2024-04-17T19:50:16.744 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:16.755+0000 7f8ec7e00640 1 --2- 172.21.15.44:0/994722501 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f8eac068380 0x7f8eac06a890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:50:16.745 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:16.755+0000 7f8ec7e00640 1 --2- 172.21.15.44:0/994722501 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f8eac068380 0x7f8eac06a890 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f8ed01f0090 tx=0x7f8eb8009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:50:16.748 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:16.759+0000 7f8ec7400640 1 -- 172.21.15.44:0/994722501 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f8ec008c020 con 0x7f8ed00c8660 2024-04-17T19:50:16.910 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:16.919+0000 7f8ed5000640 1 -- 172.21.15.44:0/994722501 --> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f8ed00c5870 con 0x7f8eac068380 2024-04-17T19:50:16.936 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:16.947+0000 7f8ec7400640 1 -- 172.21.15.44:0/994722501 <== mgr.4102 v2:172.21.15.62:6832/1020159798 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+332714 (secure 0 0 0) 0x7f8ed00c5870 con 0x7f8eac068380 2024-04-17T19:50:16.940 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-04-17T19:50:16.941 INFO:teuthology.orchestra.run.smithi044.stderr:dumped all 2024-04-17T19:50:16.942 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:16.951+0000 7f8ed5000640 1 -- 172.21.15.44:0/994722501 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f8eac068380 msgr2=0x7f8eac06a890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:50:16.942 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:16.951+0000 7f8ed5000640 1 --2- 172.21.15.44:0/994722501 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f8eac068380 0x7f8eac06a890 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f8ed01f0090 tx=0x7f8eb8009040 comp rx=0 tx=0).stop 2024-04-17T19:50:16.943 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:16.951+0000 7f8ed5000640 1 -- 172.21.15.44:0/994722501 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8ed00c8660 msgr2=0x7f8ed01f25d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:50:16.943 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:16.951+0000 7f8ed5000640 1 --2- 172.21.15.44:0/994722501 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8ed00c8660 0x7f8ed01f25d0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f8ec000e8a0 tx=0x7f8ec000eca0 comp rx=0 tx=0).stop 2024-04-17T19:50:16.943 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:16.951+0000 7f8ed5000640 1 -- 172.21.15.44:0/994722501 shutdown_connections 2024-04-17T19:50:16.943 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:16.951+0000 7f8ed5000640 1 --2- 172.21.15.44:0/994722501 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f8eac068380 0x7f8eac06a890 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:50:16.943 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:16.951+0000 7f8ed5000640 1 --2- 172.21.15.44:0/994722501 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f8ed0159a90 0x7f8ed0158500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:50:16.943 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:16.951+0000 7f8ed5000640 1 --2- 172.21.15.44:0/994722501 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8ed01535d0 0x7f8ed0157560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:50:16.943 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:16.951+0000 7f8ed5000640 1 --2- 172.21.15.44:0/994722501 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8ed00c8660 0x7f8ed01f25d0 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:50:16.943 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:16.951+0000 7f8ed5000640 1 -- 172.21.15.44:0/994722501 >> 172.21.15.44:0/994722501 conn(0x7f8ed00ce350 msgr2=0x7f8ed0150e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:50:16.943 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:16.951+0000 7f8ed5000640 1 -- 172.21.15.44:0/994722501 shutdown_connections 2024-04-17T19:50:16.943 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:16.951+0000 7f8ed5000640 1 -- 172.21.15.44:0/994722501 wait complete. 2024-04-17T19:50:16.961 INFO:teuthology.orchestra.run.smithi044.stdout:{"pg_ready":true,"pg_map":{"version":128,"stamp":"2024-04-17T19:50:15.986738+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":634796,"num_objects":101,"num_object_clones":0,"num_object_copies":202,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":101,"num_whiteouts":0,"num_read":118,"num_read_kb":102,"num_write":413,"num_write_kb":2540,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":343,"ondisk_log_size":343,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":218792,"kb_used_data":2664,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755928,"statfs":{"total":773094113280,"available":772870070272,"internally_reserved":0,"allocated":2727936,"data_stored":2194440,"data_compressed":66496,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":12751,"internal_metadata":221236785},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005888"},"pg_stats":[{"pgid":"2.1f","version":"27'13","reported_seq":40,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:39.943777+0000","last_change":"2024-04-17T19:46:55.688623+0000","last_active":"2024-04-17T19:47:39.943777+0000","last_peered":"2024-04-17T19:47:39.943777+0000","last_clean":"2024-04-17T19:47:39.943777+0000","last_became_active":"2024-04-17T19:46:55.687455+0000","last_became_peered":"2024-04-17T19:46:55.687455+0000","last_unstale":"2024-04-17T19:47:39.943777+0000","last_undegraded":"2024-04-17T19:47:39.943777+0000","last_fullsized":"2024-04-17T19:47:39.943777+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:54.640133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:54.640133+0000","last_clean_scrub_stamp":"2024-04-17T19:46:54.640133+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:02:52.057635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:38.681457+0000","last_change":"2024-04-17T19:46:56.683770+0000","last_active":"2024-04-17T19:47:38.681457+0000","last_peered":"2024-04-17T19:47:38.681457+0000","last_clean":"2024-04-17T19:47:38.681457+0000","last_became_active":"2024-04-17T19:46:56.683111+0000","last_became_peered":"2024-04-17T19:46:56.683111+0000","last_unstale":"2024-04-17T19:47:38.681457+0000","last_undegraded":"2024-04-17T19:47:38.681457+0000","last_fullsized":"2024-04-17T19:47:38.681457+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_clean_scrub_stamp":"2024-04-17T19:46:55.648649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T22:25:59.135091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:37.965849+0000","last_change":"2024-04-17T19:47:00.788461+0000","last_active":"2024-04-17T19:47:37.965849+0000","last_peered":"2024-04-17T19:47:37.965849+0000","last_clean":"2024-04-17T19:47:37.965849+0000","last_became_active":"2024-04-17T19:47:00.787654+0000","last_became_peered":"2024-04-17T19:47:00.787654+0000","last_unstale":"2024-04-17T19:47:37.965849+0000","last_undegraded":"2024-04-17T19:47:37.965849+0000","last_fullsized":"2024-04-17T19:47:37.965849+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_clean_scrub_stamp":"2024-04-17T19:46:59.695482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T07:28:34.234670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4,1],"acting":[7,6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1e","version":"25'2","reported_seq":29,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:38.681382+0000","last_change":"2024-04-17T19:46:55.703749+0000","last_active":"2024-04-17T19:47:38.681382+0000","last_peered":"2024-04-17T19:47:38.681382+0000","last_clean":"2024-04-17T19:47:38.681382+0000","last_became_active":"2024-04-17T19:46:55.695191+0000","last_became_peered":"2024-04-17T19:46:55.695191+0000","last_unstale":"2024-04-17T19:47:38.681382+0000","last_undegraded":"2024-04-17T19:47:38.681382+0000","last_fullsized":"2024-04-17T19:47:38.681382+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:54.640133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:54.640133+0000","last_clean_scrub_stamp":"2024-04-17T19:46:54.640133+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:24:42.573542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:38.681668+0000","last_change":"2024-04-17T19:46:56.684814+0000","last_active":"2024-04-17T19:47:38.681668+0000","last_peered":"2024-04-17T19:47:38.681668+0000","last_clean":"2024-04-17T19:47:38.681668+0000","last_became_active":"2024-04-17T19:46:56.684475+0000","last_became_peered":"2024-04-17T19:46:56.684475+0000","last_unstale":"2024-04-17T19:47:38.681668+0000","last_undegraded":"2024-04-17T19:47:38.681668+0000","last_fullsized":"2024-04-17T19:47:38.681668+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_clean_scrub_stamp":"2024-04-17T19:46:55.648649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T05:38:55.394025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:37.955108+0000","last_change":"2024-04-17T19:47:00.769813+0000","last_active":"2024-04-17T19:47:37.955108+0000","last_peered":"2024-04-17T19:47:37.955108+0000","last_clean":"2024-04-17T19:47:37.955108+0000","last_became_active":"2024-04-17T19:47:00.769370+0000","last_became_peered":"2024-04-17T19:47:00.769370+0000","last_unstale":"2024-04-17T19:47:37.955108+0000","last_undegraded":"2024-04-17T19:47:37.955108+0000","last_fullsized":"2024-04-17T19:47:37.955108+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_clean_scrub_stamp":"2024-04-17T19:46:59.695482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:23:20.430751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,4,6],"acting":[2,7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1d","version":"27'13","reported_seq":40,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:49:27.988193+0000","last_change":"2024-04-17T19:46:55.695159+0000","last_active":"2024-04-17T19:49:27.988193+0000","last_peered":"2024-04-17T19:49:27.988193+0000","last_clean":"2024-04-17T19:49:27.988193+0000","last_became_active":"2024-04-17T19:46:55.694285+0000","last_became_peered":"2024-04-17T19:46:55.694285+0000","last_unstale":"2024-04-17T19:49:27.988193+0000","last_undegraded":"2024-04-17T19:49:27.988193+0000","last_fullsized":"2024-04-17T19:49:27.988193+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:54.640133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:54.640133+0000","last_clean_scrub_stamp":"2024-04-17T19:46:54.640133+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T04:52:16.008572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:38.680518+0000","last_change":"2024-04-17T19:46:56.700734+0000","last_active":"2024-04-17T19:47:38.680518+0000","last_peered":"2024-04-17T19:47:38.680518+0000","last_clean":"2024-04-17T19:47:38.680518+0000","last_became_active":"2024-04-17T19:46:56.700413+0000","last_became_peered":"2024-04-17T19:46:56.700413+0000","last_unstale":"2024-04-17T19:47:38.680518+0000","last_undegraded":"2024-04-17T19:47:38.680518+0000","last_fullsized":"2024-04-17T19:47:38.680518+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_clean_scrub_stamp":"2024-04-17T19:46:55.648649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:57:40.700986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:37.955549+0000","last_change":"2024-04-17T19:47:00.772341+0000","last_active":"2024-04-17T19:47:37.955549+0000","last_peered":"2024-04-17T19:47:37.955549+0000","last_clean":"2024-04-17T19:47:37.955549+0000","last_became_active":"2024-04-17T19:47:00.771578+0000","last_became_peered":"2024-04-17T19:47:00.771578+0000","last_unstale":"2024-04-17T19:47:37.955549+0000","last_undegraded":"2024-04-17T19:47:37.955549+0000","last_fullsized":"2024-04-17T19:47:37.955549+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_clean_scrub_stamp":"2024-04-17T19:46:59.695482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:51:07.602172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,3,6],"acting":[2,5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1c","version":"27'5","reported_seq":32,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:39.944815+0000","last_change":"2024-04-17T19:46:55.687607+0000","last_active":"2024-04-17T19:47:39.944815+0000","last_peered":"2024-04-17T19:47:39.944815+0000","last_clean":"2024-04-17T19:47:39.944815+0000","last_became_active":"2024-04-17T19:46:55.687282+0000","last_became_peered":"2024-04-17T19:46:55.687282+0000","last_unstale":"2024-04-17T19:47:39.944815+0000","last_undegraded":"2024-04-17T19:47:39.944815+0000","last_fullsized":"2024-04-17T19:47:39.944815+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:54.640133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:54.640133+0000","last_clean_scrub_stamp":"2024-04-17T19:46:54.640133+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T05:52:32.550876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:38.473780+0000","last_change":"2024-04-17T19:46:56.690268+0000","last_active":"2024-04-17T19:47:38.473780+0000","last_peered":"2024-04-17T19:47:38.473780+0000","last_clean":"2024-04-17T19:47:38.473780+0000","last_became_active":"2024-04-17T19:46:56.689988+0000","last_became_peered":"2024-04-17T19:46:56.689988+0000","last_unstale":"2024-04-17T19:47:38.473780+0000","last_undegraded":"2024-04-17T19:47:38.473780+0000","last_fullsized":"2024-04-17T19:47:38.473780+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_clean_scrub_stamp":"2024-04-17T19:46:55.648649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T01:29:59.423734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:37.955298+0000","last_change":"2024-04-17T19:47:00.759608+0000","last_active":"2024-04-17T19:47:37.955298+0000","last_peered":"2024-04-17T19:47:37.955298+0000","last_clean":"2024-04-17T19:47:37.955298+0000","last_became_active":"2024-04-17T19:47:00.759059+0000","last_became_peered":"2024-04-17T19:47:00.759059+0000","last_unstale":"2024-04-17T19:47:37.955298+0000","last_undegraded":"2024-04-17T19:47:37.955298+0000","last_fullsized":"2024-04-17T19:47:37.955298+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_clean_scrub_stamp":"2024-04-17T19:46:59.695482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:22:37.460235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,5,7],"acting":[2,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:38.473032+0000","last_change":"2024-04-17T19:46:56.688273+0000","last_active":"2024-04-17T19:47:38.473032+0000","last_peered":"2024-04-17T19:47:38.473032+0000","last_clean":"2024-04-17T19:47:38.473032+0000","last_became_active":"2024-04-17T19:46:56.687662+0000","last_became_peered":"2024-04-17T19:46:56.687662+0000","last_unstale":"2024-04-17T19:47:38.473032+0000","last_undegraded":"2024-04-17T19:47:38.473032+0000","last_fullsized":"2024-04-17T19:47:38.473032+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_clean_scrub_stamp":"2024-04-17T19:46:55.648649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:51:46.684685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"27'5","reported_seq":32,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:49:12.983636+0000","last_change":"2024-04-17T19:46:55.692833+0000","last_active":"2024-04-17T19:49:12.983636+0000","last_peered":"2024-04-17T19:49:12.983636+0000","last_clean":"2024-04-17T19:49:12.983636+0000","last_became_active":"2024-04-17T19:46:55.689006+0000","last_became_peered":"2024-04-17T19:46:55.689006+0000","last_unstale":"2024-04-17T19:49:12.983636+0000","last_undegraded":"2024-04-17T19:49:12.983636+0000","last_fullsized":"2024-04-17T19:49:12.983636+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:54.640133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:54.640133+0000","last_clean_scrub_stamp":"2024-04-17T19:46:54.640133+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:57:39.692470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:38.473658+0000","last_change":"2024-04-17T19:47:00.757063+0000","last_active":"2024-04-17T19:47:38.473658+0000","last_peered":"2024-04-17T19:47:38.473658+0000","last_clean":"2024-04-17T19:47:38.473658+0000","last_became_active":"2024-04-17T19:47:00.756456+0000","last_became_peered":"2024-04-17T19:47:00.756456+0000","last_unstale":"2024-04-17T19:47:38.473658+0000","last_undegraded":"2024-04-17T19:47:38.473658+0000","last_fullsized":"2024-04-17T19:47:38.473658+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_clean_scrub_stamp":"2024-04-17T19:46:59.695482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T02:52:51.655611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,5],"acting":[3,1,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:37.966870+0000","last_change":"2024-04-17T19:46:56.691544+0000","last_active":"2024-04-17T19:47:37.966870+0000","last_peered":"2024-04-17T19:47:37.966870+0000","last_clean":"2024-04-17T19:47:37.966870+0000","last_became_active":"2024-04-17T19:46:56.690828+0000","last_became_peered":"2024-04-17T19:46:56.690828+0000","last_unstale":"2024-04-17T19:47:37.966870+0000","last_undegraded":"2024-04-17T19:47:37.966870+0000","last_fullsized":"2024-04-17T19:47:37.966870+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_clean_scrub_stamp":"2024-04-17T19:46:55.648649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:11:01.745657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.a","version":"27'4","reported_seq":31,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:53.926051+0000","last_change":"2024-04-17T19:46:55.715857+0000","last_active":"2024-04-17T19:47:53.926051+0000","last_peered":"2024-04-17T19:47:53.926051+0000","last_clean":"2024-04-17T19:47:53.926051+0000","last_became_active":"2024-04-17T19:46:55.715197+0000","last_became_peered":"2024-04-17T19:46:55.715197+0000","last_unstale":"2024-04-17T19:47:53.926051+0000","last_undegraded":"2024-04-17T19:47:53.926051+0000","last_fullsized":"2024-04-17T19:47:53.926051+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:54.640133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:54.640133+0000","last_clean_scrub_stamp":"2024-04-17T19:46:54.640133+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:25:07.379181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:37.958909+0000","last_change":"2024-04-17T19:47:00.773528+0000","last_active":"2024-04-17T19:47:37.958909+0000","last_peered":"2024-04-17T19:47:37.958909+0000","last_clean":"2024-04-17T19:47:37.958909+0000","last_became_active":"2024-04-17T19:47:00.773077+0000","last_became_peered":"2024-04-17T19:47:00.773077+0000","last_unstale":"2024-04-17T19:47:37.958909+0000","last_undegraded":"2024-04-17T19:47:37.958909+0000","last_fullsized":"2024-04-17T19:47:37.958909+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_clean_scrub_stamp":"2024-04-17T19:46:59.695482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T02:53:18.654740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,6,1],"acting":[0,4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:37.956343+0000","last_change":"2024-04-17T19:46:56.695617+0000","last_active":"2024-04-17T19:47:37.956343+0000","last_peered":"2024-04-17T19:47:37.956343+0000","last_clean":"2024-04-17T19:47:37.956343+0000","last_became_active":"2024-04-17T19:46:56.695205+0000","last_became_peered":"2024-04-17T19:46:56.695205+0000","last_unstale":"2024-04-17T19:47:37.956343+0000","last_undegraded":"2024-04-17T19:47:37.956343+0000","last_fullsized":"2024-04-17T19:47:37.956343+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_clean_scrub_stamp":"2024-04-17T19:46:55.648649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T05:05:36.718886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"27'7","reported_seq":34,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:39.942448+0000","last_change":"2024-04-17T19:46:55.686220+0000","last_active":"2024-04-17T19:47:39.942448+0000","last_peered":"2024-04-17T19:47:39.942448+0000","last_clean":"2024-04-17T19:47:39.942448+0000","last_became_active":"2024-04-17T19:46:55.684782+0000","last_became_peered":"2024-04-17T19:46:55.684782+0000","last_unstale":"2024-04-17T19:47:39.942448+0000","last_undegraded":"2024-04-17T19:47:39.942448+0000","last_fullsized":"2024-04-17T19:47:39.942448+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:54.640133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:54.640133+0000","last_clean_scrub_stamp":"2024-04-17T19:46:54.640133+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:57:31.750325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:38.475895+0000","last_change":"2024-04-17T19:47:38.474847+0000","last_active":"2024-04-17T19:47:38.475895+0000","last_peered":"2024-04-17T19:47:38.475895+0000","last_clean":"2024-04-17T19:47:38.475895+0000","last_became_active":"2024-04-17T19:47:38.474208+0000","last_became_peered":"2024-04-17T19:47:38.474208+0000","last_unstale":"2024-04-17T19:47:38.475895+0000","last_undegraded":"2024-04-17T19:47:38.475895+0000","last_fullsized":"2024-04-17T19:47:38.475895+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_clean_scrub_stamp":"2024-04-17T19:46:59.695482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T05:15:30.939022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2,3],"acting":[0,4,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:38.472711+0000","last_change":"2024-04-17T19:46:56.700069+0000","last_active":"2024-04-17T19:47:38.472711+0000","last_peered":"2024-04-17T19:47:38.472711+0000","last_clean":"2024-04-17T19:47:38.472711+0000","last_became_active":"2024-04-17T19:46:56.699525+0000","last_became_peered":"2024-04-17T19:46:56.699525+0000","last_unstale":"2024-04-17T19:47:38.472711+0000","last_undegraded":"2024-04-17T19:47:38.472711+0000","last_fullsized":"2024-04-17T19:47:38.472711+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_clean_scrub_stamp":"2024-04-17T19:46:55.648649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T00:28:36.944531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.8","version":"25'2","reported_seq":29,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:37.958712+0000","last_change":"2024-04-17T19:46:55.684594+0000","last_active":"2024-04-17T19:47:37.958712+0000","last_peered":"2024-04-17T19:47:37.958712+0000","last_clean":"2024-04-17T19:47:37.958712+0000","last_became_active":"2024-04-17T19:46:55.683145+0000","last_became_peered":"2024-04-17T19:46:55.683145+0000","last_unstale":"2024-04-17T19:47:37.958712+0000","last_undegraded":"2024-04-17T19:47:37.958712+0000","last_fullsized":"2024-04-17T19:47:37.958712+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:54.640133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:54.640133+0000","last_clean_scrub_stamp":"2024-04-17T19:46:54.640133+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T02:39:08.241534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:37.956151+0000","last_change":"2024-04-17T19:47:00.768781+0000","last_active":"2024-04-17T19:47:37.956151+0000","last_peered":"2024-04-17T19:47:37.956151+0000","last_clean":"2024-04-17T19:47:37.956151+0000","last_became_active":"2024-04-17T19:47:00.768277+0000","last_became_peered":"2024-04-17T19:47:00.768277+0000","last_unstale":"2024-04-17T19:47:37.956151+0000","last_undegraded":"2024-04-17T19:47:37.956151+0000","last_fullsized":"2024-04-17T19:47:37.956151+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_clean_scrub_stamp":"2024-04-17T19:46:59.695482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:07:00.936098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,7],"acting":[2,1,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:37.959525+0000","last_change":"2024-04-17T19:46:56.695528+0000","last_active":"2024-04-17T19:47:37.959525+0000","last_peered":"2024-04-17T19:47:37.959525+0000","last_clean":"2024-04-17T19:47:37.959525+0000","last_became_active":"2024-04-17T19:46:56.694993+0000","last_became_peered":"2024-04-17T19:46:56.694993+0000","last_unstale":"2024-04-17T19:47:37.959525+0000","last_undegraded":"2024-04-17T19:47:37.959525+0000","last_fullsized":"2024-04-17T19:47:37.959525+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_clean_scrub_stamp":"2024-04-17T19:46:55.648649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:08:14.848448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"27'8","reported_seq":35,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:49:07.983053+0000","last_change":"2024-04-17T19:46:55.688859+0000","last_active":"2024-04-17T19:49:07.983053+0000","last_peered":"2024-04-17T19:49:07.983053+0000","last_clean":"2024-04-17T19:49:07.983053+0000","last_became_active":"2024-04-17T19:46:55.688507+0000","last_became_peered":"2024-04-17T19:46:55.688507+0000","last_unstale":"2024-04-17T19:49:07.983053+0000","last_undegraded":"2024-04-17T19:49:07.983053+0000","last_fullsized":"2024-04-17T19:49:07.983053+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:54.640133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:54.640133+0000","last_clean_scrub_stamp":"2024-04-17T19:46:54.640133+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T01:53:38.377482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:37.955200+0000","last_change":"2024-04-17T19:47:00.781482+0000","last_active":"2024-04-17T19:47:37.955200+0000","last_peered":"2024-04-17T19:47:37.955200+0000","last_clean":"2024-04-17T19:47:37.955200+0000","last_became_active":"2024-04-17T19:47:00.780994+0000","last_became_peered":"2024-04-17T19:47:00.780994+0000","last_unstale":"2024-04-17T19:47:37.955200+0000","last_undegraded":"2024-04-17T19:47:37.955200+0000","last_fullsized":"2024-04-17T19:47:37.955200+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_clean_scrub_stamp":"2024-04-17T19:46:59.695482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T01:46:40.550031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,3,1],"acting":[2,6,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:37.962898+0000","last_change":"2024-04-17T19:46:56.695874+0000","last_active":"2024-04-17T19:47:37.962898+0000","last_peered":"2024-04-17T19:47:37.962898+0000","last_clean":"2024-04-17T19:47:37.962898+0000","last_became_active":"2024-04-17T19:46:56.694650+0000","last_became_peered":"2024-04-17T19:46:56.694650+0000","last_unstale":"2024-04-17T19:47:37.962898+0000","last_undegraded":"2024-04-17T19:47:37.962898+0000","last_fullsized":"2024-04-17T19:47:37.962898+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_clean_scrub_stamp":"2024-04-17T19:46:55.648649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:44:38.787541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"27'17","reported_seq":44,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:49:31.753195+0000","last_change":"2024-04-17T19:46:55.684490+0000","last_active":"2024-04-17T19:49:31.753195+0000","last_peered":"2024-04-17T19:49:31.753195+0000","last_clean":"2024-04-17T19:49:31.753195+0000","last_became_active":"2024-04-17T19:46:55.680100+0000","last_became_peered":"2024-04-17T19:46:55.680100+0000","last_unstale":"2024-04-17T19:49:31.753195+0000","last_undegraded":"2024-04-17T19:49:31.753195+0000","last_fullsized":"2024-04-17T19:49:31.753195+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:54.640133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:54.640133+0000","last_clean_scrub_stamp":"2024-04-17T19:46:54.640133+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:27:38.256174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":31,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:37.956231+0000","last_change":"2024-04-17T19:47:00.777588+0000","last_active":"2024-04-17T19:47:37.956231+0000","last_peered":"2024-04-17T19:47:37.956231+0000","last_clean":"2024-04-17T19:47:37.956231+0000","last_became_active":"2024-04-17T19:47:00.776873+0000","last_became_peered":"2024-04-17T19:47:00.776873+0000","last_unstale":"2024-04-17T19:47:37.956231+0000","last_undegraded":"2024-04-17T19:47:37.956231+0000","last_fullsized":"2024-04-17T19:47:37.956231+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_clean_scrub_stamp":"2024-04-17T19:46:59.695482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T02:52:42.471996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,6,3],"acting":[4,1,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:37.961616+0000","last_change":"2024-04-17T19:46:56.681681+0000","last_active":"2024-04-17T19:47:37.961616+0000","last_peered":"2024-04-17T19:47:37.961616+0000","last_clean":"2024-04-17T19:47:37.961616+0000","last_became_active":"2024-04-17T19:46:56.681316+0000","last_became_peered":"2024-04-17T19:46:56.681316+0000","last_unstale":"2024-04-17T19:47:37.961616+0000","last_undegraded":"2024-04-17T19:47:37.961616+0000","last_fullsized":"2024-04-17T19:47:37.961616+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_clean_scrub_stamp":"2024-04-17T19:46:55.648649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T07:28:30.187837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"27'4","reported_seq":31,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:39.945209+0000","last_change":"2024-04-17T19:46:55.692826+0000","last_active":"2024-04-17T19:47:39.945209+0000","last_peered":"2024-04-17T19:47:39.945209+0000","last_clean":"2024-04-17T19:47:39.945209+0000","last_became_active":"2024-04-17T19:46:55.691031+0000","last_became_peered":"2024-04-17T19:46:55.691031+0000","last_unstale":"2024-04-17T19:47:39.945209+0000","last_undegraded":"2024-04-17T19:47:39.945209+0000","last_fullsized":"2024-04-17T19:47:39.945209+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:54.640133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:54.640133+0000","last_clean_scrub_stamp":"2024-04-17T19:46:54.640133+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T05:52:32.550876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:37.959626+0000","last_change":"2024-04-17T19:47:00.777416+0000","last_active":"2024-04-17T19:47:37.959626+0000","last_peered":"2024-04-17T19:47:37.959626+0000","last_clean":"2024-04-17T19:47:37.959626+0000","last_became_active":"2024-04-17T19:47:00.771531+0000","last_became_peered":"2024-04-17T19:47:00.771531+0000","last_unstale":"2024-04-17T19:47:37.959626+0000","last_undegraded":"2024-04-17T19:47:37.959626+0000","last_fullsized":"2024-04-17T19:47:37.959626+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_clean_scrub_stamp":"2024-04-17T19:46:59.695482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:30:31.288100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,2,7],"acting":[6,0,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:37.955833+0000","last_change":"2024-04-17T19:46:56.692250+0000","last_active":"2024-04-17T19:47:37.955833+0000","last_peered":"2024-04-17T19:47:37.955833+0000","last_clean":"2024-04-17T19:47:37.955833+0000","last_became_active":"2024-04-17T19:46:56.691801+0000","last_became_peered":"2024-04-17T19:46:56.691801+0000","last_unstale":"2024-04-17T19:47:37.955833+0000","last_undegraded":"2024-04-17T19:47:37.955833+0000","last_fullsized":"2024-04-17T19:47:37.955833+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_clean_scrub_stamp":"2024-04-17T19:46:55.648649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T01:53:39.385998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"25'1","reported_seq":28,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:38.681129+0000","last_change":"2024-04-17T19:46:55.713556+0000","last_active":"2024-04-17T19:47:38.681129+0000","last_peered":"2024-04-17T19:47:38.681129+0000","last_clean":"2024-04-17T19:47:38.681129+0000","last_became_active":"2024-04-17T19:46:55.712908+0000","last_became_peered":"2024-04-17T19:46:55.712908+0000","last_unstale":"2024-04-17T19:47:38.681129+0000","last_undegraded":"2024-04-17T19:47:38.681129+0000","last_fullsized":"2024-04-17T19:47:38.681129+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:54.640133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:54.640133+0000","last_clean_scrub_stamp":"2024-04-17T19:46:54.640133+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:57:31.750325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:37.959269+0000","last_change":"2024-04-17T19:47:00.776868+0000","last_active":"2024-04-17T19:47:37.959269+0000","last_peered":"2024-04-17T19:47:37.959269+0000","last_clean":"2024-04-17T19:47:37.959269+0000","last_became_active":"2024-04-17T19:47:00.771385+0000","last_became_peered":"2024-04-17T19:47:00.771385+0000","last_unstale":"2024-04-17T19:47:37.959269+0000","last_undegraded":"2024-04-17T19:47:37.959269+0000","last_fullsized":"2024-04-17T19:47:37.959269+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_clean_scrub_stamp":"2024-04-17T19:46:59.695482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T01:46:40.550031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5,7],"acting":[6,3,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:37.959134+0000","last_change":"2024-04-17T19:46:56.709288+0000","last_active":"2024-04-17T19:47:37.959134+0000","last_peered":"2024-04-17T19:47:37.959134+0000","last_clean":"2024-04-17T19:47:37.959134+0000","last_became_active":"2024-04-17T19:46:56.708572+0000","last_became_peered":"2024-04-17T19:46:56.708572+0000","last_unstale":"2024-04-17T19:47:37.959134+0000","last_undegraded":"2024-04-17T19:47:37.959134+0000","last_fullsized":"2024-04-17T19:47:37.959134+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_clean_scrub_stamp":"2024-04-17T19:46:55.648649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:51:03.555339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"27'5","reported_seq":32,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:39.947236+0000","last_change":"2024-04-17T19:46:55.708506+0000","last_active":"2024-04-17T19:47:39.947236+0000","last_peered":"2024-04-17T19:47:39.947236+0000","last_clean":"2024-04-17T19:47:39.947236+0000","last_became_active":"2024-04-17T19:46:55.708175+0000","last_became_peered":"2024-04-17T19:46:55.708175+0000","last_unstale":"2024-04-17T19:47:39.947236+0000","last_undegraded":"2024-04-17T19:47:39.947236+0000","last_fullsized":"2024-04-17T19:47:39.947236+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:54.640133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:54.640133+0000","last_clean_scrub_stamp":"2024-04-17T19:46:54.640133+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T22:25:04.163982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:37.961174+0000","last_change":"2024-04-17T19:47:00.786657+0000","last_active":"2024-04-17T19:47:37.961174+0000","last_peered":"2024-04-17T19:47:37.961174+0000","last_clean":"2024-04-17T19:47:37.961174+0000","last_became_active":"2024-04-17T19:47:00.780743+0000","last_became_peered":"2024-04-17T19:47:00.780743+0000","last_unstale":"2024-04-17T19:47:37.961174+0000","last_undegraded":"2024-04-17T19:47:37.961174+0000","last_fullsized":"2024-04-17T19:47:37.961174+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_clean_scrub_stamp":"2024-04-17T19:46:59.695482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:07:00.936098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0,3],"acting":[6,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:38.680188+0000","last_change":"2024-04-17T19:46:56.679752+0000","last_active":"2024-04-17T19:47:38.680188+0000","last_peered":"2024-04-17T19:47:38.680188+0000","last_clean":"2024-04-17T19:47:38.680188+0000","last_became_active":"2024-04-17T19:46:56.679230+0000","last_became_peered":"2024-04-17T19:46:56.679230+0000","last_unstale":"2024-04-17T19:47:38.680188+0000","last_undegraded":"2024-04-17T19:47:38.680188+0000","last_fullsized":"2024-04-17T19:47:38.680188+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_clean_scrub_stamp":"2024-04-17T19:46:55.648649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:08:14.848448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"27'8","reported_seq":37,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:49:33.857429+0000","last_change":"2024-04-17T19:46:55.715967+0000","last_active":"2024-04-17T19:49:33.857429+0000","last_peered":"2024-04-17T19:49:33.857429+0000","last_clean":"2024-04-17T19:49:33.857429+0000","last_became_active":"2024-04-17T19:46:55.715247+0000","last_became_peered":"2024-04-17T19:46:55.715247+0000","last_unstale":"2024-04-17T19:49:33.857429+0000","last_undegraded":"2024-04-17T19:49:33.857429+0000","last_fullsized":"2024-04-17T19:49:33.857429+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:54.640133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:54.640133+0000","last_clean_scrub_stamp":"2024-04-17T19:46:54.640133+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T00:40:58.757373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":524,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:37.963876+0000","last_change":"2024-04-17T19:47:00.769901+0000","last_active":"2024-04-17T19:47:37.963876+0000","last_peered":"2024-04-17T19:47:37.963876+0000","last_clean":"2024-04-17T19:47:37.963876+0000","last_became_active":"2024-04-17T19:47:00.768634+0000","last_became_peered":"2024-04-17T19:47:00.768634+0000","last_unstale":"2024-04-17T19:47:37.963876+0000","last_undegraded":"2024-04-17T19:47:37.963876+0000","last_fullsized":"2024-04-17T19:47:37.963876+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_clean_scrub_stamp":"2024-04-17T19:46:59.695482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T04:48:47.816818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,7],"acting":[6,0,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:37.959374+0000","last_change":"2024-04-17T19:46:56.703467+0000","last_active":"2024-04-17T19:47:37.959374+0000","last_peered":"2024-04-17T19:47:37.959374+0000","last_clean":"2024-04-17T19:47:37.959374+0000","last_became_active":"2024-04-17T19:46:56.703148+0000","last_became_peered":"2024-04-17T19:46:56.703148+0000","last_unstale":"2024-04-17T19:47:37.959374+0000","last_undegraded":"2024-04-17T19:47:37.959374+0000","last_fullsized":"2024-04-17T19:47:37.959374+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_clean_scrub_stamp":"2024-04-17T19:46:55.648649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T22:01:49.863892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"27'4","reported_seq":31,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:39.945540+0000","last_change":"2024-04-17T19:46:55.715941+0000","last_active":"2024-04-17T19:47:39.945540+0000","last_peered":"2024-04-17T19:47:39.945540+0000","last_clean":"2024-04-17T19:47:39.945540+0000","last_became_active":"2024-04-17T19:46:55.715527+0000","last_became_peered":"2024-04-17T19:46:55.715527+0000","last_unstale":"2024-04-17T19:47:39.945540+0000","last_undegraded":"2024-04-17T19:47:39.945540+0000","last_fullsized":"2024-04-17T19:47:39.945540+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:54.640133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:54.640133+0000","last_clean_scrub_stamp":"2024-04-17T19:46:54.640133+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:11:00.737141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:38.681030+0000","last_change":"2024-04-17T19:47:00.784031+0000","last_active":"2024-04-17T19:47:38.681030+0000","last_peered":"2024-04-17T19:47:38.681030+0000","last_clean":"2024-04-17T19:47:38.681030+0000","last_became_active":"2024-04-17T19:47:00.783386+0000","last_became_peered":"2024-04-17T19:47:00.783386+0000","last_unstale":"2024-04-17T19:47:38.681030+0000","last_undegraded":"2024-04-17T19:47:38.681030+0000","last_fullsized":"2024-04-17T19:47:38.681030+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_clean_scrub_stamp":"2024-04-17T19:46:59.695482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:00:44.689926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6,1],"acting":[5,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:37.957437+0000","last_change":"2024-04-17T19:46:56.692287+0000","last_active":"2024-04-17T19:47:37.957437+0000","last_peered":"2024-04-17T19:47:37.957437+0000","last_clean":"2024-04-17T19:47:37.957437+0000","last_became_active":"2024-04-17T19:46:56.691917+0000","last_became_peered":"2024-04-17T19:46:56.691917+0000","last_unstale":"2024-04-17T19:47:37.957437+0000","last_undegraded":"2024-04-17T19:47:37.957437+0000","last_fullsized":"2024-04-17T19:47:37.957437+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_clean_scrub_stamp":"2024-04-17T19:46:55.648649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T07:37:05.790432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.3","version":"27'6","reported_seq":33,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:39.945478+0000","last_change":"2024-04-17T19:46:55.686031+0000","last_active":"2024-04-17T19:47:39.945478+0000","last_peered":"2024-04-17T19:47:39.945478+0000","last_clean":"2024-04-17T19:47:39.945478+0000","last_became_active":"2024-04-17T19:46:55.685599+0000","last_became_peered":"2024-04-17T19:46:55.685599+0000","last_unstale":"2024-04-17T19:47:39.945478+0000","last_undegraded":"2024-04-17T19:47:39.945478+0000","last_fullsized":"2024-04-17T19:47:39.945478+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:54.640133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:54.640133+0000","last_clean_scrub_stamp":"2024-04-17T19:46:54.640133+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T01:39:32.586696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":183,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:38.680085+0000","last_change":"2024-04-17T19:46:43.000943+0000","last_active":"2024-04-17T19:47:38.680085+0000","last_peered":"2024-04-17T19:47:38.680085+0000","last_clean":"2024-04-17T19:47:38.680085+0000","last_became_active":"2024-04-17T19:46:43.000652+0000","last_became_peered":"2024-04-17T19:46:43.000652+0000","last_unstale":"2024-04-17T19:47:38.680085+0000","last_undegraded":"2024-04-17T19:47:38.680085+0000","last_fullsized":"2024-04-17T19:47:38.680085+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:41.988197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:41.988197+0000","last_clean_scrub_stamp":"2024-04-17T19:46:41.988197+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T19:53:52.845547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:38.473896+0000","last_change":"2024-04-17T19:47:00.731680+0000","last_active":"2024-04-17T19:47:38.473896+0000","last_peered":"2024-04-17T19:47:38.473896+0000","last_clean":"2024-04-17T19:47:38.473896+0000","last_became_active":"2024-04-17T19:47:00.731093+0000","last_became_peered":"2024-04-17T19:47:00.731093+0000","last_unstale":"2024-04-17T19:47:38.473896+0000","last_undegraded":"2024-04-17T19:47:38.473896+0000","last_fullsized":"2024-04-17T19:47:38.473896+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_clean_scrub_stamp":"2024-04-17T19:46:59.695482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T04:59:23.336626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:38.473836+0000","last_change":"2024-04-17T19:46:56.692443+0000","last_active":"2024-04-17T19:47:38.473836+0000","last_peered":"2024-04-17T19:47:38.473836+0000","last_clean":"2024-04-17T19:47:38.473836+0000","last_became_active":"2024-04-17T19:46:56.692106+0000","last_became_peered":"2024-04-17T19:46:56.692106+0000","last_unstale":"2024-04-17T19:47:38.473836+0000","last_undegraded":"2024-04-17T19:47:38.473836+0000","last_fullsized":"2024-04-17T19:47:38.473836+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_clean_scrub_stamp":"2024-04-17T19:46:55.648649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T04:07:54.102221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.c","version":"27'6","reported_seq":33,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:48.269381+0000","last_change":"2024-04-17T19:46:55.689884+0000","last_active":"2024-04-17T19:47:48.269381+0000","last_peered":"2024-04-17T19:47:48.269381+0000","last_clean":"2024-04-17T19:47:48.269381+0000","last_became_active":"2024-04-17T19:46:55.689059+0000","last_became_peered":"2024-04-17T19:46:55.689059+0000","last_unstale":"2024-04-17T19:47:48.269381+0000","last_undegraded":"2024-04-17T19:47:48.269381+0000","last_fullsized":"2024-04-17T19:47:48.269381+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:54.640133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:54.640133+0000","last_clean_scrub_stamp":"2024-04-17T19:46:54.640133+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T04:52:16.008572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1428,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:37.955343+0000","last_change":"2024-04-17T19:47:00.760432+0000","last_active":"2024-04-17T19:47:37.955343+0000","last_peered":"2024-04-17T19:47:37.955343+0000","last_clean":"2024-04-17T19:47:37.955343+0000","last_became_active":"2024-04-17T19:47:00.759946+0000","last_became_peered":"2024-04-17T19:47:00.759946+0000","last_unstale":"2024-04-17T19:47:37.955343+0000","last_undegraded":"2024-04-17T19:47:37.955343+0000","last_fullsized":"2024-04-17T19:47:37.955343+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_clean_scrub_stamp":"2024-04-17T19:46:59.695482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:30:31.288100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,7,4],"acting":[2,3,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":11,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:39.979736+0000","last_change":"2024-04-17T19:47:37.967945+0000","last_active":"2024-04-17T19:47:39.979736+0000","last_peered":"2024-04-17T19:47:39.979736+0000","last_clean":"2024-04-17T19:47:39.979736+0000","last_became_active":"2024-04-17T19:47:37.967613+0000","last_became_peered":"2024-04-17T19:47:37.967613+0000","last_unstale":"2024-04-17T19:47:39.979736+0000","last_undegraded":"2024-04-17T19:47:39.979736+0000","last_fullsized":"2024-04-17T19:47:39.979736+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_clean_scrub_stamp":"2024-04-17T19:46:55.648649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:31:43.713056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.d","version":"27'3","reported_seq":30,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:39.940688+0000","last_change":"2024-04-17T19:46:55.704346+0000","last_active":"2024-04-17T19:47:39.940688+0000","last_peered":"2024-04-17T19:47:39.940688+0000","last_clean":"2024-04-17T19:47:39.940688+0000","last_became_active":"2024-04-17T19:46:55.703334+0000","last_became_peered":"2024-04-17T19:46:55.703334+0000","last_unstale":"2024-04-17T19:47:39.940688+0000","last_undegraded":"2024-04-17T19:47:39.940688+0000","last_fullsized":"2024-04-17T19:47:39.940688+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:54.640133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:54.640133+0000","last_clean_scrub_stamp":"2024-04-17T19:46:54.640133+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:01:11.327106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:38.680778+0000","last_change":"2024-04-17T19:47:00.745450+0000","last_active":"2024-04-17T19:47:38.680778+0000","last_peered":"2024-04-17T19:47:38.680778+0000","last_clean":"2024-04-17T19:47:38.680778+0000","last_became_active":"2024-04-17T19:47:00.744227+0000","last_became_peered":"2024-04-17T19:47:00.744227+0000","last_unstale":"2024-04-17T19:47:38.680778+0000","last_undegraded":"2024-04-17T19:47:38.680778+0000","last_fullsized":"2024-04-17T19:47:38.680778+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_clean_scrub_stamp":"2024-04-17T19:46:59.695482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:52:15.523817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1,3],"acting":[5,4,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:37.960517+0000","last_change":"2024-04-17T19:46:56.687926+0000","last_active":"2024-04-17T19:47:37.960517+0000","last_peered":"2024-04-17T19:47:37.960517+0000","last_clean":"2024-04-17T19:47:37.960517+0000","last_became_active":"2024-04-17T19:46:56.687352+0000","last_became_peered":"2024-04-17T19:46:56.687352+0000","last_unstale":"2024-04-17T19:47:37.960517+0000","last_undegraded":"2024-04-17T19:47:37.960517+0000","last_fullsized":"2024-04-17T19:47:37.960517+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_clean_scrub_stamp":"2024-04-17T19:46:55.648649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T01:32:52.608291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.e","version":"27'5","reported_seq":32,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:39.943637+0000","last_change":"2024-04-17T19:46:55.716397+0000","last_active":"2024-04-17T19:47:39.943637+0000","last_peered":"2024-04-17T19:47:39.943637+0000","last_clean":"2024-04-17T19:47:39.943637+0000","last_became_active":"2024-04-17T19:46:55.715196+0000","last_became_peered":"2024-04-17T19:46:55.715196+0000","last_unstale":"2024-04-17T19:47:39.943637+0000","last_undegraded":"2024-04-17T19:47:39.943637+0000","last_fullsized":"2024-04-17T19:47:39.943637+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:54.640133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:54.640133+0000","last_clean_scrub_stamp":"2024-04-17T19:46:54.640133+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:24:42.573542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:38.472509+0000","last_change":"2024-04-17T19:47:00.735608+0000","last_active":"2024-04-17T19:47:38.472509+0000","last_peered":"2024-04-17T19:47:38.472509+0000","last_clean":"2024-04-17T19:47:38.472509+0000","last_became_active":"2024-04-17T19:47:00.735120+0000","last_became_peered":"2024-04-17T19:47:00.735120+0000","last_unstale":"2024-04-17T19:47:38.472509+0000","last_undegraded":"2024-04-17T19:47:38.472509+0000","last_fullsized":"2024-04-17T19:47:38.472509+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_clean_scrub_stamp":"2024-04-17T19:46:59.695482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T04:40:43.846198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:37.956507+0000","last_change":"2024-04-17T19:46:56.706026+0000","last_active":"2024-04-17T19:47:37.956507+0000","last_peered":"2024-04-17T19:47:37.956507+0000","last_clean":"2024-04-17T19:47:37.956507+0000","last_became_active":"2024-04-17T19:46:56.704786+0000","last_became_peered":"2024-04-17T19:46:56.704786+0000","last_unstale":"2024-04-17T19:47:37.956507+0000","last_undegraded":"2024-04-17T19:47:37.956507+0000","last_fullsized":"2024-04-17T19:47:37.956507+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_clean_scrub_stamp":"2024-04-17T19:46:55.648649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:59:17.441539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.f","version":"25'2","reported_seq":29,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:37.960572+0000","last_change":"2024-04-17T19:46:55.707082+0000","last_active":"2024-04-17T19:47:37.960572+0000","last_peered":"2024-04-17T19:47:37.960572+0000","last_clean":"2024-04-17T19:47:37.960572+0000","last_became_active":"2024-04-17T19:46:55.706729+0000","last_became_peered":"2024-04-17T19:46:55.706729+0000","last_unstale":"2024-04-17T19:47:37.960572+0000","last_undegraded":"2024-04-17T19:47:37.960572+0000","last_fullsized":"2024-04-17T19:47:37.960572+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:54.640133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:54.640133+0000","last_clean_scrub_stamp":"2024-04-17T19:46:54.640133+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:11:00.737141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:38.680082+0000","last_change":"2024-04-17T19:47:00.744054+0000","last_active":"2024-04-17T19:47:38.680082+0000","last_peered":"2024-04-17T19:47:38.680082+0000","last_clean":"2024-04-17T19:47:38.680082+0000","last_became_active":"2024-04-17T19:47:00.743582+0000","last_became_peered":"2024-04-17T19:47:00.743582+0000","last_unstale":"2024-04-17T19:47:38.680082+0000","last_undegraded":"2024-04-17T19:47:38.680082+0000","last_fullsized":"2024-04-17T19:47:38.680082+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_clean_scrub_stamp":"2024-04-17T19:46:59.695482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T22:25:09.219331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,2],"acting":[1,5,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:38.472716+0000","last_change":"2024-04-17T19:46:56.692435+0000","last_active":"2024-04-17T19:47:38.472716+0000","last_peered":"2024-04-17T19:47:38.472716+0000","last_clean":"2024-04-17T19:47:38.472716+0000","last_became_active":"2024-04-17T19:46:56.692038+0000","last_became_peered":"2024-04-17T19:46:56.692038+0000","last_unstale":"2024-04-17T19:47:38.472716+0000","last_undegraded":"2024-04-17T19:47:38.472716+0000","last_fullsized":"2024-04-17T19:47:38.472716+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_clean_scrub_stamp":"2024-04-17T19:46:55.648649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:06:56.889266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.10","version":"27'18","reported_seq":45,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:49:14.997636+0000","last_change":"2024-04-17T19:46:55.692188+0000","last_active":"2024-04-17T19:49:14.997636+0000","last_peered":"2024-04-17T19:49:14.997636+0000","last_clean":"2024-04-17T19:49:14.997636+0000","last_became_active":"2024-04-17T19:46:55.691286+0000","last_became_peered":"2024-04-17T19:46:55.691286+0000","last_unstale":"2024-04-17T19:49:14.997636+0000","last_undegraded":"2024-04-17T19:49:14.997636+0000","last_fullsized":"2024-04-17T19:49:14.997636+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:54.640133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:54.640133+0000","last_clean_scrub_stamp":"2024-04-17T19:46:54.640133+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:01:11.327106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:38.681258+0000","last_change":"2024-04-17T19:47:00.781167+0000","last_active":"2024-04-17T19:47:38.681258+0000","last_peered":"2024-04-17T19:47:38.681258+0000","last_clean":"2024-04-17T19:47:38.681258+0000","last_became_active":"2024-04-17T19:47:00.780167+0000","last_became_peered":"2024-04-17T19:47:00.780167+0000","last_unstale":"2024-04-17T19:47:38.681258+0000","last_undegraded":"2024-04-17T19:47:38.681258+0000","last_fullsized":"2024-04-17T19:47:38.681258+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_clean_scrub_stamp":"2024-04-17T19:46:59.695482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T00:07:51.831352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1,6],"acting":[5,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:38.679978+0000","last_change":"2024-04-17T19:46:56.676150+0000","last_active":"2024-04-17T19:47:38.679978+0000","last_peered":"2024-04-17T19:47:38.679978+0000","last_clean":"2024-04-17T19:47:38.679978+0000","last_became_active":"2024-04-17T19:46:56.675826+0000","last_became_peered":"2024-04-17T19:46:56.675826+0000","last_unstale":"2024-04-17T19:47:38.679978+0000","last_undegraded":"2024-04-17T19:47:38.679978+0000","last_fullsized":"2024-04-17T19:47:38.679978+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_clean_scrub_stamp":"2024-04-17T19:46:55.648649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T04:52:17.017088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.11","version":"25'5","reported_seq":32,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:37.958901+0000","last_change":"2024-04-17T19:46:55.682001+0000","last_active":"2024-04-17T19:47:37.958901+0000","last_peered":"2024-04-17T19:47:37.958901+0000","last_clean":"2024-04-17T19:47:37.958901+0000","last_became_active":"2024-04-17T19:46:55.681607+0000","last_became_peered":"2024-04-17T19:46:55.681607+0000","last_unstale":"2024-04-17T19:47:37.958901+0000","last_undegraded":"2024-04-17T19:47:37.958901+0000","last_fullsized":"2024-04-17T19:47:37.958901+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:54.640133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:54.640133+0000","last_clean_scrub_stamp":"2024-04-17T19:46:54.640133+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T04:43:37.994081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:38.681616+0000","last_change":"2024-04-17T19:47:00.756396+0000","last_active":"2024-04-17T19:47:38.681616+0000","last_peered":"2024-04-17T19:47:38.681616+0000","last_clean":"2024-04-17T19:47:38.681616+0000","last_became_active":"2024-04-17T19:47:00.755282+0000","last_became_peered":"2024-04-17T19:47:00.755282+0000","last_unstale":"2024-04-17T19:47:38.681616+0000","last_undegraded":"2024-04-17T19:47:38.681616+0000","last_fullsized":"2024-04-17T19:47:38.681616+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_clean_scrub_stamp":"2024-04-17T19:46:59.695482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:08:25.082826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6,4],"acting":[5,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:38.473123+0000","last_change":"2024-04-17T19:46:56.694764+0000","last_active":"2024-04-17T19:47:38.473123+0000","last_peered":"2024-04-17T19:47:38.473123+0000","last_clean":"2024-04-17T19:47:38.473123+0000","last_became_active":"2024-04-17T19:46:56.694449+0000","last_became_peered":"2024-04-17T19:46:56.694449+0000","last_unstale":"2024-04-17T19:47:38.473123+0000","last_undegraded":"2024-04-17T19:47:38.473123+0000","last_fullsized":"2024-04-17T19:47:38.473123+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_clean_scrub_stamp":"2024-04-17T19:46:55.648649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T02:53:14.607908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.12","version":"27'6","reported_seq":33,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:49:17.984148+0000","last_change":"2024-04-17T19:46:55.689900+0000","last_active":"2024-04-17T19:49:17.984148+0000","last_peered":"2024-04-17T19:49:17.984148+0000","last_clean":"2024-04-17T19:49:17.984148+0000","last_became_active":"2024-04-17T19:46:55.689607+0000","last_became_peered":"2024-04-17T19:46:55.689607+0000","last_unstale":"2024-04-17T19:49:17.984148+0000","last_undegraded":"2024-04-17T19:49:17.984148+0000","last_fullsized":"2024-04-17T19:49:17.984148+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:54.640133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:54.640133+0000","last_clean_scrub_stamp":"2024-04-17T19:46:54.640133+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:59:16.433023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:37.960971+0000","last_change":"2024-04-17T19:47:00.786434+0000","last_active":"2024-04-17T19:47:37.960971+0000","last_peered":"2024-04-17T19:47:37.960971+0000","last_clean":"2024-04-17T19:47:37.960971+0000","last_became_active":"2024-04-17T19:47:00.781025+0000","last_became_peered":"2024-04-17T19:47:00.781025+0000","last_unstale":"2024-04-17T19:47:37.960971+0000","last_undegraded":"2024-04-17T19:47:37.960971+0000","last_fullsized":"2024-04-17T19:47:37.960971+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_clean_scrub_stamp":"2024-04-17T19:46:59.695482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:51:07.602172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0,7],"acting":[6,4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:37.959911+0000","last_change":"2024-04-17T19:46:56.693555+0000","last_active":"2024-04-17T19:47:37.959911+0000","last_peered":"2024-04-17T19:47:37.959911+0000","last_clean":"2024-04-17T19:47:37.959911+0000","last_became_active":"2024-04-17T19:46:56.687385+0000","last_became_peered":"2024-04-17T19:46:56.687385+0000","last_unstale":"2024-04-17T19:47:37.959911+0000","last_undegraded":"2024-04-17T19:47:37.959911+0000","last_fullsized":"2024-04-17T19:47:37.959911+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_clean_scrub_stamp":"2024-04-17T19:46:55.648649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T05:52:33.559392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"27'9","reported_seq":36,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:39.942294+0000","last_change":"2024-04-17T19:46:55.700010+0000","last_active":"2024-04-17T19:47:39.942294+0000","last_peered":"2024-04-17T19:47:39.942294+0000","last_clean":"2024-04-17T19:47:39.942294+0000","last_became_active":"2024-04-17T19:46:55.698962+0000","last_became_peered":"2024-04-17T19:46:55.698962+0000","last_unstale":"2024-04-17T19:47:39.942294+0000","last_undegraded":"2024-04-17T19:47:39.942294+0000","last_fullsized":"2024-04-17T19:47:39.942294+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:54.640133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:54.640133+0000","last_clean_scrub_stamp":"2024-04-17T19:46:54.640133+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T01:25:12.780134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:38.473724+0000","last_change":"2024-04-17T19:47:00.760341+0000","last_active":"2024-04-17T19:47:38.473724+0000","last_peered":"2024-04-17T19:47:38.473724+0000","last_clean":"2024-04-17T19:47:38.473724+0000","last_became_active":"2024-04-17T19:47:00.759892+0000","last_became_peered":"2024-04-17T19:47:00.759892+0000","last_unstale":"2024-04-17T19:47:38.473724+0000","last_undegraded":"2024-04-17T19:47:38.473724+0000","last_fullsized":"2024-04-17T19:47:38.473724+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_clean_scrub_stamp":"2024-04-17T19:46:59.695482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T05:15:30.939022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5,6],"acting":[3,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":11,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:37.970878+0000","last_change":"2024-04-17T19:47:37.969333+0000","last_active":"2024-04-17T19:47:37.970878+0000","last_peered":"2024-04-17T19:47:37.970878+0000","last_clean":"2024-04-17T19:47:37.970878+0000","last_became_active":"2024-04-17T19:47:37.968623+0000","last_became_peered":"2024-04-17T19:47:37.968623+0000","last_unstale":"2024-04-17T19:47:37.970878+0000","last_undegraded":"2024-04-17T19:47:37.970878+0000","last_fullsized":"2024-04-17T19:47:37.970878+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_clean_scrub_stamp":"2024-04-17T19:46:55.648649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T04:48:43.769985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"27'29","reported_seq":56,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:49:36.735787+0000","last_change":"2024-04-17T19:46:55.697242+0000","last_active":"2024-04-17T19:49:36.735787+0000","last_peered":"2024-04-17T19:49:36.735787+0000","last_clean":"2024-04-17T19:49:36.735787+0000","last_became_active":"2024-04-17T19:46:55.696876+0000","last_became_peered":"2024-04-17T19:46:55.696876+0000","last_unstale":"2024-04-17T19:49:36.735787+0000","last_undegraded":"2024-04-17T19:49:36.735787+0000","last_fullsized":"2024-04-17T19:49:36.735787+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:54.640133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:54.640133+0000","last_clean_scrub_stamp":"2024-04-17T19:46:54.640133+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:24:28.029324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":37336,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":30,"num_write_kb":49,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"27'3","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:49:20.435531+0000","last_change":"2024-04-17T19:47:00.743810+0000","last_active":"2024-04-17T19:49:20.435531+0000","last_peered":"2024-04-17T19:49:20.435531+0000","last_clean":"2024-04-17T19:49:20.435531+0000","last_became_active":"2024-04-17T19:47:00.742290+0000","last_became_peered":"2024-04-17T19:47:00.742290+0000","last_unstale":"2024-04-17T19:49:20.435531+0000","last_undegraded":"2024-04-17T19:49:20.435531+0000","last_fullsized":"2024-04-17T19:49:20.435531+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_clean_scrub_stamp":"2024-04-17T19:46:59.695482+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T04:20:00.039224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,5,0],"acting":[4,3,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:38.473595+0000","last_change":"2024-04-17T19:46:56.680527+0000","last_active":"2024-04-17T19:47:38.473595+0000","last_peered":"2024-04-17T19:47:38.473595+0000","last_clean":"2024-04-17T19:47:38.473595+0000","last_became_active":"2024-04-17T19:46:56.680171+0000","last_became_peered":"2024-04-17T19:46:56.680171+0000","last_unstale":"2024-04-17T19:47:38.473595+0000","last_undegraded":"2024-04-17T19:47:38.473595+0000","last_fullsized":"2024-04-17T19:47:38.473595+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_clean_scrub_stamp":"2024-04-17T19:46:55.648649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T07:11:10.748292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.15","version":"27'8","reported_seq":35,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:49:28.868607+0000","last_change":"2024-04-17T19:46:55.707717+0000","last_active":"2024-04-17T19:49:28.868607+0000","last_peered":"2024-04-17T19:49:28.868607+0000","last_clean":"2024-04-17T19:49:28.868607+0000","last_became_active":"2024-04-17T19:46:55.706967+0000","last_became_peered":"2024-04-17T19:46:55.706967+0000","last_unstale":"2024-04-17T19:49:28.868607+0000","last_undegraded":"2024-04-17T19:49:28.868607+0000","last_fullsized":"2024-04-17T19:49:28.868607+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:54.640133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:54.640133+0000","last_clean_scrub_stamp":"2024-04-17T19:46:54.640133+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T05:10:04.380307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:37.955851+0000","last_change":"2024-04-17T19:47:00.758723+0000","last_active":"2024-04-17T19:47:37.955851+0000","last_peered":"2024-04-17T19:47:37.955851+0000","last_clean":"2024-04-17T19:47:37.955851+0000","last_became_active":"2024-04-17T19:47:00.758209+0000","last_became_peered":"2024-04-17T19:47:00.758209+0000","last_unstale":"2024-04-17T19:47:37.955851+0000","last_undegraded":"2024-04-17T19:47:37.955851+0000","last_fullsized":"2024-04-17T19:47:37.955851+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_clean_scrub_stamp":"2024-04-17T19:46:59.695482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T04:48:47.816818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1,7],"acting":[2,3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:38.681917+0000","last_change":"2024-04-17T19:46:56.684067+0000","last_active":"2024-04-17T19:47:38.681917+0000","last_peered":"2024-04-17T19:47:38.681917+0000","last_clean":"2024-04-17T19:47:38.681917+0000","last_became_active":"2024-04-17T19:46:56.683685+0000","last_became_peered":"2024-04-17T19:46:56.683685+0000","last_unstale":"2024-04-17T19:47:38.681917+0000","last_undegraded":"2024-04-17T19:47:38.681917+0000","last_fullsized":"2024-04-17T19:47:38.681917+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_clean_scrub_stamp":"2024-04-17T19:46:55.648649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T02:52:38.425163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"27'4","reported_seq":31,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:39.942230+0000","last_change":"2024-04-17T19:46:55.687311+0000","last_active":"2024-04-17T19:47:39.942230+0000","last_peered":"2024-04-17T19:47:39.942230+0000","last_clean":"2024-04-17T19:47:39.942230+0000","last_became_active":"2024-04-17T19:46:55.687019+0000","last_became_peered":"2024-04-17T19:46:55.687019+0000","last_unstale":"2024-04-17T19:47:39.942230+0000","last_undegraded":"2024-04-17T19:47:39.942230+0000","last_fullsized":"2024-04-17T19:47:39.942230+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:54.640133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:54.640133+0000","last_clean_scrub_stamp":"2024-04-17T19:46:54.640133+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T01:53:38.377482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:37.965677+0000","last_change":"2024-04-17T19:47:00.780072+0000","last_active":"2024-04-17T19:47:37.965677+0000","last_peered":"2024-04-17T19:47:37.965677+0000","last_clean":"2024-04-17T19:47:37.965677+0000","last_became_active":"2024-04-17T19:47:00.777053+0000","last_became_peered":"2024-04-17T19:47:00.777053+0000","last_unstale":"2024-04-17T19:47:37.965677+0000","last_undegraded":"2024-04-17T19:47:37.965677+0000","last_fullsized":"2024-04-17T19:47:37.965677+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_clean_scrub_stamp":"2024-04-17T19:46:59.695482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T22:01:53.910725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,3,2],"acting":[7,1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:37.956396+0000","last_change":"2024-04-17T19:46:56.692985+0000","last_active":"2024-04-17T19:47:37.956396+0000","last_peered":"2024-04-17T19:47:37.956396+0000","last_clean":"2024-04-17T19:47:37.956396+0000","last_became_active":"2024-04-17T19:46:56.692287+0000","last_became_peered":"2024-04-17T19:46:56.692287+0000","last_unstale":"2024-04-17T19:47:37.956396+0000","last_undegraded":"2024-04-17T19:47:37.956396+0000","last_fullsized":"2024-04-17T19:47:37.956396+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_clean_scrub_stamp":"2024-04-17T19:46:55.648649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:20:50.341776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.17","version":"27'5","reported_seq":32,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:49:22.983650+0000","last_change":"2024-04-17T19:46:55.691681+0000","last_active":"2024-04-17T19:49:22.983650+0000","last_peered":"2024-04-17T19:49:22.983650+0000","last_clean":"2024-04-17T19:49:22.983650+0000","last_became_active":"2024-04-17T19:46:55.691354+0000","last_became_peered":"2024-04-17T19:46:55.691354+0000","last_unstale":"2024-04-17T19:49:22.983650+0000","last_undegraded":"2024-04-17T19:49:22.983650+0000","last_fullsized":"2024-04-17T19:49:22.983650+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:54.640133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:54.640133+0000","last_clean_scrub_stamp":"2024-04-17T19:46:54.640133+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T00:40:58.757373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:37.957709+0000","last_change":"2024-04-17T19:47:00.764854+0000","last_active":"2024-04-17T19:47:37.957709+0000","last_peered":"2024-04-17T19:47:37.957709+0000","last_clean":"2024-04-17T19:47:37.957709+0000","last_became_active":"2024-04-17T19:47:00.763550+0000","last_became_peered":"2024-04-17T19:47:00.763550+0000","last_unstale":"2024-04-17T19:47:37.957709+0000","last_undegraded":"2024-04-17T19:47:37.957709+0000","last_fullsized":"2024-04-17T19:47:37.957709+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_clean_scrub_stamp":"2024-04-17T19:46:59.695482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T04:26:38.527427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,3,7],"acting":[4,0,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:37.959252+0000","last_change":"2024-04-17T19:47:00.746028+0000","last_active":"2024-04-17T19:47:37.959252+0000","last_peered":"2024-04-17T19:47:37.959252+0000","last_clean":"2024-04-17T19:47:37.959252+0000","last_became_active":"2024-04-17T19:47:00.744828+0000","last_became_peered":"2024-04-17T19:47:00.744828+0000","last_unstale":"2024-04-17T19:47:37.959252+0000","last_undegraded":"2024-04-17T19:47:37.959252+0000","last_fullsized":"2024-04-17T19:47:37.959252+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_clean_scrub_stamp":"2024-04-17T19:46:59.695482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T22:37:58.836823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,5,3],"acting":[4,1,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:37.957762+0000","last_change":"2024-04-17T19:46:56.691650+0000","last_active":"2024-04-17T19:47:37.957762+0000","last_peered":"2024-04-17T19:47:37.957762+0000","last_clean":"2024-04-17T19:47:37.957762+0000","last_became_active":"2024-04-17T19:46:56.690810+0000","last_became_peered":"2024-04-17T19:46:56.690810+0000","last_unstale":"2024-04-17T19:47:37.957762+0000","last_undegraded":"2024-04-17T19:47:37.957762+0000","last_fullsized":"2024-04-17T19:47:37.957762+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_clean_scrub_stamp":"2024-04-17T19:46:55.648649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T04:25:07.123916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.18","version":"27'3","reported_seq":30,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:39.944726+0000","last_change":"2024-04-17T19:46:55.691871+0000","last_active":"2024-04-17T19:47:39.944726+0000","last_peered":"2024-04-17T19:47:39.944726+0000","last_clean":"2024-04-17T19:47:39.944726+0000","last_became_active":"2024-04-17T19:46:55.690539+0000","last_became_peered":"2024-04-17T19:46:55.690539+0000","last_unstale":"2024-04-17T19:47:39.944726+0000","last_undegraded":"2024-04-17T19:47:39.944726+0000","last_fullsized":"2024-04-17T19:47:39.944726+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:54.640133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:54.640133+0000","last_clean_scrub_stamp":"2024-04-17T19:46:54.640133+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T04:52:16.008572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:38.474111+0000","last_change":"2024-04-17T19:47:00.749616+0000","last_active":"2024-04-17T19:47:38.474111+0000","last_peered":"2024-04-17T19:47:38.474111+0000","last_clean":"2024-04-17T19:47:38.474111+0000","last_became_active":"2024-04-17T19:47:00.749061+0000","last_became_peered":"2024-04-17T19:47:00.749061+0000","last_unstale":"2024-04-17T19:47:38.474111+0000","last_undegraded":"2024-04-17T19:47:38.474111+0000","last_fullsized":"2024-04-17T19:47:38.474111+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_clean_scrub_stamp":"2024-04-17T19:46:59.695482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:33:36.676817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5,1],"acting":[3,2,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:38.680110+0000","last_change":"2024-04-17T19:46:56.692190+0000","last_active":"2024-04-17T19:47:38.680110+0000","last_peered":"2024-04-17T19:47:38.680110+0000","last_clean":"2024-04-17T19:47:38.680110+0000","last_became_active":"2024-04-17T19:46:56.691524+0000","last_became_peered":"2024-04-17T19:46:56.691524+0000","last_unstale":"2024-04-17T19:47:38.680110+0000","last_undegraded":"2024-04-17T19:47:38.680110+0000","last_fullsized":"2024-04-17T19:47:38.680110+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_clean_scrub_stamp":"2024-04-17T19:46:55.648649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:44:38.787541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"27'3","reported_seq":30,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:39.942240+0000","last_change":"2024-04-17T19:46:55.700265+0000","last_active":"2024-04-17T19:47:39.942240+0000","last_peered":"2024-04-17T19:47:39.942240+0000","last_clean":"2024-04-17T19:47:39.942240+0000","last_became_active":"2024-04-17T19:46:55.699166+0000","last_became_peered":"2024-04-17T19:46:55.699166+0000","last_unstale":"2024-04-17T19:47:39.942240+0000","last_undegraded":"2024-04-17T19:47:39.942240+0000","last_fullsized":"2024-04-17T19:47:39.942240+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:54.640133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:54.640133+0000","last_clean_scrub_stamp":"2024-04-17T19:46:54.640133+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T02:39:08.241534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"25'7","reported_seq":34,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:38.473233+0000","last_change":"2024-04-17T19:46:55.687779+0000","last_active":"2024-04-17T19:47:38.473233+0000","last_peered":"2024-04-17T19:47:38.473233+0000","last_clean":"2024-04-17T19:47:38.473233+0000","last_became_active":"2024-04-17T19:46:55.687401+0000","last_became_peered":"2024-04-17T19:46:55.687401+0000","last_unstale":"2024-04-17T19:47:38.473233+0000","last_undegraded":"2024-04-17T19:47:38.473233+0000","last_fullsized":"2024-04-17T19:47:38.473233+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:54.640133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:54.640133+0000","last_clean_scrub_stamp":"2024-04-17T19:46:54.640133+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:20:49.333260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:37.956708+0000","last_change":"2024-04-17T19:46:56.691635+0000","last_active":"2024-04-17T19:47:37.956708+0000","last_peered":"2024-04-17T19:47:37.956708+0000","last_clean":"2024-04-17T19:47:37.956708+0000","last_became_active":"2024-04-17T19:46:56.691199+0000","last_became_peered":"2024-04-17T19:46:56.691199+0000","last_unstale":"2024-04-17T19:47:37.956708+0000","last_undegraded":"2024-04-17T19:47:37.956708+0000","last_fullsized":"2024-04-17T19:47:37.956708+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_clean_scrub_stamp":"2024-04-17T19:46:55.648649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:00:10.859769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:37.960909+0000","last_change":"2024-04-17T19:47:00.776142+0000","last_active":"2024-04-17T19:47:37.960909+0000","last_peered":"2024-04-17T19:47:37.960909+0000","last_clean":"2024-04-17T19:47:37.960909+0000","last_became_active":"2024-04-17T19:47:00.774592+0000","last_became_peered":"2024-04-17T19:47:00.774592+0000","last_unstale":"2024-04-17T19:47:37.960909+0000","last_undegraded":"2024-04-17T19:47:37.960909+0000","last_fullsized":"2024-04-17T19:47:37.960909+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_clean_scrub_stamp":"2024-04-17T19:46:59.695482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:04:03.656402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,7],"acting":[4,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"25'5","reported_seq":32,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:38.680757+0000","last_change":"2024-04-17T19:46:55.713656+0000","last_active":"2024-04-17T19:47:38.680757+0000","last_peered":"2024-04-17T19:47:38.680757+0000","last_clean":"2024-04-17T19:47:38.680757+0000","last_became_active":"2024-04-17T19:46:55.712982+0000","last_became_peered":"2024-04-17T19:46:55.712982+0000","last_unstale":"2024-04-17T19:47:38.680757+0000","last_undegraded":"2024-04-17T19:47:38.680757+0000","last_fullsized":"2024-04-17T19:47:38.680757+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:54.640133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:54.640133+0000","last_clean_scrub_stamp":"2024-04-17T19:46:54.640133+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:02:52.057635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:38.680240+0000","last_change":"2024-04-17T19:46:56.681984+0000","last_active":"2024-04-17T19:47:38.680240+0000","last_peered":"2024-04-17T19:47:38.680240+0000","last_clean":"2024-04-17T19:47:38.680240+0000","last_became_active":"2024-04-17T19:46:56.679830+0000","last_became_peered":"2024-04-17T19:46:56.679830+0000","last_unstale":"2024-04-17T19:47:38.680240+0000","last_undegraded":"2024-04-17T19:47:38.680240+0000","last_fullsized":"2024-04-17T19:47:38.680240+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_clean_scrub_stamp":"2024-04-17T19:46:55.648649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:11:01.745657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:37.967233+0000","last_change":"2024-04-17T19:47:00.777411+0000","last_active":"2024-04-17T19:47:37.967233+0000","last_peered":"2024-04-17T19:47:37.967233+0000","last_clean":"2024-04-17T19:47:37.967233+0000","last_became_active":"2024-04-17T19:47:00.776357+0000","last_became_peered":"2024-04-17T19:47:00.776357+0000","last_unstale":"2024-04-17T19:47:37.967233+0000","last_undegraded":"2024-04-17T19:47:37.967233+0000","last_fullsized":"2024-04-17T19:47:37.967233+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_clean_scrub_stamp":"2024-04-17T19:46:59.695482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:41:22.030097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,1,0],"acting":[7,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:37.955184+0000","last_change":"2024-04-17T19:46:56.706021+0000","last_active":"2024-04-17T19:47:37.955184+0000","last_peered":"2024-04-17T19:47:37.955184+0000","last_clean":"2024-04-17T19:47:37.955184+0000","last_became_active":"2024-04-17T19:46:56.702724+0000","last_became_peered":"2024-04-17T19:46:56.702724+0000","last_unstale":"2024-04-17T19:47:37.955184+0000","last_undegraded":"2024-04-17T19:47:37.955184+0000","last_fullsized":"2024-04-17T19:47:37.955184+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_clean_scrub_stamp":"2024-04-17T19:46:55.648649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:11:01.745657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:37.966196+0000","last_change":"2024-04-17T19:46:56.685239+0000","last_active":"2024-04-17T19:47:37.966196+0000","last_peered":"2024-04-17T19:47:37.966196+0000","last_clean":"2024-04-17T19:47:37.966196+0000","last_became_active":"2024-04-17T19:46:56.684771+0000","last_became_peered":"2024-04-17T19:46:56.684771+0000","last_unstale":"2024-04-17T19:47:37.966196+0000","last_undegraded":"2024-04-17T19:47:37.966196+0000","last_fullsized":"2024-04-17T19:47:37.966196+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_clean_scrub_stamp":"2024-04-17T19:46:55.648649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T04:52:17.017088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:38.472926+0000","last_change":"2024-04-17T19:46:56.686238+0000","last_active":"2024-04-17T19:47:38.472926+0000","last_peered":"2024-04-17T19:47:38.472926+0000","last_clean":"2024-04-17T19:47:38.472926+0000","last_became_active":"2024-04-17T19:46:56.685745+0000","last_became_peered":"2024-04-17T19:46:56.685745+0000","last_unstale":"2024-04-17T19:47:38.472926+0000","last_undegraded":"2024-04-17T19:47:38.472926+0000","last_fullsized":"2024-04-17T19:47:38.472926+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_clean_scrub_stamp":"2024-04-17T19:46:55.648649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:01:01.006486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:38.680630+0000","last_change":"2024-04-17T19:46:56.675844+0000","last_active":"2024-04-17T19:47:38.680630+0000","last_peered":"2024-04-17T19:47:38.680630+0000","last_clean":"2024-04-17T19:47:38.680630+0000","last_became_active":"2024-04-17T19:46:56.675519+0000","last_became_peered":"2024-04-17T19:46:56.675519+0000","last_unstale":"2024-04-17T19:47:38.680630+0000","last_undegraded":"2024-04-17T19:47:38.680630+0000","last_fullsized":"2024-04-17T19:47:38.680630+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_clean_scrub_stamp":"2024-04-17T19:46:55.648649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T00:46:07.348168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:37.961362+0000","last_change":"2024-04-17T19:46:56.699663+0000","last_active":"2024-04-17T19:47:37.961362+0000","last_peered":"2024-04-17T19:47:37.961362+0000","last_clean":"2024-04-17T19:47:37.961362+0000","last_became_active":"2024-04-17T19:46:56.699293+0000","last_became_peered":"2024-04-17T19:46:56.699293+0000","last_unstale":"2024-04-17T19:47:37.961362+0000","last_undegraded":"2024-04-17T19:47:37.961362+0000","last_fullsized":"2024-04-17T19:47:37.961362+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_clean_scrub_stamp":"2024-04-17T19:46:55.648649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T22:25:05.172498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:37.963458+0000","last_change":"2024-04-17T19:46:56.684368+0000","last_active":"2024-04-17T19:47:37.963458+0000","last_peered":"2024-04-17T19:47:37.963458+0000","last_clean":"2024-04-17T19:47:37.963458+0000","last_became_active":"2024-04-17T19:46:56.683963+0000","last_became_peered":"2024-04-17T19:46:56.683963+0000","last_unstale":"2024-04-17T19:47:37.963458+0000","last_undegraded":"2024-04-17T19:47:37.963458+0000","last_fullsized":"2024-04-17T19:47:37.963458+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_clean_scrub_stamp":"2024-04-17T19:46:55.648649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:41:17.983264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:37.956294+0000","last_change":"2024-04-17T19:46:56.704924+0000","last_active":"2024-04-17T19:47:37.956294+0000","last_peered":"2024-04-17T19:47:37.956294+0000","last_clean":"2024-04-17T19:47:37.956294+0000","last_became_active":"2024-04-17T19:46:56.692688+0000","last_became_peered":"2024-04-17T19:46:56.692688+0000","last_unstale":"2024-04-17T19:47:37.956294+0000","last_undegraded":"2024-04-17T19:47:37.956294+0000","last_fullsized":"2024-04-17T19:47:37.956294+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_clean_scrub_stamp":"2024-04-17T19:46:55.648649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T01:39:33.595213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:38.681508+0000","last_change":"2024-04-17T19:46:56.685081+0000","last_active":"2024-04-17T19:47:38.681508+0000","last_peered":"2024-04-17T19:47:38.681508+0000","last_clean":"2024-04-17T19:47:38.681508+0000","last_became_active":"2024-04-17T19:46:56.684714+0000","last_became_peered":"2024-04-17T19:46:56.684714+0000","last_unstale":"2024-04-17T19:47:38.681508+0000","last_undegraded":"2024-04-17T19:47:38.681508+0000","last_fullsized":"2024-04-17T19:47:38.681508+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_clean_scrub_stamp":"2024-04-17T19:46:55.648649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T04:26:34.480594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:38.472779+0000","last_change":"2024-04-17T19:46:56.681089+0000","last_active":"2024-04-17T19:47:38.472779+0000","last_peered":"2024-04-17T19:47:38.472779+0000","last_clean":"2024-04-17T19:47:38.472779+0000","last_became_active":"2024-04-17T19:46:56.679818+0000","last_became_peered":"2024-04-17T19:46:56.679818+0000","last_unstale":"2024-04-17T19:47:38.472779+0000","last_undegraded":"2024-04-17T19:47:38.472779+0000","last_fullsized":"2024-04-17T19:47:38.472779+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_clean_scrub_stamp":"2024-04-17T19:46:55.648649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T01:32:52.608291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:38.680542+0000","last_change":"2024-04-17T19:46:56.674556+0000","last_active":"2024-04-17T19:47:38.680542+0000","last_peered":"2024-04-17T19:47:38.680542+0000","last_clean":"2024-04-17T19:47:38.680542+0000","last_became_active":"2024-04-17T19:46:56.674164+0000","last_became_peered":"2024-04-17T19:46:56.674164+0000","last_unstale":"2024-04-17T19:47:38.680542+0000","last_undegraded":"2024-04-17T19:47:38.680542+0000","last_fullsized":"2024-04-17T19:47:38.680542+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_clean_scrub_stamp":"2024-04-17T19:46:55.648649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T22:53:45.664676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:38.680145+0000","last_change":"2024-04-17T19:46:56.697359+0000","last_active":"2024-04-17T19:47:38.680145+0000","last_peered":"2024-04-17T19:47:38.680145+0000","last_clean":"2024-04-17T19:47:38.680145+0000","last_became_active":"2024-04-17T19:46:56.695255+0000","last_became_peered":"2024-04-17T19:46:56.695255+0000","last_unstale":"2024-04-17T19:47:38.680145+0000","last_undegraded":"2024-04-17T19:47:38.680145+0000","last_fullsized":"2024-04-17T19:47:38.680145+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_clean_scrub_stamp":"2024-04-17T19:46:55.648649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T01:53:39.385998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:37.956606+0000","last_change":"2024-04-17T19:46:56.692366+0000","last_active":"2024-04-17T19:47:37.956606+0000","last_peered":"2024-04-17T19:47:37.956606+0000","last_clean":"2024-04-17T19:47:37.956606+0000","last_became_active":"2024-04-17T19:46:56.691942+0000","last_became_peered":"2024-04-17T19:46:56.691942+0000","last_unstale":"2024-04-17T19:47:37.956606+0000","last_undegraded":"2024-04-17T19:47:37.956606+0000","last_fullsized":"2024-04-17T19:47:37.956606+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_clean_scrub_stamp":"2024-04-17T19:46:55.648649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T02:34:05.358659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:37.959208+0000","last_change":"2024-04-17T19:46:56.693507+0000","last_active":"2024-04-17T19:47:37.959208+0000","last_peered":"2024-04-17T19:47:37.959208+0000","last_clean":"2024-04-17T19:47:37.959208+0000","last_became_active":"2024-04-17T19:46:56.691938+0000","last_became_peered":"2024-04-17T19:46:56.691938+0000","last_unstale":"2024-04-17T19:47:37.959208+0000","last_undegraded":"2024-04-17T19:47:37.959208+0000","last_fullsized":"2024-04-17T19:47:37.959208+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_clean_scrub_stamp":"2024-04-17T19:46:55.648649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T04:48:43.769985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:38.473958+0000","last_change":"2024-04-17T19:46:56.700707+0000","last_active":"2024-04-17T19:47:38.473958+0000","last_peered":"2024-04-17T19:47:38.473958+0000","last_clean":"2024-04-17T19:47:38.473958+0000","last_became_active":"2024-04-17T19:46:56.700346+0000","last_became_peered":"2024-04-17T19:46:56.700346+0000","last_unstale":"2024-04-17T19:47:38.473958+0000","last_undegraded":"2024-04-17T19:47:38.473958+0000","last_fullsized":"2024-04-17T19:47:38.473958+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_clean_scrub_stamp":"2024-04-17T19:46:55.648649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:58:35.976326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:37.968012+0000","last_change":"2024-04-17T19:46:56.705410+0000","last_active":"2024-04-17T19:47:37.968012+0000","last_peered":"2024-04-17T19:47:37.968012+0000","last_clean":"2024-04-17T19:47:37.968012+0000","last_became_active":"2024-04-17T19:46:56.705076+0000","last_became_peered":"2024-04-17T19:46:56.705076+0000","last_unstale":"2024-04-17T19:47:37.968012+0000","last_undegraded":"2024-04-17T19:47:37.968012+0000","last_fullsized":"2024-04-17T19:47:37.968012+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_clean_scrub_stamp":"2024-04-17T19:46:55.648649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T01:53:39.385998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:38.474246+0000","last_change":"2024-04-17T19:46:56.697436+0000","last_active":"2024-04-17T19:47:38.474246+0000","last_peered":"2024-04-17T19:47:38.474246+0000","last_clean":"2024-04-17T19:47:38.474246+0000","last_became_active":"2024-04-17T19:46:56.696667+0000","last_became_peered":"2024-04-17T19:46:56.696667+0000","last_unstale":"2024-04-17T19:47:38.474246+0000","last_undegraded":"2024-04-17T19:47:38.474246+0000","last_fullsized":"2024-04-17T19:47:38.474246+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_clean_scrub_stamp":"2024-04-17T19:46:55.648649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:54:05.520742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:38.472663+0000","last_change":"2024-04-17T19:46:56.680847+0000","last_active":"2024-04-17T19:47:38.472663+0000","last_peered":"2024-04-17T19:47:38.472663+0000","last_clean":"2024-04-17T19:47:38.472663+0000","last_became_active":"2024-04-17T19:46:56.680224+0000","last_became_peered":"2024-04-17T19:46:56.680224+0000","last_unstale":"2024-04-17T19:47:38.472663+0000","last_undegraded":"2024-04-17T19:47:38.472663+0000","last_fullsized":"2024-04-17T19:47:38.472663+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_clean_scrub_stamp":"2024-04-17T19:46:55.648649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T04:48:43.769985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:38.680177+0000","last_change":"2024-04-17T19:46:56.688647+0000","last_active":"2024-04-17T19:47:38.680177+0000","last_peered":"2024-04-17T19:47:38.680177+0000","last_clean":"2024-04-17T19:47:38.680177+0000","last_became_active":"2024-04-17T19:46:56.688294+0000","last_became_peered":"2024-04-17T19:46:56.688294+0000","last_unstale":"2024-04-17T19:47:38.680177+0000","last_undegraded":"2024-04-17T19:47:38.680177+0000","last_fullsized":"2024-04-17T19:47:38.680177+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_clean_scrub_stamp":"2024-04-17T19:46:55.648649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T02:34:05.358659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.32","version":"27'1","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:49:17.990239+0000","last_change":"2024-04-17T19:46:56.686415+0000","last_active":"2024-04-17T19:49:17.990239+0000","last_peered":"2024-04-17T19:49:17.990239+0000","last_clean":"2024-04-17T19:49:17.990239+0000","last_became_active":"2024-04-17T19:46:56.684639+0000","last_became_peered":"2024-04-17T19:46:56.684639+0000","last_unstale":"2024-04-17T19:49:17.990239+0000","last_undegraded":"2024-04-17T19:49:17.990239+0000","last_fullsized":"2024-04-17T19:49:17.990239+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_clean_scrub_stamp":"2024-04-17T19:46:55.648649+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:20:50.341776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:37.960115+0000","last_change":"2024-04-17T19:46:56.694678+0000","last_active":"2024-04-17T19:47:37.960115+0000","last_peered":"2024-04-17T19:47:37.960115+0000","last_clean":"2024-04-17T19:47:37.960115+0000","last_became_active":"2024-04-17T19:46:56.694213+0000","last_became_peered":"2024-04-17T19:46:56.694213+0000","last_unstale":"2024-04-17T19:47:37.960115+0000","last_undegraded":"2024-04-17T19:47:37.960115+0000","last_fullsized":"2024-04-17T19:47:37.960115+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_clean_scrub_stamp":"2024-04-17T19:46:55.648649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:59:17.441539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:37.959176+0000","last_change":"2024-04-17T19:46:56.693810+0000","last_active":"2024-04-17T19:47:37.959176+0000","last_peered":"2024-04-17T19:47:37.959176+0000","last_clean":"2024-04-17T19:47:37.959176+0000","last_became_active":"2024-04-17T19:46:56.692874+0000","last_became_peered":"2024-04-17T19:46:56.692874+0000","last_unstale":"2024-04-17T19:47:37.959176+0000","last_undegraded":"2024-04-17T19:47:37.959176+0000","last_fullsized":"2024-04-17T19:47:37.959176+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_clean_scrub_stamp":"2024-04-17T19:46:55.648649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:30:27.241267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:37.959681+0000","last_change":"2024-04-17T19:46:56.700330+0000","last_active":"2024-04-17T19:47:37.959681+0000","last_peered":"2024-04-17T19:47:37.959681+0000","last_clean":"2024-04-17T19:47:37.959681+0000","last_became_active":"2024-04-17T19:46:56.700013+0000","last_became_peered":"2024-04-17T19:46:56.700013+0000","last_unstale":"2024-04-17T19:47:37.959681+0000","last_undegraded":"2024-04-17T19:47:37.959681+0000","last_fullsized":"2024-04-17T19:47:37.959681+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_clean_scrub_stamp":"2024-04-17T19:46:55.648649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:23:16.383918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:37.959828+0000","last_change":"2024-04-17T19:46:56.709400+0000","last_active":"2024-04-17T19:47:37.959828+0000","last_peered":"2024-04-17T19:47:37.959828+0000","last_clean":"2024-04-17T19:47:37.959828+0000","last_became_active":"2024-04-17T19:46:56.708606+0000","last_became_peered":"2024-04-17T19:46:56.708606+0000","last_unstale":"2024-04-17T19:47:37.959828+0000","last_undegraded":"2024-04-17T19:47:37.959828+0000","last_fullsized":"2024-04-17T19:47:37.959828+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_clean_scrub_stamp":"2024-04-17T19:46:55.648649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T01:46:36.503198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:38.680713+0000","last_change":"2024-04-17T19:46:56.681267+0000","last_active":"2024-04-17T19:47:38.680713+0000","last_peered":"2024-04-17T19:47:38.680713+0000","last_clean":"2024-04-17T19:47:38.680713+0000","last_became_active":"2024-04-17T19:46:56.680919+0000","last_became_peered":"2024-04-17T19:46:56.680919+0000","last_unstale":"2024-04-17T19:47:38.680713+0000","last_undegraded":"2024-04-17T19:47:38.680713+0000","last_fullsized":"2024-04-17T19:47:38.680713+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_clean_scrub_stamp":"2024-04-17T19:46:55.648649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T01:39:33.595213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:38.679990+0000","last_change":"2024-04-17T19:46:56.688682+0000","last_active":"2024-04-17T19:47:38.679990+0000","last_peered":"2024-04-17T19:47:38.679990+0000","last_clean":"2024-04-17T19:47:38.679990+0000","last_became_active":"2024-04-17T19:46:56.688320+0000","last_became_peered":"2024-04-17T19:46:56.688320+0000","last_unstale":"2024-04-17T19:47:38.679990+0000","last_undegraded":"2024-04-17T19:47:38.679990+0000","last_fullsized":"2024-04-17T19:47:38.679990+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_clean_scrub_stamp":"2024-04-17T19:46:55.648649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:00:10.859769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:37.958884+0000","last_change":"2024-04-17T19:46:56.699129+0000","last_active":"2024-04-17T19:47:37.958884+0000","last_peered":"2024-04-17T19:47:37.958884+0000","last_clean":"2024-04-17T19:47:37.958884+0000","last_became_active":"2024-04-17T19:46:56.698840+0000","last_became_peered":"2024-04-17T19:46:56.698840+0000","last_unstale":"2024-04-17T19:47:37.958884+0000","last_undegraded":"2024-04-17T19:47:37.958884+0000","last_fullsized":"2024-04-17T19:47:37.958884+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_clean_scrub_stamp":"2024-04-17T19:46:55.648649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T05:35:47.746622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:37.955456+0000","last_change":"2024-04-17T19:46:56.705903+0000","last_active":"2024-04-17T19:47:37.955456+0000","last_peered":"2024-04-17T19:47:37.955456+0000","last_clean":"2024-04-17T19:47:37.955456+0000","last_became_active":"2024-04-17T19:46:56.705539+0000","last_became_peered":"2024-04-17T19:46:56.705539+0000","last_unstale":"2024-04-17T19:47:37.955456+0000","last_undegraded":"2024-04-17T19:47:37.955456+0000","last_fullsized":"2024-04-17T19:47:37.955456+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_clean_scrub_stamp":"2024-04-17T19:46:55.648649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:57:40.700986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:37.959075+0000","last_change":"2024-04-17T19:46:56.694456+0000","last_active":"2024-04-17T19:47:37.959075+0000","last_peered":"2024-04-17T19:47:37.959075+0000","last_clean":"2024-04-17T19:47:37.959075+0000","last_became_active":"2024-04-17T19:46:56.693954+0000","last_became_peered":"2024-04-17T19:46:56.693954+0000","last_unstale":"2024-04-17T19:47:37.959075+0000","last_undegraded":"2024-04-17T19:47:37.959075+0000","last_fullsized":"2024-04-17T19:47:37.959075+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_clean_scrub_stamp":"2024-04-17T19:46:55.648649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:22:33.413402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:37.955652+0000","last_change":"2024-04-17T19:46:56.706411+0000","last_active":"2024-04-17T19:47:37.955652+0000","last_peered":"2024-04-17T19:47:37.955652+0000","last_clean":"2024-04-17T19:47:37.955652+0000","last_became_active":"2024-04-17T19:46:56.706021+0000","last_became_peered":"2024-04-17T19:46:56.706021+0000","last_unstale":"2024-04-17T19:47:37.955652+0000","last_undegraded":"2024-04-17T19:47:37.955652+0000","last_fullsized":"2024-04-17T19:47:37.955652+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_clean_scrub_stamp":"2024-04-17T19:46:55.648649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T05:52:33.559392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:38.681189+0000","last_change":"2024-04-17T19:46:56.696930+0000","last_active":"2024-04-17T19:47:38.681189+0000","last_peered":"2024-04-17T19:47:38.681189+0000","last_clean":"2024-04-17T19:47:38.681189+0000","last_became_active":"2024-04-17T19:46:56.696492+0000","last_became_peered":"2024-04-17T19:46:56.696492+0000","last_unstale":"2024-04-17T19:47:38.681189+0000","last_undegraded":"2024-04-17T19:47:38.681189+0000","last_fullsized":"2024-04-17T19:47:38.681189+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_clean_scrub_stamp":"2024-04-17T19:46:55.648649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:43:54.268148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:38.681148+0000","last_change":"2024-04-17T19:46:56.683448+0000","last_active":"2024-04-17T19:47:38.681148+0000","last_peered":"2024-04-17T19:47:38.681148+0000","last_clean":"2024-04-17T19:47:38.681148+0000","last_became_active":"2024-04-17T19:46:56.682772+0000","last_became_peered":"2024-04-17T19:46:56.682772+0000","last_unstale":"2024-04-17T19:47:38.681148+0000","last_undegraded":"2024-04-17T19:47:38.681148+0000","last_fullsized":"2024-04-17T19:47:38.681148+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_clean_scrub_stamp":"2024-04-17T19:46:55.648649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T22:39:31.496708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:37.960452+0000","last_change":"2024-04-17T19:46:56.695275+0000","last_active":"2024-04-17T19:47:37.960452+0000","last_peered":"2024-04-17T19:47:37.960452+0000","last_clean":"2024-04-17T19:47:37.960452+0000","last_became_active":"2024-04-17T19:46:56.694743+0000","last_became_peered":"2024-04-17T19:46:56.694743+0000","last_unstale":"2024-04-17T19:47:37.960452+0000","last_undegraded":"2024-04-17T19:47:37.960452+0000","last_fullsized":"2024-04-17T19:47:37.960452+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_clean_scrub_stamp":"2024-04-17T19:46:55.648649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:01:01.006486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1,"ondisk_log_size":1,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":44428,"num_objects":99,"num_object_clones":0,"num_object_copies":198,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":99,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":252,"num_write_kb":123,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":335872,"data_stored":88856,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":222,"ondisk_log_size":222,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":66496,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509485,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27332,"kb_used_data":316,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344508,"statfs":{"total":96636764160,"available":96608776192,"internally_reserved":0,"allocated":323584,"data_stored":117072,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509486,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27312,"kb_used_data":296,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344528,"statfs":{"total":96636764160,"available":96608796672,"internally_reserved":0,"allocated":303104,"data_stored":118244,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509486,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27336,"kb_used_data":320,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344504,"statfs":{"total":96636764160,"available":96608772096,"internally_reserved":0,"allocated":327680,"data_stored":118328,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509486,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27344,"kb_used_data":328,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344496,"statfs":{"total":96636764160,"available":96608763904,"internally_reserved":0,"allocated":335872,"data_stored":153010,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509485,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27376,"kb_used_data":360,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344464,"statfs":{"total":96636764160,"available":96608731136,"internally_reserved":0,"allocated":368640,"data_stored":707388,"data_compressed":33248,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509485,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27328,"kb_used_data":312,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344512,"statfs":{"total":96636764160,"available":96608780288,"internally_reserved":0,"allocated":319488,"data_stored":118406,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574894,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27384,"kb_used_data":368,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344456,"statfs":{"total":96636764160,"available":96608722944,"internally_reserved":0,"allocated":376832,"data_stored":707212,"data_compressed":33248,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574894,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27380,"kb_used_data":364,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344460,"statfs":{"total":96636764160,"available":96608727040,"internally_reserved":0,"allocated":372736,"data_stored":154780,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33248,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33248,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":2800,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1414,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":37404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":2722,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":90112,"data_stored":39174,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1238,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":1466,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-17T19:50:16.965 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-17T19:50:17.159 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:17.167+0000 7f0e35200640 1 Processor -- start 2024-04-17T19:50:17.159 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:17.167+0000 7f0e35200640 1 -- start start 2024-04-17T19:50:17.161 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:17.171+0000 7f0e35200640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f0e30153db0 0x7f0e30073820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:50:17.161 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:17.171+0000 7f0e35200640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0e30159ad0 con 0x7f0e30073d60 2024-04-17T19:50:17.161 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:17.171+0000 7f0e35200640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0e30159db0 con 0x7f0e300c66d0 2024-04-17T19:50:17.161 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:17.171+0000 7f0e35200640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7f0e3015a090 con 0x7f0e30153db0 2024-04-17T19:50:17.161 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:17.171+0000 7f0e2e800640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f0e30073d60 0x7f0e300725b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:58988/0 (socket says 172.21.15.44:58988) 2024-04-17T19:50:17.161 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:17.171+0000 7f0e2e800640 1 -- 172.21.15.44:0/1659539271 learned_addr learned my addr 172.21.15.44:0/1659539271 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-04-17T19:50:17.161 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:17.171+0000 7f0e25400640 1 --2- 172.21.15.44:0/1659539271 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f0e30153db0 0x7f0e30073820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:50:17.163 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:17.171+0000 7f0e2d400640 1 -- 172.21.15.44:0/1659539271 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1207796460 0 0) 0x7f0e30159ad0 con 0x7f0e30073d60 2024-04-17T19:50:17.163 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:17.171+0000 7f0e2d400640 1 -- 172.21.15.44:0/1659539271 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0e14003530 con 0x7f0e30073d60 2024-04-17T19:50:17.163 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:17.171+0000 7f0e2d400640 1 -- 172.21.15.44:0/1659539271 <== mon.1 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1659002125 0 0) 0x7f0e30159db0 con 0x7f0e300c66d0 2024-04-17T19:50:17.163 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:17.171+0000 7f0e2d400640 1 -- 172.21.15.44:0/1659539271 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0e30159ad0 con 0x7f0e300c66d0 2024-04-17T19:50:17.164 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:17.171+0000 7f0e2d400640 1 -- 172.21.15.44:0/1659539271 <== mon.0 v1:172.21.15.44:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2163277997 0 0) 0x7f0e14003530 con 0x7f0e30073d60 2024-04-17T19:50:17.164 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:17.171+0000 7f0e2d400640 1 -- 172.21.15.44:0/1659539271 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f0e30153db0 msgr2=0x7f0e30073820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T19:50:17.164 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:17.171+0000 7f0e2d400640 1 --2- 172.21.15.44:0/1659539271 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f0e30153db0 0x7f0e30073820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:50:17.164 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:17.171+0000 7f0e2d400640 1 -- 172.21.15.44:0/1659539271 >> v1:172.21.15.62:6789/0 conn(0x7f0e300c66d0 legacy=0x7f0e301536a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:50:17.164 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:17.171+0000 7f0e2d400640 1 -- 172.21.15.44:0/1659539271 --> v1:172.21.15.44:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0e3015a370 con 0x7f0e30073d60 2024-04-17T19:50:17.164 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:17.171+0000 7f0e2d400640 1 -- 172.21.15.44:0/1659539271 <== mon.0 v1:172.21.15.44:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1863569991 0 0) 0x7f0e28001680 con 0x7f0e30073d60 2024-04-17T19:50:17.164 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:17.171+0000 7f0e25400640 1 --2- 172.21.15.44:0/1659539271 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f0e30153db0 0x7f0e30073820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-17T19:50:17.164 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:17.171+0000 7f0e2d400640 1 -- 172.21.15.44:0/1659539271 >> v1:172.21.15.44:6789/0 conn(0x7f0e30073d60 legacy=0x7f0e300725b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:50:17.164 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:17.171+0000 7f0e2d400640 1 --2- 172.21.15.44:0/1659539271 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f0e30153db0 0x7f0e14003b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:50:17.164 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:17.171+0000 7f0e2d400640 1 --2- 172.21.15.44:0/1659539271 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0e14004130 0x7f0e14004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:50:17.164 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:17.171+0000 7f0e2d400640 1 --2- 172.21.15.44:0/1659539271 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0e14004d50 0x7f0e140051a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:50:17.164 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:17.171+0000 7f0e2d400640 1 -- 172.21.15.44:0/1659539271 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f0e3015a090 con 0x7f0e14004130 2024-04-17T19:50:17.164 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:17.171+0000 7f0e2d400640 1 -- 172.21.15.44:0/1659539271 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f0e1400bb90 con 0x7f0e14004d50 2024-04-17T19:50:17.164 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:17.171+0000 7f0e2d400640 1 -- 172.21.15.44:0/1659539271 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7f0e1400bd90 con 0x7f0e30153db0 2024-04-17T19:50:17.164 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:17.171+0000 7f0e25400640 1 --2- 172.21.15.44:0/1659539271 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0e14004130 0x7f0e14004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:50:17.165 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:17.171+0000 7f0e2e800640 1 --2- 172.21.15.44:0/1659539271 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0e14004d50 0x7f0e140051a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:50:17.165 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:17.171+0000 7f0e2de00640 1 --2- 172.21.15.44:0/1659539271 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f0e30153db0 0x7f0e14003b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:50:17.165 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:17.171+0000 7f0e25400640 1 -- 172.21.15.44:0/1659539271 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f0e30153db0 msgr2=0x7f0e14003b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T19:50:17.165 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:17.171+0000 7f0e25400640 1 --2- 172.21.15.44:0/1659539271 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f0e30153db0 0x7f0e14003b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:50:17.165 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:17.171+0000 7f0e25400640 1 -- 172.21.15.44:0/1659539271 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0e14004d50 msgr2=0x7f0e140051a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T19:50:17.165 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:17.171+0000 7f0e25400640 1 --2- 172.21.15.44:0/1659539271 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0e14004d50 0x7f0e140051a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:50:17.165 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:17.171+0000 7f0e25400640 1 -- 172.21.15.44:0/1659539271 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0e14003530 con 0x7f0e14004130 2024-04-17T19:50:17.166 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:17.175+0000 7f0e25400640 1 --2- 172.21.15.44:0/1659539271 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0e14004130 0x7f0e14004810 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f0e18009c60 tx=0x7f0e1801cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e29ff3e3dc0da4db server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:50:17.166 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:17.175+0000 7f0e2d400640 1 -- 172.21.15.44:0/1659539271 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e18009860 con 0x7f0e14004130 2024-04-17T19:50:17.166 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:17.175+0000 7f0e2d400640 1 -- 172.21.15.44:0/1659539271 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0e18004030 con 0x7f0e14004130 2024-04-17T19:50:17.166 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:17.175+0000 7f0e2d400640 1 -- 172.21.15.44:0/1659539271 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e18004460 con 0x7f0e14004130 2024-04-17T19:50:17.167 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:17.175+0000 7f0e35200640 1 -- 172.21.15.44:0/1659539271 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0e14004130 msgr2=0x7f0e14004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:50:17.167 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:17.175+0000 7f0e35200640 1 --2- 172.21.15.44:0/1659539271 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0e14004130 0x7f0e14004810 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f0e18009c60 tx=0x7f0e1801cbf0 comp rx=0 tx=0).stop 2024-04-17T19:50:17.167 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:17.175+0000 7f0e2e800640 1 -- 172.21.15.44:0/1659539271 reap_dead start 2024-04-17T19:50:17.167 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:17.175+0000 7f0e35200640 1 -- 172.21.15.44:0/1659539271 shutdown_connections 2024-04-17T19:50:17.167 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:17.175+0000 7f0e35200640 1 -- 172.21.15.44:0/1659539271 >> 172.21.15.44:0/1659539271 conn(0x7f0e3006c380 msgr2=0x7f0e30070080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:50:17.167 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:17.175+0000 7f0e35200640 1 -- 172.21.15.44:0/1659539271 shutdown_connections 2024-04-17T19:50:17.167 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:17.175+0000 7f0e35200640 1 -- 172.21.15.44:0/1659539271 wait complete. 2024-04-17T19:50:17.169 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:17.179+0000 7f0e35200640 1 Processor -- start 2024-04-17T19:50:17.169 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:17.179+0000 7f0e35200640 1 -- start start 2024-04-17T19:50:17.171 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:17.179+0000 7f0e35200640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0e14004130 0x7f0e300c4a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:50:17.171 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:17.179+0000 7f0e35200640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f0e30157940 0x7f0e30155fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:50:17.171 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:17.179+0000 7f0e35200640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0e301594f0 0x7f0e30156510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:50:17.171 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:17.179+0000 7f0e35200640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f0e300c8710 con 0x7f0e301594f0 2024-04-17T19:50:17.171 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:17.179+0000 7f0e35200640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f0e30074170 con 0x7f0e14004130 2024-04-17T19:50:17.171 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:17.179+0000 7f0e35200640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7f0e300c8890 con 0x7f0e30157940 2024-04-17T19:50:17.172 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:17.179+0000 7f0e2e800640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0e301594f0 0x7f0e30156510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:50:17.172 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:17.179+0000 7f0e2e800640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0e301594f0 0x7f0e30156510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:46932/0 (socket says 172.21.15.44:46932) 2024-04-17T19:50:17.172 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:17.179+0000 7f0e2e800640 1 -- 172.21.15.44:0/579881381 learned_addr learned my addr 172.21.15.44:0/579881381 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-04-17T19:50:17.172 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:17.179+0000 7f0e2de00640 1 --2- 172.21.15.44:0/579881381 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0e14004130 0x7f0e300c4a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:50:17.172 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:17.179+0000 7f0e25400640 1 --2- 172.21.15.44:0/579881381 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f0e30157940 0x7f0e30155fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:50:17.172 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:17.179+0000 7f0e2e800640 1 -- 172.21.15.44:0/579881381 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f0e30157940 msgr2=0x7f0e30155fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:50:17.172 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:17.179+0000 7f0e2e800640 1 --2- 172.21.15.44:0/579881381 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f0e30157940 0x7f0e30155fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:50:17.172 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:17.179+0000 7f0e2e800640 1 -- 172.21.15.44:0/579881381 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0e14004130 msgr2=0x7f0e300c4a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:50:17.172 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:17.179+0000 7f0e2e800640 1 --2- 172.21.15.44:0/579881381 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0e14004130 0x7f0e300c4a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:50:17.172 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:17.179+0000 7f0e2e800640 1 -- 172.21.15.44:0/579881381 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0e30157350 con 0x7f0e301594f0 2024-04-17T19:50:17.172 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:17.179+0000 7f0e2e800640 1 --2- 172.21.15.44:0/579881381 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0e301594f0 0x7f0e30156510 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f0e3006cd40 tx=0x7f0e2800e9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:50:17.173 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:17.179+0000 7f0e26a00640 1 -- 172.21.15.44:0/579881381 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e28019070 con 0x7f0e301594f0 2024-04-17T19:50:17.173 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:17.179+0000 7f0e26a00640 1 -- 172.21.15.44:0/579881381 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0e28010510 con 0x7f0e301594f0 2024-04-17T19:50:17.173 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:17.179+0000 7f0e35200640 1 -- 172.21.15.44:0/579881381 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0e30144e00 con 0x7f0e301594f0 2024-04-17T19:50:17.173 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:17.179+0000 7f0e26a00640 1 -- 172.21.15.44:0/579881381 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e280108e0 con 0x7f0e301594f0 2024-04-17T19:50:17.173 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:17.179+0000 7f0e35200640 1 -- 172.21.15.44:0/579881381 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0e301f6140 con 0x7f0e301594f0 2024-04-17T19:50:17.173 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:17.183+0000 7f0e35200640 1 -- 172.21.15.44:0/579881381 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0e3004ff10 con 0x7f0e301594f0 2024-04-17T19:50:17.174 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:17.183+0000 7f0e26a00640 1 -- 172.21.15.44:0/579881381 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f0e2801c070 con 0x7f0e301594f0 2024-04-17T19:50:17.175 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:17.183+0000 7f0e26a00640 1 --2- 172.21.15.44:0/579881381 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f0e0c0683b0 0x7f0e0c06a8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:50:17.175 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:17.183+0000 7f0e26a00640 1 -- 172.21.15.44:0/579881381 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6619+0+0 (secure 0 0 0) 0x7f0e280861c0 con 0x7f0e301594f0 2024-04-17T19:50:17.175 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:17.183+0000 7f0e2de00640 1 --2- 172.21.15.44:0/579881381 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f0e0c0683b0 0x7f0e0c06a8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:50:17.176 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:17.187+0000 7f0e2de00640 1 --2- 172.21.15.44:0/579881381 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f0e0c0683b0 0x7f0e0c06a8c0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f0e20007e70 tx=0x7f0e20007530 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:50:17.179 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:17.187+0000 7f0e26a00640 1 -- 172.21.15.44:0/579881381 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f0e28055d00 con 0x7f0e301594f0 2024-04-17T19:50:17.347 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:17.355+0000 7f0e35200640 1 -- 172.21.15.44:0/579881381 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f0e3014d4a0 con 0x7f0e301594f0 2024-04-17T19:50:17.348 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:17.359+0000 7f0e26a00640 1 -- 172.21.15.44:0/579881381 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) ==== 74+0+18623 (secure 0 0 0) 0x7f0e2805a000 con 0x7f0e301594f0 2024-04-17T19:50:17.348 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-04-17T19:50:17.349 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":27,"fsid":"703f77ca-79c6-4a66-b576-62c526cb1021","created":"2024-04-17T19:46:30.831994+0000","modified":"2024-04-17T19:47:37.943331+0000","last_up_change":"2024-04-17T19:46:41.988197+0000","last_in_change":"2024-04-17T19:46:33.407430+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-17T19:46:41.940380+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-17T19:46:54.222150+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-17T19:46:55.031694+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-17T19:46:58.707529+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"30520dc6-eea6-43d4-ab60-3ca9e92329dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6800","nonce":1018735925},{"type":"v1","addr":"172.21.15.44:6801","nonce":1018735925}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6802","nonce":1018735925},{"type":"v1","addr":"172.21.15.44:6803","nonce":1018735925}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6806","nonce":1018735925},{"type":"v1","addr":"172.21.15.44:6807","nonce":1018735925}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6804","nonce":1018735925},{"type":"v1","addr":"172.21.15.44:6805","nonce":1018735925}]},"public_addr":"172.21.15.44:6801/1018735925","cluster_addr":"172.21.15.44:6803/1018735925","heartbeat_back_addr":"172.21.15.44:6807/1018735925","heartbeat_front_addr":"172.21.15.44:6805/1018735925","state":["exists","up"]},{"osd":1,"uuid":"079bd511-b6ce-449b-8f11-17b311b12f7c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6817","nonce":1452577434},{"type":"v1","addr":"172.21.15.44:6820","nonce":1452577434}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6823","nonce":1452577434},{"type":"v1","addr":"172.21.15.44:6825","nonce":1452577434}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6830","nonce":1452577434},{"type":"v1","addr":"172.21.15.44:6831","nonce":1452577434}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6828","nonce":1452577434},{"type":"v1","addr":"172.21.15.44:6829","nonce":1452577434}]},"public_addr":"172.21.15.44:6820/1452577434","cluster_addr":"172.21.15.44:6825/1452577434","heartbeat_back_addr":"172.21.15.44:6831/1452577434","heartbeat_front_addr":"172.21.15.44:6829/1452577434","state":["exists","up"]},{"osd":2,"uuid":"34f0b9ab-b1d2-4ee9-841c-f15afbb6bec5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6816","nonce":1160071918},{"type":"v1","addr":"172.21.15.44:6818","nonce":1160071918}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6819","nonce":1160071918},{"type":"v1","addr":"172.21.15.44:6821","nonce":1160071918}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6826","nonce":1160071918},{"type":"v1","addr":"172.21.15.44:6827","nonce":1160071918}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6822","nonce":1160071918},{"type":"v1","addr":"172.21.15.44:6824","nonce":1160071918}]},"public_addr":"172.21.15.44:6818/1160071918","cluster_addr":"172.21.15.44:6821/1160071918","heartbeat_back_addr":"172.21.15.44:6827/1160071918","heartbeat_front_addr":"172.21.15.44:6824/1160071918","state":["exists","up"]},{"osd":3,"uuid":"4740032d-fe34-4b1b-bb85-f430896fc3c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6808","nonce":4236454921},{"type":"v1","addr":"172.21.15.44:6809","nonce":4236454921}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6810","nonce":4236454921},{"type":"v1","addr":"172.21.15.44:6811","nonce":4236454921}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6814","nonce":4236454921},{"type":"v1","addr":"172.21.15.44:6815","nonce":4236454921}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6812","nonce":4236454921},{"type":"v1","addr":"172.21.15.44:6813","nonce":4236454921}]},"public_addr":"172.21.15.44:6809/4236454921","cluster_addr":"172.21.15.44:6811/4236454921","heartbeat_back_addr":"172.21.15.44:6815/4236454921","heartbeat_front_addr":"172.21.15.44:6813/4236454921","state":["exists","up"]},{"osd":4,"uuid":"7dbedb00-302d-4d52-810c-e18839254da1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6800","nonce":2293251376},{"type":"v1","addr":"172.21.15.62:6801","nonce":2293251376}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6802","nonce":2293251376},{"type":"v1","addr":"172.21.15.62:6803","nonce":2293251376}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6806","nonce":2293251376},{"type":"v1","addr":"172.21.15.62:6807","nonce":2293251376}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6804","nonce":2293251376},{"type":"v1","addr":"172.21.15.62:6805","nonce":2293251376}]},"public_addr":"172.21.15.62:6801/2293251376","cluster_addr":"172.21.15.62:6803/2293251376","heartbeat_back_addr":"172.21.15.62:6807/2293251376","heartbeat_front_addr":"172.21.15.62:6805/2293251376","state":["exists","up"]},{"osd":5,"uuid":"38c1e8d9-393d-4f33-a97a-3295cf5c5b07","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6808","nonce":1551020300},{"type":"v1","addr":"172.21.15.62:6809","nonce":1551020300}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6810","nonce":1551020300},{"type":"v1","addr":"172.21.15.62:6811","nonce":1551020300}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6814","nonce":1551020300},{"type":"v1","addr":"172.21.15.62:6815","nonce":1551020300}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6812","nonce":1551020300},{"type":"v1","addr":"172.21.15.62:6813","nonce":1551020300}]},"public_addr":"172.21.15.62:6809/1551020300","cluster_addr":"172.21.15.62:6811/1551020300","heartbeat_back_addr":"172.21.15.62:6815/1551020300","heartbeat_front_addr":"172.21.15.62:6813/1551020300","state":["exists","up"]},{"osd":6,"uuid":"f6ff81c6-f14d-4477-88e3-9116cc5a2992","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6824","nonce":2602310256},{"type":"v1","addr":"172.21.15.62:6825","nonce":2602310256}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6826","nonce":2602310256},{"type":"v1","addr":"172.21.15.62:6827","nonce":2602310256}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6830","nonce":2602310256},{"type":"v1","addr":"172.21.15.62:6831","nonce":2602310256}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6828","nonce":2602310256},{"type":"v1","addr":"172.21.15.62:6829","nonce":2602310256}]},"public_addr":"172.21.15.62:6825/2602310256","cluster_addr":"172.21.15.62:6827/2602310256","heartbeat_back_addr":"172.21.15.62:6831/2602310256","heartbeat_front_addr":"172.21.15.62:6829/2602310256","state":["exists","up"]},{"osd":7,"uuid":"ce395bc3-bcb5-4b94-a523-5bb9df491eca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6816","nonce":2912738359},{"type":"v1","addr":"172.21.15.62:6817","nonce":2912738359}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6818","nonce":2912738359},{"type":"v1","addr":"172.21.15.62:6819","nonce":2912738359}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6822","nonce":2912738359},{"type":"v1","addr":"172.21.15.62:6823","nonce":2912738359}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6820","nonce":2912738359},{"type":"v1","addr":"172.21.15.62:6821","nonce":2912738359}]},"public_addr":"172.21.15.62:6817/2912738359","cluster_addr":"172.21.15.62:6819/2912738359","heartbeat_back_addr":"172.21.15.62:6823/2912738359","heartbeat_front_addr":"172.21.15.62:6821/2912738359","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T19:46:39.302883+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T19:46:39.177705+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T19:46:39.188894+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T19:46:39.313009+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T19:46:38.870508+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T19:46:38.790900+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T19:46:38.979163+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T19:46:38.992348+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.c","mappings":[{"from":0,"to":4}]},{"pgid":"3.15","mappings":[{"from":0,"to":7}]},{"pgid":"4.f","mappings":[{"from":7,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-17T19:50:17.351 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:17.359+0000 7f0e35200640 1 -- 172.21.15.44:0/579881381 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f0e0c0683b0 msgr2=0x7f0e0c06a8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:50:17.351 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:17.359+0000 7f0e35200640 1 --2- 172.21.15.44:0/579881381 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f0e0c0683b0 0x7f0e0c06a8c0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f0e20007e70 tx=0x7f0e20007530 comp rx=0 tx=0).stop 2024-04-17T19:50:17.351 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:17.359+0000 7f0e35200640 1 -- 172.21.15.44:0/579881381 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0e301594f0 msgr2=0x7f0e30156510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:50:17.351 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:17.359+0000 7f0e35200640 1 --2- 172.21.15.44:0/579881381 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0e301594f0 0x7f0e30156510 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f0e3006cd40 tx=0x7f0e2800e9e0 comp rx=0 tx=0).stop 2024-04-17T19:50:17.351 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:17.359+0000 7f0e35200640 1 -- 172.21.15.44:0/579881381 shutdown_connections 2024-04-17T19:50:17.351 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:17.359+0000 7f0e35200640 1 --2- 172.21.15.44:0/579881381 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f0e0c0683b0 0x7f0e0c06a8c0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:50:17.351 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:17.359+0000 7f0e35200640 1 --2- 172.21.15.44:0/579881381 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f0e30157940 0x7f0e30155fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:50:17.351 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:17.359+0000 7f0e35200640 1 --2- 172.21.15.44:0/579881381 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0e301594f0 0x7f0e30156510 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:50:17.351 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:17.359+0000 7f0e35200640 1 --2- 172.21.15.44:0/579881381 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0e14004130 0x7f0e300c4a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:50:17.351 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:17.359+0000 7f0e35200640 1 -- 172.21.15.44:0/579881381 >> 172.21.15.44:0/579881381 conn(0x7f0e3006c380 msgr2=0x7f0e301467b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:50:17.351 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:17.359+0000 7f0e35200640 1 -- 172.21.15.44:0/579881381 shutdown_connections 2024-04-17T19:50:17.351 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:17.359+0000 7f0e35200640 1 -- 172.21.15.44:0/579881381 wait complete. 2024-04-17T19:50:18.372 INFO:tasks.ceph:Scrubbing osd.0 2024-04-17T19:50:18.372 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2024-04-17T19:50:18.540 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:18.551+0000 7fc42f400640 1 Processor -- start 2024-04-17T19:50:18.541 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:18.551+0000 7fc42f400640 1 -- start start 2024-04-17T19:50:18.542 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:18.551+0000 7fc42f400640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fc4280c83d0 0x7fc4280c4870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:50:18.542 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:18.551+0000 7fc42f400640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fc4280c4db0 0x7fc428162f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:50:18.542 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:18.551+0000 7fc42f400640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc4280c6c20 con 0x7fc4280c7fc0 2024-04-17T19:50:18.542 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:18.551+0000 7fc42f400640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 -- 0x7fc428152d20 con 0x7fc4280c83d0 2024-04-17T19:50:18.543 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:18.551+0000 7fc42f400640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7fc4280c6ee0 con 0x7fc4280c4db0 2024-04-17T19:50:18.543 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:18.551+0000 7fc427e00640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fc4280c83d0 0x7fc4280c4870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:50:18.543 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:18.551+0000 7fc42d400640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fc4280c4db0 0x7fc428162f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:50:18.543 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:18.551+0000 7fc427e00640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fc4280c83d0 0x7fc4280c4870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.44:37048/0 (socket says 172.21.15.44:37048) 2024-04-17T19:50:18.543 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:18.551+0000 7fc427e00640 1 -- 172.21.15.44:0/2825561664 learned_addr learned my addr 172.21.15.44:0/2825561664 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-04-17T19:50:18.543 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:18.551+0000 7fc427e00640 1 -- 172.21.15.44:0/2825561664 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fc4280c4db0 msgr2=0x7fc428162f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T19:50:18.544 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:18.551+0000 7fc427e00640 1 --2- 172.21.15.44:0/2825561664 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fc4280c4db0 0x7fc428162f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:50:18.544 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:18.551+0000 7fc427e00640 1 -- 172.21.15.44:0/2825561664 >> v1:172.21.15.62:6789/0 conn(0x7fc4280c7fc0 legacy=0x7fc428152610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:50:18.544 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:18.551+0000 7fc427e00640 1 -- 172.21.15.44:0/2825561664 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc4280c4000 con 0x7fc4280c83d0 2024-04-17T19:50:18.546 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:18.555+0000 7fc427e00640 1 --2- 172.21.15.44:0/2825561664 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc4280c83d0 0x7fc4280c4870 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fc414009870 tx=0x7fc41401c440 comp rx=0 tx=0).ready entity=mon.1 client_cookie=381c132515ea348c server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:50:18.546 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:18.555+0000 7fc427400640 1 -- 172.21.15.44:0/2825561664 <== mon.1 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4140b0070 con 0x7fc4280c83d0 2024-04-17T19:50:18.547 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:18.555+0000 7fc427400640 1 -- 172.21.15.44:0/2825561664 <== mon.1 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc4140ab600 con 0x7fc4280c83d0 2024-04-17T19:50:18.547 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:18.555+0000 7fc427400640 1 -- 172.21.15.44:0/2825561664 <== mon.1 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4140ab9d0 con 0x7fc4280c83d0 2024-04-17T19:50:18.547 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:18.555+0000 7fc42f400640 1 -- 172.21.15.44:0/2825561664 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc4280c83d0 msgr2=0x7fc4280c4870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:50:18.548 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:18.555+0000 7fc42f400640 1 --2- 172.21.15.44:0/2825561664 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc4280c83d0 0x7fc4280c4870 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fc414009870 tx=0x7fc41401c440 comp rx=0 tx=0).stop 2024-04-17T19:50:18.548 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:18.555+0000 7fc42f400640 1 -- 172.21.15.44:0/2825561664 shutdown_connections 2024-04-17T19:50:18.548 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:18.555+0000 7fc42f400640 1 --2- 172.21.15.44:0/2825561664 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fc4280c4db0 0x7fc428162f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:50:18.548 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:18.555+0000 7fc42f400640 1 --2- 172.21.15.44:0/2825561664 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc4280c83d0 0x7fc4280c4870 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:50:18.548 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:18.555+0000 7fc42f400640 1 -- 172.21.15.44:0/2825561664 >> 172.21.15.44:0/2825561664 conn(0x7fc4280c9ad0 msgr2=0x7fc4280cc9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:50:18.548 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:18.555+0000 7fc42f400640 1 -- 172.21.15.44:0/2825561664 shutdown_connections 2024-04-17T19:50:18.548 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:18.555+0000 7fc42f400640 1 -- 172.21.15.44:0/2825561664 wait complete. 2024-04-17T19:50:18.550 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:18.559+0000 7fc42f400640 1 Processor -- start 2024-04-17T19:50:18.550 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:18.559+0000 7fc42f400640 1 -- start start 2024-04-17T19:50:18.552 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:18.559+0000 7fc42f400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc4280c4db0 0x7fc428157710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:50:18.552 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:18.559+0000 7fc42f400640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc4280c7fc0 0x7fc428154210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:50:18.552 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:18.559+0000 7fc42f400640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fc4280c83d0 0x7fc428159ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:50:18.552 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:18.559+0000 7fc42f400640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fc4280c6870 con 0x7fc4280c4db0 2024-04-17T19:50:18.552 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:18.559+0000 7fc42f400640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7fc4280c7a20 con 0x7fc4280c7fc0 2024-04-17T19:50:18.552 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:18.559+0000 7fc42f400640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7fc42814af00 con 0x7fc4280c83d0 2024-04-17T19:50:18.552 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:18.559+0000 7fc42ca00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc4280c4db0 0x7fc428157710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:50:18.552 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:18.559+0000 7fc42ca00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc4280c4db0 0x7fc428157710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:46936/0 (socket says 172.21.15.44:46936) 2024-04-17T19:50:18.552 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:18.559+0000 7fc427e00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc4280c7fc0 0x7fc428154210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:50:18.552 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:18.559+0000 7fc42ca00640 1 -- 172.21.15.44:0/2522379295 learned_addr learned my addr 172.21.15.44:0/2522379295 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-04-17T19:50:18.552 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:18.559+0000 7fc42d400640 1 --2- 172.21.15.44:0/2522379295 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fc4280c83d0 0x7fc428159ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:50:18.553 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:18.563+0000 7fc42ca00640 1 -- 172.21.15.44:0/2522379295 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fc4280c83d0 msgr2=0x7fc428159ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:50:18.553 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:18.563+0000 7fc42ca00640 1 --2- 172.21.15.44:0/2522379295 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fc4280c83d0 0x7fc428159ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:50:18.554 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:18.563+0000 7fc42ca00640 1 -- 172.21.15.44:0/2522379295 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc4280c7fc0 msgr2=0x7fc428154210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:50:18.554 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:18.563+0000 7fc42ca00640 1 --2- 172.21.15.44:0/2522379295 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc4280c7fc0 0x7fc428154210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:50:18.554 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:18.563+0000 7fc42ca00640 1 -- 172.21.15.44:0/2522379295 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc4280c62d0 con 0x7fc4280c4db0 2024-04-17T19:50:18.554 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:18.563+0000 7fc42ca00640 1 --2- 172.21.15.44:0/2522379295 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc4280c4db0 0x7fc428157710 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7fc41c00c3c0 tx=0x7fc41c00c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:50:18.554 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:18.563+0000 7fc424c00640 1 -- 172.21.15.44:0/2522379295 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc41c017070 con 0x7fc4280c4db0 2024-04-17T19:50:18.554 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:18.563+0000 7fc424c00640 1 -- 172.21.15.44:0/2522379295 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc41c0052d0 con 0x7fc4280c4db0 2024-04-17T19:50:18.554 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:18.563+0000 7fc42f400640 1 -- 172.21.15.44:0/2522379295 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc428157c50 con 0x7fc4280c4db0 2024-04-17T19:50:18.554 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:18.563+0000 7fc424c00640 1 -- 172.21.15.44:0/2522379295 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc41c003840 con 0x7fc4280c4db0 2024-04-17T19:50:18.554 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:18.563+0000 7fc42f400640 1 -- 172.21.15.44:0/2522379295 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc428156950 con 0x7fc4280c4db0 2024-04-17T19:50:18.554 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:18.563+0000 7fc42f400640 1 -- 172.21.15.44:0/2522379295 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fc428075f10 con 0x7fc4280c4db0 2024-04-17T19:50:18.555 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:18.563+0000 7fc424c00640 1 -- 172.21.15.44:0/2522379295 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fc41c01a070 con 0x7fc4280c4db0 2024-04-17T19:50:18.556 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:18.563+0000 7fc424c00640 1 --2- 172.21.15.44:0/2522379295 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7fc4080683b0 0x7fc40806a8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:50:18.556 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:18.563+0000 7fc424c00640 1 -- 172.21.15.44:0/2522379295 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6619+0+0 (secure 0 0 0) 0x7fc41c0865a0 con 0x7fc4280c4db0 2024-04-17T19:50:18.556 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:18.567+0000 7fc424c00640 1 --2- 172.21.15.44:0/2522379295 >> [v2:172.21.15.44:6800/1018735925,v1:172.21.15.44:6801/1018735925] conn(0x7fc408071b90 0x7fc408074080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:50:18.556 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:18.567+0000 7fc424c00640 1 -- 172.21.15.44:0/2522379295 --> [v2:172.21.15.44:6800/1018735925,v1:172.21.15.44:6801/1018735925] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fc408074750 con 0x7fc408071b90 2024-04-17T19:50:18.556 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:18.567+0000 7fc424c00640 1 -- 172.21.15.44:0/2522379295 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fc41c086950 con 0x7fc4280c4db0 2024-04-17T19:50:18.556 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:18.567+0000 7fc427e00640 1 --2- 172.21.15.44:0/2522379295 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7fc4080683b0 0x7fc40806a8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:50:18.557 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:18.567+0000 7fc42d400640 1 --2- 172.21.15.44:0/2522379295 >> [v2:172.21.15.44:6800/1018735925,v1:172.21.15.44:6801/1018735925] conn(0x7fc408071b90 0x7fc408074080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:50:18.557 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:18.567+0000 7fc42d400640 1 --2- 172.21.15.44:0/2522379295 >> [v2:172.21.15.44:6800/1018735925,v1:172.21.15.44:6801/1018735925] conn(0x7fc408071b90 0x7fc408074080 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:50:18.557 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:18.567+0000 7fc427e00640 1 --2- 172.21.15.44:0/2522379295 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7fc4080683b0 0x7fc40806a8c0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fc4140ad000 tx=0x7fc414008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:50:18.558 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:18.567+0000 7fc424c00640 1 -- 172.21.15.44:0/2522379295 <== osd.0 v2:172.21.15.44:6800/1018735925 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fc408074750 con 0x7fc408071b90 2024-04-17T19:50:18.571 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:18.579+0000 7fc42f400640 1 -- 172.21.15.44:0/2522379295 --> [v2:172.21.15.44:6800/1018735925,v1:172.21.15.44:6801/1018735925] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fc4280c37c0 con 0x7fc408071b90 2024-04-17T19:50:18.571 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:18.579+0000 7fc424c00640 1 -- 172.21.15.44:0/2522379295 <== osd.0 v2:172.21.15.44:6800/1018735925 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7fc4280c37c0 con 0x7fc408071b90 2024-04-17T19:50:18.572 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2024-04-17T19:50:18.572 INFO:teuthology.orchestra.run.smithi044.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-17T19:50:18.572 INFO:teuthology.orchestra.run.smithi044.stdout:} 2024-04-17T19:50:18.573 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:18.579+0000 7fc42f400640 1 -- 172.21.15.44:0/2522379295 >> [v2:172.21.15.44:6800/1018735925,v1:172.21.15.44:6801/1018735925] conn(0x7fc408071b90 msgr2=0x7fc408074080 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:50:18.573 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:18.579+0000 7fc42f400640 1 --2- 172.21.15.44:0/2522379295 >> [v2:172.21.15.44:6800/1018735925,v1:172.21.15.44:6801/1018735925] conn(0x7fc408071b90 0x7fc408074080 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:50:18.573 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:18.583+0000 7fc42f400640 1 -- 172.21.15.44:0/2522379295 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7fc4080683b0 msgr2=0x7fc40806a8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:50:18.573 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:18.583+0000 7fc42f400640 1 --2- 172.21.15.44:0/2522379295 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7fc4080683b0 0x7fc40806a8c0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fc4140ad000 tx=0x7fc414008040 comp rx=0 tx=0).stop 2024-04-17T19:50:18.573 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:18.583+0000 7fc42f400640 1 -- 172.21.15.44:0/2522379295 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc4280c4db0 msgr2=0x7fc428157710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:50:18.573 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:18.583+0000 7fc42f400640 1 --2- 172.21.15.44:0/2522379295 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc4280c4db0 0x7fc428157710 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7fc41c00c3c0 tx=0x7fc41c00c880 comp rx=0 tx=0).stop 2024-04-17T19:50:18.573 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:18.583+0000 7fc42d400640 1 -- 172.21.15.44:0/2522379295 reap_dead start 2024-04-17T19:50:18.573 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:18.583+0000 7fc42f400640 1 -- 172.21.15.44:0/2522379295 shutdown_connections 2024-04-17T19:50:18.573 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:18.583+0000 7fc42f400640 1 -- 172.21.15.44:0/2522379295 >> 172.21.15.44:0/2522379295 conn(0x7fc4280c9ad0 msgr2=0x7fc42814f020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:50:18.573 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:18.583+0000 7fc42f400640 1 -- 172.21.15.44:0/2522379295 shutdown_connections 2024-04-17T19:50:18.573 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:18.583+0000 7fc42f400640 1 -- 172.21.15.44:0/2522379295 wait complete. 2024-04-17T19:50:18.591 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2024-04-17T19:50:18.743 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:18.751+0000 7f3f68000640 1 Processor -- start 2024-04-17T19:50:18.743 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:18.751+0000 7f3f68000640 1 -- start start 2024-04-17T19:50:18.745 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:18.755+0000 7f3f68000640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f3f6015c500 0x7f3f60155d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:50:18.746 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:18.755+0000 7f3f68000640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f3f600c8110 0x7f3f600c6a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:50:18.746 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:18.755+0000 7f3f68000640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3f600c61f0 con 0x7f3f600c65f0 2024-04-17T19:50:18.746 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:18.755+0000 7f3f68000640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 -- 0x7f3f60156290 con 0x7f3f600c8110 2024-04-17T19:50:18.746 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:18.755+0000 7f3f68000640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7f3f6015c910 con 0x7f3f6015c500 2024-04-17T19:50:18.746 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:18.755+0000 7f3f66000640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f3f600c8110 0x7f3f600c6a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:50:18.746 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:18.755+0000 7f3f64c00640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f3f600c65f0 0x7f3f600c7a00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:59000/0 (socket says 172.21.15.44:59000) 2024-04-17T19:50:18.746 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:18.755+0000 7f3f64c00640 1 -- 172.21.15.44:0/2334039925 learned_addr learned my addr 172.21.15.44:0/2334039925 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-04-17T19:50:18.746 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:18.755+0000 7f3f65600640 1 --2- 172.21.15.44:0/2334039925 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f3f6015c500 0x7f3f60155d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:50:18.747 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:18.755+0000 7f3f66000640 1 -- 172.21.15.44:0/2334039925 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f3f6015c500 msgr2=0x7f3f60155d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T19:50:18.747 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:18.755+0000 7f3f66000640 1 --2- 172.21.15.44:0/2334039925 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f3f6015c500 0x7f3f60155d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:50:18.747 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:18.755+0000 7f3f66000640 1 -- 172.21.15.44:0/2334039925 >> v1:172.21.15.44:6789/0 conn(0x7f3f600c65f0 legacy=0x7f3f600c7a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:50:18.747 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:18.755+0000 7f3f66000640 1 -- 172.21.15.44:0/2334039925 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3f600c7520 con 0x7f3f600c8110 2024-04-17T19:50:18.747 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:18.755+0000 7f3f5fe00640 1 -- 172.21.15.44:0/2334039925 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1232448185 0 0) 0x7f3f600c61f0 con 0x7f3f600c65f0 2024-04-17T19:50:18.749 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:18.759+0000 7f3f66000640 1 --2- 172.21.15.44:0/2334039925 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3f600c8110 0x7f3f600c6a00 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f3f600c76f0 tx=0x7f3f5801c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9ac520689c9383a7 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:50:18.749 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:18.759+0000 7f3f5fe00640 1 -- 172.21.15.44:0/2334039925 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f580b2070 con 0x7f3f600c8110 2024-04-17T19:50:18.749 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:18.759+0000 7f3f5fe00640 1 -- 172.21.15.44:0/2334039925 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3f580a5920 con 0x7f3f600c8110 2024-04-17T19:50:18.749 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:18.759+0000 7f3f5fe00640 1 -- 172.21.15.44:0/2334039925 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f580a5cf0 con 0x7f3f600c8110 2024-04-17T19:50:18.750 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:18.759+0000 7f3f68000640 1 -- 172.21.15.44:0/2334039925 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3f600c8110 msgr2=0x7f3f600c6a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:50:18.750 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:18.759+0000 7f3f68000640 1 --2- 172.21.15.44:0/2334039925 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3f600c8110 0x7f3f600c6a00 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f3f600c76f0 tx=0x7f3f5801c950 comp rx=0 tx=0).stop 2024-04-17T19:50:18.750 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:18.759+0000 7f3f68000640 1 -- 172.21.15.44:0/2334039925 shutdown_connections 2024-04-17T19:50:18.750 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:18.759+0000 7f3f68000640 1 --2- 172.21.15.44:0/2334039925 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3f600c8110 0x7f3f600c6a00 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:50:18.750 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:18.759+0000 7f3f68000640 1 --2- 172.21.15.44:0/2334039925 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f3f6015c500 0x7f3f60155d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:50:18.750 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:18.759+0000 7f3f68000640 1 -- 172.21.15.44:0/2334039925 >> 172.21.15.44:0/2334039925 conn(0x7f3f6006c380 msgr2=0x7f3f60070080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:50:18.750 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:18.759+0000 7f3f68000640 1 -- 172.21.15.44:0/2334039925 shutdown_connections 2024-04-17T19:50:18.750 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:18.759+0000 7f3f68000640 1 -- 172.21.15.44:0/2334039925 wait complete. 2024-04-17T19:50:18.752 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:18.763+0000 7f3f68000640 1 Processor -- start 2024-04-17T19:50:18.752 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:18.763+0000 7f3f68000640 1 -- start start 2024-04-17T19:50:18.755 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:18.763+0000 7f3f68000640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3f600c65f0 0x7f3f60148780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:50:18.755 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:18.763+0000 7f3f68000640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f3f600c8110 0x7f3f60147360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:50:18.755 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:18.763+0000 7f3f68000640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3f6015c500 0x7f3f60144210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:50:18.755 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:18.763+0000 7f3f68000640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f3f60073c10 con 0x7f3f600c65f0 2024-04-17T19:50:18.755 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:18.763+0000 7f3f68000640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f3f60074280 con 0x7f3f6015c500 2024-04-17T19:50:18.755 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:18.763+0000 7f3f68000640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7f3f60073d90 con 0x7f3f600c8110 2024-04-17T19:50:18.756 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:18.763+0000 7f3f65600640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3f600c65f0 0x7f3f60148780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:50:18.756 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:18.763+0000 7f3f65600640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3f600c65f0 0x7f3f60148780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:46950/0 (socket says 172.21.15.44:46950) 2024-04-17T19:50:18.756 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:18.763+0000 7f3f65600640 1 -- 172.21.15.44:0/3174909240 learned_addr learned my addr 172.21.15.44:0/3174909240 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-04-17T19:50:18.756 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:18.763+0000 7f3f64c00640 1 --2- 172.21.15.44:0/3174909240 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f3f600c8110 0x7f3f60147360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:50:18.756 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:18.763+0000 7f3f66000640 1 --2- 172.21.15.44:0/3174909240 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3f6015c500 0x7f3f60144210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:50:18.756 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:18.763+0000 7f3f65600640 1 -- 172.21.15.44:0/3174909240 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f3f600c8110 msgr2=0x7f3f60147360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:50:18.756 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:18.763+0000 7f3f65600640 1 --2- 172.21.15.44:0/3174909240 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f3f600c8110 0x7f3f60147360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:50:18.756 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:18.763+0000 7f3f65600640 1 -- 172.21.15.44:0/3174909240 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3f6015c500 msgr2=0x7f3f60144210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:50:18.756 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:18.763+0000 7f3f65600640 1 --2- 172.21.15.44:0/3174909240 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3f6015c500 0x7f3f60144210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:50:18.756 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:18.763+0000 7f3f65600640 1 -- 172.21.15.44:0/3174909240 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3f60148cc0 con 0x7f3f600c65f0 2024-04-17T19:50:18.756 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:18.763+0000 7f3f66000640 1 --2- 172.21.15.44:0/3174909240 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3f6015c500 0x7f3f60144210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-17T19:50:18.756 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:18.763+0000 7f3f65600640 1 --2- 172.21.15.44:0/3174909240 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3f600c65f0 0x7f3f60148780 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f3f5400e8a0 tx=0x7f3f5400eca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:50:18.756 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:18.763+0000 7f3f5d600640 1 -- 172.21.15.44:0/3174909240 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f54017070 con 0x7f3f600c65f0 2024-04-17T19:50:18.756 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:18.763+0000 7f3f5d600640 1 -- 172.21.15.44:0/3174909240 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3f5400c940 con 0x7f3f600c65f0 2024-04-17T19:50:18.757 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:18.763+0000 7f3f5d600640 1 -- 172.21.15.44:0/3174909240 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f5400ccf0 con 0x7f3f600c65f0 2024-04-17T19:50:18.757 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:18.763+0000 7f3f68000640 1 -- 172.21.15.44:0/3174909240 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3f600cc3d0 con 0x7f3f600c65f0 2024-04-17T19:50:18.757 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:18.763+0000 7f3f68000640 1 -- 172.21.15.44:0/3174909240 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3f600cacb0 con 0x7f3f600c65f0 2024-04-17T19:50:18.757 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:18.767+0000 7f3f68000640 1 -- 172.21.15.44:0/3174909240 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3f6004ff10 con 0x7f3f600c65f0 2024-04-17T19:50:18.758 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:18.767+0000 7f3f5d600640 1 -- 172.21.15.44:0/3174909240 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f3f5401a070 con 0x7f3f600c65f0 2024-04-17T19:50:18.759 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:18.767+0000 7f3f5d600640 1 --2- 172.21.15.44:0/3174909240 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f3f40068380 0x7f3f4006a890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:50:18.759 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:18.767+0000 7f3f5d600640 1 -- 172.21.15.44:0/3174909240 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6619+0+0 (secure 0 0 0) 0x7f3f540874a0 con 0x7f3f600c65f0 2024-04-17T19:50:18.759 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:18.767+0000 7f3f64c00640 1 --2- 172.21.15.44:0/3174909240 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f3f40068380 0x7f3f4006a890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:50:18.760 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:18.771+0000 7f3f64c00640 1 --2- 172.21.15.44:0/3174909240 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f3f40068380 0x7f3f4006a890 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f3f601f93a0 tx=0x7f3f4c007c10 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:50:18.763 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:18.771+0000 7f3f5d600640 1 -- 172.21.15.44:0/3174909240 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f3f540576b0 con 0x7f3f600c65f0 2024-04-17T19:50:18.928 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:18.935+0000 7f3f68000640 1 -- 172.21.15.44:0/3174909240 --> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "0", "target": ["mon-mgr", ""]}) -- 0x7f3f60073fb0 con 0x7f3f40068380 2024-04-17T19:50:18.928 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:18.939+0000 7f3f5d600640 1 -- 172.21.15.44:0/3174909240 <== mgr.4102 v2:172.21.15.62:6832/1020159798 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 0 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f3f60073fb0 con 0x7f3f40068380 2024-04-17T19:50:18.928 INFO:teuthology.orchestra.run.smithi044.stderr:instructed osd(s) 0 to deep-scrub 2024-04-17T19:50:18.931 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:18.939+0000 7f3f68000640 1 -- 172.21.15.44:0/3174909240 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f3f40068380 msgr2=0x7f3f4006a890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:50:18.931 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:18.939+0000 7f3f68000640 1 --2- 172.21.15.44:0/3174909240 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f3f40068380 0x7f3f4006a890 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f3f601f93a0 tx=0x7f3f4c007c10 comp rx=0 tx=0).stop 2024-04-17T19:50:18.931 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:18.939+0000 7f3f68000640 1 -- 172.21.15.44:0/3174909240 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3f600c65f0 msgr2=0x7f3f60148780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:50:18.931 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:18.939+0000 7f3f68000640 1 --2- 172.21.15.44:0/3174909240 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3f600c65f0 0x7f3f60148780 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f3f5400e8a0 tx=0x7f3f5400eca0 comp rx=0 tx=0).stop 2024-04-17T19:50:18.931 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:18.939+0000 7f3f68000640 1 -- 172.21.15.44:0/3174909240 shutdown_connections 2024-04-17T19:50:18.931 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:18.939+0000 7f3f68000640 1 --2- 172.21.15.44:0/3174909240 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f3f40068380 0x7f3f4006a890 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:50:18.931 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:18.939+0000 7f3f68000640 1 --2- 172.21.15.44:0/3174909240 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f3f600c8110 0x7f3f60147360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:50:18.932 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:18.939+0000 7f3f68000640 1 --2- 172.21.15.44:0/3174909240 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3f6015c500 0x7f3f60144210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:50:18.932 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:18.939+0000 7f3f68000640 1 --2- 172.21.15.44:0/3174909240 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3f600c65f0 0x7f3f60148780 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:50:18.932 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:18.939+0000 7f3f68000640 1 -- 172.21.15.44:0/3174909240 >> 172.21.15.44:0/3174909240 conn(0x7f3f6006c380 msgr2=0x7f3f60072fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:50:18.932 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:18.939+0000 7f3f68000640 1 -- 172.21.15.44:0/3174909240 shutdown_connections 2024-04-17T19:50:18.932 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:18.939+0000 7f3f68000640 1 -- 172.21.15.44:0/3174909240 wait complete. 2024-04-17T19:50:18.952 INFO:tasks.ceph:Scrubbing osd.1 2024-04-17T19:50:18.952 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2024-04-17T19:50:19.108 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:19.119+0000 7f1c0c200640 1 Processor -- start 2024-04-17T19:50:19.108 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:19.119+0000 7f1c0c200640 1 -- start start 2024-04-17T19:50:19.110 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:19.119+0000 7f1c0c200640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f1c041538b0 0x7f1c04072590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:50:19.110 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:19.119+0000 7f1c0c200640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f1c0415d7c0 0x7f1c040c64f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:50:19.110 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:19.119+0000 7f1c0c200640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1c040736b0 con 0x7f1c040c60e0 2024-04-17T19:50:19.110 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:19.119+0000 7f1c0c200640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 -- 0x7f1c04073990 con 0x7f1c0415d7c0 2024-04-17T19:50:19.110 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:19.119+0000 7f1c0c200640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7f1c04073c70 con 0x7f1c041538b0 2024-04-17T19:50:19.111 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:19.119+0000 7f1c0a200640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f1c0415d7c0 0x7f1c040c64f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:50:19.111 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:19.119+0000 7f1c08e00640 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f1c040c60e0 0x7f1c0415d0b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.44:54218/0 (socket says 172.21.15.44:54218) 2024-04-17T19:50:19.111 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:19.119+0000 7f1c08e00640 1 -- 172.21.15.44:0/2659852701 learned_addr learned my addr 172.21.15.44:0/2659852701 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-04-17T19:50:19.111 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:19.119+0000 7f1c09800640 1 --2- 172.21.15.44:0/2659852701 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f1c041538b0 0x7f1c04072590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:50:19.111 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:19.119+0000 7f1c0a200640 1 -- 172.21.15.44:0/2659852701 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f1c041538b0 msgr2=0x7f1c04072590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T19:50:19.111 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:19.119+0000 7f1c0a200640 1 --2- 172.21.15.44:0/2659852701 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f1c041538b0 0x7f1c04072590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:50:19.111 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:19.119+0000 7f1c0a200640 1 -- 172.21.15.44:0/2659852701 >> v1:172.21.15.62:6789/0 conn(0x7f1c040c60e0 legacy=0x7f1c0415d0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:50:19.111 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:19.119+0000 7f1c0a200640 1 -- 172.21.15.44:0/2659852701 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1c04073f50 con 0x7f1c0415d7c0 2024-04-17T19:50:19.114 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:19.123+0000 7f1c0a200640 1 --2- 172.21.15.44:0/2659852701 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1c0415d7c0 0x7f1c040c64f0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f1bfc009d90 tx=0x7f1bfc01f150 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8a17788aed7a525f server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:50:19.114 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:19.123+0000 7f1c03e00640 1 -- 172.21.15.44:0/2659852701 <== mon.1 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1bfc0b4070 con 0x7f1c0415d7c0 2024-04-17T19:50:19.114 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:19.123+0000 7f1c03e00640 1 -- 172.21.15.44:0/2659852701 <== mon.1 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1bfc0af600 con 0x7f1c0415d7c0 2024-04-17T19:50:19.114 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:19.123+0000 7f1c03e00640 1 -- 172.21.15.44:0/2659852701 <== mon.1 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1bfc0af9d0 con 0x7f1c0415d7c0 2024-04-17T19:50:19.115 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:19.123+0000 7f1c0c200640 1 -- 172.21.15.44:0/2659852701 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1c0415d7c0 msgr2=0x7f1c040c64f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:50:19.115 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:19.123+0000 7f1c0c200640 1 --2- 172.21.15.44:0/2659852701 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1c0415d7c0 0x7f1c040c64f0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f1bfc009d90 tx=0x7f1bfc01f150 comp rx=0 tx=0).stop 2024-04-17T19:50:19.115 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:19.123+0000 7f1c0c200640 1 -- 172.21.15.44:0/2659852701 shutdown_connections 2024-04-17T19:50:19.115 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:19.123+0000 7f1c0c200640 1 --2- 172.21.15.44:0/2659852701 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1c0415d7c0 0x7f1c040c64f0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:50:19.115 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:19.123+0000 7f1c0c200640 1 --2- 172.21.15.44:0/2659852701 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f1c041538b0 0x7f1c04072590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:50:19.115 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:19.123+0000 7f1c0c200640 1 -- 172.21.15.44:0/2659852701 >> 172.21.15.44:0/2659852701 conn(0x7f1c040c9ad0 msgr2=0x7f1c040cc9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:50:19.115 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:19.123+0000 7f1c0c200640 1 -- 172.21.15.44:0/2659852701 shutdown_connections 2024-04-17T19:50:19.116 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:19.123+0000 7f1c0c200640 1 -- 172.21.15.44:0/2659852701 wait complete. 2024-04-17T19:50:19.117 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:19.127+0000 7f1c0c200640 1 Processor -- start 2024-04-17T19:50:19.117 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:19.127+0000 7f1c0c200640 1 -- start start 2024-04-17T19:50:19.119 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:19.127+0000 7f1c0c200640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1c040c60e0 0x7f1c041f5b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:50:19.120 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:19.127+0000 7f1c0c200640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f1c041538b0 0x7f1c040cbc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:50:19.120 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:19.127+0000 7f1c0c200640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1c0415d7c0 0x7f1c041431b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:50:19.120 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:19.127+0000 7f1c0c200640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f1c040c9130 con 0x7f1c040c60e0 2024-04-17T19:50:19.120 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:19.127+0000 7f1c0c200640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f1c04153cc0 con 0x7f1c0415d7c0 2024-04-17T19:50:19.120 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:19.127+0000 7f1c0c200640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7f1c04072ad0 con 0x7f1c041538b0 2024-04-17T19:50:19.120 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:19.127+0000 7f1c09800640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1c040c60e0 0x7f1c041f5b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:50:19.120 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:19.127+0000 7f1c09800640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1c040c60e0 0x7f1c041f5b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:46954/0 (socket says 172.21.15.44:46954) 2024-04-17T19:50:19.120 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:19.127+0000 7f1c09800640 1 -- 172.21.15.44:0/4002090070 learned_addr learned my addr 172.21.15.44:0/4002090070 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-04-17T19:50:19.120 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:19.127+0000 7f1c0a200640 1 --2- 172.21.15.44:0/4002090070 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1c0415d7c0 0x7f1c041431b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:50:19.120 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:19.127+0000 7f1c08e00640 1 --2- 172.21.15.44:0/4002090070 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f1c041538b0 0x7f1c040cbc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:50:19.120 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:19.127+0000 7f1c09800640 1 -- 172.21.15.44:0/4002090070 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f1c041538b0 msgr2=0x7f1c040cbc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:50:19.120 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:19.127+0000 7f1c09800640 1 --2- 172.21.15.44:0/4002090070 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f1c041538b0 0x7f1c040cbc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:50:19.120 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:19.127+0000 7f1c09800640 1 -- 172.21.15.44:0/4002090070 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1c0415d7c0 msgr2=0x7f1c041431b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:50:19.120 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:19.127+0000 7f1c09800640 1 --2- 172.21.15.44:0/4002090070 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1c0415d7c0 0x7f1c041431b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:50:19.120 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:19.127+0000 7f1c09800640 1 -- 172.21.15.44:0/4002090070 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1c041f60d0 con 0x7f1c040c60e0 2024-04-17T19:50:19.121 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:19.127+0000 7f1c0a200640 1 --2- 172.21.15.44:0/4002090070 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1c0415d7c0 0x7f1c041431b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-17T19:50:19.121 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:19.131+0000 7f1c09800640 1 --2- 172.21.15.44:0/4002090070 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1c040c60e0 0x7f1c041f5b90 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f1bf800e8a0 tx=0x7f1bf800eca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:50:19.122 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:19.131+0000 7f1c01600640 1 -- 172.21.15.44:0/4002090070 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1bf8017070 con 0x7f1c040c60e0 2024-04-17T19:50:19.122 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:19.131+0000 7f1c01600640 1 -- 172.21.15.44:0/4002090070 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1bf800c940 con 0x7f1c040c60e0 2024-04-17T19:50:19.122 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:19.131+0000 7f1c01600640 1 -- 172.21.15.44:0/4002090070 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1bf800ccf0 con 0x7f1c040c60e0 2024-04-17T19:50:19.122 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:19.131+0000 7f1c0c200640 1 -- 172.21.15.44:0/4002090070 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1c041f26f0 con 0x7f1c040c60e0 2024-04-17T19:50:19.122 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:19.131+0000 7f1c0c200640 1 -- 172.21.15.44:0/4002090070 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1c041f2990 con 0x7f1c040c60e0 2024-04-17T19:50:19.122 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:19.131+0000 7f1c0c200640 1 -- 172.21.15.44:0/4002090070 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f1c041f3330 con 0x7f1c040c60e0 2024-04-17T19:50:19.123 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:19.131+0000 7f1c01600640 1 -- 172.21.15.44:0/4002090070 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f1bf801a070 con 0x7f1c040c60e0 2024-04-17T19:50:19.124 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:19.131+0000 7f1c01600640 1 --2- 172.21.15.44:0/4002090070 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f1be40683b0 0x7f1be406a8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:50:19.124 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:19.131+0000 7f1c01600640 1 -- 172.21.15.44:0/4002090070 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6619+0+0 (secure 0 0 0) 0x7f1bf8087160 con 0x7f1c040c60e0 2024-04-17T19:50:19.124 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:19.135+0000 7f1c01600640 1 --2- 172.21.15.44:0/4002090070 >> [v2:172.21.15.44:6817/1452577434,v1:172.21.15.44:6820/1452577434] conn(0x7f1be4071b90 0x7f1be4074080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:50:19.124 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:19.135+0000 7f1c01600640 1 -- 172.21.15.44:0/4002090070 --> [v2:172.21.15.44:6817/1452577434,v1:172.21.15.44:6820/1452577434] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f1bf800ce90 con 0x7f1be4071b90 2024-04-17T19:50:19.124 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:19.135+0000 7f1c01600640 1 -- 172.21.15.44:0/4002090070 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f1bf8087510 con 0x7f1c040c60e0 2024-04-17T19:50:19.124 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:19.135+0000 7f1c08e00640 1 --2- 172.21.15.44:0/4002090070 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f1be40683b0 0x7f1be406a8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:50:19.125 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:19.135+0000 7f1c0a200640 1 --2- 172.21.15.44:0/4002090070 >> [v2:172.21.15.44:6817/1452577434,v1:172.21.15.44:6820/1452577434] conn(0x7f1be4071b90 0x7f1be4074080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:50:19.125 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:19.135+0000 7f1c0a200640 1 --2- 172.21.15.44:0/4002090070 >> [v2:172.21.15.44:6817/1452577434,v1:172.21.15.44:6820/1452577434] conn(0x7f1be4071b90 0x7f1be4074080 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:50:19.125 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:19.135+0000 7f1c08e00640 1 --2- 172.21.15.44:0/4002090070 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f1be40683b0 0x7f1be406a8c0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f1c040cc730 tx=0x7f1bf0009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:50:19.126 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:19.135+0000 7f1c01600640 1 -- 172.21.15.44:0/4002090070 <== osd.1 v2:172.21.15.44:6817/1452577434 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f1bf800ce90 con 0x7f1be4071b90 2024-04-17T19:50:19.139 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:19.147+0000 7f1c0c200640 1 -- 172.21.15.44:0/4002090070 --> [v2:172.21.15.44:6817/1452577434,v1:172.21.15.44:6820/1452577434] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f1c04075f10 con 0x7f1be4071b90 2024-04-17T19:50:19.140 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:19.147+0000 7f1c01600640 1 -- 172.21.15.44:0/4002090070 <== osd.1 v2:172.21.15.44:6817/1452577434 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f1c04075f10 con 0x7f1be4071b90 2024-04-17T19:50:19.140 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2024-04-17T19:50:19.141 INFO:teuthology.orchestra.run.smithi044.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-17T19:50:19.141 INFO:teuthology.orchestra.run.smithi044.stdout:} 2024-04-17T19:50:19.142 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:19.147+0000 7f1c0c200640 1 -- 172.21.15.44:0/4002090070 >> [v2:172.21.15.44:6817/1452577434,v1:172.21.15.44:6820/1452577434] conn(0x7f1be4071b90 msgr2=0x7f1be4074080 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:50:19.142 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:19.147+0000 7f1c0c200640 1 --2- 172.21.15.44:0/4002090070 >> [v2:172.21.15.44:6817/1452577434,v1:172.21.15.44:6820/1452577434] conn(0x7f1be4071b90 0x7f1be4074080 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:50:19.142 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:19.147+0000 7f1c0c200640 1 -- 172.21.15.44:0/4002090070 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f1be40683b0 msgr2=0x7f1be406a8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:50:19.142 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:19.147+0000 7f1c0c200640 1 --2- 172.21.15.44:0/4002090070 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f1be40683b0 0x7f1be406a8c0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f1c040cc730 tx=0x7f1bf0009040 comp rx=0 tx=0).stop 2024-04-17T19:50:19.142 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:19.147+0000 7f1c0c200640 1 -- 172.21.15.44:0/4002090070 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1c040c60e0 msgr2=0x7f1c041f5b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:50:19.142 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:19.147+0000 7f1c0c200640 1 --2- 172.21.15.44:0/4002090070 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1c040c60e0 0x7f1c041f5b90 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f1bf800e8a0 tx=0x7f1bf800eca0 comp rx=0 tx=0).stop 2024-04-17T19:50:19.142 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:19.147+0000 7f1c0a200640 1 -- 172.21.15.44:0/4002090070 reap_dead start 2024-04-17T19:50:19.143 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:19.147+0000 7f1c0c200640 1 -- 172.21.15.44:0/4002090070 shutdown_connections 2024-04-17T19:50:19.143 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:19.147+0000 7f1c0c200640 1 -- 172.21.15.44:0/4002090070 >> 172.21.15.44:0/4002090070 conn(0x7f1c040c9ad0 msgr2=0x7f1c0414ee40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:50:19.143 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:19.151+0000 7f1c0c200640 1 -- 172.21.15.44:0/4002090070 shutdown_connections 2024-04-17T19:50:19.143 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:19.151+0000 7f1c0c200640 1 -- 172.21.15.44:0/4002090070 wait complete. 2024-04-17T19:50:19.158 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2024-04-17T19:50:19.310 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:19.319+0000 7f4624400640 1 Processor -- start 2024-04-17T19:50:19.310 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:19.319+0000 7f4624400640 1 -- start start 2024-04-17T19:50:19.312 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:19.323+0000 7f4624400640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f461c153a00 0x7f461c159de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:50:19.312 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:19.323+0000 7f4624400640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f461c15a320 0x7f461c164130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:50:19.313 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:19.323+0000 7f4624400640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f461c15a730 con 0x7f461c072700 2024-04-17T19:50:19.313 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:19.323+0000 7f4624400640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 -- 0x7f461c072b10 con 0x7f461c15a320 2024-04-17T19:50:19.313 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:19.323+0000 7f4624400640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 -- 0x7f461c072d60 con 0x7f461c153a00 2024-04-17T19:50:19.313 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:19.323+0000 7f4621a00640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f461c072700 0x7f461c0c60e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:59016/0 (socket says 172.21.15.44:59016) 2024-04-17T19:50:19.313 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:19.323+0000 7f4621a00640 1 -- 172.21.15.44:0/164592295 learned_addr learned my addr 172.21.15.44:0/164592295 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-04-17T19:50:19.313 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:19.323+0000 7f4622400640 1 --2- 172.21.15.44:0/164592295 >> v2:172.21.15.44:3300/0 conn(0x7f461c15a320 0x7f461c164130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:50:19.313 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:19.323+0000 7f4621000640 1 --2- 172.21.15.44:0/164592295 >> v2:172.21.15.62:3300/0 conn(0x7f461c153a00 0x7f461c159de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:50:19.314 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:19.323+0000 7f4622400640 1 -- 172.21.15.44:0/164592295 >> v2:172.21.15.62:3300/0 conn(0x7f461c153a00 msgr2=0x7f461c159de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T19:50:19.314 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:19.323+0000 7f4622400640 1 --2- 172.21.15.44:0/164592295 >> v2:172.21.15.62:3300/0 conn(0x7f461c153a00 0x7f461c159de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:50:19.314 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:19.323+0000 7f4622400640 1 -- 172.21.15.44:0/164592295 >> v1:172.21.15.44:6789/0 conn(0x7f461c072700 legacy=0x7f461c0c60e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:50:19.314 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:19.323+0000 7f4622400640 1 -- 172.21.15.44:0/164592295 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f461c073810 con 0x7f461c15a320 2024-04-17T19:50:19.314 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:19.323+0000 7f461be00640 1 -- 172.21.15.44:0/164592295 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1877373404 0 0) 0x7f4610001120 con 0x7f461c072700 2024-04-17T19:50:19.316 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:19.323+0000 7f4622400640 1 --2- 172.21.15.44:0/164592295 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f461c15a320 0x7f461c164130 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f461c06cd70 tx=0x7f461401f110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=14d2c8f5e1c4501f server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:50:19.316 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:19.327+0000 7f461be00640 1 -- 172.21.15.44:0/164592295 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46140b4070 con 0x7f461c15a320 2024-04-17T19:50:19.316 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:19.327+0000 7f461be00640 1 -- 172.21.15.44:0/164592295 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f46140af600 con 0x7f461c15a320 2024-04-17T19:50:19.316 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:19.327+0000 7f461be00640 1 -- 172.21.15.44:0/164592295 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46140af9d0 con 0x7f461c15a320 2024-04-17T19:50:19.317 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:19.327+0000 7f4624400640 1 -- 172.21.15.44:0/164592295 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f461c15a320 msgr2=0x7f461c164130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:50:19.317 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:19.327+0000 7f4624400640 1 --2- 172.21.15.44:0/164592295 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f461c15a320 0x7f461c164130 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f461c06cd70 tx=0x7f461401f110 comp rx=0 tx=0).stop 2024-04-17T19:50:19.317 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:19.327+0000 7f4624400640 1 -- 172.21.15.44:0/164592295 shutdown_connections 2024-04-17T19:50:19.317 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:19.327+0000 7f4624400640 1 --2- 172.21.15.44:0/164592295 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f461c15a320 0x7f461c164130 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:50:19.317 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:19.327+0000 7f4624400640 1 --2- 172.21.15.44:0/164592295 >> v2:172.21.15.62:3300/0 conn(0x7f461c153a00 0x7f461c159de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:50:19.317 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:19.327+0000 7f4624400640 1 -- 172.21.15.44:0/164592295 >> 172.21.15.44:0/164592295 conn(0x7f461c06c380 msgr2=0x7f461c070080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:50:19.318 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:19.327+0000 7f4624400640 1 -- 172.21.15.44:0/164592295 shutdown_connections 2024-04-17T19:50:19.318 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:19.327+0000 7f4624400640 1 -- 172.21.15.44:0/164592295 wait complete. 2024-04-17T19:50:19.319 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:19.327+0000 7f4624400640 1 Processor -- start 2024-04-17T19:50:19.319 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:19.327+0000 7f4624400640 1 -- start start 2024-04-17T19:50:19.322 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:19.331+0000 7f4624400640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f461c072700 0x7f461c156180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:50:19.322 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:19.331+0000 7f4624400640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f461c153a00 0x7f461c14f620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:50:19.323 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:19.331+0000 7f4624400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f461c15a320 0x7f461c0cb870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:50:19.323 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:19.331+0000 7f4624400640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f461c0740b0 con 0x7f461c15a320 2024-04-17T19:50:19.323 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:19.331+0000 7f4624400640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f461c073dd0 con 0x7f461c153a00 2024-04-17T19:50:19.323 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:19.331+0000 7f4624400640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7f461c074390 con 0x7f461c072700 2024-04-17T19:50:19.323 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:19.331+0000 7f4622400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f461c15a320 0x7f461c0cb870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:50:19.323 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:19.331+0000 7f4622400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f461c15a320 0x7f461c0cb870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:46960/0 (socket says 172.21.15.44:46960) 2024-04-17T19:50:19.323 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:19.331+0000 7f4622400640 1 -- 172.21.15.44:0/3742211421 learned_addr learned my addr 172.21.15.44:0/3742211421 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-04-17T19:50:19.323 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:19.331+0000 7f4621000640 1 --2- 172.21.15.44:0/3742211421 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f461c153a00 0x7f461c14f620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:50:19.323 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:19.331+0000 7f4621a00640 1 --2- 172.21.15.44:0/3742211421 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f461c072700 0x7f461c156180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:50:19.323 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:19.331+0000 7f4622400640 1 -- 172.21.15.44:0/3742211421 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f461c072700 msgr2=0x7f461c156180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:50:19.323 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:19.331+0000 7f4622400640 1 --2- 172.21.15.44:0/3742211421 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f461c072700 0x7f461c156180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:50:19.323 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:19.331+0000 7f4622400640 1 -- 172.21.15.44:0/3742211421 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f461c153a00 msgr2=0x7f461c14f620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:50:19.323 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:19.331+0000 7f4622400640 1 --2- 172.21.15.44:0/3742211421 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f461c153a00 0x7f461c14f620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:50:19.323 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:19.331+0000 7f4622400640 1 -- 172.21.15.44:0/3742211421 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f461c156ec0 con 0x7f461c15a320 2024-04-17T19:50:19.324 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:19.331+0000 7f4621000640 1 --2- 172.21.15.44:0/3742211421 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f461c153a00 0x7f461c14f620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-17T19:50:19.324 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:19.331+0000 7f4622400640 1 --2- 172.21.15.44:0/3742211421 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f461c15a320 0x7f461c0cb870 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f46140b2040 tx=0x7f461401beb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:50:19.324 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:19.331+0000 7f4619600640 1 -- 172.21.15.44:0/3742211421 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46140b4040 con 0x7f461c15a320 2024-04-17T19:50:19.324 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:19.331+0000 7f4619600640 1 -- 172.21.15.44:0/3742211421 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f46140039a0 con 0x7f461c15a320 2024-04-17T19:50:19.324 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:19.331+0000 7f4619600640 1 -- 172.21.15.44:0/3742211421 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4614009450 con 0x7f461c15a320 2024-04-17T19:50:19.324 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:19.331+0000 7f4624400640 1 -- 172.21.15.44:0/3742211421 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f461c14fb60 con 0x7f461c15a320 2024-04-17T19:50:19.324 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:19.331+0000 7f4624400640 1 -- 172.21.15.44:0/3742211421 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f461c155bc0 con 0x7f461c15a320 2024-04-17T19:50:19.324 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:19.331+0000 7f4624400640 1 -- 172.21.15.44:0/3742211421 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f461c156c30 con 0x7f461c15a320 2024-04-17T19:50:19.325 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:19.335+0000 7f4619600640 1 -- 172.21.15.44:0/3742211421 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f4614004030 con 0x7f461c15a320 2024-04-17T19:50:19.326 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:19.335+0000 7f4619600640 1 --2- 172.21.15.44:0/3742211421 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f45fc0683b0 0x7f45fc06a8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:50:19.326 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:19.335+0000 7f4619600640 1 -- 172.21.15.44:0/3742211421 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6619+0+0 (secure 0 0 0) 0x7f4614125210 con 0x7f461c15a320 2024-04-17T19:50:19.326 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:19.335+0000 7f4621a00640 1 --2- 172.21.15.44:0/3742211421 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f45fc0683b0 0x7f45fc06a8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:50:19.327 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:19.335+0000 7f4621a00640 1 --2- 172.21.15.44:0/3742211421 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f45fc0683b0 0x7f45fc06a8c0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f4610000f70 tx=0x7f4610007c10 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:50:19.329 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:19.339+0000 7f4619600640 1 -- 172.21.15.44:0/3742211421 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f4614018c70 con 0x7f461c15a320 2024-04-17T19:50:19.494 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:19.503+0000 7f4624400640 1 -- 172.21.15.44:0/3742211421 --> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "1", "target": ["mon-mgr", ""]}) -- 0x7f461c04ff10 con 0x7f45fc0683b0 2024-04-17T19:50:19.495 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:19.503+0000 7f4619600640 1 -- 172.21.15.44:0/3742211421 <== mgr.4102 v2:172.21.15.62:6832/1020159798 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 1 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f461c04ff10 con 0x7f45fc0683b0 2024-04-17T19:50:19.495 INFO:teuthology.orchestra.run.smithi044.stderr:instructed osd(s) 1 to deep-scrub 2024-04-17T19:50:19.498 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:19.507+0000 7f4624400640 1 -- 172.21.15.44:0/3742211421 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f45fc0683b0 msgr2=0x7f45fc06a8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:50:19.498 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:19.507+0000 7f4624400640 1 --2- 172.21.15.44:0/3742211421 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f45fc0683b0 0x7f45fc06a8c0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f4610000f70 tx=0x7f4610007c10 comp rx=0 tx=0).stop 2024-04-17T19:50:19.498 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:19.507+0000 7f4624400640 1 -- 172.21.15.44:0/3742211421 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f461c15a320 msgr2=0x7f461c0cb870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:50:19.498 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:19.507+0000 7f4624400640 1 --2- 172.21.15.44:0/3742211421 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f461c15a320 0x7f461c0cb870 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f46140b2040 tx=0x7f461401beb0 comp rx=0 tx=0).stop 2024-04-17T19:50:19.498 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:19.507+0000 7f4624400640 1 -- 172.21.15.44:0/3742211421 shutdown_connections 2024-04-17T19:50:19.498 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:19.507+0000 7f4624400640 1 --2- 172.21.15.44:0/3742211421 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f45fc0683b0 0x7f45fc06a8c0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:50:19.498 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:19.507+0000 7f4624400640 1 --2- 172.21.15.44:0/3742211421 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f461c15a320 0x7f461c0cb870 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:50:19.498 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:19.507+0000 7f4624400640 1 --2- 172.21.15.44:0/3742211421 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f461c153a00 0x7f461c14f620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:50:19.499 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:19.507+0000 7f4624400640 1 --2- 172.21.15.44:0/3742211421 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f461c072700 0x7f461c156180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:50:19.499 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:19.507+0000 7f4624400640 1 -- 172.21.15.44:0/3742211421 >> 172.21.15.44:0/3742211421 conn(0x7f461c06c380 msgr2=0x7f461c1467d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:50:19.499 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:19.507+0000 7f4624400640 1 -- 172.21.15.44:0/3742211421 shutdown_connections 2024-04-17T19:50:19.499 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:19.507+0000 7f4624400640 1 -- 172.21.15.44:0/3742211421 wait complete. 2024-04-17T19:50:19.518 INFO:tasks.ceph:Scrubbing osd.2 2024-04-17T19:50:19.519 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2024-04-17T19:50:19.674 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:19.683+0000 7f5d32a00640 1 Processor -- start 2024-04-17T19:50:19.674 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:19.683+0000 7f5d32a00640 1 -- start start 2024-04-17T19:50:19.676 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:19.687+0000 7f5d32a00640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f5d2c0c83d0 0x7f5d2c0c4870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:50:19.677 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:19.687+0000 7f5d32a00640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f5d2c0c4db0 0x7f5d2c162f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:50:19.677 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:19.687+0000 7f5d32a00640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5d2c0c6c20 con 0x7f5d2c0c7fc0 2024-04-17T19:50:19.677 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:19.687+0000 7f5d32a00640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 -- 0x7f5d2c152d20 con 0x7f5d2c0c83d0 2024-04-17T19:50:19.677 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:19.687+0000 7f5d32a00640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7f5d2c0c6ee0 con 0x7f5d2c0c4db0 2024-04-17T19:50:19.677 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:19.687+0000 7f5d23e00640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f5d2c0c83d0 0x7f5d2c0c4870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:50:19.677 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:19.687+0000 7f5d23e00640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f5d2c0c83d0 0x7f5d2c0c4870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:46966/0 (socket says 172.21.15.44:46966) 2024-04-17T19:50:19.677 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:19.687+0000 7f5d23e00640 1 -- 172.21.15.44:0/1886906097 learned_addr learned my addr 172.21.15.44:0/1886906097 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-04-17T19:50:19.677 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:19.687+0000 7f5d30a00640 1 --2- 172.21.15.44:0/1886906097 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f5d2c0c4db0 0x7f5d2c162f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:50:19.678 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:19.687+0000 7f5d23e00640 1 -- 172.21.15.44:0/1886906097 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f5d2c0c4db0 msgr2=0x7f5d2c162f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T19:50:19.678 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:19.687+0000 7f5d23e00640 1 --2- 172.21.15.44:0/1886906097 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f5d2c0c4db0 0x7f5d2c162f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:50:19.678 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:19.687+0000 7f5d23e00640 1 -- 172.21.15.44:0/1886906097 >> v1:172.21.15.62:6789/0 conn(0x7f5d2c0c7fc0 legacy=0x7f5d2c152610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:50:19.678 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:19.687+0000 7f5d23e00640 1 -- 172.21.15.44:0/1886906097 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5d2c0c4000 con 0x7f5d2c0c83d0 2024-04-17T19:50:19.678 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:19.687+0000 7f5d30a00640 1 --2- 172.21.15.44:0/1886906097 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f5d2c0c4db0 0x7f5d2c162f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-17T19:50:19.680 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:19.687+0000 7f5d23e00640 1 --2- 172.21.15.44:0/1886906097 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5d2c0c83d0 0x7f5d2c0c4870 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f5d14009870 tx=0x7f5d1401c440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=27ec18df5af9f9b5 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:50:19.680 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:19.687+0000 7f5d2b400640 1 -- 172.21.15.44:0/1886906097 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d140b0070 con 0x7f5d2c0c83d0 2024-04-17T19:50:19.680 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:19.691+0000 7f5d2b400640 1 -- 172.21.15.44:0/1886906097 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5d140ab600 con 0x7f5d2c0c83d0 2024-04-17T19:50:19.680 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:19.691+0000 7f5d2b400640 1 -- 172.21.15.44:0/1886906097 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d140ab9d0 con 0x7f5d2c0c83d0 2024-04-17T19:50:19.681 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:19.691+0000 7f5d32a00640 1 -- 172.21.15.44:0/1886906097 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5d2c0c83d0 msgr2=0x7f5d2c0c4870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:50:19.681 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:19.691+0000 7f5d32a00640 1 --2- 172.21.15.44:0/1886906097 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5d2c0c83d0 0x7f5d2c0c4870 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f5d14009870 tx=0x7f5d1401c440 comp rx=0 tx=0).stop 2024-04-17T19:50:19.681 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:19.691+0000 7f5d32a00640 1 -- 172.21.15.44:0/1886906097 shutdown_connections 2024-04-17T19:50:19.681 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:19.691+0000 7f5d32a00640 1 --2- 172.21.15.44:0/1886906097 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f5d2c0c4db0 0x7f5d2c162f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:50:19.681 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:19.691+0000 7f5d32a00640 1 --2- 172.21.15.44:0/1886906097 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5d2c0c83d0 0x7f5d2c0c4870 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:50:19.681 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:19.691+0000 7f5d32a00640 1 -- 172.21.15.44:0/1886906097 >> 172.21.15.44:0/1886906097 conn(0x7f5d2c0c9ad0 msgr2=0x7f5d2c0cc9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:50:19.681 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:19.691+0000 7f5d32a00640 1 -- 172.21.15.44:0/1886906097 shutdown_connections 2024-04-17T19:50:19.681 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:19.691+0000 7f5d32a00640 1 -- 172.21.15.44:0/1886906097 wait complete. 2024-04-17T19:50:19.683 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:19.691+0000 7f5d32a00640 1 Processor -- start 2024-04-17T19:50:19.683 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:19.691+0000 7f5d32a00640 1 -- start start 2024-04-17T19:50:19.685 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:19.695+0000 7f5d32a00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5d2c0c4db0 0x7f5d2c162d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:50:19.685 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:19.695+0000 7f5d32a00640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f5d2c0c7fc0 0x7f5d2c157fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:50:19.685 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:19.695+0000 7f5d32a00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5d2c0c83d0 0x7f5d2c1f8920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:50:19.685 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:19.695+0000 7f5d32a00640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f5d2c0c6870 con 0x7f5d2c0c4db0 2024-04-17T19:50:19.686 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:19.695+0000 7f5d32a00640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f5d2c0c7a20 con 0x7f5d2c0c83d0 2024-04-17T19:50:19.686 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:19.695+0000 7f5d32a00640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7f5d2c1f9330 con 0x7f5d2c0c7fc0 2024-04-17T19:50:19.686 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:19.695+0000 7f5d2be00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5d2c0c4db0 0x7f5d2c162d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:50:19.686 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:19.695+0000 7f5d2be00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5d2c0c4db0 0x7f5d2c162d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:46972/0 (socket says 172.21.15.44:46972) 2024-04-17T19:50:19.686 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:19.695+0000 7f5d2be00640 1 -- 172.21.15.44:0/1772743346 learned_addr learned my addr 172.21.15.44:0/1772743346 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-04-17T19:50:19.686 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:19.695+0000 7f5d23e00640 1 --2- 172.21.15.44:0/1772743346 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f5d2c0c7fc0 0x7f5d2c157fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:50:19.686 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:19.695+0000 7f5d30a00640 1 --2- 172.21.15.44:0/1772743346 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5d2c0c83d0 0x7f5d2c1f8920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:50:19.686 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:19.695+0000 7f5d2be00640 1 -- 172.21.15.44:0/1772743346 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f5d2c0c7fc0 msgr2=0x7f5d2c157fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:50:19.686 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:19.695+0000 7f5d2be00640 1 --2- 172.21.15.44:0/1772743346 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f5d2c0c7fc0 0x7f5d2c157fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:50:19.686 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:19.695+0000 7f5d2be00640 1 -- 172.21.15.44:0/1772743346 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5d2c0c83d0 msgr2=0x7f5d2c1f8920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:50:19.686 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:19.695+0000 7f5d2be00640 1 --2- 172.21.15.44:0/1772743346 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5d2c0c83d0 0x7f5d2c1f8920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:50:19.686 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:19.695+0000 7f5d2be00640 1 -- 172.21.15.44:0/1772743346 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5d2c1f6040 con 0x7f5d2c0c4db0 2024-04-17T19:50:19.686 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:19.695+0000 7f5d2be00640 1 --2- 172.21.15.44:0/1772743346 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5d2c0c4db0 0x7f5d2c162d50 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f5d1c00c370 tx=0x7f5d1c00c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:50:19.687 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:19.695+0000 7f5d28c00640 1 -- 172.21.15.44:0/1772743346 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d1c0052d0 con 0x7f5d2c0c4db0 2024-04-17T19:50:19.687 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:19.695+0000 7f5d28c00640 1 -- 172.21.15.44:0/1772743346 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5d1c005470 con 0x7f5d2c0c4db0 2024-04-17T19:50:19.687 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:19.695+0000 7f5d28c00640 1 -- 172.21.15.44:0/1772743346 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d1c007260 con 0x7f5d2c0c4db0 2024-04-17T19:50:19.687 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:19.695+0000 7f5d32a00640 1 -- 172.21.15.44:0/1772743346 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5d2c1f8e60 con 0x7f5d2c0c4db0 2024-04-17T19:50:19.688 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:19.695+0000 7f5d32a00640 1 -- 172.21.15.44:0/1772743346 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5d2c1f5710 con 0x7f5d2c0c4db0 2024-04-17T19:50:19.688 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:19.695+0000 7f5d32a00640 1 -- 172.21.15.44:0/1772743346 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f5d2c075f10 con 0x7f5d2c0c4db0 2024-04-17T19:50:19.688 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:19.695+0000 7f5d28c00640 1 -- 172.21.15.44:0/1772743346 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f5d1c007400 con 0x7f5d2c0c4db0 2024-04-17T19:50:19.689 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:19.699+0000 7f5d28c00640 1 --2- 172.21.15.44:0/1772743346 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f5d08068380 0x7f5d0806a890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:50:19.689 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:19.699+0000 7f5d28c00640 1 -- 172.21.15.44:0/1772743346 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6619+0+0 (secure 0 0 0) 0x7f5d1c0868d0 con 0x7f5d2c0c4db0 2024-04-17T19:50:19.689 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:19.699+0000 7f5d28c00640 1 --2- 172.21.15.44:0/1772743346 >> [v2:172.21.15.44:6816/1160071918,v1:172.21.15.44:6818/1160071918] conn(0x7f5d08071be0 0x7f5d080740d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:50:19.689 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:19.699+0000 7f5d28c00640 1 -- 172.21.15.44:0/1772743346 --> [v2:172.21.15.44:6816/1160071918,v1:172.21.15.44:6818/1160071918] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f5d080747a0 con 0x7f5d08071be0 2024-04-17T19:50:19.689 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:19.699+0000 7f5d28c00640 1 -- 172.21.15.44:0/1772743346 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f5d1c086d60 con 0x7f5d2c0c4db0 2024-04-17T19:50:19.689 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:19.699+0000 7f5d23e00640 1 --2- 172.21.15.44:0/1772743346 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f5d08068380 0x7f5d0806a890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:50:19.690 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:19.699+0000 7f5d30a00640 1 --2- 172.21.15.44:0/1772743346 >> [v2:172.21.15.44:6816/1160071918,v1:172.21.15.44:6818/1160071918] conn(0x7f5d08071be0 0x7f5d080740d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:50:19.690 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:19.699+0000 7f5d30a00640 1 --2- 172.21.15.44:0/1772743346 >> [v2:172.21.15.44:6816/1160071918,v1:172.21.15.44:6818/1160071918] conn(0x7f5d08071be0 0x7f5d080740d0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:50:19.690 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:19.699+0000 7f5d23e00640 1 --2- 172.21.15.44:0/1772743346 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f5d08068380 0x7f5d0806a890 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f5d140ad000 tx=0x7f5d14008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:50:19.690 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:19.699+0000 7f5d28c00640 1 -- 172.21.15.44:0/1772743346 <== osd.2 v2:172.21.15.44:6816/1160071918 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f5d080747a0 con 0x7f5d08071be0 2024-04-17T19:50:19.704 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:19.711+0000 7f5d32a00640 1 -- 172.21.15.44:0/1772743346 --> [v2:172.21.15.44:6816/1160071918,v1:172.21.15.44:6818/1160071918] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f5d2c152810 con 0x7f5d08071be0 2024-04-17T19:50:19.704 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:19.715+0000 7f5d28c00640 1 -- 172.21.15.44:0/1772743346 <== osd.2 v2:172.21.15.44:6816/1160071918 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f5d2c152810 con 0x7f5d08071be0 2024-04-17T19:50:19.704 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2024-04-17T19:50:19.704 INFO:teuthology.orchestra.run.smithi044.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-17T19:50:19.705 INFO:teuthology.orchestra.run.smithi044.stdout:} 2024-04-17T19:50:19.705 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:19.715+0000 7f5d32a00640 1 -- 172.21.15.44:0/1772743346 >> [v2:172.21.15.44:6816/1160071918,v1:172.21.15.44:6818/1160071918] conn(0x7f5d08071be0 msgr2=0x7f5d080740d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:50:19.705 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:19.715+0000 7f5d32a00640 1 --2- 172.21.15.44:0/1772743346 >> [v2:172.21.15.44:6816/1160071918,v1:172.21.15.44:6818/1160071918] conn(0x7f5d08071be0 0x7f5d080740d0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:50:19.705 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:19.715+0000 7f5d32a00640 1 -- 172.21.15.44:0/1772743346 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f5d08068380 msgr2=0x7f5d0806a890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:50:19.706 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:19.715+0000 7f5d32a00640 1 --2- 172.21.15.44:0/1772743346 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f5d08068380 0x7f5d0806a890 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f5d140ad000 tx=0x7f5d14008040 comp rx=0 tx=0).stop 2024-04-17T19:50:19.706 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:19.715+0000 7f5d32a00640 1 -- 172.21.15.44:0/1772743346 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5d2c0c4db0 msgr2=0x7f5d2c162d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:50:19.706 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:19.715+0000 7f5d32a00640 1 --2- 172.21.15.44:0/1772743346 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5d2c0c4db0 0x7f5d2c162d50 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f5d1c00c370 tx=0x7f5d1c00c830 comp rx=0 tx=0).stop 2024-04-17T19:50:19.706 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:19.715+0000 7f5d30a00640 1 -- 172.21.15.44:0/1772743346 reap_dead start 2024-04-17T19:50:19.706 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:19.715+0000 7f5d32a00640 1 -- 172.21.15.44:0/1772743346 shutdown_connections 2024-04-17T19:50:19.706 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:19.715+0000 7f5d32a00640 1 -- 172.21.15.44:0/1772743346 >> 172.21.15.44:0/1772743346 conn(0x7f5d2c0c9ad0 msgr2=0x7f5d2c0ca8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:50:19.706 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:19.715+0000 7f5d32a00640 1 -- 172.21.15.44:0/1772743346 shutdown_connections 2024-04-17T19:50:19.706 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:19.715+0000 7f5d32a00640 1 -- 172.21.15.44:0/1772743346 wait complete. 2024-04-17T19:50:19.724 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2024-04-17T19:50:19.876 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:19.887+0000 7f61d0800640 1 Processor -- start 2024-04-17T19:50:19.876 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:19.887+0000 7f61d0800640 1 -- start start 2024-04-17T19:50:19.878 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:19.887+0000 7f61d0800640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f61c8072700 0x7f61c8153a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:50:19.879 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:19.887+0000 7f61d0800640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f61c80c60e0 0x7f61c80c64f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:50:19.879 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:19.887+0000 7f61d0800640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f61c8159de0 0x7f61c815a1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:50:19.879 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:19.887+0000 7f61d0800640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 -- 0x7f61c8072b10 con 0x7f61c80c60e0 2024-04-17T19:50:19.879 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:19.887+0000 7f61d0800640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 -- 0x7f61c815a730 con 0x7f61c8159de0 2024-04-17T19:50:19.879 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:19.887+0000 7f61d0800640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7f61c8072d60 con 0x7f61c8072700 2024-04-17T19:50:19.879 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:19.887+0000 7f61cd400640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f61c80c60e0 0x7f61c80c64f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:50:19.879 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:19.887+0000 7f61cd400640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f61c80c60e0 0x7f61c80c64f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:46984/0 (socket says 172.21.15.44:46984) 2024-04-17T19:50:19.879 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:19.887+0000 7f61cd400640 1 -- 172.21.15.44:0/3974084647 learned_addr learned my addr 172.21.15.44:0/3974084647 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-04-17T19:50:19.879 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:19.887+0000 7f61ce800640 1 --2- 172.21.15.44:0/3974084647 >> v2:172.21.15.62:3300/0 conn(0x7f61c8159de0 0x7f61c815a1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:50:19.879 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:19.887+0000 7f61cde00640 1 --2- 172.21.15.44:0/3974084647 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f61c8072700 0x7f61c8153a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:50:19.879 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:19.887+0000 7f61cd400640 1 -- 172.21.15.44:0/3974084647 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f61c8072700 msgr2=0x7f61c8153a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T19:50:19.879 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:19.887+0000 7f61cd400640 1 --2- 172.21.15.44:0/3974084647 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f61c8072700 0x7f61c8153a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:50:19.879 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:19.887+0000 7f61cd400640 1 -- 172.21.15.44:0/3974084647 >> v2:172.21.15.62:3300/0 conn(0x7f61c8159de0 msgr2=0x7f61c815a1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T19:50:19.879 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:19.887+0000 7f61cd400640 1 --2- 172.21.15.44:0/3974084647 >> v2:172.21.15.62:3300/0 conn(0x7f61c8159de0 0x7f61c815a1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:50:19.879 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:19.887+0000 7f61cd400640 1 -- 172.21.15.44:0/3974084647 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f61c8073810 con 0x7f61c80c60e0 2024-04-17T19:50:19.881 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:19.891+0000 7f61cd400640 1 --2- 172.21.15.44:0/3974084647 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f61c80c60e0 0x7f61c80c64f0 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f61c806cd40 tx=0x7f61b801ed10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7f280b943f82211a server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:50:19.882 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:19.891+0000 7f61cca00640 1 -- 172.21.15.44:0/3974084647 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61b80b5070 con 0x7f61c80c60e0 2024-04-17T19:50:19.882 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:19.891+0000 7f61cca00640 1 -- 172.21.15.44:0/3974084647 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f61b80a89d0 con 0x7f61c80c60e0 2024-04-17T19:50:19.882 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:19.891+0000 7f61cca00640 1 -- 172.21.15.44:0/3974084647 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61b80a8da0 con 0x7f61c80c60e0 2024-04-17T19:50:19.882 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:19.891+0000 7f61d0800640 1 -- 172.21.15.44:0/3974084647 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f61c80c60e0 msgr2=0x7f61c80c64f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:50:19.883 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:19.891+0000 7f61d0800640 1 --2- 172.21.15.44:0/3974084647 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f61c80c60e0 0x7f61c80c64f0 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f61c806cd40 tx=0x7f61b801ed10 comp rx=0 tx=0).stop 2024-04-17T19:50:19.883 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:19.891+0000 7f61d0800640 1 -- 172.21.15.44:0/3974084647 shutdown_connections 2024-04-17T19:50:19.883 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:19.891+0000 7f61d0800640 1 --2- 172.21.15.44:0/3974084647 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f61c80c60e0 0x7f61c80c64f0 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:50:19.883 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:19.891+0000 7f61d0800640 1 --2- 172.21.15.44:0/3974084647 >> v2:172.21.15.62:3300/0 conn(0x7f61c8159de0 0x7f61c815a1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:50:19.883 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:19.891+0000 7f61d0800640 1 --2- 172.21.15.44:0/3974084647 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f61c8072700 0x7f61c8153a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:50:19.883 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:19.891+0000 7f61d0800640 1 -- 172.21.15.44:0/3974084647 >> 172.21.15.44:0/3974084647 conn(0x7f61c806c380 msgr2=0x7f61c8070080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:50:19.883 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:19.891+0000 7f61d0800640 1 -- 172.21.15.44:0/3974084647 shutdown_connections 2024-04-17T19:50:19.883 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:19.891+0000 7f61d0800640 1 -- 172.21.15.44:0/3974084647 wait complete. 2024-04-17T19:50:19.885 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:19.895+0000 7f61d0800640 1 Processor -- start 2024-04-17T19:50:19.885 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:19.895+0000 7f61d0800640 1 -- start start 2024-04-17T19:50:19.887 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:19.895+0000 7f61d0800640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f61c8072700 0x7f61c80c4250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:50:19.887 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:19.895+0000 7f61d0800640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f61c80c60e0 0x7f61c814bae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:50:19.887 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:19.895+0000 7f61d0800640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f61c8159de0 0x7f61c81f58c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:50:19.887 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:19.895+0000 7f61d0800640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f61c80740b0 con 0x7f61c80c60e0 2024-04-17T19:50:19.887 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:19.895+0000 7f61d0800640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f61c8073dd0 con 0x7f61c8159de0 2024-04-17T19:50:19.887 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:19.895+0000 7f61d0800640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7f61c8074390 con 0x7f61c8072700 2024-04-17T19:50:19.888 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:19.895+0000 7f61cd400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f61c80c60e0 0x7f61c814bae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:50:19.888 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:19.895+0000 7f61cd400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f61c80c60e0 0x7f61c814bae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:46998/0 (socket says 172.21.15.44:46998) 2024-04-17T19:50:19.888 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:19.895+0000 7f61cd400640 1 -- 172.21.15.44:0/1321903423 learned_addr learned my addr 172.21.15.44:0/1321903423 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-04-17T19:50:19.888 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:19.895+0000 7f61cde00640 1 --2- 172.21.15.44:0/1321903423 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f61c8072700 0x7f61c80c4250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:50:19.888 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:19.895+0000 7f61ce800640 1 --2- 172.21.15.44:0/1321903423 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f61c8159de0 0x7f61c81f58c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:50:19.888 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:19.895+0000 7f61cd400640 1 -- 172.21.15.44:0/1321903423 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f61c8072700 msgr2=0x7f61c80c4250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:50:19.888 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:19.895+0000 7f61cd400640 1 --2- 172.21.15.44:0/1321903423 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f61c8072700 0x7f61c80c4250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:50:19.888 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:19.895+0000 7f61cd400640 1 -- 172.21.15.44:0/1321903423 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f61c8159de0 msgr2=0x7f61c81f58c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:50:19.888 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:19.895+0000 7f61cd400640 1 --2- 172.21.15.44:0/1321903423 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f61c8159de0 0x7f61c81f58c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:50:19.888 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:19.895+0000 7f61cd400640 1 -- 172.21.15.44:0/1321903423 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f61c80c5a90 con 0x7f61c80c60e0 2024-04-17T19:50:19.888 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:19.895+0000 7f61cd400640 1 --2- 172.21.15.44:0/1321903423 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f61c80c60e0 0x7f61c814bae0 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f61b80b3040 tx=0x7f61b801bab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:50:19.889 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:19.895+0000 7f61c2000640 1 -- 172.21.15.44:0/1321903423 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61b80b5070 con 0x7f61c80c60e0 2024-04-17T19:50:19.889 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:19.895+0000 7f61c2000640 1 -- 172.21.15.44:0/1321903423 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f61b80b0a50 con 0x7f61c80c60e0 2024-04-17T19:50:19.889 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:19.895+0000 7f61c2000640 1 -- 172.21.15.44:0/1321903423 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61b80b0e00 con 0x7f61c80c60e0 2024-04-17T19:50:19.889 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:19.895+0000 7f61d0800640 1 -- 172.21.15.44:0/1321903423 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f61c814c020 con 0x7f61c80c60e0 2024-04-17T19:50:19.889 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:19.895+0000 7f61d0800640 1 -- 172.21.15.44:0/1321903423 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f61c80c5d00 con 0x7f61c80c60e0 2024-04-17T19:50:19.889 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:19.899+0000 7f61d0800640 1 -- 172.21.15.44:0/1321903423 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f61c80c5ed0 con 0x7f61c80c60e0 2024-04-17T19:50:19.890 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:19.899+0000 7f61c2000640 1 -- 172.21.15.44:0/1321903423 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f61b80b9030 con 0x7f61c80c60e0 2024-04-17T19:50:19.891 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:19.899+0000 7f61c2000640 1 --2- 172.21.15.44:0/1321903423 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f61ac0683b0 0x7f61ac06a8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:50:19.891 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:19.899+0000 7f61c2000640 1 -- 172.21.15.44:0/1321903423 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6619+0+0 (secure 0 0 0) 0x7f61b8123f90 con 0x7f61c80c60e0 2024-04-17T19:50:19.891 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:19.899+0000 7f61cde00640 1 --2- 172.21.15.44:0/1321903423 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f61ac0683b0 0x7f61ac06a8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:50:19.893 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:19.903+0000 7f61cde00640 1 --2- 172.21.15.44:0/1321903423 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f61ac0683b0 0x7f61ac06a8c0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f61bc0045f0 tx=0x7f61bc008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:50:19.896 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:19.903+0000 7f61c2000640 1 -- 172.21.15.44:0/1321903423 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f61b8018870 con 0x7f61c80c60e0 2024-04-17T19:50:20.062 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:20.071+0000 7f61d0800640 1 -- 172.21.15.44:0/1321903423 --> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "2", "target": ["mon-mgr", ""]}) -- 0x7f61c814c4f0 con 0x7f61ac0683b0 2024-04-17T19:50:20.063 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:20.071+0000 7f61c2000640 1 -- 172.21.15.44:0/1321903423 <== mgr.4102 v2:172.21.15.62:6832/1020159798 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 2 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f61bc00b6a0 con 0x7f61ac0683b0 2024-04-17T19:50:20.063 INFO:teuthology.orchestra.run.smithi044.stderr:instructed osd(s) 2 to deep-scrub 2024-04-17T19:50:20.065 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:20.075+0000 7f61d0800640 1 -- 172.21.15.44:0/1321903423 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f61ac0683b0 msgr2=0x7f61ac06a8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:50:20.066 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:20.075+0000 7f61d0800640 1 --2- 172.21.15.44:0/1321903423 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f61ac0683b0 0x7f61ac06a8c0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f61bc0045f0 tx=0x7f61bc008040 comp rx=0 tx=0).stop 2024-04-17T19:50:20.066 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:20.075+0000 7f61d0800640 1 -- 172.21.15.44:0/1321903423 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f61c80c60e0 msgr2=0x7f61c814bae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:50:20.066 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:20.075+0000 7f61d0800640 1 --2- 172.21.15.44:0/1321903423 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f61c80c60e0 0x7f61c814bae0 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f61b80b3040 tx=0x7f61b801bab0 comp rx=0 tx=0).stop 2024-04-17T19:50:20.066 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:20.075+0000 7f61d0800640 1 -- 172.21.15.44:0/1321903423 shutdown_connections 2024-04-17T19:50:20.066 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:20.075+0000 7f61d0800640 1 --2- 172.21.15.44:0/1321903423 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f61ac0683b0 0x7f61ac06a8c0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:50:20.066 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:20.075+0000 7f61d0800640 1 --2- 172.21.15.44:0/1321903423 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f61c8159de0 0x7f61c81f58c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:50:20.066 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:20.075+0000 7f61d0800640 1 --2- 172.21.15.44:0/1321903423 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f61c80c60e0 0x7f61c814bae0 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:50:20.066 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:20.075+0000 7f61d0800640 1 --2- 172.21.15.44:0/1321903423 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f61c8072700 0x7f61c80c4250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:50:20.066 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:20.075+0000 7f61d0800640 1 -- 172.21.15.44:0/1321903423 >> 172.21.15.44:0/1321903423 conn(0x7f61c806c380 msgr2=0x7f61c814f0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:50:20.066 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:20.075+0000 7f61d0800640 1 -- 172.21.15.44:0/1321903423 shutdown_connections 2024-04-17T19:50:20.066 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:20.075+0000 7f61d0800640 1 -- 172.21.15.44:0/1321903423 wait complete. 2024-04-17T19:50:20.085 INFO:tasks.ceph:Scrubbing osd.3 2024-04-17T19:50:20.086 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2024-04-17T19:50:20.242 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:20.251+0000 7f72e2a00640 1 Processor -- start 2024-04-17T19:50:20.242 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:20.251+0000 7f72e2a00640 1 -- start start 2024-04-17T19:50:20.244 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:20.251+0000 7f72e2a00640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f72dc1538b0 0x7f72dc072590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:50:20.245 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:20.251+0000 7f72e2a00640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f72dc15d7c0 0x7f72dc0c64f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:50:20.245 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:20.251+0000 7f72e2a00640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f72dc0736b0 con 0x7f72dc0c60e0 2024-04-17T19:50:20.245 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:20.251+0000 7f72e2a00640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 -- 0x7f72dc073990 con 0x7f72dc1538b0 2024-04-17T19:50:20.245 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:20.251+0000 7f72e2a00640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 -- 0x7f72dc073c70 con 0x7f72dc15d7c0 2024-04-17T19:50:20.245 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:20.255+0000 7f72dbe00640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f72dc1538b0 0x7f72dc072590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:50:20.245 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:20.255+0000 7f72d3e00640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f72dc0c60e0 0x7f72dc15d0b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:59018/0 (socket says 172.21.15.44:59018) 2024-04-17T19:50:20.245 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:20.255+0000 7f72d3e00640 1 -- 172.21.15.44:0/1551484605 learned_addr learned my addr 172.21.15.44:0/1551484605 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-04-17T19:50:20.245 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:20.255+0000 7f72e0a00640 1 --2- 172.21.15.44:0/1551484605 >> v2:172.21.15.62:3300/0 conn(0x7f72dc15d7c0 0x7f72dc0c64f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:50:20.245 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:20.255+0000 7f72dbe00640 1 -- 172.21.15.44:0/1551484605 >> v2:172.21.15.62:3300/0 conn(0x7f72dc15d7c0 msgr2=0x7f72dc0c64f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T19:50:20.245 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:20.255+0000 7f72dbe00640 1 --2- 172.21.15.44:0/1551484605 >> v2:172.21.15.62:3300/0 conn(0x7f72dc15d7c0 0x7f72dc0c64f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:50:20.245 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:20.255+0000 7f72dbe00640 1 -- 172.21.15.44:0/1551484605 >> v1:172.21.15.44:6789/0 conn(0x7f72dc0c60e0 legacy=0x7f72dc15d0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:50:20.245 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:20.255+0000 7f72dbe00640 1 -- 172.21.15.44:0/1551484605 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f72dc073f50 con 0x7f72dc1538b0 2024-04-17T19:50:20.245 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:20.255+0000 7f72db400640 1 -- 172.21.15.44:0/1551484605 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 218980747 0 0) 0x7f72dc0736b0 con 0x7f72dc0c60e0 2024-04-17T19:50:20.248 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:20.255+0000 7f72dbe00640 1 --2- 172.21.15.44:0/1551484605 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f72dc1538b0 0x7f72dc072590 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f72cc0097c0 tx=0x7f72cc01ec50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e9fd022e9b442f17 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:50:20.248 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:20.255+0000 7f72db400640 1 -- 172.21.15.44:0/1551484605 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72cc0b5070 con 0x7f72dc1538b0 2024-04-17T19:50:20.248 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:20.255+0000 7f72db400640 1 -- 172.21.15.44:0/1551484605 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f72cc0a8950 con 0x7f72dc1538b0 2024-04-17T19:50:20.248 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:20.255+0000 7f72db400640 1 -- 172.21.15.44:0/1551484605 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72cc0a8d20 con 0x7f72dc1538b0 2024-04-17T19:50:20.249 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:20.259+0000 7f72e2a00640 1 -- 172.21.15.44:0/1551484605 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f72dc1538b0 msgr2=0x7f72dc072590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:50:20.249 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:20.259+0000 7f72e2a00640 1 --2- 172.21.15.44:0/1551484605 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f72dc1538b0 0x7f72dc072590 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f72cc0097c0 tx=0x7f72cc01ec50 comp rx=0 tx=0).stop 2024-04-17T19:50:20.249 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:20.259+0000 7f72e2a00640 1 -- 172.21.15.44:0/1551484605 shutdown_connections 2024-04-17T19:50:20.249 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:20.259+0000 7f72e2a00640 1 --2- 172.21.15.44:0/1551484605 >> v2:172.21.15.62:3300/0 conn(0x7f72dc15d7c0 0x7f72dc0c64f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:50:20.249 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:20.259+0000 7f72e2a00640 1 --2- 172.21.15.44:0/1551484605 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f72dc1538b0 0x7f72dc072590 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:50:20.249 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:20.259+0000 7f72e2a00640 1 -- 172.21.15.44:0/1551484605 >> 172.21.15.44:0/1551484605 conn(0x7f72dc0c9ad0 msgr2=0x7f72dc0cc9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:50:20.249 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:20.259+0000 7f72e2a00640 1 -- 172.21.15.44:0/1551484605 shutdown_connections 2024-04-17T19:50:20.249 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:20.259+0000 7f72e2a00640 1 -- 172.21.15.44:0/1551484605 wait complete. 2024-04-17T19:50:20.251 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:20.259+0000 7f72e2a00640 1 Processor -- start 2024-04-17T19:50:20.251 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:20.259+0000 7f72e2a00640 1 -- start start 2024-04-17T19:50:20.253 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:20.263+0000 7f72e2a00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f72dc0c60e0 0x7f72dc1f27b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:50:20.253 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:20.263+0000 7f72e2a00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f72dc1538b0 0x7f72dc1e55b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:50:20.253 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:20.263+0000 7f72e2a00640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f72dc15d7c0 0x7f72dc1e7390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:50:20.253 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:20.263+0000 7f72e2a00640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f72dc0c9130 con 0x7f72dc0c60e0 2024-04-17T19:50:20.253 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:20.263+0000 7f72e2a00640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f72dc153cc0 con 0x7f72dc1538b0 2024-04-17T19:50:20.253 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:20.263+0000 7f72e2a00640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7f72dc072ad0 con 0x7f72dc15d7c0 2024-04-17T19:50:20.253 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:20.263+0000 7f72dbe00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f72dc0c60e0 0x7f72dc1f27b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:50:20.254 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:20.263+0000 7f72dbe00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f72dc0c60e0 0x7f72dc1f27b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:47002/0 (socket says 172.21.15.44:47002) 2024-04-17T19:50:20.254 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:20.263+0000 7f72dbe00640 1 -- 172.21.15.44:0/3362289832 learned_addr learned my addr 172.21.15.44:0/3362289832 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-04-17T19:50:20.254 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:20.263+0000 7f72d3e00640 1 --2- 172.21.15.44:0/3362289832 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f72dc1538b0 0x7f72dc1e55b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:50:20.254 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:20.263+0000 7f72e0a00640 1 --2- 172.21.15.44:0/3362289832 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f72dc15d7c0 0x7f72dc1e7390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:50:20.254 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:20.263+0000 7f72dbe00640 1 -- 172.21.15.44:0/3362289832 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f72dc15d7c0 msgr2=0x7f72dc1e7390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:50:20.254 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:20.263+0000 7f72dbe00640 1 --2- 172.21.15.44:0/3362289832 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f72dc15d7c0 0x7f72dc1e7390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:50:20.254 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:20.263+0000 7f72dbe00640 1 -- 172.21.15.44:0/3362289832 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f72dc1538b0 msgr2=0x7f72dc1e55b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:50:20.254 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:20.263+0000 7f72dbe00640 1 --2- 172.21.15.44:0/3362289832 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f72dc1538b0 0x7f72dc1e55b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:50:20.254 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:20.263+0000 7f72dbe00640 1 -- 172.21.15.44:0/3362289832 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f72dc1f2cf0 con 0x7f72dc0c60e0 2024-04-17T19:50:20.254 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:20.263+0000 7f72dbe00640 1 --2- 172.21.15.44:0/3362289832 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f72dc0c60e0 0x7f72dc1f27b0 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f72cc01b860 tx=0x7f72cc01b9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:50:20.255 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:20.263+0000 7f72d8c00640 1 -- 172.21.15.44:0/3362289832 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72cc0bf070 con 0x7f72dc0c60e0 2024-04-17T19:50:20.255 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:20.263+0000 7f72d8c00640 1 -- 172.21.15.44:0/3362289832 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f72cc0b0720 con 0x7f72dc0c60e0 2024-04-17T19:50:20.255 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:20.263+0000 7f72e2a00640 1 -- 172.21.15.44:0/3362289832 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f72dc14d450 con 0x7f72dc0c60e0 2024-04-17T19:50:20.255 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:20.263+0000 7f72d8c00640 1 -- 172.21.15.44:0/3362289832 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72cc0b5040 con 0x7f72dc0c60e0 2024-04-17T19:50:20.255 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:20.263+0000 7f72e2a00640 1 -- 172.21.15.44:0/3362289832 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f72dc155e30 con 0x7f72dc0c60e0 2024-04-17T19:50:20.255 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:20.263+0000 7f72e2a00640 1 -- 172.21.15.44:0/3362289832 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f72dc075f10 con 0x7f72dc0c60e0 2024-04-17T19:50:20.255 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:20.263+0000 7f72d8c00640 1 -- 172.21.15.44:0/3362289832 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f72cc0c2070 con 0x7f72dc0c60e0 2024-04-17T19:50:20.257 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:20.267+0000 7f72d8c00640 1 --2- 172.21.15.44:0/3362289832 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f72b80683d0 0x7f72b806a8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:50:20.257 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:20.267+0000 7f72d8c00640 1 -- 172.21.15.44:0/3362289832 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6619+0+0 (secure 0 0 0) 0x7f72cc1238c0 con 0x7f72dc0c60e0 2024-04-17T19:50:20.257 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:20.267+0000 7f72d8c00640 1 --2- 172.21.15.44:0/3362289832 >> [v2:172.21.15.44:6808/4236454921,v1:172.21.15.44:6809/4236454921] conn(0x7f72b8071cb0 0x7f72b80741a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:50:20.257 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:20.267+0000 7f72d8c00640 1 -- 172.21.15.44:0/3362289832 --> [v2:172.21.15.44:6808/4236454921,v1:172.21.15.44:6809/4236454921] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f72cc0a8950 con 0x7f72b8071cb0 2024-04-17T19:50:20.257 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:20.267+0000 7f72d8c00640 1 -- 172.21.15.44:0/3362289832 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f72cc123d20 con 0x7f72dc0c60e0 2024-04-17T19:50:20.257 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:20.267+0000 7f72d3e00640 1 --2- 172.21.15.44:0/3362289832 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f72b80683d0 0x7f72b806a8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:50:20.257 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:20.267+0000 7f72e0a00640 1 --2- 172.21.15.44:0/3362289832 >> [v2:172.21.15.44:6808/4236454921,v1:172.21.15.44:6809/4236454921] conn(0x7f72b8071cb0 0x7f72b80741a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:50:20.258 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:20.267+0000 7f72e0a00640 1 --2- 172.21.15.44:0/3362289832 >> [v2:172.21.15.44:6808/4236454921,v1:172.21.15.44:6809/4236454921] conn(0x7f72b8071cb0 0x7f72b80741a0 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:50:20.258 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:20.267+0000 7f72d3e00640 1 --2- 172.21.15.44:0/3362289832 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f72b80683d0 0x7f72b806a8e0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f72dc1e5fe0 tx=0x7f72c4007c10 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:50:20.258 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:20.267+0000 7f72d8c00640 1 -- 172.21.15.44:0/3362289832 <== osd.3 v2:172.21.15.44:6808/4236454921 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f72cc0a8950 con 0x7f72b8071cb0 2024-04-17T19:50:20.272 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:20.283+0000 7f72e2a00640 1 -- 172.21.15.44:0/3362289832 --> [v2:172.21.15.44:6808/4236454921,v1:172.21.15.44:6809/4236454921] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f72dc04ff80 con 0x7f72b8071cb0 2024-04-17T19:50:20.272 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:20.283+0000 7f72d8c00640 1 -- 172.21.15.44:0/3362289832 <== osd.3 v2:172.21.15.44:6808/4236454921 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f72dc04ff80 con 0x7f72b8071cb0 2024-04-17T19:50:20.272 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2024-04-17T19:50:20.273 INFO:teuthology.orchestra.run.smithi044.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-17T19:50:20.273 INFO:teuthology.orchestra.run.smithi044.stdout:} 2024-04-17T19:50:20.273 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:20.283+0000 7f72e2a00640 1 -- 172.21.15.44:0/3362289832 >> [v2:172.21.15.44:6808/4236454921,v1:172.21.15.44:6809/4236454921] conn(0x7f72b8071cb0 msgr2=0x7f72b80741a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:50:20.273 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:20.283+0000 7f72e2a00640 1 --2- 172.21.15.44:0/3362289832 >> [v2:172.21.15.44:6808/4236454921,v1:172.21.15.44:6809/4236454921] conn(0x7f72b8071cb0 0x7f72b80741a0 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:50:20.274 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:20.283+0000 7f72e2a00640 1 -- 172.21.15.44:0/3362289832 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f72b80683d0 msgr2=0x7f72b806a8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:50:20.274 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:20.283+0000 7f72e2a00640 1 --2- 172.21.15.44:0/3362289832 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f72b80683d0 0x7f72b806a8e0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f72dc1e5fe0 tx=0x7f72c4007c10 comp rx=0 tx=0).stop 2024-04-17T19:50:20.274 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:20.283+0000 7f72e2a00640 1 -- 172.21.15.44:0/3362289832 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f72dc0c60e0 msgr2=0x7f72dc1f27b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:50:20.274 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:20.283+0000 7f72e2a00640 1 --2- 172.21.15.44:0/3362289832 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f72dc0c60e0 0x7f72dc1f27b0 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f72cc01b860 tx=0x7f72cc01b9f0 comp rx=0 tx=0).stop 2024-04-17T19:50:20.274 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:20.283+0000 7f72e0a00640 1 -- 172.21.15.44:0/3362289832 reap_dead start 2024-04-17T19:50:20.274 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:20.283+0000 7f72e2a00640 1 -- 172.21.15.44:0/3362289832 shutdown_connections 2024-04-17T19:50:20.274 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:20.283+0000 7f72e2a00640 1 -- 172.21.15.44:0/3362289832 >> 172.21.15.44:0/3362289832 conn(0x7f72dc0c9ad0 msgr2=0x7f72dc151ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:50:20.274 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:20.283+0000 7f72e2a00640 1 -- 172.21.15.44:0/3362289832 shutdown_connections 2024-04-17T19:50:20.274 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:20.283+0000 7f72e2a00640 1 -- 172.21.15.44:0/3362289832 wait complete. 2024-04-17T19:50:20.291 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2024-04-17T19:50:20.443 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:20.451+0000 7f6ca2600640 1 Processor -- start 2024-04-17T19:50:20.443 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:20.451+0000 7f6ca2600640 1 -- start start 2024-04-17T19:50:20.446 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:20.455+0000 7f6ca2600640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f6c9c153a00 0x7f6c9c159de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:50:20.446 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:20.455+0000 7f6ca2600640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f6c9c15a320 0x7f6c9c164130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:50:20.446 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:20.455+0000 7f6ca2600640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6c9c15a730 con 0x7f6c9c072700 2024-04-17T19:50:20.446 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:20.455+0000 7f6ca2600640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 -- 0x7f6c9c072b10 con 0x7f6c9c153a00 2024-04-17T19:50:20.446 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:20.455+0000 7f6ca2600640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 -- 0x7f6c9c072d60 con 0x7f6c9c15a320 2024-04-17T19:50:20.446 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:20.455+0000 7f6c93e00640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f6c9c153a00 0x7f6c9c159de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:50:20.446 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:20.455+0000 7f6c93e00640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f6c9c153a00 0x7f6c9c159de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:47008/0 (socket says 172.21.15.44:47008) 2024-04-17T19:50:20.446 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:20.455+0000 7f6c93e00640 1 -- 172.21.15.44:0/4059517745 learned_addr learned my addr 172.21.15.44:0/4059517745 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-04-17T19:50:20.446 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:20.455+0000 7f6c9b400640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f6c9c072700 0x7f6c9c0c60e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:59022/0 (socket says 172.21.15.44:59022) 2024-04-17T19:50:20.446 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:20.455+0000 7f6c9be00640 1 --2- 172.21.15.44:0/4059517745 >> v2:172.21.15.62:3300/0 conn(0x7f6c9c15a320 0x7f6c9c164130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:50:20.447 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:20.455+0000 7f6c93e00640 1 -- 172.21.15.44:0/4059517745 >> v2:172.21.15.62:3300/0 conn(0x7f6c9c15a320 msgr2=0x7f6c9c164130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T19:50:20.447 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:20.455+0000 7f6c93e00640 1 --2- 172.21.15.44:0/4059517745 >> v2:172.21.15.62:3300/0 conn(0x7f6c9c15a320 0x7f6c9c164130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:50:20.447 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:20.455+0000 7f6c93e00640 1 -- 172.21.15.44:0/4059517745 >> v1:172.21.15.44:6789/0 conn(0x7f6c9c072700 legacy=0x7f6c9c0c60e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:50:20.447 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:20.455+0000 7f6c9aa00640 1 -- 172.21.15.44:0/4059517745 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3714506590 0 0) 0x7f6c8c001120 con 0x7f6c9c072700 2024-04-17T19:50:20.447 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:20.455+0000 7f6c93e00640 1 -- 172.21.15.44:0/4059517745 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6c9c073810 con 0x7f6c9c153a00 2024-04-17T19:50:20.449 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:20.459+0000 7f6c93e00640 1 --2- 172.21.15.44:0/4059517745 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6c9c153a00 0x7f6c9c159de0 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f6c9c0723b0 tx=0x7f6c8401ed10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b7bd82419671f518 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:50:20.449 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:20.459+0000 7f6c9aa00640 1 -- 172.21.15.44:0/4059517745 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c840b5070 con 0x7f6c9c153a00 2024-04-17T19:50:20.449 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:20.459+0000 7f6c9aa00640 1 -- 172.21.15.44:0/4059517745 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6c840a8a10 con 0x7f6c9c153a00 2024-04-17T19:50:20.449 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:20.459+0000 7f6c9aa00640 1 -- 172.21.15.44:0/4059517745 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c840a8de0 con 0x7f6c9c153a00 2024-04-17T19:50:20.450 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:20.459+0000 7f6ca2600640 1 -- 172.21.15.44:0/4059517745 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6c9c153a00 msgr2=0x7f6c9c159de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:50:20.450 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:20.459+0000 7f6ca2600640 1 --2- 172.21.15.44:0/4059517745 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6c9c153a00 0x7f6c9c159de0 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f6c9c0723b0 tx=0x7f6c8401ed10 comp rx=0 tx=0).stop 2024-04-17T19:50:20.450 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:20.459+0000 7f6ca2600640 1 -- 172.21.15.44:0/4059517745 shutdown_connections 2024-04-17T19:50:20.450 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:20.459+0000 7f6ca2600640 1 --2- 172.21.15.44:0/4059517745 >> v2:172.21.15.62:3300/0 conn(0x7f6c9c15a320 0x7f6c9c164130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:50:20.450 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:20.459+0000 7f6ca2600640 1 --2- 172.21.15.44:0/4059517745 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6c9c153a00 0x7f6c9c159de0 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:50:20.450 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:20.459+0000 7f6ca2600640 1 -- 172.21.15.44:0/4059517745 >> 172.21.15.44:0/4059517745 conn(0x7f6c9c06c380 msgr2=0x7f6c9c070080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:50:20.450 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:20.459+0000 7f6ca2600640 1 -- 172.21.15.44:0/4059517745 shutdown_connections 2024-04-17T19:50:20.451 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:20.459+0000 7f6ca2600640 1 -- 172.21.15.44:0/4059517745 wait complete. 2024-04-17T19:50:20.452 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:20.463+0000 7f6ca2600640 1 Processor -- start 2024-04-17T19:50:20.452 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:20.463+0000 7f6ca2600640 1 -- start start 2024-04-17T19:50:20.455 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:20.463+0000 7f6ca2600640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f6c9c072700 0x7f6c9c1e5660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:50:20.455 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:20.463+0000 7f6ca2600640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6c9c153a00 0x7f6c9c15d4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:50:20.455 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:20.463+0000 7f6ca2600640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6c9c15a320 0x7f6c9c1e43c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:50:20.455 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:20.463+0000 7f6ca2600640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f6c9c0740b0 con 0x7f6c9c15a320 2024-04-17T19:50:20.455 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:20.463+0000 7f6ca2600640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f6c9c073dd0 con 0x7f6c9c153a00 2024-04-17T19:50:20.455 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:20.463+0000 7f6ca2600640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7f6c9c074390 con 0x7f6c9c072700 2024-04-17T19:50:20.455 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:20.463+0000 7f6c9be00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6c9c15a320 0x7f6c9c1e43c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:50:20.455 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:20.463+0000 7f6c9be00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6c9c15a320 0x7f6c9c1e43c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:47014/0 (socket says 172.21.15.44:47014) 2024-04-17T19:50:20.456 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:20.463+0000 7f6c9be00640 1 -- 172.21.15.44:0/1288309523 learned_addr learned my addr 172.21.15.44:0/1288309523 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-04-17T19:50:20.456 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:20.463+0000 7f6c9b400640 1 --2- 172.21.15.44:0/1288309523 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f6c9c072700 0x7f6c9c1e5660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:50:20.456 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:20.463+0000 7f6c93e00640 1 --2- 172.21.15.44:0/1288309523 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6c9c153a00 0x7f6c9c15d4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:50:20.456 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:20.463+0000 7f6c9be00640 1 -- 172.21.15.44:0/1288309523 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f6c9c072700 msgr2=0x7f6c9c1e5660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:50:20.456 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:20.463+0000 7f6c9be00640 1 --2- 172.21.15.44:0/1288309523 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f6c9c072700 0x7f6c9c1e5660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:50:20.456 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:20.463+0000 7f6c9be00640 1 -- 172.21.15.44:0/1288309523 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6c9c153a00 msgr2=0x7f6c9c15d4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:50:20.456 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:20.463+0000 7f6c9be00640 1 --2- 172.21.15.44:0/1288309523 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6c9c153a00 0x7f6c9c15d4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:50:20.456 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:20.463+0000 7f6c9be00640 1 -- 172.21.15.44:0/1288309523 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6c9c15c800 con 0x7f6c9c15a320 2024-04-17T19:50:20.456 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:20.463+0000 7f6c9b400640 1 --2- 172.21.15.44:0/1288309523 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f6c9c072700 0x7f6c9c1e5660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-17T19:50:20.456 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:20.463+0000 7f6c9be00640 1 --2- 172.21.15.44:0/1288309523 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6c9c15a320 0x7f6c9c1e43c0 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f6c94007d80 tx=0x7f6c9400e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:50:20.456 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:20.463+0000 7f6c93400640 1 -- 172.21.15.44:0/1288309523 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c94014420 con 0x7f6c9c15a320 2024-04-17T19:50:20.456 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:20.463+0000 7f6c93400640 1 -- 172.21.15.44:0/1288309523 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6c94019070 con 0x7f6c9c15a320 2024-04-17T19:50:20.456 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:20.463+0000 7f6ca2600640 1 -- 172.21.15.44:0/1288309523 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6c9c0cd8f0 con 0x7f6c9c15a320 2024-04-17T19:50:20.456 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:20.463+0000 7f6c93400640 1 -- 172.21.15.44:0/1288309523 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c94014800 con 0x7f6c9c15a320 2024-04-17T19:50:20.456 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:20.463+0000 7f6ca2600640 1 -- 172.21.15.44:0/1288309523 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6c9c15cdc0 con 0x7f6c9c15a320 2024-04-17T19:50:20.457 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:20.467+0000 7f6ca2600640 1 -- 172.21.15.44:0/1288309523 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6c9c04ff10 con 0x7f6c9c15a320 2024-04-17T19:50:20.457 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:20.467+0000 7f6c93400640 1 -- 172.21.15.44:0/1288309523 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f6c940149a0 con 0x7f6c9c15a320 2024-04-17T19:50:20.458 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:20.467+0000 7f6c93400640 1 --2- 172.21.15.44:0/1288309523 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f6c780683b0 0x7f6c7806a8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:50:20.458 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:20.467+0000 7f6c93400640 1 -- 172.21.15.44:0/1288309523 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6619+0+0 (secure 0 0 0) 0x7f6c940875d0 con 0x7f6c9c15a320 2024-04-17T19:50:20.458 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:20.467+0000 7f6c9b400640 1 --2- 172.21.15.44:0/1288309523 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f6c780683b0 0x7f6c7806a8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:50:20.459 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:20.467+0000 7f6c9b400640 1 --2- 172.21.15.44:0/1288309523 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f6c780683b0 0x7f6c7806a8c0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f6c8c000f70 tx=0x7f6c8c007cb0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:50:20.462 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:20.471+0000 7f6c93400640 1 -- 172.21.15.44:0/1288309523 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f6c94057760 con 0x7f6c9c15a320 2024-04-17T19:50:20.634 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:20.643+0000 7f6ca2600640 1 -- 172.21.15.44:0/1288309523 --> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "3", "target": ["mon-mgr", ""]}) -- 0x7f6c9c0c78b0 con 0x7f6c780683b0 2024-04-17T19:50:20.635 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:20.643+0000 7f6c93400640 1 -- 172.21.15.44:0/1288309523 <== mgr.4102 v2:172.21.15.62:6832/1020159798 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 3 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f6c9c0c78b0 con 0x7f6c780683b0 2024-04-17T19:50:20.635 INFO:teuthology.orchestra.run.smithi044.stderr:instructed osd(s) 3 to deep-scrub 2024-04-17T19:50:20.637 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:20.647+0000 7f6ca2600640 1 -- 172.21.15.44:0/1288309523 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f6c780683b0 msgr2=0x7f6c7806a8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:50:20.637 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:20.647+0000 7f6ca2600640 1 --2- 172.21.15.44:0/1288309523 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f6c780683b0 0x7f6c7806a8c0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f6c8c000f70 tx=0x7f6c8c007cb0 comp rx=0 tx=0).stop 2024-04-17T19:50:20.637 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:20.647+0000 7f6ca2600640 1 -- 172.21.15.44:0/1288309523 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6c9c15a320 msgr2=0x7f6c9c1e43c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:50:20.638 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:20.647+0000 7f6ca2600640 1 --2- 172.21.15.44:0/1288309523 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6c9c15a320 0x7f6c9c1e43c0 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f6c94007d80 tx=0x7f6c9400e4b0 comp rx=0 tx=0).stop 2024-04-17T19:50:20.638 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:20.647+0000 7f6ca2600640 1 -- 172.21.15.44:0/1288309523 shutdown_connections 2024-04-17T19:50:20.638 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:20.647+0000 7f6ca2600640 1 --2- 172.21.15.44:0/1288309523 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f6c780683b0 0x7f6c7806a8c0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:50:20.638 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:20.647+0000 7f6ca2600640 1 --2- 172.21.15.44:0/1288309523 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6c9c15a320 0x7f6c9c1e43c0 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:50:20.638 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:20.647+0000 7f6ca2600640 1 --2- 172.21.15.44:0/1288309523 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6c9c153a00 0x7f6c9c15d4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:50:20.638 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:20.647+0000 7f6ca2600640 1 --2- 172.21.15.44:0/1288309523 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f6c9c072700 0x7f6c9c1e5660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:50:20.638 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:20.647+0000 7f6ca2600640 1 -- 172.21.15.44:0/1288309523 >> 172.21.15.44:0/1288309523 conn(0x7f6c9c06c380 msgr2=0x7f6c9c1576b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:50:20.638 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:20.647+0000 7f6ca2600640 1 -- 172.21.15.44:0/1288309523 shutdown_connections 2024-04-17T19:50:20.638 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:20.647+0000 7f6ca2600640 1 -- 172.21.15.44:0/1288309523 wait complete. 2024-04-17T19:50:20.657 INFO:tasks.ceph:Scrubbing osd.4 2024-04-17T19:50:20.657 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2024-04-17T19:50:20.817 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:20.827+0000 7f0961e00640 1 Processor -- start 2024-04-17T19:50:20.817 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:20.827+0000 7f0961e00640 1 -- start start 2024-04-17T19:50:20.819 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:20.827+0000 7f0961e00640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f095c159f70 0x7f095c164e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:50:20.819 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:20.827+0000 7f0961e00640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f095c15ca90 con 0x7f095c1538b0 2024-04-17T19:50:20.819 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:20.827+0000 7f0961e00640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f095c0ca620 con 0x7f095c0ca0c0 2024-04-17T19:50:20.819 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:20.827+0000 7f0961e00640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7f095c0c48d0 con 0x7f095c159f70 2024-04-17T19:50:20.819 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:20.827+0000 7f0953e00640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f095c1538b0 0x7f095c0cba90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:59028/0 (socket says 172.21.15.44:59028) 2024-04-17T19:50:20.819 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:20.827+0000 7f0953e00640 1 -- 172.21.15.44:0/1622017859 learned_addr learned my addr 172.21.15.44:0/1622017859 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-04-17T19:50:20.820 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:20.827+0000 7f0961400640 1 --2- 172.21.15.44:0/1622017859 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f095c159f70 0x7f095c164e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:50:20.821 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:20.827+0000 7f095be00640 1 -- 172.21.15.44:0/1622017859 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 953626073 0 0) 0x7f095c15ca90 con 0x7f095c1538b0 2024-04-17T19:50:20.821 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:20.827+0000 7f095be00640 1 -- 172.21.15.44:0/1622017859 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0940003530 con 0x7f095c1538b0 2024-04-17T19:50:20.821 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:20.827+0000 7f095be00640 1 -- 172.21.15.44:0/1622017859 <== mon.1 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2954254653 0 0) 0x7f095c0ca620 con 0x7f095c0ca0c0 2024-04-17T19:50:20.821 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:20.827+0000 7f095be00640 1 -- 172.21.15.44:0/1622017859 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f095c15ca90 con 0x7f095c0ca0c0 2024-04-17T19:50:20.822 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:20.827+0000 7f095be00640 1 -- 172.21.15.44:0/1622017859 <== mon.0 v1:172.21.15.44:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1259982880 0 0) 0x7f0940003530 con 0x7f095c1538b0 2024-04-17T19:50:20.822 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:20.827+0000 7f095be00640 1 -- 172.21.15.44:0/1622017859 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f095c159f70 msgr2=0x7f095c164e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T19:50:20.822 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:20.827+0000 7f095be00640 1 --2- 172.21.15.44:0/1622017859 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f095c159f70 0x7f095c164e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:50:20.822 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:20.827+0000 7f095be00640 1 -- 172.21.15.44:0/1622017859 >> v1:172.21.15.62:6789/0 conn(0x7f095c0ca0c0 legacy=0x7f095c0c41c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:50:20.822 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:20.827+0000 7f095be00640 1 -- 172.21.15.44:0/1622017859 --> v1:172.21.15.44:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f095c0ca900 con 0x7f095c1538b0 2024-04-17T19:50:20.822 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:20.827+0000 7f095be00640 1 -- 172.21.15.44:0/1622017859 <== mon.0 v1:172.21.15.44:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1863569991 0 0) 0x7f09440016a0 con 0x7f095c1538b0 2024-04-17T19:50:20.822 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:20.827+0000 7f0961400640 1 --2- 172.21.15.44:0/1622017859 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f095c159f70 0x7f095c164e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-17T19:50:20.822 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:20.831+0000 7f095be00640 1 -- 172.21.15.44:0/1622017859 >> v1:172.21.15.44:6789/0 conn(0x7f095c1538b0 legacy=0x7f095c0cba90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:50:20.822 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:20.831+0000 7f095be00640 1 --2- 172.21.15.44:0/1622017859 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0940003b80 0x7f0940003fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:50:20.822 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:20.831+0000 7f095be00640 1 --2- 172.21.15.44:0/1622017859 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0940004810 0x7f0940004c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:50:20.822 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:20.831+0000 7f095be00640 1 --2- 172.21.15.44:0/1622017859 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f095c159f70 0x7f0940005260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:50:20.822 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:20.831+0000 7f095be00640 1 -- 172.21.15.44:0/1622017859 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f095c0c48d0 con 0x7f0940004810 2024-04-17T19:50:20.823 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:20.831+0000 7f095be00640 1 -- 172.21.15.44:0/1622017859 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f094000bb60 con 0x7f0940003b80 2024-04-17T19:50:20.823 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:20.831+0000 7f095be00640 1 -- 172.21.15.44:0/1622017859 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7f094000bd30 con 0x7f095c159f70 2024-04-17T19:50:20.823 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:20.831+0000 7f0953e00640 1 --2- 172.21.15.44:0/1622017859 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0940004810 0x7f0940004c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:50:20.823 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:20.831+0000 7f0960a00640 1 --2- 172.21.15.44:0/1622017859 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0940003b80 0x7f0940003fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:50:20.823 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:20.831+0000 7f0961400640 1 --2- 172.21.15.44:0/1622017859 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f095c159f70 0x7f0940005260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:50:20.823 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:20.831+0000 7f0953e00640 1 -- 172.21.15.44:0/1622017859 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f095c159f70 msgr2=0x7f0940005260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T19:50:20.823 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:20.831+0000 7f0953e00640 1 --2- 172.21.15.44:0/1622017859 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f095c159f70 0x7f0940005260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:50:20.823 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:20.831+0000 7f0953e00640 1 -- 172.21.15.44:0/1622017859 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0940003b80 msgr2=0x7f0940003fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T19:50:20.823 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:20.831+0000 7f0953e00640 1 --2- 172.21.15.44:0/1622017859 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0940003b80 0x7f0940003fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:50:20.823 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:20.831+0000 7f0953e00640 1 -- 172.21.15.44:0/1622017859 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0940003530 con 0x7f0940004810 2024-04-17T19:50:20.823 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:20.831+0000 7f0961400640 1 --2- 172.21.15.44:0/1622017859 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f095c159f70 0x7f0940005260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-17T19:50:20.823 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:20.831+0000 7f0953e00640 1 --2- 172.21.15.44:0/1622017859 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0940004810 0x7f0940004c20 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f095c15cc60 tx=0x7f094401cb80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=244699239cc61745 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:50:20.824 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:20.835+0000 7f095be00640 1 -- 172.21.15.44:0/1622017859 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0944007cd0 con 0x7f0940004810 2024-04-17T19:50:20.824 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:20.835+0000 7f095be00640 1 -- 172.21.15.44:0/1622017859 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f09440a9020 con 0x7f0940004810 2024-04-17T19:50:20.824 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:20.835+0000 7f095be00640 1 -- 172.21.15.44:0/1622017859 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0944005b20 con 0x7f0940004810 2024-04-17T19:50:20.825 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:20.835+0000 7f0961e00640 1 -- 172.21.15.44:0/1622017859 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0940004810 msgr2=0x7f0940004c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:50:20.825 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:20.835+0000 7f0961e00640 1 --2- 172.21.15.44:0/1622017859 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0940004810 0x7f0940004c20 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f095c15cc60 tx=0x7f094401cb80 comp rx=0 tx=0).stop 2024-04-17T19:50:20.825 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:20.835+0000 7f0961400640 1 -- 172.21.15.44:0/1622017859 reap_dead start 2024-04-17T19:50:20.825 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:20.835+0000 7f0961e00640 1 -- 172.21.15.44:0/1622017859 shutdown_connections 2024-04-17T19:50:20.825 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:20.835+0000 7f0961e00640 1 -- 172.21.15.44:0/1622017859 >> 172.21.15.44:0/1622017859 conn(0x7f095c0723e0 msgr2=0x7f095c0727f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:50:20.825 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:20.835+0000 7f0961e00640 1 -- 172.21.15.44:0/1622017859 shutdown_connections 2024-04-17T19:50:20.825 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:20.835+0000 7f0961e00640 1 -- 172.21.15.44:0/1622017859 wait complete. 2024-04-17T19:50:20.827 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:20.835+0000 7f0961e00640 1 Processor -- start 2024-04-17T19:50:20.827 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:20.835+0000 7f0961e00640 1 -- start start 2024-04-17T19:50:20.829 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:20.839+0000 7f0961e00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0940004810 0x7f095c1f8220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:50:20.829 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:20.839+0000 7f0961e00640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f095c158ed0 0x7f095c0b3220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:50:20.829 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:20.839+0000 7f0961e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f095c06e5c0 0x7f095c148240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:50:20.830 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:20.839+0000 7f0961e00640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f095c15d810 con 0x7f095c06e5c0 2024-04-17T19:50:20.830 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:20.839+0000 7f0961e00640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f095c153cc0 con 0x7f0940004810 2024-04-17T19:50:20.830 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:20.839+0000 7f0961e00640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7f095c0b3c30 con 0x7f095c158ed0 2024-04-17T19:50:20.830 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:20.839+0000 7f0961400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f095c06e5c0 0x7f095c148240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:50:20.830 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:20.839+0000 7f0961400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f095c06e5c0 0x7f095c148240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:47036/0 (socket says 172.21.15.44:47036) 2024-04-17T19:50:20.830 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:20.839+0000 7f0961400640 1 -- 172.21.15.44:0/3482602470 learned_addr learned my addr 172.21.15.44:0/3482602470 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-04-17T19:50:20.830 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:20.839+0000 7f0960a00640 1 --2- 172.21.15.44:0/3482602470 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0940004810 0x7f095c1f8220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:50:20.830 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:20.839+0000 7f0953e00640 1 --2- 172.21.15.44:0/3482602470 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f095c158ed0 0x7f095c0b3220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:50:20.830 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:20.839+0000 7f0961400640 1 -- 172.21.15.44:0/3482602470 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f095c158ed0 msgr2=0x7f095c0b3220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:50:20.830 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:20.839+0000 7f0961400640 1 --2- 172.21.15.44:0/3482602470 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f095c158ed0 0x7f095c0b3220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:50:20.830 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:20.839+0000 7f0961400640 1 -- 172.21.15.44:0/3482602470 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0940004810 msgr2=0x7f095c1f8220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:50:20.830 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:20.839+0000 7f0961400640 1 --2- 172.21.15.44:0/3482602470 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0940004810 0x7f095c1f8220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:50:20.831 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:20.839+0000 7f0961400640 1 -- 172.21.15.44:0/3482602470 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f095c0b3760 con 0x7f095c06e5c0 2024-04-17T19:50:20.831 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:20.839+0000 7f0960a00640 1 --2- 172.21.15.44:0/3482602470 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0940004810 0x7f095c1f8220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-17T19:50:20.831 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:20.839+0000 7f0961400640 1 --2- 172.21.15.44:0/3482602470 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f095c06e5c0 0x7f095c148240 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f095c0b1b50 tx=0x7f0954009f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:50:20.831 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:20.839+0000 7f0959600640 1 -- 172.21.15.44:0/3482602470 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f095401a020 con 0x7f095c06e5c0 2024-04-17T19:50:20.832 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:20.839+0000 7f0959600640 1 -- 172.21.15.44:0/3482602470 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0954011dd0 con 0x7f095c06e5c0 2024-04-17T19:50:20.832 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:20.839+0000 7f0961e00640 1 -- 172.21.15.44:0/3482602470 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f095c156be0 con 0x7f095c06e5c0 2024-04-17T19:50:20.832 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:20.839+0000 7f0959600640 1 -- 172.21.15.44:0/3482602470 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0954016690 con 0x7f095c06e5c0 2024-04-17T19:50:20.832 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:20.839+0000 7f0961e00640 1 -- 172.21.15.44:0/3482602470 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f095c150f40 con 0x7f095c06e5c0 2024-04-17T19:50:20.832 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:20.839+0000 7f0961e00640 1 -- 172.21.15.44:0/3482602470 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f095c150450 con 0x7f095c06e5c0 2024-04-17T19:50:20.832 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:20.843+0000 7f0959600640 1 -- 172.21.15.44:0/3482602470 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f095401d020 con 0x7f095c06e5c0 2024-04-17T19:50:20.833 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:20.843+0000 7f0959600640 1 --2- 172.21.15.44:0/3482602470 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f0938068380 0x7f093806a890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:50:20.833 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:20.843+0000 7f0959600640 1 -- 172.21.15.44:0/3482602470 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6619+0+0 (secure 0 0 0) 0x7f0954088280 con 0x7f095c06e5c0 2024-04-17T19:50:20.833 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:20.843+0000 7f0959600640 1 --2- 172.21.15.44:0/3482602470 >> [v2:172.21.15.62:6800/2293251376,v1:172.21.15.62:6801/2293251376] conn(0x7f0938071be0 0x7f09380740d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:50:20.833 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:20.843+0000 7f0959600640 1 -- 172.21.15.44:0/3482602470 --> [v2:172.21.15.62:6800/2293251376,v1:172.21.15.62:6801/2293251376] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f0954013e50 con 0x7f0938071be0 2024-04-17T19:50:20.833 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:20.843+0000 7f0959600640 1 -- 172.21.15.44:0/3482602470 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f0954088630 con 0x7f095c06e5c0 2024-04-17T19:50:20.834 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:20.843+0000 7f0960a00640 1 --2- 172.21.15.44:0/3482602470 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f0938068380 0x7f093806a890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:50:20.834 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:20.843+0000 7f0953e00640 1 --2- 172.21.15.44:0/3482602470 >> [v2:172.21.15.62:6800/2293251376,v1:172.21.15.62:6801/2293251376] conn(0x7f0938071be0 0x7f09380740d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:50:20.834 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:20.843+0000 7f0960a00640 1 --2- 172.21.15.44:0/3482602470 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f0938068380 0x7f093806a890 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f094c007fd0 tx=0x7f094c009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:50:20.835 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:20.843+0000 7f0953e00640 1 --2- 172.21.15.44:0/3482602470 >> [v2:172.21.15.62:6800/2293251376,v1:172.21.15.62:6801/2293251376] conn(0x7f0938071be0 0x7f09380740d0 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:50:20.836 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:20.847+0000 7f0959600640 1 -- 172.21.15.44:0/3482602470 <== osd.4 v2:172.21.15.62:6800/2293251376 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f0954013e50 con 0x7f0938071be0 2024-04-17T19:50:20.850 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:20.859+0000 7f0961e00640 1 -- 172.21.15.44:0/3482602470 --> [v2:172.21.15.62:6800/2293251376,v1:172.21.15.62:6801/2293251376] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f095c156990 con 0x7f0938071be0 2024-04-17T19:50:20.851 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:20.859+0000 7f0959600640 1 -- 172.21.15.44:0/3482602470 <== osd.4 v2:172.21.15.62:6800/2293251376 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f095c156990 con 0x7f0938071be0 2024-04-17T19:50:20.851 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2024-04-17T19:50:20.851 INFO:teuthology.orchestra.run.smithi044.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-17T19:50:20.851 INFO:teuthology.orchestra.run.smithi044.stdout:} 2024-04-17T19:50:20.852 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:20.859+0000 7f0961e00640 1 -- 172.21.15.44:0/3482602470 >> [v2:172.21.15.62:6800/2293251376,v1:172.21.15.62:6801/2293251376] conn(0x7f0938071be0 msgr2=0x7f09380740d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:50:20.852 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:20.859+0000 7f0961e00640 1 --2- 172.21.15.44:0/3482602470 >> [v2:172.21.15.62:6800/2293251376,v1:172.21.15.62:6801/2293251376] conn(0x7f0938071be0 0x7f09380740d0 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:50:20.852 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:20.859+0000 7f0961e00640 1 -- 172.21.15.44:0/3482602470 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f0938068380 msgr2=0x7f093806a890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:50:20.852 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:20.859+0000 7f0961e00640 1 --2- 172.21.15.44:0/3482602470 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f0938068380 0x7f093806a890 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f094c007fd0 tx=0x7f094c009040 comp rx=0 tx=0).stop 2024-04-17T19:50:20.852 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:20.859+0000 7f0961e00640 1 -- 172.21.15.44:0/3482602470 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f095c06e5c0 msgr2=0x7f095c148240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:50:20.852 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:20.859+0000 7f0961e00640 1 --2- 172.21.15.44:0/3482602470 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f095c06e5c0 0x7f095c148240 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f095c0b1b50 tx=0x7f0954009f90 comp rx=0 tx=0).stop 2024-04-17T19:50:20.852 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:20.859+0000 7f0961400640 1 -- 172.21.15.44:0/3482602470 reap_dead start 2024-04-17T19:50:20.852 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:20.859+0000 7f0961e00640 1 -- 172.21.15.44:0/3482602470 shutdown_connections 2024-04-17T19:50:20.852 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:20.859+0000 7f0961e00640 1 -- 172.21.15.44:0/3482602470 >> 172.21.15.44:0/3482602470 conn(0x7f095c0723e0 msgr2=0x7f095c0cd100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:50:20.853 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:20.859+0000 7f0961e00640 1 -- 172.21.15.44:0/3482602470 shutdown_connections 2024-04-17T19:50:20.853 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:20.859+0000 7f0961e00640 1 -- 172.21.15.44:0/3482602470 wait complete. 2024-04-17T19:50:20.871 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2024-04-17T19:50:21.024 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:21.035+0000 7fc58ce00640 1 Processor -- start 2024-04-17T19:50:21.024 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:21.035+0000 7fc58ce00640 1 -- start start 2024-04-17T19:50:21.027 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:21.035+0000 7fc58ce00640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fc588153670 0x7fc5880ca3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:50:21.027 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:21.035+0000 7fc58ce00640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fc588159e10 0x7fc58815a220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:50:21.027 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:21.035+0000 7fc58ce00640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc5880c4720 con 0x7fc5880c9650 2024-04-17T19:50:21.027 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:21.035+0000 7fc58ce00640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 -- 0x7fc58815ccd0 con 0x7fc588153670 2024-04-17T19:50:21.027 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:21.035+0000 7fc58ce00640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7fc5880c52a0 con 0x7fc588159e10 2024-04-17T19:50:21.027 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:21.035+0000 7fc587400640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fc588153670 0x7fc5880ca3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:50:21.027 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:21.035+0000 7fc587400640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fc588153670 0x7fc5880ca3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:47050/0 (socket says 172.21.15.44:47050) 2024-04-17T19:50:21.027 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:21.035+0000 7fc587400640 1 -- 172.21.15.44:0/782289771 learned_addr learned my addr 172.21.15.44:0/782289771 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-04-17T19:50:21.027 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:21.035+0000 7fc586a00640 1 --2- 172.21.15.44:0/782289771 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fc588159e10 0x7fc58815a220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:50:21.028 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:21.035+0000 7fc587400640 1 -- 172.21.15.44:0/782289771 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fc588159e10 msgr2=0x7fc58815a220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T19:50:21.028 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:21.035+0000 7fc587400640 1 --2- 172.21.15.44:0/782289771 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fc588159e10 0x7fc58815a220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:50:21.028 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:21.035+0000 7fc587400640 1 -- 172.21.15.44:0/782289771 >> v1:172.21.15.62:6789/0 conn(0x7fc5880c9650 legacy=0x7fc58815d090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:50:21.028 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:21.035+0000 7fc587400640 1 -- 172.21.15.44:0/782289771 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc5880c4a00 con 0x7fc588153670 2024-04-17T19:50:21.030 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:21.039+0000 7fc587400640 1 --2- 172.21.15.44:0/782289771 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc588153670 0x7fc5880ca3d0 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7fc578009870 tx=0x7fc57801ed50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f7ea3a32058038e3 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:50:21.030 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:21.039+0000 7fc586000640 1 -- 172.21.15.44:0/782289771 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5780b5070 con 0x7fc588153670 2024-04-17T19:50:21.030 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:21.039+0000 7fc586000640 1 -- 172.21.15.44:0/782289771 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc5780a8a50 con 0x7fc588153670 2024-04-17T19:50:21.031 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:21.039+0000 7fc586000640 1 -- 172.21.15.44:0/782289771 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5780a8e20 con 0x7fc588153670 2024-04-17T19:50:21.031 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:21.039+0000 7fc58ce00640 1 -- 172.21.15.44:0/782289771 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc588153670 msgr2=0x7fc5880ca3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:50:21.031 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:21.039+0000 7fc58ce00640 1 --2- 172.21.15.44:0/782289771 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc588153670 0x7fc5880ca3d0 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7fc578009870 tx=0x7fc57801ed50 comp rx=0 tx=0).stop 2024-04-17T19:50:21.031 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:21.039+0000 7fc58ce00640 1 -- 172.21.15.44:0/782289771 shutdown_connections 2024-04-17T19:50:21.032 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:21.039+0000 7fc58ce00640 1 --2- 172.21.15.44:0/782289771 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fc588159e10 0x7fc58815a220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:50:21.032 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:21.039+0000 7fc58ce00640 1 --2- 172.21.15.44:0/782289771 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc588153670 0x7fc5880ca3d0 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:50:21.032 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:21.039+0000 7fc58ce00640 1 -- 172.21.15.44:0/782289771 >> 172.21.15.44:0/782289771 conn(0x7fc5880680e0 msgr2=0x7fc5880684f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:50:21.032 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:21.039+0000 7fc58ce00640 1 -- 172.21.15.44:0/782289771 shutdown_connections 2024-04-17T19:50:21.032 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:21.039+0000 7fc58ce00640 1 -- 172.21.15.44:0/782289771 wait complete. 2024-04-17T19:50:21.033 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:21.043+0000 7fc58ce00640 1 Processor -- start 2024-04-17T19:50:21.033 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:21.043+0000 7fc58ce00640 1 -- start start 2024-04-17T19:50:21.036 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:21.043+0000 7fc58ce00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc5880c9650 0x7fc5880c7080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:50:21.036 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:21.043+0000 7fc58ce00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc588153670 0x7fc588150710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:50:21.036 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:21.043+0000 7fc58ce00640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fc588159e10 0x7fc5881e4db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:50:21.036 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:21.043+0000 7fc58ce00640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fc5880c4fc0 con 0x7fc5880c9650 2024-04-17T19:50:21.036 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:21.043+0000 7fc58ce00640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7fc588159980 con 0x7fc588153670 2024-04-17T19:50:21.037 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:21.043+0000 7fc58ce00640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7fc5880cbf20 con 0x7fc588159e10 2024-04-17T19:50:21.037 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:21.043+0000 7fc587400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc5880c9650 0x7fc5880c7080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:50:21.037 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:21.043+0000 7fc587400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc5880c9650 0x7fc5880c7080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:47054/0 (socket says 172.21.15.44:47054) 2024-04-17T19:50:21.037 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:21.043+0000 7fc587400640 1 -- 172.21.15.44:0/1429979011 learned_addr learned my addr 172.21.15.44:0/1429979011 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-04-17T19:50:21.037 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:21.043+0000 7fc586a00640 1 --2- 172.21.15.44:0/1429979011 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc588153670 0x7fc588150710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:50:21.037 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:21.043+0000 7fc587e00640 1 --2- 172.21.15.44:0/1429979011 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fc588159e10 0x7fc5881e4db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:50:21.037 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:21.043+0000 7fc587400640 1 -- 172.21.15.44:0/1429979011 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fc588159e10 msgr2=0x7fc5881e4db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:50:21.037 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:21.043+0000 7fc587400640 1 --2- 172.21.15.44:0/1429979011 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fc588159e10 0x7fc5881e4db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:50:21.037 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:21.043+0000 7fc587400640 1 -- 172.21.15.44:0/1429979011 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc588153670 msgr2=0x7fc588150710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:50:21.037 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:21.043+0000 7fc587400640 1 --2- 172.21.15.44:0/1429979011 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc588153670 0x7fc588150710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:50:21.037 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:21.043+0000 7fc587400640 1 -- 172.21.15.44:0/1429979011 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc5881540f0 con 0x7fc5880c9650 2024-04-17T19:50:21.037 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:21.043+0000 7fc587400640 1 --2- 172.21.15.44:0/1429979011 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc5880c9650 0x7fc5880c7080 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7fc57801d400 tx=0x7fc57801baf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:50:21.037 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:21.043+0000 7fc57f400640 1 -- 172.21.15.44:0/1429979011 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5780c0070 con 0x7fc5880c9650 2024-04-17T19:50:21.037 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:21.047+0000 7fc57f400640 1 -- 172.21.15.44:0/1429979011 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc5780ae550 con 0x7fc5880c9650 2024-04-17T19:50:21.038 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:21.047+0000 7fc58ce00640 1 -- 172.21.15.44:0/1429979011 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc5880c75c0 con 0x7fc5880c9650 2024-04-17T19:50:21.038 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:21.047+0000 7fc57f400640 1 -- 172.21.15.44:0/1429979011 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5780b5070 con 0x7fc5880c9650 2024-04-17T19:50:21.038 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:21.047+0000 7fc58ce00640 1 -- 172.21.15.44:0/1429979011 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc588154680 con 0x7fc5880c9650 2024-04-17T19:50:21.038 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:21.047+0000 7fc58ce00640 1 -- 172.21.15.44:0/1429979011 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc5880c8010 con 0x7fc5880c9650 2024-04-17T19:50:21.038 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:21.047+0000 7fc57f400640 1 -- 172.21.15.44:0/1429979011 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fc5780c3070 con 0x7fc5880c9650 2024-04-17T19:50:21.039 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:21.047+0000 7fc57f400640 1 --2- 172.21.15.44:0/1429979011 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7fc568068380 0x7fc56806a890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:50:21.039 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:21.047+0000 7fc57f400640 1 -- 172.21.15.44:0/1429979011 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6619+0+0 (secure 0 0 0) 0x7fc578124620 con 0x7fc5880c9650 2024-04-17T19:50:21.039 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:21.047+0000 7fc586a00640 1 --2- 172.21.15.44:0/1429979011 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7fc568068380 0x7fc56806a890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:50:21.040 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:21.051+0000 7fc586a00640 1 --2- 172.21.15.44:0/1429979011 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7fc568068380 0x7fc56806a890 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fc5880cc6c0 tx=0x7fc574008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:50:21.043 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:21.051+0000 7fc57f400640 1 -- 172.21.15.44:0/1429979011 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fc5780188b0 con 0x7fc5880c9650 2024-04-17T19:50:21.210 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:21.219+0000 7fc58ce00640 1 -- 172.21.15.44:0/1429979011 --> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "4", "target": ["mon-mgr", ""]}) -- 0x7fc588069610 con 0x7fc568068380 2024-04-17T19:50:21.211 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:21.219+0000 7fc57f400640 1 -- 172.21.15.44:0/1429979011 <== mgr.4102 v2:172.21.15.62:6832/1020159798 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 4 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7fc57400f830 con 0x7fc568068380 2024-04-17T19:50:21.211 INFO:teuthology.orchestra.run.smithi044.stderr:instructed osd(s) 4 to deep-scrub 2024-04-17T19:50:21.214 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:21.223+0000 7fc58ce00640 1 -- 172.21.15.44:0/1429979011 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7fc568068380 msgr2=0x7fc56806a890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:50:21.214 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:21.223+0000 7fc58ce00640 1 --2- 172.21.15.44:0/1429979011 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7fc568068380 0x7fc56806a890 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fc5880cc6c0 tx=0x7fc574008040 comp rx=0 tx=0).stop 2024-04-17T19:50:21.214 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:21.223+0000 7fc58ce00640 1 -- 172.21.15.44:0/1429979011 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc5880c9650 msgr2=0x7fc5880c7080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:50:21.214 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:21.223+0000 7fc58ce00640 1 --2- 172.21.15.44:0/1429979011 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc5880c9650 0x7fc5880c7080 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7fc57801d400 tx=0x7fc57801baf0 comp rx=0 tx=0).stop 2024-04-17T19:50:21.214 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:21.223+0000 7fc58ce00640 1 -- 172.21.15.44:0/1429979011 shutdown_connections 2024-04-17T19:50:21.214 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:21.223+0000 7fc58ce00640 1 --2- 172.21.15.44:0/1429979011 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7fc568068380 0x7fc56806a890 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:50:21.214 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:21.223+0000 7fc58ce00640 1 --2- 172.21.15.44:0/1429979011 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fc588159e10 0x7fc5881e4db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:50:21.214 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:21.223+0000 7fc58ce00640 1 --2- 172.21.15.44:0/1429979011 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc588153670 0x7fc588150710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:50:21.214 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:21.223+0000 7fc58ce00640 1 --2- 172.21.15.44:0/1429979011 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc5880c9650 0x7fc5880c7080 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:50:21.215 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:21.223+0000 7fc58ce00640 1 -- 172.21.15.44:0/1429979011 >> 172.21.15.44:0/1429979011 conn(0x7fc5880680e0 msgr2=0x7fc5881529c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:50:21.215 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:21.223+0000 7fc58ce00640 1 -- 172.21.15.44:0/1429979011 shutdown_connections 2024-04-17T19:50:21.215 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:21.223+0000 7fc58ce00640 1 -- 172.21.15.44:0/1429979011 wait complete. 2024-04-17T19:50:21.233 INFO:tasks.ceph:Scrubbing osd.5 2024-04-17T19:50:21.233 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2024-04-17T19:50:21.389 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:21.399+0000 7ff2f6800640 1 Processor -- start 2024-04-17T19:50:21.390 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:21.399+0000 7ff2f6800640 1 -- start start 2024-04-17T19:50:21.392 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:21.399+0000 7ff2f6800640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7ff2f00c7fc0 0x7ff2f0152610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:50:21.392 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:21.399+0000 7ff2f6800640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7ff2f00c83d0 0x7ff2f00c4870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:50:21.392 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:21.399+0000 7ff2f6800640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff2f00c6c20 con 0x7ff2f00c4db0 2024-04-17T19:50:21.392 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:21.399+0000 7ff2f6800640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 -- 0x7ff2f00c6ee0 con 0x7ff2f00c7fc0 2024-04-17T19:50:21.392 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:21.399+0000 7ff2f6800640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7ff2f00c45c0 con 0x7ff2f00c83d0 2024-04-17T19:50:21.392 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:21.399+0000 7ff2efe00640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7ff2f00c4db0 0x7ff2f015bbc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:59030/0 (socket says 172.21.15.44:59030) 2024-04-17T19:50:21.392 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:21.399+0000 7ff2efe00640 1 -- 172.21.15.44:0/3993563900 learned_addr learned my addr 172.21.15.44:0/3993563900 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-04-17T19:50:21.392 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:21.399+0000 7ff2e6a00640 1 --2- 172.21.15.44:0/3993563900 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7ff2f00c83d0 0x7ff2f00c4870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:50:21.392 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:21.399+0000 7ff2ef400640 1 --2- 172.21.15.44:0/3993563900 >> v2:172.21.15.62:3300/0 conn(0x7ff2f00c7fc0 0x7ff2f0152610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:50:21.394 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:21.403+0000 7ff2eea00640 1 -- 172.21.15.44:0/3993563900 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 163964477 0 0) 0x7ff2f00c6c20 con 0x7ff2f00c4db0 2024-04-17T19:50:21.394 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:21.403+0000 7ff2eea00640 1 -- 172.21.15.44:0/3993563900 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff2d4003530 con 0x7ff2f00c4db0 2024-04-17T19:50:21.394 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:21.403+0000 7ff2eea00640 1 -- 172.21.15.44:0/3993563900 <== mon.0 v1:172.21.15.44:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2939496099 0 0) 0x7ff2d4003530 con 0x7ff2f00c4db0 2024-04-17T19:50:21.394 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:21.403+0000 7ff2eea00640 1 -- 172.21.15.44:0/3993563900 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7ff2f00c83d0 msgr2=0x7ff2f00c4870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T19:50:21.394 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:21.403+0000 7ff2eea00640 1 --2- 172.21.15.44:0/3993563900 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7ff2f00c83d0 0x7ff2f00c4870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:50:21.394 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:21.403+0000 7ff2eea00640 1 -- 172.21.15.44:0/3993563900 >> v2:172.21.15.62:3300/0 conn(0x7ff2f00c7fc0 msgr2=0x7ff2f0152610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T19:50:21.395 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:21.403+0000 7ff2eea00640 1 --2- 172.21.15.44:0/3993563900 >> v2:172.21.15.62:3300/0 conn(0x7ff2f00c7fc0 0x7ff2f0152610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:50:21.395 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:21.403+0000 7ff2eea00640 1 -- 172.21.15.44:0/3993563900 --> v1:172.21.15.44:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff2f00c4000 con 0x7ff2f00c4db0 2024-04-17T19:50:21.395 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:21.403+0000 7ff2eea00640 1 -- 172.21.15.44:0/3993563900 <== mon.0 v1:172.21.15.44:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1863569991 0 0) 0x7ff2e8001680 con 0x7ff2f00c4db0 2024-04-17T19:50:21.395 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:21.403+0000 7ff2eea00640 1 -- 172.21.15.44:0/3993563900 >> v1:172.21.15.44:6789/0 conn(0x7ff2f00c4db0 legacy=0x7ff2f015bbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:50:21.395 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:21.403+0000 7ff2eea00640 1 --2- 172.21.15.44:0/3993563900 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7ff2d40039c0 0x7ff2d4003e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:50:21.395 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:21.403+0000 7ff2eea00640 1 --2- 172.21.15.44:0/3993563900 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff2d4004810 0x7ff2d4004c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:50:21.395 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:21.403+0000 7ff2eea00640 1 --2- 172.21.15.44:0/3993563900 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff2d4005160 0x7ff2d400b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:50:21.395 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:21.403+0000 7ff2eea00640 1 -- 172.21.15.44:0/3993563900 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7ff2f00c6ee0 con 0x7ff2d4004810 2024-04-17T19:50:21.395 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:21.403+0000 7ff2eea00640 1 -- 172.21.15.44:0/3993563900 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7ff2f00c45c0 con 0x7ff2d4005160 2024-04-17T19:50:21.395 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:21.403+0000 7ff2eea00640 1 -- 172.21.15.44:0/3993563900 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7ff2d400c0f0 con 0x7ff2d40039c0 2024-04-17T19:50:21.395 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:21.403+0000 7ff2e6a00640 1 --2- 172.21.15.44:0/3993563900 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff2d4004810 0x7ff2d4004c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:50:21.395 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:21.403+0000 7ff2ef400640 1 --2- 172.21.15.44:0/3993563900 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7ff2d40039c0 0x7ff2d4003e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:50:21.395 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:21.403+0000 7ff2efe00640 1 --2- 172.21.15.44:0/3993563900 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff2d4005160 0x7ff2d400b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:50:21.395 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:21.403+0000 7ff2e6a00640 1 -- 172.21.15.44:0/3993563900 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7ff2d40039c0 msgr2=0x7ff2d4003e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T19:50:21.395 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:21.403+0000 7ff2e6a00640 1 --2- 172.21.15.44:0/3993563900 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7ff2d40039c0 0x7ff2d4003e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:50:21.396 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:21.403+0000 7ff2e6a00640 1 -- 172.21.15.44:0/3993563900 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff2d4005160 msgr2=0x7ff2d400b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T19:50:21.396 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:21.403+0000 7ff2e6a00640 1 --2- 172.21.15.44:0/3993563900 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff2d4005160 0x7ff2d400b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:50:21.396 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:21.403+0000 7ff2e6a00640 1 -- 172.21.15.44:0/3993563900 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff2d4003530 con 0x7ff2d4004810 2024-04-17T19:50:21.396 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:21.407+0000 7ff2e6a00640 1 --2- 172.21.15.44:0/3993563900 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff2d4004810 0x7ff2d4004c20 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7ff2f00cd380 tx=0x7ff2d801c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2a16509f15b5596e server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:50:21.396 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:21.407+0000 7ff2eea00640 1 -- 172.21.15.44:0/3993563900 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2d8009670 con 0x7ff2d4004810 2024-04-17T19:50:21.396 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:21.407+0000 7ff2eea00640 1 -- 172.21.15.44:0/3993563900 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff2d80b0070 con 0x7ff2d4004810 2024-04-17T19:50:21.397 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:21.407+0000 7ff2eea00640 1 -- 172.21.15.44:0/3993563900 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2d80a7070 con 0x7ff2d4004810 2024-04-17T19:50:21.397 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:21.407+0000 7ff2f6800640 1 -- 172.21.15.44:0/3993563900 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff2d4004810 msgr2=0x7ff2d4004c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:50:21.397 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:21.407+0000 7ff2f6800640 1 --2- 172.21.15.44:0/3993563900 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff2d4004810 0x7ff2d4004c20 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7ff2f00cd380 tx=0x7ff2d801c850 comp rx=0 tx=0).stop 2024-04-17T19:50:21.398 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:21.407+0000 7ff2efe00640 1 -- 172.21.15.44:0/3993563900 reap_dead start 2024-04-17T19:50:21.398 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:21.407+0000 7ff2f6800640 1 -- 172.21.15.44:0/3993563900 shutdown_connections 2024-04-17T19:50:21.398 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:21.407+0000 7ff2f6800640 1 -- 172.21.15.44:0/3993563900 >> 172.21.15.44:0/3993563900 conn(0x7ff2f00c9ad0 msgr2=0x7ff2f00cc9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:50:21.398 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:21.407+0000 7ff2f6800640 1 -- 172.21.15.44:0/3993563900 shutdown_connections 2024-04-17T19:50:21.398 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:21.407+0000 7ff2f6800640 1 -- 172.21.15.44:0/3993563900 wait complete. 2024-04-17T19:50:21.399 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:21.407+0000 7ff2f6800640 1 Processor -- start 2024-04-17T19:50:21.399 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:21.407+0000 7ff2f6800640 1 -- start start 2024-04-17T19:50:21.402 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:21.411+0000 7ff2f6800640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7ff2d4004810 0x7ff2f01f4f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:50:21.402 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:21.411+0000 7ff2f6800640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff2f015bd30 0x7ff2f00caca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:50:21.402 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:21.411+0000 7ff2f6800640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff2f0151d40 0x7ff2f014f270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:50:21.402 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:21.411+0000 7ff2f6800640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7ff2f00c6870 con 0x7ff2f0151d40 2024-04-17T19:50:21.402 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:21.411+0000 7ff2f6800640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7ff2f0152b50 con 0x7ff2f015bd30 2024-04-17T19:50:21.402 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:21.411+0000 7ff2f6800640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7ff2f01f6980 con 0x7ff2d4004810 2024-04-17T19:50:21.402 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:21.411+0000 7ff2efe00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff2f0151d40 0x7ff2f014f270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:50:21.402 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:21.411+0000 7ff2efe00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff2f0151d40 0x7ff2f014f270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:47072/0 (socket says 172.21.15.44:47072) 2024-04-17T19:50:21.402 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:21.411+0000 7ff2efe00640 1 -- 172.21.15.44:0/2360379794 learned_addr learned my addr 172.21.15.44:0/2360379794 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-04-17T19:50:21.402 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:21.411+0000 7ff2ef400640 1 --2- 172.21.15.44:0/2360379794 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7ff2d4004810 0x7ff2f01f4f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:50:21.402 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:21.411+0000 7ff2e6a00640 1 --2- 172.21.15.44:0/2360379794 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff2f015bd30 0x7ff2f00caca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:50:21.403 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:21.411+0000 7ff2efe00640 1 -- 172.21.15.44:0/2360379794 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7ff2d4004810 msgr2=0x7ff2f01f4f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:50:21.403 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:21.411+0000 7ff2efe00640 1 --2- 172.21.15.44:0/2360379794 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7ff2d4004810 0x7ff2f01f4f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:50:21.403 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:21.411+0000 7ff2efe00640 1 -- 172.21.15.44:0/2360379794 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff2f015bd30 msgr2=0x7ff2f00caca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:50:21.403 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:21.411+0000 7ff2efe00640 1 --2- 172.21.15.44:0/2360379794 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff2f015bd30 0x7ff2f00caca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:50:21.403 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:21.411+0000 7ff2efe00640 1 -- 172.21.15.44:0/2360379794 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff2f015ac90 con 0x7ff2f0151d40 2024-04-17T19:50:21.403 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:21.411+0000 7ff2efe00640 1 --2- 172.21.15.44:0/2360379794 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff2f0151d40 0x7ff2f014f270 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7ff2f0156130 tx=0x7ff2e800e890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:50:21.404 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:21.411+0000 7ff2e7e00640 1 -- 172.21.15.44:0/2360379794 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2e80105d0 con 0x7ff2f0151d40 2024-04-17T19:50:21.404 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:21.411+0000 7ff2e7e00640 1 -- 172.21.15.44:0/2360379794 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff2e8010790 con 0x7ff2f0151d40 2024-04-17T19:50:21.404 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:21.411+0000 7ff2f6800640 1 -- 172.21.15.44:0/2360379794 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff2f015af70 con 0x7ff2f0151d40 2024-04-17T19:50:21.404 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:21.411+0000 7ff2e7e00640 1 -- 172.21.15.44:0/2360379794 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2e8010b80 con 0x7ff2f0151d40 2024-04-17T19:50:21.404 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:21.411+0000 7ff2f6800640 1 -- 172.21.15.44:0/2360379794 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff2f015b530 con 0x7ff2f0151d40 2024-04-17T19:50:21.404 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:21.411+0000 7ff2f6800640 1 -- 172.21.15.44:0/2360379794 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7ff2f015b910 con 0x7ff2f0151d40 2024-04-17T19:50:21.404 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:21.415+0000 7ff2e7e00640 1 -- 172.21.15.44:0/2360379794 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7ff2e8014430 con 0x7ff2f0151d40 2024-04-17T19:50:21.405 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:21.415+0000 7ff2e7e00640 1 --2- 172.21.15.44:0/2360379794 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7ff2cc068380 0x7ff2cc06a890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:50:21.405 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:21.415+0000 7ff2e7e00640 1 -- 172.21.15.44:0/2360379794 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6619+0+0 (secure 0 0 0) 0x7ff2e80863e0 con 0x7ff2f0151d40 2024-04-17T19:50:21.406 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:21.415+0000 7ff2e7e00640 1 --2- 172.21.15.44:0/2360379794 >> [v2:172.21.15.62:6808/1551020300,v1:172.21.15.62:6809/1551020300] conn(0x7ff2cc071bf0 0x7ff2cc0740e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:50:21.406 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:21.415+0000 7ff2e7e00640 1 -- 172.21.15.44:0/2360379794 --> [v2:172.21.15.62:6808/1551020300,v1:172.21.15.62:6809/1551020300] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7ff2cc0747b0 con 0x7ff2cc071bf0 2024-04-17T19:50:21.406 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:21.415+0000 7ff2e7e00640 1 -- 172.21.15.44:0/2360379794 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7ff2e808d050 con 0x7ff2f0151d40 2024-04-17T19:50:21.406 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:21.415+0000 7ff2ef400640 1 --2- 172.21.15.44:0/2360379794 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7ff2cc068380 0x7ff2cc06a890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:50:21.406 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:21.415+0000 7ff2e6a00640 1 --2- 172.21.15.44:0/2360379794 >> [v2:172.21.15.62:6808/1551020300,v1:172.21.15.62:6809/1551020300] conn(0x7ff2cc071bf0 0x7ff2cc0740e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:50:21.407 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:21.415+0000 7ff2ef400640 1 --2- 172.21.15.44:0/2360379794 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7ff2cc068380 0x7ff2cc06a890 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7ff2e0003c10 tx=0x7ff2e000b040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:50:21.407 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:21.415+0000 7ff2e6a00640 1 --2- 172.21.15.44:0/2360379794 >> [v2:172.21.15.62:6808/1551020300,v1:172.21.15.62:6809/1551020300] conn(0x7ff2cc071bf0 0x7ff2cc0740e0 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:50:21.409 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:21.419+0000 7ff2e7e00640 1 -- 172.21.15.44:0/2360379794 <== osd.5 v2:172.21.15.62:6808/1551020300 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7ff2cc0747b0 con 0x7ff2cc071bf0 2024-04-17T19:50:21.422 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:21.431+0000 7ff2f6800640 1 -- 172.21.15.44:0/2360379794 --> [v2:172.21.15.62:6808/1551020300,v1:172.21.15.62:6809/1551020300] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7ff2f015aa40 con 0x7ff2cc071bf0 2024-04-17T19:50:21.423 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:21.431+0000 7ff2e7e00640 1 -- 172.21.15.44:0/2360379794 <== osd.5 v2:172.21.15.62:6808/1551020300 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7ff2f015aa40 con 0x7ff2cc071bf0 2024-04-17T19:50:21.423 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2024-04-17T19:50:21.423 INFO:teuthology.orchestra.run.smithi044.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-17T19:50:21.423 INFO:teuthology.orchestra.run.smithi044.stdout:} 2024-04-17T19:50:21.424 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:21.431+0000 7ff2f6800640 1 -- 172.21.15.44:0/2360379794 >> [v2:172.21.15.62:6808/1551020300,v1:172.21.15.62:6809/1551020300] conn(0x7ff2cc071bf0 msgr2=0x7ff2cc0740e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:50:21.424 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:21.431+0000 7ff2f6800640 1 --2- 172.21.15.44:0/2360379794 >> [v2:172.21.15.62:6808/1551020300,v1:172.21.15.62:6809/1551020300] conn(0x7ff2cc071bf0 0x7ff2cc0740e0 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:50:21.424 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:21.431+0000 7ff2f6800640 1 -- 172.21.15.44:0/2360379794 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7ff2cc068380 msgr2=0x7ff2cc06a890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:50:21.424 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:21.431+0000 7ff2f6800640 1 --2- 172.21.15.44:0/2360379794 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7ff2cc068380 0x7ff2cc06a890 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7ff2e0003c10 tx=0x7ff2e000b040 comp rx=0 tx=0).stop 2024-04-17T19:50:21.424 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:21.431+0000 7ff2f6800640 1 -- 172.21.15.44:0/2360379794 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff2f0151d40 msgr2=0x7ff2f014f270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:50:21.424 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:21.431+0000 7ff2f6800640 1 --2- 172.21.15.44:0/2360379794 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff2f0151d40 0x7ff2f014f270 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7ff2f0156130 tx=0x7ff2e800e890 comp rx=0 tx=0).stop 2024-04-17T19:50:21.425 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:21.431+0000 7ff2efe00640 1 -- 172.21.15.44:0/2360379794 reap_dead start 2024-04-17T19:50:21.425 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:21.431+0000 7ff2f6800640 1 -- 172.21.15.44:0/2360379794 shutdown_connections 2024-04-17T19:50:21.425 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:21.431+0000 7ff2f6800640 1 -- 172.21.15.44:0/2360379794 >> 172.21.15.44:0/2360379794 conn(0x7ff2f00c9ad0 msgr2=0x7ff2f0072570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:50:21.425 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:21.431+0000 7ff2f6800640 1 -- 172.21.15.44:0/2360379794 shutdown_connections 2024-04-17T19:50:21.425 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:21.431+0000 7ff2f6800640 1 -- 172.21.15.44:0/2360379794 wait complete. 2024-04-17T19:50:21.442 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2024-04-17T19:50:21.596 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:21.607+0000 7f3bf4800640 1 Processor -- start 2024-04-17T19:50:21.596 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:21.607+0000 7f3bf4800640 1 -- start start 2024-04-17T19:50:21.598 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:21.607+0000 7f3bf4800640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f3bec152310 0x7f3bec15be50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:50:21.599 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:21.607+0000 7f3bf4800640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f3bec0c7530 0x7f3bec0c7940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:50:21.599 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:21.607+0000 7f3bf4800640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3bec157e50 con 0x7f3bec073f10 2024-04-17T19:50:21.599 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:21.607+0000 7f3bf4800640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 -- 0x7f3bec0c7e80 con 0x7f3bec152310 2024-04-17T19:50:21.599 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:21.607+0000 7f3bf4800640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7f3bec15c390 con 0x7f3bec0c7530 2024-04-17T19:50:21.599 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:21.607+0000 7f3bf1400640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f3bec152310 0x7f3bec15be50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:50:21.599 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:21.607+0000 7f3bf1e00640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f3bec073f10 0x7f3bec1588d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:59046/0 (socket says 172.21.15.44:59046) 2024-04-17T19:50:21.599 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:21.607+0000 7f3bf1e00640 1 -- 172.21.15.44:0/147770211 learned_addr learned my addr 172.21.15.44:0/147770211 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-04-17T19:50:21.599 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:21.607+0000 7f3bf2800640 1 --2- 172.21.15.44:0/147770211 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f3bec0c7530 0x7f3bec0c7940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:50:21.600 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:21.607+0000 7f3bf1400640 1 -- 172.21.15.44:0/147770211 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f3bec0c7530 msgr2=0x7f3bec0c7940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T19:50:21.600 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:21.607+0000 7f3bf1400640 1 --2- 172.21.15.44:0/147770211 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f3bec0c7530 0x7f3bec0c7940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:50:21.600 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:21.607+0000 7f3bf1400640 1 -- 172.21.15.44:0/147770211 >> v1:172.21.15.44:6789/0 conn(0x7f3bec073f10 legacy=0x7f3bec1588d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:50:21.600 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:21.607+0000 7f3bf1400640 1 -- 172.21.15.44:0/147770211 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3bec0c4310 con 0x7f3bec152310 2024-04-17T19:50:21.601 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:21.611+0000 7f3bf1400640 1 --2- 172.21.15.44:0/147770211 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3bec152310 0x7f3bec15be50 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f3bdc0097f0 tx=0x7f3bdc01c4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=48d3c9c7ed7afd1d server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:50:21.602 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:21.611+0000 7f3bf0a00640 1 -- 172.21.15.44:0/147770211 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3bdc0b0070 con 0x7f3bec152310 2024-04-17T19:50:21.602 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:21.611+0000 7f3bf0a00640 1 -- 172.21.15.44:0/147770211 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3bdc0ab600 con 0x7f3bec152310 2024-04-17T19:50:21.602 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:21.611+0000 7f3bf0a00640 1 -- 172.21.15.44:0/147770211 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3bdc0ab9d0 con 0x7f3bec152310 2024-04-17T19:50:21.603 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:21.611+0000 7f3bf4800640 1 -- 172.21.15.44:0/147770211 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3bec152310 msgr2=0x7f3bec15be50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:50:21.603 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:21.611+0000 7f3bf4800640 1 --2- 172.21.15.44:0/147770211 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3bec152310 0x7f3bec15be50 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f3bdc0097f0 tx=0x7f3bdc01c4a0 comp rx=0 tx=0).stop 2024-04-17T19:50:21.603 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:21.611+0000 7f3bf4800640 1 -- 172.21.15.44:0/147770211 shutdown_connections 2024-04-17T19:50:21.603 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:21.611+0000 7f3bf4800640 1 --2- 172.21.15.44:0/147770211 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f3bec0c7530 0x7f3bec0c7940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:50:21.603 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:21.611+0000 7f3bf4800640 1 --2- 172.21.15.44:0/147770211 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3bec152310 0x7f3bec15be50 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:50:21.603 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:21.611+0000 7f3bf4800640 1 -- 172.21.15.44:0/147770211 >> 172.21.15.44:0/147770211 conn(0x7f3bec06c380 msgr2=0x7f3bec070080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:50:21.603 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:21.611+0000 7f3bf4800640 1 -- 172.21.15.44:0/147770211 shutdown_connections 2024-04-17T19:50:21.603 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:21.611+0000 7f3bf4800640 1 -- 172.21.15.44:0/147770211 wait complete. 2024-04-17T19:50:21.605 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:21.615+0000 7f3bf4800640 1 Processor -- start 2024-04-17T19:50:21.605 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:21.615+0000 7f3bf4800640 1 -- start start 2024-04-17T19:50:21.607 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:21.615+0000 7f3bf4800640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f3bec073f10 0x7f3bec14f260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:50:21.607 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:21.615+0000 7f3bf4800640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3bec0c7530 0x7f3bec156fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:50:21.607 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:21.615+0000 7f3bf4800640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3bec152310 0x7f3bec14a130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:50:21.608 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:21.615+0000 7f3bf4800640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f3bec0c3ed0 con 0x7f3bec152310 2024-04-17T19:50:21.608 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:21.615+0000 7f3bf4800640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f3bec1583b0 con 0x7f3bec0c7530 2024-04-17T19:50:21.608 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:21.615+0000 7f3bf4800640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7f3bec0c4050 con 0x7f3bec073f10 2024-04-17T19:50:21.608 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:21.615+0000 7f3bf2800640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3bec152310 0x7f3bec14a130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:50:21.608 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:21.615+0000 7f3bf1e00640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f3bec073f10 0x7f3bec14f260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:50:21.608 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:21.615+0000 7f3bf1400640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3bec0c7530 0x7f3bec156fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:50:21.608 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:21.615+0000 7f3bf2800640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3bec152310 0x7f3bec14a130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:47088/0 (socket says 172.21.15.44:47088) 2024-04-17T19:50:21.608 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:21.615+0000 7f3bf2800640 1 -- 172.21.15.44:0/2823959321 learned_addr learned my addr 172.21.15.44:0/2823959321 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-04-17T19:50:21.608 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:21.615+0000 7f3bf1e00640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f3bec073f10 0x7f3bec14f260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3301/0 says I am v2:172.21.15.44:52816/0 (socket says 172.21.15.44:52816) 2024-04-17T19:50:21.609 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:21.615+0000 7f3bf2800640 1 -- 172.21.15.44:0/2823959321 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f3bec073f10 msgr2=0x7f3bec14f260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:50:21.609 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:21.615+0000 7f3bf2800640 1 --2- 172.21.15.44:0/2823959321 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f3bec073f10 0x7f3bec14f260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:50:21.609 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:21.615+0000 7f3bf2800640 1 -- 172.21.15.44:0/2823959321 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3bec0c7530 msgr2=0x7f3bec156fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:50:21.609 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:21.615+0000 7f3bf2800640 1 --2- 172.21.15.44:0/2823959321 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3bec0c7530 0x7f3bec156fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:50:21.609 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:21.615+0000 7f3bf2800640 1 -- 172.21.15.44:0/2823959321 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3bec14f7a0 con 0x7f3bec152310 2024-04-17T19:50:21.610 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:21.619+0000 7f3bf2800640 1 --2- 172.21.15.44:0/2823959321 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3bec152310 0x7f3bec14a130 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f3be8007d40 tx=0x7f3be800e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:50:21.610 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:21.619+0000 7f3be6000640 1 -- 172.21.15.44:0/2823959321 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3be8014420 con 0x7f3bec152310 2024-04-17T19:50:21.610 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:21.619+0000 7f3be6000640 1 -- 172.21.15.44:0/2823959321 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3be8019070 con 0x7f3bec152310 2024-04-17T19:50:21.610 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:21.619+0000 7f3be6000640 1 -- 172.21.15.44:0/2823959321 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3be8014820 con 0x7f3bec152310 2024-04-17T19:50:21.610 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:21.619+0000 7f3bf4800640 1 -- 172.21.15.44:0/2823959321 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3bec1f59d0 con 0x7f3bec152310 2024-04-17T19:50:21.610 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:21.619+0000 7f3bf4800640 1 -- 172.21.15.44:0/2823959321 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3bec1f5f90 con 0x7f3bec152310 2024-04-17T19:50:21.610 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:21.619+0000 7f3bf4800640 1 -- 172.21.15.44:0/2823959321 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3bec04ff10 con 0x7f3bec152310 2024-04-17T19:50:21.611 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:21.619+0000 7f3be6000640 1 -- 172.21.15.44:0/2823959321 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f3be80149c0 con 0x7f3bec152310 2024-04-17T19:50:21.611 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:21.619+0000 7f3be6000640 1 --2- 172.21.15.44:0/2823959321 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f3bd00683d0 0x7f3bd006a8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:50:21.612 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:21.619+0000 7f3be6000640 1 -- 172.21.15.44:0/2823959321 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6619+0+0 (secure 0 0 0) 0x7f3be80873b0 con 0x7f3bec152310 2024-04-17T19:50:21.612 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:21.619+0000 7f3bf1e00640 1 --2- 172.21.15.44:0/2823959321 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f3bd00683d0 0x7f3bd006a8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:50:21.613 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:21.623+0000 7f3bf1e00640 1 --2- 172.21.15.44:0/2823959321 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f3bd00683d0 0x7f3bd006a8e0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f3be0000f70 tx=0x7f3be0007e90 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:50:21.616 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:21.623+0000 7f3be6000640 1 -- 172.21.15.44:0/2823959321 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f3be8056fe0 con 0x7f3bec152310 2024-04-17T19:50:21.783 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:21.791+0000 7f3bf4800640 1 -- 172.21.15.44:0/2823959321 --> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "5", "target": ["mon-mgr", ""]}) -- 0x7f3bec074380 con 0x7f3bd00683d0 2024-04-17T19:50:21.784 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:21.795+0000 7f3be6000640 1 -- 172.21.15.44:0/2823959321 <== mgr.4102 v2:172.21.15.62:6832/1020159798 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 5 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f3bec074380 con 0x7f3bd00683d0 2024-04-17T19:50:21.784 INFO:teuthology.orchestra.run.smithi044.stderr:instructed osd(s) 5 to deep-scrub 2024-04-17T19:50:21.787 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:21.795+0000 7f3bf4800640 1 -- 172.21.15.44:0/2823959321 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f3bd00683d0 msgr2=0x7f3bd006a8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:50:21.787 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:21.795+0000 7f3bf4800640 1 --2- 172.21.15.44:0/2823959321 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f3bd00683d0 0x7f3bd006a8e0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f3be0000f70 tx=0x7f3be0007e90 comp rx=0 tx=0).stop 2024-04-17T19:50:21.787 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:21.795+0000 7f3bf4800640 1 -- 172.21.15.44:0/2823959321 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3bec152310 msgr2=0x7f3bec14a130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:50:21.787 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:21.795+0000 7f3bf4800640 1 --2- 172.21.15.44:0/2823959321 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3bec152310 0x7f3bec14a130 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f3be8007d40 tx=0x7f3be800e4b0 comp rx=0 tx=0).stop 2024-04-17T19:50:21.787 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:21.795+0000 7f3bf4800640 1 -- 172.21.15.44:0/2823959321 shutdown_connections 2024-04-17T19:50:21.787 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:21.795+0000 7f3bf4800640 1 --2- 172.21.15.44:0/2823959321 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f3bd00683d0 0x7f3bd006a8e0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:50:21.787 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:21.795+0000 7f3bf4800640 1 --2- 172.21.15.44:0/2823959321 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3bec152310 0x7f3bec14a130 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:50:21.787 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:21.795+0000 7f3bf4800640 1 --2- 172.21.15.44:0/2823959321 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3bec0c7530 0x7f3bec156fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:50:21.787 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:21.795+0000 7f3bf4800640 1 --2- 172.21.15.44:0/2823959321 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f3bec073f10 0x7f3bec14f260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:50:21.788 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:21.795+0000 7f3bf4800640 1 -- 172.21.15.44:0/2823959321 >> 172.21.15.44:0/2823959321 conn(0x7f3bec06c380 msgr2=0x7f3bec0c5f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:50:21.788 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:21.795+0000 7f3bf4800640 1 -- 172.21.15.44:0/2823959321 shutdown_connections 2024-04-17T19:50:21.788 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:21.795+0000 7f3bf4800640 1 -- 172.21.15.44:0/2823959321 wait complete. 2024-04-17T19:50:21.807 INFO:tasks.ceph:Scrubbing osd.6 2024-04-17T19:50:21.807 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 config set osd_debug_deep_scrub_sleep 0 2024-04-17T19:50:21.962 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:21.971+0000 7f4b75000640 1 Processor -- start 2024-04-17T19:50:21.962 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:21.971+0000 7f4b75000640 1 -- start start 2024-04-17T19:50:21.964 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:21.971+0000 7f4b75000640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f4b700c7fc0 0x7f4b70152610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:50:21.965 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:21.971+0000 7f4b75000640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f4b700c83d0 0x7f4b700c4870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:50:21.965 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:21.971+0000 7f4b75000640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4b700c6c20 con 0x7f4b700c4db0 2024-04-17T19:50:21.965 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:21.971+0000 7f4b75000640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 -- 0x7f4b700c6ee0 con 0x7f4b700c7fc0 2024-04-17T19:50:21.965 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:21.971+0000 7f4b75000640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7f4b700c45c0 con 0x7f4b700c83d0 2024-04-17T19:50:21.965 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:21.971+0000 7f4b6de00640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f4b700c7fc0 0x7f4b70152610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:50:21.965 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:21.975+0000 7f4b6de00640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f4b700c7fc0 0x7f4b70152610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:47094/0 (socket says 172.21.15.44:47094) 2024-04-17T19:50:21.965 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:21.975+0000 7f4b6de00640 1 -- 172.21.15.44:0/749817295 learned_addr learned my addr 172.21.15.44:0/749817295 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-04-17T19:50:21.965 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:21.975+0000 7f4b67e00640 1 --2- 172.21.15.44:0/749817295 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f4b700c83d0 0x7f4b700c4870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:50:21.965 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:21.975+0000 7f4b6de00640 1 -- 172.21.15.44:0/749817295 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f4b700c83d0 msgr2=0x7f4b700c4870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T19:50:21.965 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:21.975+0000 7f4b6de00640 1 --2- 172.21.15.44:0/749817295 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f4b700c83d0 0x7f4b700c4870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:50:21.965 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:21.975+0000 7f4b6de00640 1 -- 172.21.15.44:0/749817295 >> v1:172.21.15.44:6789/0 conn(0x7f4b700c4db0 legacy=0x7f4b7015bbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:50:21.965 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:21.975+0000 7f4b6d400640 1 -- 172.21.15.44:0/749817295 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4045435585 0 0) 0x7f4b700c6c20 con 0x7f4b700c4db0 2024-04-17T19:50:21.965 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:21.975+0000 7f4b6de00640 1 -- 172.21.15.44:0/749817295 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4b700c4000 con 0x7f4b700c7fc0 2024-04-17T19:50:21.968 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:21.975+0000 7f4b6de00640 1 --2- 172.21.15.44:0/749817295 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4b700c7fc0 0x7f4b70152610 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f4b700c7060 tx=0x7f4b6001c440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ecba5ce8cb6d99aa server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:50:21.968 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:21.975+0000 7f4b6d400640 1 -- 172.21.15.44:0/749817295 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b600b0070 con 0x7f4b700c7fc0 2024-04-17T19:50:21.968 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:21.975+0000 7f4b6d400640 1 -- 172.21.15.44:0/749817295 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4b600ab600 con 0x7f4b700c7fc0 2024-04-17T19:50:21.968 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:21.975+0000 7f4b6d400640 1 -- 172.21.15.44:0/749817295 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b600ab9d0 con 0x7f4b700c7fc0 2024-04-17T19:50:21.969 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:21.979+0000 7f4b75000640 1 -- 172.21.15.44:0/749817295 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4b700c7fc0 msgr2=0x7f4b70152610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:50:21.969 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:21.979+0000 7f4b75000640 1 --2- 172.21.15.44:0/749817295 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4b700c7fc0 0x7f4b70152610 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f4b700c7060 tx=0x7f4b6001c440 comp rx=0 tx=0).stop 2024-04-17T19:50:21.969 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:21.979+0000 7f4b75000640 1 -- 172.21.15.44:0/749817295 shutdown_connections 2024-04-17T19:50:21.969 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:21.979+0000 7f4b75000640 1 --2- 172.21.15.44:0/749817295 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f4b700c83d0 0x7f4b700c4870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:50:21.969 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:21.979+0000 7f4b75000640 1 --2- 172.21.15.44:0/749817295 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4b700c7fc0 0x7f4b70152610 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:50:21.969 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:21.979+0000 7f4b75000640 1 -- 172.21.15.44:0/749817295 >> 172.21.15.44:0/749817295 conn(0x7f4b700c9ad0 msgr2=0x7f4b700cc9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:50:21.969 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:21.979+0000 7f4b75000640 1 -- 172.21.15.44:0/749817295 shutdown_connections 2024-04-17T19:50:21.969 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:21.979+0000 7f4b75000640 1 -- 172.21.15.44:0/749817295 wait complete. 2024-04-17T19:50:21.971 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:21.979+0000 7f4b75000640 1 Processor -- start 2024-04-17T19:50:21.971 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:21.979+0000 7f4b75000640 1 -- start start 2024-04-17T19:50:21.974 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:21.983+0000 7f4b75000640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f4b700c4db0 0x7f4b700cb2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:50:21.974 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:21.983+0000 7f4b75000640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4b700c7fc0 0x7f4b700cc560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:50:21.974 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:21.983+0000 7f4b75000640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4b700c83d0 0x7f4b701f87e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:50:21.974 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:21.983+0000 7f4b75000640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f4b700c6870 con 0x7f4b700c7fc0 2024-04-17T19:50:21.974 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:21.983+0000 7f4b75000640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f4b70152b50 con 0x7f4b700c83d0 2024-04-17T19:50:21.975 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:21.983+0000 7f4b75000640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7f4b7014e020 con 0x7f4b700c4db0 2024-04-17T19:50:21.975 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:21.983+0000 7f4b67e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4b700c7fc0 0x7f4b700cc560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:50:21.975 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:21.983+0000 7f4b67e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4b700c7fc0 0x7f4b700cc560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:47100/0 (socket says 172.21.15.44:47100) 2024-04-17T19:50:21.975 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:21.983+0000 7f4b67e00640 1 -- 172.21.15.44:0/2571415750 learned_addr learned my addr 172.21.15.44:0/2571415750 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-04-17T19:50:21.975 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:21.983+0000 7f4b6de00640 1 --2- 172.21.15.44:0/2571415750 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f4b700c4db0 0x7f4b700cb2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:50:21.975 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:21.983+0000 7f4b6e800640 1 --2- 172.21.15.44:0/2571415750 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4b700c83d0 0x7f4b701f87e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:50:21.975 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:21.983+0000 7f4b67e00640 1 -- 172.21.15.44:0/2571415750 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f4b700c4db0 msgr2=0x7f4b700cb2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:50:21.975 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:21.983+0000 7f4b67e00640 1 --2- 172.21.15.44:0/2571415750 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f4b700c4db0 0x7f4b700cb2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:50:21.975 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:21.983+0000 7f4b67e00640 1 -- 172.21.15.44:0/2571415750 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4b700c83d0 msgr2=0x7f4b701f87e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:50:21.975 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:21.983+0000 7f4b67e00640 1 --2- 172.21.15.44:0/2571415750 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4b700c83d0 0x7f4b701f87e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:50:21.975 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:21.983+0000 7f4b67e00640 1 -- 172.21.15.44:0/2571415750 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4b700cb7f0 con 0x7f4b700c7fc0 2024-04-17T19:50:21.975 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:21.983+0000 7f4b67e00640 1 --2- 172.21.15.44:0/2571415750 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4b700c7fc0 0x7f4b700cc560 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f4b5800d7d0 tx=0x7f4b5800dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:50:21.975 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:21.983+0000 7f4b66000640 1 -- 172.21.15.44:0/2571415750 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b5800b660 con 0x7f4b700c7fc0 2024-04-17T19:50:21.975 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:21.983+0000 7f4b66000640 1 -- 172.21.15.44:0/2571415750 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4b58019070 con 0x7f4b700c7fc0 2024-04-17T19:50:21.976 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:21.983+0000 7f4b75000640 1 -- 172.21.15.44:0/2571415750 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4b70157050 con 0x7f4b700c7fc0 2024-04-17T19:50:21.976 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:21.983+0000 7f4b66000640 1 -- 172.21.15.44:0/2571415750 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b5800ba40 con 0x7f4b700c7fc0 2024-04-17T19:50:21.976 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:21.983+0000 7f4b75000640 1 -- 172.21.15.44:0/2571415750 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4b700cba00 con 0x7f4b700c7fc0 2024-04-17T19:50:21.976 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:21.983+0000 7f4b75000640 1 -- 172.21.15.44:0/2571415750 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f4b70075f10 con 0x7f4b700c7fc0 2024-04-17T19:50:21.977 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:21.983+0000 7f4b66000640 1 -- 172.21.15.44:0/2571415750 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f4b5800bbe0 con 0x7f4b700c7fc0 2024-04-17T19:50:21.977 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:21.987+0000 7f4b66000640 1 --2- 172.21.15.44:0/2571415750 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f4b4c0683b0 0x7f4b4c06a8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:50:21.977 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:21.987+0000 7f4b66000640 1 -- 172.21.15.44:0/2571415750 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6619+0+0 (secure 0 0 0) 0x7f4b58087a30 con 0x7f4b700c7fc0 2024-04-17T19:50:21.977 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:21.987+0000 7f4b66000640 1 --2- 172.21.15.44:0/2571415750 >> [v2:172.21.15.62:6824/2602310256,v1:172.21.15.62:6825/2602310256] conn(0x7f4b4c071c10 0x7f4b4c074100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:50:21.977 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:21.987+0000 7f4b66000640 1 -- 172.21.15.44:0/2571415750 --> [v2:172.21.15.62:6824/2602310256,v1:172.21.15.62:6825/2602310256] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f4b4c0747d0 con 0x7f4b4c071c10 2024-04-17T19:50:21.977 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:21.987+0000 7f4b66000640 1 -- 172.21.15.44:0/2571415750 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f4b58087de0 con 0x7f4b700c7fc0 2024-04-17T19:50:21.978 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:21.987+0000 7f4b6de00640 1 --2- 172.21.15.44:0/2571415750 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f4b4c0683b0 0x7f4b4c06a8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:50:21.978 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:21.987+0000 7f4b6e800640 1 --2- 172.21.15.44:0/2571415750 >> [v2:172.21.15.62:6824/2602310256,v1:172.21.15.62:6825/2602310256] conn(0x7f4b4c071c10 0x7f4b4c074100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:50:21.978 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:21.987+0000 7f4b6de00640 1 --2- 172.21.15.44:0/2571415750 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f4b4c0683b0 0x7f4b4c06a8c0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f4b600ad000 tx=0x7f4b600a6000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:50:21.978 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:21.987+0000 7f4b6e800640 1 --2- 172.21.15.44:0/2571415750 >> [v2:172.21.15.62:6824/2602310256,v1:172.21.15.62:6825/2602310256] conn(0x7f4b4c071c10 0x7f4b4c074100 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:50:21.980 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:21.991+0000 7f4b66000640 1 -- 172.21.15.44:0/2571415750 <== osd.6 v2:172.21.15.62:6824/2602310256 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f4b4c0747d0 con 0x7f4b4c071c10 2024-04-17T19:50:21.993 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:22.003+0000 7f4b75000640 1 -- 172.21.15.44:0/2571415750 --> [v2:172.21.15.62:6824/2602310256,v1:172.21.15.62:6825/2602310256] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f4b700cd430 con 0x7f4b4c071c10 2024-04-17T19:50:21.994 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:22.003+0000 7f4b66000640 1 -- 172.21.15.44:0/2571415750 <== osd.6 v2:172.21.15.62:6824/2602310256 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f4b700cd430 con 0x7f4b4c071c10 2024-04-17T19:50:21.995 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2024-04-17T19:50:21.995 INFO:teuthology.orchestra.run.smithi044.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-17T19:50:21.995 INFO:teuthology.orchestra.run.smithi044.stdout:} 2024-04-17T19:50:21.996 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:22.003+0000 7f4b75000640 1 -- 172.21.15.44:0/2571415750 >> [v2:172.21.15.62:6824/2602310256,v1:172.21.15.62:6825/2602310256] conn(0x7f4b4c071c10 msgr2=0x7f4b4c074100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:50:21.996 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:22.003+0000 7f4b75000640 1 --2- 172.21.15.44:0/2571415750 >> [v2:172.21.15.62:6824/2602310256,v1:172.21.15.62:6825/2602310256] conn(0x7f4b4c071c10 0x7f4b4c074100 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:50:21.996 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:22.003+0000 7f4b75000640 1 -- 172.21.15.44:0/2571415750 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f4b4c0683b0 msgr2=0x7f4b4c06a8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:50:21.996 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:22.003+0000 7f4b75000640 1 --2- 172.21.15.44:0/2571415750 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f4b4c0683b0 0x7f4b4c06a8c0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f4b600ad000 tx=0x7f4b600a6000 comp rx=0 tx=0).stop 2024-04-17T19:50:21.996 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:22.003+0000 7f4b75000640 1 -- 172.21.15.44:0/2571415750 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4b700c7fc0 msgr2=0x7f4b700cc560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:50:21.996 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:22.003+0000 7f4b75000640 1 --2- 172.21.15.44:0/2571415750 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4b700c7fc0 0x7f4b700cc560 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f4b5800d7d0 tx=0x7f4b5800dc90 comp rx=0 tx=0).stop 2024-04-17T19:50:21.996 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:22.003+0000 7f4b6e800640 1 -- 172.21.15.44:0/2571415750 reap_dead start 2024-04-17T19:50:21.997 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:22.003+0000 7f4b75000640 1 -- 172.21.15.44:0/2571415750 shutdown_connections 2024-04-17T19:50:21.997 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:22.003+0000 7f4b75000640 1 -- 172.21.15.44:0/2571415750 >> 172.21.15.44:0/2571415750 conn(0x7f4b700c9ad0 msgr2=0x7f4b7014f730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:50:21.997 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:22.003+0000 7f4b75000640 1 -- 172.21.15.44:0/2571415750 shutdown_connections 2024-04-17T19:50:21.997 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:22.003+0000 7f4b75000640 1 -- 172.21.15.44:0/2571415750 wait complete. 2024-04-17T19:50:22.014 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 6 2024-04-17T19:50:22.167 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:22.175+0000 7fbf9ea00640 1 Processor -- start 2024-04-17T19:50:22.167 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:22.175+0000 7fbf9ea00640 1 -- start start 2024-04-17T19:50:22.170 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:22.179+0000 7fbf9ea00640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fbf9815f5c0 0x7fbf9815f9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:50:22.170 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:22.179+0000 7fbf9ea00640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fbf980ca950 0x7fbf980cad60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:50:22.170 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:22.179+0000 7fbf9ea00640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbf9815ff10 con 0x7fbf98155ce0 2024-04-17T19:50:22.170 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:22.179+0000 7fbf9ea00640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 -- 0x7fbf9815f130 con 0x7fbf9815f5c0 2024-04-17T19:50:22.170 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:22.179+0000 7fbf9ea00640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 -- 0x7fbf9806d820 con 0x7fbf980ca950 2024-04-17T19:50:22.170 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:22.179+0000 7fbf9d600640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7fbf98155ce0 0x7fbf98070770 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:59072/0 (socket says 172.21.15.44:59072) 2024-04-17T19:50:22.170 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:22.179+0000 7fbf9d600640 1 -- 172.21.15.44:0/203718670 learned_addr learned my addr 172.21.15.44:0/203718670 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-04-17T19:50:22.170 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:22.179+0000 7fbf9cc00640 1 --2- 172.21.15.44:0/203718670 >> v2:172.21.15.44:3300/0 conn(0x7fbf9815f5c0 0x7fbf9815f9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:50:22.170 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:22.179+0000 7fbf9e000640 1 --2- 172.21.15.44:0/203718670 >> v2:172.21.15.62:3300/0 conn(0x7fbf980ca950 0x7fbf980cad60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:50:22.170 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:22.179+0000 7fbf9cc00640 1 -- 172.21.15.44:0/203718670 >> v2:172.21.15.62:3300/0 conn(0x7fbf980ca950 msgr2=0x7fbf980cad60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T19:50:22.171 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:22.179+0000 7fbf9cc00640 1 --2- 172.21.15.44:0/203718670 >> v2:172.21.15.62:3300/0 conn(0x7fbf980ca950 0x7fbf980cad60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:50:22.171 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:22.179+0000 7fbf9cc00640 1 -- 172.21.15.44:0/203718670 >> v1:172.21.15.44:6789/0 conn(0x7fbf98155ce0 legacy=0x7fbf98070770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:50:22.171 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:22.179+0000 7fbf9cc00640 1 -- 172.21.15.44:0/203718670 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbf9806db00 con 0x7fbf9815f5c0 2024-04-17T19:50:22.171 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:22.179+0000 7fbf97e00640 1 -- 172.21.15.44:0/203718670 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 509855408 0 0) 0x7fbf8c001120 con 0x7fbf98155ce0 2024-04-17T19:50:22.173 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:22.183+0000 7fbf9cc00640 1 --2- 172.21.15.44:0/203718670 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbf9815f5c0 0x7fbf9815f9d0 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7fbf840097c0 tx=0x7fbf8401c460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a37240e9b640f4d7 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:50:22.173 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:22.183+0000 7fbf97e00640 1 -- 172.21.15.44:0/203718670 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf840b0070 con 0x7fbf9815f5c0 2024-04-17T19:50:22.173 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:22.183+0000 7fbf97e00640 1 -- 172.21.15.44:0/203718670 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbf84004230 con 0x7fbf9815f5c0 2024-04-17T19:50:22.173 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:22.183+0000 7fbf97e00640 1 -- 172.21.15.44:0/203718670 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf84003620 con 0x7fbf9815f5c0 2024-04-17T19:50:22.174 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:22.183+0000 7fbf9ea00640 1 -- 172.21.15.44:0/203718670 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbf9815f5c0 msgr2=0x7fbf9815f9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:50:22.174 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:22.183+0000 7fbf9ea00640 1 --2- 172.21.15.44:0/203718670 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbf9815f5c0 0x7fbf9815f9d0 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7fbf840097c0 tx=0x7fbf8401c460 comp rx=0 tx=0).stop 2024-04-17T19:50:22.174 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:22.183+0000 7fbf9ea00640 1 -- 172.21.15.44:0/203718670 shutdown_connections 2024-04-17T19:50:22.174 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:22.183+0000 7fbf9ea00640 1 --2- 172.21.15.44:0/203718670 >> v2:172.21.15.62:3300/0 conn(0x7fbf980ca950 0x7fbf980cad60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:50:22.174 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:22.183+0000 7fbf9ea00640 1 --2- 172.21.15.44:0/203718670 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbf9815f5c0 0x7fbf9815f9d0 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:50:22.174 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:22.183+0000 7fbf9ea00640 1 -- 172.21.15.44:0/203718670 >> 172.21.15.44:0/203718670 conn(0x7fbf980680e0 msgr2=0x7fbf980684f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:50:22.174 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:22.183+0000 7fbf9ea00640 1 -- 172.21.15.44:0/203718670 shutdown_connections 2024-04-17T19:50:22.174 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:22.183+0000 7fbf9ea00640 1 -- 172.21.15.44:0/203718670 wait complete. 2024-04-17T19:50:22.176 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:22.183+0000 7fbf9ea00640 1 Processor -- start 2024-04-17T19:50:22.176 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:22.183+0000 7fbf9ea00640 1 -- start start 2024-04-17T19:50:22.179 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:22.187+0000 7fbf9ea00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbf980ca950 0x7fbf9815adf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:50:22.179 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:22.187+0000 7fbf9ea00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbf98155ce0 0x7fbf980ce1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:50:22.180 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:22.187+0000 7fbf9ea00640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fbf9815f5c0 0x7fbf981f84e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:50:22.180 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:22.187+0000 7fbf9ea00640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fbf981560f0 con 0x7fbf98155ce0 2024-04-17T19:50:22.180 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:22.187+0000 7fbf9ea00640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7fbf980cb2a0 con 0x7fbf980ca950 2024-04-17T19:50:22.180 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:22.187+0000 7fbf9ea00640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7fbf981f8ed0 con 0x7fbf9815f5c0 2024-04-17T19:50:22.180 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:22.187+0000 7fbf9cc00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbf98155ce0 0x7fbf980ce1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:50:22.180 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:22.187+0000 7fbf9cc00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbf98155ce0 0x7fbf980ce1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:47108/0 (socket says 172.21.15.44:47108) 2024-04-17T19:50:22.180 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:22.187+0000 7fbf9cc00640 1 -- 172.21.15.44:0/3803801291 learned_addr learned my addr 172.21.15.44:0/3803801291 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-04-17T19:50:22.180 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:22.187+0000 7fbf9d600640 1 --2- 172.21.15.44:0/3803801291 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbf980ca950 0x7fbf9815adf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:50:22.180 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:22.187+0000 7fbf9e000640 1 --2- 172.21.15.44:0/3803801291 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fbf9815f5c0 0x7fbf981f84e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:50:22.180 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:22.187+0000 7fbf9cc00640 1 -- 172.21.15.44:0/3803801291 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fbf9815f5c0 msgr2=0x7fbf981f84e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:50:22.180 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:22.187+0000 7fbf9cc00640 1 --2- 172.21.15.44:0/3803801291 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fbf9815f5c0 0x7fbf981f84e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:50:22.180 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:22.187+0000 7fbf9cc00640 1 -- 172.21.15.44:0/3803801291 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbf980ca950 msgr2=0x7fbf9815adf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:50:22.180 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:22.187+0000 7fbf9cc00640 1 --2- 172.21.15.44:0/3803801291 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbf980ca950 0x7fbf9815adf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:50:22.180 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:22.187+0000 7fbf9cc00640 1 -- 172.21.15.44:0/3803801291 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbf980ce6f0 con 0x7fbf98155ce0 2024-04-17T19:50:22.181 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:22.187+0000 7fbf9d600640 1 --2- 172.21.15.44:0/3803801291 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbf980ca950 0x7fbf9815adf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-17T19:50:22.181 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:22.187+0000 7fbf9cc00640 1 --2- 172.21.15.44:0/3803801291 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbf98155ce0 0x7fbf980ce1b0 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7fbf840097c0 tx=0x7fbf84019200 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:50:22.181 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:22.187+0000 7fbf95600640 1 -- 172.21.15.44:0/3803801291 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf840b0040 con 0x7fbf98155ce0 2024-04-17T19:50:22.181 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:22.187+0000 7fbf95600640 1 -- 172.21.15.44:0/3803801291 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbf840bb070 con 0x7fbf98155ce0 2024-04-17T19:50:22.181 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:22.187+0000 7fbf95600640 1 -- 172.21.15.44:0/3803801291 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf84006e20 con 0x7fbf98155ce0 2024-04-17T19:50:22.181 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:22.187+0000 7fbf9ea00640 1 -- 172.21.15.44:0/3803801291 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbf981f9120 con 0x7fbf98155ce0 2024-04-17T19:50:22.181 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:22.187+0000 7fbf9ea00640 1 -- 172.21.15.44:0/3803801291 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbf9815a910 con 0x7fbf98155ce0 2024-04-17T19:50:22.182 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:22.187+0000 7fbf9ea00640 1 -- 172.21.15.44:0/3803801291 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbf9804fea0 con 0x7fbf98155ce0 2024-04-17T19:50:22.182 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:22.191+0000 7fbf95600640 1 -- 172.21.15.44:0/3803801291 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fbf840b3070 con 0x7fbf98155ce0 2024-04-17T19:50:22.182 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:22.191+0000 7fbf95600640 1 --2- 172.21.15.44:0/3803801291 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7fbf78068380 0x7fbf7806a890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:50:22.182 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:22.191+0000 7fbf95600640 1 -- 172.21.15.44:0/3803801291 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6619+0+0 (secure 0 0 0) 0x7fbf84120af0 con 0x7fbf98155ce0 2024-04-17T19:50:22.182 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:22.191+0000 7fbf9d600640 1 --2- 172.21.15.44:0/3803801291 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7fbf78068380 0x7fbf7806a890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:50:22.183 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:22.191+0000 7fbf9d600640 1 --2- 172.21.15.44:0/3803801291 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7fbf78068380 0x7fbf7806a890 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fbf8c000f70 tx=0x7fbf8c007cb0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:50:22.186 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:22.195+0000 7fbf95600640 1 -- 172.21.15.44:0/3803801291 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fbf84016050 con 0x7fbf98155ce0 2024-04-17T19:50:22.353 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:22.363+0000 7fbf9ea00640 1 -- 172.21.15.44:0/3803801291 --> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "6", "target": ["mon-mgr", ""]}) -- 0x7fbf98069610 con 0x7fbf78068380 2024-04-17T19:50:22.354 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:22.363+0000 7fbf95600640 1 -- 172.21.15.44:0/3803801291 <== mgr.4102 v2:172.21.15.62:6832/1020159798 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 6 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7fbf8c005c90 con 0x7fbf78068380 2024-04-17T19:50:22.354 INFO:teuthology.orchestra.run.smithi044.stderr:instructed osd(s) 6 to deep-scrub 2024-04-17T19:50:22.356 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:22.363+0000 7fbf9ea00640 1 -- 172.21.15.44:0/3803801291 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7fbf78068380 msgr2=0x7fbf7806a890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:50:22.356 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:22.363+0000 7fbf9ea00640 1 --2- 172.21.15.44:0/3803801291 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7fbf78068380 0x7fbf7806a890 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fbf8c000f70 tx=0x7fbf8c007cb0 comp rx=0 tx=0).stop 2024-04-17T19:50:22.356 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:22.363+0000 7fbf9ea00640 1 -- 172.21.15.44:0/3803801291 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbf98155ce0 msgr2=0x7fbf980ce1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:50:22.356 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:22.363+0000 7fbf9ea00640 1 --2- 172.21.15.44:0/3803801291 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbf98155ce0 0x7fbf980ce1b0 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7fbf840097c0 tx=0x7fbf84019200 comp rx=0 tx=0).stop 2024-04-17T19:50:22.357 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:22.363+0000 7fbf9ea00640 1 -- 172.21.15.44:0/3803801291 shutdown_connections 2024-04-17T19:50:22.357 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:22.363+0000 7fbf9ea00640 1 --2- 172.21.15.44:0/3803801291 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7fbf78068380 0x7fbf7806a890 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:50:22.357 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:22.363+0000 7fbf9ea00640 1 --2- 172.21.15.44:0/3803801291 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fbf9815f5c0 0x7fbf981f84e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:50:22.357 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:22.363+0000 7fbf9ea00640 1 --2- 172.21.15.44:0/3803801291 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbf98155ce0 0x7fbf980ce1b0 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:50:22.357 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:22.363+0000 7fbf9ea00640 1 --2- 172.21.15.44:0/3803801291 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbf980ca950 0x7fbf9815adf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:50:22.357 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:22.363+0000 7fbf9ea00640 1 -- 172.21.15.44:0/3803801291 >> 172.21.15.44:0/3803801291 conn(0x7fbf980680e0 msgr2=0x7fbf98151530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:50:22.357 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:22.367+0000 7fbf9ea00640 1 -- 172.21.15.44:0/3803801291 shutdown_connections 2024-04-17T19:50:22.357 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:22.367+0000 7fbf9ea00640 1 -- 172.21.15.44:0/3803801291 wait complete. 2024-04-17T19:50:22.376 INFO:tasks.ceph:Scrubbing osd.7 2024-04-17T19:50:22.376 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 config set osd_debug_deep_scrub_sleep 0 2024-04-17T19:50:22.534 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:22.543+0000 7f7ddfa00640 1 Processor -- start 2024-04-17T19:50:22.534 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:22.543+0000 7f7ddfa00640 1 -- start start 2024-04-17T19:50:22.536 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:22.543+0000 7f7ddfa00640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f7dd8152450 0x7f7dd80c5090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:50:22.536 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:22.543+0000 7f7ddfa00640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f7dd80c55d0 0x7f7dd80c59e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:50:22.536 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:22.543+0000 7f7ddfa00640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7dd806cfc0 con 0x7f7dd8070e70 2024-04-17T19:50:22.536 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:22.543+0000 7f7ddfa00640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 -- 0x7f7dd815c870 con 0x7f7dd80c55d0 2024-04-17T19:50:22.536 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:22.543+0000 7f7ddfa00640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 -- 0x7f7dd815c3e0 con 0x7f7dd8152450 2024-04-17T19:50:22.536 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:22.543+0000 7f7ddda00640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f7dd80c55d0 0x7f7dd80c59e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:50:22.537 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:22.543+0000 7f7ddda00640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f7dd80c55d0 0x7f7dd80c59e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:47124/0 (socket says 172.21.15.44:47124) 2024-04-17T19:50:22.537 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:22.543+0000 7f7ddda00640 1 -- 172.21.15.44:0/1984116611 learned_addr learned my addr 172.21.15.44:0/1984116611 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-04-17T19:50:22.537 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:22.543+0000 7f7dd7e00640 1 --2- 172.21.15.44:0/1984116611 >> v2:172.21.15.62:3300/0 conn(0x7f7dd8152450 0x7f7dd80c5090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:50:22.537 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:22.547+0000 7f7ddda00640 1 -- 172.21.15.44:0/1984116611 >> v2:172.21.15.62:3300/0 conn(0x7f7dd8152450 msgr2=0x7f7dd80c5090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T19:50:22.537 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:22.547+0000 7f7ddda00640 1 --2- 172.21.15.44:0/1984116611 >> v2:172.21.15.62:3300/0 conn(0x7f7dd8152450 0x7f7dd80c5090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:50:22.537 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:22.547+0000 7f7ddda00640 1 -- 172.21.15.44:0/1984116611 >> v1:172.21.15.62:6789/0 conn(0x7f7dd8070e70 legacy=0x7f7dd80c9550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:50:22.537 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:22.547+0000 7f7ddda00640 1 -- 172.21.15.44:0/1984116611 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7dd815bab0 con 0x7f7dd80c55d0 2024-04-17T19:50:22.539 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:22.547+0000 7f7ddda00640 1 --2- 172.21.15.44:0/1984116611 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7dd80c55d0 0x7f7dd80c59e0 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f7dd8073670 tx=0x7f7dd001c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7f339f5faf7bfc79 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:50:22.539 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:22.547+0000 7f7dd7400640 1 -- 172.21.15.44:0/1984116611 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7dd00a56c0 con 0x7f7dd80c55d0 2024-04-17T19:50:22.539 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:22.547+0000 7f7dd7400640 1 -- 172.21.15.44:0/1984116611 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7dd00a5860 con 0x7f7dd80c55d0 2024-04-17T19:50:22.540 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:22.547+0000 7f7dd7400640 1 -- 172.21.15.44:0/1984116611 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7dd00a5c30 con 0x7f7dd80c55d0 2024-04-17T19:50:22.540 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:22.551+0000 7f7ddfa00640 1 -- 172.21.15.44:0/1984116611 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7dd80c55d0 msgr2=0x7f7dd80c59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:50:22.540 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:22.551+0000 7f7ddfa00640 1 --2- 172.21.15.44:0/1984116611 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7dd80c55d0 0x7f7dd80c59e0 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f7dd8073670 tx=0x7f7dd001c9f0 comp rx=0 tx=0).stop 2024-04-17T19:50:22.540 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:22.551+0000 7f7ddfa00640 1 -- 172.21.15.44:0/1984116611 shutdown_connections 2024-04-17T19:50:22.540 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:22.551+0000 7f7ddfa00640 1 --2- 172.21.15.44:0/1984116611 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7dd80c55d0 0x7f7dd80c59e0 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:50:22.541 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:22.551+0000 7f7ddfa00640 1 --2- 172.21.15.44:0/1984116611 >> v2:172.21.15.62:3300/0 conn(0x7f7dd8152450 0x7f7dd80c5090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:50:22.541 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:22.551+0000 7f7ddfa00640 1 -- 172.21.15.44:0/1984116611 >> 172.21.15.44:0/1984116611 conn(0x7f7dd80cebd0 msgr2=0x7f7dd80cefe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:50:22.541 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:22.551+0000 7f7ddfa00640 1 -- 172.21.15.44:0/1984116611 shutdown_connections 2024-04-17T19:50:22.541 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:22.551+0000 7f7ddfa00640 1 -- 172.21.15.44:0/1984116611 wait complete. 2024-04-17T19:50:22.542 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:22.551+0000 7f7ddfa00640 1 Processor -- start 2024-04-17T19:50:22.542 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:22.551+0000 7f7ddfa00640 1 -- start start 2024-04-17T19:50:22.545 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:22.551+0000 7f7ddfa00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7dd8070e70 0x7f7dd80c8630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:50:22.545 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:22.551+0000 7f7ddfa00640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f7dd80c55d0 0x7f7dd81f8bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:50:22.546 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:22.551+0000 7f7ddfa00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7dd8152450 0x7f7dd80c67b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:50:22.546 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:22.551+0000 7f7ddfa00640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f7dd8168ab0 con 0x7f7dd8070e70 2024-04-17T19:50:22.546 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:22.551+0000 7f7ddfa00640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f7dd806d2a0 con 0x7f7dd8152450 2024-04-17T19:50:22.546 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:22.551+0000 7f7ddfa00640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7f7dd8168c30 con 0x7f7dd80c55d0 2024-04-17T19:50:22.546 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:22.555+0000 7f7ddd000640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7dd8070e70 0x7f7dd80c8630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:50:22.546 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:22.555+0000 7f7ddd000640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7dd8070e70 0x7f7dd80c8630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:47136/0 (socket says 172.21.15.44:47136) 2024-04-17T19:50:22.546 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:22.555+0000 7f7ddd000640 1 -- 172.21.15.44:0/3850636993 learned_addr learned my addr 172.21.15.44:0/3850636993 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-04-17T19:50:22.546 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:22.555+0000 7f7dd7e00640 1 --2- 172.21.15.44:0/3850636993 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f7dd80c55d0 0x7f7dd81f8bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:50:22.546 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:22.555+0000 7f7ddda00640 1 --2- 172.21.15.44:0/3850636993 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7dd8152450 0x7f7dd80c67b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:50:22.546 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:22.555+0000 7f7ddd000640 1 -- 172.21.15.44:0/3850636993 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f7dd80c55d0 msgr2=0x7f7dd81f8bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:50:22.546 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:22.555+0000 7f7ddd000640 1 --2- 172.21.15.44:0/3850636993 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f7dd80c55d0 0x7f7dd81f8bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:50:22.546 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:22.555+0000 7f7ddd000640 1 -- 172.21.15.44:0/3850636993 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7dd8152450 msgr2=0x7f7dd80c67b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:50:22.547 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:22.555+0000 7f7ddd000640 1 --2- 172.21.15.44:0/3850636993 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7dd8152450 0x7f7dd80c67b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:50:22.547 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:22.555+0000 7f7ddd000640 1 -- 172.21.15.44:0/3850636993 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7dd81f9100 con 0x7f7dd8070e70 2024-04-17T19:50:22.547 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:22.555+0000 7f7ddda00640 1 --2- 172.21.15.44:0/3850636993 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7dd8152450 0x7f7dd80c67b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-17T19:50:22.547 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:22.555+0000 7f7ddd000640 1 --2- 172.21.15.44:0/3850636993 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7dd8070e70 0x7f7dd80c8630 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f7dcc00c370 tx=0x7f7dcc00c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:50:22.547 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:22.555+0000 7f7dd4c00640 1 -- 172.21.15.44:0/3850636993 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7dcc0052d0 con 0x7f7dd8070e70 2024-04-17T19:50:22.547 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:22.555+0000 7f7dd4c00640 1 -- 172.21.15.44:0/3850636993 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7dcc005470 con 0x7f7dd8070e70 2024-04-17T19:50:22.547 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:22.555+0000 7f7ddfa00640 1 -- 172.21.15.44:0/3850636993 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7dd80c7570 con 0x7f7dd8070e70 2024-04-17T19:50:22.547 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:22.555+0000 7f7dd4c00640 1 -- 172.21.15.44:0/3850636993 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7dcc007260 con 0x7f7dd8070e70 2024-04-17T19:50:22.547 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:22.555+0000 7f7ddfa00640 1 -- 172.21.15.44:0/3850636993 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7dd80c7af0 con 0x7f7dd8070e70 2024-04-17T19:50:22.548 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:22.555+0000 7f7ddfa00640 1 -- 172.21.15.44:0/3850636993 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f7dd804ff80 con 0x7f7dd8070e70 2024-04-17T19:50:22.548 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:22.555+0000 7f7dd4c00640 1 -- 172.21.15.44:0/3850636993 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f7dcc007400 con 0x7f7dd8070e70 2024-04-17T19:50:22.548 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:22.559+0000 7f7dd4c00640 1 --2- 172.21.15.44:0/3850636993 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f7db80683b0 0x7f7db806a8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:50:22.549 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:22.559+0000 7f7dd4c00640 1 -- 172.21.15.44:0/3850636993 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6619+0+0 (secure 0 0 0) 0x7f7dcc086aa0 con 0x7f7dd8070e70 2024-04-17T19:50:22.549 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:22.559+0000 7f7dd4c00640 1 --2- 172.21.15.44:0/3850636993 >> [v2:172.21.15.62:6816/2912738359,v1:172.21.15.62:6817/2912738359] conn(0x7f7db8071c20 0x7f7db8074110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:50:22.549 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:22.559+0000 7f7dd4c00640 1 -- 172.21.15.44:0/3850636993 --> [v2:172.21.15.62:6816/2912738359,v1:172.21.15.62:6817/2912738359] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f7db80747e0 con 0x7f7db8071c20 2024-04-17T19:50:22.549 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:22.559+0000 7f7dd4c00640 1 -- 172.21.15.44:0/3850636993 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f7dcc086e50 con 0x7f7dd8070e70 2024-04-17T19:50:22.549 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:22.559+0000 7f7dd7e00640 1 --2- 172.21.15.44:0/3850636993 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f7db80683b0 0x7f7db806a8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:50:22.549 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:22.559+0000 7f7ddda00640 1 --2- 172.21.15.44:0/3850636993 >> [v2:172.21.15.62:6816/2912738359,v1:172.21.15.62:6817/2912738359] conn(0x7f7db8071c20 0x7f7db8074110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:50:22.550 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:22.559+0000 7f7dd7e00640 1 --2- 172.21.15.44:0/3850636993 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f7db80683b0 0x7f7db806a8c0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f7dd8158400 tx=0x7f7dc4008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:50:22.550 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:22.559+0000 7f7ddda00640 1 --2- 172.21.15.44:0/3850636993 >> [v2:172.21.15.62:6816/2912738359,v1:172.21.15.62:6817/2912738359] conn(0x7f7db8071c20 0x7f7db8074110 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:50:22.552 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:22.559+0000 7f7dd4c00640 1 -- 172.21.15.44:0/3850636993 <== osd.7 v2:172.21.15.62:6816/2912738359 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f7db80747e0 con 0x7f7db8071c20 2024-04-17T19:50:22.565 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:22.575+0000 7f7ddfa00640 1 -- 172.21.15.44:0/3850636993 --> [v2:172.21.15.62:6816/2912738359,v1:172.21.15.62:6817/2912738359] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f7dd80cad40 con 0x7f7db8071c20 2024-04-17T19:50:22.566 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:22.575+0000 7f7dd4c00640 1 -- 172.21.15.44:0/3850636993 <== osd.7 v2:172.21.15.62:6816/2912738359 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f7dd80cad40 con 0x7f7db8071c20 2024-04-17T19:50:22.566 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2024-04-17T19:50:22.567 INFO:teuthology.orchestra.run.smithi044.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-17T19:50:22.567 INFO:teuthology.orchestra.run.smithi044.stdout:} 2024-04-17T19:50:22.567 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:22.575+0000 7f7ddfa00640 1 -- 172.21.15.44:0/3850636993 >> [v2:172.21.15.62:6816/2912738359,v1:172.21.15.62:6817/2912738359] conn(0x7f7db8071c20 msgr2=0x7f7db8074110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:50:22.568 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:22.575+0000 7f7ddfa00640 1 --2- 172.21.15.44:0/3850636993 >> [v2:172.21.15.62:6816/2912738359,v1:172.21.15.62:6817/2912738359] conn(0x7f7db8071c20 0x7f7db8074110 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:50:22.568 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:22.575+0000 7f7ddfa00640 1 -- 172.21.15.44:0/3850636993 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f7db80683b0 msgr2=0x7f7db806a8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:50:22.568 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:22.575+0000 7f7ddfa00640 1 --2- 172.21.15.44:0/3850636993 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f7db80683b0 0x7f7db806a8c0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f7dd8158400 tx=0x7f7dc4008040 comp rx=0 tx=0).stop 2024-04-17T19:50:22.568 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:22.575+0000 7f7ddfa00640 1 -- 172.21.15.44:0/3850636993 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7dd8070e70 msgr2=0x7f7dd80c8630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:50:22.568 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:22.575+0000 7f7ddfa00640 1 --2- 172.21.15.44:0/3850636993 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7dd8070e70 0x7f7dd80c8630 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f7dcc00c370 tx=0x7f7dcc00c830 comp rx=0 tx=0).stop 2024-04-17T19:50:22.568 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:22.575+0000 7f7ddda00640 1 -- 172.21.15.44:0/3850636993 reap_dead start 2024-04-17T19:50:22.568 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:22.575+0000 7f7ddfa00640 1 -- 172.21.15.44:0/3850636993 shutdown_connections 2024-04-17T19:50:22.568 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:22.575+0000 7f7ddfa00640 1 -- 172.21.15.44:0/3850636993 >> 172.21.15.44:0/3850636993 conn(0x7f7dd80cebd0 msgr2=0x7f7dd80cb640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:50:22.568 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:22.575+0000 7f7ddfa00640 1 -- 172.21.15.44:0/3850636993 shutdown_connections 2024-04-17T19:50:22.568 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:22.575+0000 7f7ddfa00640 1 -- 172.21.15.44:0/3850636993 wait complete. 2024-04-17T19:50:22.585 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 7 2024-04-17T19:50:22.738 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:22.747+0000 7f82fc400640 1 Processor -- start 2024-04-17T19:50:22.738 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:22.747+0000 7f82fc400640 1 -- start start 2024-04-17T19:50:22.741 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:22.751+0000 7f82fc400640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f82f4072700 0x7f82f4153a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:50:22.741 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:22.751+0000 7f82fc400640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f82f40c60e0 0x7f82f40c64f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:50:22.741 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:22.751+0000 7f82fc400640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f82f4072d60 con 0x7f82f4159de0 2024-04-17T19:50:22.741 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:22.751+0000 7f82fc400640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 -- 0x7f82f4072b10 con 0x7f82f4072700 2024-04-17T19:50:22.741 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:22.751+0000 7f82fc400640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7f82f4073810 con 0x7f82f40c60e0 2024-04-17T19:50:22.741 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:22.751+0000 7f82f9a00640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f82f4072700 0x7f82f4153a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:50:22.741 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:22.751+0000 7f82f9a00640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f82f4072700 0x7f82f4153a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:47148/0 (socket says 172.21.15.44:47148) 2024-04-17T19:50:22.741 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:22.751+0000 7f82f9a00640 1 -- 172.21.15.44:0/2044702046 learned_addr learned my addr 172.21.15.44:0/2044702046 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-04-17T19:50:22.741 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:22.751+0000 7f82f9000640 1 --2- 172.21.15.44:0/2044702046 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f82f40c60e0 0x7f82f40c64f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:50:22.741 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:22.751+0000 7f82f9a00640 1 -- 172.21.15.44:0/2044702046 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f82f40c60e0 msgr2=0x7f82f40c64f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T19:50:22.741 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:22.751+0000 7f82f9a00640 1 --2- 172.21.15.44:0/2044702046 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f82f40c60e0 0x7f82f40c64f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:50:22.741 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:22.751+0000 7f82f9a00640 1 -- 172.21.15.44:0/2044702046 >> v1:172.21.15.62:6789/0 conn(0x7f82f4159de0 legacy=0x7f82f415a1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:50:22.742 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:22.751+0000 7f82f9a00640 1 -- 172.21.15.44:0/2044702046 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f82f4073af0 con 0x7f82f4072700 2024-04-17T19:50:22.744 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:22.751+0000 7f82f9a00640 1 --2- 172.21.15.44:0/2044702046 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f82f4072700 0x7f82f4153a00 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f82e8009870 tx=0x7f82e801ed50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2b69162e52bae4c5 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:50:22.744 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:22.751+0000 7f82f3e00640 1 -- 172.21.15.44:0/2044702046 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82e80b5070 con 0x7f82f4072700 2024-04-17T19:50:22.744 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:22.755+0000 7f82f3e00640 1 -- 172.21.15.44:0/2044702046 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f82e80a8a50 con 0x7f82f4072700 2024-04-17T19:50:22.744 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:22.755+0000 7f82f3e00640 1 -- 172.21.15.44:0/2044702046 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82e80a8e20 con 0x7f82f4072700 2024-04-17T19:50:22.745 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:22.755+0000 7f82fc400640 1 -- 172.21.15.44:0/2044702046 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f82f4072700 msgr2=0x7f82f4153a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:50:22.745 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:22.755+0000 7f82fc400640 1 --2- 172.21.15.44:0/2044702046 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f82f4072700 0x7f82f4153a00 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f82e8009870 tx=0x7f82e801ed50 comp rx=0 tx=0).stop 2024-04-17T19:50:22.745 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:22.755+0000 7f82fc400640 1 -- 172.21.15.44:0/2044702046 shutdown_connections 2024-04-17T19:50:22.745 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:22.755+0000 7f82fc400640 1 --2- 172.21.15.44:0/2044702046 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f82f40c60e0 0x7f82f40c64f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:50:22.745 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:22.755+0000 7f82fc400640 1 --2- 172.21.15.44:0/2044702046 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f82f4072700 0x7f82f4153a00 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:50:22.745 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:22.755+0000 7f82fc400640 1 -- 172.21.15.44:0/2044702046 >> 172.21.15.44:0/2044702046 conn(0x7f82f406c380 msgr2=0x7f82f4070080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:50:22.745 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:22.755+0000 7f82fc400640 1 -- 172.21.15.44:0/2044702046 shutdown_connections 2024-04-17T19:50:22.746 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:22.755+0000 7f82fc400640 1 -- 172.21.15.44:0/2044702046 wait complete. 2024-04-17T19:50:22.747 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:22.755+0000 7f82fc400640 1 Processor -- start 2024-04-17T19:50:22.747 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:22.755+0000 7f82fc400640 1 -- start start 2024-04-17T19:50:22.750 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:22.759+0000 7f82fc400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f82f4072700 0x7f82f40c4870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:50:22.750 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:22.759+0000 7f82fc400640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f82f40c60e0 0x7f82f40cba70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:50:22.750 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:22.759+0000 7f82fc400640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f82f4159de0 0x7f82f40cbfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:50:22.750 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:22.759+0000 7f82fc400640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f82f4074390 con 0x7f82f4072700 2024-04-17T19:50:22.750 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:22.759+0000 7f82fc400640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f82f40740b0 con 0x7f82f40c60e0 2024-04-17T19:50:22.751 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:22.759+0000 7f82fc400640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7f82f41598c0 con 0x7f82f4159de0 2024-04-17T19:50:22.751 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:22.759+0000 7f82f9a00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f82f4072700 0x7f82f40c4870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:50:22.751 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:22.759+0000 7f82f9a00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f82f4072700 0x7f82f40c4870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:47154/0 (socket says 172.21.15.44:47154) 2024-04-17T19:50:22.751 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:22.759+0000 7f82f9a00640 1 -- 172.21.15.44:0/2037994428 learned_addr learned my addr 172.21.15.44:0/2037994428 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-04-17T19:50:22.751 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:22.759+0000 7f82f9000640 1 --2- 172.21.15.44:0/2037994428 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f82f40c60e0 0x7f82f40cba70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:50:22.751 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:22.759+0000 7f82fa400640 1 --2- 172.21.15.44:0/2037994428 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f82f4159de0 0x7f82f40cbfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:50:22.751 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:22.759+0000 7f82f9a00640 1 -- 172.21.15.44:0/2037994428 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f82f4159de0 msgr2=0x7f82f40cbfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:50:22.751 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:22.759+0000 7f82f9a00640 1 --2- 172.21.15.44:0/2037994428 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f82f4159de0 0x7f82f40cbfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:50:22.751 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:22.759+0000 7f82f9a00640 1 -- 172.21.15.44:0/2037994428 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f82f40c60e0 msgr2=0x7f82f40cba70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:50:22.751 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:22.759+0000 7f82f9a00640 1 --2- 172.21.15.44:0/2037994428 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f82f40c60e0 0x7f82f40cba70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:50:22.751 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:22.759+0000 7f82f9a00640 1 -- 172.21.15.44:0/2037994428 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f82f40c4db0 con 0x7f82f4072700 2024-04-17T19:50:22.751 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:22.759+0000 7f82f9a00640 1 --2- 172.21.15.44:0/2037994428 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f82f4072700 0x7f82f40c4870 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f82e80b3040 tx=0x7f82e801baf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:50:22.752 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:22.759+0000 7f82f1600640 1 -- 172.21.15.44:0/2037994428 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82e80c0070 con 0x7f82f4072700 2024-04-17T19:50:22.752 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:22.759+0000 7f82f1600640 1 -- 172.21.15.44:0/2037994428 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f82e80ae550 con 0x7f82f4072700 2024-04-17T19:50:22.752 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:22.759+0000 7f82f1600640 1 -- 172.21.15.44:0/2037994428 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82e80b5070 con 0x7f82f4072700 2024-04-17T19:50:22.752 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:22.759+0000 7f82fc400640 1 -- 172.21.15.44:0/2037994428 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f82f41e35f0 con 0x7f82f4072700 2024-04-17T19:50:22.752 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:22.759+0000 7f82fc400640 1 -- 172.21.15.44:0/2037994428 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f82f40c4070 con 0x7f82f4072700 2024-04-17T19:50:22.752 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:22.759+0000 7f82fc400640 1 -- 172.21.15.44:0/2037994428 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f82f404ff10 con 0x7f82f4072700 2024-04-17T19:50:22.753 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:22.763+0000 7f82f1600640 1 -- 172.21.15.44:0/2037994428 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f82e80c3070 con 0x7f82f4072700 2024-04-17T19:50:22.753 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:22.763+0000 7f82f1600640 1 --2- 172.21.15.44:0/2037994428 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f82d40683b0 0x7f82d406a8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:50:22.753 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:22.763+0000 7f82f1600640 1 -- 172.21.15.44:0/2037994428 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6619+0+0 (secure 0 0 0) 0x7f82e8124530 con 0x7f82f4072700 2024-04-17T19:50:22.754 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:22.763+0000 7f82f9000640 1 --2- 172.21.15.44:0/2037994428 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f82d40683b0 0x7f82d406a8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:50:22.754 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:22.763+0000 7f82f9000640 1 --2- 172.21.15.44:0/2037994428 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f82d40683b0 0x7f82d406a8c0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f82f40cc810 tx=0x7f82e0008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:50:22.758 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:22.767+0000 7f82f1600640 1 -- 172.21.15.44:0/2037994428 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f82e80188b0 con 0x7f82f4072700 2024-04-17T19:50:22.923 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:22.931+0000 7f82fc400640 1 -- 172.21.15.44:0/2037994428 --> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "7", "target": ["mon-mgr", ""]}) -- 0x7f82f41e38b0 con 0x7f82d40683b0 2024-04-17T19:50:22.925 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:22.935+0000 7f82f1600640 1 -- 172.21.15.44:0/2037994428 <== mgr.4102 v2:172.21.15.62:6832/1020159798 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 7 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f82f41e38b0 con 0x7f82d40683b0 2024-04-17T19:50:22.925 INFO:teuthology.orchestra.run.smithi044.stderr:instructed osd(s) 7 to deep-scrub 2024-04-17T19:50:22.927 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:22.935+0000 7f82fc400640 1 -- 172.21.15.44:0/2037994428 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f82d40683b0 msgr2=0x7f82d406a8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:50:22.927 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:22.935+0000 7f82fc400640 1 --2- 172.21.15.44:0/2037994428 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f82d40683b0 0x7f82d406a8c0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f82f40cc810 tx=0x7f82e0008040 comp rx=0 tx=0).stop 2024-04-17T19:50:22.927 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:22.935+0000 7f82fc400640 1 -- 172.21.15.44:0/2037994428 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f82f4072700 msgr2=0x7f82f40c4870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:50:22.927 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:22.935+0000 7f82fc400640 1 --2- 172.21.15.44:0/2037994428 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f82f4072700 0x7f82f40c4870 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f82e80b3040 tx=0x7f82e801baf0 comp rx=0 tx=0).stop 2024-04-17T19:50:22.927 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:22.935+0000 7f82fc400640 1 -- 172.21.15.44:0/2037994428 shutdown_connections 2024-04-17T19:50:22.927 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:22.935+0000 7f82fc400640 1 --2- 172.21.15.44:0/2037994428 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f82d40683b0 0x7f82d406a8c0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:50:22.927 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:22.935+0000 7f82fc400640 1 --2- 172.21.15.44:0/2037994428 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f82f4159de0 0x7f82f40cbfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:50:22.927 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:22.935+0000 7f82fc400640 1 --2- 172.21.15.44:0/2037994428 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f82f40c60e0 0x7f82f40cba70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:50:22.928 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:22.935+0000 7f82fc400640 1 --2- 172.21.15.44:0/2037994428 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f82f4072700 0x7f82f40c4870 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:50:22.928 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:22.935+0000 7f82fc400640 1 -- 172.21.15.44:0/2037994428 >> 172.21.15.44:0/2037994428 conn(0x7f82f406c380 msgr2=0x7f82f41527a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:50:22.928 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:22.935+0000 7f82fc400640 1 -- 172.21.15.44:0/2037994428 shutdown_connections 2024-04-17T19:50:22.928 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:22.935+0000 7f82fc400640 1 -- 172.21.15.44:0/2037994428 wait complete. 2024-04-17T19:50:22.947 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-17T19:50:23.100 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:23.107+0000 7f855da00640 1 Processor -- start 2024-04-17T19:50:23.100 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:23.111+0000 7f855da00640 1 -- start start 2024-04-17T19:50:23.102 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:23.111+0000 7f855da00640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f8558152a60 0x7f85580c6920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:50:23.102 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:23.111+0000 7f855da00640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8558152e70 con 0x7f85581592c0 2024-04-17T19:50:23.102 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:23.111+0000 7f855da00640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f85580c52c0 con 0x7f8558158eb0 2024-04-17T19:50:23.102 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:23.111+0000 7f855da00640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7f85580c8840 con 0x7f8558152a60 2024-04-17T19:50:23.103 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:23.111+0000 7f8557400640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f85581592c0 0x7f8558163100 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:59076/0 (socket says 172.21.15.44:59076) 2024-04-17T19:50:23.103 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:23.111+0000 7f8557400640 1 -- 172.21.15.44:0/2137885850 learned_addr learned my addr 172.21.15.44:0/2137885850 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-04-17T19:50:23.103 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:23.111+0000 7f8556a00640 1 --2- 172.21.15.44:0/2137885850 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f8558152a60 0x7f85580c6920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:50:23.105 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:23.111+0000 7f8556000640 1 -- 172.21.15.44:0/2137885850 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1470661781 0 0) 0x7f8558152e70 con 0x7f85581592c0 2024-04-17T19:50:23.105 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:23.111+0000 7f8556000640 1 -- 172.21.15.44:0/2137885850 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f853c005740 con 0x7f85581592c0 2024-04-17T19:50:23.105 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:23.111+0000 7f8556000640 1 -- 172.21.15.44:0/2137885850 <== mon.1 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1493389320 0 0) 0x7f85580c52c0 con 0x7f8558158eb0 2024-04-17T19:50:23.105 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:23.111+0000 7f8556000640 1 -- 172.21.15.44:0/2137885850 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8558152e70 con 0x7f8558158eb0 2024-04-17T19:50:23.105 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:23.111+0000 7f8556000640 1 -- 172.21.15.44:0/2137885850 <== mon.0 v1:172.21.15.44:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3116476503 0 0) 0x7f853c005740 con 0x7f85581592c0 2024-04-17T19:50:23.105 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:23.111+0000 7f8556000640 1 -- 172.21.15.44:0/2137885850 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f8558152a60 msgr2=0x7f85580c6920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T19:50:23.105 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:23.111+0000 7f8556000640 1 --2- 172.21.15.44:0/2137885850 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f8558152a60 0x7f85580c6920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:50:23.105 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:23.111+0000 7f8556000640 1 -- 172.21.15.44:0/2137885850 >> v1:172.21.15.62:6789/0 conn(0x7f8558158eb0 legacy=0x7f85580c47c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:50:23.106 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:23.111+0000 7f8556000640 1 -- 172.21.15.44:0/2137885850 --> v1:172.21.15.44:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f85580c8b20 con 0x7f85581592c0 2024-04-17T19:50:23.106 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:23.111+0000 7f8556000640 1 -- 172.21.15.44:0/2137885850 <== mon.0 v1:172.21.15.44:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1863569991 0 0) 0x7f8550001a00 con 0x7f85581592c0 2024-04-17T19:50:23.106 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:23.111+0000 7f8556000640 1 -- 172.21.15.44:0/2137885850 >> v1:172.21.15.44:6789/0 conn(0x7f85581592c0 legacy=0x7f8558163100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:50:23.106 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:23.111+0000 7f8556000640 1 --2- 172.21.15.44:0/2137885850 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f853c005d90 0x7f853c0061e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:50:23.106 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:23.111+0000 7f8556000640 1 --2- 172.21.15.44:0/2137885850 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f853c006a20 0x7f853c006e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:50:23.106 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:23.111+0000 7f8556000640 1 --2- 172.21.15.44:0/2137885850 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f8558152a60 0x7f853c007440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:50:23.106 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:23.111+0000 7f8556000640 1 -- 172.21.15.44:0/2137885850 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f85580c8840 con 0x7f853c006a20 2024-04-17T19:50:23.106 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:23.111+0000 7f8556000640 1 -- 172.21.15.44:0/2137885850 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f853c00dd70 con 0x7f853c005d90 2024-04-17T19:50:23.106 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:23.111+0000 7f8556000640 1 -- 172.21.15.44:0/2137885850 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7f853c00df40 con 0x7f8558152a60 2024-04-17T19:50:23.106 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:23.111+0000 7f854e000640 1 --2- 172.21.15.44:0/2137885850 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f853c006a20 0x7f853c006e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:50:23.106 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:23.111+0000 7f8556a00640 1 --2- 172.21.15.44:0/2137885850 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f853c005d90 0x7f853c0061e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:50:23.106 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:23.111+0000 7f8557400640 1 --2- 172.21.15.44:0/2137885850 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f8558152a60 0x7f853c007440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:50:23.107 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:23.111+0000 7f854e000640 1 -- 172.21.15.44:0/2137885850 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f8558152a60 msgr2=0x7f853c007440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T19:50:23.107 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:23.111+0000 7f854e000640 1 --2- 172.21.15.44:0/2137885850 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f8558152a60 0x7f853c007440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:50:23.107 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:23.111+0000 7f854e000640 1 -- 172.21.15.44:0/2137885850 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f853c005d90 msgr2=0x7f853c0061e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T19:50:23.107 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:23.111+0000 7f854e000640 1 --2- 172.21.15.44:0/2137885850 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f853c005d90 0x7f853c0061e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:50:23.107 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:23.111+0000 7f854e000640 1 -- 172.21.15.44:0/2137885850 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f853c005740 con 0x7f853c006a20 2024-04-17T19:50:23.108 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:23.115+0000 7f854e000640 1 --2- 172.21.15.44:0/2137885850 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f853c006a20 0x7f853c006e30 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f85400018e0 tx=0x7f854001c560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=563504670c9559cc server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:50:23.108 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:23.115+0000 7f8556000640 1 -- 172.21.15.44:0/2137885850 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85400af070 con 0x7f853c006a20 2024-04-17T19:50:23.108 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:23.115+0000 7f8556000640 1 -- 172.21.15.44:0/2137885850 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f85400052d0 con 0x7f853c006a20 2024-04-17T19:50:23.108 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:23.115+0000 7f8556000640 1 -- 172.21.15.44:0/2137885850 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8540001530 con 0x7f853c006a20 2024-04-17T19:50:23.109 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:23.115+0000 7f855da00640 1 -- 172.21.15.44:0/2137885850 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f853c006a20 msgr2=0x7f853c006e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:50:23.109 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:23.115+0000 7f855da00640 1 --2- 172.21.15.44:0/2137885850 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f853c006a20 0x7f853c006e30 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f85400018e0 tx=0x7f854001c560 comp rx=0 tx=0).stop 2024-04-17T19:50:23.109 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:23.115+0000 7f8557400640 1 -- 172.21.15.44:0/2137885850 reap_dead start 2024-04-17T19:50:23.109 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:23.115+0000 7f855da00640 1 -- 172.21.15.44:0/2137885850 shutdown_connections 2024-04-17T19:50:23.109 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:23.115+0000 7f855da00640 1 -- 172.21.15.44:0/2137885850 >> 172.21.15.44:0/2137885850 conn(0x7f855806c380 msgr2=0x7f8558070080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:50:23.109 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:23.115+0000 7f855da00640 1 -- 172.21.15.44:0/2137885850 shutdown_connections 2024-04-17T19:50:23.109 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:23.115+0000 7f855da00640 1 -- 172.21.15.44:0/2137885850 wait complete. 2024-04-17T19:50:23.110 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:23.119+0000 7f855da00640 1 Processor -- start 2024-04-17T19:50:23.110 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:23.119+0000 7f855da00640 1 -- start start 2024-04-17T19:50:23.113 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:23.119+0000 7f855da00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f853c006a20 0x7f85581f68f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:50:23.113 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:23.119+0000 7f855da00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8558146bb0 0x7f8558147c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:50:23.113 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:23.119+0000 7f855da00640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f855814c3b0 0x7f8558157730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:50:23.113 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:23.119+0000 7f855da00640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f8558158990 con 0x7f8558146bb0 2024-04-17T19:50:23.113 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:23.119+0000 7f855da00640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f85580c90e0 con 0x7f853c006a20 2024-04-17T19:50:23.113 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:23.119+0000 7f855da00640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7f85581596d0 con 0x7f855814c3b0 2024-04-17T19:50:23.113 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:23.119+0000 7f854e000640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8558146bb0 0x7f8558147c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:50:23.113 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:23.119+0000 7f854e000640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8558146bb0 0x7f8558147c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:47176/0 (socket says 172.21.15.44:47176) 2024-04-17T19:50:23.114 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:23.119+0000 7f854e000640 1 -- 172.21.15.44:0/1307313931 learned_addr learned my addr 172.21.15.44:0/1307313931 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-04-17T19:50:23.114 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:23.119+0000 7f8557400640 1 --2- 172.21.15.44:0/1307313931 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f855814c3b0 0x7f8558157730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:50:23.114 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:23.119+0000 7f8556a00640 1 --2- 172.21.15.44:0/1307313931 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f853c006a20 0x7f85581f68f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:50:23.114 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:23.123+0000 7f854e000640 1 -- 172.21.15.44:0/1307313931 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f855814c3b0 msgr2=0x7f8558157730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:50:23.114 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:23.123+0000 7f854e000640 1 --2- 172.21.15.44:0/1307313931 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f855814c3b0 0x7f8558157730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:50:23.114 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:23.123+0000 7f854e000640 1 -- 172.21.15.44:0/1307313931 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f853c006a20 msgr2=0x7f85581f68f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:50:23.114 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:23.123+0000 7f854e000640 1 --2- 172.21.15.44:0/1307313931 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f853c006a20 0x7f85581f68f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:50:23.114 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:23.123+0000 7f854e000640 1 -- 172.21.15.44:0/1307313931 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8558146fc0 con 0x7f8558146bb0 2024-04-17T19:50:23.114 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:23.123+0000 7f854e000640 1 --2- 172.21.15.44:0/1307313931 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8558146bb0 0x7f8558147c90 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f8540005040 tx=0x7f853c007a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:50:23.114 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:23.123+0000 7f854f400640 1 -- 172.21.15.44:0/1307313931 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85400bd070 con 0x7f8558146bb0 2024-04-17T19:50:23.114 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:23.123+0000 7f854f400640 1 -- 172.21.15.44:0/1307313931 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8540001510 con 0x7f8558146bb0 2024-04-17T19:50:23.114 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:23.123+0000 7f854f400640 1 -- 172.21.15.44:0/1307313931 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85400af040 con 0x7f8558146bb0 2024-04-17T19:50:23.115 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:23.123+0000 7f855da00640 1 -- 172.21.15.44:0/1307313931 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f855814e570 con 0x7f8558146bb0 2024-04-17T19:50:23.115 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:23.123+0000 7f855da00640 1 -- 172.21.15.44:0/1307313931 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f85580cd690 con 0x7f8558146bb0 2024-04-17T19:50:23.115 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:23.123+0000 7f855da00640 1 -- 172.21.15.44:0/1307313931 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f855804ff10 con 0x7f8558146bb0 2024-04-17T19:50:23.115 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:23.123+0000 7f854f400640 1 -- 172.21.15.44:0/1307313931 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f85400a9070 con 0x7f8558146bb0 2024-04-17T19:50:23.116 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:23.123+0000 7f854f400640 1 --2- 172.21.15.44:0/1307313931 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f8534068380 0x7f853406a890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:50:23.116 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:23.123+0000 7f854f400640 1 -- 172.21.15.44:0/1307313931 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6619+0+0 (secure 0 0 0) 0x7f8540120480 con 0x7f8558146bb0 2024-04-17T19:50:23.116 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:23.127+0000 7f8556a00640 1 --2- 172.21.15.44:0/1307313931 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f8534068380 0x7f853406a890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:50:23.117 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:23.127+0000 7f8556a00640 1 --2- 172.21.15.44:0/1307313931 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f8534068380 0x7f853406a890 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f8548009160 tx=0x7f8548008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:50:23.120 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:23.127+0000 7f854f400640 1 -- 172.21.15.44:0/1307313931 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f8540016270 con 0x7f8558146bb0 2024-04-17T19:50:23.282 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:23.291+0000 7f855da00640 1 -- 172.21.15.44:0/1307313931 --> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f8558143120 con 0x7f8534068380 2024-04-17T19:50:23.306 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:23.315+0000 7f854f400640 1 -- 172.21.15.44:0/1307313931 <== mgr.4102 v2:172.21.15.62:6832/1020159798 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+332942 (secure 0 0 0) 0x7f85480096c0 con 0x7f8534068380 2024-04-17T19:50:23.310 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-04-17T19:50:23.312 INFO:teuthology.orchestra.run.smithi044.stderr:dumped all 2024-04-17T19:50:23.313 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:23.319+0000 7f855da00640 1 -- 172.21.15.44:0/1307313931 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f8534068380 msgr2=0x7f853406a890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:50:23.313 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:23.319+0000 7f855da00640 1 --2- 172.21.15.44:0/1307313931 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f8534068380 0x7f853406a890 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f8548009160 tx=0x7f8548008040 comp rx=0 tx=0).stop 2024-04-17T19:50:23.313 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:23.319+0000 7f855da00640 1 -- 172.21.15.44:0/1307313931 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8558146bb0 msgr2=0x7f8558147c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:50:23.313 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:23.319+0000 7f855da00640 1 --2- 172.21.15.44:0/1307313931 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8558146bb0 0x7f8558147c90 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f8540005040 tx=0x7f853c007a50 comp rx=0 tx=0).stop 2024-04-17T19:50:23.313 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:23.319+0000 7f855da00640 1 -- 172.21.15.44:0/1307313931 shutdown_connections 2024-04-17T19:50:23.313 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:23.319+0000 7f855da00640 1 --2- 172.21.15.44:0/1307313931 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f8534068380 0x7f853406a890 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:50:23.313 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:23.319+0000 7f855da00640 1 --2- 172.21.15.44:0/1307313931 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f855814c3b0 0x7f8558157730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:50:23.313 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:23.319+0000 7f855da00640 1 --2- 172.21.15.44:0/1307313931 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8558146bb0 0x7f8558147c90 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:50:23.313 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:23.319+0000 7f855da00640 1 --2- 172.21.15.44:0/1307313931 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f853c006a20 0x7f85581f68f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:50:23.313 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:23.319+0000 7f855da00640 1 -- 172.21.15.44:0/1307313931 >> 172.21.15.44:0/1307313931 conn(0x7f855806c380 msgr2=0x7f8558072e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:50:23.313 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:23.319+0000 7f855da00640 1 -- 172.21.15.44:0/1307313931 shutdown_connections 2024-04-17T19:50:23.313 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:23.319+0000 7f855da00640 1 -- 172.21.15.44:0/1307313931 wait complete. 2024-04-17T19:50:23.330 INFO:teuthology.orchestra.run.smithi044.stdout:{"pg_ready":true,"pg_map":{"version":131,"stamp":"2024-04-17T19:50:21.989503+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":635186,"num_objects":101,"num_object_clones":0,"num_object_copies":202,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":101,"num_whiteouts":0,"num_read":118,"num_read_kb":102,"num_write":422,"num_write_kb":2545,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":850,"ondisk_log_size":850,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":227120,"kb_used_data":2672,"kb_used_omap":12,"kb_used_meta":224371,"kb_avail":754747600,"statfs":{"total":773094113280,"available":772861542400,"internally_reserved":0,"allocated":2736128,"data_stored":2195220,"data_compressed":66496,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":12751,"internal_metadata":229756465},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":61,"apply_latency_ms":61,"commit_latency_ns":61000000,"apply_latency_ns":61000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":390,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005929"},"pg_stats":[{"pgid":"2.1f","version":"27'13","reported_seq":40,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:39.943777+0000","last_change":"2024-04-17T19:46:55.688623+0000","last_active":"2024-04-17T19:47:39.943777+0000","last_peered":"2024-04-17T19:47:39.943777+0000","last_clean":"2024-04-17T19:47:39.943777+0000","last_became_active":"2024-04-17T19:46:55.687455+0000","last_became_peered":"2024-04-17T19:46:55.687455+0000","last_unstale":"2024-04-17T19:47:39.943777+0000","last_undegraded":"2024-04-17T19:47:39.943777+0000","last_fullsized":"2024-04-17T19:47:39.943777+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:54.640133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:54.640133+0000","last_clean_scrub_stamp":"2024-04-17T19:46:54.640133+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:02:52.057635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"27'5","reported_seq":30,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:50:15.428180+0000","last_change":"2024-04-17T19:46:56.683770+0000","last_active":"2024-04-17T19:50:15.428180+0000","last_peered":"2024-04-17T19:50:15.428180+0000","last_clean":"2024-04-17T19:50:15.428180+0000","last_became_active":"2024-04-17T19:46:56.683111+0000","last_became_peered":"2024-04-17T19:46:56.683111+0000","last_unstale":"2024-04-17T19:50:15.428180+0000","last_undegraded":"2024-04-17T19:50:15.428180+0000","last_fullsized":"2024-04-17T19:50:15.428180+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_clean_scrub_stamp":"2024-04-17T19:46:55.648649+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T22:25:59.135091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:37.965849+0000","last_change":"2024-04-17T19:47:00.788461+0000","last_active":"2024-04-17T19:47:37.965849+0000","last_peered":"2024-04-17T19:47:37.965849+0000","last_clean":"2024-04-17T19:47:37.965849+0000","last_became_active":"2024-04-17T19:47:00.787654+0000","last_became_peered":"2024-04-17T19:47:00.787654+0000","last_unstale":"2024-04-17T19:47:37.965849+0000","last_undegraded":"2024-04-17T19:47:37.965849+0000","last_fullsized":"2024-04-17T19:47:37.965849+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_clean_scrub_stamp":"2024-04-17T19:46:59.695482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T07:28:34.234670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4,1],"acting":[7,6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1e","version":"25'2","reported_seq":29,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:38.681382+0000","last_change":"2024-04-17T19:46:55.703749+0000","last_active":"2024-04-17T19:47:38.681382+0000","last_peered":"2024-04-17T19:47:38.681382+0000","last_clean":"2024-04-17T19:47:38.681382+0000","last_became_active":"2024-04-17T19:46:55.695191+0000","last_became_peered":"2024-04-17T19:46:55.695191+0000","last_unstale":"2024-04-17T19:47:38.681382+0000","last_undegraded":"2024-04-17T19:47:38.681382+0000","last_fullsized":"2024-04-17T19:47:38.681382+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:54.640133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:54.640133+0000","last_clean_scrub_stamp":"2024-04-17T19:46:54.640133+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:24:42.573542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1f","version":"27'6","reported_seq":31,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:50:15.436059+0000","last_change":"2024-04-17T19:46:56.684814+0000","last_active":"2024-04-17T19:50:15.436059+0000","last_peered":"2024-04-17T19:50:15.436059+0000","last_clean":"2024-04-17T19:50:15.436059+0000","last_became_active":"2024-04-17T19:46:56.684475+0000","last_became_peered":"2024-04-17T19:46:56.684475+0000","last_unstale":"2024-04-17T19:50:15.436059+0000","last_undegraded":"2024-04-17T19:50:15.436059+0000","last_fullsized":"2024-04-17T19:50:15.436059+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_clean_scrub_stamp":"2024-04-17T19:46:55.648649+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T05:38:55.394025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:37.955108+0000","last_change":"2024-04-17T19:47:00.769813+0000","last_active":"2024-04-17T19:47:37.955108+0000","last_peered":"2024-04-17T19:47:37.955108+0000","last_clean":"2024-04-17T19:47:37.955108+0000","last_became_active":"2024-04-17T19:47:00.769370+0000","last_became_peered":"2024-04-17T19:47:00.769370+0000","last_unstale":"2024-04-17T19:47:37.955108+0000","last_undegraded":"2024-04-17T19:47:37.955108+0000","last_fullsized":"2024-04-17T19:47:37.955108+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_clean_scrub_stamp":"2024-04-17T19:46:59.695482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:23:20.430751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,4,6],"acting":[2,7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1d","version":"27'13","reported_seq":40,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:49:27.988193+0000","last_change":"2024-04-17T19:46:55.695159+0000","last_active":"2024-04-17T19:49:27.988193+0000","last_peered":"2024-04-17T19:49:27.988193+0000","last_clean":"2024-04-17T19:49:27.988193+0000","last_became_active":"2024-04-17T19:46:55.694285+0000","last_became_peered":"2024-04-17T19:46:55.694285+0000","last_unstale":"2024-04-17T19:49:27.988193+0000","last_undegraded":"2024-04-17T19:49:27.988193+0000","last_fullsized":"2024-04-17T19:49:27.988193+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:54.640133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:54.640133+0000","last_clean_scrub_stamp":"2024-04-17T19:46:54.640133+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T04:52:16.008572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"27'9","reported_seq":34,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:50:15.422070+0000","last_change":"2024-04-17T19:46:56.700734+0000","last_active":"2024-04-17T19:50:15.422070+0000","last_peered":"2024-04-17T19:50:15.422070+0000","last_clean":"2024-04-17T19:50:15.422070+0000","last_became_active":"2024-04-17T19:46:56.700413+0000","last_became_peered":"2024-04-17T19:46:56.700413+0000","last_unstale":"2024-04-17T19:50:15.422070+0000","last_undegraded":"2024-04-17T19:50:15.422070+0000","last_fullsized":"2024-04-17T19:50:15.422070+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_clean_scrub_stamp":"2024-04-17T19:46:55.648649+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:57:40.700986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:37.955549+0000","last_change":"2024-04-17T19:47:00.772341+0000","last_active":"2024-04-17T19:47:37.955549+0000","last_peered":"2024-04-17T19:47:37.955549+0000","last_clean":"2024-04-17T19:47:37.955549+0000","last_became_active":"2024-04-17T19:47:00.771578+0000","last_became_peered":"2024-04-17T19:47:00.771578+0000","last_unstale":"2024-04-17T19:47:37.955549+0000","last_undegraded":"2024-04-17T19:47:37.955549+0000","last_fullsized":"2024-04-17T19:47:37.955549+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_clean_scrub_stamp":"2024-04-17T19:46:59.695482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:51:07.602172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,3,6],"acting":[2,5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1c","version":"27'5","reported_seq":32,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:39.944815+0000","last_change":"2024-04-17T19:46:55.687607+0000","last_active":"2024-04-17T19:47:39.944815+0000","last_peered":"2024-04-17T19:47:39.944815+0000","last_clean":"2024-04-17T19:47:39.944815+0000","last_became_active":"2024-04-17T19:46:55.687282+0000","last_became_peered":"2024-04-17T19:46:55.687282+0000","last_unstale":"2024-04-17T19:47:39.944815+0000","last_undegraded":"2024-04-17T19:47:39.944815+0000","last_fullsized":"2024-04-17T19:47:39.944815+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:54.640133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:54.640133+0000","last_clean_scrub_stamp":"2024-04-17T19:46:54.640133+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T05:52:32.550876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"27'15","reported_seq":40,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:50:15.417559+0000","last_change":"2024-04-17T19:46:56.690268+0000","last_active":"2024-04-17T19:50:15.417559+0000","last_peered":"2024-04-17T19:50:15.417559+0000","last_clean":"2024-04-17T19:50:15.417559+0000","last_became_active":"2024-04-17T19:46:56.689988+0000","last_became_peered":"2024-04-17T19:46:56.689988+0000","last_unstale":"2024-04-17T19:50:15.417559+0000","last_undegraded":"2024-04-17T19:50:15.417559+0000","last_fullsized":"2024-04-17T19:50:15.417559+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_clean_scrub_stamp":"2024-04-17T19:46:55.648649+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T01:29:59.423734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:37.955298+0000","last_change":"2024-04-17T19:47:00.759608+0000","last_active":"2024-04-17T19:47:37.955298+0000","last_peered":"2024-04-17T19:47:37.955298+0000","last_clean":"2024-04-17T19:47:37.955298+0000","last_became_active":"2024-04-17T19:47:00.759059+0000","last_became_peered":"2024-04-17T19:47:00.759059+0000","last_unstale":"2024-04-17T19:47:37.955298+0000","last_undegraded":"2024-04-17T19:47:37.955298+0000","last_fullsized":"2024-04-17T19:47:37.955298+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_clean_scrub_stamp":"2024-04-17T19:46:59.695482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:22:37.460235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,5,7],"acting":[2,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"27'5","reported_seq":30,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:50:15.423204+0000","last_change":"2024-04-17T19:46:56.688273+0000","last_active":"2024-04-17T19:50:15.423204+0000","last_peered":"2024-04-17T19:50:15.423204+0000","last_clean":"2024-04-17T19:50:15.423204+0000","last_became_active":"2024-04-17T19:46:56.687662+0000","last_became_peered":"2024-04-17T19:46:56.687662+0000","last_unstale":"2024-04-17T19:50:15.423204+0000","last_undegraded":"2024-04-17T19:50:15.423204+0000","last_fullsized":"2024-04-17T19:50:15.423204+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_clean_scrub_stamp":"2024-04-17T19:46:55.648649+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:51:46.684685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"27'5","reported_seq":32,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:49:12.983636+0000","last_change":"2024-04-17T19:46:55.692833+0000","last_active":"2024-04-17T19:49:12.983636+0000","last_peered":"2024-04-17T19:49:12.983636+0000","last_clean":"2024-04-17T19:49:12.983636+0000","last_became_active":"2024-04-17T19:46:55.689006+0000","last_became_peered":"2024-04-17T19:46:55.689006+0000","last_unstale":"2024-04-17T19:49:12.983636+0000","last_undegraded":"2024-04-17T19:49:12.983636+0000","last_fullsized":"2024-04-17T19:49:12.983636+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:54.640133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:54.640133+0000","last_clean_scrub_stamp":"2024-04-17T19:46:54.640133+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:57:39.692470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:38.473658+0000","last_change":"2024-04-17T19:47:00.757063+0000","last_active":"2024-04-17T19:47:38.473658+0000","last_peered":"2024-04-17T19:47:38.473658+0000","last_clean":"2024-04-17T19:47:38.473658+0000","last_became_active":"2024-04-17T19:47:00.756456+0000","last_became_peered":"2024-04-17T19:47:00.756456+0000","last_unstale":"2024-04-17T19:47:38.473658+0000","last_undegraded":"2024-04-17T19:47:38.473658+0000","last_fullsized":"2024-04-17T19:47:38.473658+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_clean_scrub_stamp":"2024-04-17T19:46:59.695482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T02:52:51.655611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,5],"acting":[3,1,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.b","version":"27'8","reported_seq":33,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:50:15.395806+0000","last_change":"2024-04-17T19:46:56.691544+0000","last_active":"2024-04-17T19:50:15.395806+0000","last_peered":"2024-04-17T19:50:15.395806+0000","last_clean":"2024-04-17T19:50:15.395806+0000","last_became_active":"2024-04-17T19:46:56.690828+0000","last_became_peered":"2024-04-17T19:46:56.690828+0000","last_unstale":"2024-04-17T19:50:15.395806+0000","last_undegraded":"2024-04-17T19:50:15.395806+0000","last_fullsized":"2024-04-17T19:50:15.395806+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_clean_scrub_stamp":"2024-04-17T19:46:55.648649+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:11:01.745657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.a","version":"27'5","reported_seq":32,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:49:07.988359+0000","last_change":"2024-04-17T19:46:55.715857+0000","last_active":"2024-04-17T19:49:07.988359+0000","last_peered":"2024-04-17T19:49:07.988359+0000","last_clean":"2024-04-17T19:49:07.988359+0000","last_became_active":"2024-04-17T19:46:55.715197+0000","last_became_peered":"2024-04-17T19:46:55.715197+0000","last_unstale":"2024-04-17T19:49:07.988359+0000","last_undegraded":"2024-04-17T19:49:07.988359+0000","last_fullsized":"2024-04-17T19:49:07.988359+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:54.640133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:54.640133+0000","last_clean_scrub_stamp":"2024-04-17T19:46:54.640133+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:25:07.379181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:37.958909+0000","last_change":"2024-04-17T19:47:00.773528+0000","last_active":"2024-04-17T19:47:37.958909+0000","last_peered":"2024-04-17T19:47:37.958909+0000","last_clean":"2024-04-17T19:47:37.958909+0000","last_became_active":"2024-04-17T19:47:00.773077+0000","last_became_peered":"2024-04-17T19:47:00.773077+0000","last_unstale":"2024-04-17T19:47:37.958909+0000","last_undegraded":"2024-04-17T19:47:37.958909+0000","last_fullsized":"2024-04-17T19:47:37.958909+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_clean_scrub_stamp":"2024-04-17T19:46:59.695482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T02:53:18.654740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,6,1],"acting":[0,4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"27'9","reported_seq":34,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:50:15.411762+0000","last_change":"2024-04-17T19:46:56.695617+0000","last_active":"2024-04-17T19:50:15.411762+0000","last_peered":"2024-04-17T19:50:15.411762+0000","last_clean":"2024-04-17T19:50:15.411762+0000","last_became_active":"2024-04-17T19:46:56.695205+0000","last_became_peered":"2024-04-17T19:46:56.695205+0000","last_unstale":"2024-04-17T19:50:15.411762+0000","last_undegraded":"2024-04-17T19:50:15.411762+0000","last_fullsized":"2024-04-17T19:50:15.411762+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_clean_scrub_stamp":"2024-04-17T19:46:55.648649+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T05:05:36.718886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"27'7","reported_seq":34,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:39.942448+0000","last_change":"2024-04-17T19:46:55.686220+0000","last_active":"2024-04-17T19:47:39.942448+0000","last_peered":"2024-04-17T19:47:39.942448+0000","last_clean":"2024-04-17T19:47:39.942448+0000","last_became_active":"2024-04-17T19:46:55.684782+0000","last_became_peered":"2024-04-17T19:46:55.684782+0000","last_unstale":"2024-04-17T19:47:39.942448+0000","last_undegraded":"2024-04-17T19:47:39.942448+0000","last_fullsized":"2024-04-17T19:47:39.942448+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:54.640133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:54.640133+0000","last_clean_scrub_stamp":"2024-04-17T19:46:54.640133+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:57:31.750325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:38.475895+0000","last_change":"2024-04-17T19:47:38.474847+0000","last_active":"2024-04-17T19:47:38.475895+0000","last_peered":"2024-04-17T19:47:38.475895+0000","last_clean":"2024-04-17T19:47:38.475895+0000","last_became_active":"2024-04-17T19:47:38.474208+0000","last_became_peered":"2024-04-17T19:47:38.474208+0000","last_unstale":"2024-04-17T19:47:38.475895+0000","last_undegraded":"2024-04-17T19:47:38.475895+0000","last_fullsized":"2024-04-17T19:47:38.475895+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_clean_scrub_stamp":"2024-04-17T19:46:59.695482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T05:15:30.939022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2,3],"acting":[0,4,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"27'2","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:50:15.353461+0000","last_change":"2024-04-17T19:46:56.700069+0000","last_active":"2024-04-17T19:50:15.353461+0000","last_peered":"2024-04-17T19:50:15.353461+0000","last_clean":"2024-04-17T19:50:15.353461+0000","last_became_active":"2024-04-17T19:46:56.699525+0000","last_became_peered":"2024-04-17T19:46:56.699525+0000","last_unstale":"2024-04-17T19:50:15.353461+0000","last_undegraded":"2024-04-17T19:50:15.353461+0000","last_fullsized":"2024-04-17T19:50:15.353461+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_clean_scrub_stamp":"2024-04-17T19:46:55.648649+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T00:28:36.944531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.8","version":"25'2","reported_seq":29,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:37.958712+0000","last_change":"2024-04-17T19:46:55.684594+0000","last_active":"2024-04-17T19:47:37.958712+0000","last_peered":"2024-04-17T19:47:37.958712+0000","last_clean":"2024-04-17T19:47:37.958712+0000","last_became_active":"2024-04-17T19:46:55.683145+0000","last_became_peered":"2024-04-17T19:46:55.683145+0000","last_unstale":"2024-04-17T19:47:37.958712+0000","last_undegraded":"2024-04-17T19:47:37.958712+0000","last_fullsized":"2024-04-17T19:47:37.958712+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:54.640133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:54.640133+0000","last_clean_scrub_stamp":"2024-04-17T19:46:54.640133+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T02:39:08.241534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:37.956151+0000","last_change":"2024-04-17T19:47:00.768781+0000","last_active":"2024-04-17T19:47:37.956151+0000","last_peered":"2024-04-17T19:47:37.956151+0000","last_clean":"2024-04-17T19:47:37.956151+0000","last_became_active":"2024-04-17T19:47:00.768277+0000","last_became_peered":"2024-04-17T19:47:00.768277+0000","last_unstale":"2024-04-17T19:47:37.956151+0000","last_undegraded":"2024-04-17T19:47:37.956151+0000","last_fullsized":"2024-04-17T19:47:37.956151+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_clean_scrub_stamp":"2024-04-17T19:46:59.695482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:07:00.936098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,7],"acting":[2,1,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"27'7","reported_seq":32,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:50:15.411553+0000","last_change":"2024-04-17T19:46:56.695528+0000","last_active":"2024-04-17T19:50:15.411553+0000","last_peered":"2024-04-17T19:50:15.411553+0000","last_clean":"2024-04-17T19:50:15.411553+0000","last_became_active":"2024-04-17T19:46:56.694993+0000","last_became_peered":"2024-04-17T19:46:56.694993+0000","last_unstale":"2024-04-17T19:50:15.411553+0000","last_undegraded":"2024-04-17T19:50:15.411553+0000","last_fullsized":"2024-04-17T19:50:15.411553+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_clean_scrub_stamp":"2024-04-17T19:46:55.648649+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:08:14.848448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"27'8","reported_seq":35,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:49:07.983053+0000","last_change":"2024-04-17T19:46:55.688859+0000","last_active":"2024-04-17T19:49:07.983053+0000","last_peered":"2024-04-17T19:49:07.983053+0000","last_clean":"2024-04-17T19:49:07.983053+0000","last_became_active":"2024-04-17T19:46:55.688507+0000","last_became_peered":"2024-04-17T19:46:55.688507+0000","last_unstale":"2024-04-17T19:49:07.983053+0000","last_undegraded":"2024-04-17T19:49:07.983053+0000","last_fullsized":"2024-04-17T19:49:07.983053+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:54.640133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:54.640133+0000","last_clean_scrub_stamp":"2024-04-17T19:46:54.640133+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T01:53:38.377482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:37.955200+0000","last_change":"2024-04-17T19:47:00.781482+0000","last_active":"2024-04-17T19:47:37.955200+0000","last_peered":"2024-04-17T19:47:37.955200+0000","last_clean":"2024-04-17T19:47:37.955200+0000","last_became_active":"2024-04-17T19:47:00.780994+0000","last_became_peered":"2024-04-17T19:47:00.780994+0000","last_unstale":"2024-04-17T19:47:37.955200+0000","last_undegraded":"2024-04-17T19:47:37.955200+0000","last_fullsized":"2024-04-17T19:47:37.955200+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_clean_scrub_stamp":"2024-04-17T19:46:59.695482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T01:46:40.550031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,3,1],"acting":[2,6,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"27'5","reported_seq":30,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:50:15.421562+0000","last_change":"2024-04-17T19:46:56.695874+0000","last_active":"2024-04-17T19:50:15.421562+0000","last_peered":"2024-04-17T19:50:15.421562+0000","last_clean":"2024-04-17T19:50:15.421562+0000","last_became_active":"2024-04-17T19:46:56.694650+0000","last_became_peered":"2024-04-17T19:46:56.694650+0000","last_unstale":"2024-04-17T19:50:15.421562+0000","last_undegraded":"2024-04-17T19:50:15.421562+0000","last_fullsized":"2024-04-17T19:50:15.421562+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_clean_scrub_stamp":"2024-04-17T19:46:55.648649+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:44:38.787541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"27'18","reported_seq":45,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:49:33.753683+0000","last_change":"2024-04-17T19:46:55.684490+0000","last_active":"2024-04-17T19:49:33.753683+0000","last_peered":"2024-04-17T19:49:33.753683+0000","last_clean":"2024-04-17T19:49:33.753683+0000","last_became_active":"2024-04-17T19:46:55.680100+0000","last_became_peered":"2024-04-17T19:46:55.680100+0000","last_unstale":"2024-04-17T19:49:33.753683+0000","last_undegraded":"2024-04-17T19:49:33.753683+0000","last_fullsized":"2024-04-17T19:49:33.753683+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:54.640133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:54.640133+0000","last_clean_scrub_stamp":"2024-04-17T19:46:54.640133+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:27:38.256174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":33,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:37.956231+0000","last_change":"2024-04-17T19:47:00.777588+0000","last_active":"2024-04-17T19:47:37.956231+0000","last_peered":"2024-04-17T19:47:37.956231+0000","last_clean":"2024-04-17T19:47:37.956231+0000","last_became_active":"2024-04-17T19:47:00.776873+0000","last_became_peered":"2024-04-17T19:47:00.776873+0000","last_unstale":"2024-04-17T19:47:37.956231+0000","last_undegraded":"2024-04-17T19:47:37.956231+0000","last_fullsized":"2024-04-17T19:47:37.956231+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_clean_scrub_stamp":"2024-04-17T19:46:59.695482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T02:52:42.471996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,6,3],"acting":[4,1,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.4","version":"27'9","reported_seq":34,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:50:15.438639+0000","last_change":"2024-04-17T19:46:56.681681+0000","last_active":"2024-04-17T19:50:15.438639+0000","last_peered":"2024-04-17T19:50:15.438639+0000","last_clean":"2024-04-17T19:50:15.438639+0000","last_became_active":"2024-04-17T19:46:56.681316+0000","last_became_peered":"2024-04-17T19:46:56.681316+0000","last_unstale":"2024-04-17T19:50:15.438639+0000","last_undegraded":"2024-04-17T19:50:15.438639+0000","last_fullsized":"2024-04-17T19:50:15.438639+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_clean_scrub_stamp":"2024-04-17T19:46:55.648649+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T07:28:30.187837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"27'4","reported_seq":31,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:39.945209+0000","last_change":"2024-04-17T19:46:55.692826+0000","last_active":"2024-04-17T19:47:39.945209+0000","last_peered":"2024-04-17T19:47:39.945209+0000","last_clean":"2024-04-17T19:47:39.945209+0000","last_became_active":"2024-04-17T19:46:55.691031+0000","last_became_peered":"2024-04-17T19:46:55.691031+0000","last_unstale":"2024-04-17T19:47:39.945209+0000","last_undegraded":"2024-04-17T19:47:39.945209+0000","last_fullsized":"2024-04-17T19:47:39.945209+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:54.640133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:54.640133+0000","last_clean_scrub_stamp":"2024-04-17T19:46:54.640133+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T05:52:32.550876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:37.959626+0000","last_change":"2024-04-17T19:47:00.777416+0000","last_active":"2024-04-17T19:47:37.959626+0000","last_peered":"2024-04-17T19:47:37.959626+0000","last_clean":"2024-04-17T19:47:37.959626+0000","last_became_active":"2024-04-17T19:47:00.771531+0000","last_became_peered":"2024-04-17T19:47:00.771531+0000","last_unstale":"2024-04-17T19:47:37.959626+0000","last_undegraded":"2024-04-17T19:47:37.959626+0000","last_fullsized":"2024-04-17T19:47:37.959626+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_clean_scrub_stamp":"2024-04-17T19:46:59.695482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:30:31.288100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,2,7],"acting":[6,0,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"27'5","reported_seq":30,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:50:15.416976+0000","last_change":"2024-04-17T19:46:56.692250+0000","last_active":"2024-04-17T19:50:15.416976+0000","last_peered":"2024-04-17T19:50:15.416976+0000","last_clean":"2024-04-17T19:50:15.416976+0000","last_became_active":"2024-04-17T19:46:56.691801+0000","last_became_peered":"2024-04-17T19:46:56.691801+0000","last_unstale":"2024-04-17T19:50:15.416976+0000","last_undegraded":"2024-04-17T19:50:15.416976+0000","last_fullsized":"2024-04-17T19:50:15.416976+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_clean_scrub_stamp":"2024-04-17T19:46:55.648649+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T01:53:39.385998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"25'1","reported_seq":28,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:38.681129+0000","last_change":"2024-04-17T19:46:55.713556+0000","last_active":"2024-04-17T19:47:38.681129+0000","last_peered":"2024-04-17T19:47:38.681129+0000","last_clean":"2024-04-17T19:47:38.681129+0000","last_became_active":"2024-04-17T19:46:55.712908+0000","last_became_peered":"2024-04-17T19:46:55.712908+0000","last_unstale":"2024-04-17T19:47:38.681129+0000","last_undegraded":"2024-04-17T19:47:38.681129+0000","last_fullsized":"2024-04-17T19:47:38.681129+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:54.640133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:54.640133+0000","last_clean_scrub_stamp":"2024-04-17T19:46:54.640133+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:57:31.750325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:37.959269+0000","last_change":"2024-04-17T19:47:00.776868+0000","last_active":"2024-04-17T19:47:37.959269+0000","last_peered":"2024-04-17T19:47:37.959269+0000","last_clean":"2024-04-17T19:47:37.959269+0000","last_became_active":"2024-04-17T19:47:00.771385+0000","last_became_peered":"2024-04-17T19:47:00.771385+0000","last_unstale":"2024-04-17T19:47:37.959269+0000","last_undegraded":"2024-04-17T19:47:37.959269+0000","last_fullsized":"2024-04-17T19:47:37.959269+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_clean_scrub_stamp":"2024-04-17T19:46:59.695482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T01:46:40.550031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5,7],"acting":[6,3,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3","version":"27'7","reported_seq":32,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:50:15.378550+0000","last_change":"2024-04-17T19:46:56.709288+0000","last_active":"2024-04-17T19:50:15.378550+0000","last_peered":"2024-04-17T19:50:15.378550+0000","last_clean":"2024-04-17T19:50:15.378550+0000","last_became_active":"2024-04-17T19:46:56.708572+0000","last_became_peered":"2024-04-17T19:46:56.708572+0000","last_unstale":"2024-04-17T19:50:15.378550+0000","last_undegraded":"2024-04-17T19:50:15.378550+0000","last_fullsized":"2024-04-17T19:50:15.378550+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_clean_scrub_stamp":"2024-04-17T19:46:55.648649+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:51:03.555339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"27'5","reported_seq":32,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:39.947236+0000","last_change":"2024-04-17T19:46:55.708506+0000","last_active":"2024-04-17T19:47:39.947236+0000","last_peered":"2024-04-17T19:47:39.947236+0000","last_clean":"2024-04-17T19:47:39.947236+0000","last_became_active":"2024-04-17T19:46:55.708175+0000","last_became_peered":"2024-04-17T19:46:55.708175+0000","last_unstale":"2024-04-17T19:47:39.947236+0000","last_undegraded":"2024-04-17T19:47:39.947236+0000","last_fullsized":"2024-04-17T19:47:39.947236+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:54.640133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:54.640133+0000","last_clean_scrub_stamp":"2024-04-17T19:46:54.640133+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T22:25:04.163982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:37.961174+0000","last_change":"2024-04-17T19:47:00.786657+0000","last_active":"2024-04-17T19:47:37.961174+0000","last_peered":"2024-04-17T19:47:37.961174+0000","last_clean":"2024-04-17T19:47:37.961174+0000","last_became_active":"2024-04-17T19:47:00.780743+0000","last_became_peered":"2024-04-17T19:47:00.780743+0000","last_unstale":"2024-04-17T19:47:37.961174+0000","last_undegraded":"2024-04-17T19:47:37.961174+0000","last_fullsized":"2024-04-17T19:47:37.961174+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_clean_scrub_stamp":"2024-04-17T19:46:59.695482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:07:00.936098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0,3],"acting":[6,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"27'8","reported_seq":33,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:50:15.431220+0000","last_change":"2024-04-17T19:46:56.679752+0000","last_active":"2024-04-17T19:50:15.431220+0000","last_peered":"2024-04-17T19:50:15.431220+0000","last_clean":"2024-04-17T19:50:15.431220+0000","last_became_active":"2024-04-17T19:46:56.679230+0000","last_became_peered":"2024-04-17T19:46:56.679230+0000","last_unstale":"2024-04-17T19:50:15.431220+0000","last_undegraded":"2024-04-17T19:50:15.431220+0000","last_fullsized":"2024-04-17T19:50:15.431220+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_clean_scrub_stamp":"2024-04-17T19:46:55.648649+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:08:14.848448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"27'8","reported_seq":37,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:49:33.857429+0000","last_change":"2024-04-17T19:46:55.715967+0000","last_active":"2024-04-17T19:49:33.857429+0000","last_peered":"2024-04-17T19:49:33.857429+0000","last_clean":"2024-04-17T19:49:33.857429+0000","last_became_active":"2024-04-17T19:46:55.715247+0000","last_became_peered":"2024-04-17T19:46:55.715247+0000","last_unstale":"2024-04-17T19:49:33.857429+0000","last_undegraded":"2024-04-17T19:49:33.857429+0000","last_fullsized":"2024-04-17T19:49:33.857429+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:54.640133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:54.640133+0000","last_clean_scrub_stamp":"2024-04-17T19:46:54.640133+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T00:40:58.757373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":524,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:37.963876+0000","last_change":"2024-04-17T19:47:00.769901+0000","last_active":"2024-04-17T19:47:37.963876+0000","last_peered":"2024-04-17T19:47:37.963876+0000","last_clean":"2024-04-17T19:47:37.963876+0000","last_became_active":"2024-04-17T19:47:00.768634+0000","last_became_peered":"2024-04-17T19:47:00.768634+0000","last_unstale":"2024-04-17T19:47:37.963876+0000","last_undegraded":"2024-04-17T19:47:37.963876+0000","last_fullsized":"2024-04-17T19:47:37.963876+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_clean_scrub_stamp":"2024-04-17T19:46:59.695482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T04:48:47.816818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,7],"acting":[6,0,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"27'5","reported_seq":30,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:50:15.419019+0000","last_change":"2024-04-17T19:46:56.703467+0000","last_active":"2024-04-17T19:50:15.419019+0000","last_peered":"2024-04-17T19:50:15.419019+0000","last_clean":"2024-04-17T19:50:15.419019+0000","last_became_active":"2024-04-17T19:46:56.703148+0000","last_became_peered":"2024-04-17T19:46:56.703148+0000","last_unstale":"2024-04-17T19:50:15.419019+0000","last_undegraded":"2024-04-17T19:50:15.419019+0000","last_fullsized":"2024-04-17T19:50:15.419019+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_clean_scrub_stamp":"2024-04-17T19:46:55.648649+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T22:01:49.863892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"27'4","reported_seq":31,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:39.945540+0000","last_change":"2024-04-17T19:46:55.715941+0000","last_active":"2024-04-17T19:47:39.945540+0000","last_peered":"2024-04-17T19:47:39.945540+0000","last_clean":"2024-04-17T19:47:39.945540+0000","last_became_active":"2024-04-17T19:46:55.715527+0000","last_became_peered":"2024-04-17T19:46:55.715527+0000","last_unstale":"2024-04-17T19:47:39.945540+0000","last_undegraded":"2024-04-17T19:47:39.945540+0000","last_fullsized":"2024-04-17T19:47:39.945540+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:54.640133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:54.640133+0000","last_clean_scrub_stamp":"2024-04-17T19:46:54.640133+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:11:00.737141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:38.681030+0000","last_change":"2024-04-17T19:47:00.784031+0000","last_active":"2024-04-17T19:47:38.681030+0000","last_peered":"2024-04-17T19:47:38.681030+0000","last_clean":"2024-04-17T19:47:38.681030+0000","last_became_active":"2024-04-17T19:47:00.783386+0000","last_became_peered":"2024-04-17T19:47:00.783386+0000","last_unstale":"2024-04-17T19:47:38.681030+0000","last_undegraded":"2024-04-17T19:47:38.681030+0000","last_fullsized":"2024-04-17T19:47:38.681030+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_clean_scrub_stamp":"2024-04-17T19:46:59.695482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:00:44.689926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6,1],"acting":[5,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"27'8","reported_seq":33,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:50:15.397426+0000","last_change":"2024-04-17T19:46:56.692287+0000","last_active":"2024-04-17T19:50:15.397426+0000","last_peered":"2024-04-17T19:50:15.397426+0000","last_clean":"2024-04-17T19:50:15.397426+0000","last_became_active":"2024-04-17T19:46:56.691917+0000","last_became_peered":"2024-04-17T19:46:56.691917+0000","last_unstale":"2024-04-17T19:50:15.397426+0000","last_undegraded":"2024-04-17T19:50:15.397426+0000","last_fullsized":"2024-04-17T19:50:15.397426+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_clean_scrub_stamp":"2024-04-17T19:46:55.648649+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T07:37:05.790432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.3","version":"27'6","reported_seq":33,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:39.945478+0000","last_change":"2024-04-17T19:46:55.686031+0000","last_active":"2024-04-17T19:47:39.945478+0000","last_peered":"2024-04-17T19:47:39.945478+0000","last_clean":"2024-04-17T19:47:39.945478+0000","last_became_active":"2024-04-17T19:46:55.685599+0000","last_became_peered":"2024-04-17T19:46:55.685599+0000","last_unstale":"2024-04-17T19:47:39.945478+0000","last_undegraded":"2024-04-17T19:47:39.945478+0000","last_fullsized":"2024-04-17T19:47:39.945478+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:54.640133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:54.640133+0000","last_clean_scrub_stamp":"2024-04-17T19:46:54.640133+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T01:39:32.586696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":183,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:38.680085+0000","last_change":"2024-04-17T19:46:43.000943+0000","last_active":"2024-04-17T19:47:38.680085+0000","last_peered":"2024-04-17T19:47:38.680085+0000","last_clean":"2024-04-17T19:47:38.680085+0000","last_became_active":"2024-04-17T19:46:43.000652+0000","last_became_peered":"2024-04-17T19:46:43.000652+0000","last_unstale":"2024-04-17T19:47:38.680085+0000","last_undegraded":"2024-04-17T19:47:38.680085+0000","last_fullsized":"2024-04-17T19:47:38.680085+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:41.988197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:41.988197+0000","last_clean_scrub_stamp":"2024-04-17T19:46:41.988197+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T19:53:52.845547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:38.473896+0000","last_change":"2024-04-17T19:47:00.731680+0000","last_active":"2024-04-17T19:47:38.473896+0000","last_peered":"2024-04-17T19:47:38.473896+0000","last_clean":"2024-04-17T19:47:38.473896+0000","last_became_active":"2024-04-17T19:47:00.731093+0000","last_became_peered":"2024-04-17T19:47:00.731093+0000","last_unstale":"2024-04-17T19:47:38.473896+0000","last_undegraded":"2024-04-17T19:47:38.473896+0000","last_fullsized":"2024-04-17T19:47:38.473896+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_clean_scrub_stamp":"2024-04-17T19:46:59.695482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T04:59:23.336626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.d","version":"27'7","reported_seq":32,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:50:15.414895+0000","last_change":"2024-04-17T19:46:56.692443+0000","last_active":"2024-04-17T19:50:15.414895+0000","last_peered":"2024-04-17T19:50:15.414895+0000","last_clean":"2024-04-17T19:50:15.414895+0000","last_became_active":"2024-04-17T19:46:56.692106+0000","last_became_peered":"2024-04-17T19:46:56.692106+0000","last_unstale":"2024-04-17T19:50:15.414895+0000","last_undegraded":"2024-04-17T19:50:15.414895+0000","last_fullsized":"2024-04-17T19:50:15.414895+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_clean_scrub_stamp":"2024-04-17T19:46:55.648649+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T04:07:54.102221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.c","version":"27'7","reported_seq":34,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:49:12.989378+0000","last_change":"2024-04-17T19:46:55.689884+0000","last_active":"2024-04-17T19:49:12.989378+0000","last_peered":"2024-04-17T19:49:12.989378+0000","last_clean":"2024-04-17T19:49:12.989378+0000","last_became_active":"2024-04-17T19:46:55.689059+0000","last_became_peered":"2024-04-17T19:46:55.689059+0000","last_unstale":"2024-04-17T19:49:12.989378+0000","last_undegraded":"2024-04-17T19:49:12.989378+0000","last_fullsized":"2024-04-17T19:49:12.989378+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:54.640133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:54.640133+0000","last_clean_scrub_stamp":"2024-04-17T19:46:54.640133+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T04:52:16.008572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1569,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:37.955343+0000","last_change":"2024-04-17T19:47:00.760432+0000","last_active":"2024-04-17T19:47:37.955343+0000","last_peered":"2024-04-17T19:47:37.955343+0000","last_clean":"2024-04-17T19:47:37.955343+0000","last_became_active":"2024-04-17T19:47:00.759946+0000","last_became_peered":"2024-04-17T19:47:00.759946+0000","last_unstale":"2024-04-17T19:47:37.955343+0000","last_undegraded":"2024-04-17T19:47:37.955343+0000","last_fullsized":"2024-04-17T19:47:37.955343+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_clean_scrub_stamp":"2024-04-17T19:46:59.695482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:30:31.288100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,7,4],"acting":[2,3,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"27'6","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:50:15.402771+0000","last_change":"2024-04-17T19:47:37.967945+0000","last_active":"2024-04-17T19:50:15.402771+0000","last_peered":"2024-04-17T19:50:15.402771+0000","last_clean":"2024-04-17T19:50:15.402771+0000","last_became_active":"2024-04-17T19:47:37.967613+0000","last_became_peered":"2024-04-17T19:47:37.967613+0000","last_unstale":"2024-04-17T19:50:15.402771+0000","last_undegraded":"2024-04-17T19:50:15.402771+0000","last_fullsized":"2024-04-17T19:50:15.402771+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_clean_scrub_stamp":"2024-04-17T19:46:55.648649+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:31:43.713056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.d","version":"27'3","reported_seq":30,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:39.940688+0000","last_change":"2024-04-17T19:46:55.704346+0000","last_active":"2024-04-17T19:47:39.940688+0000","last_peered":"2024-04-17T19:47:39.940688+0000","last_clean":"2024-04-17T19:47:39.940688+0000","last_became_active":"2024-04-17T19:46:55.703334+0000","last_became_peered":"2024-04-17T19:46:55.703334+0000","last_unstale":"2024-04-17T19:47:39.940688+0000","last_undegraded":"2024-04-17T19:47:39.940688+0000","last_fullsized":"2024-04-17T19:47:39.940688+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:54.640133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:54.640133+0000","last_clean_scrub_stamp":"2024-04-17T19:46:54.640133+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:01:11.327106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:38.680778+0000","last_change":"2024-04-17T19:47:00.745450+0000","last_active":"2024-04-17T19:47:38.680778+0000","last_peered":"2024-04-17T19:47:38.680778+0000","last_clean":"2024-04-17T19:47:38.680778+0000","last_became_active":"2024-04-17T19:47:00.744227+0000","last_became_peered":"2024-04-17T19:47:00.744227+0000","last_unstale":"2024-04-17T19:47:38.680778+0000","last_undegraded":"2024-04-17T19:47:38.680778+0000","last_fullsized":"2024-04-17T19:47:38.680778+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_clean_scrub_stamp":"2024-04-17T19:46:59.695482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:52:15.523817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1,3],"acting":[5,4,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"27'9","reported_seq":34,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:50:15.417099+0000","last_change":"2024-04-17T19:46:56.687926+0000","last_active":"2024-04-17T19:50:15.417099+0000","last_peered":"2024-04-17T19:50:15.417099+0000","last_clean":"2024-04-17T19:50:15.417099+0000","last_became_active":"2024-04-17T19:46:56.687352+0000","last_became_peered":"2024-04-17T19:46:56.687352+0000","last_unstale":"2024-04-17T19:50:15.417099+0000","last_undegraded":"2024-04-17T19:50:15.417099+0000","last_fullsized":"2024-04-17T19:50:15.417099+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_clean_scrub_stamp":"2024-04-17T19:46:55.648649+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T01:32:52.608291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.e","version":"27'5","reported_seq":32,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:39.943637+0000","last_change":"2024-04-17T19:46:55.716397+0000","last_active":"2024-04-17T19:47:39.943637+0000","last_peered":"2024-04-17T19:47:39.943637+0000","last_clean":"2024-04-17T19:47:39.943637+0000","last_became_active":"2024-04-17T19:46:55.715196+0000","last_became_peered":"2024-04-17T19:46:55.715196+0000","last_unstale":"2024-04-17T19:47:39.943637+0000","last_undegraded":"2024-04-17T19:47:39.943637+0000","last_fullsized":"2024-04-17T19:47:39.943637+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:54.640133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:54.640133+0000","last_clean_scrub_stamp":"2024-04-17T19:46:54.640133+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:24:42.573542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:38.472509+0000","last_change":"2024-04-17T19:47:00.735608+0000","last_active":"2024-04-17T19:47:38.472509+0000","last_peered":"2024-04-17T19:47:38.472509+0000","last_clean":"2024-04-17T19:47:38.472509+0000","last_became_active":"2024-04-17T19:47:00.735120+0000","last_became_peered":"2024-04-17T19:47:00.735120+0000","last_unstale":"2024-04-17T19:47:38.472509+0000","last_undegraded":"2024-04-17T19:47:38.472509+0000","last_fullsized":"2024-04-17T19:47:38.472509+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_clean_scrub_stamp":"2024-04-17T19:46:59.695482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T04:40:43.846198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"27'5","reported_seq":30,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:50:15.387875+0000","last_change":"2024-04-17T19:46:56.706026+0000","last_active":"2024-04-17T19:50:15.387875+0000","last_peered":"2024-04-17T19:50:15.387875+0000","last_clean":"2024-04-17T19:50:15.387875+0000","last_became_active":"2024-04-17T19:46:56.704786+0000","last_became_peered":"2024-04-17T19:46:56.704786+0000","last_unstale":"2024-04-17T19:50:15.387875+0000","last_undegraded":"2024-04-17T19:50:15.387875+0000","last_fullsized":"2024-04-17T19:50:15.387875+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_clean_scrub_stamp":"2024-04-17T19:46:55.648649+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:59:17.441539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.f","version":"25'2","reported_seq":29,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:37.960572+0000","last_change":"2024-04-17T19:46:55.707082+0000","last_active":"2024-04-17T19:47:37.960572+0000","last_peered":"2024-04-17T19:47:37.960572+0000","last_clean":"2024-04-17T19:47:37.960572+0000","last_became_active":"2024-04-17T19:46:55.706729+0000","last_became_peered":"2024-04-17T19:46:55.706729+0000","last_unstale":"2024-04-17T19:47:37.960572+0000","last_undegraded":"2024-04-17T19:47:37.960572+0000","last_fullsized":"2024-04-17T19:47:37.960572+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:54.640133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:54.640133+0000","last_clean_scrub_stamp":"2024-04-17T19:46:54.640133+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:11:00.737141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:38.680082+0000","last_change":"2024-04-17T19:47:00.744054+0000","last_active":"2024-04-17T19:47:38.680082+0000","last_peered":"2024-04-17T19:47:38.680082+0000","last_clean":"2024-04-17T19:47:38.680082+0000","last_became_active":"2024-04-17T19:47:00.743582+0000","last_became_peered":"2024-04-17T19:47:00.743582+0000","last_unstale":"2024-04-17T19:47:38.680082+0000","last_undegraded":"2024-04-17T19:47:38.680082+0000","last_fullsized":"2024-04-17T19:47:38.680082+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_clean_scrub_stamp":"2024-04-17T19:46:59.695482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T22:25:09.219331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,2],"acting":[1,5,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"27'6","reported_seq":31,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:50:15.385035+0000","last_change":"2024-04-17T19:46:56.692435+0000","last_active":"2024-04-17T19:50:15.385035+0000","last_peered":"2024-04-17T19:50:15.385035+0000","last_clean":"2024-04-17T19:50:15.385035+0000","last_became_active":"2024-04-17T19:46:56.692038+0000","last_became_peered":"2024-04-17T19:46:56.692038+0000","last_unstale":"2024-04-17T19:50:15.385035+0000","last_undegraded":"2024-04-17T19:50:15.385035+0000","last_fullsized":"2024-04-17T19:50:15.385035+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_clean_scrub_stamp":"2024-04-17T19:46:55.648649+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:06:56.889266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.10","version":"27'18","reported_seq":45,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:49:14.997636+0000","last_change":"2024-04-17T19:46:55.692188+0000","last_active":"2024-04-17T19:49:14.997636+0000","last_peered":"2024-04-17T19:49:14.997636+0000","last_clean":"2024-04-17T19:49:14.997636+0000","last_became_active":"2024-04-17T19:46:55.691286+0000","last_became_peered":"2024-04-17T19:46:55.691286+0000","last_unstale":"2024-04-17T19:49:14.997636+0000","last_undegraded":"2024-04-17T19:49:14.997636+0000","last_fullsized":"2024-04-17T19:49:14.997636+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:54.640133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:54.640133+0000","last_clean_scrub_stamp":"2024-04-17T19:46:54.640133+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:01:11.327106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:38.681258+0000","last_change":"2024-04-17T19:47:00.781167+0000","last_active":"2024-04-17T19:47:38.681258+0000","last_peered":"2024-04-17T19:47:38.681258+0000","last_clean":"2024-04-17T19:47:38.681258+0000","last_became_active":"2024-04-17T19:47:00.780167+0000","last_became_peered":"2024-04-17T19:47:00.780167+0000","last_unstale":"2024-04-17T19:47:38.681258+0000","last_undegraded":"2024-04-17T19:47:38.681258+0000","last_fullsized":"2024-04-17T19:47:38.681258+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_clean_scrub_stamp":"2024-04-17T19:46:59.695482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T00:07:51.831352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1,6],"acting":[5,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"27'6","reported_seq":31,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:50:15.438760+0000","last_change":"2024-04-17T19:46:56.676150+0000","last_active":"2024-04-17T19:50:15.438760+0000","last_peered":"2024-04-17T19:50:15.438760+0000","last_clean":"2024-04-17T19:50:15.438760+0000","last_became_active":"2024-04-17T19:46:56.675826+0000","last_became_peered":"2024-04-17T19:46:56.675826+0000","last_unstale":"2024-04-17T19:50:15.438760+0000","last_undegraded":"2024-04-17T19:50:15.438760+0000","last_fullsized":"2024-04-17T19:50:15.438760+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_clean_scrub_stamp":"2024-04-17T19:46:55.648649+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T04:52:17.017088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.11","version":"25'5","reported_seq":32,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:37.958901+0000","last_change":"2024-04-17T19:46:55.682001+0000","last_active":"2024-04-17T19:47:37.958901+0000","last_peered":"2024-04-17T19:47:37.958901+0000","last_clean":"2024-04-17T19:47:37.958901+0000","last_became_active":"2024-04-17T19:46:55.681607+0000","last_became_peered":"2024-04-17T19:46:55.681607+0000","last_unstale":"2024-04-17T19:47:37.958901+0000","last_undegraded":"2024-04-17T19:47:37.958901+0000","last_fullsized":"2024-04-17T19:47:37.958901+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:54.640133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:54.640133+0000","last_clean_scrub_stamp":"2024-04-17T19:46:54.640133+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T04:43:37.994081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:38.681616+0000","last_change":"2024-04-17T19:47:00.756396+0000","last_active":"2024-04-17T19:47:38.681616+0000","last_peered":"2024-04-17T19:47:38.681616+0000","last_clean":"2024-04-17T19:47:38.681616+0000","last_became_active":"2024-04-17T19:47:00.755282+0000","last_became_peered":"2024-04-17T19:47:00.755282+0000","last_unstale":"2024-04-17T19:47:38.681616+0000","last_undegraded":"2024-04-17T19:47:38.681616+0000","last_fullsized":"2024-04-17T19:47:38.681616+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_clean_scrub_stamp":"2024-04-17T19:46:59.695482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:08:25.082826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6,4],"acting":[5,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"27'15","reported_seq":40,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:50:15.420723+0000","last_change":"2024-04-17T19:46:56.694764+0000","last_active":"2024-04-17T19:50:15.420723+0000","last_peered":"2024-04-17T19:50:15.420723+0000","last_clean":"2024-04-17T19:50:15.420723+0000","last_became_active":"2024-04-17T19:46:56.694449+0000","last_became_peered":"2024-04-17T19:46:56.694449+0000","last_unstale":"2024-04-17T19:50:15.420723+0000","last_undegraded":"2024-04-17T19:50:15.420723+0000","last_fullsized":"2024-04-17T19:50:15.420723+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_clean_scrub_stamp":"2024-04-17T19:46:55.648649+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T02:53:14.607908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.12","version":"27'6","reported_seq":33,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:49:17.984148+0000","last_change":"2024-04-17T19:46:55.689900+0000","last_active":"2024-04-17T19:49:17.984148+0000","last_peered":"2024-04-17T19:49:17.984148+0000","last_clean":"2024-04-17T19:49:17.984148+0000","last_became_active":"2024-04-17T19:46:55.689607+0000","last_became_peered":"2024-04-17T19:46:55.689607+0000","last_unstale":"2024-04-17T19:49:17.984148+0000","last_undegraded":"2024-04-17T19:49:17.984148+0000","last_fullsized":"2024-04-17T19:49:17.984148+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:54.640133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:54.640133+0000","last_clean_scrub_stamp":"2024-04-17T19:46:54.640133+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:59:16.433023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:37.960971+0000","last_change":"2024-04-17T19:47:00.786434+0000","last_active":"2024-04-17T19:47:37.960971+0000","last_peered":"2024-04-17T19:47:37.960971+0000","last_clean":"2024-04-17T19:47:37.960971+0000","last_became_active":"2024-04-17T19:47:00.781025+0000","last_became_peered":"2024-04-17T19:47:00.781025+0000","last_unstale":"2024-04-17T19:47:37.960971+0000","last_undegraded":"2024-04-17T19:47:37.960971+0000","last_fullsized":"2024-04-17T19:47:37.960971+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_clean_scrub_stamp":"2024-04-17T19:46:59.695482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:51:07.602172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0,7],"acting":[6,4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.12","version":"27'9","reported_seq":34,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:50:15.418651+0000","last_change":"2024-04-17T19:46:56.693555+0000","last_active":"2024-04-17T19:50:15.418651+0000","last_peered":"2024-04-17T19:50:15.418651+0000","last_clean":"2024-04-17T19:50:15.418651+0000","last_became_active":"2024-04-17T19:46:56.687385+0000","last_became_peered":"2024-04-17T19:46:56.687385+0000","last_unstale":"2024-04-17T19:50:15.418651+0000","last_undegraded":"2024-04-17T19:50:15.418651+0000","last_fullsized":"2024-04-17T19:50:15.418651+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_clean_scrub_stamp":"2024-04-17T19:46:55.648649+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T05:52:33.559392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"27'9","reported_seq":36,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:39.942294+0000","last_change":"2024-04-17T19:46:55.700010+0000","last_active":"2024-04-17T19:47:39.942294+0000","last_peered":"2024-04-17T19:47:39.942294+0000","last_clean":"2024-04-17T19:47:39.942294+0000","last_became_active":"2024-04-17T19:46:55.698962+0000","last_became_peered":"2024-04-17T19:46:55.698962+0000","last_unstale":"2024-04-17T19:47:39.942294+0000","last_undegraded":"2024-04-17T19:47:39.942294+0000","last_fullsized":"2024-04-17T19:47:39.942294+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:54.640133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:54.640133+0000","last_clean_scrub_stamp":"2024-04-17T19:46:54.640133+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T01:25:12.780134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:38.473724+0000","last_change":"2024-04-17T19:47:00.760341+0000","last_active":"2024-04-17T19:47:38.473724+0000","last_peered":"2024-04-17T19:47:38.473724+0000","last_clean":"2024-04-17T19:47:38.473724+0000","last_became_active":"2024-04-17T19:47:00.759892+0000","last_became_peered":"2024-04-17T19:47:00.759892+0000","last_unstale":"2024-04-17T19:47:38.473724+0000","last_undegraded":"2024-04-17T19:47:38.473724+0000","last_fullsized":"2024-04-17T19:47:38.473724+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_clean_scrub_stamp":"2024-04-17T19:46:59.695482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T05:15:30.939022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5,6],"acting":[3,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"27'6","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:50:15.396242+0000","last_change":"2024-04-17T19:47:37.969333+0000","last_active":"2024-04-17T19:50:15.396242+0000","last_peered":"2024-04-17T19:50:15.396242+0000","last_clean":"2024-04-17T19:50:15.396242+0000","last_became_active":"2024-04-17T19:47:37.968623+0000","last_became_peered":"2024-04-17T19:47:37.968623+0000","last_unstale":"2024-04-17T19:50:15.396242+0000","last_undegraded":"2024-04-17T19:50:15.396242+0000","last_fullsized":"2024-04-17T19:50:15.396242+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_clean_scrub_stamp":"2024-04-17T19:46:55.648649+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T04:48:43.769985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"27'32","reported_seq":59,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:50:15.336039+0000","last_change":"2024-04-17T19:46:55.697242+0000","last_active":"2024-04-17T19:50:15.336039+0000","last_peered":"2024-04-17T19:50:15.336039+0000","last_clean":"2024-04-17T19:50:15.336039+0000","last_became_active":"2024-04-17T19:46:55.696876+0000","last_became_peered":"2024-04-17T19:46:55.696876+0000","last_unstale":"2024-04-17T19:50:15.336039+0000","last_undegraded":"2024-04-17T19:50:15.336039+0000","last_fullsized":"2024-04-17T19:50:15.336039+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:54.640133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:54.640133+0000","last_clean_scrub_stamp":"2024-04-17T19:46:54.640133+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:24:28.029324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":37585,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":33,"num_write_kb":52,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"27'3","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:49:20.435531+0000","last_change":"2024-04-17T19:47:00.743810+0000","last_active":"2024-04-17T19:49:20.435531+0000","last_peered":"2024-04-17T19:49:20.435531+0000","last_clean":"2024-04-17T19:49:20.435531+0000","last_became_active":"2024-04-17T19:47:00.742290+0000","last_became_peered":"2024-04-17T19:47:00.742290+0000","last_unstale":"2024-04-17T19:49:20.435531+0000","last_undegraded":"2024-04-17T19:49:20.435531+0000","last_fullsized":"2024-04-17T19:49:20.435531+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_clean_scrub_stamp":"2024-04-17T19:46:59.695482+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T04:20:00.039224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,5,0],"acting":[4,3,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"27'11","reported_seq":36,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:50:15.422187+0000","last_change":"2024-04-17T19:46:56.680527+0000","last_active":"2024-04-17T19:50:15.422187+0000","last_peered":"2024-04-17T19:50:15.422187+0000","last_clean":"2024-04-17T19:50:15.422187+0000","last_became_active":"2024-04-17T19:46:56.680171+0000","last_became_peered":"2024-04-17T19:46:56.680171+0000","last_unstale":"2024-04-17T19:50:15.422187+0000","last_undegraded":"2024-04-17T19:50:15.422187+0000","last_fullsized":"2024-04-17T19:50:15.422187+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_clean_scrub_stamp":"2024-04-17T19:46:55.648649+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T07:11:10.748292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.15","version":"27'8","reported_seq":35,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:49:28.868607+0000","last_change":"2024-04-17T19:46:55.707717+0000","last_active":"2024-04-17T19:49:28.868607+0000","last_peered":"2024-04-17T19:49:28.868607+0000","last_clean":"2024-04-17T19:49:28.868607+0000","last_became_active":"2024-04-17T19:46:55.706967+0000","last_became_peered":"2024-04-17T19:46:55.706967+0000","last_unstale":"2024-04-17T19:49:28.868607+0000","last_undegraded":"2024-04-17T19:49:28.868607+0000","last_fullsized":"2024-04-17T19:49:28.868607+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:54.640133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:54.640133+0000","last_clean_scrub_stamp":"2024-04-17T19:46:54.640133+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T05:10:04.380307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:37.955851+0000","last_change":"2024-04-17T19:47:00.758723+0000","last_active":"2024-04-17T19:47:37.955851+0000","last_peered":"2024-04-17T19:47:37.955851+0000","last_clean":"2024-04-17T19:47:37.955851+0000","last_became_active":"2024-04-17T19:47:00.758209+0000","last_became_peered":"2024-04-17T19:47:00.758209+0000","last_unstale":"2024-04-17T19:47:37.955851+0000","last_undegraded":"2024-04-17T19:47:37.955851+0000","last_fullsized":"2024-04-17T19:47:37.955851+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_clean_scrub_stamp":"2024-04-17T19:46:59.695482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T04:48:47.816818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1,7],"acting":[2,3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"27'9","reported_seq":34,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:50:15.434602+0000","last_change":"2024-04-17T19:46:56.684067+0000","last_active":"2024-04-17T19:50:15.434602+0000","last_peered":"2024-04-17T19:50:15.434602+0000","last_clean":"2024-04-17T19:50:15.434602+0000","last_became_active":"2024-04-17T19:46:56.683685+0000","last_became_peered":"2024-04-17T19:46:56.683685+0000","last_unstale":"2024-04-17T19:50:15.434602+0000","last_undegraded":"2024-04-17T19:50:15.434602+0000","last_fullsized":"2024-04-17T19:50:15.434602+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_clean_scrub_stamp":"2024-04-17T19:46:55.648649+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T02:52:38.425163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"27'4","reported_seq":31,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:39.942230+0000","last_change":"2024-04-17T19:46:55.687311+0000","last_active":"2024-04-17T19:47:39.942230+0000","last_peered":"2024-04-17T19:47:39.942230+0000","last_clean":"2024-04-17T19:47:39.942230+0000","last_became_active":"2024-04-17T19:46:55.687019+0000","last_became_peered":"2024-04-17T19:46:55.687019+0000","last_unstale":"2024-04-17T19:47:39.942230+0000","last_undegraded":"2024-04-17T19:47:39.942230+0000","last_fullsized":"2024-04-17T19:47:39.942230+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:54.640133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:54.640133+0000","last_clean_scrub_stamp":"2024-04-17T19:46:54.640133+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T01:53:38.377482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:37.965677+0000","last_change":"2024-04-17T19:47:00.780072+0000","last_active":"2024-04-17T19:47:37.965677+0000","last_peered":"2024-04-17T19:47:37.965677+0000","last_clean":"2024-04-17T19:47:37.965677+0000","last_became_active":"2024-04-17T19:47:00.777053+0000","last_became_peered":"2024-04-17T19:47:00.777053+0000","last_unstale":"2024-04-17T19:47:37.965677+0000","last_undegraded":"2024-04-17T19:47:37.965677+0000","last_fullsized":"2024-04-17T19:47:37.965677+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_clean_scrub_stamp":"2024-04-17T19:46:59.695482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T22:01:53.910725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,3,2],"acting":[7,1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"27'10","reported_seq":35,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:50:15.423004+0000","last_change":"2024-04-17T19:46:56.692985+0000","last_active":"2024-04-17T19:50:15.423004+0000","last_peered":"2024-04-17T19:50:15.423004+0000","last_clean":"2024-04-17T19:50:15.423004+0000","last_became_active":"2024-04-17T19:46:56.692287+0000","last_became_peered":"2024-04-17T19:46:56.692287+0000","last_unstale":"2024-04-17T19:50:15.423004+0000","last_undegraded":"2024-04-17T19:50:15.423004+0000","last_fullsized":"2024-04-17T19:50:15.423004+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_clean_scrub_stamp":"2024-04-17T19:46:55.648649+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:20:50.341776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.17","version":"27'6","reported_seq":33,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:49:28.854216+0000","last_change":"2024-04-17T19:46:55.691681+0000","last_active":"2024-04-17T19:49:28.854216+0000","last_peered":"2024-04-17T19:49:28.854216+0000","last_clean":"2024-04-17T19:49:28.854216+0000","last_became_active":"2024-04-17T19:46:55.691354+0000","last_became_peered":"2024-04-17T19:46:55.691354+0000","last_unstale":"2024-04-17T19:49:28.854216+0000","last_undegraded":"2024-04-17T19:49:28.854216+0000","last_fullsized":"2024-04-17T19:49:28.854216+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:54.640133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:54.640133+0000","last_clean_scrub_stamp":"2024-04-17T19:46:54.640133+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T00:40:58.757373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:37.957709+0000","last_change":"2024-04-17T19:47:00.764854+0000","last_active":"2024-04-17T19:47:37.957709+0000","last_peered":"2024-04-17T19:47:37.957709+0000","last_clean":"2024-04-17T19:47:37.957709+0000","last_became_active":"2024-04-17T19:47:00.763550+0000","last_became_peered":"2024-04-17T19:47:00.763550+0000","last_unstale":"2024-04-17T19:47:37.957709+0000","last_undegraded":"2024-04-17T19:47:37.957709+0000","last_fullsized":"2024-04-17T19:47:37.957709+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_clean_scrub_stamp":"2024-04-17T19:46:59.695482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T04:26:38.527427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,3,7],"acting":[4,0,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:37.959252+0000","last_change":"2024-04-17T19:47:00.746028+0000","last_active":"2024-04-17T19:47:37.959252+0000","last_peered":"2024-04-17T19:47:37.959252+0000","last_clean":"2024-04-17T19:47:37.959252+0000","last_became_active":"2024-04-17T19:47:00.744828+0000","last_became_peered":"2024-04-17T19:47:00.744828+0000","last_unstale":"2024-04-17T19:47:37.959252+0000","last_undegraded":"2024-04-17T19:47:37.959252+0000","last_fullsized":"2024-04-17T19:47:37.959252+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_clean_scrub_stamp":"2024-04-17T19:46:59.695482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T22:37:58.836823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,5,3],"acting":[4,1,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"27'10","reported_seq":35,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:50:15.424768+0000","last_change":"2024-04-17T19:46:56.691650+0000","last_active":"2024-04-17T19:50:15.424768+0000","last_peered":"2024-04-17T19:50:15.424768+0000","last_clean":"2024-04-17T19:50:15.424768+0000","last_became_active":"2024-04-17T19:46:56.690810+0000","last_became_peered":"2024-04-17T19:46:56.690810+0000","last_unstale":"2024-04-17T19:50:15.424768+0000","last_undegraded":"2024-04-17T19:50:15.424768+0000","last_fullsized":"2024-04-17T19:50:15.424768+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_clean_scrub_stamp":"2024-04-17T19:46:55.648649+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T04:25:07.123916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.18","version":"27'3","reported_seq":30,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:39.944726+0000","last_change":"2024-04-17T19:46:55.691871+0000","last_active":"2024-04-17T19:47:39.944726+0000","last_peered":"2024-04-17T19:47:39.944726+0000","last_clean":"2024-04-17T19:47:39.944726+0000","last_became_active":"2024-04-17T19:46:55.690539+0000","last_became_peered":"2024-04-17T19:46:55.690539+0000","last_unstale":"2024-04-17T19:47:39.944726+0000","last_undegraded":"2024-04-17T19:47:39.944726+0000","last_fullsized":"2024-04-17T19:47:39.944726+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:54.640133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:54.640133+0000","last_clean_scrub_stamp":"2024-04-17T19:46:54.640133+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T04:52:16.008572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:38.474111+0000","last_change":"2024-04-17T19:47:00.749616+0000","last_active":"2024-04-17T19:47:38.474111+0000","last_peered":"2024-04-17T19:47:38.474111+0000","last_clean":"2024-04-17T19:47:38.474111+0000","last_became_active":"2024-04-17T19:47:00.749061+0000","last_became_peered":"2024-04-17T19:47:00.749061+0000","last_unstale":"2024-04-17T19:47:38.474111+0000","last_undegraded":"2024-04-17T19:47:38.474111+0000","last_fullsized":"2024-04-17T19:47:38.474111+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_clean_scrub_stamp":"2024-04-17T19:46:59.695482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:33:36.676817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5,1],"acting":[3,2,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"27'8","reported_seq":33,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:50:15.437952+0000","last_change":"2024-04-17T19:46:56.692190+0000","last_active":"2024-04-17T19:50:15.437952+0000","last_peered":"2024-04-17T19:50:15.437952+0000","last_clean":"2024-04-17T19:50:15.437952+0000","last_became_active":"2024-04-17T19:46:56.691524+0000","last_became_peered":"2024-04-17T19:46:56.691524+0000","last_unstale":"2024-04-17T19:50:15.437952+0000","last_undegraded":"2024-04-17T19:50:15.437952+0000","last_fullsized":"2024-04-17T19:50:15.437952+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_clean_scrub_stamp":"2024-04-17T19:46:55.648649+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:44:38.787541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"27'3","reported_seq":30,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:39.942240+0000","last_change":"2024-04-17T19:46:55.700265+0000","last_active":"2024-04-17T19:47:39.942240+0000","last_peered":"2024-04-17T19:47:39.942240+0000","last_clean":"2024-04-17T19:47:39.942240+0000","last_became_active":"2024-04-17T19:46:55.699166+0000","last_became_peered":"2024-04-17T19:46:55.699166+0000","last_unstale":"2024-04-17T19:47:39.942240+0000","last_undegraded":"2024-04-17T19:47:39.942240+0000","last_fullsized":"2024-04-17T19:47:39.942240+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:54.640133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:54.640133+0000","last_clean_scrub_stamp":"2024-04-17T19:46:54.640133+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T02:39:08.241534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"25'7","reported_seq":34,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:38.473233+0000","last_change":"2024-04-17T19:46:55.687779+0000","last_active":"2024-04-17T19:47:38.473233+0000","last_peered":"2024-04-17T19:47:38.473233+0000","last_clean":"2024-04-17T19:47:38.473233+0000","last_became_active":"2024-04-17T19:46:55.687401+0000","last_became_peered":"2024-04-17T19:46:55.687401+0000","last_unstale":"2024-04-17T19:47:38.473233+0000","last_undegraded":"2024-04-17T19:47:38.473233+0000","last_fullsized":"2024-04-17T19:47:38.473233+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:54.640133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:54.640133+0000","last_clean_scrub_stamp":"2024-04-17T19:46:54.640133+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:20:49.333260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"27'8","reported_seq":33,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:50:15.420401+0000","last_change":"2024-04-17T19:46:56.691635+0000","last_active":"2024-04-17T19:50:15.420401+0000","last_peered":"2024-04-17T19:50:15.420401+0000","last_clean":"2024-04-17T19:50:15.420401+0000","last_became_active":"2024-04-17T19:46:56.691199+0000","last_became_peered":"2024-04-17T19:46:56.691199+0000","last_unstale":"2024-04-17T19:50:15.420401+0000","last_undegraded":"2024-04-17T19:50:15.420401+0000","last_fullsized":"2024-04-17T19:50:15.420401+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_clean_scrub_stamp":"2024-04-17T19:46:55.648649+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:00:10.859769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:37.960909+0000","last_change":"2024-04-17T19:47:00.776142+0000","last_active":"2024-04-17T19:47:37.960909+0000","last_peered":"2024-04-17T19:47:37.960909+0000","last_clean":"2024-04-17T19:47:37.960909+0000","last_became_active":"2024-04-17T19:47:00.774592+0000","last_became_peered":"2024-04-17T19:47:00.774592+0000","last_unstale":"2024-04-17T19:47:37.960909+0000","last_undegraded":"2024-04-17T19:47:37.960909+0000","last_fullsized":"2024-04-17T19:47:37.960909+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_clean_scrub_stamp":"2024-04-17T19:46:59.695482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:04:03.656402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,7],"acting":[4,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"25'5","reported_seq":32,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:38.680757+0000","last_change":"2024-04-17T19:46:55.713656+0000","last_active":"2024-04-17T19:47:38.680757+0000","last_peered":"2024-04-17T19:47:38.680757+0000","last_clean":"2024-04-17T19:47:38.680757+0000","last_became_active":"2024-04-17T19:46:55.712982+0000","last_became_peered":"2024-04-17T19:46:55.712982+0000","last_unstale":"2024-04-17T19:47:38.680757+0000","last_undegraded":"2024-04-17T19:47:38.680757+0000","last_fullsized":"2024-04-17T19:47:38.680757+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:54.640133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:54.640133+0000","last_clean_scrub_stamp":"2024-04-17T19:46:54.640133+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:02:52.057635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"27'7","reported_seq":32,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:50:15.437579+0000","last_change":"2024-04-17T19:46:56.681984+0000","last_active":"2024-04-17T19:50:15.437579+0000","last_peered":"2024-04-17T19:50:15.437579+0000","last_clean":"2024-04-17T19:50:15.437579+0000","last_became_active":"2024-04-17T19:46:56.679830+0000","last_became_peered":"2024-04-17T19:46:56.679830+0000","last_unstale":"2024-04-17T19:50:15.437579+0000","last_undegraded":"2024-04-17T19:50:15.437579+0000","last_fullsized":"2024-04-17T19:50:15.437579+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_clean_scrub_stamp":"2024-04-17T19:46:55.648649+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:11:01.745657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:47:37.967233+0000","last_change":"2024-04-17T19:47:00.777411+0000","last_active":"2024-04-17T19:47:37.967233+0000","last_peered":"2024-04-17T19:47:37.967233+0000","last_clean":"2024-04-17T19:47:37.967233+0000","last_became_active":"2024-04-17T19:47:00.776357+0000","last_became_peered":"2024-04-17T19:47:00.776357+0000","last_unstale":"2024-04-17T19:47:37.967233+0000","last_undegraded":"2024-04-17T19:47:37.967233+0000","last_fullsized":"2024-04-17T19:47:37.967233+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_clean_scrub_stamp":"2024-04-17T19:46:59.695482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:41:22.030097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,1,0],"acting":[7,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"27'9","reported_seq":34,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:50:15.419947+0000","last_change":"2024-04-17T19:46:56.706021+0000","last_active":"2024-04-17T19:50:15.419947+0000","last_peered":"2024-04-17T19:50:15.419947+0000","last_clean":"2024-04-17T19:50:15.419947+0000","last_became_active":"2024-04-17T19:46:56.702724+0000","last_became_peered":"2024-04-17T19:46:56.702724+0000","last_unstale":"2024-04-17T19:50:15.419947+0000","last_undegraded":"2024-04-17T19:50:15.419947+0000","last_fullsized":"2024-04-17T19:50:15.419947+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_clean_scrub_stamp":"2024-04-17T19:46:55.648649+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:11:01.745657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"27'12","reported_seq":37,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:50:15.408062+0000","last_change":"2024-04-17T19:46:56.685239+0000","last_active":"2024-04-17T19:50:15.408062+0000","last_peered":"2024-04-17T19:50:15.408062+0000","last_clean":"2024-04-17T19:50:15.408062+0000","last_became_active":"2024-04-17T19:46:56.684771+0000","last_became_peered":"2024-04-17T19:46:56.684771+0000","last_unstale":"2024-04-17T19:50:15.408062+0000","last_undegraded":"2024-04-17T19:50:15.408062+0000","last_fullsized":"2024-04-17T19:50:15.408062+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_clean_scrub_stamp":"2024-04-17T19:46:55.648649+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T04:52:17.017088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.22","version":"27'8","reported_seq":33,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:50:15.428490+0000","last_change":"2024-04-17T19:46:56.686238+0000","last_active":"2024-04-17T19:50:15.428490+0000","last_peered":"2024-04-17T19:50:15.428490+0000","last_clean":"2024-04-17T19:50:15.428490+0000","last_became_active":"2024-04-17T19:46:56.685745+0000","last_became_peered":"2024-04-17T19:46:56.685745+0000","last_unstale":"2024-04-17T19:50:15.428490+0000","last_undegraded":"2024-04-17T19:50:15.428490+0000","last_fullsized":"2024-04-17T19:50:15.428490+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_clean_scrub_stamp":"2024-04-17T19:46:55.648649+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:01:01.006486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"27'7","reported_seq":32,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:50:15.434360+0000","last_change":"2024-04-17T19:46:56.675844+0000","last_active":"2024-04-17T19:50:15.434360+0000","last_peered":"2024-04-17T19:50:15.434360+0000","last_clean":"2024-04-17T19:50:15.434360+0000","last_became_active":"2024-04-17T19:46:56.675519+0000","last_became_peered":"2024-04-17T19:46:56.675519+0000","last_unstale":"2024-04-17T19:50:15.434360+0000","last_undegraded":"2024-04-17T19:50:15.434360+0000","last_fullsized":"2024-04-17T19:50:15.434360+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_clean_scrub_stamp":"2024-04-17T19:46:55.648649+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T00:46:07.348168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.24","version":"27'4","reported_seq":29,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:50:15.420197+0000","last_change":"2024-04-17T19:46:56.699663+0000","last_active":"2024-04-17T19:50:15.420197+0000","last_peered":"2024-04-17T19:50:15.420197+0000","last_clean":"2024-04-17T19:50:15.420197+0000","last_became_active":"2024-04-17T19:46:56.699293+0000","last_became_peered":"2024-04-17T19:46:56.699293+0000","last_unstale":"2024-04-17T19:50:15.420197+0000","last_undegraded":"2024-04-17T19:50:15.420197+0000","last_fullsized":"2024-04-17T19:50:15.420197+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_clean_scrub_stamp":"2024-04-17T19:46:55.648649+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T22:25:05.172498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"27'6","reported_seq":31,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:50:15.403976+0000","last_change":"2024-04-17T19:46:56.684368+0000","last_active":"2024-04-17T19:50:15.403976+0000","last_peered":"2024-04-17T19:50:15.403976+0000","last_clean":"2024-04-17T19:50:15.403976+0000","last_became_active":"2024-04-17T19:46:56.683963+0000","last_became_peered":"2024-04-17T19:46:56.683963+0000","last_unstale":"2024-04-17T19:50:15.403976+0000","last_undegraded":"2024-04-17T19:50:15.403976+0000","last_fullsized":"2024-04-17T19:50:15.403976+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_clean_scrub_stamp":"2024-04-17T19:46:55.648649+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:41:17.983264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.26","version":"27'15","reported_seq":40,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:50:15.412161+0000","last_change":"2024-04-17T19:46:56.704924+0000","last_active":"2024-04-17T19:50:15.412161+0000","last_peered":"2024-04-17T19:50:15.412161+0000","last_clean":"2024-04-17T19:50:15.412161+0000","last_became_active":"2024-04-17T19:46:56.692688+0000","last_became_peered":"2024-04-17T19:46:56.692688+0000","last_unstale":"2024-04-17T19:50:15.412161+0000","last_undegraded":"2024-04-17T19:50:15.412161+0000","last_fullsized":"2024-04-17T19:50:15.412161+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_clean_scrub_stamp":"2024-04-17T19:46:55.648649+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T01:39:33.595213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"27'2","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:50:15.434704+0000","last_change":"2024-04-17T19:46:56.685081+0000","last_active":"2024-04-17T19:50:15.434704+0000","last_peered":"2024-04-17T19:50:15.434704+0000","last_clean":"2024-04-17T19:50:15.434704+0000","last_became_active":"2024-04-17T19:46:56.684714+0000","last_became_peered":"2024-04-17T19:46:56.684714+0000","last_unstale":"2024-04-17T19:50:15.434704+0000","last_undegraded":"2024-04-17T19:50:15.434704+0000","last_fullsized":"2024-04-17T19:50:15.434704+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_clean_scrub_stamp":"2024-04-17T19:46:55.648649+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T04:26:34.480594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"27'6","reported_seq":31,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:50:15.428933+0000","last_change":"2024-04-17T19:46:56.681089+0000","last_active":"2024-04-17T19:50:15.428933+0000","last_peered":"2024-04-17T19:50:15.428933+0000","last_clean":"2024-04-17T19:50:15.428933+0000","last_became_active":"2024-04-17T19:46:56.679818+0000","last_became_peered":"2024-04-17T19:46:56.679818+0000","last_unstale":"2024-04-17T19:50:15.428933+0000","last_undegraded":"2024-04-17T19:50:15.428933+0000","last_fullsized":"2024-04-17T19:50:15.428933+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_clean_scrub_stamp":"2024-04-17T19:46:55.648649+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T01:32:52.608291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"27'8","reported_seq":33,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:50:15.436026+0000","last_change":"2024-04-17T19:46:56.674556+0000","last_active":"2024-04-17T19:50:15.436026+0000","last_peered":"2024-04-17T19:50:15.436026+0000","last_clean":"2024-04-17T19:50:15.436026+0000","last_became_active":"2024-04-17T19:46:56.674164+0000","last_became_peered":"2024-04-17T19:46:56.674164+0000","last_unstale":"2024-04-17T19:50:15.436026+0000","last_undegraded":"2024-04-17T19:50:15.436026+0000","last_fullsized":"2024-04-17T19:50:15.436026+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_clean_scrub_stamp":"2024-04-17T19:46:55.648649+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T22:53:45.664676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2a","version":"27'10","reported_seq":35,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:50:15.420452+0000","last_change":"2024-04-17T19:46:56.697359+0000","last_active":"2024-04-17T19:50:15.420452+0000","last_peered":"2024-04-17T19:50:15.420452+0000","last_clean":"2024-04-17T19:50:15.420452+0000","last_became_active":"2024-04-17T19:46:56.695255+0000","last_became_peered":"2024-04-17T19:46:56.695255+0000","last_unstale":"2024-04-17T19:50:15.420452+0000","last_undegraded":"2024-04-17T19:50:15.420452+0000","last_fullsized":"2024-04-17T19:50:15.420452+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_clean_scrub_stamp":"2024-04-17T19:46:55.648649+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T01:53:39.385998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"27'11","reported_seq":36,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:50:15.414592+0000","last_change":"2024-04-17T19:46:56.692366+0000","last_active":"2024-04-17T19:50:15.414592+0000","last_peered":"2024-04-17T19:50:15.414592+0000","last_clean":"2024-04-17T19:50:15.414592+0000","last_became_active":"2024-04-17T19:46:56.691942+0000","last_became_peered":"2024-04-17T19:46:56.691942+0000","last_unstale":"2024-04-17T19:50:15.414592+0000","last_undegraded":"2024-04-17T19:50:15.414592+0000","last_fullsized":"2024-04-17T19:50:15.414592+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_clean_scrub_stamp":"2024-04-17T19:46:55.648649+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T02:34:05.358659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2c","version":"27'8","reported_seq":33,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:50:15.415291+0000","last_change":"2024-04-17T19:46:56.693507+0000","last_active":"2024-04-17T19:50:15.415291+0000","last_peered":"2024-04-17T19:50:15.415291+0000","last_clean":"2024-04-17T19:50:15.415291+0000","last_became_active":"2024-04-17T19:46:56.691938+0000","last_became_peered":"2024-04-17T19:46:56.691938+0000","last_unstale":"2024-04-17T19:50:15.415291+0000","last_undegraded":"2024-04-17T19:50:15.415291+0000","last_fullsized":"2024-04-17T19:50:15.415291+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_clean_scrub_stamp":"2024-04-17T19:46:55.648649+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T04:48:43.769985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"27'7","reported_seq":32,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:50:15.409193+0000","last_change":"2024-04-17T19:46:56.700707+0000","last_active":"2024-04-17T19:50:15.409193+0000","last_peered":"2024-04-17T19:50:15.409193+0000","last_clean":"2024-04-17T19:50:15.409193+0000","last_became_active":"2024-04-17T19:46:56.700346+0000","last_became_peered":"2024-04-17T19:46:56.700346+0000","last_unstale":"2024-04-17T19:50:15.409193+0000","last_undegraded":"2024-04-17T19:50:15.409193+0000","last_fullsized":"2024-04-17T19:50:15.409193+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_clean_scrub_stamp":"2024-04-17T19:46:55.648649+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:58:35.976326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"27'10","reported_seq":35,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:50:15.418764+0000","last_change":"2024-04-17T19:46:56.705410+0000","last_active":"2024-04-17T19:50:15.418764+0000","last_peered":"2024-04-17T19:50:15.418764+0000","last_clean":"2024-04-17T19:50:15.418764+0000","last_became_active":"2024-04-17T19:46:56.705076+0000","last_became_peered":"2024-04-17T19:46:56.705076+0000","last_unstale":"2024-04-17T19:50:15.418764+0000","last_undegraded":"2024-04-17T19:50:15.418764+0000","last_fullsized":"2024-04-17T19:50:15.418764+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_clean_scrub_stamp":"2024-04-17T19:46:55.648649+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T01:53:39.385998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"27'8","reported_seq":33,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:50:15.385984+0000","last_change":"2024-04-17T19:46:56.697436+0000","last_active":"2024-04-17T19:50:15.385984+0000","last_peered":"2024-04-17T19:50:15.385984+0000","last_clean":"2024-04-17T19:50:15.385984+0000","last_became_active":"2024-04-17T19:46:56.696667+0000","last_became_peered":"2024-04-17T19:46:56.696667+0000","last_unstale":"2024-04-17T19:50:15.385984+0000","last_undegraded":"2024-04-17T19:50:15.385984+0000","last_fullsized":"2024-04-17T19:50:15.385984+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_clean_scrub_stamp":"2024-04-17T19:46:55.648649+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:54:05.520742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"27'9","reported_seq":34,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:50:15.415422+0000","last_change":"2024-04-17T19:46:56.680847+0000","last_active":"2024-04-17T19:50:15.415422+0000","last_peered":"2024-04-17T19:50:15.415422+0000","last_clean":"2024-04-17T19:50:15.415422+0000","last_became_active":"2024-04-17T19:46:56.680224+0000","last_became_peered":"2024-04-17T19:46:56.680224+0000","last_unstale":"2024-04-17T19:50:15.415422+0000","last_undegraded":"2024-04-17T19:50:15.415422+0000","last_fullsized":"2024-04-17T19:50:15.415422+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_clean_scrub_stamp":"2024-04-17T19:46:55.648649+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T04:48:43.769985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.31","version":"27'7","reported_seq":32,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:50:15.434611+0000","last_change":"2024-04-17T19:46:56.688647+0000","last_active":"2024-04-17T19:50:15.434611+0000","last_peered":"2024-04-17T19:50:15.434611+0000","last_clean":"2024-04-17T19:50:15.434611+0000","last_became_active":"2024-04-17T19:46:56.688294+0000","last_became_peered":"2024-04-17T19:46:56.688294+0000","last_unstale":"2024-04-17T19:50:15.434611+0000","last_undegraded":"2024-04-17T19:50:15.434611+0000","last_fullsized":"2024-04-17T19:50:15.434611+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_clean_scrub_stamp":"2024-04-17T19:46:55.648649+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T02:34:05.358659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.32","version":"27'8","reported_seq":33,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:50:15.418778+0000","last_change":"2024-04-17T19:46:56.686415+0000","last_active":"2024-04-17T19:50:15.418778+0000","last_peered":"2024-04-17T19:50:15.418778+0000","last_clean":"2024-04-17T19:50:15.418778+0000","last_became_active":"2024-04-17T19:46:56.684639+0000","last_became_peered":"2024-04-17T19:46:56.684639+0000","last_unstale":"2024-04-17T19:50:15.418778+0000","last_undegraded":"2024-04-17T19:50:15.418778+0000","last_fullsized":"2024-04-17T19:50:15.418778+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_clean_scrub_stamp":"2024-04-17T19:46:55.648649+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:20:50.341776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.33","version":"27'10","reported_seq":35,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:50:15.420452+0000","last_change":"2024-04-17T19:46:56.694678+0000","last_active":"2024-04-17T19:50:15.420452+0000","last_peered":"2024-04-17T19:50:15.420452+0000","last_clean":"2024-04-17T19:50:15.420452+0000","last_became_active":"2024-04-17T19:46:56.694213+0000","last_became_peered":"2024-04-17T19:46:56.694213+0000","last_unstale":"2024-04-17T19:50:15.420452+0000","last_undegraded":"2024-04-17T19:50:15.420452+0000","last_fullsized":"2024-04-17T19:50:15.420452+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_clean_scrub_stamp":"2024-04-17T19:46:55.648649+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:59:17.441539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"27'7","reported_seq":32,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:50:15.418934+0000","last_change":"2024-04-17T19:46:56.693810+0000","last_active":"2024-04-17T19:50:15.418934+0000","last_peered":"2024-04-17T19:50:15.418934+0000","last_clean":"2024-04-17T19:50:15.418934+0000","last_became_active":"2024-04-17T19:46:56.692874+0000","last_became_peered":"2024-04-17T19:46:56.692874+0000","last_unstale":"2024-04-17T19:50:15.418934+0000","last_undegraded":"2024-04-17T19:50:15.418934+0000","last_fullsized":"2024-04-17T19:50:15.418934+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_clean_scrub_stamp":"2024-04-17T19:46:55.648649+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:30:27.241267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"27'6","reported_seq":31,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:50:15.395815+0000","last_change":"2024-04-17T19:46:56.700330+0000","last_active":"2024-04-17T19:50:15.395815+0000","last_peered":"2024-04-17T19:50:15.395815+0000","last_clean":"2024-04-17T19:50:15.395815+0000","last_became_active":"2024-04-17T19:46:56.700013+0000","last_became_peered":"2024-04-17T19:46:56.700013+0000","last_unstale":"2024-04-17T19:50:15.395815+0000","last_undegraded":"2024-04-17T19:50:15.395815+0000","last_fullsized":"2024-04-17T19:50:15.395815+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_clean_scrub_stamp":"2024-04-17T19:46:55.648649+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:23:16.383918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.36","version":"27'16","reported_seq":41,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:50:15.414366+0000","last_change":"2024-04-17T19:46:56.709400+0000","last_active":"2024-04-17T19:50:15.414366+0000","last_peered":"2024-04-17T19:50:15.414366+0000","last_clean":"2024-04-17T19:50:15.414366+0000","last_became_active":"2024-04-17T19:46:56.708606+0000","last_became_peered":"2024-04-17T19:46:56.708606+0000","last_unstale":"2024-04-17T19:50:15.414366+0000","last_undegraded":"2024-04-17T19:50:15.414366+0000","last_fullsized":"2024-04-17T19:50:15.414366+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_clean_scrub_stamp":"2024-04-17T19:46:55.648649+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T01:46:36.503198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.37","version":"27'11","reported_seq":36,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:50:15.422337+0000","last_change":"2024-04-17T19:46:56.681267+0000","last_active":"2024-04-17T19:50:15.422337+0000","last_peered":"2024-04-17T19:50:15.422337+0000","last_clean":"2024-04-17T19:50:15.422337+0000","last_became_active":"2024-04-17T19:46:56.680919+0000","last_became_peered":"2024-04-17T19:46:56.680919+0000","last_unstale":"2024-04-17T19:50:15.422337+0000","last_undegraded":"2024-04-17T19:50:15.422337+0000","last_fullsized":"2024-04-17T19:50:15.422337+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_clean_scrub_stamp":"2024-04-17T19:46:55.648649+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T01:39:33.595213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"27'9","reported_seq":34,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:50:15.436263+0000","last_change":"2024-04-17T19:46:56.688682+0000","last_active":"2024-04-17T19:50:15.436263+0000","last_peered":"2024-04-17T19:50:15.436263+0000","last_clean":"2024-04-17T19:50:15.436263+0000","last_became_active":"2024-04-17T19:46:56.688320+0000","last_became_peered":"2024-04-17T19:46:56.688320+0000","last_unstale":"2024-04-17T19:50:15.436263+0000","last_undegraded":"2024-04-17T19:50:15.436263+0000","last_fullsized":"2024-04-17T19:50:15.436263+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_clean_scrub_stamp":"2024-04-17T19:46:55.648649+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:00:10.859769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"27'5","reported_seq":30,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:50:15.399041+0000","last_change":"2024-04-17T19:46:56.699129+0000","last_active":"2024-04-17T19:50:15.399041+0000","last_peered":"2024-04-17T19:50:15.399041+0000","last_clean":"2024-04-17T19:50:15.399041+0000","last_became_active":"2024-04-17T19:46:56.698840+0000","last_became_peered":"2024-04-17T19:46:56.698840+0000","last_unstale":"2024-04-17T19:50:15.399041+0000","last_undegraded":"2024-04-17T19:50:15.399041+0000","last_fullsized":"2024-04-17T19:50:15.399041+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_clean_scrub_stamp":"2024-04-17T19:46:55.648649+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T05:35:47.746622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"27'6","reported_seq":31,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:50:15.399382+0000","last_change":"2024-04-17T19:46:56.705903+0000","last_active":"2024-04-17T19:50:15.399382+0000","last_peered":"2024-04-17T19:50:15.399382+0000","last_clean":"2024-04-17T19:50:15.399382+0000","last_became_active":"2024-04-17T19:46:56.705539+0000","last_became_peered":"2024-04-17T19:46:56.705539+0000","last_unstale":"2024-04-17T19:50:15.399382+0000","last_undegraded":"2024-04-17T19:50:15.399382+0000","last_fullsized":"2024-04-17T19:50:15.399382+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_clean_scrub_stamp":"2024-04-17T19:46:55.648649+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:57:40.700986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"27'4","reported_seq":29,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:50:15.428503+0000","last_change":"2024-04-17T19:46:56.694456+0000","last_active":"2024-04-17T19:50:15.428503+0000","last_peered":"2024-04-17T19:50:15.428503+0000","last_clean":"2024-04-17T19:50:15.428503+0000","last_became_active":"2024-04-17T19:46:56.693954+0000","last_became_peered":"2024-04-17T19:46:56.693954+0000","last_unstale":"2024-04-17T19:50:15.428503+0000","last_undegraded":"2024-04-17T19:50:15.428503+0000","last_fullsized":"2024-04-17T19:50:15.428503+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_clean_scrub_stamp":"2024-04-17T19:46:55.648649+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:22:33.413402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"27'8","reported_seq":33,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:50:15.421043+0000","last_change":"2024-04-17T19:46:56.706411+0000","last_active":"2024-04-17T19:50:15.421043+0000","last_peered":"2024-04-17T19:50:15.421043+0000","last_clean":"2024-04-17T19:50:15.421043+0000","last_became_active":"2024-04-17T19:46:56.706021+0000","last_became_peered":"2024-04-17T19:46:56.706021+0000","last_unstale":"2024-04-17T19:50:15.421043+0000","last_undegraded":"2024-04-17T19:50:15.421043+0000","last_fullsized":"2024-04-17T19:50:15.421043+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_clean_scrub_stamp":"2024-04-17T19:46:55.648649+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T05:52:33.559392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3d","version":"27'7","reported_seq":32,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:50:15.434698+0000","last_change":"2024-04-17T19:46:56.696930+0000","last_active":"2024-04-17T19:50:15.434698+0000","last_peered":"2024-04-17T19:50:15.434698+0000","last_clean":"2024-04-17T19:50:15.434698+0000","last_became_active":"2024-04-17T19:46:56.696492+0000","last_became_peered":"2024-04-17T19:46:56.696492+0000","last_unstale":"2024-04-17T19:50:15.434698+0000","last_undegraded":"2024-04-17T19:50:15.434698+0000","last_fullsized":"2024-04-17T19:50:15.434698+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_clean_scrub_stamp":"2024-04-17T19:46:55.648649+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:43:54.268148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"27'4","reported_seq":29,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:50:15.436265+0000","last_change":"2024-04-17T19:46:56.683448+0000","last_active":"2024-04-17T19:50:15.436265+0000","last_peered":"2024-04-17T19:50:15.436265+0000","last_clean":"2024-04-17T19:50:15.436265+0000","last_became_active":"2024-04-17T19:46:56.682772+0000","last_became_peered":"2024-04-17T19:46:56.682772+0000","last_unstale":"2024-04-17T19:50:15.436265+0000","last_undegraded":"2024-04-17T19:50:15.436265+0000","last_fullsized":"2024-04-17T19:50:15.436265+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_clean_scrub_stamp":"2024-04-17T19:46:55.648649+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T22:39:31.496708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3f","version":"27'8","reported_seq":33,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:50:15.381265+0000","last_change":"2024-04-17T19:46:56.695275+0000","last_active":"2024-04-17T19:50:15.381265+0000","last_peered":"2024-04-17T19:50:15.381265+0000","last_clean":"2024-04-17T19:50:15.381265+0000","last_became_active":"2024-04-17T19:46:56.694743+0000","last_became_peered":"2024-04-17T19:46:56.694743+0000","last_unstale":"2024-04-17T19:50:15.381265+0000","last_undegraded":"2024-04-17T19:50:15.381265+0000","last_fullsized":"2024-04-17T19:50:15.381265+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_clean_scrub_stamp":"2024-04-17T19:46:55.648649+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:01:01.006486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":501,"ondisk_log_size":501,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":44818,"num_objects":99,"num_object_clones":0,"num_object_copies":198,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":99,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":261,"num_write_kb":128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":344064,"data_stored":89636,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":229,"ondisk_log_size":229,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":66496,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509486,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27332,"kb_used_data":316,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344508,"statfs":{"total":96636764160,"available":96608776192,"internally_reserved":0,"allocated":323584,"data_stored":117072,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509487,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27312,"kb_used_data":296,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344528,"statfs":{"total":96636764160,"available":96608796672,"internally_reserved":0,"allocated":303104,"data_stored":118385,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509487,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27336,"kb_used_data":320,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344504,"statfs":{"total":96636764160,"available":96608772096,"internally_reserved":0,"allocated":327680,"data_stored":118328,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509487,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27348,"kb_used_data":332,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344492,"statfs":{"total":96636764160,"available":96608759808,"internally_reserved":0,"allocated":339968,"data_stored":153259,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509486,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31536,"kb_used_data":360,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340304,"statfs":{"total":96636764160,"available":96604471296,"internally_reserved":0,"allocated":368640,"data_stored":707388,"data_compressed":33248,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509486,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27328,"kb_used_data":312,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344512,"statfs":{"total":96636764160,"available":96608780288,"internally_reserved":0,"allocated":319488,"data_stored":118547,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574895,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31544,"kb_used_data":368,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340296,"statfs":{"total":96636764160,"available":96604463104,"internally_reserved":0,"allocated":376832,"data_stored":707212,"data_compressed":33248,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":24,"apply_latency_ms":24,"commit_latency_ns":24000000,"apply_latency_ns":24000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574895,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27384,"kb_used_data":368,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344456,"statfs":{"total":96636764160,"available":96608722944,"internally_reserved":0,"allocated":376832,"data_stored":155029,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":11,"apply_latency_ms":11,"commit_latency_ns":11000000,"apply_latency_ns":11000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33248,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33248,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":2941,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1414,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":37653,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":2722,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":94208,"data_stored":39423,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1238,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2779,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":1466,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-17T19:50:23.338 INFO:tasks.ceph:pgid 2.1f last_scrub_stamp 2024-04-17T19:46:54.640133+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=19, tm_min=46, tm_sec=54, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=19, tm_min=50, tm_sec=17, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T19:50:23.339 INFO:tasks.ceph:pgid 3.1e last_scrub_stamp 2024-04-17T19:46:55.648649+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=19, tm_min=46, tm_sec=55, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=19, tm_min=50, tm_sec=17, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T19:50:23.339 INFO:tasks.ceph:pgid 4.19 last_scrub_stamp 2024-04-17T19:46:59.695482+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=19, tm_min=46, tm_sec=59, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=19, tm_min=50, tm_sec=17, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T19:50:23.339 INFO:tasks.ceph:pgid 2.1e last_scrub_stamp 2024-04-17T19:46:54.640133+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=19, tm_min=46, tm_sec=54, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=19, tm_min=50, tm_sec=17, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T19:50:23.339 INFO:tasks.ceph:pgid 3.1f last_scrub_stamp 2024-04-17T19:46:55.648649+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=19, tm_min=46, tm_sec=55, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=19, tm_min=50, tm_sec=17, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T19:50:23.339 INFO:tasks.ceph:pgid 4.18 last_scrub_stamp 2024-04-17T19:46:59.695482+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=19, tm_min=46, tm_sec=59, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=19, tm_min=50, tm_sec=17, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T19:50:23.339 INFO:tasks.ceph:pgid 2.1d last_scrub_stamp 2024-04-17T19:46:54.640133+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=19, tm_min=46, tm_sec=54, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=19, tm_min=50, tm_sec=17, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T19:50:23.339 INFO:tasks.ceph:pgid 3.1c last_scrub_stamp 2024-04-17T19:46:55.648649+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=19, tm_min=46, tm_sec=55, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=19, tm_min=50, tm_sec=17, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T19:50:23.339 INFO:tasks.ceph:pgid 4.1b last_scrub_stamp 2024-04-17T19:46:59.695482+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=19, tm_min=46, tm_sec=59, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=19, tm_min=50, tm_sec=17, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T19:50:23.340 INFO:tasks.ceph:pgid 2.1c last_scrub_stamp 2024-04-17T19:46:54.640133+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=19, tm_min=46, tm_sec=54, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=19, tm_min=50, tm_sec=17, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T19:50:23.340 INFO:tasks.ceph:pgid 3.1d last_scrub_stamp 2024-04-17T19:46:55.648649+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=19, tm_min=46, tm_sec=55, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=19, tm_min=50, tm_sec=17, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T19:50:23.340 INFO:tasks.ceph:pgid 4.1a last_scrub_stamp 2024-04-17T19:46:59.695482+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=19, tm_min=46, tm_sec=59, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=19, tm_min=50, tm_sec=17, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T19:50:23.340 INFO:tasks.ceph:pgid 3.a last_scrub_stamp 2024-04-17T19:46:55.648649+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=19, tm_min=46, tm_sec=55, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=19, tm_min=50, tm_sec=17, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T19:50:23.340 INFO:tasks.ceph:pgid 2.b last_scrub_stamp 2024-04-17T19:46:54.640133+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=19, tm_min=46, tm_sec=54, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=19, tm_min=50, tm_sec=17, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T19:50:23.340 INFO:tasks.ceph:pgid 4.d last_scrub_stamp 2024-04-17T19:46:59.695482+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=19, tm_min=46, tm_sec=59, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=19, tm_min=50, tm_sec=17, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T19:50:23.340 INFO:tasks.ceph:pgid 3.b last_scrub_stamp 2024-04-17T19:46:55.648649+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=19, tm_min=46, tm_sec=55, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=19, tm_min=50, tm_sec=17, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T19:50:23.340 INFO:tasks.ceph:pgid 2.a last_scrub_stamp 2024-04-17T19:46:54.640133+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=19, tm_min=46, tm_sec=54, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=19, tm_min=50, tm_sec=17, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T19:50:23.340 INFO:tasks.ceph:pgid 4.c last_scrub_stamp 2024-04-17T19:46:59.695482+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=19, tm_min=46, tm_sec=59, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=19, tm_min=50, tm_sec=17, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T19:50:23.340 INFO:tasks.ceph:pgid 3.8 last_scrub_stamp 2024-04-17T19:46:55.648649+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=19, tm_min=46, tm_sec=55, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=19, tm_min=50, tm_sec=17, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T19:50:23.341 INFO:tasks.ceph:pgid 2.9 last_scrub_stamp 2024-04-17T19:46:54.640133+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=19, tm_min=46, tm_sec=54, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=19, tm_min=50, tm_sec=17, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T19:50:23.341 INFO:tasks.ceph:pgid 4.f last_scrub_stamp 2024-04-17T19:46:59.695482+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=19, tm_min=46, tm_sec=59, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=19, tm_min=50, tm_sec=17, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T19:50:23.341 INFO:tasks.ceph:pgid 3.9 last_scrub_stamp 2024-04-17T19:46:55.648649+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=19, tm_min=46, tm_sec=55, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=19, tm_min=50, tm_sec=17, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T19:50:23.341 INFO:tasks.ceph:pgid 2.8 last_scrub_stamp 2024-04-17T19:46:54.640133+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=19, tm_min=46, tm_sec=54, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=19, tm_min=50, tm_sec=17, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T19:50:23.341 INFO:tasks.ceph:pgid 4.e last_scrub_stamp 2024-04-17T19:46:59.695482+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=19, tm_min=46, tm_sec=59, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=19, tm_min=50, tm_sec=17, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T19:50:23.341 INFO:tasks.ceph:pgid 3.6 last_scrub_stamp 2024-04-17T19:46:55.648649+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=19, tm_min=46, tm_sec=55, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=19, tm_min=50, tm_sec=17, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T19:50:23.341 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2024-04-17T19:46:54.640133+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=19, tm_min=46, tm_sec=54, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=19, tm_min=50, tm_sec=17, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T19:50:23.341 INFO:tasks.ceph:pgid 4.1 last_scrub_stamp 2024-04-17T19:46:59.695482+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=19, tm_min=46, tm_sec=59, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=19, tm_min=50, tm_sec=17, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T19:50:23.341 INFO:tasks.ceph:pgid 3.7 last_scrub_stamp 2024-04-17T19:46:55.648649+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=19, tm_min=46, tm_sec=55, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=19, tm_min=50, tm_sec=17, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T19:50:23.341 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2024-04-17T19:46:54.640133+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=19, tm_min=46, tm_sec=54, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=19, tm_min=50, tm_sec=17, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T19:50:23.341 INFO:tasks.ceph:pgid 4.0 last_scrub_stamp 2024-04-17T19:46:59.695482+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=19, tm_min=46, tm_sec=59, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=19, tm_min=50, tm_sec=17, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T19:50:23.342 INFO:tasks.ceph:pgid 3.4 last_scrub_stamp 2024-04-17T19:46:55.648649+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=19, tm_min=46, tm_sec=55, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=19, tm_min=50, tm_sec=17, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T19:50:23.342 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2024-04-17T19:46:54.640133+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=19, tm_min=46, tm_sec=54, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=19, tm_min=50, tm_sec=17, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T19:50:23.342 INFO:tasks.ceph:pgid 4.3 last_scrub_stamp 2024-04-17T19:46:59.695482+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=19, tm_min=46, tm_sec=59, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=19, tm_min=50, tm_sec=17, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T19:50:23.342 INFO:tasks.ceph:pgid 3.5 last_scrub_stamp 2024-04-17T19:46:55.648649+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=19, tm_min=46, tm_sec=55, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=19, tm_min=50, tm_sec=17, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T19:50:23.342 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2024-04-17T19:46:54.640133+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=19, tm_min=46, tm_sec=54, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=19, tm_min=50, tm_sec=17, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T19:50:23.342 INFO:tasks.ceph:pgid 4.2 last_scrub_stamp 2024-04-17T19:46:59.695482+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=19, tm_min=46, tm_sec=59, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=19, tm_min=50, tm_sec=17, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T19:50:23.342 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2024-04-17T19:46:55.648649+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=19, tm_min=46, tm_sec=55, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=19, tm_min=50, tm_sec=17, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T19:50:23.342 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2024-04-17T19:46:54.640133+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=19, tm_min=46, tm_sec=54, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=19, tm_min=50, tm_sec=17, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T19:50:23.342 INFO:tasks.ceph:pgid 4.4 last_scrub_stamp 2024-04-17T19:46:59.695482+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=19, tm_min=46, tm_sec=59, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=19, tm_min=50, tm_sec=17, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T19:50:23.342 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2024-04-17T19:46:55.648649+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=19, tm_min=46, tm_sec=55, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=19, tm_min=50, tm_sec=17, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T19:50:23.343 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2024-04-17T19:46:54.640133+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=19, tm_min=46, tm_sec=54, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=19, tm_min=50, tm_sec=17, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T19:50:23.343 INFO:tasks.ceph:pgid 4.7 last_scrub_stamp 2024-04-17T19:46:59.695482+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=19, tm_min=46, tm_sec=59, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=19, tm_min=50, tm_sec=17, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T19:50:23.343 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2024-04-17T19:46:55.648649+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=19, tm_min=46, tm_sec=55, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=19, tm_min=50, tm_sec=17, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T19:50:23.343 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2024-04-17T19:46:54.640133+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=19, tm_min=46, tm_sec=54, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=19, tm_min=50, tm_sec=17, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T19:50:23.343 INFO:tasks.ceph:pgid 4.6 last_scrub_stamp 2024-04-17T19:46:59.695482+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=19, tm_min=46, tm_sec=59, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=19, tm_min=50, tm_sec=17, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T19:50:23.343 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2024-04-17T19:46:55.648649+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=19, tm_min=46, tm_sec=55, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=19, tm_min=50, tm_sec=17, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T19:50:23.343 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2024-04-17T19:46:54.640133+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=19, tm_min=46, tm_sec=54, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=19, tm_min=50, tm_sec=17, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T19:50:23.343 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-04-17T19:46:41.988197+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=19, tm_min=46, tm_sec=41, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=19, tm_min=50, tm_sec=17, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T19:50:23.343 INFO:tasks.ceph:pgid 4.5 last_scrub_stamp 2024-04-17T19:46:59.695482+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=19, tm_min=46, tm_sec=59, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=19, tm_min=50, tm_sec=17, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T19:50:23.343 INFO:tasks.ceph:pgid 3.d last_scrub_stamp 2024-04-17T19:46:55.648649+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=19, tm_min=46, tm_sec=55, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=19, tm_min=50, tm_sec=17, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T19:50:23.343 INFO:tasks.ceph:pgid 2.c last_scrub_stamp 2024-04-17T19:46:54.640133+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=19, tm_min=46, tm_sec=54, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=19, tm_min=50, tm_sec=17, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T19:50:23.344 INFO:tasks.ceph:pgid 4.a last_scrub_stamp 2024-04-17T19:46:59.695482+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=19, tm_min=46, tm_sec=59, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=19, tm_min=50, tm_sec=17, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T19:50:23.344 INFO:tasks.ceph:pgid 3.c last_scrub_stamp 2024-04-17T19:46:55.648649+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=19, tm_min=46, tm_sec=55, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=19, tm_min=50, tm_sec=17, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T19:50:23.344 INFO:tasks.ceph:pgid 2.d last_scrub_stamp 2024-04-17T19:46:54.640133+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=19, tm_min=46, tm_sec=54, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=19, tm_min=50, tm_sec=17, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T19:50:23.344 INFO:tasks.ceph:pgid 4.b last_scrub_stamp 2024-04-17T19:46:59.695482+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=19, tm_min=46, tm_sec=59, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=19, tm_min=50, tm_sec=17, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T19:50:23.344 INFO:tasks.ceph:pgid 3.f last_scrub_stamp 2024-04-17T19:46:55.648649+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=19, tm_min=46, tm_sec=55, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=19, tm_min=50, tm_sec=17, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T19:50:23.344 INFO:tasks.ceph:pgid 2.e last_scrub_stamp 2024-04-17T19:46:54.640133+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=19, tm_min=46, tm_sec=54, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=19, tm_min=50, tm_sec=17, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T19:50:23.344 INFO:tasks.ceph:pgid 4.8 last_scrub_stamp 2024-04-17T19:46:59.695482+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=19, tm_min=46, tm_sec=59, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=19, tm_min=50, tm_sec=17, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T19:50:23.344 INFO:tasks.ceph:pgid 3.e last_scrub_stamp 2024-04-17T19:46:55.648649+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=19, tm_min=46, tm_sec=55, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=19, tm_min=50, tm_sec=17, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T19:50:23.344 INFO:tasks.ceph:pgid 2.f last_scrub_stamp 2024-04-17T19:46:54.640133+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=19, tm_min=46, tm_sec=54, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=19, tm_min=50, tm_sec=17, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T19:50:23.344 INFO:tasks.ceph:pgid 4.9 last_scrub_stamp 2024-04-17T19:46:59.695482+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=19, tm_min=46, tm_sec=59, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=19, tm_min=50, tm_sec=17, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T19:50:23.345 INFO:tasks.ceph:pgid 3.11 last_scrub_stamp 2024-04-17T19:46:55.648649+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=19, tm_min=46, tm_sec=55, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=19, tm_min=50, tm_sec=17, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T19:50:23.345 INFO:tasks.ceph:pgid 2.10 last_scrub_stamp 2024-04-17T19:46:54.640133+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=19, tm_min=46, tm_sec=54, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=19, tm_min=50, tm_sec=17, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T19:50:23.345 INFO:tasks.ceph:pgid 4.16 last_scrub_stamp 2024-04-17T19:46:59.695482+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=19, tm_min=46, tm_sec=59, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=19, tm_min=50, tm_sec=17, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T19:50:23.345 INFO:tasks.ceph:pgid 3.10 last_scrub_stamp 2024-04-17T19:46:55.648649+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=19, tm_min=46, tm_sec=55, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=19, tm_min=50, tm_sec=17, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T19:50:23.345 INFO:tasks.ceph:pgid 2.11 last_scrub_stamp 2024-04-17T19:46:54.640133+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=19, tm_min=46, tm_sec=54, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=19, tm_min=50, tm_sec=17, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T19:50:23.345 INFO:tasks.ceph:pgid 4.17 last_scrub_stamp 2024-04-17T19:46:59.695482+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=19, tm_min=46, tm_sec=59, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=19, tm_min=50, tm_sec=17, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T19:50:23.345 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2024-04-17T19:46:55.648649+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=19, tm_min=46, tm_sec=55, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=19, tm_min=50, tm_sec=17, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T19:50:23.345 INFO:tasks.ceph:pgid 2.12 last_scrub_stamp 2024-04-17T19:46:54.640133+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=19, tm_min=46, tm_sec=54, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=19, tm_min=50, tm_sec=17, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T19:50:23.345 INFO:tasks.ceph:pgid 4.14 last_scrub_stamp 2024-04-17T19:46:59.695482+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=19, tm_min=46, tm_sec=59, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=19, tm_min=50, tm_sec=17, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T19:50:23.345 INFO:tasks.ceph:pgid 3.12 last_scrub_stamp 2024-04-17T19:46:55.648649+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=19, tm_min=46, tm_sec=55, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=19, tm_min=50, tm_sec=17, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T19:50:23.345 INFO:tasks.ceph:pgid 2.13 last_scrub_stamp 2024-04-17T19:46:54.640133+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=19, tm_min=46, tm_sec=54, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=19, tm_min=50, tm_sec=17, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T19:50:23.346 INFO:tasks.ceph:pgid 4.15 last_scrub_stamp 2024-04-17T19:46:59.695482+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=19, tm_min=46, tm_sec=59, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=19, tm_min=50, tm_sec=17, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T19:50:23.346 INFO:tasks.ceph:pgid 3.15 last_scrub_stamp 2024-04-17T19:46:55.648649+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=19, tm_min=46, tm_sec=55, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=19, tm_min=50, tm_sec=17, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T19:50:23.346 INFO:tasks.ceph:pgid 2.14 last_scrub_stamp 2024-04-17T19:46:54.640133+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=19, tm_min=46, tm_sec=54, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=19, tm_min=50, tm_sec=17, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T19:50:23.346 INFO:tasks.ceph:pgid 4.12 last_scrub_stamp 2024-04-17T19:46:59.695482+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=19, tm_min=46, tm_sec=59, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=19, tm_min=50, tm_sec=17, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T19:50:23.346 INFO:tasks.ceph:pgid 3.14 last_scrub_stamp 2024-04-17T19:46:55.648649+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=19, tm_min=46, tm_sec=55, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=19, tm_min=50, tm_sec=17, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T19:50:23.346 INFO:tasks.ceph:pgid 2.15 last_scrub_stamp 2024-04-17T19:46:54.640133+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=19, tm_min=46, tm_sec=54, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=19, tm_min=50, tm_sec=17, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T19:50:23.346 INFO:tasks.ceph:pgid 4.13 last_scrub_stamp 2024-04-17T19:46:59.695482+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=19, tm_min=46, tm_sec=59, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=19, tm_min=50, tm_sec=17, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T19:50:23.346 INFO:tasks.ceph:pgid 3.17 last_scrub_stamp 2024-04-17T19:46:55.648649+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=19, tm_min=46, tm_sec=55, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=19, tm_min=50, tm_sec=17, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T19:50:23.346 INFO:tasks.ceph:pgid 2.16 last_scrub_stamp 2024-04-17T19:46:54.640133+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=19, tm_min=46, tm_sec=54, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=19, tm_min=50, tm_sec=17, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T19:50:23.346 INFO:tasks.ceph:pgid 4.10 last_scrub_stamp 2024-04-17T19:46:59.695482+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=19, tm_min=46, tm_sec=59, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=19, tm_min=50, tm_sec=17, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T19:50:23.347 INFO:tasks.ceph:pgid 3.16 last_scrub_stamp 2024-04-17T19:46:55.648649+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=19, tm_min=46, tm_sec=55, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=19, tm_min=50, tm_sec=17, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T19:50:23.347 INFO:tasks.ceph:pgid 2.17 last_scrub_stamp 2024-04-17T19:46:54.640133+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=19, tm_min=46, tm_sec=54, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=19, tm_min=50, tm_sec=17, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T19:50:23.347 INFO:tasks.ceph:pgid 4.11 last_scrub_stamp 2024-04-17T19:46:59.695482+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=19, tm_min=46, tm_sec=59, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=19, tm_min=50, tm_sec=17, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T19:50:23.347 INFO:tasks.ceph:pgid 4.1e last_scrub_stamp 2024-04-17T19:46:59.695482+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=19, tm_min=46, tm_sec=59, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=19, tm_min=50, tm_sec=17, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T19:50:23.347 INFO:tasks.ceph:pgid 3.19 last_scrub_stamp 2024-04-17T19:46:55.648649+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=19, tm_min=46, tm_sec=55, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=19, tm_min=50, tm_sec=17, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T19:50:23.347 INFO:tasks.ceph:pgid 2.18 last_scrub_stamp 2024-04-17T19:46:54.640133+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=19, tm_min=46, tm_sec=54, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=19, tm_min=50, tm_sec=17, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T19:50:23.347 INFO:tasks.ceph:pgid 4.1f last_scrub_stamp 2024-04-17T19:46:59.695482+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=19, tm_min=46, tm_sec=59, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=19, tm_min=50, tm_sec=17, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T19:50:23.347 INFO:tasks.ceph:pgid 3.18 last_scrub_stamp 2024-04-17T19:46:55.648649+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=19, tm_min=46, tm_sec=55, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=19, tm_min=50, tm_sec=17, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T19:50:23.347 INFO:tasks.ceph:pgid 2.19 last_scrub_stamp 2024-04-17T19:46:54.640133+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=19, tm_min=46, tm_sec=54, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=19, tm_min=50, tm_sec=17, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T19:50:23.347 INFO:tasks.ceph:pgid 2.1a last_scrub_stamp 2024-04-17T19:46:54.640133+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=19, tm_min=46, tm_sec=54, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=19, tm_min=50, tm_sec=17, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T19:50:23.347 INFO:tasks.ceph:pgid 3.1b last_scrub_stamp 2024-04-17T19:46:55.648649+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=19, tm_min=46, tm_sec=55, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=19, tm_min=50, tm_sec=17, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T19:50:23.348 INFO:tasks.ceph:pgid 4.1c last_scrub_stamp 2024-04-17T19:46:59.695482+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=19, tm_min=46, tm_sec=59, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=19, tm_min=50, tm_sec=17, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T19:50:23.348 INFO:tasks.ceph:pgid 2.1b last_scrub_stamp 2024-04-17T19:46:54.640133+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=19, tm_min=46, tm_sec=54, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=19, tm_min=50, tm_sec=17, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T19:50:23.348 INFO:tasks.ceph:pgid 3.1a last_scrub_stamp 2024-04-17T19:46:55.648649+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=19, tm_min=46, tm_sec=55, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=19, tm_min=50, tm_sec=17, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T19:50:23.348 INFO:tasks.ceph:pgid 4.1d last_scrub_stamp 2024-04-17T19:46:59.695482+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=19, tm_min=46, tm_sec=59, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=19, tm_min=50, tm_sec=17, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T19:50:23.348 INFO:tasks.ceph:pgid 3.20 last_scrub_stamp 2024-04-17T19:46:55.648649+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=19, tm_min=46, tm_sec=55, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=19, tm_min=50, tm_sec=17, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T19:50:23.348 INFO:tasks.ceph:pgid 3.21 last_scrub_stamp 2024-04-17T19:46:55.648649+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=19, tm_min=46, tm_sec=55, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=19, tm_min=50, tm_sec=17, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T19:50:23.348 INFO:tasks.ceph:pgid 3.22 last_scrub_stamp 2024-04-17T19:46:55.648649+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=19, tm_min=46, tm_sec=55, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=19, tm_min=50, tm_sec=17, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T19:50:23.348 INFO:tasks.ceph:pgid 3.23 last_scrub_stamp 2024-04-17T19:46:55.648649+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=19, tm_min=46, tm_sec=55, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=19, tm_min=50, tm_sec=17, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T19:50:23.348 INFO:tasks.ceph:pgid 3.24 last_scrub_stamp 2024-04-17T19:46:55.648649+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=19, tm_min=46, tm_sec=55, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=19, tm_min=50, tm_sec=17, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T19:50:23.348 INFO:tasks.ceph:pgid 3.25 last_scrub_stamp 2024-04-17T19:46:55.648649+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=19, tm_min=46, tm_sec=55, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=19, tm_min=50, tm_sec=17, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T19:50:23.349 INFO:tasks.ceph:pgid 3.26 last_scrub_stamp 2024-04-17T19:46:55.648649+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=19, tm_min=46, tm_sec=55, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=19, tm_min=50, tm_sec=17, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T19:50:23.349 INFO:tasks.ceph:pgid 3.27 last_scrub_stamp 2024-04-17T19:46:55.648649+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=19, tm_min=46, tm_sec=55, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=19, tm_min=50, tm_sec=17, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T19:50:23.349 INFO:tasks.ceph:pgid 3.28 last_scrub_stamp 2024-04-17T19:46:55.648649+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=19, tm_min=46, tm_sec=55, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=19, tm_min=50, tm_sec=17, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T19:50:23.349 INFO:tasks.ceph:pgid 3.29 last_scrub_stamp 2024-04-17T19:46:55.648649+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=19, tm_min=46, tm_sec=55, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=19, tm_min=50, tm_sec=17, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T19:50:23.349 INFO:tasks.ceph:pgid 3.2a last_scrub_stamp 2024-04-17T19:46:55.648649+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=19, tm_min=46, tm_sec=55, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=19, tm_min=50, tm_sec=17, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T19:50:23.349 INFO:tasks.ceph:pgid 3.2b last_scrub_stamp 2024-04-17T19:46:55.648649+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=19, tm_min=46, tm_sec=55, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=19, tm_min=50, tm_sec=17, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T19:50:23.349 INFO:tasks.ceph:pgid 3.2c last_scrub_stamp 2024-04-17T19:46:55.648649+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=19, tm_min=46, tm_sec=55, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=19, tm_min=50, tm_sec=17, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T19:50:23.349 INFO:tasks.ceph:pgid 3.2d last_scrub_stamp 2024-04-17T19:46:55.648649+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=19, tm_min=46, tm_sec=55, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=19, tm_min=50, tm_sec=17, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T19:50:23.349 INFO:tasks.ceph:pgid 3.2e last_scrub_stamp 2024-04-17T19:46:55.648649+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=19, tm_min=46, tm_sec=55, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=19, tm_min=50, tm_sec=17, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T19:50:23.350 INFO:tasks.ceph:pgid 3.2f last_scrub_stamp 2024-04-17T19:46:55.648649+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=19, tm_min=46, tm_sec=55, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=19, tm_min=50, tm_sec=17, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T19:50:23.350 INFO:tasks.ceph:pgid 3.30 last_scrub_stamp 2024-04-17T19:46:55.648649+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=19, tm_min=46, tm_sec=55, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=19, tm_min=50, tm_sec=17, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T19:50:23.350 INFO:tasks.ceph:pgid 3.31 last_scrub_stamp 2024-04-17T19:46:55.648649+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=19, tm_min=46, tm_sec=55, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=19, tm_min=50, tm_sec=17, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T19:50:23.350 INFO:tasks.ceph:pgid 3.32 last_scrub_stamp 2024-04-17T19:46:55.648649+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=19, tm_min=46, tm_sec=55, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=19, tm_min=50, tm_sec=17, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T19:50:23.350 INFO:tasks.ceph:pgid 3.33 last_scrub_stamp 2024-04-17T19:46:55.648649+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=19, tm_min=46, tm_sec=55, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=19, tm_min=50, tm_sec=17, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T19:50:23.350 INFO:tasks.ceph:pgid 3.34 last_scrub_stamp 2024-04-17T19:46:55.648649+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=19, tm_min=46, tm_sec=55, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=19, tm_min=50, tm_sec=17, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T19:50:23.350 INFO:tasks.ceph:pgid 3.35 last_scrub_stamp 2024-04-17T19:46:55.648649+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=19, tm_min=46, tm_sec=55, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=19, tm_min=50, tm_sec=17, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T19:50:23.350 INFO:tasks.ceph:pgid 3.36 last_scrub_stamp 2024-04-17T19:46:55.648649+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=19, tm_min=46, tm_sec=55, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=19, tm_min=50, tm_sec=17, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T19:50:23.350 INFO:tasks.ceph:pgid 3.37 last_scrub_stamp 2024-04-17T19:46:55.648649+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=19, tm_min=46, tm_sec=55, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=19, tm_min=50, tm_sec=17, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T19:50:23.350 INFO:tasks.ceph:pgid 3.38 last_scrub_stamp 2024-04-17T19:46:55.648649+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=19, tm_min=46, tm_sec=55, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=19, tm_min=50, tm_sec=17, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T19:50:23.351 INFO:tasks.ceph:pgid 3.39 last_scrub_stamp 2024-04-17T19:46:55.648649+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=19, tm_min=46, tm_sec=55, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=19, tm_min=50, tm_sec=17, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T19:50:23.351 INFO:tasks.ceph:pgid 3.3a last_scrub_stamp 2024-04-17T19:46:55.648649+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=19, tm_min=46, tm_sec=55, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=19, tm_min=50, tm_sec=17, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T19:50:23.351 INFO:tasks.ceph:pgid 3.3b last_scrub_stamp 2024-04-17T19:46:55.648649+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=19, tm_min=46, tm_sec=55, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=19, tm_min=50, tm_sec=17, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T19:50:23.351 INFO:tasks.ceph:pgid 3.3c last_scrub_stamp 2024-04-17T19:46:55.648649+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=19, tm_min=46, tm_sec=55, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=19, tm_min=50, tm_sec=17, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T19:50:23.351 INFO:tasks.ceph:pgid 3.3d last_scrub_stamp 2024-04-17T19:46:55.648649+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=19, tm_min=46, tm_sec=55, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=19, tm_min=50, tm_sec=17, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T19:50:23.351 INFO:tasks.ceph:pgid 3.3e last_scrub_stamp 2024-04-17T19:46:55.648649+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=19, tm_min=46, tm_sec=55, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=19, tm_min=50, tm_sec=17, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T19:50:23.351 INFO:tasks.ceph:pgid 3.3f last_scrub_stamp 2024-04-17T19:46:55.648649+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=19, tm_min=46, tm_sec=55, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=19, tm_min=50, tm_sec=17, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T19:50:23.351 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-04-17T19:50:24.139 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T19:50:24.143 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T19:50:43.353 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-17T19:50:43.518 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:43.527+0000 7f000f800640 1 Processor -- start 2024-04-17T19:50:43.518 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:43.527+0000 7f000f800640 1 -- start start 2024-04-17T19:50:43.521 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:43.527+0000 7f000f800640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f0008152a60 0x7f00080c6920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:50:43.521 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:43.527+0000 7f000f800640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f0008158eb0 0x7f00081592c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:50:43.521 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:43.527+0000 7f000f800640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f00080c47c0 0x7f00080c4bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:50:43.521 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:43.527+0000 7f000f800640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 -- 0x7f0008152e70 con 0x7f0008158eb0 2024-04-17T19:50:43.521 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:43.527+0000 7f000f800640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 -- 0x7f00080c52c0 con 0x7f00080c47c0 2024-04-17T19:50:43.521 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:43.527+0000 7f000f800640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7f00080c8840 con 0x7f0008152a60 2024-04-17T19:50:43.521 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:43.527+0000 7effffe00640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f0008158eb0 0x7f00081592c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:50:43.522 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:43.527+0000 7effffe00640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f0008158eb0 0x7f00081592c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:49094/0 (socket says 172.21.15.44:49094) 2024-04-17T19:50:43.522 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:43.527+0000 7effffe00640 1 -- 172.21.15.44:0/1187779678 learned_addr learned my addr 172.21.15.44:0/1187779678 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-04-17T19:50:43.522 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:43.527+0000 7f000ce00640 1 --2- 172.21.15.44:0/1187779678 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f0008152a60 0x7f00080c6920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:50:43.522 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:43.527+0000 7f000d800640 1 --2- 172.21.15.44:0/1187779678 >> v2:172.21.15.62:3300/0 conn(0x7f00080c47c0 0x7f00080c4bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:50:43.522 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:43.531+0000 7effffe00640 1 -- 172.21.15.44:0/1187779678 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f0008152a60 msgr2=0x7f00080c6920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T19:50:43.522 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:43.531+0000 7effffe00640 1 --2- 172.21.15.44:0/1187779678 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f0008152a60 0x7f00080c6920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:50:43.522 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:43.531+0000 7effffe00640 1 -- 172.21.15.44:0/1187779678 >> v2:172.21.15.62:3300/0 conn(0x7f00080c47c0 msgr2=0x7f00080c4bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T19:50:43.522 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:43.531+0000 7effffe00640 1 --2- 172.21.15.44:0/1187779678 >> v2:172.21.15.62:3300/0 conn(0x7f00080c47c0 0x7f00080c4bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:50:43.522 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:43.531+0000 7effffe00640 1 -- 172.21.15.44:0/1187779678 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f00080c8b20 con 0x7f0008158eb0 2024-04-17T19:50:43.524 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:43.531+0000 7effffe00640 1 --2- 172.21.15.44:0/1187779678 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0008158eb0 0x7f00081592c0 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f00080745d0 tx=0x7efff001ed10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9e1efeaf914e6b8 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:50:43.524 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:43.531+0000 7f0007e00640 1 -- 172.21.15.44:0/1187779678 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efff00b5070 con 0x7f0008158eb0 2024-04-17T19:50:43.524 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:43.531+0000 7f0007e00640 1 -- 172.21.15.44:0/1187779678 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efff00a89d0 con 0x7f0008158eb0 2024-04-17T19:50:43.524 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:43.531+0000 7f0007e00640 1 -- 172.21.15.44:0/1187779678 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efff00a8da0 con 0x7f0008158eb0 2024-04-17T19:50:43.525 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:43.531+0000 7f000f800640 1 -- 172.21.15.44:0/1187779678 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0008158eb0 msgr2=0x7f00081592c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:50:43.525 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:43.531+0000 7f000f800640 1 --2- 172.21.15.44:0/1187779678 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0008158eb0 0x7f00081592c0 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f00080745d0 tx=0x7efff001ed10 comp rx=0 tx=0).stop 2024-04-17T19:50:43.525 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:43.535+0000 7f000f800640 1 -- 172.21.15.44:0/1187779678 shutdown_connections 2024-04-17T19:50:43.525 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:43.535+0000 7f000f800640 1 --2- 172.21.15.44:0/1187779678 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0008158eb0 0x7f00081592c0 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:50:43.525 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:43.535+0000 7f000f800640 1 --2- 172.21.15.44:0/1187779678 >> v2:172.21.15.62:3300/0 conn(0x7f00080c47c0 0x7f00080c4bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:50:43.525 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:43.535+0000 7f000f800640 1 --2- 172.21.15.44:0/1187779678 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f0008152a60 0x7f00080c6920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:50:43.526 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:43.535+0000 7f000f800640 1 -- 172.21.15.44:0/1187779678 >> 172.21.15.44:0/1187779678 conn(0x7f000806c380 msgr2=0x7f0008070080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:50:43.526 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:43.535+0000 7f000f800640 1 -- 172.21.15.44:0/1187779678 shutdown_connections 2024-04-17T19:50:43.526 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:43.535+0000 7f000f800640 1 -- 172.21.15.44:0/1187779678 wait complete. 2024-04-17T19:50:43.527 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:43.535+0000 7f000f800640 1 Processor -- start 2024-04-17T19:50:43.527 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:43.535+0000 7f000f800640 1 -- start start 2024-04-17T19:50:43.531 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:43.535+0000 7f000f800640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f00080c47c0 0x7f0008150bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:50:43.531 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:43.535+0000 7f000f800640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f0008152a60 0x7f00081574c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:50:43.531 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:43.535+0000 7f000f800640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0008158eb0 0x7f0008150360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:50:43.531 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:43.535+0000 7f000f800640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f0008158990 con 0x7f00080c47c0 2024-04-17T19:50:43.531 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:43.535+0000 7f000f800640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f00080c90e0 con 0x7f0008158eb0 2024-04-17T19:50:43.531 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:43.535+0000 7f000f800640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7f00080c6e60 con 0x7f0008152a60 2024-04-17T19:50:43.531 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:43.539+0000 7f000ce00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f00080c47c0 0x7f0008150bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:50:43.531 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:43.539+0000 7f000ce00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f00080c47c0 0x7f0008150bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:49106/0 (socket says 172.21.15.44:49106) 2024-04-17T19:50:43.532 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:43.539+0000 7f000ce00640 1 -- 172.21.15.44:0/3775857979 learned_addr learned my addr 172.21.15.44:0/3775857979 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-04-17T19:50:43.532 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:43.539+0000 7f000d800640 1 --2- 172.21.15.44:0/3775857979 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0008158eb0 0x7f0008150360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:50:43.532 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:43.539+0000 7effffe00640 1 --2- 172.21.15.44:0/3775857979 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f0008152a60 0x7f00081574c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:50:43.532 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:43.539+0000 7f000ce00640 1 -- 172.21.15.44:0/3775857979 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f0008152a60 msgr2=0x7f00081574c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:50:43.532 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:43.539+0000 7f000ce00640 1 --2- 172.21.15.44:0/3775857979 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f0008152a60 0x7f00081574c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:50:43.532 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:43.539+0000 7f000ce00640 1 -- 172.21.15.44:0/3775857979 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0008158eb0 msgr2=0x7f0008150360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:50:43.532 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:43.539+0000 7f000ce00640 1 --2- 172.21.15.44:0/3775857979 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0008158eb0 0x7f0008150360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:50:43.532 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:43.539+0000 7f000ce00640 1 -- 172.21.15.44:0/3775857979 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f00081560a0 con 0x7f00080c47c0 2024-04-17T19:50:43.533 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:43.539+0000 7f000ce00640 1 --2- 172.21.15.44:0/3775857979 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f00080c47c0 0x7f0008150bf0 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7efff800e870 tx=0x7efff800ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:50:43.533 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:43.539+0000 7f0005600640 1 -- 172.21.15.44:0/3775857979 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efff8017070 con 0x7f00080c47c0 2024-04-17T19:50:43.533 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:43.539+0000 7f0005600640 1 -- 172.21.15.44:0/3775857979 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efff800c940 con 0x7f00080c47c0 2024-04-17T19:50:43.533 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:43.539+0000 7f000f800640 1 -- 172.21.15.44:0/3775857979 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0008155000 con 0x7f00080c47c0 2024-04-17T19:50:43.533 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:43.539+0000 7f0005600640 1 -- 172.21.15.44:0/3775857979 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efff800ccf0 con 0x7f00080c47c0 2024-04-17T19:50:43.533 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:43.539+0000 7f000f800640 1 -- 172.21.15.44:0/3775857979 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f00081555c0 con 0x7f00080c47c0 2024-04-17T19:50:43.533 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:43.539+0000 7f000f800640 1 -- 172.21.15.44:0/3775857979 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f000804ff10 con 0x7f00080c47c0 2024-04-17T19:50:43.534 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:43.539+0000 7f0005600640 1 -- 172.21.15.44:0/3775857979 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7efff801a070 con 0x7f00080c47c0 2024-04-17T19:50:43.534 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:43.543+0000 7f0005600640 1 --2- 172.21.15.44:0/3775857979 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7effe40683b0 0x7effe406a8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:50:43.534 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:43.543+0000 7f0005600640 1 -- 172.21.15.44:0/3775857979 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6619+0+0 (secure 0 0 0) 0x7efff8087100 con 0x7f00080c47c0 2024-04-17T19:50:43.535 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:43.543+0000 7effffe00640 1 --2- 172.21.15.44:0/3775857979 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7effe40683b0 0x7effe406a8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:50:43.535 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:43.543+0000 7effffe00640 1 --2- 172.21.15.44:0/3775857979 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7effe40683b0 0x7effe406a8c0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7efff00b2000 tx=0x7efff0008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:50:43.537 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:43.547+0000 7f0005600640 1 -- 172.21.15.44:0/3775857979 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7efff8057200 con 0x7f00080c47c0 2024-04-17T19:50:43.700 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:43.707+0000 7f000f800640 1 -- 172.21.15.44:0/3775857979 --> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f00080c7ea0 con 0x7effe40683b0 2024-04-17T19:50:43.725 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:43.735+0000 7f0005600640 1 -- 172.21.15.44:0/3775857979 <== mgr.4102 v2:172.21.15.62:6832/1020159798 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+332791 (secure 0 0 0) 0x7f00080c7ea0 con 0x7effe40683b0 2024-04-17T19:50:43.729 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-04-17T19:50:43.731 INFO:teuthology.orchestra.run.smithi044.stderr:dumped all 2024-04-17T19:50:43.732 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:43.739+0000 7f000f800640 1 -- 172.21.15.44:0/3775857979 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7effe40683b0 msgr2=0x7effe406a8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:50:43.733 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:43.739+0000 7f000f800640 1 --2- 172.21.15.44:0/3775857979 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7effe40683b0 0x7effe406a8c0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7efff00b2000 tx=0x7efff0008040 comp rx=0 tx=0).stop 2024-04-17T19:50:43.733 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:43.739+0000 7f000f800640 1 -- 172.21.15.44:0/3775857979 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f00080c47c0 msgr2=0x7f0008150bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:50:43.733 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:43.739+0000 7f000f800640 1 --2- 172.21.15.44:0/3775857979 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f00080c47c0 0x7f0008150bf0 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7efff800e870 tx=0x7efff800ec70 comp rx=0 tx=0).stop 2024-04-17T19:50:43.733 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:43.739+0000 7f000f800640 1 -- 172.21.15.44:0/3775857979 shutdown_connections 2024-04-17T19:50:43.733 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:43.739+0000 7f000f800640 1 --2- 172.21.15.44:0/3775857979 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7effe40683b0 0x7effe406a8c0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:50:43.733 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:43.739+0000 7f000f800640 1 --2- 172.21.15.44:0/3775857979 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f0008152a60 0x7f00081574c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:50:43.733 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:43.739+0000 7f000f800640 1 --2- 172.21.15.44:0/3775857979 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0008158eb0 0x7f0008150360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:50:43.733 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:43.739+0000 7f000f800640 1 --2- 172.21.15.44:0/3775857979 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f00080c47c0 0x7f0008150bf0 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:50:43.733 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:43.739+0000 7f000f800640 1 -- 172.21.15.44:0/3775857979 >> 172.21.15.44:0/3775857979 conn(0x7f000806c380 msgr2=0x7f0008075110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:50:43.733 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:43.739+0000 7f000f800640 1 -- 172.21.15.44:0/3775857979 shutdown_connections 2024-04-17T19:50:43.733 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:50:43.739+0000 7f000f800640 1 -- 172.21.15.44:0/3775857979 wait complete. 2024-04-17T19:50:43.749 INFO:teuthology.orchestra.run.smithi044.stdout:{"pg_ready":true,"pg_map":{"version":141,"stamp":"2024-04-17T19:50:41.999557+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":635186,"num_objects":101,"num_object_clones":0,"num_object_copies":202,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":101,"num_whiteouts":0,"num_read":118,"num_read_kb":102,"num_write":422,"num_write_kb":2545,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":25000,"num_omap_keys":50,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":945,"ondisk_log_size":945,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":243760,"kb_used_data":2672,"kb_used_omap":12,"kb_used_meta":241011,"kb_avail":754730960,"statfs":{"total":773094113280,"available":772844503040,"internally_reserved":0,"allocated":2736128,"data_stored":2195220,"data_compressed":66496,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":12751,"internal_metadata":246795825},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.006012"},"pg_stats":[{"pgid":"2.1f","version":"27'19","reported_seq":55,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:50:25.674146+0000","last_change":"2024-04-17T19:50:25.674252+0000","last_active":"2024-04-17T19:50:25.674146+0000","last_peered":"2024-04-17T19:50:25.674146+0000","last_clean":"2024-04-17T19:50:25.674146+0000","last_became_active":"2024-04-17T19:46:55.687455+0000","last_became_peered":"2024-04-17T19:46:55.687455+0000","last_unstale":"2024-04-17T19:50:25.674146+0000","last_undegraded":"2024-04-17T19:50:25.674146+0000","last_fullsized":"2024-04-17T19:50:25.674146+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'19","last_scrub_stamp":"2024-04-17T19:50:25.673918+0000","last_deep_scrub":"27'19","last_deep_scrub_stamp":"2024-04-17T19:50:25.673918+0000","last_clean_scrub_stamp":"2024-04-17T19:50:25.673918+0000","objects_scrubbed":6,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:48:23.122011+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"27'5","reported_seq":39,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:50:25.077714+0000","last_change":"2024-04-17T19:50:25.077785+0000","last_active":"2024-04-17T19:50:25.077714+0000","last_peered":"2024-04-17T19:50:25.077714+0000","last_clean":"2024-04-17T19:50:25.077714+0000","last_became_active":"2024-04-17T19:46:56.683111+0000","last_became_peered":"2024-04-17T19:46:56.683111+0000","last_unstale":"2024-04-17T19:50:25.077714+0000","last_undegraded":"2024-04-17T19:50:25.077714+0000","last_fullsized":"2024-04-17T19:50:25.077714+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'5","last_scrub_stamp":"2024-04-17T19:50:25.077491+0000","last_deep_scrub":"27'5","last_deep_scrub_stamp":"2024-04-17T19:50:25.077491+0000","last_clean_scrub_stamp":"2024-04-17T19:50:25.077491+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:56:59.656692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":28,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:50:31.817484+0000","last_change":"2024-04-17T19:50:31.817580+0000","last_active":"2024-04-17T19:50:31.817484+0000","last_peered":"2024-04-17T19:50:31.817484+0000","last_clean":"2024-04-17T19:50:31.817484+0000","last_became_active":"2024-04-17T19:47:00.787654+0000","last_became_peered":"2024-04-17T19:47:00.787654+0000","last_unstale":"2024-04-17T19:50:31.817484+0000","last_undegraded":"2024-04-17T19:50:31.817484+0000","last_fullsized":"2024-04-17T19:50:31.817484+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:50:31.817267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:50:31.817267+0000","last_clean_scrub_stamp":"2024-04-17T19:50:31.817267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T00:50:32.595961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4,1],"acting":[7,6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1e","version":"25'2","reported_seq":38,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:50:26.067802+0000","last_change":"2024-04-17T19:50:26.067872+0000","last_active":"2024-04-17T19:50:26.067802+0000","last_peered":"2024-04-17T19:50:26.067802+0000","last_clean":"2024-04-17T19:50:26.067802+0000","last_became_active":"2024-04-17T19:46:55.695191+0000","last_became_peered":"2024-04-17T19:46:55.695191+0000","last_unstale":"2024-04-17T19:50:26.067802+0000","last_undegraded":"2024-04-17T19:50:26.067802+0000","last_fullsized":"2024-04-17T19:50:26.067802+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'2","last_scrub_stamp":"2024-04-17T19:50:26.067581+0000","last_deep_scrub":"25'2","last_deep_scrub_stamp":"2024-04-17T19:50:26.067581+0000","last_clean_scrub_stamp":"2024-04-17T19:50:26.067581+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:33:02.937785+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1f","version":"27'6","reported_seq":40,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:50:22.045742+0000","last_change":"2024-04-17T19:50:22.045813+0000","last_active":"2024-04-17T19:50:22.045742+0000","last_peered":"2024-04-17T19:50:22.045742+0000","last_clean":"2024-04-17T19:50:22.045742+0000","last_became_active":"2024-04-17T19:46:56.684475+0000","last_became_peered":"2024-04-17T19:46:56.684475+0000","last_unstale":"2024-04-17T19:50:22.045742+0000","last_undegraded":"2024-04-17T19:50:22.045742+0000","last_fullsized":"2024-04-17T19:50:22.045742+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'6","last_scrub_stamp":"2024-04-17T19:50:22.045527+0000","last_deep_scrub":"27'6","last_deep_scrub_stamp":"2024-04-17T19:50:22.045527+0000","last_clean_scrub_stamp":"2024-04-17T19:50:22.045527+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:41:58.854118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":28,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:50:32.377503+0000","last_change":"2024-04-17T19:50:32.377535+0000","last_active":"2024-04-17T19:50:32.377503+0000","last_peered":"2024-04-17T19:50:32.377503+0000","last_clean":"2024-04-17T19:50:32.377503+0000","last_became_active":"2024-04-17T19:47:00.769370+0000","last_became_peered":"2024-04-17T19:47:00.769370+0000","last_unstale":"2024-04-17T19:50:32.377503+0000","last_undegraded":"2024-04-17T19:50:32.377503+0000","last_fullsized":"2024-04-17T19:50:32.377503+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:50:32.377393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:50:32.377393+0000","last_clean_scrub_stamp":"2024-04-17T19:50:32.377393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:40:45.461056+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,4,6],"acting":[2,7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1d","version":"27'20","reported_seq":56,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:50:24.474659+0000","last_change":"2024-04-17T19:50:24.474714+0000","last_active":"2024-04-17T19:50:24.474659+0000","last_peered":"2024-04-17T19:50:24.474659+0000","last_clean":"2024-04-17T19:50:24.474659+0000","last_became_active":"2024-04-17T19:46:55.694285+0000","last_became_peered":"2024-04-17T19:46:55.694285+0000","last_unstale":"2024-04-17T19:50:24.474659+0000","last_undegraded":"2024-04-17T19:50:24.474659+0000","last_fullsized":"2024-04-17T19:50:24.474659+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'20","last_scrub_stamp":"2024-04-17T19:50:24.474541+0000","last_deep_scrub":"27'20","last_deep_scrub_stamp":"2024-04-17T19:50:24.474541+0000","last_clean_scrub_stamp":"2024-04-17T19:50:24.474541+0000","objects_scrubbed":7,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T19:52:16.697549+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"27'9","reported_seq":43,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:50:25.503674+0000","last_change":"2024-04-17T19:50:25.503734+0000","last_active":"2024-04-17T19:50:25.503674+0000","last_peered":"2024-04-17T19:50:25.503674+0000","last_clean":"2024-04-17T19:50:25.503674+0000","last_became_active":"2024-04-17T19:46:56.700413+0000","last_became_peered":"2024-04-17T19:46:56.700413+0000","last_unstale":"2024-04-17T19:50:25.503674+0000","last_undegraded":"2024-04-17T19:50:25.503674+0000","last_fullsized":"2024-04-17T19:50:25.503674+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'9","last_scrub_stamp":"2024-04-17T19:50:25.503554+0000","last_deep_scrub":"27'9","last_deep_scrub_stamp":"2024-04-17T19:50:25.503554+0000","last_clean_scrub_stamp":"2024-04-17T19:50:25.503554+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T00:30:34.681670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":28,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:50:33.334335+0000","last_change":"2024-04-17T19:50:33.334366+0000","last_active":"2024-04-17T19:50:33.334335+0000","last_peered":"2024-04-17T19:50:33.334335+0000","last_clean":"2024-04-17T19:50:33.334335+0000","last_became_active":"2024-04-17T19:47:00.771578+0000","last_became_peered":"2024-04-17T19:47:00.771578+0000","last_unstale":"2024-04-17T19:50:33.334335+0000","last_undegraded":"2024-04-17T19:50:33.334335+0000","last_fullsized":"2024-04-17T19:50:33.334335+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:50:33.334198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:50:33.334198+0000","last_clean_scrub_stamp":"2024-04-17T19:50:33.334198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T22:47:28.581714+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,3,6],"acting":[2,5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1c","version":"27'8","reported_seq":44,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:50:23.428725+0000","last_change":"2024-04-17T19:50:23.428756+0000","last_active":"2024-04-17T19:50:23.428725+0000","last_peered":"2024-04-17T19:50:23.428725+0000","last_clean":"2024-04-17T19:50:23.428725+0000","last_became_active":"2024-04-17T19:46:55.687282+0000","last_became_peered":"2024-04-17T19:46:55.687282+0000","last_unstale":"2024-04-17T19:50:23.428725+0000","last_undegraded":"2024-04-17T19:50:23.428725+0000","last_fullsized":"2024-04-17T19:50:23.428725+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'8","last_scrub_stamp":"2024-04-17T19:50:23.428653+0000","last_deep_scrub":"27'8","last_deep_scrub_stamp":"2024-04-17T19:50:23.428653+0000","last_clean_scrub_stamp":"2024-04-17T19:50:23.428653+0000","objects_scrubbed":3,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T05:45:27.897107+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"27'15","reported_seq":49,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:50:22.772083+0000","last_change":"2024-04-17T19:50:22.772128+0000","last_active":"2024-04-17T19:50:22.772083+0000","last_peered":"2024-04-17T19:50:22.772083+0000","last_clean":"2024-04-17T19:50:22.772083+0000","last_became_active":"2024-04-17T19:46:56.689988+0000","last_became_peered":"2024-04-17T19:46:56.689988+0000","last_unstale":"2024-04-17T19:50:22.772083+0000","last_undegraded":"2024-04-17T19:50:22.772083+0000","last_fullsized":"2024-04-17T19:50:22.772083+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'15","last_scrub_stamp":"2024-04-17T19:50:22.771978+0000","last_deep_scrub":"27'15","last_deep_scrub_stamp":"2024-04-17T19:50:22.771978+0000","last_clean_scrub_stamp":"2024-04-17T19:50:22.771978+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T01:42:51.824142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":28,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:50:29.382459+0000","last_change":"2024-04-17T19:50:29.382488+0000","last_active":"2024-04-17T19:50:29.382459+0000","last_peered":"2024-04-17T19:50:29.382459+0000","last_clean":"2024-04-17T19:50:29.382459+0000","last_became_active":"2024-04-17T19:47:00.759059+0000","last_became_peered":"2024-04-17T19:47:00.759059+0000","last_unstale":"2024-04-17T19:50:29.382459+0000","last_undegraded":"2024-04-17T19:50:29.382459+0000","last_fullsized":"2024-04-17T19:50:29.382459+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:50:29.382356+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:50:29.382356+0000","last_clean_scrub_stamp":"2024-04-17T19:50:29.382356+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T07:09:07.213461+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,5,7],"acting":[2,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"27'5","reported_seq":39,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:50:20.786568+0000","last_change":"2024-04-17T19:50:20.786610+0000","last_active":"2024-04-17T19:50:20.786568+0000","last_peered":"2024-04-17T19:50:20.786568+0000","last_clean":"2024-04-17T19:50:20.786568+0000","last_became_active":"2024-04-17T19:46:56.687662+0000","last_became_peered":"2024-04-17T19:46:56.687662+0000","last_unstale":"2024-04-17T19:50:20.786568+0000","last_undegraded":"2024-04-17T19:50:20.786568+0000","last_fullsized":"2024-04-17T19:50:20.786568+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'5","last_scrub_stamp":"2024-04-17T19:50:20.786436+0000","last_deep_scrub":"27'5","last_deep_scrub_stamp":"2024-04-17T19:50:20.786436+0000","last_clean_scrub_stamp":"2024-04-17T19:50:20.786436+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T00:49:16.372826+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"27'7","reported_seq":43,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:50:36.739095+0000","last_change":"2024-04-17T19:50:36.739135+0000","last_active":"2024-04-17T19:50:36.739095+0000","last_peered":"2024-04-17T19:50:36.739095+0000","last_clean":"2024-04-17T19:50:36.739095+0000","last_became_active":"2024-04-17T19:46:55.689006+0000","last_became_peered":"2024-04-17T19:46:55.689006+0000","last_unstale":"2024-04-17T19:50:36.739095+0000","last_undegraded":"2024-04-17T19:50:36.739095+0000","last_fullsized":"2024-04-17T19:50:36.739095+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'7","last_scrub_stamp":"2024-04-17T19:50:36.738995+0000","last_deep_scrub":"27'7","last_deep_scrub_stamp":"2024-04-17T19:50:36.738995+0000","last_clean_scrub_stamp":"2024-04-17T19:50:36.738995+0000","objects_scrubbed":2,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:56:15.474748+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:49:17.984189+0000","last_change":"2024-04-17T19:47:00.757063+0000","last_active":"2024-04-17T19:49:17.984189+0000","last_peered":"2024-04-17T19:49:17.984189+0000","last_clean":"2024-04-17T19:49:17.984189+0000","last_became_active":"2024-04-17T19:47:00.756456+0000","last_became_peered":"2024-04-17T19:47:00.756456+0000","last_unstale":"2024-04-17T19:49:17.984189+0000","last_undegraded":"2024-04-17T19:49:17.984189+0000","last_fullsized":"2024-04-17T19:49:17.984189+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_clean_scrub_stamp":"2024-04-17T19:46:59.695482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,5],"acting":[3,1,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.b","version":"27'8","reported_seq":42,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:50:27.759803+0000","last_change":"2024-04-17T19:50:27.759870+0000","last_active":"2024-04-17T19:50:27.759803+0000","last_peered":"2024-04-17T19:50:27.759803+0000","last_clean":"2024-04-17T19:50:27.759803+0000","last_became_active":"2024-04-17T19:46:56.690828+0000","last_became_peered":"2024-04-17T19:46:56.690828+0000","last_unstale":"2024-04-17T19:50:27.759803+0000","last_undegraded":"2024-04-17T19:50:27.759803+0000","last_fullsized":"2024-04-17T19:50:27.759803+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'8","last_scrub_stamp":"2024-04-17T19:50:27.759602+0000","last_deep_scrub":"27'8","last_deep_scrub_stamp":"2024-04-17T19:50:27.759602+0000","last_clean_scrub_stamp":"2024-04-17T19:50:27.759602+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T02:48:21.958835+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.a","version":"27'6","reported_seq":42,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:50:24.665544+0000","last_change":"2024-04-17T19:50:24.665622+0000","last_active":"2024-04-17T19:50:24.665544+0000","last_peered":"2024-04-17T19:50:24.665544+0000","last_clean":"2024-04-17T19:50:24.665544+0000","last_became_active":"2024-04-17T19:46:55.715197+0000","last_became_peered":"2024-04-17T19:46:55.715197+0000","last_unstale":"2024-04-17T19:50:24.665544+0000","last_undegraded":"2024-04-17T19:50:24.665544+0000","last_fullsized":"2024-04-17T19:50:24.665544+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'6","last_scrub_stamp":"2024-04-17T19:50:24.665343+0000","last_deep_scrub":"27'6","last_deep_scrub_stamp":"2024-04-17T19:50:24.665343+0000","last_clean_scrub_stamp":"2024-04-17T19:50:24.665343+0000","objects_scrubbed":2,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T02:12:14.591521+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":28,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:50:34.478767+0000","last_change":"2024-04-17T19:50:34.478794+0000","last_active":"2024-04-17T19:50:34.478767+0000","last_peered":"2024-04-17T19:50:34.478767+0000","last_clean":"2024-04-17T19:50:34.478767+0000","last_became_active":"2024-04-17T19:47:00.773077+0000","last_became_peered":"2024-04-17T19:47:00.773077+0000","last_unstale":"2024-04-17T19:50:34.478767+0000","last_undegraded":"2024-04-17T19:50:34.478767+0000","last_fullsized":"2024-04-17T19:50:34.478767+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:50:34.478667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:50:34.478667+0000","last_clean_scrub_stamp":"2024-04-17T19:50:34.478667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:16:03.516500+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,6,1],"acting":[0,4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"27'9","reported_seq":43,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:50:31.639003+0000","last_change":"2024-04-17T19:50:31.639082+0000","last_active":"2024-04-17T19:50:31.639003+0000","last_peered":"2024-04-17T19:50:31.639003+0000","last_clean":"2024-04-17T19:50:31.639003+0000","last_became_active":"2024-04-17T19:46:56.695205+0000","last_became_peered":"2024-04-17T19:46:56.695205+0000","last_unstale":"2024-04-17T19:50:31.639003+0000","last_undegraded":"2024-04-17T19:50:31.639003+0000","last_fullsized":"2024-04-17T19:50:31.639003+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'9","last_scrub_stamp":"2024-04-17T19:50:31.638798+0000","last_deep_scrub":"27'9","last_deep_scrub_stamp":"2024-04-17T19:50:31.638798+0000","last_clean_scrub_stamp":"2024-04-17T19:50:31.638798+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T05:39:52.201151+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"27'11","reported_seq":47,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:50:24.662762+0000","last_change":"2024-04-17T19:50:24.662848+0000","last_active":"2024-04-17T19:50:24.662762+0000","last_peered":"2024-04-17T19:50:24.662762+0000","last_clean":"2024-04-17T19:50:24.662762+0000","last_became_active":"2024-04-17T19:46:55.684782+0000","last_became_peered":"2024-04-17T19:46:55.684782+0000","last_unstale":"2024-04-17T19:50:24.662762+0000","last_undegraded":"2024-04-17T19:50:24.662762+0000","last_fullsized":"2024-04-17T19:50:24.662762+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'11","last_scrub_stamp":"2024-04-17T19:50:24.662572+0000","last_deep_scrub":"27'11","last_deep_scrub_stamp":"2024-04-17T19:50:24.662572+0000","last_clean_scrub_stamp":"2024-04-17T19:50:24.662572+0000","objects_scrubbed":4,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:33:22.082901+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:50:35.472812+0000","last_change":"2024-04-17T19:50:35.472840+0000","last_active":"2024-04-17T19:50:35.472812+0000","last_peered":"2024-04-17T19:50:35.472812+0000","last_clean":"2024-04-17T19:50:35.472812+0000","last_became_active":"2024-04-17T19:47:38.474208+0000","last_became_peered":"2024-04-17T19:47:38.474208+0000","last_unstale":"2024-04-17T19:50:35.472812+0000","last_undegraded":"2024-04-17T19:50:35.472812+0000","last_fullsized":"2024-04-17T19:50:35.472812+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:50:35.472688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:50:35.472688+0000","last_clean_scrub_stamp":"2024-04-17T19:50:35.472688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T05:36:30.126180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2,3],"acting":[0,4,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"27'2","reported_seq":28,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:50:15.404805+0000","last_change":"2024-04-17T19:46:56.700069+0000","last_active":"2024-04-17T19:50:15.404805+0000","last_peered":"2024-04-17T19:50:15.404805+0000","last_clean":"2024-04-17T19:50:15.404805+0000","last_became_active":"2024-04-17T19:46:56.699525+0000","last_became_peered":"2024-04-17T19:46:56.699525+0000","last_unstale":"2024-04-17T19:50:15.404805+0000","last_undegraded":"2024-04-17T19:50:15.404805+0000","last_fullsized":"2024-04-17T19:50:15.404805+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_clean_scrub_stamp":"2024-04-17T19:46:55.648649+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.8","version":"27'3","reported_seq":39,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:50:21.497956+0000","last_change":"2024-04-17T19:50:21.497983+0000","last_active":"2024-04-17T19:50:21.497956+0000","last_peered":"2024-04-17T19:50:21.497956+0000","last_clean":"2024-04-17T19:50:21.497956+0000","last_became_active":"2024-04-17T19:46:55.683145+0000","last_became_peered":"2024-04-17T19:46:55.683145+0000","last_unstale":"2024-04-17T19:50:21.497956+0000","last_undegraded":"2024-04-17T19:50:21.497956+0000","last_fullsized":"2024-04-17T19:50:21.497956+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'3","last_scrub_stamp":"2024-04-17T19:50:21.497879+0000","last_deep_scrub":"27'3","last_deep_scrub_stamp":"2024-04-17T19:50:21.497879+0000","last_clean_scrub_stamp":"2024-04-17T19:50:21.497879+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T04:32:34.992896+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":28,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:50:31.333368+0000","last_change":"2024-04-17T19:50:31.333397+0000","last_active":"2024-04-17T19:50:31.333368+0000","last_peered":"2024-04-17T19:50:31.333368+0000","last_clean":"2024-04-17T19:50:31.333368+0000","last_became_active":"2024-04-17T19:47:00.768277+0000","last_became_peered":"2024-04-17T19:47:00.768277+0000","last_unstale":"2024-04-17T19:50:31.333368+0000","last_undegraded":"2024-04-17T19:50:31.333368+0000","last_fullsized":"2024-04-17T19:50:31.333368+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:50:31.333237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:50:31.333237+0000","last_clean_scrub_stamp":"2024-04-17T19:50:31.333237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T07:00:35.238805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,7],"acting":[2,1,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"27'7","reported_seq":41,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:50:21.554760+0000","last_change":"2024-04-17T19:50:21.554944+0000","last_active":"2024-04-17T19:50:21.554760+0000","last_peered":"2024-04-17T19:50:21.554760+0000","last_clean":"2024-04-17T19:50:21.554760+0000","last_became_active":"2024-04-17T19:46:56.694993+0000","last_became_peered":"2024-04-17T19:46:56.694993+0000","last_unstale":"2024-04-17T19:50:21.554760+0000","last_undegraded":"2024-04-17T19:50:21.554760+0000","last_fullsized":"2024-04-17T19:50:21.554760+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'7","last_scrub_stamp":"2024-04-17T19:50:21.554509+0000","last_deep_scrub":"27'7","last_deep_scrub_stamp":"2024-04-17T19:50:21.554509+0000","last_clean_scrub_stamp":"2024-04-17T19:50:21.554509+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:06:11.860900+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"27'12","reported_seq":48,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:50:32.782762+0000","last_change":"2024-04-17T19:50:32.782802+0000","last_active":"2024-04-17T19:50:32.782762+0000","last_peered":"2024-04-17T19:50:32.782762+0000","last_clean":"2024-04-17T19:50:32.782762+0000","last_became_active":"2024-04-17T19:46:55.688507+0000","last_became_peered":"2024-04-17T19:46:55.688507+0000","last_unstale":"2024-04-17T19:50:32.782762+0000","last_undegraded":"2024-04-17T19:50:32.782762+0000","last_fullsized":"2024-04-17T19:50:32.782762+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'12","last_scrub_stamp":"2024-04-17T19:50:32.782655+0000","last_deep_scrub":"27'12","last_deep_scrub_stamp":"2024-04-17T19:50:32.782655+0000","last_clean_scrub_stamp":"2024-04-17T19:50:32.782655+0000","objects_scrubbed":4,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:09:39.177854+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":28,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:50:34.285998+0000","last_change":"2024-04-17T19:50:34.286026+0000","last_active":"2024-04-17T19:50:34.285998+0000","last_peered":"2024-04-17T19:50:34.285998+0000","last_clean":"2024-04-17T19:50:34.285998+0000","last_became_active":"2024-04-17T19:47:00.780994+0000","last_became_peered":"2024-04-17T19:47:00.780994+0000","last_unstale":"2024-04-17T19:50:34.285998+0000","last_undegraded":"2024-04-17T19:50:34.285998+0000","last_fullsized":"2024-04-17T19:50:34.285998+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:50:34.285902+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:50:34.285902+0000","last_clean_scrub_stamp":"2024-04-17T19:50:34.285902+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T05:06:23.545222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,3,1],"acting":[2,6,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"27'5","reported_seq":39,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:50:32.589394+0000","last_change":"2024-04-17T19:50:32.589465+0000","last_active":"2024-04-17T19:50:32.589394+0000","last_peered":"2024-04-17T19:50:32.589394+0000","last_clean":"2024-04-17T19:50:32.589394+0000","last_became_active":"2024-04-17T19:46:56.694650+0000","last_became_peered":"2024-04-17T19:46:56.694650+0000","last_unstale":"2024-04-17T19:50:32.589394+0000","last_undegraded":"2024-04-17T19:50:32.589394+0000","last_fullsized":"2024-04-17T19:50:32.589394+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'5","last_scrub_stamp":"2024-04-17T19:50:32.589185+0000","last_deep_scrub":"27'5","last_deep_scrub_stamp":"2024-04-17T19:50:32.589185+0000","last_clean_scrub_stamp":"2024-04-17T19:50:32.589185+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T01:48:52.524238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"27'21","reported_seq":57,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:50:23.625398+0000","last_change":"2024-04-17T19:50:23.625491+0000","last_active":"2024-04-17T19:50:23.625398+0000","last_peered":"2024-04-17T19:50:23.625398+0000","last_clean":"2024-04-17T19:50:23.625398+0000","last_became_active":"2024-04-17T19:46:55.680100+0000","last_became_peered":"2024-04-17T19:46:55.680100+0000","last_unstale":"2024-04-17T19:50:23.625398+0000","last_undegraded":"2024-04-17T19:50:23.625398+0000","last_fullsized":"2024-04-17T19:50:23.625398+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'21","last_scrub_stamp":"2024-04-17T19:50:23.625167+0000","last_deep_scrub":"27'21","last_deep_scrub_stamp":"2024-04-17T19:50:23.625167+0000","last_clean_scrub_stamp":"2024-04-17T19:50:23.625167+0000","objects_scrubbed":4,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:30:38.893156+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":33,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":28,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:50:37.569952+0000","last_change":"2024-04-17T19:50:37.570023+0000","last_active":"2024-04-17T19:50:37.569952+0000","last_peered":"2024-04-17T19:50:37.569952+0000","last_clean":"2024-04-17T19:50:37.569952+0000","last_became_active":"2024-04-17T19:47:00.776873+0000","last_became_peered":"2024-04-17T19:47:00.776873+0000","last_unstale":"2024-04-17T19:50:37.569952+0000","last_undegraded":"2024-04-17T19:50:37.569952+0000","last_fullsized":"2024-04-17T19:50:37.569952+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:50:37.569740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:50:37.569740+0000","last_clean_scrub_stamp":"2024-04-17T19:50:37.569740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T22:21:40.926579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,6,3],"acting":[4,1,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.4","version":"27'9","reported_seq":43,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:50:25.703665+0000","last_change":"2024-04-17T19:50:25.703733+0000","last_active":"2024-04-17T19:50:25.703665+0000","last_peered":"2024-04-17T19:50:25.703665+0000","last_clean":"2024-04-17T19:50:25.703665+0000","last_became_active":"2024-04-17T19:46:56.681316+0000","last_became_peered":"2024-04-17T19:46:56.681316+0000","last_unstale":"2024-04-17T19:50:25.703665+0000","last_undegraded":"2024-04-17T19:50:25.703665+0000","last_fullsized":"2024-04-17T19:50:25.703665+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'9","last_scrub_stamp":"2024-04-17T19:50:25.703455+0000","last_deep_scrub":"27'9","last_deep_scrub_stamp":"2024-04-17T19:50:25.703455+0000","last_clean_scrub_stamp":"2024-04-17T19:50:25.703455+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T04:32:39.198472+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"27'7","reported_seq":43,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:50:35.721097+0000","last_change":"2024-04-17T19:50:35.721130+0000","last_active":"2024-04-17T19:50:35.721097+0000","last_peered":"2024-04-17T19:50:35.721097+0000","last_clean":"2024-04-17T19:50:35.721097+0000","last_became_active":"2024-04-17T19:46:55.691031+0000","last_became_peered":"2024-04-17T19:46:55.691031+0000","last_unstale":"2024-04-17T19:50:35.721097+0000","last_undegraded":"2024-04-17T19:50:35.721097+0000","last_fullsized":"2024-04-17T19:50:35.721097+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'7","last_scrub_stamp":"2024-04-17T19:50:35.720991+0000","last_deep_scrub":"27'7","last_deep_scrub_stamp":"2024-04-17T19:50:35.720991+0000","last_clean_scrub_stamp":"2024-04-17T19:50:35.720991+0000","objects_scrubbed":3,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:03:06.622831+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":28,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:50:34.805894+0000","last_change":"2024-04-17T19:50:34.805964+0000","last_active":"2024-04-17T19:50:34.805894+0000","last_peered":"2024-04-17T19:50:34.805894+0000","last_clean":"2024-04-17T19:50:34.805894+0000","last_became_active":"2024-04-17T19:47:00.771531+0000","last_became_peered":"2024-04-17T19:47:00.771531+0000","last_unstale":"2024-04-17T19:50:34.805894+0000","last_undegraded":"2024-04-17T19:50:34.805894+0000","last_fullsized":"2024-04-17T19:50:34.805894+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:50:34.805674+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:50:34.805674+0000","last_clean_scrub_stamp":"2024-04-17T19:50:34.805674+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T05:01:39.473317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,2,7],"acting":[6,0,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"27'5","reported_seq":39,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:50:21.446685+0000","last_change":"2024-04-17T19:50:21.446713+0000","last_active":"2024-04-17T19:50:21.446685+0000","last_peered":"2024-04-17T19:50:21.446685+0000","last_clean":"2024-04-17T19:50:21.446685+0000","last_became_active":"2024-04-17T19:46:56.691801+0000","last_became_peered":"2024-04-17T19:46:56.691801+0000","last_unstale":"2024-04-17T19:50:21.446685+0000","last_undegraded":"2024-04-17T19:50:21.446685+0000","last_fullsized":"2024-04-17T19:50:21.446685+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'5","last_scrub_stamp":"2024-04-17T19:50:21.446598+0000","last_deep_scrub":"27'5","last_deep_scrub_stamp":"2024-04-17T19:50:21.446598+0000","last_clean_scrub_stamp":"2024-04-17T19:50:21.446598+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T05:57:05.310736+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"25'1","reported_seq":37,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:50:28.046983+0000","last_change":"2024-04-17T19:50:28.047055+0000","last_active":"2024-04-17T19:50:28.046983+0000","last_peered":"2024-04-17T19:50:28.046983+0000","last_clean":"2024-04-17T19:50:28.046983+0000","last_became_active":"2024-04-17T19:46:55.712908+0000","last_became_peered":"2024-04-17T19:46:55.712908+0000","last_unstale":"2024-04-17T19:50:28.046983+0000","last_undegraded":"2024-04-17T19:50:28.046983+0000","last_fullsized":"2024-04-17T19:50:28.046983+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'1","last_scrub_stamp":"2024-04-17T19:50:28.046766+0000","last_deep_scrub":"25'1","last_deep_scrub_stamp":"2024-04-17T19:50:28.046766+0000","last_clean_scrub_stamp":"2024-04-17T19:50:28.046766+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:57:01.778821+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":28,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:50:33.762256+0000","last_change":"2024-04-17T19:50:33.762336+0000","last_active":"2024-04-17T19:50:33.762256+0000","last_peered":"2024-04-17T19:50:33.762256+0000","last_clean":"2024-04-17T19:50:33.762256+0000","last_became_active":"2024-04-17T19:47:00.771385+0000","last_became_peered":"2024-04-17T19:47:00.771385+0000","last_unstale":"2024-04-17T19:50:33.762256+0000","last_undegraded":"2024-04-17T19:50:33.762256+0000","last_fullsized":"2024-04-17T19:50:33.762256+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:50:33.762005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:50:33.762005+0000","last_clean_scrub_stamp":"2024-04-17T19:50:33.762005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:43:41.595918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5,7],"acting":[6,3,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3","version":"27'7","reported_seq":41,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:50:32.510113+0000","last_change":"2024-04-17T19:50:32.510155+0000","last_active":"2024-04-17T19:50:32.510113+0000","last_peered":"2024-04-17T19:50:32.510113+0000","last_clean":"2024-04-17T19:50:32.510113+0000","last_became_active":"2024-04-17T19:46:56.708572+0000","last_became_peered":"2024-04-17T19:46:56.708572+0000","last_unstale":"2024-04-17T19:50:32.510113+0000","last_undegraded":"2024-04-17T19:50:32.510113+0000","last_fullsized":"2024-04-17T19:50:32.510113+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'7","last_scrub_stamp":"2024-04-17T19:50:32.510018+0000","last_deep_scrub":"27'7","last_deep_scrub_stamp":"2024-04-17T19:50:32.510018+0000","last_clean_scrub_stamp":"2024-04-17T19:50:32.510018+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T05:06:21.769339+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"27'7","reported_seq":43,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:50:37.704622+0000","last_change":"2024-04-17T19:50:37.704663+0000","last_active":"2024-04-17T19:50:37.704622+0000","last_peered":"2024-04-17T19:50:37.704622+0000","last_clean":"2024-04-17T19:50:37.704622+0000","last_became_active":"2024-04-17T19:46:55.708175+0000","last_became_peered":"2024-04-17T19:46:55.708175+0000","last_unstale":"2024-04-17T19:50:37.704622+0000","last_undegraded":"2024-04-17T19:50:37.704622+0000","last_fullsized":"2024-04-17T19:50:37.704622+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'7","last_scrub_stamp":"2024-04-17T19:50:37.704516+0000","last_deep_scrub":"27'7","last_deep_scrub_stamp":"2024-04-17T19:50:37.704516+0000","last_clean_scrub_stamp":"2024-04-17T19:50:37.704516+0000","objects_scrubbed":2,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:47:01.135691+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":28,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:50:36.794323+0000","last_change":"2024-04-17T19:50:36.794398+0000","last_active":"2024-04-17T19:50:36.794323+0000","last_peered":"2024-04-17T19:50:36.794323+0000","last_clean":"2024-04-17T19:50:36.794323+0000","last_became_active":"2024-04-17T19:47:00.780743+0000","last_became_peered":"2024-04-17T19:47:00.780743+0000","last_unstale":"2024-04-17T19:50:36.794323+0000","last_undegraded":"2024-04-17T19:50:36.794323+0000","last_fullsized":"2024-04-17T19:50:36.794323+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:50:36.794052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:50:36.794052+0000","last_clean_scrub_stamp":"2024-04-17T19:50:36.794052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T04:27:43.398961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0,3],"acting":[6,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"27'8","reported_seq":42,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:50:32.157710+0000","last_change":"2024-04-17T19:50:32.157790+0000","last_active":"2024-04-17T19:50:32.157710+0000","last_peered":"2024-04-17T19:50:32.157710+0000","last_clean":"2024-04-17T19:50:32.157710+0000","last_became_active":"2024-04-17T19:46:56.679230+0000","last_became_peered":"2024-04-17T19:46:56.679230+0000","last_unstale":"2024-04-17T19:50:32.157710+0000","last_undegraded":"2024-04-17T19:50:32.157710+0000","last_fullsized":"2024-04-17T19:50:32.157710+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'8","last_scrub_stamp":"2024-04-17T19:50:32.157487+0000","last_deep_scrub":"27'8","last_deep_scrub_stamp":"2024-04-17T19:50:32.157487+0000","last_clean_scrub_stamp":"2024-04-17T19:50:32.157487+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:39:55.835904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"27'12","reported_seq":50,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:50:25.731452+0000","last_change":"2024-04-17T19:50:25.731536+0000","last_active":"2024-04-17T19:50:25.731452+0000","last_peered":"2024-04-17T19:50:25.731452+0000","last_clean":"2024-04-17T19:50:25.731452+0000","last_became_active":"2024-04-17T19:46:55.715247+0000","last_became_peered":"2024-04-17T19:46:55.715247+0000","last_unstale":"2024-04-17T19:50:25.731452+0000","last_undegraded":"2024-04-17T19:50:25.731452+0000","last_fullsized":"2024-04-17T19:50:25.731452+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'12","last_scrub_stamp":"2024-04-17T19:50:25.731248+0000","last_deep_scrub":"27'12","last_deep_scrub_stamp":"2024-04-17T19:50:25.731248+0000","last_clean_scrub_stamp":"2024-04-17T19:50:25.731248+0000","objects_scrubbed":4,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T01:44:01.234209+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":524,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":28,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:50:32.770110+0000","last_change":"2024-04-17T19:50:32.770180+0000","last_active":"2024-04-17T19:50:32.770110+0000","last_peered":"2024-04-17T19:50:32.770110+0000","last_clean":"2024-04-17T19:50:32.770110+0000","last_became_active":"2024-04-17T19:47:00.768634+0000","last_became_peered":"2024-04-17T19:47:00.768634+0000","last_unstale":"2024-04-17T19:50:32.770110+0000","last_undegraded":"2024-04-17T19:50:32.770110+0000","last_fullsized":"2024-04-17T19:50:32.770110+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:50:32.769839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:50:32.769839+0000","last_clean_scrub_stamp":"2024-04-17T19:50:32.769839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T07:00:36.675406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,7],"acting":[6,0,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"27'5","reported_seq":39,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:50:31.777025+0000","last_change":"2024-04-17T19:50:31.777097+0000","last_active":"2024-04-17T19:50:31.777025+0000","last_peered":"2024-04-17T19:50:31.777025+0000","last_clean":"2024-04-17T19:50:31.777025+0000","last_became_active":"2024-04-17T19:46:56.703148+0000","last_became_peered":"2024-04-17T19:46:56.703148+0000","last_unstale":"2024-04-17T19:50:31.777025+0000","last_undegraded":"2024-04-17T19:50:31.777025+0000","last_fullsized":"2024-04-17T19:50:31.777025+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'5","last_scrub_stamp":"2024-04-17T19:50:31.776815+0000","last_deep_scrub":"27'5","last_deep_scrub_stamp":"2024-04-17T19:50:31.776815+0000","last_clean_scrub_stamp":"2024-04-17T19:50:31.776815+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:50:03.584176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"27'5","reported_seq":41,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:50:29.756218+0000","last_change":"2024-04-17T19:50:29.756294+0000","last_active":"2024-04-17T19:50:29.756218+0000","last_peered":"2024-04-17T19:50:29.756218+0000","last_clean":"2024-04-17T19:50:29.756218+0000","last_became_active":"2024-04-17T19:46:55.715527+0000","last_became_peered":"2024-04-17T19:46:55.715527+0000","last_unstale":"2024-04-17T19:50:29.756218+0000","last_undegraded":"2024-04-17T19:50:29.756218+0000","last_fullsized":"2024-04-17T19:50:29.756218+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'5","last_scrub_stamp":"2024-04-17T19:50:29.756106+0000","last_deep_scrub":"27'5","last_deep_scrub_stamp":"2024-04-17T19:50:29.756106+0000","last_clean_scrub_stamp":"2024-04-17T19:50:29.756106+0000","objects_scrubbed":1,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T04:41:30.743957+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:49:09.989221+0000","last_change":"2024-04-17T19:47:00.784031+0000","last_active":"2024-04-17T19:49:09.989221+0000","last_peered":"2024-04-17T19:49:09.989221+0000","last_clean":"2024-04-17T19:49:09.989221+0000","last_became_active":"2024-04-17T19:47:00.783386+0000","last_became_peered":"2024-04-17T19:47:00.783386+0000","last_unstale":"2024-04-17T19:49:09.989221+0000","last_undegraded":"2024-04-17T19:49:09.989221+0000","last_fullsized":"2024-04-17T19:49:09.989221+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_clean_scrub_stamp":"2024-04-17T19:46:59.695482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6,1],"acting":[5,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"27'8","reported_seq":42,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:50:30.676084+0000","last_change":"2024-04-17T19:50:30.676178+0000","last_active":"2024-04-17T19:50:30.676084+0000","last_peered":"2024-04-17T19:50:30.676084+0000","last_clean":"2024-04-17T19:50:30.676084+0000","last_became_active":"2024-04-17T19:46:56.691917+0000","last_became_peered":"2024-04-17T19:46:56.691917+0000","last_unstale":"2024-04-17T19:50:30.676084+0000","last_undegraded":"2024-04-17T19:50:30.676084+0000","last_fullsized":"2024-04-17T19:50:30.676084+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'8","last_scrub_stamp":"2024-04-17T19:50:30.675815+0000","last_deep_scrub":"27'8","last_deep_scrub_stamp":"2024-04-17T19:50:30.675815+0000","last_clean_scrub_stamp":"2024-04-17T19:50:30.675815+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:57:04.407869+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.3","version":"27'11","reported_seq":47,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:50:30.788818+0000","last_change":"2024-04-17T19:50:30.788859+0000","last_active":"2024-04-17T19:50:30.788818+0000","last_peered":"2024-04-17T19:50:30.788818+0000","last_clean":"2024-04-17T19:50:30.788818+0000","last_became_active":"2024-04-17T19:46:55.685599+0000","last_became_peered":"2024-04-17T19:46:55.685599+0000","last_unstale":"2024-04-17T19:50:30.788818+0000","last_undegraded":"2024-04-17T19:50:30.788818+0000","last_fullsized":"2024-04-17T19:50:30.788818+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'11","last_scrub_stamp":"2024-04-17T19:50:30.788727+0000","last_deep_scrub":"27'11","last_deep_scrub_stamp":"2024-04-17T19:50:30.788727+0000","last_clean_scrub_stamp":"2024-04-17T19:50:30.788727+0000","objects_scrubbed":5,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:14:16.711052+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"27'119","reported_seq":194,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:50:19.569353+0000","last_change":"2024-04-17T19:50:19.569421+0000","last_active":"2024-04-17T19:50:19.569353+0000","last_peered":"2024-04-17T19:50:19.569353+0000","last_clean":"2024-04-17T19:50:19.569353+0000","last_became_active":"2024-04-17T19:46:43.000652+0000","last_became_peered":"2024-04-17T19:46:43.000652+0000","last_unstale":"2024-04-17T19:50:19.569353+0000","last_undegraded":"2024-04-17T19:50:19.569353+0000","last_fullsized":"2024-04-17T19:50:19.569353+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'119","last_scrub_stamp":"2024-04-17T19:50:19.569239+0000","last_deep_scrub":"27'119","last_deep_scrub_stamp":"2024-04-17T19:50:19.569239+0000","last_clean_scrub_stamp":"2024-04-17T19:50:19.569239+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:07:38.005068+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:49:07.983011+0000","last_change":"2024-04-17T19:47:00.731680+0000","last_active":"2024-04-17T19:49:07.983011+0000","last_peered":"2024-04-17T19:49:07.983011+0000","last_clean":"2024-04-17T19:49:07.983011+0000","last_became_active":"2024-04-17T19:47:00.731093+0000","last_became_peered":"2024-04-17T19:47:00.731093+0000","last_unstale":"2024-04-17T19:49:07.983011+0000","last_undegraded":"2024-04-17T19:49:07.983011+0000","last_fullsized":"2024-04-17T19:49:07.983011+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_clean_scrub_stamp":"2024-04-17T19:46:59.695482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.d","version":"27'7","reported_seq":41,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:50:24.769041+0000","last_change":"2024-04-17T19:50:24.769113+0000","last_active":"2024-04-17T19:50:24.769041+0000","last_peered":"2024-04-17T19:50:24.769041+0000","last_clean":"2024-04-17T19:50:24.769041+0000","last_became_active":"2024-04-17T19:46:56.692106+0000","last_became_peered":"2024-04-17T19:46:56.692106+0000","last_unstale":"2024-04-17T19:50:24.769041+0000","last_undegraded":"2024-04-17T19:50:24.769041+0000","last_fullsized":"2024-04-17T19:50:24.769041+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'7","last_scrub_stamp":"2024-04-17T19:50:24.768931+0000","last_deep_scrub":"27'7","last_deep_scrub_stamp":"2024-04-17T19:50:24.768931+0000","last_clean_scrub_stamp":"2024-04-17T19:50:24.768931+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T05:01:29.436574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.c","version":"27'9","reported_seq":45,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:50:22.657409+0000","last_change":"2024-04-17T19:50:22.657492+0000","last_active":"2024-04-17T19:50:22.657409+0000","last_peered":"2024-04-17T19:50:22.657409+0000","last_clean":"2024-04-17T19:50:22.657409+0000","last_became_active":"2024-04-17T19:46:55.689059+0000","last_became_peered":"2024-04-17T19:46:55.689059+0000","last_unstale":"2024-04-17T19:50:22.657409+0000","last_undegraded":"2024-04-17T19:50:22.657409+0000","last_fullsized":"2024-04-17T19:50:22.657409+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'9","last_scrub_stamp":"2024-04-17T19:50:22.657189+0000","last_deep_scrub":"27'9","last_deep_scrub_stamp":"2024-04-17T19:50:22.657189+0000","last_clean_scrub_stamp":"2024-04-17T19:50:22.657189+0000","objects_scrubbed":3,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T19:55:07.248866+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1569,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":28,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:50:30.372979+0000","last_change":"2024-04-17T19:50:30.373007+0000","last_active":"2024-04-17T19:50:30.372979+0000","last_peered":"2024-04-17T19:50:30.372979+0000","last_clean":"2024-04-17T19:50:30.372979+0000","last_became_active":"2024-04-17T19:47:00.759946+0000","last_became_peered":"2024-04-17T19:47:00.759946+0000","last_unstale":"2024-04-17T19:50:30.372979+0000","last_undegraded":"2024-04-17T19:50:30.372979+0000","last_fullsized":"2024-04-17T19:50:30.372979+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:50:30.372876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:50:30.372876+0000","last_clean_scrub_stamp":"2024-04-17T19:50:30.372876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T02:10:27.930543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,7,4],"acting":[2,3,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"27'6","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:50:38.567840+0000","last_change":"2024-04-17T19:50:38.567981+0000","last_active":"2024-04-17T19:50:38.567840+0000","last_peered":"2024-04-17T19:50:38.567840+0000","last_clean":"2024-04-17T19:50:38.567840+0000","last_became_active":"2024-04-17T19:47:37.967613+0000","last_became_peered":"2024-04-17T19:47:37.967613+0000","last_unstale":"2024-04-17T19:50:38.567840+0000","last_undegraded":"2024-04-17T19:50:38.567840+0000","last_fullsized":"2024-04-17T19:50:38.567840+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'6","last_scrub_stamp":"2024-04-17T19:50:38.567487+0000","last_deep_scrub":"27'6","last_deep_scrub_stamp":"2024-04-17T19:50:38.567487+0000","last_clean_scrub_stamp":"2024-04-17T19:50:38.567487+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T07:33:13.995099+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.d","version":"27'4","reported_seq":40,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:50:27.052069+0000","last_change":"2024-04-17T19:50:27.052147+0000","last_active":"2024-04-17T19:50:27.052069+0000","last_peered":"2024-04-17T19:50:27.052069+0000","last_clean":"2024-04-17T19:50:27.052069+0000","last_became_active":"2024-04-17T19:46:55.703334+0000","last_became_peered":"2024-04-17T19:46:55.703334+0000","last_unstale":"2024-04-17T19:50:27.052069+0000","last_undegraded":"2024-04-17T19:50:27.052069+0000","last_fullsized":"2024-04-17T19:50:27.052069+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'4","last_scrub_stamp":"2024-04-17T19:50:27.051846+0000","last_deep_scrub":"27'4","last_deep_scrub_stamp":"2024-04-17T19:50:27.051846+0000","last_clean_scrub_stamp":"2024-04-17T19:50:27.051846+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:20:51.361202+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":28,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:50:38.189429+0000","last_change":"2024-04-17T19:50:38.189562+0000","last_active":"2024-04-17T19:50:38.189429+0000","last_peered":"2024-04-17T19:50:38.189429+0000","last_clean":"2024-04-17T19:50:38.189429+0000","last_became_active":"2024-04-17T19:47:00.744227+0000","last_became_peered":"2024-04-17T19:47:00.744227+0000","last_unstale":"2024-04-17T19:50:38.189429+0000","last_undegraded":"2024-04-17T19:50:38.189429+0000","last_fullsized":"2024-04-17T19:50:38.189429+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:50:38.189160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:50:38.189160+0000","last_clean_scrub_stamp":"2024-04-17T19:50:38.189160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T05:16:08.344646+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1,3],"acting":[5,4,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"27'9","reported_seq":43,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:50:26.454757+0000","last_change":"2024-04-17T19:50:26.454785+0000","last_active":"2024-04-17T19:50:26.454757+0000","last_peered":"2024-04-17T19:50:26.454757+0000","last_clean":"2024-04-17T19:50:26.454757+0000","last_became_active":"2024-04-17T19:46:56.687352+0000","last_became_peered":"2024-04-17T19:46:56.687352+0000","last_unstale":"2024-04-17T19:50:26.454757+0000","last_undegraded":"2024-04-17T19:50:26.454757+0000","last_fullsized":"2024-04-17T19:50:26.454757+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'9","last_scrub_stamp":"2024-04-17T19:50:26.454653+0000","last_deep_scrub":"27'9","last_deep_scrub_stamp":"2024-04-17T19:50:26.454653+0000","last_clean_scrub_stamp":"2024-04-17T19:50:26.454653+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T02:46:30.447563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.e","version":"27'7","reported_seq":43,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:50:27.673773+0000","last_change":"2024-04-17T19:50:27.673859+0000","last_active":"2024-04-17T19:50:27.673773+0000","last_peered":"2024-04-17T19:50:27.673773+0000","last_clean":"2024-04-17T19:50:27.673773+0000","last_became_active":"2024-04-17T19:46:55.715196+0000","last_became_peered":"2024-04-17T19:46:55.715196+0000","last_unstale":"2024-04-17T19:50:27.673773+0000","last_undegraded":"2024-04-17T19:50:27.673773+0000","last_fullsized":"2024-04-17T19:50:27.673773+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'7","last_scrub_stamp":"2024-04-17T19:50:27.673548+0000","last_deep_scrub":"27'7","last_deep_scrub_stamp":"2024-04-17T19:50:27.673548+0000","last_clean_scrub_stamp":"2024-04-17T19:50:27.673548+0000","objects_scrubbed":2,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T22:24:07.004354+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:49:12.983573+0000","last_change":"2024-04-17T19:47:00.735608+0000","last_active":"2024-04-17T19:49:12.983573+0000","last_peered":"2024-04-17T19:49:12.983573+0000","last_clean":"2024-04-17T19:49:12.983573+0000","last_became_active":"2024-04-17T19:47:00.735120+0000","last_became_peered":"2024-04-17T19:47:00.735120+0000","last_unstale":"2024-04-17T19:49:12.983573+0000","last_undegraded":"2024-04-17T19:49:12.983573+0000","last_fullsized":"2024-04-17T19:49:12.983573+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_clean_scrub_stamp":"2024-04-17T19:46:59.695482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"27'5","reported_seq":39,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:50:26.472337+0000","last_change":"2024-04-17T19:50:26.472369+0000","last_active":"2024-04-17T19:50:26.472337+0000","last_peered":"2024-04-17T19:50:26.472337+0000","last_clean":"2024-04-17T19:50:26.472337+0000","last_became_active":"2024-04-17T19:46:56.704786+0000","last_became_peered":"2024-04-17T19:46:56.704786+0000","last_unstale":"2024-04-17T19:50:26.472337+0000","last_undegraded":"2024-04-17T19:50:26.472337+0000","last_fullsized":"2024-04-17T19:50:26.472337+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'5","last_scrub_stamp":"2024-04-17T19:50:26.472243+0000","last_deep_scrub":"27'5","last_deep_scrub_stamp":"2024-04-17T19:50:26.472243+0000","last_clean_scrub_stamp":"2024-04-17T19:50:26.472243+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T04:35:48.987478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.f","version":"27'4","reported_seq":40,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:50:25.504504+0000","last_change":"2024-04-17T19:50:25.504544+0000","last_active":"2024-04-17T19:50:25.504504+0000","last_peered":"2024-04-17T19:50:25.504504+0000","last_clean":"2024-04-17T19:50:25.504504+0000","last_became_active":"2024-04-17T19:46:55.706729+0000","last_became_peered":"2024-04-17T19:46:55.706729+0000","last_unstale":"2024-04-17T19:50:25.504504+0000","last_undegraded":"2024-04-17T19:50:25.504504+0000","last_fullsized":"2024-04-17T19:50:25.504504+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'4","last_scrub_stamp":"2024-04-17T19:50:25.504381+0000","last_deep_scrub":"27'4","last_deep_scrub_stamp":"2024-04-17T19:50:25.504381+0000","last_clean_scrub_stamp":"2024-04-17T19:50:25.504381+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:33:08.396515+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":28,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:50:26.521860+0000","last_change":"2024-04-17T19:50:26.521889+0000","last_active":"2024-04-17T19:50:26.521860+0000","last_peered":"2024-04-17T19:50:26.521860+0000","last_clean":"2024-04-17T19:50:26.521860+0000","last_became_active":"2024-04-17T19:47:00.743582+0000","last_became_peered":"2024-04-17T19:47:00.743582+0000","last_unstale":"2024-04-17T19:50:26.521860+0000","last_undegraded":"2024-04-17T19:50:26.521860+0000","last_fullsized":"2024-04-17T19:50:26.521860+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:50:26.521764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:50:26.521764+0000","last_clean_scrub_stamp":"2024-04-17T19:50:26.521764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:54:13.935388+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,2],"acting":[1,5,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"27'6","reported_seq":40,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:50:26.818686+0000","last_change":"2024-04-17T19:50:26.818714+0000","last_active":"2024-04-17T19:50:26.818686+0000","last_peered":"2024-04-17T19:50:26.818686+0000","last_clean":"2024-04-17T19:50:26.818686+0000","last_became_active":"2024-04-17T19:46:56.692038+0000","last_became_peered":"2024-04-17T19:46:56.692038+0000","last_unstale":"2024-04-17T19:50:26.818686+0000","last_undegraded":"2024-04-17T19:50:26.818686+0000","last_fullsized":"2024-04-17T19:50:26.818686+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'6","last_scrub_stamp":"2024-04-17T19:50:26.818588+0000","last_deep_scrub":"27'6","last_deep_scrub_stamp":"2024-04-17T19:50:26.818588+0000","last_clean_scrub_stamp":"2024-04-17T19:50:26.818588+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T04:27:33.423497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.10","version":"27'26","reported_seq":62,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:50:26.657570+0000","last_change":"2024-04-17T19:50:26.657685+0000","last_active":"2024-04-17T19:50:26.657570+0000","last_peered":"2024-04-17T19:50:26.657570+0000","last_clean":"2024-04-17T19:50:26.657570+0000","last_became_active":"2024-04-17T19:46:55.691286+0000","last_became_peered":"2024-04-17T19:46:55.691286+0000","last_unstale":"2024-04-17T19:50:26.657570+0000","last_undegraded":"2024-04-17T19:50:26.657570+0000","last_fullsized":"2024-04-17T19:50:26.657570+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'26","last_scrub_stamp":"2024-04-17T19:50:26.657344+0000","last_deep_scrub":"27'26","last_deep_scrub_stamp":"2024-04-17T19:50:26.657344+0000","last_clean_scrub_stamp":"2024-04-17T19:50:26.657344+0000","objects_scrubbed":8,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:35:54.933030+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:49:24.992543+0000","last_change":"2024-04-17T19:47:00.781167+0000","last_active":"2024-04-17T19:49:24.992543+0000","last_peered":"2024-04-17T19:49:24.992543+0000","last_clean":"2024-04-17T19:49:24.992543+0000","last_became_active":"2024-04-17T19:47:00.780167+0000","last_became_peered":"2024-04-17T19:47:00.780167+0000","last_unstale":"2024-04-17T19:49:24.992543+0000","last_undegraded":"2024-04-17T19:49:24.992543+0000","last_fullsized":"2024-04-17T19:49:24.992543+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_clean_scrub_stamp":"2024-04-17T19:46:59.695482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1,6],"acting":[5,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"27'6","reported_seq":40,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:50:21.544760+0000","last_change":"2024-04-17T19:50:21.544786+0000","last_active":"2024-04-17T19:50:21.544760+0000","last_peered":"2024-04-17T19:50:21.544760+0000","last_clean":"2024-04-17T19:50:21.544760+0000","last_became_active":"2024-04-17T19:46:56.675826+0000","last_became_peered":"2024-04-17T19:46:56.675826+0000","last_unstale":"2024-04-17T19:50:21.544760+0000","last_undegraded":"2024-04-17T19:50:21.544760+0000","last_fullsized":"2024-04-17T19:50:21.544760+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'6","last_scrub_stamp":"2024-04-17T19:50:21.544672+0000","last_deep_scrub":"27'6","last_deep_scrub_stamp":"2024-04-17T19:50:21.544672+0000","last_clean_scrub_stamp":"2024-04-17T19:50:21.544672+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T05:06:34.238949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.11","version":"27'8","reported_seq":44,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:50:20.521351+0000","last_change":"2024-04-17T19:50:20.521411+0000","last_active":"2024-04-17T19:50:20.521351+0000","last_peered":"2024-04-17T19:50:20.521351+0000","last_clean":"2024-04-17T19:50:20.521351+0000","last_became_active":"2024-04-17T19:46:55.681607+0000","last_became_peered":"2024-04-17T19:46:55.681607+0000","last_unstale":"2024-04-17T19:50:20.521351+0000","last_undegraded":"2024-04-17T19:50:20.521351+0000","last_fullsized":"2024-04-17T19:50:20.521351+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'8","last_scrub_stamp":"2024-04-17T19:50:20.521185+0000","last_deep_scrub":"27'8","last_deep_scrub_stamp":"2024-04-17T19:50:20.521185+0000","last_clean_scrub_stamp":"2024-04-17T19:50:20.521185+0000","objects_scrubbed":3,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T02:12:10.447363+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":28,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:50:39.163506+0000","last_change":"2024-04-17T19:50:39.163584+0000","last_active":"2024-04-17T19:50:39.163506+0000","last_peered":"2024-04-17T19:50:39.163506+0000","last_clean":"2024-04-17T19:50:39.163506+0000","last_became_active":"2024-04-17T19:47:00.755282+0000","last_became_peered":"2024-04-17T19:47:00.755282+0000","last_unstale":"2024-04-17T19:50:39.163506+0000","last_undegraded":"2024-04-17T19:50:39.163506+0000","last_fullsized":"2024-04-17T19:50:39.163506+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:50:39.163255+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:50:39.163255+0000","last_clean_scrub_stamp":"2024-04-17T19:50:39.163255+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:34:40.689185+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6,4],"acting":[5,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"27'15","reported_seq":49,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:50:28.790880+0000","last_change":"2024-04-17T19:50:28.790914+0000","last_active":"2024-04-17T19:50:28.790880+0000","last_peered":"2024-04-17T19:50:28.790880+0000","last_clean":"2024-04-17T19:50:28.790880+0000","last_became_active":"2024-04-17T19:46:56.694449+0000","last_became_peered":"2024-04-17T19:46:56.694449+0000","last_unstale":"2024-04-17T19:50:28.790880+0000","last_undegraded":"2024-04-17T19:50:28.790880+0000","last_fullsized":"2024-04-17T19:50:28.790880+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'15","last_scrub_stamp":"2024-04-17T19:50:28.790790+0000","last_deep_scrub":"27'15","last_deep_scrub_stamp":"2024-04-17T19:50:28.790790+0000","last_clean_scrub_stamp":"2024-04-17T19:50:28.790790+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T02:46:37.967518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.12","version":"27'9","reported_seq":45,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:50:33.773097+0000","last_change":"2024-04-17T19:50:33.773141+0000","last_active":"2024-04-17T19:50:33.773097+0000","last_peered":"2024-04-17T19:50:33.773097+0000","last_clean":"2024-04-17T19:50:33.773097+0000","last_became_active":"2024-04-17T19:46:55.689607+0000","last_became_peered":"2024-04-17T19:46:55.689607+0000","last_unstale":"2024-04-17T19:50:33.773097+0000","last_undegraded":"2024-04-17T19:50:33.773097+0000","last_fullsized":"2024-04-17T19:50:33.773097+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'9","last_scrub_stamp":"2024-04-17T19:50:33.772990+0000","last_deep_scrub":"27'9","last_deep_scrub_stamp":"2024-04-17T19:50:33.772990+0000","last_clean_scrub_stamp":"2024-04-17T19:50:33.772990+0000","objects_scrubbed":3,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T02:08:35.754599+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":28,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:50:35.789465+0000","last_change":"2024-04-17T19:50:35.789536+0000","last_active":"2024-04-17T19:50:35.789465+0000","last_peered":"2024-04-17T19:50:35.789465+0000","last_clean":"2024-04-17T19:50:35.789465+0000","last_became_active":"2024-04-17T19:47:00.781025+0000","last_became_peered":"2024-04-17T19:47:00.781025+0000","last_unstale":"2024-04-17T19:50:35.789465+0000","last_undegraded":"2024-04-17T19:50:35.789465+0000","last_fullsized":"2024-04-17T19:50:35.789465+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:50:35.789229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:50:35.789229+0000","last_clean_scrub_stamp":"2024-04-17T19:50:35.789229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T05:06:25.048549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0,7],"acting":[6,4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.12","version":"27'9","reported_seq":43,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:50:28.757857+0000","last_change":"2024-04-17T19:50:28.757926+0000","last_active":"2024-04-17T19:50:28.757857+0000","last_peered":"2024-04-17T19:50:28.757857+0000","last_clean":"2024-04-17T19:50:28.757857+0000","last_became_active":"2024-04-17T19:46:56.687385+0000","last_became_peered":"2024-04-17T19:46:56.687385+0000","last_unstale":"2024-04-17T19:50:28.757857+0000","last_undegraded":"2024-04-17T19:50:28.757857+0000","last_fullsized":"2024-04-17T19:50:28.757857+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'9","last_scrub_stamp":"2024-04-17T19:50:28.757645+0000","last_deep_scrub":"27'9","last_deep_scrub_stamp":"2024-04-17T19:50:28.757645+0000","last_clean_scrub_stamp":"2024-04-17T19:50:28.757645+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:02:51.661927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"27'15","reported_seq":51,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:50:23.759425+0000","last_change":"2024-04-17T19:50:23.759508+0000","last_active":"2024-04-17T19:50:23.759425+0000","last_peered":"2024-04-17T19:50:23.759425+0000","last_clean":"2024-04-17T19:50:23.759425+0000","last_became_active":"2024-04-17T19:46:55.698962+0000","last_became_peered":"2024-04-17T19:46:55.698962+0000","last_unstale":"2024-04-17T19:50:23.759425+0000","last_undegraded":"2024-04-17T19:50:23.759425+0000","last_fullsized":"2024-04-17T19:50:23.759425+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'15","last_scrub_stamp":"2024-04-17T19:50:23.759206+0000","last_deep_scrub":"27'15","last_deep_scrub_stamp":"2024-04-17T19:50:23.759206+0000","last_clean_scrub_stamp":"2024-04-17T19:50:23.759206+0000","objects_scrubbed":6,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:11:25.730463+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:49:27.985245+0000","last_change":"2024-04-17T19:47:00.760341+0000","last_active":"2024-04-17T19:49:27.985245+0000","last_peered":"2024-04-17T19:49:27.985245+0000","last_clean":"2024-04-17T19:49:27.985245+0000","last_became_active":"2024-04-17T19:47:00.759892+0000","last_became_peered":"2024-04-17T19:47:00.759892+0000","last_unstale":"2024-04-17T19:49:27.985245+0000","last_undegraded":"2024-04-17T19:49:27.985245+0000","last_fullsized":"2024-04-17T19:49:27.985245+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_clean_scrub_stamp":"2024-04-17T19:46:59.695482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5,6],"acting":[3,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"27'6","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:50:32.771784+0000","last_change":"2024-04-17T19:50:32.771858+0000","last_active":"2024-04-17T19:50:32.771784+0000","last_peered":"2024-04-17T19:50:32.771784+0000","last_clean":"2024-04-17T19:50:32.771784+0000","last_became_active":"2024-04-17T19:47:37.968623+0000","last_became_peered":"2024-04-17T19:47:37.968623+0000","last_unstale":"2024-04-17T19:50:32.771784+0000","last_undegraded":"2024-04-17T19:50:32.771784+0000","last_fullsized":"2024-04-17T19:50:32.771784+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'6","last_scrub_stamp":"2024-04-17T19:50:32.771588+0000","last_deep_scrub":"27'6","last_deep_scrub_stamp":"2024-04-17T19:50:32.771588+0000","last_clean_scrub_stamp":"2024-04-17T19:50:32.771588+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:42:26.764363+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"27'36","reported_seq":72,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:50:20.493946+0000","last_change":"2024-04-17T19:50:20.494007+0000","last_active":"2024-04-17T19:50:20.493946+0000","last_peered":"2024-04-17T19:50:20.493946+0000","last_clean":"2024-04-17T19:50:20.493946+0000","last_became_active":"2024-04-17T19:46:55.696876+0000","last_became_peered":"2024-04-17T19:46:55.696876+0000","last_unstale":"2024-04-17T19:50:20.493946+0000","last_undegraded":"2024-04-17T19:50:20.493946+0000","last_fullsized":"2024-04-17T19:50:20.493946+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'36","last_scrub_stamp":"2024-04-17T19:50:20.493864+0000","last_deep_scrub":"27'36","last_deep_scrub_stamp":"2024-04-17T19:50:20.493864+0000","last_clean_scrub_stamp":"2024-04-17T19:50:20.493864+0000","objects_scrubbed":6,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T02:48:14.693097+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":37585,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":33,"num_write_kb":52,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"27'3","reported_seq":31,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:50:33.579024+0000","last_change":"2024-04-17T19:50:33.579107+0000","last_active":"2024-04-17T19:50:33.579024+0000","last_peered":"2024-04-17T19:50:33.579024+0000","last_clean":"2024-04-17T19:50:33.579024+0000","last_became_active":"2024-04-17T19:47:00.742290+0000","last_became_peered":"2024-04-17T19:47:00.742290+0000","last_unstale":"2024-04-17T19:50:33.579024+0000","last_undegraded":"2024-04-17T19:50:33.579024+0000","last_fullsized":"2024-04-17T19:50:33.579024+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'3","last_scrub_stamp":"2024-04-17T19:50:33.578782+0000","last_deep_scrub":"27'3","last_deep_scrub_stamp":"2024-04-17T19:50:33.578782+0000","last_clean_scrub_stamp":"2024-04-17T19:50:33.578782+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:24:06.950808+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,5,0],"acting":[4,3,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"27'11","reported_seq":45,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:50:27.819153+0000","last_change":"2024-04-17T19:50:27.819186+0000","last_active":"2024-04-17T19:50:27.819153+0000","last_peered":"2024-04-17T19:50:27.819153+0000","last_clean":"2024-04-17T19:50:27.819153+0000","last_became_active":"2024-04-17T19:46:56.680171+0000","last_became_peered":"2024-04-17T19:46:56.680171+0000","last_unstale":"2024-04-17T19:50:27.819153+0000","last_undegraded":"2024-04-17T19:50:27.819153+0000","last_fullsized":"2024-04-17T19:50:27.819153+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'11","last_scrub_stamp":"2024-04-17T19:50:27.819055+0000","last_deep_scrub":"27'11","last_deep_scrub_stamp":"2024-04-17T19:50:27.819055+0000","last_clean_scrub_stamp":"2024-04-17T19:50:27.819055+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:15:56.856888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.15","version":"27'12","reported_seq":48,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:50:24.767714+0000","last_change":"2024-04-17T19:50:24.767865+0000","last_active":"2024-04-17T19:50:24.767714+0000","last_peered":"2024-04-17T19:50:24.767714+0000","last_clean":"2024-04-17T19:50:24.767714+0000","last_became_active":"2024-04-17T19:46:55.706967+0000","last_became_peered":"2024-04-17T19:46:55.706967+0000","last_unstale":"2024-04-17T19:50:24.767714+0000","last_undegraded":"2024-04-17T19:50:24.767714+0000","last_fullsized":"2024-04-17T19:50:24.767714+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'12","last_scrub_stamp":"2024-04-17T19:50:24.767391+0000","last_deep_scrub":"27'12","last_deep_scrub_stamp":"2024-04-17T19:50:24.767391+0000","last_clean_scrub_stamp":"2024-04-17T19:50:24.767391+0000","objects_scrubbed":4,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:55:04.789357+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":28,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:50:28.427111+0000","last_change":"2024-04-17T19:50:28.427138+0000","last_active":"2024-04-17T19:50:28.427111+0000","last_peered":"2024-04-17T19:50:28.427111+0000","last_clean":"2024-04-17T19:50:28.427111+0000","last_became_active":"2024-04-17T19:47:00.758209+0000","last_became_peered":"2024-04-17T19:47:00.758209+0000","last_unstale":"2024-04-17T19:50:28.427111+0000","last_undegraded":"2024-04-17T19:50:28.427111+0000","last_fullsized":"2024-04-17T19:50:28.427111+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:50:28.427008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:50:28.427008+0000","last_clean_scrub_stamp":"2024-04-17T19:50:28.427008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T02:46:32.419918+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1,7],"acting":[2,3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"27'9","reported_seq":43,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:50:23.060566+0000","last_change":"2024-04-17T19:50:23.060634+0000","last_active":"2024-04-17T19:50:23.060566+0000","last_peered":"2024-04-17T19:50:23.060566+0000","last_clean":"2024-04-17T19:50:23.060566+0000","last_became_active":"2024-04-17T19:46:56.683685+0000","last_became_peered":"2024-04-17T19:46:56.683685+0000","last_unstale":"2024-04-17T19:50:23.060566+0000","last_undegraded":"2024-04-17T19:50:23.060566+0000","last_fullsized":"2024-04-17T19:50:23.060566+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'9","last_scrub_stamp":"2024-04-17T19:50:23.060363+0000","last_deep_scrub":"27'9","last_deep_scrub_stamp":"2024-04-17T19:50:23.060363+0000","last_clean_scrub_stamp":"2024-04-17T19:50:23.060363+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:42:11.876156+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"27'6","reported_seq":42,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:50:22.465768+0000","last_change":"2024-04-17T19:50:22.465797+0000","last_active":"2024-04-17T19:50:22.465768+0000","last_peered":"2024-04-17T19:50:22.465768+0000","last_clean":"2024-04-17T19:50:22.465768+0000","last_became_active":"2024-04-17T19:46:55.687019+0000","last_became_peered":"2024-04-17T19:46:55.687019+0000","last_unstale":"2024-04-17T19:50:22.465768+0000","last_undegraded":"2024-04-17T19:50:22.465768+0000","last_fullsized":"2024-04-17T19:50:22.465768+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'6","last_scrub_stamp":"2024-04-17T19:50:22.465695+0000","last_deep_scrub":"27'6","last_deep_scrub_stamp":"2024-04-17T19:50:22.465695+0000","last_clean_scrub_stamp":"2024-04-17T19:50:22.465695+0000","objects_scrubbed":2,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:55:28.800074+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":28,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:50:30.808320+0000","last_change":"2024-04-17T19:50:30.808387+0000","last_active":"2024-04-17T19:50:30.808320+0000","last_peered":"2024-04-17T19:50:30.808320+0000","last_clean":"2024-04-17T19:50:30.808320+0000","last_became_active":"2024-04-17T19:47:00.777053+0000","last_became_peered":"2024-04-17T19:47:00.777053+0000","last_unstale":"2024-04-17T19:50:30.808320+0000","last_undegraded":"2024-04-17T19:50:30.808320+0000","last_fullsized":"2024-04-17T19:50:30.808320+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:50:30.808113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:50:30.808113+0000","last_clean_scrub_stamp":"2024-04-17T19:50:30.808113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:42:04.878402+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,3,2],"acting":[7,1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"27'10","reported_seq":44,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:50:22.420110+0000","last_change":"2024-04-17T19:50:22.420133+0000","last_active":"2024-04-17T19:50:22.420110+0000","last_peered":"2024-04-17T19:50:22.420110+0000","last_clean":"2024-04-17T19:50:22.420110+0000","last_became_active":"2024-04-17T19:46:56.692287+0000","last_became_peered":"2024-04-17T19:46:56.692287+0000","last_unstale":"2024-04-17T19:50:22.420110+0000","last_undegraded":"2024-04-17T19:50:22.420110+0000","last_fullsized":"2024-04-17T19:50:22.420110+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'10","last_scrub_stamp":"2024-04-17T19:50:22.420031+0000","last_deep_scrub":"27'10","last_deep_scrub_stamp":"2024-04-17T19:50:22.420031+0000","last_clean_scrub_stamp":"2024-04-17T19:50:22.420031+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:38:14.319185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.17","version":"27'8","reported_seq":44,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:50:20.536890+0000","last_change":"2024-04-17T19:50:20.536928+0000","last_active":"2024-04-17T19:50:20.536890+0000","last_peered":"2024-04-17T19:50:20.536890+0000","last_clean":"2024-04-17T19:50:20.536890+0000","last_became_active":"2024-04-17T19:46:55.691354+0000","last_became_peered":"2024-04-17T19:46:55.691354+0000","last_unstale":"2024-04-17T19:50:20.536890+0000","last_undegraded":"2024-04-17T19:50:20.536890+0000","last_fullsized":"2024-04-17T19:50:20.536890+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'8","last_scrub_stamp":"2024-04-17T19:50:20.536822+0000","last_deep_scrub":"27'8","last_deep_scrub_stamp":"2024-04-17T19:50:20.536822+0000","last_clean_scrub_stamp":"2024-04-17T19:50:20.536822+0000","objects_scrubbed":3,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T00:32:34.736066+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":28,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:50:35.539932+0000","last_change":"2024-04-17T19:50:35.540062+0000","last_active":"2024-04-17T19:50:35.539932+0000","last_peered":"2024-04-17T19:50:35.539932+0000","last_clean":"2024-04-17T19:50:35.539932+0000","last_became_active":"2024-04-17T19:47:00.763550+0000","last_became_peered":"2024-04-17T19:47:00.763550+0000","last_unstale":"2024-04-17T19:50:35.539932+0000","last_undegraded":"2024-04-17T19:50:35.539932+0000","last_fullsized":"2024-04-17T19:50:35.539932+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:50:35.539666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:50:35.539666+0000","last_clean_scrub_stamp":"2024-04-17T19:50:35.539666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T05:23:38.211990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,3,7],"acting":[4,0,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":28,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:50:34.562768+0000","last_change":"2024-04-17T19:50:34.562835+0000","last_active":"2024-04-17T19:50:34.562768+0000","last_peered":"2024-04-17T19:50:34.562768+0000","last_clean":"2024-04-17T19:50:34.562768+0000","last_became_active":"2024-04-17T19:47:00.744828+0000","last_became_peered":"2024-04-17T19:47:00.744828+0000","last_unstale":"2024-04-17T19:50:34.562768+0000","last_undegraded":"2024-04-17T19:50:34.562768+0000","last_fullsized":"2024-04-17T19:50:34.562768+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:50:34.562556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:50:34.562556+0000","last_clean_scrub_stamp":"2024-04-17T19:50:34.562556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:18:30.014267+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,5,3],"acting":[4,1,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"27'10","reported_seq":44,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:50:29.662967+0000","last_change":"2024-04-17T19:50:29.663048+0000","last_active":"2024-04-17T19:50:29.662967+0000","last_peered":"2024-04-17T19:50:29.662967+0000","last_clean":"2024-04-17T19:50:29.662967+0000","last_became_active":"2024-04-17T19:46:56.690810+0000","last_became_peered":"2024-04-17T19:46:56.690810+0000","last_unstale":"2024-04-17T19:50:29.662967+0000","last_undegraded":"2024-04-17T19:50:29.662967+0000","last_fullsized":"2024-04-17T19:50:29.662967+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'10","last_scrub_stamp":"2024-04-17T19:50:29.662751+0000","last_deep_scrub":"27'10","last_deep_scrub_stamp":"2024-04-17T19:50:29.662751+0000","last_clean_scrub_stamp":"2024-04-17T19:50:29.662751+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:28:57.615862+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.18","version":"27'4","reported_seq":40,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:50:34.748085+0000","last_change":"2024-04-17T19:50:34.748121+0000","last_active":"2024-04-17T19:50:34.748085+0000","last_peered":"2024-04-17T19:50:34.748085+0000","last_clean":"2024-04-17T19:50:34.748085+0000","last_became_active":"2024-04-17T19:46:55.690539+0000","last_became_peered":"2024-04-17T19:46:55.690539+0000","last_unstale":"2024-04-17T19:50:34.748085+0000","last_undegraded":"2024-04-17T19:50:34.748085+0000","last_fullsized":"2024-04-17T19:50:34.748085+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'4","last_scrub_stamp":"2024-04-17T19:50:34.747947+0000","last_deep_scrub":"27'4","last_deep_scrub_stamp":"2024-04-17T19:50:34.747947+0000","last_clean_scrub_stamp":"2024-04-17T19:50:34.747947+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:10:36.597623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:49:07.983035+0000","last_change":"2024-04-17T19:47:00.749616+0000","last_active":"2024-04-17T19:49:07.983035+0000","last_peered":"2024-04-17T19:49:07.983035+0000","last_clean":"2024-04-17T19:49:07.983035+0000","last_became_active":"2024-04-17T19:47:00.749061+0000","last_became_peered":"2024-04-17T19:47:00.749061+0000","last_unstale":"2024-04-17T19:49:07.983035+0000","last_undegraded":"2024-04-17T19:49:07.983035+0000","last_fullsized":"2024-04-17T19:49:07.983035+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:59.695482+0000","last_clean_scrub_stamp":"2024-04-17T19:46:59.695482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5,1],"acting":[3,2,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"27'8","reported_seq":42,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:50:36.172809+0000","last_change":"2024-04-17T19:50:36.172878+0000","last_active":"2024-04-17T19:50:36.172809+0000","last_peered":"2024-04-17T19:50:36.172809+0000","last_clean":"2024-04-17T19:50:36.172809+0000","last_became_active":"2024-04-17T19:46:56.691524+0000","last_became_peered":"2024-04-17T19:46:56.691524+0000","last_unstale":"2024-04-17T19:50:36.172809+0000","last_undegraded":"2024-04-17T19:50:36.172809+0000","last_fullsized":"2024-04-17T19:50:36.172809+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'8","last_scrub_stamp":"2024-04-17T19:50:36.172591+0000","last_deep_scrub":"27'8","last_deep_scrub_stamp":"2024-04-17T19:50:36.172591+0000","last_clean_scrub_stamp":"2024-04-17T19:50:36.172591+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:53:06.803690+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"27'5","reported_seq":41,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:50:23.649745+0000","last_change":"2024-04-17T19:50:23.649823+0000","last_active":"2024-04-17T19:50:23.649745+0000","last_peered":"2024-04-17T19:50:23.649745+0000","last_clean":"2024-04-17T19:50:23.649745+0000","last_became_active":"2024-04-17T19:46:55.699166+0000","last_became_peered":"2024-04-17T19:46:55.699166+0000","last_unstale":"2024-04-17T19:50:23.649745+0000","last_undegraded":"2024-04-17T19:50:23.649745+0000","last_fullsized":"2024-04-17T19:50:23.649745+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'5","last_scrub_stamp":"2024-04-17T19:50:23.649537+0000","last_deep_scrub":"27'5","last_deep_scrub_stamp":"2024-04-17T19:50:23.649537+0000","last_clean_scrub_stamp":"2024-04-17T19:50:23.649537+0000","objects_scrubbed":2,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T05:39:22.971551+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"27'10","reported_seq":46,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:50:31.780877+0000","last_change":"2024-04-17T19:50:31.780919+0000","last_active":"2024-04-17T19:50:31.780877+0000","last_peered":"2024-04-17T19:50:31.780877+0000","last_clean":"2024-04-17T19:50:31.780877+0000","last_became_active":"2024-04-17T19:46:55.687401+0000","last_became_peered":"2024-04-17T19:46:55.687401+0000","last_unstale":"2024-04-17T19:50:31.780877+0000","last_undegraded":"2024-04-17T19:50:31.780877+0000","last_fullsized":"2024-04-17T19:50:31.780877+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'10","last_scrub_stamp":"2024-04-17T19:50:31.780785+0000","last_deep_scrub":"27'10","last_deep_scrub_stamp":"2024-04-17T19:50:31.780785+0000","last_clean_scrub_stamp":"2024-04-17T19:50:31.780785+0000","objects_scrubbed":3,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T04:40:27.173317+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"27'8","reported_seq":42,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:50:28.630675+0000","last_change":"2024-04-17T19:50:28.630752+0000","last_active":"2024-04-17T19:50:28.630675+0000","last_peered":"2024-04-17T19:50:28.630675+0000","last_clean":"2024-04-17T19:50:28.630675+0000","last_became_active":"2024-04-17T19:46:56.691199+0000","last_became_peered":"2024-04-17T19:46:56.691199+0000","last_unstale":"2024-04-17T19:50:28.630675+0000","last_undegraded":"2024-04-17T19:50:28.630675+0000","last_fullsized":"2024-04-17T19:50:28.630675+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'8","last_scrub_stamp":"2024-04-17T19:50:28.630460+0000","last_deep_scrub":"27'8","last_deep_scrub_stamp":"2024-04-17T19:50:28.630460+0000","last_clean_scrub_stamp":"2024-04-17T19:50:28.630460+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:46:08.307620+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":28,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:50:36.580797+0000","last_change":"2024-04-17T19:50:36.580864+0000","last_active":"2024-04-17T19:50:36.580797+0000","last_peered":"2024-04-17T19:50:36.580797+0000","last_clean":"2024-04-17T19:50:36.580797+0000","last_became_active":"2024-04-17T19:47:00.774592+0000","last_became_peered":"2024-04-17T19:47:00.774592+0000","last_unstale":"2024-04-17T19:50:36.580797+0000","last_undegraded":"2024-04-17T19:50:36.580797+0000","last_fullsized":"2024-04-17T19:50:36.580797+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:50:36.580584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:50:36.580584+0000","last_clean_scrub_stamp":"2024-04-17T19:50:36.580584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:55:52.224262+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,7],"acting":[4,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"27'7","reported_seq":43,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:50:29.088288+0000","last_change":"2024-04-17T19:50:29.088368+0000","last_active":"2024-04-17T19:50:29.088288+0000","last_peered":"2024-04-17T19:50:29.088288+0000","last_clean":"2024-04-17T19:50:29.088288+0000","last_became_active":"2024-04-17T19:46:55.712982+0000","last_became_peered":"2024-04-17T19:46:55.712982+0000","last_unstale":"2024-04-17T19:50:29.088288+0000","last_undegraded":"2024-04-17T19:50:29.088288+0000","last_fullsized":"2024-04-17T19:50:29.088288+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'7","last_scrub_stamp":"2024-04-17T19:50:29.088081+0000","last_deep_scrub":"27'7","last_deep_scrub_stamp":"2024-04-17T19:50:29.088081+0000","last_clean_scrub_stamp":"2024-04-17T19:50:29.088081+0000","objects_scrubbed":2,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T05:39:49.650434+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"27'7","reported_seq":41,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:50:23.529150+0000","last_change":"2024-04-17T19:50:23.529173+0000","last_active":"2024-04-17T19:50:23.529150+0000","last_peered":"2024-04-17T19:50:23.529150+0000","last_clean":"2024-04-17T19:50:23.529150+0000","last_became_active":"2024-04-17T19:46:56.679830+0000","last_became_peered":"2024-04-17T19:46:56.679830+0000","last_unstale":"2024-04-17T19:50:23.529150+0000","last_undegraded":"2024-04-17T19:50:23.529150+0000","last_fullsized":"2024-04-17T19:50:23.529150+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'7","last_scrub_stamp":"2024-04-17T19:50:23.529082+0000","last_deep_scrub":"27'7","last_deep_scrub_stamp":"2024-04-17T19:50:23.529082+0000","last_clean_scrub_stamp":"2024-04-17T19:50:23.529082+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T04:31:17.505359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":28,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:50:29.775285+0000","last_change":"2024-04-17T19:50:29.775359+0000","last_active":"2024-04-17T19:50:29.775285+0000","last_peered":"2024-04-17T19:50:29.775285+0000","last_clean":"2024-04-17T19:50:29.775285+0000","last_became_active":"2024-04-17T19:47:00.776357+0000","last_became_peered":"2024-04-17T19:47:00.776357+0000","last_unstale":"2024-04-17T19:50:29.775285+0000","last_undegraded":"2024-04-17T19:50:29.775285+0000","last_fullsized":"2024-04-17T19:50:29.775285+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:50:29.775042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:50:29.775042+0000","last_clean_scrub_stamp":"2024-04-17T19:50:29.775042+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:38:21.674196+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,1,0],"acting":[7,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"27'9","reported_seq":43,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:50:25.443382+0000","last_change":"2024-04-17T19:50:25.443413+0000","last_active":"2024-04-17T19:50:25.443382+0000","last_peered":"2024-04-17T19:50:25.443382+0000","last_clean":"2024-04-17T19:50:25.443382+0000","last_became_active":"2024-04-17T19:46:56.702724+0000","last_became_peered":"2024-04-17T19:46:56.702724+0000","last_unstale":"2024-04-17T19:50:25.443382+0000","last_undegraded":"2024-04-17T19:50:25.443382+0000","last_fullsized":"2024-04-17T19:50:25.443382+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'9","last_scrub_stamp":"2024-04-17T19:50:25.443274+0000","last_deep_scrub":"27'9","last_deep_scrub_stamp":"2024-04-17T19:50:25.443274+0000","last_clean_scrub_stamp":"2024-04-17T19:50:25.443274+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:42:19.436049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"27'12","reported_seq":46,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:50:26.757746+0000","last_change":"2024-04-17T19:50:26.757817+0000","last_active":"2024-04-17T19:50:26.757746+0000","last_peered":"2024-04-17T19:50:26.757746+0000","last_clean":"2024-04-17T19:50:26.757746+0000","last_became_active":"2024-04-17T19:46:56.684771+0000","last_became_peered":"2024-04-17T19:46:56.684771+0000","last_unstale":"2024-04-17T19:50:26.757746+0000","last_undegraded":"2024-04-17T19:50:26.757746+0000","last_fullsized":"2024-04-17T19:50:26.757746+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'12","last_scrub_stamp":"2024-04-17T19:50:26.757547+0000","last_deep_scrub":"27'12","last_deep_scrub_stamp":"2024-04-17T19:50:26.757547+0000","last_clean_scrub_stamp":"2024-04-17T19:50:26.757547+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:08:24.114869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.22","version":"27'8","reported_seq":42,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:50:21.759980+0000","last_change":"2024-04-17T19:50:21.760005+0000","last_active":"2024-04-17T19:50:21.759980+0000","last_peered":"2024-04-17T19:50:21.759980+0000","last_clean":"2024-04-17T19:50:21.759980+0000","last_became_active":"2024-04-17T19:46:56.685745+0000","last_became_peered":"2024-04-17T19:46:56.685745+0000","last_unstale":"2024-04-17T19:50:21.759980+0000","last_undegraded":"2024-04-17T19:50:21.759980+0000","last_fullsized":"2024-04-17T19:50:21.759980+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'8","last_scrub_stamp":"2024-04-17T19:50:21.759902+0000","last_deep_scrub":"27'8","last_deep_scrub_stamp":"2024-04-17T19:50:21.759902+0000","last_clean_scrub_stamp":"2024-04-17T19:50:21.759902+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T02:10:19.317569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"27'7","reported_seq":41,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:50:31.115212+0000","last_change":"2024-04-17T19:50:31.115280+0000","last_active":"2024-04-17T19:50:31.115212+0000","last_peered":"2024-04-17T19:50:31.115212+0000","last_clean":"2024-04-17T19:50:31.115212+0000","last_became_active":"2024-04-17T19:46:56.675519+0000","last_became_peered":"2024-04-17T19:46:56.675519+0000","last_unstale":"2024-04-17T19:50:31.115212+0000","last_undegraded":"2024-04-17T19:50:31.115212+0000","last_fullsized":"2024-04-17T19:50:31.115212+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'7","last_scrub_stamp":"2024-04-17T19:50:31.115007+0000","last_deep_scrub":"27'7","last_deep_scrub_stamp":"2024-04-17T19:50:31.115007+0000","last_clean_scrub_stamp":"2024-04-17T19:50:31.115007+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:24:13.380642+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.24","version":"27'4","reported_seq":38,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:50:30.807183+0000","last_change":"2024-04-17T19:50:30.807331+0000","last_active":"2024-04-17T19:50:30.807183+0000","last_peered":"2024-04-17T19:50:30.807183+0000","last_clean":"2024-04-17T19:50:30.807183+0000","last_became_active":"2024-04-17T19:46:56.699293+0000","last_became_peered":"2024-04-17T19:46:56.699293+0000","last_unstale":"2024-04-17T19:50:30.807183+0000","last_undegraded":"2024-04-17T19:50:30.807183+0000","last_fullsized":"2024-04-17T19:50:30.807183+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'4","last_scrub_stamp":"2024-04-17T19:50:30.806912+0000","last_deep_scrub":"27'4","last_deep_scrub_stamp":"2024-04-17T19:50:30.806912+0000","last_clean_scrub_stamp":"2024-04-17T19:50:30.806912+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T07:09:08.638017+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"27'6","reported_seq":40,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:50:26.694720+0000","last_change":"2024-04-17T19:50:26.694789+0000","last_active":"2024-04-17T19:50:26.694720+0000","last_peered":"2024-04-17T19:50:26.694720+0000","last_clean":"2024-04-17T19:50:26.694720+0000","last_became_active":"2024-04-17T19:46:56.683963+0000","last_became_peered":"2024-04-17T19:46:56.683963+0000","last_unstale":"2024-04-17T19:50:26.694720+0000","last_undegraded":"2024-04-17T19:50:26.694720+0000","last_fullsized":"2024-04-17T19:50:26.694720+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'6","last_scrub_stamp":"2024-04-17T19:50:26.694520+0000","last_deep_scrub":"27'6","last_deep_scrub_stamp":"2024-04-17T19:50:26.694520+0000","last_clean_scrub_stamp":"2024-04-17T19:50:26.694520+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T00:50:27.473214+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.26","version":"27'15","reported_seq":49,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:50:23.466915+0000","last_change":"2024-04-17T19:50:23.466941+0000","last_active":"2024-04-17T19:50:23.466915+0000","last_peered":"2024-04-17T19:50:23.466915+0000","last_clean":"2024-04-17T19:50:23.466915+0000","last_became_active":"2024-04-17T19:46:56.692688+0000","last_became_peered":"2024-04-17T19:46:56.692688+0000","last_unstale":"2024-04-17T19:50:23.466915+0000","last_undegraded":"2024-04-17T19:50:23.466915+0000","last_fullsized":"2024-04-17T19:50:23.466915+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'15","last_scrub_stamp":"2024-04-17T19:50:23.466846+0000","last_deep_scrub":"27'15","last_deep_scrub_stamp":"2024-04-17T19:50:23.466846+0000","last_clean_scrub_stamp":"2024-04-17T19:50:23.466846+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:41:57.537135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"27'2","reported_seq":36,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:50:24.050534+0000","last_change":"2024-04-17T19:50:24.050619+0000","last_active":"2024-04-17T19:50:24.050534+0000","last_peered":"2024-04-17T19:50:24.050534+0000","last_clean":"2024-04-17T19:50:24.050534+0000","last_became_active":"2024-04-17T19:46:56.684714+0000","last_became_peered":"2024-04-17T19:46:56.684714+0000","last_unstale":"2024-04-17T19:50:24.050534+0000","last_undegraded":"2024-04-17T19:50:24.050534+0000","last_fullsized":"2024-04-17T19:50:24.050534+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2","last_scrub_stamp":"2024-04-17T19:50:24.050303+0000","last_deep_scrub":"27'2","last_deep_scrub_stamp":"2024-04-17T19:50:24.050303+0000","last_clean_scrub_stamp":"2024-04-17T19:50:24.050303+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T04:58:15.614346+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"27'6","reported_seq":40,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:50:23.780572+0000","last_change":"2024-04-17T19:50:23.780620+0000","last_active":"2024-04-17T19:50:23.780572+0000","last_peered":"2024-04-17T19:50:23.780572+0000","last_clean":"2024-04-17T19:50:23.780572+0000","last_became_active":"2024-04-17T19:46:56.679818+0000","last_became_peered":"2024-04-17T19:46:56.679818+0000","last_unstale":"2024-04-17T19:50:23.780572+0000","last_undegraded":"2024-04-17T19:50:23.780572+0000","last_fullsized":"2024-04-17T19:50:23.780572+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'6","last_scrub_stamp":"2024-04-17T19:50:23.780451+0000","last_deep_scrub":"27'6","last_deep_scrub_stamp":"2024-04-17T19:50:23.780451+0000","last_clean_scrub_stamp":"2024-04-17T19:50:23.780451+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:43:31.614363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"27'8","reported_seq":42,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:50:30.107985+0000","last_change":"2024-04-17T19:50:30.108081+0000","last_active":"2024-04-17T19:50:30.107985+0000","last_peered":"2024-04-17T19:50:30.107985+0000","last_clean":"2024-04-17T19:50:30.107985+0000","last_became_active":"2024-04-17T19:46:56.674164+0000","last_became_peered":"2024-04-17T19:46:56.674164+0000","last_unstale":"2024-04-17T19:50:30.107985+0000","last_undegraded":"2024-04-17T19:50:30.107985+0000","last_fullsized":"2024-04-17T19:50:30.107985+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'8","last_scrub_stamp":"2024-04-17T19:50:30.107777+0000","last_deep_scrub":"27'8","last_deep_scrub_stamp":"2024-04-17T19:50:30.107777+0000","last_clean_scrub_stamp":"2024-04-17T19:50:30.107777+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:20:51.236605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2a","version":"27'10","reported_seq":44,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:50:24.541115+0000","last_change":"2024-04-17T19:50:24.541145+0000","last_active":"2024-04-17T19:50:24.541115+0000","last_peered":"2024-04-17T19:50:24.541115+0000","last_clean":"2024-04-17T19:50:24.541115+0000","last_became_active":"2024-04-17T19:46:56.695255+0000","last_became_peered":"2024-04-17T19:46:56.695255+0000","last_unstale":"2024-04-17T19:50:24.541115+0000","last_undegraded":"2024-04-17T19:50:24.541115+0000","last_fullsized":"2024-04-17T19:50:24.541115+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'10","last_scrub_stamp":"2024-04-17T19:50:24.541022+0000","last_deep_scrub":"27'10","last_deep_scrub_stamp":"2024-04-17T19:50:24.541022+0000","last_clean_scrub_stamp":"2024-04-17T19:50:24.541022+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T01:44:00.043982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"27'11","reported_seq":45,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:50:22.571632+0000","last_change":"2024-04-17T19:50:22.571741+0000","last_active":"2024-04-17T19:50:22.571632+0000","last_peered":"2024-04-17T19:50:22.571632+0000","last_clean":"2024-04-17T19:50:22.571632+0000","last_became_active":"2024-04-17T19:46:56.691942+0000","last_became_peered":"2024-04-17T19:46:56.691942+0000","last_unstale":"2024-04-17T19:50:22.571632+0000","last_undegraded":"2024-04-17T19:50:22.571632+0000","last_fullsized":"2024-04-17T19:50:22.571632+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'11","last_scrub_stamp":"2024-04-17T19:50:22.571415+0000","last_deep_scrub":"27'11","last_deep_scrub_stamp":"2024-04-17T19:50:22.571415+0000","last_clean_scrub_stamp":"2024-04-17T19:50:22.571415+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T01:55:29.792028+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2c","version":"27'8","reported_seq":42,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:50:27.504007+0000","last_change":"2024-04-17T19:50:27.504037+0000","last_active":"2024-04-17T19:50:27.504007+0000","last_peered":"2024-04-17T19:50:27.504007+0000","last_clean":"2024-04-17T19:50:27.504007+0000","last_became_active":"2024-04-17T19:46:56.691938+0000","last_became_peered":"2024-04-17T19:46:56.691938+0000","last_unstale":"2024-04-17T19:50:27.504007+0000","last_undegraded":"2024-04-17T19:50:27.504007+0000","last_fullsized":"2024-04-17T19:50:27.504007+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'8","last_scrub_stamp":"2024-04-17T19:50:27.503909+0000","last_deep_scrub":"27'8","last_deep_scrub_stamp":"2024-04-17T19:50:27.503909+0000","last_clean_scrub_stamp":"2024-04-17T19:50:27.503909+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T07:09:05.335014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"27'7","reported_seq":33,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:50:15.421402+0000","last_change":"2024-04-17T19:46:56.700707+0000","last_active":"2024-04-17T19:50:15.421402+0000","last_peered":"2024-04-17T19:50:15.421402+0000","last_clean":"2024-04-17T19:50:15.421402+0000","last_became_active":"2024-04-17T19:46:56.700346+0000","last_became_peered":"2024-04-17T19:46:56.700346+0000","last_unstale":"2024-04-17T19:50:15.421402+0000","last_undegraded":"2024-04-17T19:50:15.421402+0000","last_fullsized":"2024-04-17T19:50:15.421402+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_clean_scrub_stamp":"2024-04-17T19:46:55.648649+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"27'10","reported_seq":44,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:50:28.730498+0000","last_change":"2024-04-17T19:50:28.730638+0000","last_active":"2024-04-17T19:50:28.730498+0000","last_peered":"2024-04-17T19:50:28.730498+0000","last_clean":"2024-04-17T19:50:28.730498+0000","last_became_active":"2024-04-17T19:46:56.705076+0000","last_became_peered":"2024-04-17T19:46:56.705076+0000","last_unstale":"2024-04-17T19:50:28.730498+0000","last_undegraded":"2024-04-17T19:50:28.730498+0000","last_fullsized":"2024-04-17T19:50:28.730498+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'10","last_scrub_stamp":"2024-04-17T19:50:28.730233+0000","last_deep_scrub":"27'10","last_deep_scrub_stamp":"2024-04-17T19:50:28.730233+0000","last_clean_scrub_stamp":"2024-04-17T19:50:28.730233+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T05:57:12.594371+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"27'8","reported_seq":34,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:50:15.386104+0000","last_change":"2024-04-17T19:46:56.697436+0000","last_active":"2024-04-17T19:50:15.386104+0000","last_peered":"2024-04-17T19:50:15.386104+0000","last_clean":"2024-04-17T19:50:15.386104+0000","last_became_active":"2024-04-17T19:46:56.696667+0000","last_became_peered":"2024-04-17T19:46:56.696667+0000","last_unstale":"2024-04-17T19:50:15.386104+0000","last_undegraded":"2024-04-17T19:50:15.386104+0000","last_fullsized":"2024-04-17T19:50:15.386104+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:46:55.648649+0000","last_clean_scrub_stamp":"2024-04-17T19:46:55.648649+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"27'9","reported_seq":43,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:50:25.810141+0000","last_change":"2024-04-17T19:50:25.810171+0000","last_active":"2024-04-17T19:50:25.810141+0000","last_peered":"2024-04-17T19:50:25.810141+0000","last_clean":"2024-04-17T19:50:25.810141+0000","last_became_active":"2024-04-17T19:46:56.680224+0000","last_became_peered":"2024-04-17T19:46:56.680224+0000","last_unstale":"2024-04-17T19:50:25.810141+0000","last_undegraded":"2024-04-17T19:50:25.810141+0000","last_fullsized":"2024-04-17T19:50:25.810141+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'9","last_scrub_stamp":"2024-04-17T19:50:25.810043+0000","last_deep_scrub":"27'9","last_deep_scrub_stamp":"2024-04-17T19:50:25.810043+0000","last_clean_scrub_stamp":"2024-04-17T19:50:25.810043+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:38:33.092958+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.31","version":"27'7","reported_seq":41,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:50:34.202341+0000","last_change":"2024-04-17T19:50:34.202469+0000","last_active":"2024-04-17T19:50:34.202341+0000","last_peered":"2024-04-17T19:50:34.202341+0000","last_clean":"2024-04-17T19:50:34.202341+0000","last_became_active":"2024-04-17T19:46:56.688294+0000","last_became_peered":"2024-04-17T19:46:56.688294+0000","last_unstale":"2024-04-17T19:50:34.202341+0000","last_undegraded":"2024-04-17T19:50:34.202341+0000","last_fullsized":"2024-04-17T19:50:34.202341+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'7","last_scrub_stamp":"2024-04-17T19:50:34.202065+0000","last_deep_scrub":"27'7","last_deep_scrub_stamp":"2024-04-17T19:50:34.202065+0000","last_clean_scrub_stamp":"2024-04-17T19:50:34.202065+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:55:49.845743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.32","version":"27'8","reported_seq":42,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:50:27.739670+0000","last_change":"2024-04-17T19:50:27.739827+0000","last_active":"2024-04-17T19:50:27.739670+0000","last_peered":"2024-04-17T19:50:27.739670+0000","last_clean":"2024-04-17T19:50:27.739670+0000","last_became_active":"2024-04-17T19:46:56.684639+0000","last_became_peered":"2024-04-17T19:46:56.684639+0000","last_unstale":"2024-04-17T19:50:27.739670+0000","last_undegraded":"2024-04-17T19:50:27.739670+0000","last_fullsized":"2024-04-17T19:50:27.739670+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'8","last_scrub_stamp":"2024-04-17T19:50:27.739409+0000","last_deep_scrub":"27'8","last_deep_scrub_stamp":"2024-04-17T19:50:27.739409+0000","last_clean_scrub_stamp":"2024-04-17T19:50:27.739409+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T05:45:32.207863+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.33","version":"27'10","reported_seq":44,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:50:29.802330+0000","last_change":"2024-04-17T19:50:29.802401+0000","last_active":"2024-04-17T19:50:29.802330+0000","last_peered":"2024-04-17T19:50:29.802330+0000","last_clean":"2024-04-17T19:50:29.802330+0000","last_became_active":"2024-04-17T19:46:56.694213+0000","last_became_peered":"2024-04-17T19:46:56.694213+0000","last_unstale":"2024-04-17T19:50:29.802330+0000","last_undegraded":"2024-04-17T19:50:29.802330+0000","last_fullsized":"2024-04-17T19:50:29.802330+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'10","last_scrub_stamp":"2024-04-17T19:50:29.802116+0000","last_deep_scrub":"27'10","last_deep_scrub_stamp":"2024-04-17T19:50:29.802116+0000","last_clean_scrub_stamp":"2024-04-17T19:50:29.802116+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T02:46:33.795026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"27'7","reported_seq":41,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:50:19.528933+0000","last_change":"2024-04-17T19:50:19.528978+0000","last_active":"2024-04-17T19:50:19.528933+0000","last_peered":"2024-04-17T19:50:19.528933+0000","last_clean":"2024-04-17T19:50:19.528933+0000","last_became_active":"2024-04-17T19:46:56.692874+0000","last_became_peered":"2024-04-17T19:46:56.692874+0000","last_unstale":"2024-04-17T19:50:19.528933+0000","last_undegraded":"2024-04-17T19:50:19.528933+0000","last_fullsized":"2024-04-17T19:50:19.528933+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'7","last_scrub_stamp":"2024-04-17T19:50:19.528808+0000","last_deep_scrub":"27'7","last_deep_scrub_stamp":"2024-04-17T19:50:19.528808+0000","last_clean_scrub_stamp":"2024-04-17T19:50:19.528808+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T05:39:18.850822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"27'6","reported_seq":40,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:50:31.498571+0000","last_change":"2024-04-17T19:50:31.498600+0000","last_active":"2024-04-17T19:50:31.498571+0000","last_peered":"2024-04-17T19:50:31.498571+0000","last_clean":"2024-04-17T19:50:31.498571+0000","last_became_active":"2024-04-17T19:46:56.700013+0000","last_became_peered":"2024-04-17T19:46:56.700013+0000","last_unstale":"2024-04-17T19:50:31.498571+0000","last_undegraded":"2024-04-17T19:50:31.498571+0000","last_fullsized":"2024-04-17T19:50:31.498571+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'6","last_scrub_stamp":"2024-04-17T19:50:31.498470+0000","last_deep_scrub":"27'6","last_deep_scrub_stamp":"2024-04-17T19:50:31.498470+0000","last_clean_scrub_stamp":"2024-04-17T19:50:31.498470+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T05:01:36.166114+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.36","version":"27'16","reported_seq":50,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:50:33.480454+0000","last_change":"2024-04-17T19:50:33.480486+0000","last_active":"2024-04-17T19:50:33.480454+0000","last_peered":"2024-04-17T19:50:33.480454+0000","last_clean":"2024-04-17T19:50:33.480454+0000","last_became_active":"2024-04-17T19:46:56.708606+0000","last_became_peered":"2024-04-17T19:46:56.708606+0000","last_unstale":"2024-04-17T19:50:33.480454+0000","last_undegraded":"2024-04-17T19:50:33.480454+0000","last_fullsized":"2024-04-17T19:50:33.480454+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'16","last_scrub_stamp":"2024-04-17T19:50:33.480324+0000","last_deep_scrub":"27'16","last_deep_scrub_stamp":"2024-04-17T19:50:33.480324+0000","last_clean_scrub_stamp":"2024-04-17T19:50:33.480324+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T04:27:40.085233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.37","version":"27'11","reported_seq":45,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:50:22.562439+0000","last_change":"2024-04-17T19:50:22.562463+0000","last_active":"2024-04-17T19:50:22.562439+0000","last_peered":"2024-04-17T19:50:22.562439+0000","last_clean":"2024-04-17T19:50:22.562439+0000","last_became_active":"2024-04-17T19:46:56.680919+0000","last_became_peered":"2024-04-17T19:46:56.680919+0000","last_unstale":"2024-04-17T19:50:22.562439+0000","last_undegraded":"2024-04-17T19:50:22.562439+0000","last_fullsized":"2024-04-17T19:50:22.562439+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'11","last_scrub_stamp":"2024-04-17T19:50:22.562361+0000","last_deep_scrub":"27'11","last_deep_scrub_stamp":"2024-04-17T19:50:22.562361+0000","last_clean_scrub_stamp":"2024-04-17T19:50:22.562361+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T05:42:07.599649+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"27'9","reported_seq":43,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:50:35.159113+0000","last_change":"2024-04-17T19:50:35.159187+0000","last_active":"2024-04-17T19:50:35.159113+0000","last_peered":"2024-04-17T19:50:35.159113+0000","last_clean":"2024-04-17T19:50:35.159113+0000","last_became_active":"2024-04-17T19:46:56.688320+0000","last_became_peered":"2024-04-17T19:46:56.688320+0000","last_unstale":"2024-04-17T19:50:35.159113+0000","last_undegraded":"2024-04-17T19:50:35.159113+0000","last_fullsized":"2024-04-17T19:50:35.159113+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'9","last_scrub_stamp":"2024-04-17T19:50:35.158901+0000","last_deep_scrub":"27'9","last_deep_scrub_stamp":"2024-04-17T19:50:35.158901+0000","last_clean_scrub_stamp":"2024-04-17T19:50:35.158901+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T22:21:38.515740+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"27'5","reported_seq":39,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:50:30.535202+0000","last_change":"2024-04-17T19:50:30.535232+0000","last_active":"2024-04-17T19:50:30.535202+0000","last_peered":"2024-04-17T19:50:30.535202+0000","last_clean":"2024-04-17T19:50:30.535202+0000","last_became_active":"2024-04-17T19:46:56.698840+0000","last_became_peered":"2024-04-17T19:46:56.698840+0000","last_unstale":"2024-04-17T19:50:30.535202+0000","last_undegraded":"2024-04-17T19:50:30.535202+0000","last_fullsized":"2024-04-17T19:50:30.535202+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'5","last_scrub_stamp":"2024-04-17T19:50:30.535066+0000","last_deep_scrub":"27'5","last_deep_scrub_stamp":"2024-04-17T19:50:30.535066+0000","last_clean_scrub_stamp":"2024-04-17T19:50:30.535066+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:43:38.368978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"27'6","reported_seq":40,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:50:24.469606+0000","last_change":"2024-04-17T19:50:24.469666+0000","last_active":"2024-04-17T19:50:24.469606+0000","last_peered":"2024-04-17T19:50:24.469606+0000","last_clean":"2024-04-17T19:50:24.469606+0000","last_became_active":"2024-04-17T19:46:56.705539+0000","last_became_peered":"2024-04-17T19:46:56.705539+0000","last_unstale":"2024-04-17T19:50:24.469606+0000","last_undegraded":"2024-04-17T19:50:24.469606+0000","last_fullsized":"2024-04-17T19:50:24.469606+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'6","last_scrub_stamp":"2024-04-17T19:50:24.469421+0000","last_deep_scrub":"27'6","last_deep_scrub_stamp":"2024-04-17T19:50:24.469421+0000","last_clean_scrub_stamp":"2024-04-17T19:50:24.469421+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T00:50:25.248114+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"27'4","reported_seq":38,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:50:28.540132+0000","last_change":"2024-04-17T19:50:28.540164+0000","last_active":"2024-04-17T19:50:28.540132+0000","last_peered":"2024-04-17T19:50:28.540132+0000","last_clean":"2024-04-17T19:50:28.540132+0000","last_became_active":"2024-04-17T19:46:56.693954+0000","last_became_peered":"2024-04-17T19:46:56.693954+0000","last_unstale":"2024-04-17T19:50:28.540132+0000","last_undegraded":"2024-04-17T19:50:28.540132+0000","last_fullsized":"2024-04-17T19:50:28.540132+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'4","last_scrub_stamp":"2024-04-17T19:50:28.540030+0000","last_deep_scrub":"27'4","last_deep_scrub_stamp":"2024-04-17T19:50:28.540030+0000","last_clean_scrub_stamp":"2024-04-17T19:50:28.540030+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:50:00.347391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"27'8","reported_seq":42,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:50:27.462901+0000","last_change":"2024-04-17T19:50:27.462958+0000","last_active":"2024-04-17T19:50:27.462901+0000","last_peered":"2024-04-17T19:50:27.462901+0000","last_clean":"2024-04-17T19:50:27.462901+0000","last_became_active":"2024-04-17T19:46:56.706021+0000","last_became_peered":"2024-04-17T19:46:56.706021+0000","last_unstale":"2024-04-17T19:50:27.462901+0000","last_undegraded":"2024-04-17T19:50:27.462901+0000","last_fullsized":"2024-04-17T19:50:27.462901+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'8","last_scrub_stamp":"2024-04-17T19:50:27.462782+0000","last_deep_scrub":"27'8","last_deep_scrub_stamp":"2024-04-17T19:50:27.462782+0000","last_clean_scrub_stamp":"2024-04-17T19:50:27.462782+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:33:10.354916+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3d","version":"27'7","reported_seq":41,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:50:37.192409+0000","last_change":"2024-04-17T19:50:37.192543+0000","last_active":"2024-04-17T19:50:37.192409+0000","last_peered":"2024-04-17T19:50:37.192409+0000","last_clean":"2024-04-17T19:50:37.192409+0000","last_became_active":"2024-04-17T19:46:56.696492+0000","last_became_peered":"2024-04-17T19:46:56.696492+0000","last_unstale":"2024-04-17T19:50:37.192409+0000","last_undegraded":"2024-04-17T19:50:37.192409+0000","last_fullsized":"2024-04-17T19:50:37.192409+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'7","last_scrub_stamp":"2024-04-17T19:50:37.192050+0000","last_deep_scrub":"27'7","last_deep_scrub_stamp":"2024-04-17T19:50:37.192050+0000","last_clean_scrub_stamp":"2024-04-17T19:50:37.192050+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:31:10.067736+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"27'4","reported_seq":38,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:50:33.165191+0000","last_change":"2024-04-17T19:50:33.165290+0000","last_active":"2024-04-17T19:50:33.165191+0000","last_peered":"2024-04-17T19:50:33.165191+0000","last_clean":"2024-04-17T19:50:33.165191+0000","last_became_active":"2024-04-17T19:46:56.682772+0000","last_became_peered":"2024-04-17T19:46:56.682772+0000","last_unstale":"2024-04-17T19:50:33.165191+0000","last_undegraded":"2024-04-17T19:50:33.165191+0000","last_fullsized":"2024-04-17T19:50:33.165191+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'4","last_scrub_stamp":"2024-04-17T19:50:33.164945+0000","last_deep_scrub":"27'4","last_deep_scrub_stamp":"2024-04-17T19:50:33.164945+0000","last_clean_scrub_stamp":"2024-04-17T19:50:33.164945+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T05:23:35.837268+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3f","version":"27'8","reported_seq":42,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:50:29.527981+0000","last_change":"2024-04-17T19:50:29.528008+0000","last_active":"2024-04-17T19:50:29.527981+0000","last_peered":"2024-04-17T19:50:29.527981+0000","last_clean":"2024-04-17T19:50:29.527981+0000","last_became_active":"2024-04-17T19:46:56.694743+0000","last_became_peered":"2024-04-17T19:46:56.694743+0000","last_unstale":"2024-04-17T19:50:29.527981+0000","last_undegraded":"2024-04-17T19:50:29.527981+0000","last_fullsized":"2024-04-17T19:50:29.527981+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'8","last_scrub_stamp":"2024-04-17T19:50:29.527888+0000","last_deep_scrub":"27'8","last_deep_scrub_stamp":"2024-04-17T19:50:29.527888+0000","last_clean_scrub_stamp":"2024-04-17T19:50:29.527888+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T07:00:33.433456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":501,"ondisk_log_size":501,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":44818,"num_objects":99,"num_object_clones":0,"num_object_copies":198,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":99,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":261,"num_write_kb":128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":25000,"num_omap_keys":50,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":344064,"data_stored":89636,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":322,"ondisk_log_size":322,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":66496,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509490,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31492,"kb_used_data":316,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340348,"statfs":{"total":96636764160,"available":96604516352,"internally_reserved":0,"allocated":323584,"data_stored":117072,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509491,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27312,"kb_used_data":296,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344528,"statfs":{"total":96636764160,"available":96608796672,"internally_reserved":0,"allocated":303104,"data_stored":118385,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509491,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31496,"kb_used_data":320,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340344,"statfs":{"total":96636764160,"available":96604512256,"internally_reserved":0,"allocated":327680,"data_stored":118328,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509491,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27348,"kb_used_data":332,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344492,"statfs":{"total":96636764160,"available":96608759808,"internally_reserved":0,"allocated":339968,"data_stored":153259,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509490,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31536,"kb_used_data":360,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340304,"statfs":{"total":96636764160,"available":96604471296,"internally_reserved":0,"allocated":368640,"data_stored":707388,"data_compressed":33248,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509490,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31488,"kb_used_data":312,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340352,"statfs":{"total":96636764160,"available":96604520448,"internally_reserved":0,"allocated":319488,"data_stored":118547,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574899,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31544,"kb_used_data":368,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340296,"statfs":{"total":96636764160,"available":96604463104,"internally_reserved":0,"allocated":376832,"data_stored":707212,"data_compressed":33248,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574899,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31544,"kb_used_data":368,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340296,"statfs":{"total":96636764160,"available":96604463104,"internally_reserved":0,"allocated":376832,"data_stored":155029,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33248,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33248,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":2941,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1414,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":37653,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":2722,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":94208,"data_stored":39423,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1238,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2779,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":1466,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-17T19:50:43.754 INFO:tasks.ceph:pgid 4.d last_scrub_stamp 2024-04-17T19:46:59.695482+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=19, tm_min=46, tm_sec=59, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=19, tm_min=50, tm_sec=17, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T19:50:43.754 INFO:tasks.ceph:pgid 3.9 last_scrub_stamp 2024-04-17T19:46:55.648649+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=19, tm_min=46, tm_sec=55, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=19, tm_min=50, tm_sec=17, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T19:50:43.755 INFO:tasks.ceph:pgid 4.6 last_scrub_stamp 2024-04-17T19:46:59.695482+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=19, tm_min=46, tm_sec=59, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=19, tm_min=50, tm_sec=17, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T19:50:43.755 INFO:tasks.ceph:pgid 4.5 last_scrub_stamp 2024-04-17T19:46:59.695482+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=19, tm_min=46, tm_sec=59, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=19, tm_min=50, tm_sec=17, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T19:50:43.755 INFO:tasks.ceph:pgid 4.8 last_scrub_stamp 2024-04-17T19:46:59.695482+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=19, tm_min=46, tm_sec=59, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=19, tm_min=50, tm_sec=17, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T19:50:43.755 INFO:tasks.ceph:pgid 4.16 last_scrub_stamp 2024-04-17T19:46:59.695482+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=19, tm_min=46, tm_sec=59, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=19, tm_min=50, tm_sec=17, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T19:50:43.755 INFO:tasks.ceph:pgid 4.15 last_scrub_stamp 2024-04-17T19:46:59.695482+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=19, tm_min=46, tm_sec=59, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=19, tm_min=50, tm_sec=17, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T19:50:43.756 INFO:tasks.ceph:pgid 4.1f last_scrub_stamp 2024-04-17T19:46:59.695482+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=19, tm_min=46, tm_sec=59, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=19, tm_min=50, tm_sec=17, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T19:50:43.756 INFO:tasks.ceph:pgid 3.2d last_scrub_stamp 2024-04-17T19:46:55.648649+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=19, tm_min=46, tm_sec=55, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=19, tm_min=50, tm_sec=17, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T19:50:43.756 INFO:tasks.ceph:pgid 3.2f last_scrub_stamp 2024-04-17T19:46:55.648649+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=19, tm_min=46, tm_sec=55, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=19, tm_min=50, tm_sec=17, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T19:50:43.757 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-04-17T19:50:54.196 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T19:50:54.200 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T19:51:03.758 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-17T19:51:03.923 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:03.931+0000 7fe821600640 1 Processor -- start 2024-04-17T19:51:03.923 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:03.931+0000 7fe821600640 1 -- start start 2024-04-17T19:51:03.925 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:03.931+0000 7fe821600640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fe81c0c9680 0x7fe81c0c9c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:51:03.925 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:03.931+0000 7fe821600640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fe81c159b50 0x7fe81c159f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:51:03.925 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:03.931+0000 7fe821600640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe81c0c4680 con 0x7fe81c153760 2024-04-17T19:51:03.925 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:03.931+0000 7fe821600640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 -- 0x7fe81c0c4920 con 0x7fe81c159b50 2024-04-17T19:51:03.925 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:03.931+0000 7fe821600640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 -- 0x7fe81c0c4be0 con 0x7fe81c0c9680 2024-04-17T19:51:03.925 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:03.931+0000 7fe820c00640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fe81c159b50 0x7fe81c159f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:51:03.925 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:03.931+0000 7fe813e00640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7fe81c153760 0x7fe81c0cebd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:34074/0 (socket says 172.21.15.44:34074) 2024-04-17T19:51:03.925 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:03.935+0000 7fe813e00640 1 -- 172.21.15.44:0/2136272995 learned_addr learned my addr 172.21.15.44:0/2136272995 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-04-17T19:51:03.925 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:03.935+0000 7fe81be00640 1 --2- 172.21.15.44:0/2136272995 >> v2:172.21.15.62:3300/0 conn(0x7fe81c0c9680 0x7fe81c0c9c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:51:03.926 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:03.935+0000 7fe820c00640 1 -- 172.21.15.44:0/2136272995 >> v2:172.21.15.62:3300/0 conn(0x7fe81c0c9680 msgr2=0x7fe81c0c9c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T19:51:03.926 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:03.935+0000 7fe820c00640 1 --2- 172.21.15.44:0/2136272995 >> v2:172.21.15.62:3300/0 conn(0x7fe81c0c9680 0x7fe81c0c9c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:51:03.926 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:03.935+0000 7fe820c00640 1 -- 172.21.15.44:0/2136272995 >> v1:172.21.15.44:6789/0 conn(0x7fe81c153760 legacy=0x7fe81c0cebd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:51:03.926 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:03.935+0000 7fe820c00640 1 -- 172.21.15.44:0/2136272995 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe81c0c4ec0 con 0x7fe81c159b50 2024-04-17T19:51:03.926 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:03.935+0000 7fe81b400640 1 -- 172.21.15.44:0/2136272995 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2416633179 0 0) 0x7fe81c0c4680 con 0x7fe81c153760 2024-04-17T19:51:03.928 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:03.935+0000 7fe820c00640 1 --2- 172.21.15.44:0/2136272995 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe81c159b50 0x7fe81c159f60 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7fe81c0cf910 tx=0x7fe81401c930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b66b056efeba2764 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:51:03.928 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:03.935+0000 7fe81b400640 1 -- 172.21.15.44:0/2136272995 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8140b2070 con 0x7fe81c159b50 2024-04-17T19:51:03.929 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:03.935+0000 7fe81b400640 1 -- 172.21.15.44:0/2136272995 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe8140a5900 con 0x7fe81c159b50 2024-04-17T19:51:03.929 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:03.935+0000 7fe81b400640 1 -- 172.21.15.44:0/2136272995 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8140a5cd0 con 0x7fe81c159b50 2024-04-17T19:51:03.929 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:03.939+0000 7fe821600640 1 -- 172.21.15.44:0/2136272995 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe81c159b50 msgr2=0x7fe81c159f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:51:03.930 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:03.939+0000 7fe821600640 1 --2- 172.21.15.44:0/2136272995 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe81c159b50 0x7fe81c159f60 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7fe81c0cf910 tx=0x7fe81401c930 comp rx=0 tx=0).stop 2024-04-17T19:51:03.930 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:03.939+0000 7fe821600640 1 -- 172.21.15.44:0/2136272995 shutdown_connections 2024-04-17T19:51:03.930 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:03.939+0000 7fe821600640 1 --2- 172.21.15.44:0/2136272995 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe81c159b50 0x7fe81c159f60 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:51:03.930 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:03.939+0000 7fe821600640 1 --2- 172.21.15.44:0/2136272995 >> v2:172.21.15.62:3300/0 conn(0x7fe81c0c9680 0x7fe81c0c9c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:51:03.930 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:03.939+0000 7fe821600640 1 -- 172.21.15.44:0/2136272995 >> 172.21.15.44:0/2136272995 conn(0x7fe81c0682e0 msgr2=0x7fe81c0721e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:51:03.930 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:03.939+0000 7fe821600640 1 -- 172.21.15.44:0/2136272995 shutdown_connections 2024-04-17T19:51:03.930 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:03.939+0000 7fe821600640 1 -- 172.21.15.44:0/2136272995 wait complete. 2024-04-17T19:51:03.931 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:03.939+0000 7fe821600640 1 Processor -- start 2024-04-17T19:51:03.932 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:03.939+0000 7fe821600640 1 -- start start 2024-04-17T19:51:03.934 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:03.943+0000 7fe821600640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fe81c0c9680 0x7fe81c1f50f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:51:03.935 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:03.943+0000 7fe821600640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe81c153760 0x7fe81c157380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:51:03.935 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:03.943+0000 7fe821600640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe81c159b50 0x7fe81c0c7350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:51:03.935 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:03.943+0000 7fe821600640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fe81c0cf460 con 0x7fe81c159b50 2024-04-17T19:51:03.935 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:03.943+0000 7fe821600640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7fe81c0cf2e0 con 0x7fe81c153760 2024-04-17T19:51:03.935 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:03.943+0000 7fe821600640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7fe81c1669a0 con 0x7fe81c0c9680 2024-04-17T19:51:03.935 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:03.943+0000 7fe820c00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe81c159b50 0x7fe81c0c7350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:51:03.935 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:03.943+0000 7fe820c00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe81c159b50 0x7fe81c0c7350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:39018/0 (socket says 172.21.15.44:39018) 2024-04-17T19:51:03.935 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:03.943+0000 7fe820c00640 1 -- 172.21.15.44:0/2241825141 learned_addr learned my addr 172.21.15.44:0/2241825141 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-04-17T19:51:03.935 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:03.943+0000 7fe813e00640 1 --2- 172.21.15.44:0/2241825141 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe81c153760 0x7fe81c157380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:51:03.935 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:03.943+0000 7fe81be00640 1 --2- 172.21.15.44:0/2241825141 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fe81c0c9680 0x7fe81c1f50f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:51:03.935 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:03.943+0000 7fe820c00640 1 -- 172.21.15.44:0/2241825141 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fe81c0c9680 msgr2=0x7fe81c1f50f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:51:03.935 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:03.943+0000 7fe820c00640 1 --2- 172.21.15.44:0/2241825141 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fe81c0c9680 0x7fe81c1f50f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:51:03.935 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:03.943+0000 7fe820c00640 1 -- 172.21.15.44:0/2241825141 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe81c153760 msgr2=0x7fe81c157380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:51:03.936 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:03.943+0000 7fe820c00640 1 --2- 172.21.15.44:0/2241825141 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe81c153760 0x7fe81c157380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:51:03.936 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:03.943+0000 7fe820c00640 1 -- 172.21.15.44:0/2241825141 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe81c1f5630 con 0x7fe81c159b50 2024-04-17T19:51:03.936 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:03.943+0000 7fe81be00640 1 --2- 172.21.15.44:0/2241825141 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fe81c0c9680 0x7fe81c1f50f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-17T19:51:03.936 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:03.943+0000 7fe820c00640 1 --2- 172.21.15.44:0/2241825141 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe81c159b50 0x7fe81c0c7350 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7fe8140b0040 tx=0x7fe8140196d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:51:03.936 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:03.943+0000 7fe818c00640 1 -- 172.21.15.44:0/2241825141 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8140b2050 con 0x7fe81c159b50 2024-04-17T19:51:03.936 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:03.943+0000 7fe818c00640 1 -- 172.21.15.44:0/2241825141 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe8140b3040 con 0x7fe81c159b50 2024-04-17T19:51:03.936 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:03.943+0000 7fe818c00640 1 -- 172.21.15.44:0/2241825141 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe814003dc0 con 0x7fe81c159b50 2024-04-17T19:51:03.936 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:03.943+0000 7fe821600640 1 -- 172.21.15.44:0/2241825141 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe81c0c8660 con 0x7fe81c159b50 2024-04-17T19:51:03.936 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:03.943+0000 7fe821600640 1 -- 172.21.15.44:0/2241825141 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe81c0c8c20 con 0x7fe81c159b50 2024-04-17T19:51:03.937 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:03.943+0000 7fe821600640 1 -- 172.21.15.44:0/2241825141 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe81c1f49c0 con 0x7fe81c159b50 2024-04-17T19:51:03.937 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:03.943+0000 7fe818c00640 1 -- 172.21.15.44:0/2241825141 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fe8140c1060 con 0x7fe81c159b50 2024-04-17T19:51:03.937 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:03.947+0000 7fe818c00640 1 --2- 172.21.15.44:0/2241825141 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7fe7f8068380 0x7fe7f806a890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:51:03.938 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:03.947+0000 7fe818c00640 1 -- 172.21.15.44:0/2241825141 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6619+0+0 (secure 0 0 0) 0x7fe814120c50 con 0x7fe81c159b50 2024-04-17T19:51:03.938 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:03.947+0000 7fe81be00640 1 --2- 172.21.15.44:0/2241825141 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7fe7f8068380 0x7fe7f806a890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:51:03.939 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:03.947+0000 7fe81be00640 1 --2- 172.21.15.44:0/2241825141 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7fe7f8068380 0x7fe7f806a890 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fe80c009b10 tx=0x7fe80c008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:51:03.942 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:03.951+0000 7fe818c00640 1 -- 172.21.15.44:0/2241825141 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fe814016520 con 0x7fe81c159b50 2024-04-17T19:51:04.103 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:04.111+0000 7fe821600640 1 -- 172.21.15.44:0/2241825141 --> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fe81c0c83f0 con 0x7fe7f8068380 2024-04-17T19:51:04.129 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:04.139+0000 7fe818c00640 1 -- 172.21.15.44:0/2241825141 <== mgr.4102 v2:172.21.15.62:6832/1020159798 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+333127 (secure 0 0 0) 0x7fe81c0c83f0 con 0x7fe7f8068380 2024-04-17T19:51:04.133 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-04-17T19:51:04.135 INFO:teuthology.orchestra.run.smithi044.stderr:dumped all 2024-04-17T19:51:04.136 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:04.143+0000 7fe821600640 1 -- 172.21.15.44:0/2241825141 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7fe7f8068380 msgr2=0x7fe7f806a890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:51:04.136 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:04.143+0000 7fe821600640 1 --2- 172.21.15.44:0/2241825141 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7fe7f8068380 0x7fe7f806a890 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fe80c009b10 tx=0x7fe80c008040 comp rx=0 tx=0).stop 2024-04-17T19:51:04.136 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:04.143+0000 7fe821600640 1 -- 172.21.15.44:0/2241825141 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe81c159b50 msgr2=0x7fe81c0c7350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:51:04.136 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:04.143+0000 7fe821600640 1 --2- 172.21.15.44:0/2241825141 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe81c159b50 0x7fe81c0c7350 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7fe8140b0040 tx=0x7fe8140196d0 comp rx=0 tx=0).stop 2024-04-17T19:51:04.136 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:04.143+0000 7fe821600640 1 -- 172.21.15.44:0/2241825141 shutdown_connections 2024-04-17T19:51:04.136 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:04.143+0000 7fe821600640 1 --2- 172.21.15.44:0/2241825141 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7fe7f8068380 0x7fe7f806a890 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:51:04.136 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:04.143+0000 7fe821600640 1 --2- 172.21.15.44:0/2241825141 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe81c159b50 0x7fe81c0c7350 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:51:04.136 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:04.143+0000 7fe821600640 1 --2- 172.21.15.44:0/2241825141 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe81c153760 0x7fe81c157380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:51:04.136 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:04.143+0000 7fe821600640 1 --2- 172.21.15.44:0/2241825141 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fe81c0c9680 0x7fe81c1f50f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:51:04.137 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:04.143+0000 7fe821600640 1 -- 172.21.15.44:0/2241825141 >> 172.21.15.44:0/2241825141 conn(0x7fe81c0682e0 msgr2=0x7fe81c150440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:51:04.137 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:04.143+0000 7fe821600640 1 -- 172.21.15.44:0/2241825141 shutdown_connections 2024-04-17T19:51:04.137 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:04.143+0000 7fe821600640 1 -- 172.21.15.44:0/2241825141 wait complete. 2024-04-17T19:51:04.153 INFO:teuthology.orchestra.run.smithi044.stdout:{"pg_ready":true,"pg_map":{"version":152,"stamp":"2024-04-17T19:51:04.010454+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":635186,"num_objects":101,"num_object_clones":0,"num_object_copies":202,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":101,"num_whiteouts":0,"num_read":118,"num_read_kb":102,"num_write":422,"num_write_kb":2545,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":25000,"num_omap_keys":50,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":945,"ondisk_log_size":945,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":243760,"kb_used_data":2672,"kb_used_omap":12,"kb_used_meta":241011,"kb_avail":754730960,"statfs":{"total":773094113280,"available":772844503040,"internally_reserved":0,"allocated":2736128,"data_stored":2195220,"data_compressed":66496,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":12751,"internal_metadata":246795825},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.006048"},"pg_stats":[{"pgid":"2.1f","version":"27'19","reported_seq":55,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:50:25.674146+0000","last_change":"2024-04-17T19:50:25.674252+0000","last_active":"2024-04-17T19:50:25.674146+0000","last_peered":"2024-04-17T19:50:25.674146+0000","last_clean":"2024-04-17T19:50:25.674146+0000","last_became_active":"2024-04-17T19:46:55.687455+0000","last_became_peered":"2024-04-17T19:46:55.687455+0000","last_unstale":"2024-04-17T19:50:25.674146+0000","last_undegraded":"2024-04-17T19:50:25.674146+0000","last_fullsized":"2024-04-17T19:50:25.674146+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'19","last_scrub_stamp":"2024-04-17T19:50:25.673918+0000","last_deep_scrub":"27'19","last_deep_scrub_stamp":"2024-04-17T19:50:25.673918+0000","last_clean_scrub_stamp":"2024-04-17T19:50:25.673918+0000","objects_scrubbed":6,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:48:23.122011+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"27'5","reported_seq":40,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:50:25.077785+0000","last_change":"2024-04-17T19:50:25.077785+0000","last_active":"2024-04-17T19:50:25.077785+0000","last_peered":"2024-04-17T19:50:25.077785+0000","last_clean":"2024-04-17T19:50:25.077785+0000","last_became_active":"2024-04-17T19:46:56.683111+0000","last_became_peered":"2024-04-17T19:46:56.683111+0000","last_unstale":"2024-04-17T19:50:25.077785+0000","last_undegraded":"2024-04-17T19:50:25.077785+0000","last_fullsized":"2024-04-17T19:50:25.077785+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'5","last_scrub_stamp":"2024-04-17T19:50:25.077491+0000","last_deep_scrub":"27'5","last_deep_scrub_stamp":"2024-04-17T19:50:25.077491+0000","last_clean_scrub_stamp":"2024-04-17T19:50:25.077491+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:56:59.656692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":28,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:50:31.817484+0000","last_change":"2024-04-17T19:50:31.817580+0000","last_active":"2024-04-17T19:50:31.817484+0000","last_peered":"2024-04-17T19:50:31.817484+0000","last_clean":"2024-04-17T19:50:31.817484+0000","last_became_active":"2024-04-17T19:47:00.787654+0000","last_became_peered":"2024-04-17T19:47:00.787654+0000","last_unstale":"2024-04-17T19:50:31.817484+0000","last_undegraded":"2024-04-17T19:50:31.817484+0000","last_fullsized":"2024-04-17T19:50:31.817484+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:50:31.817267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:50:31.817267+0000","last_clean_scrub_stamp":"2024-04-17T19:50:31.817267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T00:50:32.595961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4,1],"acting":[7,6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1e","version":"25'2","reported_seq":39,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:50:26.067872+0000","last_change":"2024-04-17T19:50:26.067872+0000","last_active":"2024-04-17T19:50:26.067872+0000","last_peered":"2024-04-17T19:50:26.067872+0000","last_clean":"2024-04-17T19:50:26.067872+0000","last_became_active":"2024-04-17T19:46:55.695191+0000","last_became_peered":"2024-04-17T19:46:55.695191+0000","last_unstale":"2024-04-17T19:50:26.067872+0000","last_undegraded":"2024-04-17T19:50:26.067872+0000","last_fullsized":"2024-04-17T19:50:26.067872+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'2","last_scrub_stamp":"2024-04-17T19:50:26.067581+0000","last_deep_scrub":"25'2","last_deep_scrub_stamp":"2024-04-17T19:50:26.067581+0000","last_clean_scrub_stamp":"2024-04-17T19:50:26.067581+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:33:02.937785+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1f","version":"27'6","reported_seq":40,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:50:22.045742+0000","last_change":"2024-04-17T19:50:22.045813+0000","last_active":"2024-04-17T19:50:22.045742+0000","last_peered":"2024-04-17T19:50:22.045742+0000","last_clean":"2024-04-17T19:50:22.045742+0000","last_became_active":"2024-04-17T19:46:56.684475+0000","last_became_peered":"2024-04-17T19:46:56.684475+0000","last_unstale":"2024-04-17T19:50:22.045742+0000","last_undegraded":"2024-04-17T19:50:22.045742+0000","last_fullsized":"2024-04-17T19:50:22.045742+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'6","last_scrub_stamp":"2024-04-17T19:50:22.045527+0000","last_deep_scrub":"27'6","last_deep_scrub_stamp":"2024-04-17T19:50:22.045527+0000","last_clean_scrub_stamp":"2024-04-17T19:50:22.045527+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:41:58.854118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":28,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:50:32.377503+0000","last_change":"2024-04-17T19:50:32.377535+0000","last_active":"2024-04-17T19:50:32.377503+0000","last_peered":"2024-04-17T19:50:32.377503+0000","last_clean":"2024-04-17T19:50:32.377503+0000","last_became_active":"2024-04-17T19:47:00.769370+0000","last_became_peered":"2024-04-17T19:47:00.769370+0000","last_unstale":"2024-04-17T19:50:32.377503+0000","last_undegraded":"2024-04-17T19:50:32.377503+0000","last_fullsized":"2024-04-17T19:50:32.377503+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:50:32.377393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:50:32.377393+0000","last_clean_scrub_stamp":"2024-04-17T19:50:32.377393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:40:45.461056+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,4,6],"acting":[2,7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1d","version":"27'20","reported_seq":56,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:50:24.474659+0000","last_change":"2024-04-17T19:50:24.474714+0000","last_active":"2024-04-17T19:50:24.474659+0000","last_peered":"2024-04-17T19:50:24.474659+0000","last_clean":"2024-04-17T19:50:24.474659+0000","last_became_active":"2024-04-17T19:46:55.694285+0000","last_became_peered":"2024-04-17T19:46:55.694285+0000","last_unstale":"2024-04-17T19:50:24.474659+0000","last_undegraded":"2024-04-17T19:50:24.474659+0000","last_fullsized":"2024-04-17T19:50:24.474659+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'20","last_scrub_stamp":"2024-04-17T19:50:24.474541+0000","last_deep_scrub":"27'20","last_deep_scrub_stamp":"2024-04-17T19:50:24.474541+0000","last_clean_scrub_stamp":"2024-04-17T19:50:24.474541+0000","objects_scrubbed":7,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T19:52:16.697549+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"27'9","reported_seq":43,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:50:25.503674+0000","last_change":"2024-04-17T19:50:25.503734+0000","last_active":"2024-04-17T19:50:25.503674+0000","last_peered":"2024-04-17T19:50:25.503674+0000","last_clean":"2024-04-17T19:50:25.503674+0000","last_became_active":"2024-04-17T19:46:56.700413+0000","last_became_peered":"2024-04-17T19:46:56.700413+0000","last_unstale":"2024-04-17T19:50:25.503674+0000","last_undegraded":"2024-04-17T19:50:25.503674+0000","last_fullsized":"2024-04-17T19:50:25.503674+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'9","last_scrub_stamp":"2024-04-17T19:50:25.503554+0000","last_deep_scrub":"27'9","last_deep_scrub_stamp":"2024-04-17T19:50:25.503554+0000","last_clean_scrub_stamp":"2024-04-17T19:50:25.503554+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T00:30:34.681670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":28,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:50:33.334335+0000","last_change":"2024-04-17T19:50:33.334366+0000","last_active":"2024-04-17T19:50:33.334335+0000","last_peered":"2024-04-17T19:50:33.334335+0000","last_clean":"2024-04-17T19:50:33.334335+0000","last_became_active":"2024-04-17T19:47:00.771578+0000","last_became_peered":"2024-04-17T19:47:00.771578+0000","last_unstale":"2024-04-17T19:50:33.334335+0000","last_undegraded":"2024-04-17T19:50:33.334335+0000","last_fullsized":"2024-04-17T19:50:33.334335+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:50:33.334198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:50:33.334198+0000","last_clean_scrub_stamp":"2024-04-17T19:50:33.334198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T22:47:28.581714+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,3,6],"acting":[2,5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1c","version":"27'8","reported_seq":44,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:50:23.428725+0000","last_change":"2024-04-17T19:50:23.428756+0000","last_active":"2024-04-17T19:50:23.428725+0000","last_peered":"2024-04-17T19:50:23.428725+0000","last_clean":"2024-04-17T19:50:23.428725+0000","last_became_active":"2024-04-17T19:46:55.687282+0000","last_became_peered":"2024-04-17T19:46:55.687282+0000","last_unstale":"2024-04-17T19:50:23.428725+0000","last_undegraded":"2024-04-17T19:50:23.428725+0000","last_fullsized":"2024-04-17T19:50:23.428725+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'8","last_scrub_stamp":"2024-04-17T19:50:23.428653+0000","last_deep_scrub":"27'8","last_deep_scrub_stamp":"2024-04-17T19:50:23.428653+0000","last_clean_scrub_stamp":"2024-04-17T19:50:23.428653+0000","objects_scrubbed":3,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T05:45:27.897107+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"27'15","reported_seq":49,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:50:22.772083+0000","last_change":"2024-04-17T19:50:22.772128+0000","last_active":"2024-04-17T19:50:22.772083+0000","last_peered":"2024-04-17T19:50:22.772083+0000","last_clean":"2024-04-17T19:50:22.772083+0000","last_became_active":"2024-04-17T19:46:56.689988+0000","last_became_peered":"2024-04-17T19:46:56.689988+0000","last_unstale":"2024-04-17T19:50:22.772083+0000","last_undegraded":"2024-04-17T19:50:22.772083+0000","last_fullsized":"2024-04-17T19:50:22.772083+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'15","last_scrub_stamp":"2024-04-17T19:50:22.771978+0000","last_deep_scrub":"27'15","last_deep_scrub_stamp":"2024-04-17T19:50:22.771978+0000","last_clean_scrub_stamp":"2024-04-17T19:50:22.771978+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T01:42:51.824142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":28,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:50:29.382459+0000","last_change":"2024-04-17T19:50:29.382488+0000","last_active":"2024-04-17T19:50:29.382459+0000","last_peered":"2024-04-17T19:50:29.382459+0000","last_clean":"2024-04-17T19:50:29.382459+0000","last_became_active":"2024-04-17T19:47:00.759059+0000","last_became_peered":"2024-04-17T19:47:00.759059+0000","last_unstale":"2024-04-17T19:50:29.382459+0000","last_undegraded":"2024-04-17T19:50:29.382459+0000","last_fullsized":"2024-04-17T19:50:29.382459+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:50:29.382356+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:50:29.382356+0000","last_clean_scrub_stamp":"2024-04-17T19:50:29.382356+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T07:09:07.213461+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,5,7],"acting":[2,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"27'5","reported_seq":39,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:50:20.786568+0000","last_change":"2024-04-17T19:50:20.786610+0000","last_active":"2024-04-17T19:50:20.786568+0000","last_peered":"2024-04-17T19:50:20.786568+0000","last_clean":"2024-04-17T19:50:20.786568+0000","last_became_active":"2024-04-17T19:46:56.687662+0000","last_became_peered":"2024-04-17T19:46:56.687662+0000","last_unstale":"2024-04-17T19:50:20.786568+0000","last_undegraded":"2024-04-17T19:50:20.786568+0000","last_fullsized":"2024-04-17T19:50:20.786568+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'5","last_scrub_stamp":"2024-04-17T19:50:20.786436+0000","last_deep_scrub":"27'5","last_deep_scrub_stamp":"2024-04-17T19:50:20.786436+0000","last_clean_scrub_stamp":"2024-04-17T19:50:20.786436+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T00:49:16.372826+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"27'7","reported_seq":43,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:50:36.739095+0000","last_change":"2024-04-17T19:50:36.739135+0000","last_active":"2024-04-17T19:50:36.739095+0000","last_peered":"2024-04-17T19:50:36.739095+0000","last_clean":"2024-04-17T19:50:36.739095+0000","last_became_active":"2024-04-17T19:46:55.689006+0000","last_became_peered":"2024-04-17T19:46:55.689006+0000","last_unstale":"2024-04-17T19:50:36.739095+0000","last_undegraded":"2024-04-17T19:50:36.739095+0000","last_fullsized":"2024-04-17T19:50:36.739095+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'7","last_scrub_stamp":"2024-04-17T19:50:36.738995+0000","last_deep_scrub":"27'7","last_deep_scrub_stamp":"2024-04-17T19:50:36.738995+0000","last_clean_scrub_stamp":"2024-04-17T19:50:36.738995+0000","objects_scrubbed":2,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:56:15.474748+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":28,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:50:44.550323+0000","last_change":"2024-04-17T19:50:44.550354+0000","last_active":"2024-04-17T19:50:44.550323+0000","last_peered":"2024-04-17T19:50:44.550323+0000","last_clean":"2024-04-17T19:50:44.550323+0000","last_became_active":"2024-04-17T19:47:00.756456+0000","last_became_peered":"2024-04-17T19:47:00.756456+0000","last_unstale":"2024-04-17T19:50:44.550323+0000","last_undegraded":"2024-04-17T19:50:44.550323+0000","last_fullsized":"2024-04-17T19:50:44.550323+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:50:44.550186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:50:44.550186+0000","last_clean_scrub_stamp":"2024-04-17T19:50:44.550186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T02:19:57.543546+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,5],"acting":[3,1,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.b","version":"27'8","reported_seq":42,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:50:27.759803+0000","last_change":"2024-04-17T19:50:27.759870+0000","last_active":"2024-04-17T19:50:27.759803+0000","last_peered":"2024-04-17T19:50:27.759803+0000","last_clean":"2024-04-17T19:50:27.759803+0000","last_became_active":"2024-04-17T19:46:56.690828+0000","last_became_peered":"2024-04-17T19:46:56.690828+0000","last_unstale":"2024-04-17T19:50:27.759803+0000","last_undegraded":"2024-04-17T19:50:27.759803+0000","last_fullsized":"2024-04-17T19:50:27.759803+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'8","last_scrub_stamp":"2024-04-17T19:50:27.759602+0000","last_deep_scrub":"27'8","last_deep_scrub_stamp":"2024-04-17T19:50:27.759602+0000","last_clean_scrub_stamp":"2024-04-17T19:50:27.759602+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T02:48:21.958835+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.a","version":"27'6","reported_seq":42,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:50:24.665544+0000","last_change":"2024-04-17T19:50:24.665622+0000","last_active":"2024-04-17T19:50:24.665544+0000","last_peered":"2024-04-17T19:50:24.665544+0000","last_clean":"2024-04-17T19:50:24.665544+0000","last_became_active":"2024-04-17T19:46:55.715197+0000","last_became_peered":"2024-04-17T19:46:55.715197+0000","last_unstale":"2024-04-17T19:50:24.665544+0000","last_undegraded":"2024-04-17T19:50:24.665544+0000","last_fullsized":"2024-04-17T19:50:24.665544+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'6","last_scrub_stamp":"2024-04-17T19:50:24.665343+0000","last_deep_scrub":"27'6","last_deep_scrub_stamp":"2024-04-17T19:50:24.665343+0000","last_clean_scrub_stamp":"2024-04-17T19:50:24.665343+0000","objects_scrubbed":2,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T02:12:14.591521+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":28,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:50:34.478767+0000","last_change":"2024-04-17T19:50:34.478794+0000","last_active":"2024-04-17T19:50:34.478767+0000","last_peered":"2024-04-17T19:50:34.478767+0000","last_clean":"2024-04-17T19:50:34.478767+0000","last_became_active":"2024-04-17T19:47:00.773077+0000","last_became_peered":"2024-04-17T19:47:00.773077+0000","last_unstale":"2024-04-17T19:50:34.478767+0000","last_undegraded":"2024-04-17T19:50:34.478767+0000","last_fullsized":"2024-04-17T19:50:34.478767+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:50:34.478667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:50:34.478667+0000","last_clean_scrub_stamp":"2024-04-17T19:50:34.478667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:16:03.516500+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,6,1],"acting":[0,4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"27'9","reported_seq":43,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:50:31.639003+0000","last_change":"2024-04-17T19:50:31.639082+0000","last_active":"2024-04-17T19:50:31.639003+0000","last_peered":"2024-04-17T19:50:31.639003+0000","last_clean":"2024-04-17T19:50:31.639003+0000","last_became_active":"2024-04-17T19:46:56.695205+0000","last_became_peered":"2024-04-17T19:46:56.695205+0000","last_unstale":"2024-04-17T19:50:31.639003+0000","last_undegraded":"2024-04-17T19:50:31.639003+0000","last_fullsized":"2024-04-17T19:50:31.639003+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'9","last_scrub_stamp":"2024-04-17T19:50:31.638798+0000","last_deep_scrub":"27'9","last_deep_scrub_stamp":"2024-04-17T19:50:31.638798+0000","last_clean_scrub_stamp":"2024-04-17T19:50:31.638798+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T05:39:52.201151+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"27'11","reported_seq":47,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:50:24.662762+0000","last_change":"2024-04-17T19:50:24.662848+0000","last_active":"2024-04-17T19:50:24.662762+0000","last_peered":"2024-04-17T19:50:24.662762+0000","last_clean":"2024-04-17T19:50:24.662762+0000","last_became_active":"2024-04-17T19:46:55.684782+0000","last_became_peered":"2024-04-17T19:46:55.684782+0000","last_unstale":"2024-04-17T19:50:24.662762+0000","last_undegraded":"2024-04-17T19:50:24.662762+0000","last_fullsized":"2024-04-17T19:50:24.662762+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'11","last_scrub_stamp":"2024-04-17T19:50:24.662572+0000","last_deep_scrub":"27'11","last_deep_scrub_stamp":"2024-04-17T19:50:24.662572+0000","last_clean_scrub_stamp":"2024-04-17T19:50:24.662572+0000","objects_scrubbed":4,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:33:22.082901+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:50:35.472812+0000","last_change":"2024-04-17T19:50:35.472840+0000","last_active":"2024-04-17T19:50:35.472812+0000","last_peered":"2024-04-17T19:50:35.472812+0000","last_clean":"2024-04-17T19:50:35.472812+0000","last_became_active":"2024-04-17T19:47:38.474208+0000","last_became_peered":"2024-04-17T19:47:38.474208+0000","last_unstale":"2024-04-17T19:50:35.472812+0000","last_undegraded":"2024-04-17T19:50:35.472812+0000","last_fullsized":"2024-04-17T19:50:35.472812+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:50:35.472688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:50:35.472688+0000","last_clean_scrub_stamp":"2024-04-17T19:50:35.472688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T05:36:30.126180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2,3],"acting":[0,4,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"27'2","reported_seq":36,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:50:39.609883+0000","last_change":"2024-04-17T19:50:39.609915+0000","last_active":"2024-04-17T19:50:39.609883+0000","last_peered":"2024-04-17T19:50:39.609883+0000","last_clean":"2024-04-17T19:50:39.609883+0000","last_became_active":"2024-04-17T19:46:56.699525+0000","last_became_peered":"2024-04-17T19:46:56.699525+0000","last_unstale":"2024-04-17T19:50:39.609883+0000","last_undegraded":"2024-04-17T19:50:39.609883+0000","last_fullsized":"2024-04-17T19:50:39.609883+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2","last_scrub_stamp":"2024-04-17T19:50:39.609747+0000","last_deep_scrub":"27'2","last_deep_scrub_stamp":"2024-04-17T19:50:39.609747+0000","last_clean_scrub_stamp":"2024-04-17T19:50:39.609747+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T22:56:52.704671+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.8","version":"27'3","reported_seq":39,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:50:21.497956+0000","last_change":"2024-04-17T19:50:21.497983+0000","last_active":"2024-04-17T19:50:21.497956+0000","last_peered":"2024-04-17T19:50:21.497956+0000","last_clean":"2024-04-17T19:50:21.497956+0000","last_became_active":"2024-04-17T19:46:55.683145+0000","last_became_peered":"2024-04-17T19:46:55.683145+0000","last_unstale":"2024-04-17T19:50:21.497956+0000","last_undegraded":"2024-04-17T19:50:21.497956+0000","last_fullsized":"2024-04-17T19:50:21.497956+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'3","last_scrub_stamp":"2024-04-17T19:50:21.497879+0000","last_deep_scrub":"27'3","last_deep_scrub_stamp":"2024-04-17T19:50:21.497879+0000","last_clean_scrub_stamp":"2024-04-17T19:50:21.497879+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T04:32:34.992896+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":28,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:50:31.333368+0000","last_change":"2024-04-17T19:50:31.333397+0000","last_active":"2024-04-17T19:50:31.333368+0000","last_peered":"2024-04-17T19:50:31.333368+0000","last_clean":"2024-04-17T19:50:31.333368+0000","last_became_active":"2024-04-17T19:47:00.768277+0000","last_became_peered":"2024-04-17T19:47:00.768277+0000","last_unstale":"2024-04-17T19:50:31.333368+0000","last_undegraded":"2024-04-17T19:50:31.333368+0000","last_fullsized":"2024-04-17T19:50:31.333368+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:50:31.333237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:50:31.333237+0000","last_clean_scrub_stamp":"2024-04-17T19:50:31.333237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T07:00:35.238805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,7],"acting":[2,1,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"27'7","reported_seq":41,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:50:21.554760+0000","last_change":"2024-04-17T19:50:21.554944+0000","last_active":"2024-04-17T19:50:21.554760+0000","last_peered":"2024-04-17T19:50:21.554760+0000","last_clean":"2024-04-17T19:50:21.554760+0000","last_became_active":"2024-04-17T19:46:56.694993+0000","last_became_peered":"2024-04-17T19:46:56.694993+0000","last_unstale":"2024-04-17T19:50:21.554760+0000","last_undegraded":"2024-04-17T19:50:21.554760+0000","last_fullsized":"2024-04-17T19:50:21.554760+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'7","last_scrub_stamp":"2024-04-17T19:50:21.554509+0000","last_deep_scrub":"27'7","last_deep_scrub_stamp":"2024-04-17T19:50:21.554509+0000","last_clean_scrub_stamp":"2024-04-17T19:50:21.554509+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:06:11.860900+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"27'12","reported_seq":48,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:50:32.782762+0000","last_change":"2024-04-17T19:50:32.782802+0000","last_active":"2024-04-17T19:50:32.782762+0000","last_peered":"2024-04-17T19:50:32.782762+0000","last_clean":"2024-04-17T19:50:32.782762+0000","last_became_active":"2024-04-17T19:46:55.688507+0000","last_became_peered":"2024-04-17T19:46:55.688507+0000","last_unstale":"2024-04-17T19:50:32.782762+0000","last_undegraded":"2024-04-17T19:50:32.782762+0000","last_fullsized":"2024-04-17T19:50:32.782762+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'12","last_scrub_stamp":"2024-04-17T19:50:32.782655+0000","last_deep_scrub":"27'12","last_deep_scrub_stamp":"2024-04-17T19:50:32.782655+0000","last_clean_scrub_stamp":"2024-04-17T19:50:32.782655+0000","objects_scrubbed":4,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:09:39.177854+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":28,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:50:34.285998+0000","last_change":"2024-04-17T19:50:34.286026+0000","last_active":"2024-04-17T19:50:34.285998+0000","last_peered":"2024-04-17T19:50:34.285998+0000","last_clean":"2024-04-17T19:50:34.285998+0000","last_became_active":"2024-04-17T19:47:00.780994+0000","last_became_peered":"2024-04-17T19:47:00.780994+0000","last_unstale":"2024-04-17T19:50:34.285998+0000","last_undegraded":"2024-04-17T19:50:34.285998+0000","last_fullsized":"2024-04-17T19:50:34.285998+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:50:34.285902+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:50:34.285902+0000","last_clean_scrub_stamp":"2024-04-17T19:50:34.285902+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T05:06:23.545222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,3,1],"acting":[2,6,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"27'5","reported_seq":39,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:50:32.589394+0000","last_change":"2024-04-17T19:50:32.589465+0000","last_active":"2024-04-17T19:50:32.589394+0000","last_peered":"2024-04-17T19:50:32.589394+0000","last_clean":"2024-04-17T19:50:32.589394+0000","last_became_active":"2024-04-17T19:46:56.694650+0000","last_became_peered":"2024-04-17T19:46:56.694650+0000","last_unstale":"2024-04-17T19:50:32.589394+0000","last_undegraded":"2024-04-17T19:50:32.589394+0000","last_fullsized":"2024-04-17T19:50:32.589394+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'5","last_scrub_stamp":"2024-04-17T19:50:32.589185+0000","last_deep_scrub":"27'5","last_deep_scrub_stamp":"2024-04-17T19:50:32.589185+0000","last_clean_scrub_stamp":"2024-04-17T19:50:32.589185+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T01:48:52.524238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"27'21","reported_seq":57,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:50:23.625398+0000","last_change":"2024-04-17T19:50:23.625491+0000","last_active":"2024-04-17T19:50:23.625398+0000","last_peered":"2024-04-17T19:50:23.625398+0000","last_clean":"2024-04-17T19:50:23.625398+0000","last_became_active":"2024-04-17T19:46:55.680100+0000","last_became_peered":"2024-04-17T19:46:55.680100+0000","last_unstale":"2024-04-17T19:50:23.625398+0000","last_undegraded":"2024-04-17T19:50:23.625398+0000","last_fullsized":"2024-04-17T19:50:23.625398+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'21","last_scrub_stamp":"2024-04-17T19:50:23.625167+0000","last_deep_scrub":"27'21","last_deep_scrub_stamp":"2024-04-17T19:50:23.625167+0000","last_clean_scrub_stamp":"2024-04-17T19:50:23.625167+0000","objects_scrubbed":4,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:30:38.893156+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":33,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":29,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:50:37.570023+0000","last_change":"2024-04-17T19:50:37.570023+0000","last_active":"2024-04-17T19:50:37.570023+0000","last_peered":"2024-04-17T19:50:37.570023+0000","last_clean":"2024-04-17T19:50:37.570023+0000","last_became_active":"2024-04-17T19:47:00.776873+0000","last_became_peered":"2024-04-17T19:47:00.776873+0000","last_unstale":"2024-04-17T19:50:37.570023+0000","last_undegraded":"2024-04-17T19:50:37.570023+0000","last_fullsized":"2024-04-17T19:50:37.570023+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:50:37.569740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:50:37.569740+0000","last_clean_scrub_stamp":"2024-04-17T19:50:37.569740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T22:21:40.926579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,6,3],"acting":[4,1,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.4","version":"27'9","reported_seq":43,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:50:25.703665+0000","last_change":"2024-04-17T19:50:25.703733+0000","last_active":"2024-04-17T19:50:25.703665+0000","last_peered":"2024-04-17T19:50:25.703665+0000","last_clean":"2024-04-17T19:50:25.703665+0000","last_became_active":"2024-04-17T19:46:56.681316+0000","last_became_peered":"2024-04-17T19:46:56.681316+0000","last_unstale":"2024-04-17T19:50:25.703665+0000","last_undegraded":"2024-04-17T19:50:25.703665+0000","last_fullsized":"2024-04-17T19:50:25.703665+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'9","last_scrub_stamp":"2024-04-17T19:50:25.703455+0000","last_deep_scrub":"27'9","last_deep_scrub_stamp":"2024-04-17T19:50:25.703455+0000","last_clean_scrub_stamp":"2024-04-17T19:50:25.703455+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T04:32:39.198472+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"27'7","reported_seq":43,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:50:35.721097+0000","last_change":"2024-04-17T19:50:35.721130+0000","last_active":"2024-04-17T19:50:35.721097+0000","last_peered":"2024-04-17T19:50:35.721097+0000","last_clean":"2024-04-17T19:50:35.721097+0000","last_became_active":"2024-04-17T19:46:55.691031+0000","last_became_peered":"2024-04-17T19:46:55.691031+0000","last_unstale":"2024-04-17T19:50:35.721097+0000","last_undegraded":"2024-04-17T19:50:35.721097+0000","last_fullsized":"2024-04-17T19:50:35.721097+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'7","last_scrub_stamp":"2024-04-17T19:50:35.720991+0000","last_deep_scrub":"27'7","last_deep_scrub_stamp":"2024-04-17T19:50:35.720991+0000","last_clean_scrub_stamp":"2024-04-17T19:50:35.720991+0000","objects_scrubbed":3,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:03:06.622831+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":28,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:50:34.805894+0000","last_change":"2024-04-17T19:50:34.805964+0000","last_active":"2024-04-17T19:50:34.805894+0000","last_peered":"2024-04-17T19:50:34.805894+0000","last_clean":"2024-04-17T19:50:34.805894+0000","last_became_active":"2024-04-17T19:47:00.771531+0000","last_became_peered":"2024-04-17T19:47:00.771531+0000","last_unstale":"2024-04-17T19:50:34.805894+0000","last_undegraded":"2024-04-17T19:50:34.805894+0000","last_fullsized":"2024-04-17T19:50:34.805894+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:50:34.805674+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:50:34.805674+0000","last_clean_scrub_stamp":"2024-04-17T19:50:34.805674+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T05:01:39.473317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,2,7],"acting":[6,0,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"27'5","reported_seq":39,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:50:21.446685+0000","last_change":"2024-04-17T19:50:21.446713+0000","last_active":"2024-04-17T19:50:21.446685+0000","last_peered":"2024-04-17T19:50:21.446685+0000","last_clean":"2024-04-17T19:50:21.446685+0000","last_became_active":"2024-04-17T19:46:56.691801+0000","last_became_peered":"2024-04-17T19:46:56.691801+0000","last_unstale":"2024-04-17T19:50:21.446685+0000","last_undegraded":"2024-04-17T19:50:21.446685+0000","last_fullsized":"2024-04-17T19:50:21.446685+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'5","last_scrub_stamp":"2024-04-17T19:50:21.446598+0000","last_deep_scrub":"27'5","last_deep_scrub_stamp":"2024-04-17T19:50:21.446598+0000","last_clean_scrub_stamp":"2024-04-17T19:50:21.446598+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T05:57:05.310736+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"25'1","reported_seq":37,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:50:28.046983+0000","last_change":"2024-04-17T19:50:28.047055+0000","last_active":"2024-04-17T19:50:28.046983+0000","last_peered":"2024-04-17T19:50:28.046983+0000","last_clean":"2024-04-17T19:50:28.046983+0000","last_became_active":"2024-04-17T19:46:55.712908+0000","last_became_peered":"2024-04-17T19:46:55.712908+0000","last_unstale":"2024-04-17T19:50:28.046983+0000","last_undegraded":"2024-04-17T19:50:28.046983+0000","last_fullsized":"2024-04-17T19:50:28.046983+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'1","last_scrub_stamp":"2024-04-17T19:50:28.046766+0000","last_deep_scrub":"25'1","last_deep_scrub_stamp":"2024-04-17T19:50:28.046766+0000","last_clean_scrub_stamp":"2024-04-17T19:50:28.046766+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:57:01.778821+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":28,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:50:33.762256+0000","last_change":"2024-04-17T19:50:33.762336+0000","last_active":"2024-04-17T19:50:33.762256+0000","last_peered":"2024-04-17T19:50:33.762256+0000","last_clean":"2024-04-17T19:50:33.762256+0000","last_became_active":"2024-04-17T19:47:00.771385+0000","last_became_peered":"2024-04-17T19:47:00.771385+0000","last_unstale":"2024-04-17T19:50:33.762256+0000","last_undegraded":"2024-04-17T19:50:33.762256+0000","last_fullsized":"2024-04-17T19:50:33.762256+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:50:33.762005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:50:33.762005+0000","last_clean_scrub_stamp":"2024-04-17T19:50:33.762005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:43:41.595918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5,7],"acting":[6,3,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3","version":"27'7","reported_seq":41,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:50:32.510113+0000","last_change":"2024-04-17T19:50:32.510155+0000","last_active":"2024-04-17T19:50:32.510113+0000","last_peered":"2024-04-17T19:50:32.510113+0000","last_clean":"2024-04-17T19:50:32.510113+0000","last_became_active":"2024-04-17T19:46:56.708572+0000","last_became_peered":"2024-04-17T19:46:56.708572+0000","last_unstale":"2024-04-17T19:50:32.510113+0000","last_undegraded":"2024-04-17T19:50:32.510113+0000","last_fullsized":"2024-04-17T19:50:32.510113+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'7","last_scrub_stamp":"2024-04-17T19:50:32.510018+0000","last_deep_scrub":"27'7","last_deep_scrub_stamp":"2024-04-17T19:50:32.510018+0000","last_clean_scrub_stamp":"2024-04-17T19:50:32.510018+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T05:06:21.769339+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"27'7","reported_seq":43,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:50:37.704622+0000","last_change":"2024-04-17T19:50:37.704663+0000","last_active":"2024-04-17T19:50:37.704622+0000","last_peered":"2024-04-17T19:50:37.704622+0000","last_clean":"2024-04-17T19:50:37.704622+0000","last_became_active":"2024-04-17T19:46:55.708175+0000","last_became_peered":"2024-04-17T19:46:55.708175+0000","last_unstale":"2024-04-17T19:50:37.704622+0000","last_undegraded":"2024-04-17T19:50:37.704622+0000","last_fullsized":"2024-04-17T19:50:37.704622+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'7","last_scrub_stamp":"2024-04-17T19:50:37.704516+0000","last_deep_scrub":"27'7","last_deep_scrub_stamp":"2024-04-17T19:50:37.704516+0000","last_clean_scrub_stamp":"2024-04-17T19:50:37.704516+0000","objects_scrubbed":2,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:47:01.135691+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":28,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:50:36.794323+0000","last_change":"2024-04-17T19:50:36.794398+0000","last_active":"2024-04-17T19:50:36.794323+0000","last_peered":"2024-04-17T19:50:36.794323+0000","last_clean":"2024-04-17T19:50:36.794323+0000","last_became_active":"2024-04-17T19:47:00.780743+0000","last_became_peered":"2024-04-17T19:47:00.780743+0000","last_unstale":"2024-04-17T19:50:36.794323+0000","last_undegraded":"2024-04-17T19:50:36.794323+0000","last_fullsized":"2024-04-17T19:50:36.794323+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:50:36.794052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:50:36.794052+0000","last_clean_scrub_stamp":"2024-04-17T19:50:36.794052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T04:27:43.398961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0,3],"acting":[6,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"27'8","reported_seq":43,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:50:32.157790+0000","last_change":"2024-04-17T19:50:32.157790+0000","last_active":"2024-04-17T19:50:32.157790+0000","last_peered":"2024-04-17T19:50:32.157790+0000","last_clean":"2024-04-17T19:50:32.157790+0000","last_became_active":"2024-04-17T19:46:56.679230+0000","last_became_peered":"2024-04-17T19:46:56.679230+0000","last_unstale":"2024-04-17T19:50:32.157790+0000","last_undegraded":"2024-04-17T19:50:32.157790+0000","last_fullsized":"2024-04-17T19:50:32.157790+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'8","last_scrub_stamp":"2024-04-17T19:50:32.157487+0000","last_deep_scrub":"27'8","last_deep_scrub_stamp":"2024-04-17T19:50:32.157487+0000","last_clean_scrub_stamp":"2024-04-17T19:50:32.157487+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:39:55.835904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"27'12","reported_seq":50,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:50:25.731452+0000","last_change":"2024-04-17T19:50:25.731536+0000","last_active":"2024-04-17T19:50:25.731452+0000","last_peered":"2024-04-17T19:50:25.731452+0000","last_clean":"2024-04-17T19:50:25.731452+0000","last_became_active":"2024-04-17T19:46:55.715247+0000","last_became_peered":"2024-04-17T19:46:55.715247+0000","last_unstale":"2024-04-17T19:50:25.731452+0000","last_undegraded":"2024-04-17T19:50:25.731452+0000","last_fullsized":"2024-04-17T19:50:25.731452+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'12","last_scrub_stamp":"2024-04-17T19:50:25.731248+0000","last_deep_scrub":"27'12","last_deep_scrub_stamp":"2024-04-17T19:50:25.731248+0000","last_clean_scrub_stamp":"2024-04-17T19:50:25.731248+0000","objects_scrubbed":4,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T01:44:01.234209+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":524,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":28,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:50:32.770110+0000","last_change":"2024-04-17T19:50:32.770180+0000","last_active":"2024-04-17T19:50:32.770110+0000","last_peered":"2024-04-17T19:50:32.770110+0000","last_clean":"2024-04-17T19:50:32.770110+0000","last_became_active":"2024-04-17T19:47:00.768634+0000","last_became_peered":"2024-04-17T19:47:00.768634+0000","last_unstale":"2024-04-17T19:50:32.770110+0000","last_undegraded":"2024-04-17T19:50:32.770110+0000","last_fullsized":"2024-04-17T19:50:32.770110+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:50:32.769839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:50:32.769839+0000","last_clean_scrub_stamp":"2024-04-17T19:50:32.769839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T07:00:36.675406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,7],"acting":[6,0,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"27'5","reported_seq":39,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:50:31.777025+0000","last_change":"2024-04-17T19:50:31.777097+0000","last_active":"2024-04-17T19:50:31.777025+0000","last_peered":"2024-04-17T19:50:31.777025+0000","last_clean":"2024-04-17T19:50:31.777025+0000","last_became_active":"2024-04-17T19:46:56.703148+0000","last_became_peered":"2024-04-17T19:46:56.703148+0000","last_unstale":"2024-04-17T19:50:31.777025+0000","last_undegraded":"2024-04-17T19:50:31.777025+0000","last_fullsized":"2024-04-17T19:50:31.777025+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'5","last_scrub_stamp":"2024-04-17T19:50:31.776815+0000","last_deep_scrub":"27'5","last_deep_scrub_stamp":"2024-04-17T19:50:31.776815+0000","last_clean_scrub_stamp":"2024-04-17T19:50:31.776815+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:50:03.584176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"27'5","reported_seq":42,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:50:29.756294+0000","last_change":"2024-04-17T19:50:29.756294+0000","last_active":"2024-04-17T19:50:29.756294+0000","last_peered":"2024-04-17T19:50:29.756294+0000","last_clean":"2024-04-17T19:50:29.756294+0000","last_became_active":"2024-04-17T19:46:55.715527+0000","last_became_peered":"2024-04-17T19:46:55.715527+0000","last_unstale":"2024-04-17T19:50:29.756294+0000","last_undegraded":"2024-04-17T19:50:29.756294+0000","last_fullsized":"2024-04-17T19:50:29.756294+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'5","last_scrub_stamp":"2024-04-17T19:50:29.756106+0000","last_deep_scrub":"27'5","last_deep_scrub_stamp":"2024-04-17T19:50:29.756106+0000","last_clean_scrub_stamp":"2024-04-17T19:50:29.756106+0000","objects_scrubbed":1,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T04:41:30.743957+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":28,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:50:41.152023+0000","last_change":"2024-04-17T19:50:41.152103+0000","last_active":"2024-04-17T19:50:41.152023+0000","last_peered":"2024-04-17T19:50:41.152023+0000","last_clean":"2024-04-17T19:50:41.152023+0000","last_became_active":"2024-04-17T19:47:00.783386+0000","last_became_peered":"2024-04-17T19:47:00.783386+0000","last_unstale":"2024-04-17T19:50:41.152023+0000","last_undegraded":"2024-04-17T19:50:41.152023+0000","last_fullsized":"2024-04-17T19:50:41.152023+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:50:41.151750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:50:41.151750+0000","last_clean_scrub_stamp":"2024-04-17T19:50:41.151750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T05:58:58.314276+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6,1],"acting":[5,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"27'8","reported_seq":42,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:50:30.676084+0000","last_change":"2024-04-17T19:50:30.676178+0000","last_active":"2024-04-17T19:50:30.676084+0000","last_peered":"2024-04-17T19:50:30.676084+0000","last_clean":"2024-04-17T19:50:30.676084+0000","last_became_active":"2024-04-17T19:46:56.691917+0000","last_became_peered":"2024-04-17T19:46:56.691917+0000","last_unstale":"2024-04-17T19:50:30.676084+0000","last_undegraded":"2024-04-17T19:50:30.676084+0000","last_fullsized":"2024-04-17T19:50:30.676084+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'8","last_scrub_stamp":"2024-04-17T19:50:30.675815+0000","last_deep_scrub":"27'8","last_deep_scrub_stamp":"2024-04-17T19:50:30.675815+0000","last_clean_scrub_stamp":"2024-04-17T19:50:30.675815+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:57:04.407869+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.3","version":"27'11","reported_seq":47,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:50:30.788818+0000","last_change":"2024-04-17T19:50:30.788859+0000","last_active":"2024-04-17T19:50:30.788818+0000","last_peered":"2024-04-17T19:50:30.788818+0000","last_clean":"2024-04-17T19:50:30.788818+0000","last_became_active":"2024-04-17T19:46:55.685599+0000","last_became_peered":"2024-04-17T19:46:55.685599+0000","last_unstale":"2024-04-17T19:50:30.788818+0000","last_undegraded":"2024-04-17T19:50:30.788818+0000","last_fullsized":"2024-04-17T19:50:30.788818+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'11","last_scrub_stamp":"2024-04-17T19:50:30.788727+0000","last_deep_scrub":"27'11","last_deep_scrub_stamp":"2024-04-17T19:50:30.788727+0000","last_clean_scrub_stamp":"2024-04-17T19:50:30.788727+0000","objects_scrubbed":5,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:14:16.711052+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"27'119","reported_seq":195,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:50:19.569421+0000","last_change":"2024-04-17T19:50:19.569421+0000","last_active":"2024-04-17T19:50:19.569421+0000","last_peered":"2024-04-17T19:50:19.569421+0000","last_clean":"2024-04-17T19:50:19.569421+0000","last_became_active":"2024-04-17T19:46:43.000652+0000","last_became_peered":"2024-04-17T19:46:43.000652+0000","last_unstale":"2024-04-17T19:50:19.569421+0000","last_undegraded":"2024-04-17T19:50:19.569421+0000","last_fullsized":"2024-04-17T19:50:19.569421+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'119","last_scrub_stamp":"2024-04-17T19:50:19.569239+0000","last_deep_scrub":"27'119","last_deep_scrub_stamp":"2024-04-17T19:50:19.569239+0000","last_clean_scrub_stamp":"2024-04-17T19:50:19.569239+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:07:38.005068+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":28,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:50:41.575145+0000","last_change":"2024-04-17T19:50:41.575175+0000","last_active":"2024-04-17T19:50:41.575145+0000","last_peered":"2024-04-17T19:50:41.575145+0000","last_clean":"2024-04-17T19:50:41.575145+0000","last_became_active":"2024-04-17T19:47:00.731093+0000","last_became_peered":"2024-04-17T19:47:00.731093+0000","last_unstale":"2024-04-17T19:50:41.575145+0000","last_undegraded":"2024-04-17T19:50:41.575145+0000","last_fullsized":"2024-04-17T19:50:41.575145+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:50:41.575040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:50:41.575040+0000","last_clean_scrub_stamp":"2024-04-17T19:50:41.575040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:52:30.077482+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.d","version":"27'7","reported_seq":41,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:50:24.769041+0000","last_change":"2024-04-17T19:50:24.769113+0000","last_active":"2024-04-17T19:50:24.769041+0000","last_peered":"2024-04-17T19:50:24.769041+0000","last_clean":"2024-04-17T19:50:24.769041+0000","last_became_active":"2024-04-17T19:46:56.692106+0000","last_became_peered":"2024-04-17T19:46:56.692106+0000","last_unstale":"2024-04-17T19:50:24.769041+0000","last_undegraded":"2024-04-17T19:50:24.769041+0000","last_fullsized":"2024-04-17T19:50:24.769041+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'7","last_scrub_stamp":"2024-04-17T19:50:24.768931+0000","last_deep_scrub":"27'7","last_deep_scrub_stamp":"2024-04-17T19:50:24.768931+0000","last_clean_scrub_stamp":"2024-04-17T19:50:24.768931+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T05:01:29.436574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.c","version":"27'9","reported_seq":45,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:50:22.657409+0000","last_change":"2024-04-17T19:50:22.657492+0000","last_active":"2024-04-17T19:50:22.657409+0000","last_peered":"2024-04-17T19:50:22.657409+0000","last_clean":"2024-04-17T19:50:22.657409+0000","last_became_active":"2024-04-17T19:46:55.689059+0000","last_became_peered":"2024-04-17T19:46:55.689059+0000","last_unstale":"2024-04-17T19:50:22.657409+0000","last_undegraded":"2024-04-17T19:50:22.657409+0000","last_fullsized":"2024-04-17T19:50:22.657409+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'9","last_scrub_stamp":"2024-04-17T19:50:22.657189+0000","last_deep_scrub":"27'9","last_deep_scrub_stamp":"2024-04-17T19:50:22.657189+0000","last_clean_scrub_stamp":"2024-04-17T19:50:22.657189+0000","objects_scrubbed":3,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T19:55:07.248866+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1569,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":28,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:50:30.372979+0000","last_change":"2024-04-17T19:50:30.373007+0000","last_active":"2024-04-17T19:50:30.372979+0000","last_peered":"2024-04-17T19:50:30.372979+0000","last_clean":"2024-04-17T19:50:30.372979+0000","last_became_active":"2024-04-17T19:47:00.759946+0000","last_became_peered":"2024-04-17T19:47:00.759946+0000","last_unstale":"2024-04-17T19:50:30.372979+0000","last_undegraded":"2024-04-17T19:50:30.372979+0000","last_fullsized":"2024-04-17T19:50:30.372979+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:50:30.372876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:50:30.372876+0000","last_clean_scrub_stamp":"2024-04-17T19:50:30.372876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T02:10:27.930543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,7,4],"acting":[2,3,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"27'6","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:50:38.567840+0000","last_change":"2024-04-17T19:50:38.567981+0000","last_active":"2024-04-17T19:50:38.567840+0000","last_peered":"2024-04-17T19:50:38.567840+0000","last_clean":"2024-04-17T19:50:38.567840+0000","last_became_active":"2024-04-17T19:47:37.967613+0000","last_became_peered":"2024-04-17T19:47:37.967613+0000","last_unstale":"2024-04-17T19:50:38.567840+0000","last_undegraded":"2024-04-17T19:50:38.567840+0000","last_fullsized":"2024-04-17T19:50:38.567840+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'6","last_scrub_stamp":"2024-04-17T19:50:38.567487+0000","last_deep_scrub":"27'6","last_deep_scrub_stamp":"2024-04-17T19:50:38.567487+0000","last_clean_scrub_stamp":"2024-04-17T19:50:38.567487+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T07:33:13.995099+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.d","version":"27'4","reported_seq":40,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:50:27.052069+0000","last_change":"2024-04-17T19:50:27.052147+0000","last_active":"2024-04-17T19:50:27.052069+0000","last_peered":"2024-04-17T19:50:27.052069+0000","last_clean":"2024-04-17T19:50:27.052069+0000","last_became_active":"2024-04-17T19:46:55.703334+0000","last_became_peered":"2024-04-17T19:46:55.703334+0000","last_unstale":"2024-04-17T19:50:27.052069+0000","last_undegraded":"2024-04-17T19:50:27.052069+0000","last_fullsized":"2024-04-17T19:50:27.052069+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'4","last_scrub_stamp":"2024-04-17T19:50:27.051846+0000","last_deep_scrub":"27'4","last_deep_scrub_stamp":"2024-04-17T19:50:27.051846+0000","last_clean_scrub_stamp":"2024-04-17T19:50:27.051846+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:20:51.361202+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":28,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:50:38.189429+0000","last_change":"2024-04-17T19:50:38.189562+0000","last_active":"2024-04-17T19:50:38.189429+0000","last_peered":"2024-04-17T19:50:38.189429+0000","last_clean":"2024-04-17T19:50:38.189429+0000","last_became_active":"2024-04-17T19:47:00.744227+0000","last_became_peered":"2024-04-17T19:47:00.744227+0000","last_unstale":"2024-04-17T19:50:38.189429+0000","last_undegraded":"2024-04-17T19:50:38.189429+0000","last_fullsized":"2024-04-17T19:50:38.189429+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:50:38.189160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:50:38.189160+0000","last_clean_scrub_stamp":"2024-04-17T19:50:38.189160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T05:16:08.344646+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1,3],"acting":[5,4,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"27'9","reported_seq":43,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:50:26.454757+0000","last_change":"2024-04-17T19:50:26.454785+0000","last_active":"2024-04-17T19:50:26.454757+0000","last_peered":"2024-04-17T19:50:26.454757+0000","last_clean":"2024-04-17T19:50:26.454757+0000","last_became_active":"2024-04-17T19:46:56.687352+0000","last_became_peered":"2024-04-17T19:46:56.687352+0000","last_unstale":"2024-04-17T19:50:26.454757+0000","last_undegraded":"2024-04-17T19:50:26.454757+0000","last_fullsized":"2024-04-17T19:50:26.454757+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'9","last_scrub_stamp":"2024-04-17T19:50:26.454653+0000","last_deep_scrub":"27'9","last_deep_scrub_stamp":"2024-04-17T19:50:26.454653+0000","last_clean_scrub_stamp":"2024-04-17T19:50:26.454653+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T02:46:30.447563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.e","version":"27'7","reported_seq":43,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:50:27.673773+0000","last_change":"2024-04-17T19:50:27.673859+0000","last_active":"2024-04-17T19:50:27.673773+0000","last_peered":"2024-04-17T19:50:27.673773+0000","last_clean":"2024-04-17T19:50:27.673773+0000","last_became_active":"2024-04-17T19:46:55.715196+0000","last_became_peered":"2024-04-17T19:46:55.715196+0000","last_unstale":"2024-04-17T19:50:27.673773+0000","last_undegraded":"2024-04-17T19:50:27.673773+0000","last_fullsized":"2024-04-17T19:50:27.673773+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'7","last_scrub_stamp":"2024-04-17T19:50:27.673548+0000","last_deep_scrub":"27'7","last_deep_scrub_stamp":"2024-04-17T19:50:27.673548+0000","last_clean_scrub_stamp":"2024-04-17T19:50:27.673548+0000","objects_scrubbed":2,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T22:24:07.004354+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":28,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:50:42.526645+0000","last_change":"2024-04-17T19:50:42.526676+0000","last_active":"2024-04-17T19:50:42.526645+0000","last_peered":"2024-04-17T19:50:42.526645+0000","last_clean":"2024-04-17T19:50:42.526645+0000","last_became_active":"2024-04-17T19:47:00.735120+0000","last_became_peered":"2024-04-17T19:47:00.735120+0000","last_unstale":"2024-04-17T19:50:42.526645+0000","last_undegraded":"2024-04-17T19:50:42.526645+0000","last_fullsized":"2024-04-17T19:50:42.526645+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:50:42.526539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:50:42.526539+0000","last_clean_scrub_stamp":"2024-04-17T19:50:42.526539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T00:51:35.071921+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"27'5","reported_seq":39,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:50:26.472337+0000","last_change":"2024-04-17T19:50:26.472369+0000","last_active":"2024-04-17T19:50:26.472337+0000","last_peered":"2024-04-17T19:50:26.472337+0000","last_clean":"2024-04-17T19:50:26.472337+0000","last_became_active":"2024-04-17T19:46:56.704786+0000","last_became_peered":"2024-04-17T19:46:56.704786+0000","last_unstale":"2024-04-17T19:50:26.472337+0000","last_undegraded":"2024-04-17T19:50:26.472337+0000","last_fullsized":"2024-04-17T19:50:26.472337+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'5","last_scrub_stamp":"2024-04-17T19:50:26.472243+0000","last_deep_scrub":"27'5","last_deep_scrub_stamp":"2024-04-17T19:50:26.472243+0000","last_clean_scrub_stamp":"2024-04-17T19:50:26.472243+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T04:35:48.987478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.f","version":"27'4","reported_seq":40,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:50:25.504504+0000","last_change":"2024-04-17T19:50:25.504544+0000","last_active":"2024-04-17T19:50:25.504504+0000","last_peered":"2024-04-17T19:50:25.504504+0000","last_clean":"2024-04-17T19:50:25.504504+0000","last_became_active":"2024-04-17T19:46:55.706729+0000","last_became_peered":"2024-04-17T19:46:55.706729+0000","last_unstale":"2024-04-17T19:50:25.504504+0000","last_undegraded":"2024-04-17T19:50:25.504504+0000","last_fullsized":"2024-04-17T19:50:25.504504+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'4","last_scrub_stamp":"2024-04-17T19:50:25.504381+0000","last_deep_scrub":"27'4","last_deep_scrub_stamp":"2024-04-17T19:50:25.504381+0000","last_clean_scrub_stamp":"2024-04-17T19:50:25.504381+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:33:08.396515+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":28,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:50:26.521860+0000","last_change":"2024-04-17T19:50:26.521889+0000","last_active":"2024-04-17T19:50:26.521860+0000","last_peered":"2024-04-17T19:50:26.521860+0000","last_clean":"2024-04-17T19:50:26.521860+0000","last_became_active":"2024-04-17T19:47:00.743582+0000","last_became_peered":"2024-04-17T19:47:00.743582+0000","last_unstale":"2024-04-17T19:50:26.521860+0000","last_undegraded":"2024-04-17T19:50:26.521860+0000","last_fullsized":"2024-04-17T19:50:26.521860+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:50:26.521764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:50:26.521764+0000","last_clean_scrub_stamp":"2024-04-17T19:50:26.521764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:54:13.935388+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,2],"acting":[1,5,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"27'6","reported_seq":40,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:50:26.818686+0000","last_change":"2024-04-17T19:50:26.818714+0000","last_active":"2024-04-17T19:50:26.818686+0000","last_peered":"2024-04-17T19:50:26.818686+0000","last_clean":"2024-04-17T19:50:26.818686+0000","last_became_active":"2024-04-17T19:46:56.692038+0000","last_became_peered":"2024-04-17T19:46:56.692038+0000","last_unstale":"2024-04-17T19:50:26.818686+0000","last_undegraded":"2024-04-17T19:50:26.818686+0000","last_fullsized":"2024-04-17T19:50:26.818686+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'6","last_scrub_stamp":"2024-04-17T19:50:26.818588+0000","last_deep_scrub":"27'6","last_deep_scrub_stamp":"2024-04-17T19:50:26.818588+0000","last_clean_scrub_stamp":"2024-04-17T19:50:26.818588+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T04:27:33.423497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.10","version":"27'26","reported_seq":62,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:50:26.657570+0000","last_change":"2024-04-17T19:50:26.657685+0000","last_active":"2024-04-17T19:50:26.657570+0000","last_peered":"2024-04-17T19:50:26.657570+0000","last_clean":"2024-04-17T19:50:26.657570+0000","last_became_active":"2024-04-17T19:46:55.691286+0000","last_became_peered":"2024-04-17T19:46:55.691286+0000","last_unstale":"2024-04-17T19:50:26.657570+0000","last_undegraded":"2024-04-17T19:50:26.657570+0000","last_fullsized":"2024-04-17T19:50:26.657570+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'26","last_scrub_stamp":"2024-04-17T19:50:26.657344+0000","last_deep_scrub":"27'26","last_deep_scrub_stamp":"2024-04-17T19:50:26.657344+0000","last_clean_scrub_stamp":"2024-04-17T19:50:26.657344+0000","objects_scrubbed":8,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:35:54.933030+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":28,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:50:40.127875+0000","last_change":"2024-04-17T19:50:40.127944+0000","last_active":"2024-04-17T19:50:40.127875+0000","last_peered":"2024-04-17T19:50:40.127875+0000","last_clean":"2024-04-17T19:50:40.127875+0000","last_became_active":"2024-04-17T19:47:00.780167+0000","last_became_peered":"2024-04-17T19:47:00.780167+0000","last_unstale":"2024-04-17T19:50:40.127875+0000","last_undegraded":"2024-04-17T19:50:40.127875+0000","last_fullsized":"2024-04-17T19:50:40.127875+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:50:40.127656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:50:40.127656+0000","last_clean_scrub_stamp":"2024-04-17T19:50:40.127656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T01:33:27.259721+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1,6],"acting":[5,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"27'6","reported_seq":40,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:50:21.544760+0000","last_change":"2024-04-17T19:50:21.544786+0000","last_active":"2024-04-17T19:50:21.544760+0000","last_peered":"2024-04-17T19:50:21.544760+0000","last_clean":"2024-04-17T19:50:21.544760+0000","last_became_active":"2024-04-17T19:46:56.675826+0000","last_became_peered":"2024-04-17T19:46:56.675826+0000","last_unstale":"2024-04-17T19:50:21.544760+0000","last_undegraded":"2024-04-17T19:50:21.544760+0000","last_fullsized":"2024-04-17T19:50:21.544760+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'6","last_scrub_stamp":"2024-04-17T19:50:21.544672+0000","last_deep_scrub":"27'6","last_deep_scrub_stamp":"2024-04-17T19:50:21.544672+0000","last_clean_scrub_stamp":"2024-04-17T19:50:21.544672+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T05:06:34.238949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.11","version":"27'8","reported_seq":44,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:50:20.521351+0000","last_change":"2024-04-17T19:50:20.521411+0000","last_active":"2024-04-17T19:50:20.521351+0000","last_peered":"2024-04-17T19:50:20.521351+0000","last_clean":"2024-04-17T19:50:20.521351+0000","last_became_active":"2024-04-17T19:46:55.681607+0000","last_became_peered":"2024-04-17T19:46:55.681607+0000","last_unstale":"2024-04-17T19:50:20.521351+0000","last_undegraded":"2024-04-17T19:50:20.521351+0000","last_fullsized":"2024-04-17T19:50:20.521351+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'8","last_scrub_stamp":"2024-04-17T19:50:20.521185+0000","last_deep_scrub":"27'8","last_deep_scrub_stamp":"2024-04-17T19:50:20.521185+0000","last_clean_scrub_stamp":"2024-04-17T19:50:20.521185+0000","objects_scrubbed":3,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T02:12:10.447363+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":28,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:50:39.163506+0000","last_change":"2024-04-17T19:50:39.163584+0000","last_active":"2024-04-17T19:50:39.163506+0000","last_peered":"2024-04-17T19:50:39.163506+0000","last_clean":"2024-04-17T19:50:39.163506+0000","last_became_active":"2024-04-17T19:47:00.755282+0000","last_became_peered":"2024-04-17T19:47:00.755282+0000","last_unstale":"2024-04-17T19:50:39.163506+0000","last_undegraded":"2024-04-17T19:50:39.163506+0000","last_fullsized":"2024-04-17T19:50:39.163506+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:50:39.163255+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:50:39.163255+0000","last_clean_scrub_stamp":"2024-04-17T19:50:39.163255+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:34:40.689185+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6,4],"acting":[5,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"27'15","reported_seq":49,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:50:28.790880+0000","last_change":"2024-04-17T19:50:28.790914+0000","last_active":"2024-04-17T19:50:28.790880+0000","last_peered":"2024-04-17T19:50:28.790880+0000","last_clean":"2024-04-17T19:50:28.790880+0000","last_became_active":"2024-04-17T19:46:56.694449+0000","last_became_peered":"2024-04-17T19:46:56.694449+0000","last_unstale":"2024-04-17T19:50:28.790880+0000","last_undegraded":"2024-04-17T19:50:28.790880+0000","last_fullsized":"2024-04-17T19:50:28.790880+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'15","last_scrub_stamp":"2024-04-17T19:50:28.790790+0000","last_deep_scrub":"27'15","last_deep_scrub_stamp":"2024-04-17T19:50:28.790790+0000","last_clean_scrub_stamp":"2024-04-17T19:50:28.790790+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T02:46:37.967518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.12","version":"27'9","reported_seq":45,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:50:33.773097+0000","last_change":"2024-04-17T19:50:33.773141+0000","last_active":"2024-04-17T19:50:33.773097+0000","last_peered":"2024-04-17T19:50:33.773097+0000","last_clean":"2024-04-17T19:50:33.773097+0000","last_became_active":"2024-04-17T19:46:55.689607+0000","last_became_peered":"2024-04-17T19:46:55.689607+0000","last_unstale":"2024-04-17T19:50:33.773097+0000","last_undegraded":"2024-04-17T19:50:33.773097+0000","last_fullsized":"2024-04-17T19:50:33.773097+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'9","last_scrub_stamp":"2024-04-17T19:50:33.772990+0000","last_deep_scrub":"27'9","last_deep_scrub_stamp":"2024-04-17T19:50:33.772990+0000","last_clean_scrub_stamp":"2024-04-17T19:50:33.772990+0000","objects_scrubbed":3,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T02:08:35.754599+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":28,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:50:35.789465+0000","last_change":"2024-04-17T19:50:35.789536+0000","last_active":"2024-04-17T19:50:35.789465+0000","last_peered":"2024-04-17T19:50:35.789465+0000","last_clean":"2024-04-17T19:50:35.789465+0000","last_became_active":"2024-04-17T19:47:00.781025+0000","last_became_peered":"2024-04-17T19:47:00.781025+0000","last_unstale":"2024-04-17T19:50:35.789465+0000","last_undegraded":"2024-04-17T19:50:35.789465+0000","last_fullsized":"2024-04-17T19:50:35.789465+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:50:35.789229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:50:35.789229+0000","last_clean_scrub_stamp":"2024-04-17T19:50:35.789229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T05:06:25.048549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0,7],"acting":[6,4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.12","version":"27'9","reported_seq":43,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:50:28.757857+0000","last_change":"2024-04-17T19:50:28.757926+0000","last_active":"2024-04-17T19:50:28.757857+0000","last_peered":"2024-04-17T19:50:28.757857+0000","last_clean":"2024-04-17T19:50:28.757857+0000","last_became_active":"2024-04-17T19:46:56.687385+0000","last_became_peered":"2024-04-17T19:46:56.687385+0000","last_unstale":"2024-04-17T19:50:28.757857+0000","last_undegraded":"2024-04-17T19:50:28.757857+0000","last_fullsized":"2024-04-17T19:50:28.757857+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'9","last_scrub_stamp":"2024-04-17T19:50:28.757645+0000","last_deep_scrub":"27'9","last_deep_scrub_stamp":"2024-04-17T19:50:28.757645+0000","last_clean_scrub_stamp":"2024-04-17T19:50:28.757645+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:02:51.661927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"27'15","reported_seq":51,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:50:23.759425+0000","last_change":"2024-04-17T19:50:23.759508+0000","last_active":"2024-04-17T19:50:23.759425+0000","last_peered":"2024-04-17T19:50:23.759425+0000","last_clean":"2024-04-17T19:50:23.759425+0000","last_became_active":"2024-04-17T19:46:55.698962+0000","last_became_peered":"2024-04-17T19:46:55.698962+0000","last_unstale":"2024-04-17T19:50:23.759425+0000","last_undegraded":"2024-04-17T19:50:23.759425+0000","last_fullsized":"2024-04-17T19:50:23.759425+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'15","last_scrub_stamp":"2024-04-17T19:50:23.759206+0000","last_deep_scrub":"27'15","last_deep_scrub_stamp":"2024-04-17T19:50:23.759206+0000","last_clean_scrub_stamp":"2024-04-17T19:50:23.759206+0000","objects_scrubbed":6,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:11:25.730463+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":28,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:50:45.583358+0000","last_change":"2024-04-17T19:50:45.583387+0000","last_active":"2024-04-17T19:50:45.583358+0000","last_peered":"2024-04-17T19:50:45.583358+0000","last_clean":"2024-04-17T19:50:45.583358+0000","last_became_active":"2024-04-17T19:47:00.759892+0000","last_became_peered":"2024-04-17T19:47:00.759892+0000","last_unstale":"2024-04-17T19:50:45.583358+0000","last_undegraded":"2024-04-17T19:50:45.583358+0000","last_fullsized":"2024-04-17T19:50:45.583358+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:50:45.583253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:50:45.583253+0000","last_clean_scrub_stamp":"2024-04-17T19:50:45.583253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T05:51:32.877568+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5,6],"acting":[3,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"27'6","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:50:32.771784+0000","last_change":"2024-04-17T19:50:32.771858+0000","last_active":"2024-04-17T19:50:32.771784+0000","last_peered":"2024-04-17T19:50:32.771784+0000","last_clean":"2024-04-17T19:50:32.771784+0000","last_became_active":"2024-04-17T19:47:37.968623+0000","last_became_peered":"2024-04-17T19:47:37.968623+0000","last_unstale":"2024-04-17T19:50:32.771784+0000","last_undegraded":"2024-04-17T19:50:32.771784+0000","last_fullsized":"2024-04-17T19:50:32.771784+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'6","last_scrub_stamp":"2024-04-17T19:50:32.771588+0000","last_deep_scrub":"27'6","last_deep_scrub_stamp":"2024-04-17T19:50:32.771588+0000","last_clean_scrub_stamp":"2024-04-17T19:50:32.771588+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:42:26.764363+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"27'36","reported_seq":72,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:50:20.493946+0000","last_change":"2024-04-17T19:50:20.494007+0000","last_active":"2024-04-17T19:50:20.493946+0000","last_peered":"2024-04-17T19:50:20.493946+0000","last_clean":"2024-04-17T19:50:20.493946+0000","last_became_active":"2024-04-17T19:46:55.696876+0000","last_became_peered":"2024-04-17T19:46:55.696876+0000","last_unstale":"2024-04-17T19:50:20.493946+0000","last_undegraded":"2024-04-17T19:50:20.493946+0000","last_fullsized":"2024-04-17T19:50:20.493946+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'36","last_scrub_stamp":"2024-04-17T19:50:20.493864+0000","last_deep_scrub":"27'36","last_deep_scrub_stamp":"2024-04-17T19:50:20.493864+0000","last_clean_scrub_stamp":"2024-04-17T19:50:20.493864+0000","objects_scrubbed":6,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T02:48:14.693097+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":37585,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":33,"num_write_kb":52,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"27'3","reported_seq":31,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:50:33.579024+0000","last_change":"2024-04-17T19:50:33.579107+0000","last_active":"2024-04-17T19:50:33.579024+0000","last_peered":"2024-04-17T19:50:33.579024+0000","last_clean":"2024-04-17T19:50:33.579024+0000","last_became_active":"2024-04-17T19:47:00.742290+0000","last_became_peered":"2024-04-17T19:47:00.742290+0000","last_unstale":"2024-04-17T19:50:33.579024+0000","last_undegraded":"2024-04-17T19:50:33.579024+0000","last_fullsized":"2024-04-17T19:50:33.579024+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'3","last_scrub_stamp":"2024-04-17T19:50:33.578782+0000","last_deep_scrub":"27'3","last_deep_scrub_stamp":"2024-04-17T19:50:33.578782+0000","last_clean_scrub_stamp":"2024-04-17T19:50:33.578782+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:24:06.950808+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,5,0],"acting":[4,3,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"27'11","reported_seq":45,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:50:27.819153+0000","last_change":"2024-04-17T19:50:27.819186+0000","last_active":"2024-04-17T19:50:27.819153+0000","last_peered":"2024-04-17T19:50:27.819153+0000","last_clean":"2024-04-17T19:50:27.819153+0000","last_became_active":"2024-04-17T19:46:56.680171+0000","last_became_peered":"2024-04-17T19:46:56.680171+0000","last_unstale":"2024-04-17T19:50:27.819153+0000","last_undegraded":"2024-04-17T19:50:27.819153+0000","last_fullsized":"2024-04-17T19:50:27.819153+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'11","last_scrub_stamp":"2024-04-17T19:50:27.819055+0000","last_deep_scrub":"27'11","last_deep_scrub_stamp":"2024-04-17T19:50:27.819055+0000","last_clean_scrub_stamp":"2024-04-17T19:50:27.819055+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:15:56.856888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.15","version":"27'12","reported_seq":48,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:50:24.767714+0000","last_change":"2024-04-17T19:50:24.767865+0000","last_active":"2024-04-17T19:50:24.767714+0000","last_peered":"2024-04-17T19:50:24.767714+0000","last_clean":"2024-04-17T19:50:24.767714+0000","last_became_active":"2024-04-17T19:46:55.706967+0000","last_became_peered":"2024-04-17T19:46:55.706967+0000","last_unstale":"2024-04-17T19:50:24.767714+0000","last_undegraded":"2024-04-17T19:50:24.767714+0000","last_fullsized":"2024-04-17T19:50:24.767714+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'12","last_scrub_stamp":"2024-04-17T19:50:24.767391+0000","last_deep_scrub":"27'12","last_deep_scrub_stamp":"2024-04-17T19:50:24.767391+0000","last_clean_scrub_stamp":"2024-04-17T19:50:24.767391+0000","objects_scrubbed":4,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:55:04.789357+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":28,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:50:28.427111+0000","last_change":"2024-04-17T19:50:28.427138+0000","last_active":"2024-04-17T19:50:28.427111+0000","last_peered":"2024-04-17T19:50:28.427111+0000","last_clean":"2024-04-17T19:50:28.427111+0000","last_became_active":"2024-04-17T19:47:00.758209+0000","last_became_peered":"2024-04-17T19:47:00.758209+0000","last_unstale":"2024-04-17T19:50:28.427111+0000","last_undegraded":"2024-04-17T19:50:28.427111+0000","last_fullsized":"2024-04-17T19:50:28.427111+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:50:28.427008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:50:28.427008+0000","last_clean_scrub_stamp":"2024-04-17T19:50:28.427008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T02:46:32.419918+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1,7],"acting":[2,3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"27'9","reported_seq":43,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:50:23.060566+0000","last_change":"2024-04-17T19:50:23.060634+0000","last_active":"2024-04-17T19:50:23.060566+0000","last_peered":"2024-04-17T19:50:23.060566+0000","last_clean":"2024-04-17T19:50:23.060566+0000","last_became_active":"2024-04-17T19:46:56.683685+0000","last_became_peered":"2024-04-17T19:46:56.683685+0000","last_unstale":"2024-04-17T19:50:23.060566+0000","last_undegraded":"2024-04-17T19:50:23.060566+0000","last_fullsized":"2024-04-17T19:50:23.060566+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'9","last_scrub_stamp":"2024-04-17T19:50:23.060363+0000","last_deep_scrub":"27'9","last_deep_scrub_stamp":"2024-04-17T19:50:23.060363+0000","last_clean_scrub_stamp":"2024-04-17T19:50:23.060363+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:42:11.876156+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"27'6","reported_seq":42,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:50:22.465768+0000","last_change":"2024-04-17T19:50:22.465797+0000","last_active":"2024-04-17T19:50:22.465768+0000","last_peered":"2024-04-17T19:50:22.465768+0000","last_clean":"2024-04-17T19:50:22.465768+0000","last_became_active":"2024-04-17T19:46:55.687019+0000","last_became_peered":"2024-04-17T19:46:55.687019+0000","last_unstale":"2024-04-17T19:50:22.465768+0000","last_undegraded":"2024-04-17T19:50:22.465768+0000","last_fullsized":"2024-04-17T19:50:22.465768+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'6","last_scrub_stamp":"2024-04-17T19:50:22.465695+0000","last_deep_scrub":"27'6","last_deep_scrub_stamp":"2024-04-17T19:50:22.465695+0000","last_clean_scrub_stamp":"2024-04-17T19:50:22.465695+0000","objects_scrubbed":2,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:55:28.800074+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":28,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:50:30.808320+0000","last_change":"2024-04-17T19:50:30.808387+0000","last_active":"2024-04-17T19:50:30.808320+0000","last_peered":"2024-04-17T19:50:30.808320+0000","last_clean":"2024-04-17T19:50:30.808320+0000","last_became_active":"2024-04-17T19:47:00.777053+0000","last_became_peered":"2024-04-17T19:47:00.777053+0000","last_unstale":"2024-04-17T19:50:30.808320+0000","last_undegraded":"2024-04-17T19:50:30.808320+0000","last_fullsized":"2024-04-17T19:50:30.808320+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:50:30.808113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:50:30.808113+0000","last_clean_scrub_stamp":"2024-04-17T19:50:30.808113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:42:04.878402+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,3,2],"acting":[7,1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"27'10","reported_seq":44,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:50:22.420110+0000","last_change":"2024-04-17T19:50:22.420133+0000","last_active":"2024-04-17T19:50:22.420110+0000","last_peered":"2024-04-17T19:50:22.420110+0000","last_clean":"2024-04-17T19:50:22.420110+0000","last_became_active":"2024-04-17T19:46:56.692287+0000","last_became_peered":"2024-04-17T19:46:56.692287+0000","last_unstale":"2024-04-17T19:50:22.420110+0000","last_undegraded":"2024-04-17T19:50:22.420110+0000","last_fullsized":"2024-04-17T19:50:22.420110+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'10","last_scrub_stamp":"2024-04-17T19:50:22.420031+0000","last_deep_scrub":"27'10","last_deep_scrub_stamp":"2024-04-17T19:50:22.420031+0000","last_clean_scrub_stamp":"2024-04-17T19:50:22.420031+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:38:14.319185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.17","version":"27'8","reported_seq":44,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:50:20.536890+0000","last_change":"2024-04-17T19:50:20.536928+0000","last_active":"2024-04-17T19:50:20.536890+0000","last_peered":"2024-04-17T19:50:20.536890+0000","last_clean":"2024-04-17T19:50:20.536890+0000","last_became_active":"2024-04-17T19:46:55.691354+0000","last_became_peered":"2024-04-17T19:46:55.691354+0000","last_unstale":"2024-04-17T19:50:20.536890+0000","last_undegraded":"2024-04-17T19:50:20.536890+0000","last_fullsized":"2024-04-17T19:50:20.536890+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'8","last_scrub_stamp":"2024-04-17T19:50:20.536822+0000","last_deep_scrub":"27'8","last_deep_scrub_stamp":"2024-04-17T19:50:20.536822+0000","last_clean_scrub_stamp":"2024-04-17T19:50:20.536822+0000","objects_scrubbed":3,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T00:32:34.736066+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":28,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:50:35.539932+0000","last_change":"2024-04-17T19:50:35.540062+0000","last_active":"2024-04-17T19:50:35.539932+0000","last_peered":"2024-04-17T19:50:35.539932+0000","last_clean":"2024-04-17T19:50:35.539932+0000","last_became_active":"2024-04-17T19:47:00.763550+0000","last_became_peered":"2024-04-17T19:47:00.763550+0000","last_unstale":"2024-04-17T19:50:35.539932+0000","last_undegraded":"2024-04-17T19:50:35.539932+0000","last_fullsized":"2024-04-17T19:50:35.539932+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:50:35.539666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:50:35.539666+0000","last_clean_scrub_stamp":"2024-04-17T19:50:35.539666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T05:23:38.211990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,3,7],"acting":[4,0,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":29,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:50:34.562835+0000","last_change":"2024-04-17T19:50:34.562835+0000","last_active":"2024-04-17T19:50:34.562835+0000","last_peered":"2024-04-17T19:50:34.562835+0000","last_clean":"2024-04-17T19:50:34.562835+0000","last_became_active":"2024-04-17T19:47:00.744828+0000","last_became_peered":"2024-04-17T19:47:00.744828+0000","last_unstale":"2024-04-17T19:50:34.562835+0000","last_undegraded":"2024-04-17T19:50:34.562835+0000","last_fullsized":"2024-04-17T19:50:34.562835+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:50:34.562556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:50:34.562556+0000","last_clean_scrub_stamp":"2024-04-17T19:50:34.562556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:18:30.014267+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,5,3],"acting":[4,1,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"27'10","reported_seq":44,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:50:29.662967+0000","last_change":"2024-04-17T19:50:29.663048+0000","last_active":"2024-04-17T19:50:29.662967+0000","last_peered":"2024-04-17T19:50:29.662967+0000","last_clean":"2024-04-17T19:50:29.662967+0000","last_became_active":"2024-04-17T19:46:56.690810+0000","last_became_peered":"2024-04-17T19:46:56.690810+0000","last_unstale":"2024-04-17T19:50:29.662967+0000","last_undegraded":"2024-04-17T19:50:29.662967+0000","last_fullsized":"2024-04-17T19:50:29.662967+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'10","last_scrub_stamp":"2024-04-17T19:50:29.662751+0000","last_deep_scrub":"27'10","last_deep_scrub_stamp":"2024-04-17T19:50:29.662751+0000","last_clean_scrub_stamp":"2024-04-17T19:50:29.662751+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:28:57.615862+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.18","version":"27'4","reported_seq":40,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:50:34.748085+0000","last_change":"2024-04-17T19:50:34.748121+0000","last_active":"2024-04-17T19:50:34.748085+0000","last_peered":"2024-04-17T19:50:34.748085+0000","last_clean":"2024-04-17T19:50:34.748085+0000","last_became_active":"2024-04-17T19:46:55.690539+0000","last_became_peered":"2024-04-17T19:46:55.690539+0000","last_unstale":"2024-04-17T19:50:34.748085+0000","last_undegraded":"2024-04-17T19:50:34.748085+0000","last_fullsized":"2024-04-17T19:50:34.748085+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'4","last_scrub_stamp":"2024-04-17T19:50:34.747947+0000","last_deep_scrub":"27'4","last_deep_scrub_stamp":"2024-04-17T19:50:34.747947+0000","last_clean_scrub_stamp":"2024-04-17T19:50:34.747947+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:10:36.597623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":28,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:50:43.576715+0000","last_change":"2024-04-17T19:50:43.576738+0000","last_active":"2024-04-17T19:50:43.576715+0000","last_peered":"2024-04-17T19:50:43.576715+0000","last_clean":"2024-04-17T19:50:43.576715+0000","last_became_active":"2024-04-17T19:47:00.749061+0000","last_became_peered":"2024-04-17T19:47:00.749061+0000","last_unstale":"2024-04-17T19:50:43.576715+0000","last_undegraded":"2024-04-17T19:50:43.576715+0000","last_fullsized":"2024-04-17T19:50:43.576715+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:50:43.576636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:50:43.576636+0000","last_clean_scrub_stamp":"2024-04-17T19:50:43.576636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T22:06:38.055604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5,1],"acting":[3,2,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"27'8","reported_seq":42,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:50:36.172809+0000","last_change":"2024-04-17T19:50:36.172878+0000","last_active":"2024-04-17T19:50:36.172809+0000","last_peered":"2024-04-17T19:50:36.172809+0000","last_clean":"2024-04-17T19:50:36.172809+0000","last_became_active":"2024-04-17T19:46:56.691524+0000","last_became_peered":"2024-04-17T19:46:56.691524+0000","last_unstale":"2024-04-17T19:50:36.172809+0000","last_undegraded":"2024-04-17T19:50:36.172809+0000","last_fullsized":"2024-04-17T19:50:36.172809+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'8","last_scrub_stamp":"2024-04-17T19:50:36.172591+0000","last_deep_scrub":"27'8","last_deep_scrub_stamp":"2024-04-17T19:50:36.172591+0000","last_clean_scrub_stamp":"2024-04-17T19:50:36.172591+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:53:06.803690+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"27'5","reported_seq":41,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:50:23.649745+0000","last_change":"2024-04-17T19:50:23.649823+0000","last_active":"2024-04-17T19:50:23.649745+0000","last_peered":"2024-04-17T19:50:23.649745+0000","last_clean":"2024-04-17T19:50:23.649745+0000","last_became_active":"2024-04-17T19:46:55.699166+0000","last_became_peered":"2024-04-17T19:46:55.699166+0000","last_unstale":"2024-04-17T19:50:23.649745+0000","last_undegraded":"2024-04-17T19:50:23.649745+0000","last_fullsized":"2024-04-17T19:50:23.649745+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'5","last_scrub_stamp":"2024-04-17T19:50:23.649537+0000","last_deep_scrub":"27'5","last_deep_scrub_stamp":"2024-04-17T19:50:23.649537+0000","last_clean_scrub_stamp":"2024-04-17T19:50:23.649537+0000","objects_scrubbed":2,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T05:39:22.971551+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"27'10","reported_seq":46,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:50:31.780877+0000","last_change":"2024-04-17T19:50:31.780919+0000","last_active":"2024-04-17T19:50:31.780877+0000","last_peered":"2024-04-17T19:50:31.780877+0000","last_clean":"2024-04-17T19:50:31.780877+0000","last_became_active":"2024-04-17T19:46:55.687401+0000","last_became_peered":"2024-04-17T19:46:55.687401+0000","last_unstale":"2024-04-17T19:50:31.780877+0000","last_undegraded":"2024-04-17T19:50:31.780877+0000","last_fullsized":"2024-04-17T19:50:31.780877+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'10","last_scrub_stamp":"2024-04-17T19:50:31.780785+0000","last_deep_scrub":"27'10","last_deep_scrub_stamp":"2024-04-17T19:50:31.780785+0000","last_clean_scrub_stamp":"2024-04-17T19:50:31.780785+0000","objects_scrubbed":3,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T04:40:27.173317+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"27'8","reported_seq":42,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:50:28.630675+0000","last_change":"2024-04-17T19:50:28.630752+0000","last_active":"2024-04-17T19:50:28.630675+0000","last_peered":"2024-04-17T19:50:28.630675+0000","last_clean":"2024-04-17T19:50:28.630675+0000","last_became_active":"2024-04-17T19:46:56.691199+0000","last_became_peered":"2024-04-17T19:46:56.691199+0000","last_unstale":"2024-04-17T19:50:28.630675+0000","last_undegraded":"2024-04-17T19:50:28.630675+0000","last_fullsized":"2024-04-17T19:50:28.630675+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'8","last_scrub_stamp":"2024-04-17T19:50:28.630460+0000","last_deep_scrub":"27'8","last_deep_scrub_stamp":"2024-04-17T19:50:28.630460+0000","last_clean_scrub_stamp":"2024-04-17T19:50:28.630460+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:46:08.307620+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":28,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:50:36.580797+0000","last_change":"2024-04-17T19:50:36.580864+0000","last_active":"2024-04-17T19:50:36.580797+0000","last_peered":"2024-04-17T19:50:36.580797+0000","last_clean":"2024-04-17T19:50:36.580797+0000","last_became_active":"2024-04-17T19:47:00.774592+0000","last_became_peered":"2024-04-17T19:47:00.774592+0000","last_unstale":"2024-04-17T19:50:36.580797+0000","last_undegraded":"2024-04-17T19:50:36.580797+0000","last_fullsized":"2024-04-17T19:50:36.580797+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:50:36.580584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:50:36.580584+0000","last_clean_scrub_stamp":"2024-04-17T19:50:36.580584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:55:52.224262+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,7],"acting":[4,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"27'7","reported_seq":43,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:50:29.088288+0000","last_change":"2024-04-17T19:50:29.088368+0000","last_active":"2024-04-17T19:50:29.088288+0000","last_peered":"2024-04-17T19:50:29.088288+0000","last_clean":"2024-04-17T19:50:29.088288+0000","last_became_active":"2024-04-17T19:46:55.712982+0000","last_became_peered":"2024-04-17T19:46:55.712982+0000","last_unstale":"2024-04-17T19:50:29.088288+0000","last_undegraded":"2024-04-17T19:50:29.088288+0000","last_fullsized":"2024-04-17T19:50:29.088288+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'7","last_scrub_stamp":"2024-04-17T19:50:29.088081+0000","last_deep_scrub":"27'7","last_deep_scrub_stamp":"2024-04-17T19:50:29.088081+0000","last_clean_scrub_stamp":"2024-04-17T19:50:29.088081+0000","objects_scrubbed":2,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T05:39:49.650434+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"27'7","reported_seq":41,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:50:23.529150+0000","last_change":"2024-04-17T19:50:23.529173+0000","last_active":"2024-04-17T19:50:23.529150+0000","last_peered":"2024-04-17T19:50:23.529150+0000","last_clean":"2024-04-17T19:50:23.529150+0000","last_became_active":"2024-04-17T19:46:56.679830+0000","last_became_peered":"2024-04-17T19:46:56.679830+0000","last_unstale":"2024-04-17T19:50:23.529150+0000","last_undegraded":"2024-04-17T19:50:23.529150+0000","last_fullsized":"2024-04-17T19:50:23.529150+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'7","last_scrub_stamp":"2024-04-17T19:50:23.529082+0000","last_deep_scrub":"27'7","last_deep_scrub_stamp":"2024-04-17T19:50:23.529082+0000","last_clean_scrub_stamp":"2024-04-17T19:50:23.529082+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T04:31:17.505359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":28,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:50:29.775285+0000","last_change":"2024-04-17T19:50:29.775359+0000","last_active":"2024-04-17T19:50:29.775285+0000","last_peered":"2024-04-17T19:50:29.775285+0000","last_clean":"2024-04-17T19:50:29.775285+0000","last_became_active":"2024-04-17T19:47:00.776357+0000","last_became_peered":"2024-04-17T19:47:00.776357+0000","last_unstale":"2024-04-17T19:50:29.775285+0000","last_undegraded":"2024-04-17T19:50:29.775285+0000","last_fullsized":"2024-04-17T19:50:29.775285+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:50:29.775042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:50:29.775042+0000","last_clean_scrub_stamp":"2024-04-17T19:50:29.775042+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:38:21.674196+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,1,0],"acting":[7,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"27'9","reported_seq":43,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:50:25.443382+0000","last_change":"2024-04-17T19:50:25.443413+0000","last_active":"2024-04-17T19:50:25.443382+0000","last_peered":"2024-04-17T19:50:25.443382+0000","last_clean":"2024-04-17T19:50:25.443382+0000","last_became_active":"2024-04-17T19:46:56.702724+0000","last_became_peered":"2024-04-17T19:46:56.702724+0000","last_unstale":"2024-04-17T19:50:25.443382+0000","last_undegraded":"2024-04-17T19:50:25.443382+0000","last_fullsized":"2024-04-17T19:50:25.443382+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'9","last_scrub_stamp":"2024-04-17T19:50:25.443274+0000","last_deep_scrub":"27'9","last_deep_scrub_stamp":"2024-04-17T19:50:25.443274+0000","last_clean_scrub_stamp":"2024-04-17T19:50:25.443274+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:42:19.436049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"27'12","reported_seq":46,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:50:26.757746+0000","last_change":"2024-04-17T19:50:26.757817+0000","last_active":"2024-04-17T19:50:26.757746+0000","last_peered":"2024-04-17T19:50:26.757746+0000","last_clean":"2024-04-17T19:50:26.757746+0000","last_became_active":"2024-04-17T19:46:56.684771+0000","last_became_peered":"2024-04-17T19:46:56.684771+0000","last_unstale":"2024-04-17T19:50:26.757746+0000","last_undegraded":"2024-04-17T19:50:26.757746+0000","last_fullsized":"2024-04-17T19:50:26.757746+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'12","last_scrub_stamp":"2024-04-17T19:50:26.757547+0000","last_deep_scrub":"27'12","last_deep_scrub_stamp":"2024-04-17T19:50:26.757547+0000","last_clean_scrub_stamp":"2024-04-17T19:50:26.757547+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:08:24.114869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.22","version":"27'8","reported_seq":42,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:50:21.759980+0000","last_change":"2024-04-17T19:50:21.760005+0000","last_active":"2024-04-17T19:50:21.759980+0000","last_peered":"2024-04-17T19:50:21.759980+0000","last_clean":"2024-04-17T19:50:21.759980+0000","last_became_active":"2024-04-17T19:46:56.685745+0000","last_became_peered":"2024-04-17T19:46:56.685745+0000","last_unstale":"2024-04-17T19:50:21.759980+0000","last_undegraded":"2024-04-17T19:50:21.759980+0000","last_fullsized":"2024-04-17T19:50:21.759980+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'8","last_scrub_stamp":"2024-04-17T19:50:21.759902+0000","last_deep_scrub":"27'8","last_deep_scrub_stamp":"2024-04-17T19:50:21.759902+0000","last_clean_scrub_stamp":"2024-04-17T19:50:21.759902+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T02:10:19.317569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"27'7","reported_seq":41,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:50:31.115212+0000","last_change":"2024-04-17T19:50:31.115280+0000","last_active":"2024-04-17T19:50:31.115212+0000","last_peered":"2024-04-17T19:50:31.115212+0000","last_clean":"2024-04-17T19:50:31.115212+0000","last_became_active":"2024-04-17T19:46:56.675519+0000","last_became_peered":"2024-04-17T19:46:56.675519+0000","last_unstale":"2024-04-17T19:50:31.115212+0000","last_undegraded":"2024-04-17T19:50:31.115212+0000","last_fullsized":"2024-04-17T19:50:31.115212+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'7","last_scrub_stamp":"2024-04-17T19:50:31.115007+0000","last_deep_scrub":"27'7","last_deep_scrub_stamp":"2024-04-17T19:50:31.115007+0000","last_clean_scrub_stamp":"2024-04-17T19:50:31.115007+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:24:13.380642+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.24","version":"27'4","reported_seq":38,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:50:30.807183+0000","last_change":"2024-04-17T19:50:30.807331+0000","last_active":"2024-04-17T19:50:30.807183+0000","last_peered":"2024-04-17T19:50:30.807183+0000","last_clean":"2024-04-17T19:50:30.807183+0000","last_became_active":"2024-04-17T19:46:56.699293+0000","last_became_peered":"2024-04-17T19:46:56.699293+0000","last_unstale":"2024-04-17T19:50:30.807183+0000","last_undegraded":"2024-04-17T19:50:30.807183+0000","last_fullsized":"2024-04-17T19:50:30.807183+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'4","last_scrub_stamp":"2024-04-17T19:50:30.806912+0000","last_deep_scrub":"27'4","last_deep_scrub_stamp":"2024-04-17T19:50:30.806912+0000","last_clean_scrub_stamp":"2024-04-17T19:50:30.806912+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T07:09:08.638017+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"27'6","reported_seq":40,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:50:26.694720+0000","last_change":"2024-04-17T19:50:26.694789+0000","last_active":"2024-04-17T19:50:26.694720+0000","last_peered":"2024-04-17T19:50:26.694720+0000","last_clean":"2024-04-17T19:50:26.694720+0000","last_became_active":"2024-04-17T19:46:56.683963+0000","last_became_peered":"2024-04-17T19:46:56.683963+0000","last_unstale":"2024-04-17T19:50:26.694720+0000","last_undegraded":"2024-04-17T19:50:26.694720+0000","last_fullsized":"2024-04-17T19:50:26.694720+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'6","last_scrub_stamp":"2024-04-17T19:50:26.694520+0000","last_deep_scrub":"27'6","last_deep_scrub_stamp":"2024-04-17T19:50:26.694520+0000","last_clean_scrub_stamp":"2024-04-17T19:50:26.694520+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T00:50:27.473214+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.26","version":"27'15","reported_seq":49,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:50:23.466915+0000","last_change":"2024-04-17T19:50:23.466941+0000","last_active":"2024-04-17T19:50:23.466915+0000","last_peered":"2024-04-17T19:50:23.466915+0000","last_clean":"2024-04-17T19:50:23.466915+0000","last_became_active":"2024-04-17T19:46:56.692688+0000","last_became_peered":"2024-04-17T19:46:56.692688+0000","last_unstale":"2024-04-17T19:50:23.466915+0000","last_undegraded":"2024-04-17T19:50:23.466915+0000","last_fullsized":"2024-04-17T19:50:23.466915+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'15","last_scrub_stamp":"2024-04-17T19:50:23.466846+0000","last_deep_scrub":"27'15","last_deep_scrub_stamp":"2024-04-17T19:50:23.466846+0000","last_clean_scrub_stamp":"2024-04-17T19:50:23.466846+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:41:57.537135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"27'2","reported_seq":36,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:50:24.050534+0000","last_change":"2024-04-17T19:50:24.050619+0000","last_active":"2024-04-17T19:50:24.050534+0000","last_peered":"2024-04-17T19:50:24.050534+0000","last_clean":"2024-04-17T19:50:24.050534+0000","last_became_active":"2024-04-17T19:46:56.684714+0000","last_became_peered":"2024-04-17T19:46:56.684714+0000","last_unstale":"2024-04-17T19:50:24.050534+0000","last_undegraded":"2024-04-17T19:50:24.050534+0000","last_fullsized":"2024-04-17T19:50:24.050534+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2","last_scrub_stamp":"2024-04-17T19:50:24.050303+0000","last_deep_scrub":"27'2","last_deep_scrub_stamp":"2024-04-17T19:50:24.050303+0000","last_clean_scrub_stamp":"2024-04-17T19:50:24.050303+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T04:58:15.614346+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"27'6","reported_seq":40,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:50:23.780572+0000","last_change":"2024-04-17T19:50:23.780620+0000","last_active":"2024-04-17T19:50:23.780572+0000","last_peered":"2024-04-17T19:50:23.780572+0000","last_clean":"2024-04-17T19:50:23.780572+0000","last_became_active":"2024-04-17T19:46:56.679818+0000","last_became_peered":"2024-04-17T19:46:56.679818+0000","last_unstale":"2024-04-17T19:50:23.780572+0000","last_undegraded":"2024-04-17T19:50:23.780572+0000","last_fullsized":"2024-04-17T19:50:23.780572+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'6","last_scrub_stamp":"2024-04-17T19:50:23.780451+0000","last_deep_scrub":"27'6","last_deep_scrub_stamp":"2024-04-17T19:50:23.780451+0000","last_clean_scrub_stamp":"2024-04-17T19:50:23.780451+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:43:31.614363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"27'8","reported_seq":42,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:50:30.107985+0000","last_change":"2024-04-17T19:50:30.108081+0000","last_active":"2024-04-17T19:50:30.107985+0000","last_peered":"2024-04-17T19:50:30.107985+0000","last_clean":"2024-04-17T19:50:30.107985+0000","last_became_active":"2024-04-17T19:46:56.674164+0000","last_became_peered":"2024-04-17T19:46:56.674164+0000","last_unstale":"2024-04-17T19:50:30.107985+0000","last_undegraded":"2024-04-17T19:50:30.107985+0000","last_fullsized":"2024-04-17T19:50:30.107985+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'8","last_scrub_stamp":"2024-04-17T19:50:30.107777+0000","last_deep_scrub":"27'8","last_deep_scrub_stamp":"2024-04-17T19:50:30.107777+0000","last_clean_scrub_stamp":"2024-04-17T19:50:30.107777+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:20:51.236605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2a","version":"27'10","reported_seq":44,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:50:24.541115+0000","last_change":"2024-04-17T19:50:24.541145+0000","last_active":"2024-04-17T19:50:24.541115+0000","last_peered":"2024-04-17T19:50:24.541115+0000","last_clean":"2024-04-17T19:50:24.541115+0000","last_became_active":"2024-04-17T19:46:56.695255+0000","last_became_peered":"2024-04-17T19:46:56.695255+0000","last_unstale":"2024-04-17T19:50:24.541115+0000","last_undegraded":"2024-04-17T19:50:24.541115+0000","last_fullsized":"2024-04-17T19:50:24.541115+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'10","last_scrub_stamp":"2024-04-17T19:50:24.541022+0000","last_deep_scrub":"27'10","last_deep_scrub_stamp":"2024-04-17T19:50:24.541022+0000","last_clean_scrub_stamp":"2024-04-17T19:50:24.541022+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T01:44:00.043982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"27'11","reported_seq":45,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:50:22.571632+0000","last_change":"2024-04-17T19:50:22.571741+0000","last_active":"2024-04-17T19:50:22.571632+0000","last_peered":"2024-04-17T19:50:22.571632+0000","last_clean":"2024-04-17T19:50:22.571632+0000","last_became_active":"2024-04-17T19:46:56.691942+0000","last_became_peered":"2024-04-17T19:46:56.691942+0000","last_unstale":"2024-04-17T19:50:22.571632+0000","last_undegraded":"2024-04-17T19:50:22.571632+0000","last_fullsized":"2024-04-17T19:50:22.571632+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'11","last_scrub_stamp":"2024-04-17T19:50:22.571415+0000","last_deep_scrub":"27'11","last_deep_scrub_stamp":"2024-04-17T19:50:22.571415+0000","last_clean_scrub_stamp":"2024-04-17T19:50:22.571415+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T01:55:29.792028+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2c","version":"27'8","reported_seq":42,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:50:27.504007+0000","last_change":"2024-04-17T19:50:27.504037+0000","last_active":"2024-04-17T19:50:27.504007+0000","last_peered":"2024-04-17T19:50:27.504007+0000","last_clean":"2024-04-17T19:50:27.504007+0000","last_became_active":"2024-04-17T19:46:56.691938+0000","last_became_peered":"2024-04-17T19:46:56.691938+0000","last_unstale":"2024-04-17T19:50:27.504007+0000","last_undegraded":"2024-04-17T19:50:27.504007+0000","last_fullsized":"2024-04-17T19:50:27.504007+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'8","last_scrub_stamp":"2024-04-17T19:50:27.503909+0000","last_deep_scrub":"27'8","last_deep_scrub_stamp":"2024-04-17T19:50:27.503909+0000","last_clean_scrub_stamp":"2024-04-17T19:50:27.503909+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T07:09:05.335014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"27'7","reported_seq":41,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:50:40.606344+0000","last_change":"2024-04-17T19:50:40.606378+0000","last_active":"2024-04-17T19:50:40.606344+0000","last_peered":"2024-04-17T19:50:40.606344+0000","last_clean":"2024-04-17T19:50:40.606344+0000","last_became_active":"2024-04-17T19:46:56.700346+0000","last_became_peered":"2024-04-17T19:46:56.700346+0000","last_unstale":"2024-04-17T19:50:40.606344+0000","last_undegraded":"2024-04-17T19:50:40.606344+0000","last_fullsized":"2024-04-17T19:50:40.606344+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'7","last_scrub_stamp":"2024-04-17T19:50:40.606232+0000","last_deep_scrub":"27'7","last_deep_scrub_stamp":"2024-04-17T19:50:40.606232+0000","last_clean_scrub_stamp":"2024-04-17T19:50:40.606232+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T02:06:34.455203+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"27'10","reported_seq":44,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:50:28.730498+0000","last_change":"2024-04-17T19:50:28.730638+0000","last_active":"2024-04-17T19:50:28.730498+0000","last_peered":"2024-04-17T19:50:28.730498+0000","last_clean":"2024-04-17T19:50:28.730498+0000","last_became_active":"2024-04-17T19:46:56.705076+0000","last_became_peered":"2024-04-17T19:46:56.705076+0000","last_unstale":"2024-04-17T19:50:28.730498+0000","last_undegraded":"2024-04-17T19:50:28.730498+0000","last_fullsized":"2024-04-17T19:50:28.730498+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'10","last_scrub_stamp":"2024-04-17T19:50:28.730233+0000","last_deep_scrub":"27'10","last_deep_scrub_stamp":"2024-04-17T19:50:28.730233+0000","last_clean_scrub_stamp":"2024-04-17T19:50:28.730233+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T05:57:12.594371+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"27'8","reported_seq":42,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:50:38.654584+0000","last_change":"2024-04-17T19:50:38.654616+0000","last_active":"2024-04-17T19:50:38.654584+0000","last_peered":"2024-04-17T19:50:38.654584+0000","last_clean":"2024-04-17T19:50:38.654584+0000","last_became_active":"2024-04-17T19:46:56.696667+0000","last_became_peered":"2024-04-17T19:46:56.696667+0000","last_unstale":"2024-04-17T19:50:38.654584+0000","last_undegraded":"2024-04-17T19:50:38.654584+0000","last_fullsized":"2024-04-17T19:50:38.654584+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'8","last_scrub_stamp":"2024-04-17T19:50:38.654482+0000","last_deep_scrub":"27'8","last_deep_scrub_stamp":"2024-04-17T19:50:38.654482+0000","last_clean_scrub_stamp":"2024-04-17T19:50:38.654482+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T22:17:02.465864+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"27'9","reported_seq":43,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:50:25.810141+0000","last_change":"2024-04-17T19:50:25.810171+0000","last_active":"2024-04-17T19:50:25.810141+0000","last_peered":"2024-04-17T19:50:25.810141+0000","last_clean":"2024-04-17T19:50:25.810141+0000","last_became_active":"2024-04-17T19:46:56.680224+0000","last_became_peered":"2024-04-17T19:46:56.680224+0000","last_unstale":"2024-04-17T19:50:25.810141+0000","last_undegraded":"2024-04-17T19:50:25.810141+0000","last_fullsized":"2024-04-17T19:50:25.810141+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'9","last_scrub_stamp":"2024-04-17T19:50:25.810043+0000","last_deep_scrub":"27'9","last_deep_scrub_stamp":"2024-04-17T19:50:25.810043+0000","last_clean_scrub_stamp":"2024-04-17T19:50:25.810043+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:38:33.092958+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.31","version":"27'7","reported_seq":41,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:50:34.202341+0000","last_change":"2024-04-17T19:50:34.202469+0000","last_active":"2024-04-17T19:50:34.202341+0000","last_peered":"2024-04-17T19:50:34.202341+0000","last_clean":"2024-04-17T19:50:34.202341+0000","last_became_active":"2024-04-17T19:46:56.688294+0000","last_became_peered":"2024-04-17T19:46:56.688294+0000","last_unstale":"2024-04-17T19:50:34.202341+0000","last_undegraded":"2024-04-17T19:50:34.202341+0000","last_fullsized":"2024-04-17T19:50:34.202341+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'7","last_scrub_stamp":"2024-04-17T19:50:34.202065+0000","last_deep_scrub":"27'7","last_deep_scrub_stamp":"2024-04-17T19:50:34.202065+0000","last_clean_scrub_stamp":"2024-04-17T19:50:34.202065+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:55:49.845743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.32","version":"27'8","reported_seq":42,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:50:27.739670+0000","last_change":"2024-04-17T19:50:27.739827+0000","last_active":"2024-04-17T19:50:27.739670+0000","last_peered":"2024-04-17T19:50:27.739670+0000","last_clean":"2024-04-17T19:50:27.739670+0000","last_became_active":"2024-04-17T19:46:56.684639+0000","last_became_peered":"2024-04-17T19:46:56.684639+0000","last_unstale":"2024-04-17T19:50:27.739670+0000","last_undegraded":"2024-04-17T19:50:27.739670+0000","last_fullsized":"2024-04-17T19:50:27.739670+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'8","last_scrub_stamp":"2024-04-17T19:50:27.739409+0000","last_deep_scrub":"27'8","last_deep_scrub_stamp":"2024-04-17T19:50:27.739409+0000","last_clean_scrub_stamp":"2024-04-17T19:50:27.739409+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T05:45:32.207863+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.33","version":"27'10","reported_seq":44,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:50:29.802330+0000","last_change":"2024-04-17T19:50:29.802401+0000","last_active":"2024-04-17T19:50:29.802330+0000","last_peered":"2024-04-17T19:50:29.802330+0000","last_clean":"2024-04-17T19:50:29.802330+0000","last_became_active":"2024-04-17T19:46:56.694213+0000","last_became_peered":"2024-04-17T19:46:56.694213+0000","last_unstale":"2024-04-17T19:50:29.802330+0000","last_undegraded":"2024-04-17T19:50:29.802330+0000","last_fullsized":"2024-04-17T19:50:29.802330+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'10","last_scrub_stamp":"2024-04-17T19:50:29.802116+0000","last_deep_scrub":"27'10","last_deep_scrub_stamp":"2024-04-17T19:50:29.802116+0000","last_clean_scrub_stamp":"2024-04-17T19:50:29.802116+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T02:46:33.795026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"27'7","reported_seq":41,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:50:19.528933+0000","last_change":"2024-04-17T19:50:19.528978+0000","last_active":"2024-04-17T19:50:19.528933+0000","last_peered":"2024-04-17T19:50:19.528933+0000","last_clean":"2024-04-17T19:50:19.528933+0000","last_became_active":"2024-04-17T19:46:56.692874+0000","last_became_peered":"2024-04-17T19:46:56.692874+0000","last_unstale":"2024-04-17T19:50:19.528933+0000","last_undegraded":"2024-04-17T19:50:19.528933+0000","last_fullsized":"2024-04-17T19:50:19.528933+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'7","last_scrub_stamp":"2024-04-17T19:50:19.528808+0000","last_deep_scrub":"27'7","last_deep_scrub_stamp":"2024-04-17T19:50:19.528808+0000","last_clean_scrub_stamp":"2024-04-17T19:50:19.528808+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T05:39:18.850822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"27'6","reported_seq":40,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:50:31.498571+0000","last_change":"2024-04-17T19:50:31.498600+0000","last_active":"2024-04-17T19:50:31.498571+0000","last_peered":"2024-04-17T19:50:31.498571+0000","last_clean":"2024-04-17T19:50:31.498571+0000","last_became_active":"2024-04-17T19:46:56.700013+0000","last_became_peered":"2024-04-17T19:46:56.700013+0000","last_unstale":"2024-04-17T19:50:31.498571+0000","last_undegraded":"2024-04-17T19:50:31.498571+0000","last_fullsized":"2024-04-17T19:50:31.498571+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'6","last_scrub_stamp":"2024-04-17T19:50:31.498470+0000","last_deep_scrub":"27'6","last_deep_scrub_stamp":"2024-04-17T19:50:31.498470+0000","last_clean_scrub_stamp":"2024-04-17T19:50:31.498470+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T05:01:36.166114+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.36","version":"27'16","reported_seq":50,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:50:33.480454+0000","last_change":"2024-04-17T19:50:33.480486+0000","last_active":"2024-04-17T19:50:33.480454+0000","last_peered":"2024-04-17T19:50:33.480454+0000","last_clean":"2024-04-17T19:50:33.480454+0000","last_became_active":"2024-04-17T19:46:56.708606+0000","last_became_peered":"2024-04-17T19:46:56.708606+0000","last_unstale":"2024-04-17T19:50:33.480454+0000","last_undegraded":"2024-04-17T19:50:33.480454+0000","last_fullsized":"2024-04-17T19:50:33.480454+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'16","last_scrub_stamp":"2024-04-17T19:50:33.480324+0000","last_deep_scrub":"27'16","last_deep_scrub_stamp":"2024-04-17T19:50:33.480324+0000","last_clean_scrub_stamp":"2024-04-17T19:50:33.480324+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T04:27:40.085233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.37","version":"27'11","reported_seq":45,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:50:22.562439+0000","last_change":"2024-04-17T19:50:22.562463+0000","last_active":"2024-04-17T19:50:22.562439+0000","last_peered":"2024-04-17T19:50:22.562439+0000","last_clean":"2024-04-17T19:50:22.562439+0000","last_became_active":"2024-04-17T19:46:56.680919+0000","last_became_peered":"2024-04-17T19:46:56.680919+0000","last_unstale":"2024-04-17T19:50:22.562439+0000","last_undegraded":"2024-04-17T19:50:22.562439+0000","last_fullsized":"2024-04-17T19:50:22.562439+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'11","last_scrub_stamp":"2024-04-17T19:50:22.562361+0000","last_deep_scrub":"27'11","last_deep_scrub_stamp":"2024-04-17T19:50:22.562361+0000","last_clean_scrub_stamp":"2024-04-17T19:50:22.562361+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T05:42:07.599649+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"27'9","reported_seq":43,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:50:35.159113+0000","last_change":"2024-04-17T19:50:35.159187+0000","last_active":"2024-04-17T19:50:35.159113+0000","last_peered":"2024-04-17T19:50:35.159113+0000","last_clean":"2024-04-17T19:50:35.159113+0000","last_became_active":"2024-04-17T19:46:56.688320+0000","last_became_peered":"2024-04-17T19:46:56.688320+0000","last_unstale":"2024-04-17T19:50:35.159113+0000","last_undegraded":"2024-04-17T19:50:35.159113+0000","last_fullsized":"2024-04-17T19:50:35.159113+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'9","last_scrub_stamp":"2024-04-17T19:50:35.158901+0000","last_deep_scrub":"27'9","last_deep_scrub_stamp":"2024-04-17T19:50:35.158901+0000","last_clean_scrub_stamp":"2024-04-17T19:50:35.158901+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T22:21:38.515740+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"27'5","reported_seq":39,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:50:30.535202+0000","last_change":"2024-04-17T19:50:30.535232+0000","last_active":"2024-04-17T19:50:30.535202+0000","last_peered":"2024-04-17T19:50:30.535202+0000","last_clean":"2024-04-17T19:50:30.535202+0000","last_became_active":"2024-04-17T19:46:56.698840+0000","last_became_peered":"2024-04-17T19:46:56.698840+0000","last_unstale":"2024-04-17T19:50:30.535202+0000","last_undegraded":"2024-04-17T19:50:30.535202+0000","last_fullsized":"2024-04-17T19:50:30.535202+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'5","last_scrub_stamp":"2024-04-17T19:50:30.535066+0000","last_deep_scrub":"27'5","last_deep_scrub_stamp":"2024-04-17T19:50:30.535066+0000","last_clean_scrub_stamp":"2024-04-17T19:50:30.535066+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:43:38.368978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"27'6","reported_seq":40,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:50:24.469606+0000","last_change":"2024-04-17T19:50:24.469666+0000","last_active":"2024-04-17T19:50:24.469606+0000","last_peered":"2024-04-17T19:50:24.469606+0000","last_clean":"2024-04-17T19:50:24.469606+0000","last_became_active":"2024-04-17T19:46:56.705539+0000","last_became_peered":"2024-04-17T19:46:56.705539+0000","last_unstale":"2024-04-17T19:50:24.469606+0000","last_undegraded":"2024-04-17T19:50:24.469606+0000","last_fullsized":"2024-04-17T19:50:24.469606+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'6","last_scrub_stamp":"2024-04-17T19:50:24.469421+0000","last_deep_scrub":"27'6","last_deep_scrub_stamp":"2024-04-17T19:50:24.469421+0000","last_clean_scrub_stamp":"2024-04-17T19:50:24.469421+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T00:50:25.248114+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"27'4","reported_seq":38,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:50:28.540132+0000","last_change":"2024-04-17T19:50:28.540164+0000","last_active":"2024-04-17T19:50:28.540132+0000","last_peered":"2024-04-17T19:50:28.540132+0000","last_clean":"2024-04-17T19:50:28.540132+0000","last_became_active":"2024-04-17T19:46:56.693954+0000","last_became_peered":"2024-04-17T19:46:56.693954+0000","last_unstale":"2024-04-17T19:50:28.540132+0000","last_undegraded":"2024-04-17T19:50:28.540132+0000","last_fullsized":"2024-04-17T19:50:28.540132+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'4","last_scrub_stamp":"2024-04-17T19:50:28.540030+0000","last_deep_scrub":"27'4","last_deep_scrub_stamp":"2024-04-17T19:50:28.540030+0000","last_clean_scrub_stamp":"2024-04-17T19:50:28.540030+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:50:00.347391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"27'8","reported_seq":43,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:50:27.462958+0000","last_change":"2024-04-17T19:50:27.462958+0000","last_active":"2024-04-17T19:50:27.462958+0000","last_peered":"2024-04-17T19:50:27.462958+0000","last_clean":"2024-04-17T19:50:27.462958+0000","last_became_active":"2024-04-17T19:46:56.706021+0000","last_became_peered":"2024-04-17T19:46:56.706021+0000","last_unstale":"2024-04-17T19:50:27.462958+0000","last_undegraded":"2024-04-17T19:50:27.462958+0000","last_fullsized":"2024-04-17T19:50:27.462958+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'8","last_scrub_stamp":"2024-04-17T19:50:27.462782+0000","last_deep_scrub":"27'8","last_deep_scrub_stamp":"2024-04-17T19:50:27.462782+0000","last_clean_scrub_stamp":"2024-04-17T19:50:27.462782+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:33:10.354916+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3d","version":"27'7","reported_seq":41,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:50:37.192409+0000","last_change":"2024-04-17T19:50:37.192543+0000","last_active":"2024-04-17T19:50:37.192409+0000","last_peered":"2024-04-17T19:50:37.192409+0000","last_clean":"2024-04-17T19:50:37.192409+0000","last_became_active":"2024-04-17T19:46:56.696492+0000","last_became_peered":"2024-04-17T19:46:56.696492+0000","last_unstale":"2024-04-17T19:50:37.192409+0000","last_undegraded":"2024-04-17T19:50:37.192409+0000","last_fullsized":"2024-04-17T19:50:37.192409+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'7","last_scrub_stamp":"2024-04-17T19:50:37.192050+0000","last_deep_scrub":"27'7","last_deep_scrub_stamp":"2024-04-17T19:50:37.192050+0000","last_clean_scrub_stamp":"2024-04-17T19:50:37.192050+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:31:10.067736+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"27'4","reported_seq":38,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:50:33.165191+0000","last_change":"2024-04-17T19:50:33.165290+0000","last_active":"2024-04-17T19:50:33.165191+0000","last_peered":"2024-04-17T19:50:33.165191+0000","last_clean":"2024-04-17T19:50:33.165191+0000","last_became_active":"2024-04-17T19:46:56.682772+0000","last_became_peered":"2024-04-17T19:46:56.682772+0000","last_unstale":"2024-04-17T19:50:33.165191+0000","last_undegraded":"2024-04-17T19:50:33.165191+0000","last_fullsized":"2024-04-17T19:50:33.165191+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'4","last_scrub_stamp":"2024-04-17T19:50:33.164945+0000","last_deep_scrub":"27'4","last_deep_scrub_stamp":"2024-04-17T19:50:33.164945+0000","last_clean_scrub_stamp":"2024-04-17T19:50:33.164945+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T05:23:35.837268+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3f","version":"27'8","reported_seq":42,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:50:29.527981+0000","last_change":"2024-04-17T19:50:29.528008+0000","last_active":"2024-04-17T19:50:29.527981+0000","last_peered":"2024-04-17T19:50:29.527981+0000","last_clean":"2024-04-17T19:50:29.527981+0000","last_became_active":"2024-04-17T19:46:56.694743+0000","last_became_peered":"2024-04-17T19:46:56.694743+0000","last_unstale":"2024-04-17T19:50:29.527981+0000","last_undegraded":"2024-04-17T19:50:29.527981+0000","last_fullsized":"2024-04-17T19:50:29.527981+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'8","last_scrub_stamp":"2024-04-17T19:50:29.527888+0000","last_deep_scrub":"27'8","last_deep_scrub_stamp":"2024-04-17T19:50:29.527888+0000","last_clean_scrub_stamp":"2024-04-17T19:50:29.527888+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T07:00:33.433456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":501,"ondisk_log_size":501,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":44818,"num_objects":99,"num_object_clones":0,"num_object_copies":198,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":99,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":261,"num_write_kb":128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":25000,"num_omap_keys":50,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":344064,"data_stored":89636,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":322,"ondisk_log_size":322,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":66496,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509495,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31492,"kb_used_data":316,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340348,"statfs":{"total":96636764160,"available":96604516352,"internally_reserved":0,"allocated":323584,"data_stored":117072,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509496,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27312,"kb_used_data":296,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344528,"statfs":{"total":96636764160,"available":96608796672,"internally_reserved":0,"allocated":303104,"data_stored":118385,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509496,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31496,"kb_used_data":320,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340344,"statfs":{"total":96636764160,"available":96604512256,"internally_reserved":0,"allocated":327680,"data_stored":118328,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509496,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27348,"kb_used_data":332,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344492,"statfs":{"total":96636764160,"available":96608759808,"internally_reserved":0,"allocated":339968,"data_stored":153259,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509495,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31536,"kb_used_data":360,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340304,"statfs":{"total":96636764160,"available":96604471296,"internally_reserved":0,"allocated":368640,"data_stored":707388,"data_compressed":33248,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509495,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31488,"kb_used_data":312,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340352,"statfs":{"total":96636764160,"available":96604520448,"internally_reserved":0,"allocated":319488,"data_stored":118547,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574903,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31544,"kb_used_data":368,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340296,"statfs":{"total":96636764160,"available":96604463104,"internally_reserved":0,"allocated":376832,"data_stored":707212,"data_compressed":33248,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574903,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31544,"kb_used_data":368,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340296,"statfs":{"total":96636764160,"available":96604463104,"internally_reserved":0,"allocated":376832,"data_stored":155029,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33248,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33248,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":2941,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1414,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":37653,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":2722,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":94208,"data_stored":39423,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1238,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2779,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":1466,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-17T19:51:04.160 DEBUG:teuthology.orchestra.run.smithi044:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2024-04-17T19:51:04.350 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:04.359+0000 7f8894e00640 1 Processor -- start 2024-04-17T19:51:04.350 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:04.359+0000 7f8894e00640 1 -- start start 2024-04-17T19:51:04.352 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:04.359+0000 7f8894e00640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f8890152860 0x7f88900c68b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:51:04.353 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:04.359+0000 7f8894e00640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f8890159140 0x7f88900c47e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:51:04.353 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:04.359+0000 7f8894e00640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f88900c4000 con 0x7f88900c4d20 2024-04-17T19:51:04.353 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:04.359+0000 7f8894e00640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 -- 0x7f88900c6eb0 con 0x7f8890152860 2024-04-17T19:51:04.353 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:04.359+0000 7f8894e00640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7f88900c78e0 con 0x7f8890159140 2024-04-17T19:51:04.353 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:04.359+0000 7f888de00640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f8890152860 0x7f88900c68b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:51:04.353 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:04.359+0000 7f888e800640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f88900c4d20 0x7f88900c80a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:34078/0 (socket says 172.21.15.44:34078) 2024-04-17T19:51:04.353 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:04.359+0000 7f888e800640 1 -- 172.21.15.44:0/3330320654 learned_addr learned my addr 172.21.15.44:0/3330320654 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-04-17T19:51:04.353 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:04.359+0000 7f8885400640 1 --2- 172.21.15.44:0/3330320654 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f8890159140 0x7f88900c47e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:51:04.353 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:04.359+0000 7f888d400640 1 -- 172.21.15.44:0/3330320654 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3612046172 0 0) 0x7f88900c4000 con 0x7f88900c4d20 2024-04-17T19:51:04.353 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:04.359+0000 7f888de00640 1 -- 172.21.15.44:0/3330320654 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f8890159140 msgr2=0x7f88900c47e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T19:51:04.353 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:04.359+0000 7f888de00640 1 --2- 172.21.15.44:0/3330320654 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f8890159140 0x7f88900c47e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:51:04.353 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:04.359+0000 7f888de00640 1 -- 172.21.15.44:0/3330320654 >> v1:172.21.15.44:6789/0 conn(0x7f88900c4d20 legacy=0x7f88900c80a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:51:04.353 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:04.359+0000 7f888de00640 1 -- 172.21.15.44:0/3330320654 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f88900c42e0 con 0x7f8890152860 2024-04-17T19:51:04.355 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:04.363+0000 7f888de00640 1 --2- 172.21.15.44:0/3330320654 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8890152860 0x7f88900c68b0 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f88800097c0 tx=0x7f888001c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=60b78b2f6148f409 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:51:04.356 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:04.363+0000 7f888d400640 1 -- 172.21.15.44:0/3330320654 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88800b0070 con 0x7f8890152860 2024-04-17T19:51:04.356 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:04.363+0000 7f888d400640 1 -- 172.21.15.44:0/3330320654 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f88800ab600 con 0x7f8890152860 2024-04-17T19:51:04.356 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:04.363+0000 7f888d400640 1 -- 172.21.15.44:0/3330320654 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88800ab9d0 con 0x7f8890152860 2024-04-17T19:51:04.357 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:04.363+0000 7f8894e00640 1 -- 172.21.15.44:0/3330320654 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8890152860 msgr2=0x7f88900c68b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:51:04.357 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:04.363+0000 7f8894e00640 1 --2- 172.21.15.44:0/3330320654 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8890152860 0x7f88900c68b0 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f88800097c0 tx=0x7f888001c430 comp rx=0 tx=0).stop 2024-04-17T19:51:04.357 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:04.363+0000 7f8894e00640 1 -- 172.21.15.44:0/3330320654 shutdown_connections 2024-04-17T19:51:04.357 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:04.363+0000 7f8894e00640 1 --2- 172.21.15.44:0/3330320654 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f8890159140 0x7f88900c47e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:51:04.357 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:04.363+0000 7f8894e00640 1 --2- 172.21.15.44:0/3330320654 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8890152860 0x7f88900c68b0 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:51:04.357 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:04.363+0000 7f8894e00640 1 -- 172.21.15.44:0/3330320654 >> 172.21.15.44:0/3330320654 conn(0x7f889006c380 msgr2=0x7f8890070080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:51:04.357 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:04.363+0000 7f8894e00640 1 -- 172.21.15.44:0/3330320654 shutdown_connections 2024-04-17T19:51:04.357 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:04.363+0000 7f8894e00640 1 -- 172.21.15.44:0/3330320654 wait complete. 2024-04-17T19:51:04.359 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:04.367+0000 7f8894e00640 1 Processor -- start 2024-04-17T19:51:04.359 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:04.367+0000 7f8894e00640 1 -- start start 2024-04-17T19:51:04.362 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:04.367+0000 7f8894e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f88900c4d20 0x7f889014ae80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:51:04.362 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:04.367+0000 7f8894e00640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f8890152860 0x7f88901f5ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:51:04.362 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:04.367+0000 7f8894e00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8890159140 0x7f88900cbba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:51:04.362 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:04.367+0000 7f8894e00640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f88900c5130 con 0x7f88900c4d20 2024-04-17T19:51:04.362 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:04.367+0000 7f8894e00640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f88900c8a00 con 0x7f8890159140 2024-04-17T19:51:04.362 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:04.367+0000 7f8894e00640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7f8890165860 con 0x7f8890152860 2024-04-17T19:51:04.362 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:04.367+0000 7f888de00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f88900c4d20 0x7f889014ae80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:51:04.362 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:04.367+0000 7f888de00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f88900c4d20 0x7f889014ae80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:39034/0 (socket says 172.21.15.44:39034) 2024-04-17T19:51:04.363 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:04.367+0000 7f888de00640 1 -- 172.21.15.44:0/3722880220 learned_addr learned my addr 172.21.15.44:0/3722880220 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-04-17T19:51:04.363 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:04.367+0000 7f8885400640 1 --2- 172.21.15.44:0/3722880220 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f8890152860 0x7f88901f5ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:51:04.363 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:04.367+0000 7f888e800640 1 --2- 172.21.15.44:0/3722880220 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8890159140 0x7f88900cbba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:51:04.363 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:04.371+0000 7f888de00640 1 -- 172.21.15.44:0/3722880220 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f8890152860 msgr2=0x7f88901f5ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:51:04.363 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:04.371+0000 7f888de00640 1 --2- 172.21.15.44:0/3722880220 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f8890152860 0x7f88901f5ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:51:04.363 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:04.371+0000 7f888de00640 1 -- 172.21.15.44:0/3722880220 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8890159140 msgr2=0x7f88900cbba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:51:04.363 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:04.371+0000 7f888de00640 1 --2- 172.21.15.44:0/3722880220 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8890159140 0x7f88900cbba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:51:04.363 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:04.371+0000 7f888de00640 1 -- 172.21.15.44:0/3722880220 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f889014b3c0 con 0x7f88900c4d20 2024-04-17T19:51:04.363 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:04.371+0000 7f8885400640 1 --2- 172.21.15.44:0/3722880220 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f8890152860 0x7f88901f5ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-17T19:51:04.363 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:04.371+0000 7f888de00640 1 --2- 172.21.15.44:0/3722880220 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f88900c4d20 0x7f889014ae80 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f88800097c0 tx=0x7f888001ac70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:51:04.363 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:04.371+0000 7f8886a00640 1 -- 172.21.15.44:0/3722880220 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88800bd070 con 0x7f88900c4d20 2024-04-17T19:51:04.363 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:04.371+0000 7f8886a00640 1 -- 172.21.15.44:0/3722880220 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8880004030 con 0x7f88900c4d20 2024-04-17T19:51:04.363 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:04.371+0000 7f8894e00640 1 -- 172.21.15.44:0/3722880220 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f889014ddb0 con 0x7f88900c4d20 2024-04-17T19:51:04.363 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:04.371+0000 7f8886a00640 1 -- 172.21.15.44:0/3722880220 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88800b0040 con 0x7f88900c4d20 2024-04-17T19:51:04.363 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:04.371+0000 7f8894e00640 1 -- 172.21.15.44:0/3722880220 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f889014d2d0 con 0x7f88900c4d20 2024-04-17T19:51:04.364 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:04.371+0000 7f8894e00640 1 -- 172.21.15.44:0/3722880220 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f889004ff10 con 0x7f88900c4d20 2024-04-17T19:51:04.364 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:04.371+0000 7f8886a00640 1 -- 172.21.15.44:0/3722880220 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f88800c0070 con 0x7f88900c4d20 2024-04-17T19:51:04.364 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:04.371+0000 7f8886a00640 1 --2- 172.21.15.44:0/3722880220 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f886c068380 0x7f886c06a890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:51:04.365 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:04.371+0000 7f8886a00640 1 -- 172.21.15.44:0/3722880220 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6619+0+0 (secure 0 0 0) 0x7f88801208d0 con 0x7f88900c4d20 2024-04-17T19:51:04.365 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:04.375+0000 7f8885400640 1 --2- 172.21.15.44:0/3722880220 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f886c068380 0x7f886c06a890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:51:04.366 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:04.375+0000 7f8885400640 1 --2- 172.21.15.44:0/3722880220 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f886c068380 0x7f886c06a890 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f8890151fc0 tx=0x7f8878008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:51:04.369 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:04.379+0000 7f8886a00640 1 -- 172.21.15.44:0/3722880220 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f88800160b0 con 0x7f88900c4d20 2024-04-17T19:51:04.536 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:04.543+0000 7f8894e00640 1 -- 172.21.15.44:0/3722880220 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command([{prefix=config set, name=mon_health_to_clog}] v 0) -- 0x7f88900c7e80 con 0x7f88900c4d20 2024-04-17T19:51:04.540 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:04.547+0000 7f8886a00640 1 -- 172.21.15.44:0/3722880220 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_health_to_clog}]=0 v10)=0 v10) ==== 123+0+0 (secure 0 0 0) 0x7f88800f09d0 con 0x7f88900c4d20 2024-04-17T19:51:04.543 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:04.551+0000 7f8886a00640 1 -- 172.21.15.44:0/3722880220 <== mon.0 v2:172.21.15.44:3300/0 8 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f8880126080 con 0x7f88900c4d20 2024-04-17T19:51:04.543 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:04.551+0000 7f8894e00640 1 -- 172.21.15.44:0/3722880220 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f886c068380 msgr2=0x7f886c06a890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:51:04.543 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:04.551+0000 7f8894e00640 1 --2- 172.21.15.44:0/3722880220 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f886c068380 0x7f886c06a890 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f8890151fc0 tx=0x7f8878008040 comp rx=0 tx=0).stop 2024-04-17T19:51:04.543 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:04.551+0000 7f8894e00640 1 -- 172.21.15.44:0/3722880220 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f88900c4d20 msgr2=0x7f889014ae80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:51:04.543 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:04.551+0000 7f8894e00640 1 --2- 172.21.15.44:0/3722880220 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f88900c4d20 0x7f889014ae80 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f88800097c0 tx=0x7f888001ac70 comp rx=0 tx=0).stop 2024-04-17T19:51:04.543 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:04.551+0000 7f8894e00640 1 -- 172.21.15.44:0/3722880220 shutdown_connections 2024-04-17T19:51:04.543 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:04.551+0000 7f8894e00640 1 --2- 172.21.15.44:0/3722880220 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f886c068380 0x7f886c06a890 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:51:04.543 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:04.551+0000 7f8894e00640 1 --2- 172.21.15.44:0/3722880220 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f8890152860 0x7f88901f5ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:51:04.544 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:04.551+0000 7f8894e00640 1 --2- 172.21.15.44:0/3722880220 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8890159140 0x7f88900cbba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:51:04.544 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:04.551+0000 7f8894e00640 1 --2- 172.21.15.44:0/3722880220 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f88900c4d20 0x7f889014ae80 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:51:04.544 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:04.551+0000 7f8894e00640 1 -- 172.21.15.44:0/3722880220 >> 172.21.15.44:0/3722880220 conn(0x7f889006c380 msgr2=0x7f8890073720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:51:04.544 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:04.551+0000 7f8894e00640 1 -- 172.21.15.44:0/3722880220 shutdown_connections 2024-04-17T19:51:04.544 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:04.551+0000 7f8894e00640 1 -- 172.21.15.44:0/3722880220 wait complete. 2024-04-17T19:51:04.563 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-04-17T19:51:04.563 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-17T19:51:04.717 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:04.723+0000 7fcab9400640 1 Processor -- start 2024-04-17T19:51:04.717 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:04.723+0000 7fcab9400640 1 -- start start 2024-04-17T19:51:04.719 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:04.727+0000 7fcab9400640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fcab4153db0 0x7fcab4073820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:51:04.719 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:04.727+0000 7fcab9400640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fcab4073d60 0x7fcab40725b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:51:04.719 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:04.727+0000 7fcab9400640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcab4159ad0 con 0x7fcab40c66d0 2024-04-17T19:51:04.719 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:04.727+0000 7fcab9400640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 -- 0x7fcab4159db0 con 0x7fcab4153db0 2024-04-17T19:51:04.719 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:04.727+0000 7fcab9400640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7fcab415a090 con 0x7fcab4073d60 2024-04-17T19:51:04.719 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:04.727+0000 7fcaabe00640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fcab4153db0 0x7fcab4073820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:51:04.719 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:04.727+0000 7fcaabe00640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fcab4153db0 0x7fcab4073820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:39046/0 (socket says 172.21.15.44:39046) 2024-04-17T19:51:04.719 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:04.727+0000 7fcaabe00640 1 -- 172.21.15.44:0/3200913302 learned_addr learned my addr 172.21.15.44:0/3200913302 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-04-17T19:51:04.720 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:04.727+0000 7fcab3200640 1 --2- 172.21.15.44:0/3200913302 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fcab4073d60 0x7fcab40725b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:51:04.720 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:04.727+0000 7fcaabe00640 1 -- 172.21.15.44:0/3200913302 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fcab4073d60 msgr2=0x7fcab40725b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T19:51:04.720 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:04.727+0000 7fcaabe00640 1 --2- 172.21.15.44:0/3200913302 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fcab4073d60 0x7fcab40725b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:51:04.720 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:04.727+0000 7fcaabe00640 1 -- 172.21.15.44:0/3200913302 >> v1:172.21.15.62:6789/0 conn(0x7fcab40c66d0 legacy=0x7fcab41536a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:51:04.720 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:04.727+0000 7fcaabe00640 1 -- 172.21.15.44:0/3200913302 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcab415a370 con 0x7fcab4153db0 2024-04-17T19:51:04.722 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:04.731+0000 7fcaabe00640 1 --2- 172.21.15.44:0/3200913302 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fcab4153db0 0x7fcab4073820 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7fca9c009870 tx=0x7fca9c01c560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=98f88fa6695e2215 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:51:04.722 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:04.731+0000 7fcab1e00640 1 -- 172.21.15.44:0/3200913302 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca9c0ab430 con 0x7fcab4153db0 2024-04-17T19:51:04.722 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:04.731+0000 7fcab1e00640 1 -- 172.21.15.44:0/3200913302 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7fca9c0b0070 con 0x7fcab4153db0 2024-04-17T19:51:04.723 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:04.731+0000 7fcab1e00640 1 -- 172.21.15.44:0/3200913302 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca9c0ab810 con 0x7fcab4153db0 2024-04-17T19:51:04.723 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:04.731+0000 7fcab9400640 1 -- 172.21.15.44:0/3200913302 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fcab4153db0 msgr2=0x7fcab4073820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:51:04.723 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:04.731+0000 7fcab9400640 1 --2- 172.21.15.44:0/3200913302 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fcab4153db0 0x7fcab4073820 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7fca9c009870 tx=0x7fca9c01c560 comp rx=0 tx=0).stop 2024-04-17T19:51:04.724 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:04.731+0000 7fcab9400640 1 -- 172.21.15.44:0/3200913302 shutdown_connections 2024-04-17T19:51:04.724 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:04.731+0000 7fcab9400640 1 --2- 172.21.15.44:0/3200913302 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fcab4073d60 0x7fcab40725b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:51:04.724 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:04.731+0000 7fcab9400640 1 --2- 172.21.15.44:0/3200913302 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fcab4153db0 0x7fcab4073820 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:51:04.724 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:04.731+0000 7fcab9400640 1 -- 172.21.15.44:0/3200913302 >> 172.21.15.44:0/3200913302 conn(0x7fcab406c380 msgr2=0x7fcab4070080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:51:04.724 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:04.731+0000 7fcab9400640 1 -- 172.21.15.44:0/3200913302 shutdown_connections 2024-04-17T19:51:04.724 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:04.731+0000 7fcab9400640 1 -- 172.21.15.44:0/3200913302 wait complete. 2024-04-17T19:51:04.726 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:04.735+0000 7fcab9400640 1 Processor -- start 2024-04-17T19:51:04.726 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:04.735+0000 7fcab9400640 1 -- start start 2024-04-17T19:51:04.728 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:04.735+0000 7fcab9400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fcab4073d60 0x7fcab414f300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:51:04.729 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:04.735+0000 7fcab9400640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fcab40c66d0 0x7fcab41f8960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:51:04.729 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:04.735+0000 7fcab9400640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fcab4153db0 0x7fcab4158960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:51:04.729 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:04.735+0000 7fcab9400640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fcab40c8890 con 0x7fcab4073d60 2024-04-17T19:51:04.729 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:04.735+0000 7fcab9400640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7fcab40c8710 con 0x7fcab40c66d0 2024-04-17T19:51:04.729 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:04.735+0000 7fcab9400640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7fcab4166a80 con 0x7fcab4153db0 2024-04-17T19:51:04.729 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:04.735+0000 7fcab2800640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fcab4073d60 0x7fcab414f300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:51:04.729 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:04.735+0000 7fcab2800640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fcab4073d60 0x7fcab414f300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:39062/0 (socket says 172.21.15.44:39062) 2024-04-17T19:51:04.729 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:04.735+0000 7fcab2800640 1 -- 172.21.15.44:0/1163931560 learned_addr learned my addr 172.21.15.44:0/1163931560 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-04-17T19:51:04.729 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:04.735+0000 7fcaabe00640 1 --2- 172.21.15.44:0/1163931560 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fcab40c66d0 0x7fcab41f8960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:51:04.729 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:04.735+0000 7fcab3200640 1 --2- 172.21.15.44:0/1163931560 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fcab4153db0 0x7fcab4158960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:51:04.729 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:04.735+0000 7fcab2800640 1 -- 172.21.15.44:0/1163931560 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fcab4153db0 msgr2=0x7fcab4158960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:51:04.729 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:04.735+0000 7fcab2800640 1 --2- 172.21.15.44:0/1163931560 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fcab4153db0 0x7fcab4158960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:51:04.729 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:04.735+0000 7fcab2800640 1 -- 172.21.15.44:0/1163931560 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fcab40c66d0 msgr2=0x7fcab41f8960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:51:04.730 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:04.735+0000 7fcab2800640 1 --2- 172.21.15.44:0/1163931560 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fcab40c66d0 0x7fcab41f8960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:51:04.730 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:04.735+0000 7fcab2800640 1 -- 172.21.15.44:0/1163931560 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcab41f8ea0 con 0x7fcab4073d60 2024-04-17T19:51:04.730 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:04.735+0000 7fcab2800640 1 --2- 172.21.15.44:0/1163931560 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fcab4073d60 0x7fcab414f300 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7fcaa400c370 tx=0x7fcaa400c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:51:04.730 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:04.735+0000 7fcaaaa00640 1 -- 172.21.15.44:0/1163931560 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcaa40052d0 con 0x7fcab4073d60 2024-04-17T19:51:04.730 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:04.735+0000 7fcaaaa00640 1 -- 172.21.15.44:0/1163931560 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7fcaa4005470 con 0x7fcab4073d60 2024-04-17T19:51:04.730 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:04.735+0000 7fcab9400640 1 -- 172.21.15.44:0/1163931560 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcab4156e60 con 0x7fcab4073d60 2024-04-17T19:51:04.730 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:04.735+0000 7fcaaaa00640 1 -- 172.21.15.44:0/1163931560 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcaa4007280 con 0x7fcab4073d60 2024-04-17T19:51:04.730 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:04.735+0000 7fcab9400640 1 -- 172.21.15.44:0/1163931560 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcab4157120 con 0x7fcab4073d60 2024-04-17T19:51:04.731 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:04.739+0000 7fcab9400640 1 -- 172.21.15.44:0/1163931560 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcab404ff10 con 0x7fcab4073d60 2024-04-17T19:51:04.731 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:04.739+0000 7fcaaaa00640 1 -- 172.21.15.44:0/1163931560 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fcaa4007420 con 0x7fcab4073d60 2024-04-17T19:51:04.731 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:04.739+0000 7fcaaaa00640 1 --2- 172.21.15.44:0/1163931560 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7fca90068380 0x7fca9006a890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:51:04.731 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:04.739+0000 7fcaaaa00640 1 -- 172.21.15.44:0/1163931560 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6619+0+0 (secure 0 0 0) 0x7fcaa4086340 con 0x7fcab4073d60 2024-04-17T19:51:04.732 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:04.739+0000 7fcaabe00640 1 --2- 172.21.15.44:0/1163931560 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7fca90068380 0x7fca9006a890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:51:04.732 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:04.739+0000 7fcaabe00640 1 --2- 172.21.15.44:0/1163931560 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7fca90068380 0x7fca9006a890 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fca9c0af000 tx=0x7fca9c008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:51:04.735 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:04.743+0000 7fcaaaa00640 1 -- 172.21.15.44:0/1163931560 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fcaa4056440 con 0x7fcab4073d60 2024-04-17T19:51:04.939 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:04.947+0000 7fcab9400640 1 -- 172.21.15.44:0/1163931560 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fcab4146990 con 0x7fcab4073d60 2024-04-17T19:51:04.940 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:04.947+0000 7fcaaaa00640 1 -- 172.21.15.44:0/1163931560 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 18 v18) ==== 94+0+6911 (secure 0 0 0) 0x7fcaa4055d40 con 0x7fcab4073d60 2024-04-17T19:51:04.940 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-04-17T19:51:04.941 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":18,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4263,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.44:6835/1724891996","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6832","nonce":1724891996},{"type":"v1","addr":"172.21.15.44:6835","nonce":1724891996}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":18,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-17T19:46:56.083202+0000","modified":"2024-04-17T19:47:39.954509+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":4306,"mds_1":4294,"mds_2":4269,"mds_3":4268,"mds_4":4266},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4266":{"gid":4266,"name":"c","rank":4,"incarnation":17,"state":"up:active","state_seq":14,"addr":"172.21.15.44:6836/2201911513","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6833","nonce":2201911513},{"type":"v1","addr":"172.21.15.44:6836","nonce":2201911513}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4268":{"gid":4268,"name":"f","rank":3,"incarnation":15,"state":"up:active","state_seq":13,"addr":"172.21.15.62:6837/3085335335","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6836","nonce":3085335335},{"type":"v1","addr":"172.21.15.62:6837","nonce":3085335335}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4269":{"gid":4269,"name":"e","rank":2,"incarnation":13,"state":"up:active","state_seq":11,"addr":"172.21.15.44:6837/4073536070","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6834","nonce":4073536070},{"type":"v1","addr":"172.21.15.44:6837","nonce":4073536070}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4294":{"gid":4294,"name":"d","rank":1,"incarnation":9,"state":"up:active","state_seq":10,"addr":"172.21.15.62:6835/2585862759","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6834","nonce":2585862759},{"type":"v1","addr":"172.21.15.62:6835","nonce":2585862759}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4306":{"gid":4306,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":5,"addr":"172.21.15.62:6839/1537667111","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6838","nonce":1537667111},{"type":"v1","addr":"172.21.15.62:6839","nonce":1537667111}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4306,"qdb_cluster":[4266,4268,4294,4269,4306]},"id":1}]} 2024-04-17T19:51:04.941 INFO:teuthology.orchestra.run.smithi044.stderr:dumped fsmap epoch 18 2024-04-17T19:51:04.943 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:04.951+0000 7fcab9400640 1 -- 172.21.15.44:0/1163931560 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7fca90068380 msgr2=0x7fca9006a890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:51:04.943 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:04.951+0000 7fcab9400640 1 --2- 172.21.15.44:0/1163931560 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7fca90068380 0x7fca9006a890 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fca9c0af000 tx=0x7fca9c008040 comp rx=0 tx=0).stop 2024-04-17T19:51:04.943 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:04.951+0000 7fcab9400640 1 -- 172.21.15.44:0/1163931560 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fcab4073d60 msgr2=0x7fcab414f300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:51:04.943 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:04.951+0000 7fcab9400640 1 --2- 172.21.15.44:0/1163931560 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fcab4073d60 0x7fcab414f300 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7fcaa400c370 tx=0x7fcaa400c830 comp rx=0 tx=0).stop 2024-04-17T19:51:04.943 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:04.951+0000 7fcab9400640 1 -- 172.21.15.44:0/1163931560 shutdown_connections 2024-04-17T19:51:04.943 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:04.951+0000 7fcab9400640 1 --2- 172.21.15.44:0/1163931560 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7fca90068380 0x7fca9006a890 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:51:04.943 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:04.951+0000 7fcab9400640 1 --2- 172.21.15.44:0/1163931560 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fcab4153db0 0x7fcab4158960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:51:04.943 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:04.951+0000 7fcab9400640 1 --2- 172.21.15.44:0/1163931560 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fcab40c66d0 0x7fcab41f8960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:51:04.943 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:04.951+0000 7fcab9400640 1 --2- 172.21.15.44:0/1163931560 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fcab4073d60 0x7fcab414f300 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:51:04.943 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:04.951+0000 7fcab9400640 1 -- 172.21.15.44:0/1163931560 >> 172.21.15.44:0/1163931560 conn(0x7fcab406c380 msgr2=0x7fcab4150180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:51:04.943 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:04.951+0000 7fcab9400640 1 -- 172.21.15.44:0/1163931560 shutdown_connections 2024-04-17T19:51:04.943 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:04.951+0000 7fcab9400640 1 -- 172.21.15.44:0/1163931560 wait complete. 2024-04-17T19:51:04.962 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-17T19:51:05.114 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:05.123+0000 7f44e1800640 1 Processor -- start 2024-04-17T19:51:05.114 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:05.123+0000 7f44e1800640 1 -- start start 2024-04-17T19:51:05.116 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:05.123+0000 7f44e1800640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f44dc158eb0 0x7f44dc1592c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:51:05.116 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:05.123+0000 7f44e1800640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f44dc152e70 con 0x7f44dc152a60 2024-04-17T19:51:05.116 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:05.123+0000 7f44e1800640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f44dc0c52c0 con 0x7f44dc0c47c0 2024-04-17T19:51:05.116 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:05.123+0000 7f44e1800640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 -- 0x7f44dc0c8840 con 0x7f44dc158eb0 2024-04-17T19:51:05.116 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:05.123+0000 7f44d3e00640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f44dc158eb0 0x7f44dc1592c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:51:05.116 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:05.123+0000 7f44daa00640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f44dc152a60 0x7f44dc0c6920 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:34080/0 (socket says 172.21.15.44:34080) 2024-04-17T19:51:05.117 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:05.123+0000 7f44daa00640 1 -- 172.21.15.44:0/3910169691 learned_addr learned my addr 172.21.15.44:0/3910169691 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-04-17T19:51:05.117 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:05.123+0000 7f44d3e00640 1 -- 172.21.15.44:0/3910169691 >> v1:172.21.15.62:6789/0 conn(0x7f44dc0c47c0 legacy=0x7f44dc163100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:51:05.117 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:05.123+0000 7f44d3e00640 1 -- 172.21.15.44:0/3910169691 >> v1:172.21.15.44:6789/0 conn(0x7f44dc152a60 legacy=0x7f44dc0c6920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:51:05.117 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:05.123+0000 7f44da000640 1 -- 172.21.15.44:0/3910169691 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3700808486 0 0) 0x7f44dc152e70 con 0x7f44dc152a60 2024-04-17T19:51:05.117 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:05.123+0000 7f44d3e00640 1 -- 172.21.15.44:0/3910169691 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f44dc0c8b20 con 0x7f44dc158eb0 2024-04-17T19:51:05.119 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:05.127+0000 7f44d3e00640 1 --2- 172.21.15.44:0/3910169691 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f44dc158eb0 0x7f44dc1592c0 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f44c40097c0 tx=0x7f44c401c4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6e74ce3db34ecfe server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:51:05.120 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:05.127+0000 7f44da000640 1 -- 172.21.15.44:0/3910169691 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44c40b0070 con 0x7f44dc158eb0 2024-04-17T19:51:05.120 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:05.127+0000 7f44da000640 1 -- 172.21.15.44:0/3910169691 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f44c40ab600 con 0x7f44dc158eb0 2024-04-17T19:51:05.120 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:05.127+0000 7f44da000640 1 -- 172.21.15.44:0/3910169691 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44c40ab9f0 con 0x7f44dc158eb0 2024-04-17T19:51:05.121 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:05.127+0000 7f44e1800640 1 -- 172.21.15.44:0/3910169691 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f44dc158eb0 msgr2=0x7f44dc1592c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:51:05.121 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:05.127+0000 7f44e1800640 1 --2- 172.21.15.44:0/3910169691 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f44dc158eb0 0x7f44dc1592c0 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f44c40097c0 tx=0x7f44c401c4a0 comp rx=0 tx=0).stop 2024-04-17T19:51:05.121 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:05.127+0000 7f44e1800640 1 -- 172.21.15.44:0/3910169691 shutdown_connections 2024-04-17T19:51:05.121 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:05.127+0000 7f44e1800640 1 --2- 172.21.15.44:0/3910169691 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f44dc158eb0 0x7f44dc1592c0 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:51:05.121 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:05.127+0000 7f44e1800640 1 -- 172.21.15.44:0/3910169691 >> 172.21.15.44:0/3910169691 conn(0x7f44dc06c380 msgr2=0x7f44dc070080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:51:05.121 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:05.127+0000 7f44e1800640 1 -- 172.21.15.44:0/3910169691 shutdown_connections 2024-04-17T19:51:05.121 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:05.127+0000 7f44e1800640 1 -- 172.21.15.44:0/3910169691 wait complete. 2024-04-17T19:51:05.123 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:05.131+0000 7f44e1800640 1 Processor -- start 2024-04-17T19:51:05.123 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:05.131+0000 7f44e1800640 1 -- start start 2024-04-17T19:51:05.126 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:05.131+0000 7f44e1800640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f44dc0c47c0 0x7f44dc14ea20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:51:05.126 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:05.131+0000 7f44e1800640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f44dc152a60 0x7f44dc1f4ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:51:05.126 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:05.131+0000 7f44e1800640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f44dc158eb0 0x7f44dc1491d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:51:05.126 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:05.131+0000 7f44e1800640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f44dc167450 con 0x7f44dc158eb0 2024-04-17T19:51:05.126 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:05.131+0000 7f44e1800640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f44dc0c4fe0 con 0x7f44dc152a60 2024-04-17T19:51:05.126 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:05.131+0000 7f44e1800640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7f44dc1675d0 con 0x7f44dc0c47c0 2024-04-17T19:51:05.126 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:05.131+0000 7f44db400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f44dc158eb0 0x7f44dc1491d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:51:05.126 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:05.131+0000 7f44db400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f44dc158eb0 0x7f44dc1491d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:39082/0 (socket says 172.21.15.44:39082) 2024-04-17T19:51:05.127 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:05.131+0000 7f44db400640 1 -- 172.21.15.44:0/3493599428 learned_addr learned my addr 172.21.15.44:0/3493599428 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-04-17T19:51:05.127 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:05.131+0000 7f44daa00640 1 --2- 172.21.15.44:0/3493599428 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f44dc0c47c0 0x7f44dc14ea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:51:05.127 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:05.131+0000 7f44d3e00640 1 --2- 172.21.15.44:0/3493599428 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f44dc152a60 0x7f44dc1f4ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:51:05.127 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:05.131+0000 7f44db400640 1 -- 172.21.15.44:0/3493599428 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f44dc0c47c0 msgr2=0x7f44dc14ea20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:51:05.127 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:05.131+0000 7f44db400640 1 --2- 172.21.15.44:0/3493599428 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f44dc0c47c0 0x7f44dc14ea20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:51:05.127 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:05.131+0000 7f44db400640 1 -- 172.21.15.44:0/3493599428 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f44dc152a60 msgr2=0x7f44dc1f4ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:51:05.127 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:05.131+0000 7f44db400640 1 --2- 172.21.15.44:0/3493599428 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f44dc152a60 0x7f44dc1f4ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:51:05.127 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:05.131+0000 7f44db400640 1 -- 172.21.15.44:0/3493599428 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f44dc1f5530 con 0x7f44dc158eb0 2024-04-17T19:51:05.127 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:05.135+0000 7f44db400640 1 --2- 172.21.15.44:0/3493599428 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f44dc158eb0 0x7f44dc1491d0 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f44d400c730 tx=0x7f44d400cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:51:05.127 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:05.135+0000 7f44d2a00640 1 -- 172.21.15.44:0/3493599428 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44d4003b80 con 0x7f44dc158eb0 2024-04-17T19:51:05.127 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:05.135+0000 7f44d2a00640 1 -- 172.21.15.44:0/3493599428 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f44d4003d20 con 0x7f44dc158eb0 2024-04-17T19:51:05.127 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:05.135+0000 7f44e1800640 1 -- 172.21.15.44:0/3493599428 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f44dc0c34b0 con 0x7f44dc158eb0 2024-04-17T19:51:05.127 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:05.135+0000 7f44d2a00640 1 -- 172.21.15.44:0/3493599428 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44d4005330 con 0x7f44dc158eb0 2024-04-17T19:51:05.128 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:05.135+0000 7f44e1800640 1 -- 172.21.15.44:0/3493599428 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f44dc154dd0 con 0x7f44dc158eb0 2024-04-17T19:51:05.128 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:05.135+0000 7f44e1800640 1 -- 172.21.15.44:0/3493599428 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f44dc1f5700 con 0x7f44dc158eb0 2024-04-17T19:51:05.128 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:05.135+0000 7f44d2a00640 1 -- 172.21.15.44:0/3493599428 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f44d40054d0 con 0x7f44dc158eb0 2024-04-17T19:51:05.129 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:05.139+0000 7f44d2a00640 1 --2- 172.21.15.44:0/3493599428 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f44b80683b0 0x7f44b806a8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:51:05.129 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:05.139+0000 7f44d2a00640 1 -- 172.21.15.44:0/3493599428 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6619+0+0 (secure 0 0 0) 0x7f44d4086d30 con 0x7f44dc158eb0 2024-04-17T19:51:05.130 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:05.139+0000 7f44daa00640 1 --2- 172.21.15.44:0/3493599428 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f44b80683b0 0x7f44b806a8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:51:05.130 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:05.139+0000 7f44daa00640 1 --2- 172.21.15.44:0/3493599428 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f44b80683b0 0x7f44b806a8c0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f44cc000f70 tx=0x7f44cc007d10 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:51:05.133 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:05.143+0000 7f44d2a00640 1 -- 172.21.15.44:0/3493599428 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f44d4056e30 con 0x7f44dc158eb0 2024-04-17T19:51:05.336 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:05.343+0000 7f44e1800640 1 -- 172.21.15.44:0/3493599428 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f44dc0c7ea0 con 0x7f44dc158eb0 2024-04-17T19:51:05.337 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:05.347+0000 7f44d2a00640 1 -- 172.21.15.44:0/3493599428 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 18 v18) ==== 94+0+6911 (secure 0 0 0) 0x7f44d4056730 con 0x7f44dc158eb0 2024-04-17T19:51:05.337 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-04-17T19:51:05.337 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":18,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4263,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.44:6835/1724891996","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6832","nonce":1724891996},{"type":"v1","addr":"172.21.15.44:6835","nonce":1724891996}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":18,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-17T19:46:56.083202+0000","modified":"2024-04-17T19:47:39.954509+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":4306,"mds_1":4294,"mds_2":4269,"mds_3":4268,"mds_4":4266},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4266":{"gid":4266,"name":"c","rank":4,"incarnation":17,"state":"up:active","state_seq":14,"addr":"172.21.15.44:6836/2201911513","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6833","nonce":2201911513},{"type":"v1","addr":"172.21.15.44:6836","nonce":2201911513}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4268":{"gid":4268,"name":"f","rank":3,"incarnation":15,"state":"up:active","state_seq":13,"addr":"172.21.15.62:6837/3085335335","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6836","nonce":3085335335},{"type":"v1","addr":"172.21.15.62:6837","nonce":3085335335}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4269":{"gid":4269,"name":"e","rank":2,"incarnation":13,"state":"up:active","state_seq":11,"addr":"172.21.15.44:6837/4073536070","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6834","nonce":4073536070},{"type":"v1","addr":"172.21.15.44:6837","nonce":4073536070}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4294":{"gid":4294,"name":"d","rank":1,"incarnation":9,"state":"up:active","state_seq":10,"addr":"172.21.15.62:6835/2585862759","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6834","nonce":2585862759},{"type":"v1","addr":"172.21.15.62:6835","nonce":2585862759}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4306":{"gid":4306,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":5,"addr":"172.21.15.62:6839/1537667111","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6838","nonce":1537667111},{"type":"v1","addr":"172.21.15.62:6839","nonce":1537667111}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4306,"qdb_cluster":[4266,4268,4294,4269,4306]},"id":1}]} 2024-04-17T19:51:05.338 INFO:teuthology.orchestra.run.smithi044.stderr:dumped fsmap epoch 18 2024-04-17T19:51:05.340 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:05.347+0000 7f44e1800640 1 -- 172.21.15.44:0/3493599428 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f44b80683b0 msgr2=0x7f44b806a8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:51:05.340 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:05.347+0000 7f44e1800640 1 --2- 172.21.15.44:0/3493599428 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f44b80683b0 0x7f44b806a8c0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f44cc000f70 tx=0x7f44cc007d10 comp rx=0 tx=0).stop 2024-04-17T19:51:05.340 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:05.347+0000 7f44e1800640 1 -- 172.21.15.44:0/3493599428 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f44dc158eb0 msgr2=0x7f44dc1491d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:51:05.340 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:05.347+0000 7f44e1800640 1 --2- 172.21.15.44:0/3493599428 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f44dc158eb0 0x7f44dc1491d0 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f44d400c730 tx=0x7f44d400cbf0 comp rx=0 tx=0).stop 2024-04-17T19:51:05.340 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:05.347+0000 7f44e1800640 1 -- 172.21.15.44:0/3493599428 shutdown_connections 2024-04-17T19:51:05.340 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:05.347+0000 7f44e1800640 1 --2- 172.21.15.44:0/3493599428 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f44b80683b0 0x7f44b806a8c0 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:51:05.340 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:05.347+0000 7f44e1800640 1 --2- 172.21.15.44:0/3493599428 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f44dc158eb0 0x7f44dc1491d0 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:51:05.340 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:05.347+0000 7f44e1800640 1 --2- 172.21.15.44:0/3493599428 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f44dc152a60 0x7f44dc1f4ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:51:05.340 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:05.347+0000 7f44e1800640 1 --2- 172.21.15.44:0/3493599428 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f44dc0c47c0 0x7f44dc14ea20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:51:05.340 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:05.347+0000 7f44e1800640 1 -- 172.21.15.44:0/3493599428 >> 172.21.15.44:0/3493599428 conn(0x7f44dc06c380 msgr2=0x7f44dc0735a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:51:05.340 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:05.347+0000 7f44e1800640 1 -- 172.21.15.44:0/3493599428 shutdown_connections 2024-04-17T19:51:05.340 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:05.347+0000 7f44e1800640 1 -- 172.21.15.44:0/3493599428 wait complete. 2024-04-17T19:51:05.359 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-17T19:51:05.512 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:05.519+0000 7fa44ec00640 1 Processor -- start 2024-04-17T19:51:05.512 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:05.519+0000 7fa44ec00640 1 -- start start 2024-04-17T19:51:05.515 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:05.523+0000 7fa44ec00640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fa448153db0 0x7fa448073820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:51:05.515 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:05.523+0000 7fa44ec00640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa448159ad0 con 0x7fa448073d60 2024-04-17T19:51:05.515 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:05.523+0000 7fa44ec00640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa448159db0 con 0x7fa4480c66d0 2024-04-17T19:51:05.515 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:05.523+0000 7fa44ec00640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 -- 0x7fa44815a090 con 0x7fa448153db0 2024-04-17T19:51:05.515 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:05.523+0000 7fa44cc00640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7fa448073d60 0x7fa4480725b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:45420/0 (socket says 172.21.15.44:45420) 2024-04-17T19:51:05.515 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:05.523+0000 7fa44cc00640 1 -- 172.21.15.44:0/3895262865 learned_addr learned my addr 172.21.15.44:0/3895262865 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-04-17T19:51:05.515 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:05.523+0000 7fa43fe00640 1 --2- 172.21.15.44:0/3895262865 >> v2:172.21.15.62:3300/0 conn(0x7fa448153db0 0x7fa448073820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:51:05.515 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:05.523+0000 7fa447400640 1 -- 172.21.15.44:0/3895262865 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3421476537 0 0) 0x7fa448159ad0 con 0x7fa448073d60 2024-04-17T19:51:05.515 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:05.523+0000 7fa447400640 1 -- 172.21.15.44:0/3895262865 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa42c003530 con 0x7fa448073d60 2024-04-17T19:51:05.515 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:05.523+0000 7fa43fe00640 1 -- 172.21.15.44:0/3895262865 >> v1:172.21.15.62:6789/0 conn(0x7fa4480c66d0 legacy=0x7fa4481536a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:51:05.515 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:05.523+0000 7fa43fe00640 1 -- 172.21.15.44:0/3895262865 >> v1:172.21.15.44:6789/0 conn(0x7fa448073d60 legacy=0x7fa4480725b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:51:05.515 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:05.523+0000 7fa43fe00640 1 -- 172.21.15.44:0/3895262865 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa44815a370 con 0x7fa448153db0 2024-04-17T19:51:05.518 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:05.527+0000 7fa43fe00640 1 --2- 172.21.15.44:0/3895262865 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa448153db0 0x7fa448073820 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fa4300097c0 tx=0x7fa43001c4a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=57fd533010ccfcba server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:51:05.518 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:05.527+0000 7fa447400640 1 -- 172.21.15.44:0/3895262865 <== mon.1 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4300b0070 con 0x7fa448153db0 2024-04-17T19:51:05.518 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:05.527+0000 7fa447400640 1 -- 172.21.15.44:0/3895262865 <== mon.1 v2:172.21.15.62:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7fa4300ab600 con 0x7fa448153db0 2024-04-17T19:51:05.518 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:05.527+0000 7fa447400640 1 -- 172.21.15.44:0/3895262865 <== mon.1 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4300ab9b0 con 0x7fa448153db0 2024-04-17T19:51:05.519 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:05.527+0000 7fa44ec00640 1 -- 172.21.15.44:0/3895262865 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa448153db0 msgr2=0x7fa448073820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:51:05.519 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:05.527+0000 7fa44ec00640 1 --2- 172.21.15.44:0/3895262865 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa448153db0 0x7fa448073820 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fa4300097c0 tx=0x7fa43001c4a0 comp rx=0 tx=0).stop 2024-04-17T19:51:05.519 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:05.527+0000 7fa44ec00640 1 -- 172.21.15.44:0/3895262865 shutdown_connections 2024-04-17T19:51:05.519 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:05.527+0000 7fa44ec00640 1 --2- 172.21.15.44:0/3895262865 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa448153db0 0x7fa448073820 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:51:05.520 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:05.527+0000 7fa44ec00640 1 -- 172.21.15.44:0/3895262865 >> 172.21.15.44:0/3895262865 conn(0x7fa44806c380 msgr2=0x7fa448070080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:51:05.520 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:05.527+0000 7fa44ec00640 1 -- 172.21.15.44:0/3895262865 shutdown_connections 2024-04-17T19:51:05.520 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:05.527+0000 7fa44ec00640 1 -- 172.21.15.44:0/3895262865 wait complete. 2024-04-17T19:51:05.521 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:05.531+0000 7fa44ec00640 1 Processor -- start 2024-04-17T19:51:05.521 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:05.531+0000 7fa44ec00640 1 -- start start 2024-04-17T19:51:05.524 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:05.531+0000 7fa44ec00640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fa448073d60 0x7fa44813c9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:51:05.524 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:05.531+0000 7fa44ec00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa4480c66d0 0x7fa4480cbe80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:51:05.524 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:05.531+0000 7fa44ec00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa448153db0 0x7fa448155650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:51:05.524 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:05.531+0000 7fa44ec00640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fa448167c10 con 0x7fa448153db0 2024-04-17T19:51:05.524 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:05.531+0000 7fa44ec00640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7fa448167a90 con 0x7fa4480c66d0 2024-04-17T19:51:05.524 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:05.531+0000 7fa44ec00640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7fa448167d90 con 0x7fa448073d60 2024-04-17T19:51:05.524 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:05.531+0000 7fa44cc00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa448153db0 0x7fa448155650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:51:05.524 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:05.531+0000 7fa44cc00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa448153db0 0x7fa448155650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:44442/0 (socket says 172.21.15.44:44442) 2024-04-17T19:51:05.525 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:05.531+0000 7fa44cc00640 1 -- 172.21.15.44:0/3980223426 learned_addr learned my addr 172.21.15.44:0/3980223426 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-04-17T19:51:05.525 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:05.531+0000 7fa43fe00640 1 --2- 172.21.15.44:0/3980223426 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa4480c66d0 0x7fa4480cbe80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:51:05.525 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:05.531+0000 7fa447e00640 1 --2- 172.21.15.44:0/3980223426 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fa448073d60 0x7fa44813c9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:51:05.525 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:05.531+0000 7fa44cc00640 1 -- 172.21.15.44:0/3980223426 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fa448073d60 msgr2=0x7fa44813c9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:51:05.525 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:05.531+0000 7fa44cc00640 1 --2- 172.21.15.44:0/3980223426 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fa448073d60 0x7fa44813c9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:51:05.525 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:05.531+0000 7fa44cc00640 1 -- 172.21.15.44:0/3980223426 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa4480c66d0 msgr2=0x7fa4480cbe80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:51:05.525 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:05.531+0000 7fa44cc00640 1 --2- 172.21.15.44:0/3980223426 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa4480c66d0 0x7fa4480cbe80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:51:05.525 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:05.531+0000 7fa44cc00640 1 -- 172.21.15.44:0/3980223426 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa448155b90 con 0x7fa448153db0 2024-04-17T19:51:05.525 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:05.531+0000 7fa44cc00640 1 --2- 172.21.15.44:0/3980223426 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa448153db0 0x7fa448155650 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7fa44000cad0 tx=0x7fa44000cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:51:05.525 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:05.531+0000 7fa444c00640 1 -- 172.21.15.44:0/3980223426 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa440017070 con 0x7fa448153db0 2024-04-17T19:51:05.525 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:05.531+0000 7fa444c00640 1 -- 172.21.15.44:0/3980223426 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7fa44000ac30 con 0x7fa448153db0 2024-04-17T19:51:05.525 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:05.531+0000 7fa444c00640 1 -- 172.21.15.44:0/3980223426 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa440012400 con 0x7fa448153db0 2024-04-17T19:51:05.526 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:05.531+0000 7fa44ec00640 1 -- 172.21.15.44:0/3980223426 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa448156920 con 0x7fa448153db0 2024-04-17T19:51:05.526 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:05.531+0000 7fa44ec00640 1 -- 172.21.15.44:0/3980223426 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa448156ee0 con 0x7fa448153db0 2024-04-17T19:51:05.526 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:05.535+0000 7fa44ec00640 1 -- 172.21.15.44:0/3980223426 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa44813d2c0 con 0x7fa448153db0 2024-04-17T19:51:05.526 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:05.535+0000 7fa444c00640 1 -- 172.21.15.44:0/3980223426 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fa44001a070 con 0x7fa448153db0 2024-04-17T19:51:05.527 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:05.535+0000 7fa444c00640 1 --2- 172.21.15.44:0/3980223426 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7fa4240683b0 0x7fa42406a8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:51:05.527 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:05.535+0000 7fa444c00640 1 -- 172.21.15.44:0/3980223426 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6619+0+0 (secure 0 0 0) 0x7fa440086a60 con 0x7fa448153db0 2024-04-17T19:51:05.528 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:05.535+0000 7fa447e00640 1 --2- 172.21.15.44:0/3980223426 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7fa4240683b0 0x7fa42406a8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:51:05.529 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:05.535+0000 7fa447e00640 1 --2- 172.21.15.44:0/3980223426 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7fa4240683b0 0x7fa42406a8c0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fa438007fd0 tx=0x7fa438009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:51:05.532 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:05.539+0000 7fa444c00640 1 -- 172.21.15.44:0/3980223426 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fa440056510 con 0x7fa448153db0 2024-04-17T19:51:05.698 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:05.707+0000 7fa44ec00640 1 -- 172.21.15.44:0/3980223426 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fa44813d050 con 0x7fa448153db0 2024-04-17T19:51:05.700 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:05.707+0000 7fa444c00640 1 -- 172.21.15.44:0/3980223426 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) ==== 74+0+18623 (secure 0 0 0) 0x7fa44005a810 con 0x7fa448153db0 2024-04-17T19:51:05.700 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-04-17T19:51:05.701 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":27,"fsid":"703f77ca-79c6-4a66-b576-62c526cb1021","created":"2024-04-17T19:46:30.831994+0000","modified":"2024-04-17T19:47:37.943331+0000","last_up_change":"2024-04-17T19:46:41.988197+0000","last_in_change":"2024-04-17T19:46:33.407430+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-17T19:46:41.940380+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-17T19:46:54.222150+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-17T19:46:55.031694+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-17T19:46:58.707529+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"30520dc6-eea6-43d4-ab60-3ca9e92329dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6800","nonce":1018735925},{"type":"v1","addr":"172.21.15.44:6801","nonce":1018735925}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6802","nonce":1018735925},{"type":"v1","addr":"172.21.15.44:6803","nonce":1018735925}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6806","nonce":1018735925},{"type":"v1","addr":"172.21.15.44:6807","nonce":1018735925}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6804","nonce":1018735925},{"type":"v1","addr":"172.21.15.44:6805","nonce":1018735925}]},"public_addr":"172.21.15.44:6801/1018735925","cluster_addr":"172.21.15.44:6803/1018735925","heartbeat_back_addr":"172.21.15.44:6807/1018735925","heartbeat_front_addr":"172.21.15.44:6805/1018735925","state":["exists","up"]},{"osd":1,"uuid":"079bd511-b6ce-449b-8f11-17b311b12f7c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6817","nonce":1452577434},{"type":"v1","addr":"172.21.15.44:6820","nonce":1452577434}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6823","nonce":1452577434},{"type":"v1","addr":"172.21.15.44:6825","nonce":1452577434}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6830","nonce":1452577434},{"type":"v1","addr":"172.21.15.44:6831","nonce":1452577434}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6828","nonce":1452577434},{"type":"v1","addr":"172.21.15.44:6829","nonce":1452577434}]},"public_addr":"172.21.15.44:6820/1452577434","cluster_addr":"172.21.15.44:6825/1452577434","heartbeat_back_addr":"172.21.15.44:6831/1452577434","heartbeat_front_addr":"172.21.15.44:6829/1452577434","state":["exists","up"]},{"osd":2,"uuid":"34f0b9ab-b1d2-4ee9-841c-f15afbb6bec5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6816","nonce":1160071918},{"type":"v1","addr":"172.21.15.44:6818","nonce":1160071918}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6819","nonce":1160071918},{"type":"v1","addr":"172.21.15.44:6821","nonce":1160071918}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6826","nonce":1160071918},{"type":"v1","addr":"172.21.15.44:6827","nonce":1160071918}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6822","nonce":1160071918},{"type":"v1","addr":"172.21.15.44:6824","nonce":1160071918}]},"public_addr":"172.21.15.44:6818/1160071918","cluster_addr":"172.21.15.44:6821/1160071918","heartbeat_back_addr":"172.21.15.44:6827/1160071918","heartbeat_front_addr":"172.21.15.44:6824/1160071918","state":["exists","up"]},{"osd":3,"uuid":"4740032d-fe34-4b1b-bb85-f430896fc3c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6808","nonce":4236454921},{"type":"v1","addr":"172.21.15.44:6809","nonce":4236454921}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6810","nonce":4236454921},{"type":"v1","addr":"172.21.15.44:6811","nonce":4236454921}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6814","nonce":4236454921},{"type":"v1","addr":"172.21.15.44:6815","nonce":4236454921}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6812","nonce":4236454921},{"type":"v1","addr":"172.21.15.44:6813","nonce":4236454921}]},"public_addr":"172.21.15.44:6809/4236454921","cluster_addr":"172.21.15.44:6811/4236454921","heartbeat_back_addr":"172.21.15.44:6815/4236454921","heartbeat_front_addr":"172.21.15.44:6813/4236454921","state":["exists","up"]},{"osd":4,"uuid":"7dbedb00-302d-4d52-810c-e18839254da1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6800","nonce":2293251376},{"type":"v1","addr":"172.21.15.62:6801","nonce":2293251376}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6802","nonce":2293251376},{"type":"v1","addr":"172.21.15.62:6803","nonce":2293251376}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6806","nonce":2293251376},{"type":"v1","addr":"172.21.15.62:6807","nonce":2293251376}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6804","nonce":2293251376},{"type":"v1","addr":"172.21.15.62:6805","nonce":2293251376}]},"public_addr":"172.21.15.62:6801/2293251376","cluster_addr":"172.21.15.62:6803/2293251376","heartbeat_back_addr":"172.21.15.62:6807/2293251376","heartbeat_front_addr":"172.21.15.62:6805/2293251376","state":["exists","up"]},{"osd":5,"uuid":"38c1e8d9-393d-4f33-a97a-3295cf5c5b07","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6808","nonce":1551020300},{"type":"v1","addr":"172.21.15.62:6809","nonce":1551020300}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6810","nonce":1551020300},{"type":"v1","addr":"172.21.15.62:6811","nonce":1551020300}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6814","nonce":1551020300},{"type":"v1","addr":"172.21.15.62:6815","nonce":1551020300}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6812","nonce":1551020300},{"type":"v1","addr":"172.21.15.62:6813","nonce":1551020300}]},"public_addr":"172.21.15.62:6809/1551020300","cluster_addr":"172.21.15.62:6811/1551020300","heartbeat_back_addr":"172.21.15.62:6815/1551020300","heartbeat_front_addr":"172.21.15.62:6813/1551020300","state":["exists","up"]},{"osd":6,"uuid":"f6ff81c6-f14d-4477-88e3-9116cc5a2992","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6824","nonce":2602310256},{"type":"v1","addr":"172.21.15.62:6825","nonce":2602310256}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6826","nonce":2602310256},{"type":"v1","addr":"172.21.15.62:6827","nonce":2602310256}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6830","nonce":2602310256},{"type":"v1","addr":"172.21.15.62:6831","nonce":2602310256}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6828","nonce":2602310256},{"type":"v1","addr":"172.21.15.62:6829","nonce":2602310256}]},"public_addr":"172.21.15.62:6825/2602310256","cluster_addr":"172.21.15.62:6827/2602310256","heartbeat_back_addr":"172.21.15.62:6831/2602310256","heartbeat_front_addr":"172.21.15.62:6829/2602310256","state":["exists","up"]},{"osd":7,"uuid":"ce395bc3-bcb5-4b94-a523-5bb9df491eca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6816","nonce":2912738359},{"type":"v1","addr":"172.21.15.62:6817","nonce":2912738359}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6818","nonce":2912738359},{"type":"v1","addr":"172.21.15.62:6819","nonce":2912738359}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6822","nonce":2912738359},{"type":"v1","addr":"172.21.15.62:6823","nonce":2912738359}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6820","nonce":2912738359},{"type":"v1","addr":"172.21.15.62:6821","nonce":2912738359}]},"public_addr":"172.21.15.62:6817/2912738359","cluster_addr":"172.21.15.62:6819/2912738359","heartbeat_back_addr":"172.21.15.62:6823/2912738359","heartbeat_front_addr":"172.21.15.62:6821/2912738359","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T19:46:39.302883+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T19:46:39.177705+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T19:46:39.188894+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T19:46:39.313009+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T19:46:38.870508+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T19:46:38.790900+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T19:46:38.979163+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T19:46:38.992348+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.c","mappings":[{"from":0,"to":4}]},{"pgid":"3.15","mappings":[{"from":0,"to":7}]},{"pgid":"4.f","mappings":[{"from":7,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-17T19:51:05.702 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:05.711+0000 7fa44ec00640 1 -- 172.21.15.44:0/3980223426 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7fa4240683b0 msgr2=0x7fa42406a8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:51:05.702 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:05.711+0000 7fa44ec00640 1 --2- 172.21.15.44:0/3980223426 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7fa4240683b0 0x7fa42406a8c0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fa438007fd0 tx=0x7fa438009040 comp rx=0 tx=0).stop 2024-04-17T19:51:05.702 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:05.711+0000 7fa44ec00640 1 -- 172.21.15.44:0/3980223426 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa448153db0 msgr2=0x7fa448155650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:51:05.702 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:05.711+0000 7fa44ec00640 1 --2- 172.21.15.44:0/3980223426 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa448153db0 0x7fa448155650 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7fa44000cad0 tx=0x7fa44000cf90 comp rx=0 tx=0).stop 2024-04-17T19:51:05.702 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:05.711+0000 7fa44ec00640 1 -- 172.21.15.44:0/3980223426 shutdown_connections 2024-04-17T19:51:05.702 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:05.711+0000 7fa44ec00640 1 --2- 172.21.15.44:0/3980223426 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7fa4240683b0 0x7fa42406a8c0 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:51:05.702 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:05.711+0000 7fa44ec00640 1 --2- 172.21.15.44:0/3980223426 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa448153db0 0x7fa448155650 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:51:05.702 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:05.711+0000 7fa44ec00640 1 --2- 172.21.15.44:0/3980223426 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa4480c66d0 0x7fa4480cbe80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:51:05.703 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:05.711+0000 7fa44ec00640 1 --2- 172.21.15.44:0/3980223426 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fa448073d60 0x7fa44813c9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:51:05.703 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:05.711+0000 7fa44ec00640 1 -- 172.21.15.44:0/3980223426 >> 172.21.15.44:0/3980223426 conn(0x7fa44806c380 msgr2=0x7fa448152090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:51:05.703 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:05.711+0000 7fa44ec00640 1 -- 172.21.15.44:0/3980223426 shutdown_connections 2024-04-17T19:51:05.703 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:05.711+0000 7fa44ec00640 1 -- 172.21.15.44:0/3980223426 wait complete. 2024-04-17T19:51:05.722 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-04-17T19:51:05.874 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:05.883+0000 7f967ee00640 1 Processor -- start 2024-04-17T19:51:05.875 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:05.883+0000 7f967ee00640 1 -- start start 2024-04-17T19:51:05.876 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:05.883+0000 7f967ee00640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f9678152860 0x7f96780c68b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:51:05.876 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:05.883+0000 7f967ee00640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f96780c80a0 0x7f96780c84b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:51:05.877 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:05.883+0000 7f967ee00640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f96780c89f0 con 0x7f9678159140 2024-04-17T19:51:05.877 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:05.883+0000 7f967ee00640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 -- 0x7f96780c6eb0 con 0x7f9678152860 2024-04-17T19:51:05.877 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:05.883+0000 7f967ee00640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7f96780c78e0 con 0x7f96780c80a0 2024-04-17T19:51:05.877 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:05.883+0000 7f966fe00640 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f9678159140 0x7f96780c47e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.44:46756/0 (socket says 172.21.15.44:46756) 2024-04-17T19:51:05.877 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:05.883+0000 7f9677e00640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f9678152860 0x7f96780c68b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:51:05.877 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:05.883+0000 7f966fe00640 1 -- 172.21.15.44:0/625496945 learned_addr learned my addr 172.21.15.44:0/625496945 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-04-17T19:51:05.877 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:05.883+0000 7f967ce00640 1 --2- 172.21.15.44:0/625496945 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f96780c80a0 0x7f96780c84b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:51:05.878 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:05.887+0000 7f9677400640 1 -- 172.21.15.44:0/625496945 <== mon.1 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1648562442 0 0) 0x7f9660001120 con 0x7f9678159140 2024-04-17T19:51:05.878 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:05.887+0000 7f9677400640 1 -- 172.21.15.44:0/625496945 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f965c003530 con 0x7f9678159140 2024-04-17T19:51:05.878 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:05.887+0000 7f9677e00640 1 -- 172.21.15.44:0/625496945 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f96780c80a0 msgr2=0x7f96780c84b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T19:51:05.878 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:05.887+0000 7f9677e00640 1 --2- 172.21.15.44:0/625496945 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f96780c80a0 0x7f96780c84b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:51:05.878 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:05.887+0000 7f9677e00640 1 -- 172.21.15.44:0/625496945 >> v1:172.21.15.62:6789/0 conn(0x7f9678159140 legacy=0x7f96780c47e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:51:05.878 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:05.887+0000 7f9677e00640 1 -- 172.21.15.44:0/625496945 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f96780c4000 con 0x7f9678152860 2024-04-17T19:51:05.879 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:05.887+0000 7f967ce00640 1 --2- 172.21.15.44:0/625496945 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f96780c80a0 0x7f96780c84b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-17T19:51:05.880 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:05.887+0000 7f9677e00640 1 --2- 172.21.15.44:0/625496945 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9678152860 0x7f96780c68b0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f96680097c0 tx=0x7f966801c410 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1fb109a7411de314 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:51:05.881 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:05.887+0000 7f9677400640 1 -- 172.21.15.44:0/625496945 <== mon.1 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96680b0070 con 0x7f9678152860 2024-04-17T19:51:05.881 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:05.887+0000 7f9677400640 1 -- 172.21.15.44:0/625496945 <== mon.1 v2:172.21.15.62:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f96680ab600 con 0x7f9678152860 2024-04-17T19:51:05.881 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:05.887+0000 7f9677400640 1 -- 172.21.15.44:0/625496945 <== mon.1 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96680ab9f0 con 0x7f9678152860 2024-04-17T19:51:05.882 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:05.891+0000 7f967ee00640 1 -- 172.21.15.44:0/625496945 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9678152860 msgr2=0x7f96780c68b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:51:05.882 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:05.891+0000 7f967ee00640 1 --2- 172.21.15.44:0/625496945 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9678152860 0x7f96780c68b0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f96680097c0 tx=0x7f966801c410 comp rx=0 tx=0).stop 2024-04-17T19:51:05.882 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:05.891+0000 7f967ee00640 1 -- 172.21.15.44:0/625496945 shutdown_connections 2024-04-17T19:51:05.882 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:05.891+0000 7f967ee00640 1 --2- 172.21.15.44:0/625496945 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f96780c80a0 0x7f96780c84b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:51:05.882 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:05.891+0000 7f967ee00640 1 --2- 172.21.15.44:0/625496945 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9678152860 0x7f96780c68b0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:51:05.882 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:05.891+0000 7f967ee00640 1 -- 172.21.15.44:0/625496945 >> 172.21.15.44:0/625496945 conn(0x7f967806c380 msgr2=0x7f9678070080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:51:05.882 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:05.891+0000 7f967ee00640 1 -- 172.21.15.44:0/625496945 shutdown_connections 2024-04-17T19:51:05.882 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:05.891+0000 7f967ee00640 1 -- 172.21.15.44:0/625496945 wait complete. 2024-04-17T19:51:05.884 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:05.891+0000 7f967ee00640 1 Processor -- start 2024-04-17T19:51:05.884 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:05.891+0000 7f967ee00640 1 -- start start 2024-04-17T19:51:05.886 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:05.895+0000 7f967ee00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f96780c80a0 0x7f967814d510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:51:05.886 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:05.895+0000 7f967ee00640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f9678152860 0x7f9678072a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:51:05.886 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:05.895+0000 7f967ee00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9678159140 0x7f9678143050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:51:05.886 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:05.895+0000 7f967ee00640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f96780c5070 con 0x7f96780c80a0 2024-04-17T19:51:05.887 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:05.895+0000 7f967ee00640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f96780c4ef0 con 0x7f9678159140 2024-04-17T19:51:05.887 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:05.895+0000 7f967ee00640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7f9678165860 con 0x7f9678152860 2024-04-17T19:51:05.887 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:05.895+0000 7f9677e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f96780c80a0 0x7f967814d510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:51:05.887 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:05.895+0000 7f9677e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f96780c80a0 0x7f967814d510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:44444/0 (socket says 172.21.15.44:44444) 2024-04-17T19:51:05.887 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:05.895+0000 7f9677e00640 1 -- 172.21.15.44:0/2464287603 learned_addr learned my addr 172.21.15.44:0/2464287603 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-04-17T19:51:05.887 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:05.895+0000 7f967ce00640 1 --2- 172.21.15.44:0/2464287603 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9678159140 0x7f9678143050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:51:05.887 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:05.895+0000 7f966fe00640 1 --2- 172.21.15.44:0/2464287603 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f9678152860 0x7f9678072a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:51:05.887 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:05.895+0000 7f9677e00640 1 -- 172.21.15.44:0/2464287603 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f9678152860 msgr2=0x7f9678072a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:51:05.887 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:05.895+0000 7f9677e00640 1 --2- 172.21.15.44:0/2464287603 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f9678152860 0x7f9678072a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:51:05.887 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:05.895+0000 7f9677e00640 1 -- 172.21.15.44:0/2464287603 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9678159140 msgr2=0x7f9678143050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:51:05.887 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:05.895+0000 7f9677e00640 1 --2- 172.21.15.44:0/2464287603 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9678159140 0x7f9678143050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:51:05.887 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:05.895+0000 7f9677e00640 1 -- 172.21.15.44:0/2464287603 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9678149640 con 0x7f96780c80a0 2024-04-17T19:51:05.888 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:05.895+0000 7f9677e00640 1 --2- 172.21.15.44:0/2464287603 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f96780c80a0 0x7f967814d510 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f966801a040 tx=0x7f96680191b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:51:05.888 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:05.895+0000 7f9674c00640 1 -- 172.21.15.44:0/2464287603 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96680b0040 con 0x7f96780c80a0 2024-04-17T19:51:05.889 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:05.895+0000 7f9674c00640 1 -- 172.21.15.44:0/2464287603 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f96680b9070 con 0x7f96780c80a0 2024-04-17T19:51:05.889 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:05.895+0000 7f9674c00640 1 -- 172.21.15.44:0/2464287603 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96680b4670 con 0x7f96780c80a0 2024-04-17T19:51:05.889 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:05.895+0000 7f967ee00640 1 -- 172.21.15.44:0/2464287603 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9678157190 con 0x7f96780c80a0 2024-04-17T19:51:05.889 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:05.895+0000 7f967ee00640 1 -- 172.21.15.44:0/2464287603 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f967814e730 con 0x7f96780c80a0 2024-04-17T19:51:05.889 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:05.895+0000 7f967ee00640 1 -- 172.21.15.44:0/2464287603 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f967804ff10 con 0x7f96780c80a0 2024-04-17T19:51:05.889 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:05.895+0000 7f9674c00640 1 -- 172.21.15.44:0/2464287603 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f96680b4810 con 0x7f96780c80a0 2024-04-17T19:51:05.889 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:05.899+0000 7f9674c00640 1 --2- 172.21.15.44:0/2464287603 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f96540683b0 0x7f965406a8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:51:05.890 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:05.899+0000 7f9674c00640 1 -- 172.21.15.44:0/2464287603 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6619+0+0 (secure 0 0 0) 0x7f9668120ba0 con 0x7f96780c80a0 2024-04-17T19:51:05.890 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:05.899+0000 7f966fe00640 1 --2- 172.21.15.44:0/2464287603 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f96540683b0 0x7f965406a8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:51:05.891 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:05.899+0000 7f966fe00640 1 --2- 172.21.15.44:0/2464287603 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f96540683b0 0x7f965406a8c0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f9660005890 tx=0x7f9660009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:51:05.894 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:05.903+0000 7f9674c00640 1 -- 172.21.15.44:0/2464287603 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f9668016090 con 0x7f96780c80a0 2024-04-17T19:51:06.092 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:06.099+0000 7f967ee00640 1 -- 172.21.15.44:0/2464287603 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f96780c7e80 con 0x7f96780c80a0 2024-04-17T19:51:06.095 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:06.103+0000 7f9674c00640 1 -- 172.21.15.44:0/2464287603 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v19) ==== 161+0+0 (secure 0 0 0) 0x7f96680f0ca0 con 0x7f96780c80a0 2024-04-17T19:51:06.095 INFO:teuthology.orchestra.run.smithi044.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-04-17T19:51:06.097 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:06.103+0000 7f967ee00640 1 -- 172.21.15.44:0/2464287603 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f96540683b0 msgr2=0x7f965406a8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:51:06.098 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:06.107+0000 7f967ee00640 1 --2- 172.21.15.44:0/2464287603 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f96540683b0 0x7f965406a8c0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f9660005890 tx=0x7f9660009040 comp rx=0 tx=0).stop 2024-04-17T19:51:06.098 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:06.107+0000 7f967ee00640 1 -- 172.21.15.44:0/2464287603 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f96780c80a0 msgr2=0x7f967814d510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:51:06.098 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:06.107+0000 7f967ee00640 1 --2- 172.21.15.44:0/2464287603 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f96780c80a0 0x7f967814d510 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f966801a040 tx=0x7f96680191b0 comp rx=0 tx=0).stop 2024-04-17T19:51:06.098 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:06.107+0000 7f967ee00640 1 -- 172.21.15.44:0/2464287603 shutdown_connections 2024-04-17T19:51:06.098 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:06.107+0000 7f967ee00640 1 --2- 172.21.15.44:0/2464287603 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f96540683b0 0x7f965406a8c0 secure :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f9660005890 tx=0x7f9660009040 comp rx=0 tx=0).stop 2024-04-17T19:51:06.098 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:06.107+0000 7f967ee00640 1 --2- 172.21.15.44:0/2464287603 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f9678152860 0x7f9678072a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:51:06.098 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:06.107+0000 7f967ee00640 1 --2- 172.21.15.44:0/2464287603 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9678159140 0x7f9678143050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:51:06.098 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:06.107+0000 7f967ee00640 1 --2- 172.21.15.44:0/2464287603 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f96780c80a0 0x7f967814d510 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:51:06.098 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:06.107+0000 7f967ee00640 1 -- 172.21.15.44:0/2464287603 >> 172.21.15.44:0/2464287603 conn(0x7f967806c380 msgr2=0x7f967814f7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:51:06.099 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:06.107+0000 7f967ee00640 1 -- 172.21.15.44:0/2464287603 shutdown_connections 2024-04-17T19:51:06.099 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:06.107+0000 7f967ee00640 1 -- 172.21.15.44:0/2464287603 wait complete. 2024-04-17T19:51:06.119 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-04-17T19:51:06.199 INFO:tasks.ceph.mds.f.smithi062.stdout:starting mds.f at 2024-04-17T19:51:06.210 INFO:tasks.ceph.mds.d.smithi062.stdout:starting mds.d at 2024-04-17T19:51:06.217 INFO:tasks.ceph.mds.b.smithi062.stdout:starting mds.b at 2024-04-17T19:51:06.246 INFO:tasks.ceph.mds.e.smithi044.stdout:starting mds.e at 2024-04-17T19:51:06.246 INFO:tasks.ceph.mds.c.smithi044.stdout:starting mds.c at 2024-04-17T19:51:06.281 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:06.287+0000 7fafc2200640 1 Processor -- start 2024-04-17T19:51:06.281 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:06.291+0000 7fafc2200640 1 -- start start 2024-04-17T19:51:06.284 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:06.291+0000 7fafc2200640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fafbc0cb540 0x7fafbc155ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:51:06.284 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:06.291+0000 7fafc2200640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fafbc0cab10 con 0x7fafbc06d690 2024-04-17T19:51:06.284 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:06.291+0000 7fafc2200640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fafbc0ca4f0 con 0x7fafbc15c590 2024-04-17T19:51:06.284 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:06.291+0000 7fafc2200640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 -- 0x7fafbc0ca2a0 con 0x7fafbc0cb540 2024-04-17T19:51:06.284 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:06.291+0000 7fafbb400640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7fafbc06d690 0x7fafbc0cef90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:45440/0 (socket says 172.21.15.44:45440) 2024-04-17T19:51:06.284 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:06.291+0000 7fafbb400640 1 -- 172.21.15.44:0/2653391823 learned_addr learned my addr 172.21.15.44:0/2653391823 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-04-17T19:51:06.284 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:06.291+0000 7fafbbe00640 1 --2- 172.21.15.44:0/2653391823 >> v2:172.21.15.62:3300/0 conn(0x7fafbc0cb540 0x7fafbc155ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:51:06.284 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:06.291+0000 7fafbaa00640 1 -- 172.21.15.44:0/2653391823 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 41168622 0 0) 0x7fafbc0cab10 con 0x7fafbc06d690 2024-04-17T19:51:06.284 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:06.291+0000 7fafbaa00640 1 -- 172.21.15.44:0/2653391823 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fafa0003530 con 0x7fafbc06d690 2024-04-17T19:51:06.285 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:06.291+0000 7fafbaa00640 1 -- 172.21.15.44:0/2653391823 <== mon.1 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 933492148 0 0) 0x7fafbc0ca4f0 con 0x7fafbc15c590 2024-04-17T19:51:06.285 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:06.291+0000 7fafbaa00640 1 -- 172.21.15.44:0/2653391823 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fafbc0cab10 con 0x7fafbc15c590 2024-04-17T19:51:06.285 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:06.291+0000 7fafbbe00640 1 -- 172.21.15.44:0/2653391823 >> v1:172.21.15.62:6789/0 conn(0x7fafbc15c590 legacy=0x7fafbc164280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:51:06.285 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:06.291+0000 7fafbbe00640 1 -- 172.21.15.44:0/2653391823 >> v1:172.21.15.44:6789/0 conn(0x7fafbc06d690 legacy=0x7fafbc0cef90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:51:06.285 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:06.291+0000 7fafbbe00640 1 -- 172.21.15.44:0/2653391823 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fafbc15bab0 con 0x7fafbc0cb540 2024-04-17T19:51:06.286 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:06.295+0000 7fafbbe00640 1 --2- 172.21.15.44:0/2653391823 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fafbc0cb540 0x7fafbc155ba0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fafb4009d90 tx=0x7fafb401f150 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4f6b5430e11cc13a server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:51:06.287 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:06.295+0000 7fafbaa00640 1 -- 172.21.15.44:0/2653391823 <== mon.1 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fafb40b4070 con 0x7fafbc0cb540 2024-04-17T19:51:06.287 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:06.295+0000 7fafbaa00640 1 -- 172.21.15.44:0/2653391823 <== mon.1 v2:172.21.15.62:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7fafb40af600 con 0x7fafbc0cb540 2024-04-17T19:51:06.287 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:06.295+0000 7fafbaa00640 1 -- 172.21.15.44:0/2653391823 <== mon.1 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fafb40af9b0 con 0x7fafbc0cb540 2024-04-17T19:51:06.288 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:06.295+0000 7fafc2200640 1 -- 172.21.15.44:0/2653391823 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fafbc0cb540 msgr2=0x7fafbc155ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:51:06.288 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:06.295+0000 7fafc2200640 1 --2- 172.21.15.44:0/2653391823 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fafbc0cb540 0x7fafbc155ba0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fafb4009d90 tx=0x7fafb401f150 comp rx=0 tx=0).stop 2024-04-17T19:51:06.288 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:06.295+0000 7fafc2200640 1 -- 172.21.15.44:0/2653391823 shutdown_connections 2024-04-17T19:51:06.288 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:06.295+0000 7fafc2200640 1 --2- 172.21.15.44:0/2653391823 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fafbc0cb540 0x7fafbc155ba0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:51:06.288 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:06.295+0000 7fafc2200640 1 -- 172.21.15.44:0/2653391823 >> 172.21.15.44:0/2653391823 conn(0x7fafbc067eb0 msgr2=0x7fafbc0682c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:51:06.288 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:06.295+0000 7fafc2200640 1 -- 172.21.15.44:0/2653391823 shutdown_connections 2024-04-17T19:51:06.288 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:06.295+0000 7fafc2200640 1 -- 172.21.15.44:0/2653391823 wait complete. 2024-04-17T19:51:06.290 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:06.299+0000 7fafc2200640 1 Processor -- start 2024-04-17T19:51:06.290 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:06.299+0000 7fafc2200640 1 -- start start 2024-04-17T19:51:06.293 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:06.299+0000 7fafc2200640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fafbc06d690 0x7fafbc15ac50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:51:06.293 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:06.299+0000 7fafc2200640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fafbc0cb540 0x7fafbc14ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:51:06.293 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:06.299+0000 7fafc2200640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fafbc15c590 0x7fafbc13eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:51:06.293 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:06.299+0000 7fafc2200640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fafbc15c070 con 0x7fafbc0cb540 2024-04-17T19:51:06.293 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:06.299+0000 7fafc2200640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7fafbc0ca7d0 con 0x7fafbc15c590 2024-04-17T19:51:06.293 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:06.299+0000 7fafc2200640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7fafbc0cb950 con 0x7fafbc06d690 2024-04-17T19:51:06.293 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:06.299+0000 7fafb3e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fafbc0cb540 0x7fafbc14ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:51:06.293 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:06.299+0000 7fafb3e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fafbc0cb540 0x7fafbc14ede0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:44478/0 (socket says 172.21.15.44:44478) 2024-04-17T19:51:06.294 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:06.299+0000 7fafb3e00640 1 -- 172.21.15.44:0/3852477524 learned_addr learned my addr 172.21.15.44:0/3852477524 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-04-17T19:51:06.294 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:06.299+0000 7fafbb400640 1 --2- 172.21.15.44:0/3852477524 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fafbc06d690 0x7fafbc15ac50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:51:06.294 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:06.299+0000 7fafbbe00640 1 --2- 172.21.15.44:0/3852477524 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fafbc15c590 0x7fafbc13eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:51:06.294 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:06.299+0000 7fafb3e00640 1 -- 172.21.15.44:0/3852477524 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fafbc06d690 msgr2=0x7fafbc15ac50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:51:06.294 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:06.299+0000 7fafb3e00640 1 --2- 172.21.15.44:0/3852477524 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fafbc06d690 0x7fafbc15ac50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:51:06.294 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:06.299+0000 7fafb3e00640 1 -- 172.21.15.44:0/3852477524 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fafbc15c590 msgr2=0x7fafbc13eb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:51:06.294 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:06.299+0000 7fafb3e00640 1 --2- 172.21.15.44:0/3852477524 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fafbc15c590 0x7fafbc13eb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:51:06.294 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:06.299+0000 7fafb3e00640 1 -- 172.21.15.44:0/3852477524 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fafbc14f320 con 0x7fafbc0cb540 2024-04-17T19:51:06.294 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:06.299+0000 7fafb3e00640 1 --2- 172.21.15.44:0/3852477524 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fafbc0cb540 0x7fafbc14ede0 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7fafa400c3a0 tx=0x7fafa400c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:51:06.294 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:06.299+0000 7fafb3400640 1 -- 172.21.15.44:0/3852477524 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fafa4017070 con 0x7fafbc0cb540 2024-04-17T19:51:06.294 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:06.299+0000 7fafb3400640 1 -- 172.21.15.44:0/3852477524 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7fafa40052f0 con 0x7fafbc0cb540 2024-04-17T19:51:06.294 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:06.299+0000 7fafc2200640 1 -- 172.21.15.44:0/3852477524 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fafbc1477d0 con 0x7fafbc0cb540 2024-04-17T19:51:06.295 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:06.303+0000 7fafb3400640 1 -- 172.21.15.44:0/3852477524 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fafa4003860 con 0x7fafbc0cb540 2024-04-17T19:51:06.295 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:06.303+0000 7fafc2200640 1 -- 172.21.15.44:0/3852477524 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fafbc147d50 con 0x7fafbc0cb540 2024-04-17T19:51:06.295 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:06.303+0000 7fafc2200640 1 -- 172.21.15.44:0/3852477524 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fafbc04fea0 con 0x7fafbc0cb540 2024-04-17T19:51:06.295 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:06.303+0000 7fafb3400640 1 -- 172.21.15.44:0/3852477524 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fafa401a070 con 0x7fafbc0cb540 2024-04-17T19:51:06.296 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:06.303+0000 7fafb3400640 1 --2- 172.21.15.44:0/3852477524 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7faf98068380 0x7faf9806a890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:51:06.296 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:06.303+0000 7fafb3400640 1 -- 172.21.15.44:0/3852477524 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 7049+0+0 (secure 0 0 0) 0x7fafa40862d0 con 0x7fafbc0cb540 2024-04-17T19:51:06.296 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:06.303+0000 7fafbb400640 1 --2- 172.21.15.44:0/3852477524 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7faf98068380 0x7faf9806a890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:51:06.297 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:06.307+0000 7fafbb400640 1 --2- 172.21.15.44:0/3852477524 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7faf98068380 0x7faf9806a890 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fafac007fd0 tx=0x7fafac009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:51:06.300 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:06.307+0000 7fafb3400640 1 -- 172.21.15.44:0/3852477524 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fafa4055c60 con 0x7fafbc0cb540 2024-04-17T19:51:06.502 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:06.511+0000 7fafc2200640 1 -- 172.21.15.44:0/3852477524 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7fafbc0cad40 con 0x7fafbc0cb540 2024-04-17T19:51:07.097 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:07.107+0000 7fafb3400640 1 -- 172.21.15.44:0/3852477524 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v20) ==== 104+0+0 (secure 0 0 0) 0x7fafa4059f60 con 0x7fafbc0cb540 2024-04-17T19:51:07.100 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:07.107+0000 7fafc2200640 1 -- 172.21.15.44:0/3852477524 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7faf98068380 msgr2=0x7faf9806a890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:51:07.100 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:07.107+0000 7fafc2200640 1 --2- 172.21.15.44:0/3852477524 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7faf98068380 0x7faf9806a890 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fafac007fd0 tx=0x7fafac009040 comp rx=0 tx=0).stop 2024-04-17T19:51:07.100 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:07.107+0000 7fafc2200640 1 -- 172.21.15.44:0/3852477524 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fafbc0cb540 msgr2=0x7fafbc14ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:51:07.101 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:07.107+0000 7fafc2200640 1 --2- 172.21.15.44:0/3852477524 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fafbc0cb540 0x7fafbc14ede0 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7fafa400c3a0 tx=0x7fafa400c860 comp rx=0 tx=0).stop 2024-04-17T19:51:07.101 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:07.107+0000 7fafc2200640 1 -- 172.21.15.44:0/3852477524 shutdown_connections 2024-04-17T19:51:07.101 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:07.107+0000 7fafc2200640 1 --2- 172.21.15.44:0/3852477524 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7faf98068380 0x7faf9806a890 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:51:07.101 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:07.107+0000 7fafc2200640 1 --2- 172.21.15.44:0/3852477524 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fafbc15c590 0x7fafbc13eb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:51:07.101 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:07.107+0000 7fafc2200640 1 --2- 172.21.15.44:0/3852477524 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fafbc0cb540 0x7fafbc14ede0 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:51:07.101 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:07.107+0000 7fafc2200640 1 --2- 172.21.15.44:0/3852477524 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fafbc06d690 0x7fafbc15ac50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:51:07.101 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:07.107+0000 7fafc2200640 1 -- 172.21.15.44:0/3852477524 >> 172.21.15.44:0/3852477524 conn(0x7fafbc067eb0 msgr2=0x7fafbc0682c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:51:07.101 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:07.107+0000 7fafc2200640 1 -- 172.21.15.44:0/3852477524 shutdown_connections 2024-04-17T19:51:07.101 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:07.107+0000 7fafc2200640 1 -- 172.21.15.44:0/3852477524 wait complete. 2024-04-17T19:51:07.125 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-04-17T19:51:07.283 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:07.291+0000 7f2d5e200640 1 Processor -- start 2024-04-17T19:51:07.283 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:07.291+0000 7f2d5e200640 1 -- start start 2024-04-17T19:51:07.286 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:07.295+0000 7f2d5e200640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f2d5806bd80 0x7f2d580c7330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:51:07.286 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:07.295+0000 7f2d5e200640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f2d5806c190 0x7f2d580c7870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:51:07.286 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:07.295+0000 7f2d5e200640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f2d58159830 0x7f2d58159c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:51:07.286 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:07.295+0000 7f2d5e200640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 -- 0x7f2d580c9d90 con 0x7f2d5806bd80 2024-04-17T19:51:07.286 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:07.295+0000 7f2d5e200640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 -- 0x7f2d580c8850 con 0x7f2d5806c190 2024-04-17T19:51:07.286 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:07.295+0000 7f2d5e200640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7f2d58150570 con 0x7f2d58159830 2024-04-17T19:51:07.286 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:07.295+0000 7f2d5ce00640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f2d5806bd80 0x7f2d580c7330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:51:07.286 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:07.295+0000 7f2d5ce00640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f2d5806bd80 0x7f2d580c7330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:44492/0 (socket says 172.21.15.44:44492) 2024-04-17T19:51:07.286 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:07.295+0000 7f2d5ce00640 1 -- 172.21.15.44:0/35629785 learned_addr learned my addr 172.21.15.44:0/35629785 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-04-17T19:51:07.286 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:07.295+0000 7f2d5d800640 1 --2- 172.21.15.44:0/35629785 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f2d58159830 0x7f2d58159c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:51:07.287 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:07.295+0000 7f2d57e00640 1 --2- 172.21.15.44:0/35629785 >> v2:172.21.15.62:3300/0 conn(0x7f2d5806c190 0x7f2d580c7870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:51:07.287 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:07.295+0000 7f2d5ce00640 1 -- 172.21.15.44:0/35629785 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f2d58159830 msgr2=0x7f2d58159c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T19:51:07.287 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:07.295+0000 7f2d5ce00640 1 --2- 172.21.15.44:0/35629785 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f2d58159830 0x7f2d58159c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:51:07.287 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:07.295+0000 7f2d5ce00640 1 -- 172.21.15.44:0/35629785 >> v2:172.21.15.62:3300/0 conn(0x7f2d5806c190 msgr2=0x7f2d580c7870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T19:51:07.287 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:07.295+0000 7f2d5ce00640 1 --2- 172.21.15.44:0/35629785 >> v2:172.21.15.62:3300/0 conn(0x7f2d5806c190 0x7f2d580c7870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:51:07.287 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:07.295+0000 7f2d5ce00640 1 -- 172.21.15.44:0/35629785 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2d580c8ab0 con 0x7f2d5806bd80 2024-04-17T19:51:07.289 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:07.299+0000 7f2d5ce00640 1 --2- 172.21.15.44:0/35629785 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2d5806bd80 0x7f2d580c7330 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f2d58150720 tx=0x7f2d4c01c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9ebdfc289af64d3a server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:51:07.289 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:07.299+0000 7f2d57400640 1 -- 172.21.15.44:0/35629785 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d4c0b1070 con 0x7f2d5806bd80 2024-04-17T19:51:07.290 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:07.299+0000 7f2d57400640 1 -- 172.21.15.44:0/35629785 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f2d4c0ac630 con 0x7f2d5806bd80 2024-04-17T19:51:07.290 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:07.299+0000 7f2d57400640 1 -- 172.21.15.44:0/35629785 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d4c0a8050 con 0x7f2d5806bd80 2024-04-17T19:51:07.290 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:07.299+0000 7f2d5e200640 1 -- 172.21.15.44:0/35629785 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2d5806bd80 msgr2=0x7f2d580c7330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:51:07.290 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:07.299+0000 7f2d5e200640 1 --2- 172.21.15.44:0/35629785 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2d5806bd80 0x7f2d580c7330 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f2d58150720 tx=0x7f2d4c01c520 comp rx=0 tx=0).stop 2024-04-17T19:51:07.291 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:07.299+0000 7f2d5e200640 1 -- 172.21.15.44:0/35629785 shutdown_connections 2024-04-17T19:51:07.291 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:07.299+0000 7f2d5e200640 1 --2- 172.21.15.44:0/35629785 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f2d58159830 0x7f2d58159c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:51:07.291 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:07.299+0000 7f2d5e200640 1 --2- 172.21.15.44:0/35629785 >> v2:172.21.15.62:3300/0 conn(0x7f2d5806c190 0x7f2d580c7870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:51:07.291 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:07.299+0000 7f2d5e200640 1 --2- 172.21.15.44:0/35629785 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2d5806bd80 0x7f2d580c7330 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:51:07.291 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:07.299+0000 7f2d5e200640 1 -- 172.21.15.44:0/35629785 >> 172.21.15.44:0/35629785 conn(0x7f2d580ce2d0 msgr2=0x7f2d58070fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:51:07.291 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:07.299+0000 7f2d5e200640 1 -- 172.21.15.44:0/35629785 shutdown_connections 2024-04-17T19:51:07.291 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:07.299+0000 7f2d5e200640 1 -- 172.21.15.44:0/35629785 wait complete. 2024-04-17T19:51:07.292 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:07.299+0000 7f2d5e200640 1 Processor -- start 2024-04-17T19:51:07.292 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:07.299+0000 7f2d5e200640 1 -- start start 2024-04-17T19:51:07.294 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:07.303+0000 7f2d5e200640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2d5806bd80 0x7f2d5814c3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:51:07.294 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:07.303+0000 7f2d5e200640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f2d5806c190 0x7f2d581556e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:51:07.294 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:07.303+0000 7f2d5e200640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2d58159830 0x7f2d581f8750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:51:07.294 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:07.303+0000 7f2d5e200640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f2d58153c80 con 0x7f2d58159830 2024-04-17T19:51:07.295 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:07.303+0000 7f2d5e200640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f2d580ca2c0 con 0x7f2d5806bd80 2024-04-17T19:51:07.295 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:07.303+0000 7f2d5e200640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7f2d5806d1a0 con 0x7f2d5806c190 2024-04-17T19:51:07.295 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:07.303+0000 7f2d5d800640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2d58159830 0x7f2d581f8750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:51:07.295 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:07.303+0000 7f2d5d800640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2d58159830 0x7f2d581f8750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:44500/0 (socket says 172.21.15.44:44500) 2024-04-17T19:51:07.295 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:07.303+0000 7f2d5d800640 1 -- 172.21.15.44:0/1280308817 learned_addr learned my addr 172.21.15.44:0/1280308817 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-04-17T19:51:07.295 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:07.303+0000 7f2d5ce00640 1 --2- 172.21.15.44:0/1280308817 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2d5806bd80 0x7f2d5814c3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:51:07.295 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:07.303+0000 7f2d57e00640 1 --2- 172.21.15.44:0/1280308817 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f2d5806c190 0x7f2d581556e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:51:07.296 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:07.303+0000 7f2d5d800640 1 -- 172.21.15.44:0/1280308817 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f2d5806c190 msgr2=0x7f2d581556e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:51:07.296 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:07.303+0000 7f2d5d800640 1 --2- 172.21.15.44:0/1280308817 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f2d5806c190 0x7f2d581556e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:51:07.296 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:07.303+0000 7f2d5d800640 1 -- 172.21.15.44:0/1280308817 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2d5806bd80 msgr2=0x7f2d5814c3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:51:07.296 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:07.303+0000 7f2d5d800640 1 --2- 172.21.15.44:0/1280308817 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2d5806bd80 0x7f2d5814c3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:51:07.297 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:07.303+0000 7f2d5d800640 1 -- 172.21.15.44:0/1280308817 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2d58155c20 con 0x7f2d58159830 2024-04-17T19:51:07.297 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:07.303+0000 7f2d5d800640 1 --2- 172.21.15.44:0/1280308817 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2d58159830 0x7f2d581f8750 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f2d50007d40 tx=0x7f2d5000e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:51:07.297 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:07.303+0000 7f2d54c00640 1 -- 172.21.15.44:0/1280308817 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d50014420 con 0x7f2d58159830 2024-04-17T19:51:07.297 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:07.303+0000 7f2d54c00640 1 -- 172.21.15.44:0/1280308817 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f2d50019070 con 0x7f2d58159830 2024-04-17T19:51:07.297 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:07.303+0000 7f2d54c00640 1 -- 172.21.15.44:0/1280308817 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d50014840 con 0x7f2d58159830 2024-04-17T19:51:07.297 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:07.303+0000 7f2d5e200640 1 -- 172.21.15.44:0/1280308817 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2d58157f10 con 0x7f2d58159830 2024-04-17T19:51:07.297 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:07.303+0000 7f2d5e200640 1 -- 172.21.15.44:0/1280308817 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2d58154de0 con 0x7f2d58159830 2024-04-17T19:51:07.297 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:07.303+0000 7f2d5e200640 1 -- 172.21.15.44:0/1280308817 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2d5804fea0 con 0x7f2d58159830 2024-04-17T19:51:07.297 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:07.307+0000 7f2d54c00640 1 -- 172.21.15.44:0/1280308817 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f2d500149e0 con 0x7f2d58159830 2024-04-17T19:51:07.298 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:07.307+0000 7f2d54c00640 1 --2- 172.21.15.44:0/1280308817 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f2d38068380 0x7f2d3806a890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:51:07.298 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:07.307+0000 7f2d54c00640 1 -- 172.21.15.44:0/1280308817 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 7049+0+0 (secure 0 0 0) 0x7f2d50087530 con 0x7f2d58159830 2024-04-17T19:51:07.299 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:07.307+0000 7f2d5ce00640 1 --2- 172.21.15.44:0/1280308817 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f2d38068380 0x7f2d3806a890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:51:07.299 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:07.307+0000 7f2d5ce00640 1 --2- 172.21.15.44:0/1280308817 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f2d38068380 0x7f2d3806a890 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f2d4c0ae000 tx=0x7f2d4c009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:51:07.303 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:07.311+0000 7f2d54c00640 1 -- 172.21.15.44:0/1280308817 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f2d50056ff0 con 0x7f2d58159830 2024-04-17T19:51:07.466 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:07.475+0000 7f2d5e200640 1 -- 172.21.15.44:0/1280308817 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7f2d58075740 con 0x7f2d58159830 2024-04-17T19:51:08.099 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:08.107+0000 7f2d54c00640 1 -- 172.21.15.44:0/1280308817 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v29) ==== 181+0+0 (secure 0 0 0) 0x7f2d5005b2f0 con 0x7f2d58159830 2024-04-17T19:51:08.100 INFO:teuthology.orchestra.run.smithi044.stderr:pool 'cephfs_metadata' removed 2024-04-17T19:51:08.103 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:08.111+0000 7f2d5e200640 1 -- 172.21.15.44:0/1280308817 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f2d38068380 msgr2=0x7f2d3806a890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:51:08.103 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:08.111+0000 7f2d5e200640 1 --2- 172.21.15.44:0/1280308817 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f2d38068380 0x7f2d3806a890 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f2d4c0ae000 tx=0x7f2d4c009040 comp rx=0 tx=0).stop 2024-04-17T19:51:08.103 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:08.111+0000 7f2d5e200640 1 -- 172.21.15.44:0/1280308817 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2d58159830 msgr2=0x7f2d581f8750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:51:08.103 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:08.111+0000 7f2d5e200640 1 --2- 172.21.15.44:0/1280308817 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2d58159830 0x7f2d581f8750 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f2d50007d40 tx=0x7f2d5000e4b0 comp rx=0 tx=0).stop 2024-04-17T19:51:08.104 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:08.111+0000 7f2d5e200640 1 -- 172.21.15.44:0/1280308817 shutdown_connections 2024-04-17T19:51:08.104 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:08.111+0000 7f2d5e200640 1 --2- 172.21.15.44:0/1280308817 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f2d38068380 0x7f2d3806a890 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:51:08.104 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:08.111+0000 7f2d5e200640 1 --2- 172.21.15.44:0/1280308817 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f2d5806c190 0x7f2d581556e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:51:08.104 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:08.111+0000 7f2d5e200640 1 --2- 172.21.15.44:0/1280308817 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2d58159830 0x7f2d581f8750 unknown :-1 s=CLOSED pgs=478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:51:08.105 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:08.111+0000 7f2d5e200640 1 --2- 172.21.15.44:0/1280308817 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2d5806bd80 0x7f2d5814c3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:51:08.105 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:08.111+0000 7f2d5e200640 1 -- 172.21.15.44:0/1280308817 >> 172.21.15.44:0/1280308817 conn(0x7f2d580ce2d0 msgr2=0x7f2d58158330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:51:08.105 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:08.111+0000 7f2d5e200640 1 -- 172.21.15.44:0/1280308817 shutdown_connections 2024-04-17T19:51:08.105 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:08.111+0000 7f2d5e200640 1 -- 172.21.15.44:0/1280308817 wait complete. 2024-04-17T19:51:08.128 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-04-17T19:51:08.287 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:08.295+0000 7f9498e00640 1 Processor -- start 2024-04-17T19:51:08.287 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:08.295+0000 7f9498e00640 1 -- start start 2024-04-17T19:51:08.289 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:08.295+0000 7f9498e00640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f94940c7da0 0x7f94940c8b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:51:08.289 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:08.295+0000 7f9498e00640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f949406d700 con 0x7f94940c9050 2024-04-17T19:51:08.289 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:08.295+0000 7f9498e00640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f94940c4940 con 0x7f9494164420 2024-04-17T19:51:08.289 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:08.299+0000 7f9498e00640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 -- 0x7f949415bab0 con 0x7f94940c7da0 2024-04-17T19:51:08.289 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:08.299+0000 7f9489400640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f94940c9050 0x7f9494072df0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:45442/0 (socket says 172.21.15.44:45442) 2024-04-17T19:51:08.289 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:08.299+0000 7f9489400640 1 -- 172.21.15.44:0/3058235529 learned_addr learned my addr 172.21.15.44:0/3058235529 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-04-17T19:51:08.290 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:08.299+0000 7f9491e00640 1 --2- 172.21.15.44:0/3058235529 >> v2:172.21.15.62:3300/0 conn(0x7f94940c7da0 0x7f94940c8b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:51:08.291 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:08.299+0000 7f9491400640 1 -- 172.21.15.44:0/3058235529 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2952174387 0 0) 0x7f949406d700 con 0x7f94940c9050 2024-04-17T19:51:08.291 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:08.299+0000 7f9491400640 1 -- 172.21.15.44:0/3058235529 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9478003530 con 0x7f94940c9050 2024-04-17T19:51:08.292 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:08.299+0000 7f9491400640 1 -- 172.21.15.44:0/3058235529 <== mon.0 v1:172.21.15.44:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 503926791 0 0) 0x7f9478003530 con 0x7f94940c9050 2024-04-17T19:51:08.292 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:08.299+0000 7f9491400640 1 -- 172.21.15.44:0/3058235529 >> v2:172.21.15.62:3300/0 conn(0x7f94940c7da0 msgr2=0x7f94940c8b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T19:51:08.292 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:08.299+0000 7f9491400640 1 --2- 172.21.15.44:0/3058235529 >> v2:172.21.15.62:3300/0 conn(0x7f94940c7da0 0x7f94940c8b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:51:08.292 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:08.299+0000 7f9491400640 1 -- 172.21.15.44:0/3058235529 >> v1:172.21.15.62:6789/0 conn(0x7f9494164420 legacy=0x7f9494166840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:51:08.292 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:08.299+0000 7f9491400640 1 -- 172.21.15.44:0/3058235529 --> v1:172.21.15.44:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f94940c4bb0 con 0x7f94940c9050 2024-04-17T19:51:08.292 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:08.299+0000 7f9491400640 1 -- 172.21.15.44:0/3058235529 <== mon.0 v1:172.21.15.44:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1863569991 0 0) 0x7f947c001680 con 0x7f94940c9050 2024-04-17T19:51:08.292 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:08.299+0000 7f9491400640 1 -- 172.21.15.44:0/3058235529 >> v1:172.21.15.44:6789/0 conn(0x7f94940c9050 legacy=0x7f9494072df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:51:08.292 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:08.299+0000 7f9491400640 1 --2- 172.21.15.44:0/3058235529 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f94780039c0 0x7f9478003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:51:08.292 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:08.299+0000 7f9491400640 1 --2- 172.21.15.44:0/3058235529 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9478004810 0x7f9478004c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:51:08.292 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:08.299+0000 7f9491400640 1 --2- 172.21.15.44:0/3058235529 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f94780051d0 0x7f947800b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:51:08.292 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:08.299+0000 7f9491400640 1 -- 172.21.15.44:0/3058235529 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f949415bab0 con 0x7f9478004810 2024-04-17T19:51:08.292 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:08.299+0000 7f9491400640 1 -- 172.21.15.44:0/3058235529 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f947800c160 con 0x7f94780051d0 2024-04-17T19:51:08.292 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:08.299+0000 7f9491400640 1 -- 172.21.15.44:0/3058235529 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7f947800c360 con 0x7f94780039c0 2024-04-17T19:51:08.292 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:08.299+0000 7f9489400640 1 --2- 172.21.15.44:0/3058235529 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9478004810 0x7f9478004c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:51:08.293 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:08.299+0000 7f9491e00640 1 --2- 172.21.15.44:0/3058235529 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f94780039c0 0x7f9478003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:51:08.293 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:08.299+0000 7f9492800640 1 --2- 172.21.15.44:0/3058235529 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f94780051d0 0x7f947800b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:51:08.293 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:08.299+0000 7f9489400640 1 -- 172.21.15.44:0/3058235529 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f94780039c0 msgr2=0x7f9478003e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T19:51:08.293 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:08.299+0000 7f9489400640 1 --2- 172.21.15.44:0/3058235529 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f94780039c0 0x7f9478003e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:51:08.293 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:08.299+0000 7f9489400640 1 -- 172.21.15.44:0/3058235529 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f94780051d0 msgr2=0x7f947800b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T19:51:08.293 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:08.299+0000 7f9489400640 1 --2- 172.21.15.44:0/3058235529 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f94780051d0 0x7f947800b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:51:08.293 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:08.299+0000 7f9489400640 1 -- 172.21.15.44:0/3058235529 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9478003530 con 0x7f9478004810 2024-04-17T19:51:08.293 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:08.299+0000 7f9492800640 1 --2- 172.21.15.44:0/3058235529 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f94780051d0 0x7f947800b9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-17T19:51:08.293 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:08.299+0000 7f9492800640 1 -- 172.21.15.44:0/3058235529 reap_dead start 2024-04-17T19:51:08.293 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:08.303+0000 7f9489400640 1 --2- 172.21.15.44:0/3058235529 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9478004810 0x7f9478004c20 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f94940718f0 tx=0x7f947c01cc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c3844ea5b880c561 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:51:08.294 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:08.303+0000 7f9491400640 1 -- 172.21.15.44:0/3058235529 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f947c007d00 con 0x7f9478004810 2024-04-17T19:51:08.294 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:08.303+0000 7f9491400640 1 -- 172.21.15.44:0/3058235529 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f947c0a9020 con 0x7f9478004810 2024-04-17T19:51:08.294 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:08.303+0000 7f9491400640 1 -- 172.21.15.44:0/3058235529 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f947c0a5b20 con 0x7f9478004810 2024-04-17T19:51:08.295 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:08.303+0000 7f9498e00640 1 -- 172.21.15.44:0/3058235529 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9478004810 msgr2=0x7f9478004c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:51:08.295 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:08.303+0000 7f9498e00640 1 --2- 172.21.15.44:0/3058235529 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9478004810 0x7f9478004c20 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f94940718f0 tx=0x7f947c01cc00 comp rx=0 tx=0).stop 2024-04-17T19:51:08.295 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:08.303+0000 7f9498e00640 1 -- 172.21.15.44:0/3058235529 shutdown_connections 2024-04-17T19:51:08.295 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:08.303+0000 7f9498e00640 1 --2- 172.21.15.44:0/3058235529 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9478004810 0x7f9478004c20 unknown :-1 s=CLOSED pgs=480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:51:08.295 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:08.303+0000 7f9498e00640 1 -- 172.21.15.44:0/3058235529 >> 172.21.15.44:0/3058235529 conn(0x7f94940708e0 msgr2=0x7f9494070cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:51:08.295 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:08.303+0000 7f9498e00640 1 -- 172.21.15.44:0/3058235529 shutdown_connections 2024-04-17T19:51:08.295 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:08.303+0000 7f9498e00640 1 -- 172.21.15.44:0/3058235529 wait complete. 2024-04-17T19:51:08.297 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:08.303+0000 7f9498e00640 1 Processor -- start 2024-04-17T19:51:08.297 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:08.307+0000 7f9498e00640 1 -- start start 2024-04-17T19:51:08.300 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:08.307+0000 7f9498e00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9478004810 0x7f94941529d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:51:08.300 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:08.307+0000 7f9498e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f94941510f0 0x7f94941f1fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:51:08.300 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:08.307+0000 7f9498e00640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f9494153470 0x7f9494148c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:51:08.300 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:08.307+0000 7f9498e00640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f94940c77b0 con 0x7f94941510f0 2024-04-17T19:51:08.300 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:08.307+0000 7f9498e00640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f94940c9a60 con 0x7f9478004810 2024-04-17T19:51:08.300 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:08.307+0000 7f9498e00640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7f94940c81b0 con 0x7f9494153470 2024-04-17T19:51:08.300 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:08.307+0000 7f9489400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f94941510f0 0x7f94941f1fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:51:08.300 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:08.307+0000 7f9489400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f94941510f0 0x7f94941f1fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:44522/0 (socket says 172.21.15.44:44522) 2024-04-17T19:51:08.300 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:08.307+0000 7f9489400640 1 -- 172.21.15.44:0/4137523126 learned_addr learned my addr 172.21.15.44:0/4137523126 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-04-17T19:51:08.300 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:08.307+0000 7f9491e00640 1 --2- 172.21.15.44:0/4137523126 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9478004810 0x7f94941529d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:51:08.300 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:08.307+0000 7f9492800640 1 --2- 172.21.15.44:0/4137523126 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f9494153470 0x7f9494148c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:51:08.301 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:08.307+0000 7f9489400640 1 -- 172.21.15.44:0/4137523126 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f9494153470 msgr2=0x7f9494148c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:51:08.301 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:08.307+0000 7f9489400640 1 --2- 172.21.15.44:0/4137523126 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f9494153470 0x7f9494148c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:51:08.301 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:08.307+0000 7f9489400640 1 -- 172.21.15.44:0/4137523126 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9478004810 msgr2=0x7f94941529d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:51:08.301 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:08.307+0000 7f9489400640 1 --2- 172.21.15.44:0/4137523126 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9478004810 0x7f94941529d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:51:08.301 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:08.307+0000 7f9489400640 1 -- 172.21.15.44:0/4137523126 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9494152f10 con 0x7f94941510f0 2024-04-17T19:51:08.301 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:08.307+0000 7f9491e00640 1 --2- 172.21.15.44:0/4137523126 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9478004810 0x7f94941529d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-17T19:51:08.301 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:08.307+0000 7f9489400640 1 --2- 172.21.15.44:0/4137523126 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f94941510f0 0x7f94941f1fc0 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f947c0ab040 tx=0x7f9478005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:51:08.301 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:08.307+0000 7f948aa00640 1 -- 172.21.15.44:0/4137523126 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f947c007d00 con 0x7f94941510f0 2024-04-17T19:51:08.301 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:08.307+0000 7f948aa00640 1 -- 172.21.15.44:0/4137523126 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f947c0b2070 con 0x7f94941510f0 2024-04-17T19:51:08.301 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:08.307+0000 7f948aa00640 1 -- 172.21.15.44:0/4137523126 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f947c004c30 con 0x7f94941510f0 2024-04-17T19:51:08.301 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:08.307+0000 7f9498e00640 1 -- 172.21.15.44:0/4137523126 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f94941f2500 con 0x7f94941510f0 2024-04-17T19:51:08.301 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:08.307+0000 7f9498e00640 1 -- 172.21.15.44:0/4137523126 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f94941f5790 con 0x7f94941510f0 2024-04-17T19:51:08.302 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:08.307+0000 7f9498e00640 1 -- 172.21.15.44:0/4137523126 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9494075f10 con 0x7f94941510f0 2024-04-17T19:51:08.302 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:08.311+0000 7f948aa00640 1 -- 172.21.15.44:0/4137523126 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f947c0ae430 con 0x7f94941510f0 2024-04-17T19:51:08.303 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:08.311+0000 7f948aa00640 1 --2- 172.21.15.44:0/4137523126 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f9470068380 0x7f947006a890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:51:08.303 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:08.311+0000 7f948aa00640 1 -- 172.21.15.44:0/4137523126 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6611+0+0 (secure 0 0 0) 0x7f947c1207e0 con 0x7f94941510f0 2024-04-17T19:51:08.303 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:08.311+0000 7f9491e00640 1 --2- 172.21.15.44:0/4137523126 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f9470068380 0x7f947006a890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:51:08.304 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:08.311+0000 7f9491e00640 1 --2- 172.21.15.44:0/4137523126 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f9470068380 0x7f947006a890 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f9484009c60 tx=0x7f9484008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:51:08.307 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:08.315+0000 7f948aa00640 1 -- 172.21.15.44:0/4137523126 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f947c016910 con 0x7f94941510f0 2024-04-17T19:51:08.472 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:08.479+0000 7f9498e00640 1 -- 172.21.15.44:0/4137523126 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7f949404ff80 con 0x7f94941510f0 2024-04-17T19:51:09.102 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:09.111+0000 7f948aa00640 1 -- 172.21.15.44:0/4137523126 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v30) ==== 169+0+0 (secure 0 0 0) 0x7f947c0f08e0 con 0x7f94941510f0 2024-04-17T19:51:09.102 INFO:teuthology.orchestra.run.smithi044.stderr:pool 'cephfs_data' removed 2024-04-17T19:51:09.104 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:09.111+0000 7f9498e00640 1 -- 172.21.15.44:0/4137523126 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f9470068380 msgr2=0x7f947006a890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:51:09.105 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:09.111+0000 7f9498e00640 1 --2- 172.21.15.44:0/4137523126 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f9470068380 0x7f947006a890 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f9484009c60 tx=0x7f9484008040 comp rx=0 tx=0).stop 2024-04-17T19:51:09.105 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:09.111+0000 7f9498e00640 1 -- 172.21.15.44:0/4137523126 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f94941510f0 msgr2=0x7f94941f1fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:51:09.105 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:09.111+0000 7f9498e00640 1 --2- 172.21.15.44:0/4137523126 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f94941510f0 0x7f94941f1fc0 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f947c0ab040 tx=0x7f9478005840 comp rx=0 tx=0).stop 2024-04-17T19:51:09.105 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:09.111+0000 7f9498e00640 1 -- 172.21.15.44:0/4137523126 shutdown_connections 2024-04-17T19:51:09.105 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:09.111+0000 7f9498e00640 1 --2- 172.21.15.44:0/4137523126 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f9470068380 0x7f947006a890 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:51:09.105 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:09.111+0000 7f9498e00640 1 --2- 172.21.15.44:0/4137523126 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f9494153470 0x7f9494148c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:51:09.105 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:09.111+0000 7f9498e00640 1 --2- 172.21.15.44:0/4137523126 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f94941510f0 0x7f94941f1fc0 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:51:09.105 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:09.111+0000 7f9498e00640 1 --2- 172.21.15.44:0/4137523126 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9478004810 0x7f94941529d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:51:09.105 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:09.111+0000 7f9498e00640 1 -- 172.21.15.44:0/4137523126 >> 172.21.15.44:0/4137523126 conn(0x7f94940708e0 msgr2=0x7f9494070cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:51:09.105 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:09.111+0000 7f9498e00640 1 -- 172.21.15.44:0/4137523126 shutdown_connections 2024-04-17T19:51:09.105 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:09.111+0000 7f9498e00640 1 -- 172.21.15.44:0/4137523126 wait complete. 2024-04-17T19:51:09.129 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data_ec cephfs_data_ec --yes-i-really-really-mean-it 2024-04-17T19:51:09.312 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:09.319+0000 7f5ca2600640 1 Processor -- start 2024-04-17T19:51:09.312 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:09.319+0000 7f5ca2600640 1 -- start start 2024-04-17T19:51:09.314 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:09.323+0000 7f5ca2600640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f5c9c1538b0 0x7f5c9c072590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:51:09.314 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:09.323+0000 7f5ca2600640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f5c9c15d7c0 0x7f5c9c0c64f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:51:09.314 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:09.323+0000 7f5ca2600640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5c9c0736b0 con 0x7f5c9c0c60e0 2024-04-17T19:51:09.314 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:09.323+0000 7f5ca2600640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 -- 0x7f5c9c073990 con 0x7f5c9c1538b0 2024-04-17T19:51:09.314 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:09.323+0000 7f5ca2600640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7f5c9c073c70 con 0x7f5c9c15d7c0 2024-04-17T19:51:09.314 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:09.323+0000 7f5c9b400640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f5c9c1538b0 0x7f5c9c072590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:51:09.314 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:09.323+0000 7f5c9b400640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f5c9c1538b0 0x7f5c9c072590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:44526/0 (socket says 172.21.15.44:44526) 2024-04-17T19:51:09.314 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:09.323+0000 7f5c9b400640 1 -- 172.21.15.44:0/2877614112 learned_addr learned my addr 172.21.15.44:0/2877614112 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-04-17T19:51:09.314 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:09.323+0000 7f5c9aa00640 1 --1- 172.21.15.44:0/2877614112 >> v1:172.21.15.44:6789/0 conn(0x7f5c9c0c60e0 0x7f5c9c15d0b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:45448/0 (socket says 172.21.15.44:45448) 2024-04-17T19:51:09.314 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:09.323+0000 7f5c9be00640 1 --2- 172.21.15.44:0/2877614112 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f5c9c15d7c0 0x7f5c9c0c64f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:51:09.314 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:09.323+0000 7f5c9b400640 1 -- 172.21.15.44:0/2877614112 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f5c9c15d7c0 msgr2=0x7f5c9c0c64f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T19:51:09.315 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:09.323+0000 7f5c9b400640 1 --2- 172.21.15.44:0/2877614112 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f5c9c15d7c0 0x7f5c9c0c64f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:51:09.315 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:09.323+0000 7f5c9b400640 1 -- 172.21.15.44:0/2877614112 >> v1:172.21.15.44:6789/0 conn(0x7f5c9c0c60e0 legacy=0x7f5c9c15d0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:51:09.315 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:09.323+0000 7f5c9b400640 1 -- 172.21.15.44:0/2877614112 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5c9c073f50 con 0x7f5c9c1538b0 2024-04-17T19:51:09.317 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:09.323+0000 7f5c9b400640 1 --2- 172.21.15.44:0/2877614112 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5c9c1538b0 0x7f5c9c072590 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f5c8c009870 tx=0x7f5c8c01ed50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f57e378d8ced455a server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:51:09.317 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:09.327+0000 7f5c9a000640 1 -- 172.21.15.44:0/2877614112 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c8c0b5070 con 0x7f5c9c1538b0 2024-04-17T19:51:09.317 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:09.327+0000 7f5c9a000640 1 -- 172.21.15.44:0/2877614112 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f5c8c0a8a50 con 0x7f5c9c1538b0 2024-04-17T19:51:09.317 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:09.327+0000 7f5c9a000640 1 -- 172.21.15.44:0/2877614112 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c8c0a8e40 con 0x7f5c9c1538b0 2024-04-17T19:51:09.318 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:09.327+0000 7f5ca2600640 1 -- 172.21.15.44:0/2877614112 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5c9c1538b0 msgr2=0x7f5c9c072590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:51:09.318 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:09.327+0000 7f5ca2600640 1 --2- 172.21.15.44:0/2877614112 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5c9c1538b0 0x7f5c9c072590 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f5c8c009870 tx=0x7f5c8c01ed50 comp rx=0 tx=0).stop 2024-04-17T19:51:09.318 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:09.327+0000 7f5ca2600640 1 -- 172.21.15.44:0/2877614112 shutdown_connections 2024-04-17T19:51:09.318 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:09.327+0000 7f5ca2600640 1 --2- 172.21.15.44:0/2877614112 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f5c9c15d7c0 0x7f5c9c0c64f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:51:09.318 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:09.327+0000 7f5ca2600640 1 --2- 172.21.15.44:0/2877614112 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5c9c1538b0 0x7f5c9c072590 unknown :-1 s=CLOSED pgs=483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:51:09.318 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:09.327+0000 7f5ca2600640 1 -- 172.21.15.44:0/2877614112 >> 172.21.15.44:0/2877614112 conn(0x7f5c9c0c9ad0 msgr2=0x7f5c9c0cc9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:51:09.319 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:09.327+0000 7f5ca2600640 1 -- 172.21.15.44:0/2877614112 shutdown_connections 2024-04-17T19:51:09.319 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:09.327+0000 7f5ca2600640 1 -- 172.21.15.44:0/2877614112 wait complete. 2024-04-17T19:51:09.320 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:09.327+0000 7f5ca2600640 1 Processor -- start 2024-04-17T19:51:09.320 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:09.327+0000 7f5ca2600640 1 -- start start 2024-04-17T19:51:09.323 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:09.331+0000 7f5ca2600640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f5c9c0c60e0 0x7f5c9c1471d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:51:09.323 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:09.331+0000 7f5ca2600640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5c9c1538b0 0x7f5c9c15c190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:51:09.323 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:09.331+0000 7f5ca2600640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5c9c15d7c0 0x7f5c9c1463f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:51:09.323 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:09.331+0000 7f5ca2600640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f5c9c0c9130 con 0x7f5c9c1538b0 2024-04-17T19:51:09.323 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:09.331+0000 7f5ca2600640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f5c9c153cc0 con 0x7f5c9c15d7c0 2024-04-17T19:51:09.323 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:09.331+0000 7f5ca2600640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7f5c9c072ad0 con 0x7f5c9c0c60e0 2024-04-17T19:51:09.324 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:09.331+0000 7f5c9aa00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5c9c1538b0 0x7f5c9c15c190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:51:09.324 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:09.331+0000 7f5c9aa00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5c9c1538b0 0x7f5c9c15c190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:44538/0 (socket says 172.21.15.44:44538) 2024-04-17T19:51:09.324 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:09.331+0000 7f5c9aa00640 1 -- 172.21.15.44:0/4260432471 learned_addr learned my addr 172.21.15.44:0/4260432471 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-04-17T19:51:09.324 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:09.331+0000 7f5c9b400640 1 --2- 172.21.15.44:0/4260432471 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f5c9c0c60e0 0x7f5c9c1471d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:51:09.324 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:09.331+0000 7f5c9be00640 1 --2- 172.21.15.44:0/4260432471 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5c9c15d7c0 0x7f5c9c1463f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:51:09.324 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:09.331+0000 7f5c9aa00640 1 -- 172.21.15.44:0/4260432471 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f5c9c0c60e0 msgr2=0x7f5c9c1471d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:51:09.324 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:09.331+0000 7f5c9aa00640 1 --2- 172.21.15.44:0/4260432471 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f5c9c0c60e0 0x7f5c9c1471d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:51:09.324 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:09.331+0000 7f5c9aa00640 1 -- 172.21.15.44:0/4260432471 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5c9c15d7c0 msgr2=0x7f5c9c1463f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:51:09.324 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:09.331+0000 7f5c9aa00640 1 --2- 172.21.15.44:0/4260432471 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5c9c15d7c0 0x7f5c9c1463f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:51:09.324 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:09.331+0000 7f5c9aa00640 1 -- 172.21.15.44:0/4260432471 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5c9c15aee0 con 0x7f5c9c1538b0 2024-04-17T19:51:09.324 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:09.331+0000 7f5c9aa00640 1 --2- 172.21.15.44:0/4260432471 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5c9c1538b0 0x7f5c9c15c190 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f5c8800c340 tx=0x7f5c8800c800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:51:09.324 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:09.331+0000 7f5c93400640 1 -- 172.21.15.44:0/4260432471 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c880074e0 con 0x7f5c9c1538b0 2024-04-17T19:51:09.324 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:09.331+0000 7f5c93400640 1 -- 172.21.15.44:0/4260432471 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f5c88007680 con 0x7f5c9c1538b0 2024-04-17T19:51:09.325 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:09.331+0000 7f5ca2600640 1 -- 172.21.15.44:0/4260432471 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5c9c149000 con 0x7f5c9c1538b0 2024-04-17T19:51:09.325 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:09.331+0000 7f5c93400640 1 -- 172.21.15.44:0/4260432471 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c88004a50 con 0x7f5c9c1538b0 2024-04-17T19:51:09.325 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:09.331+0000 7f5ca2600640 1 -- 172.21.15.44:0/4260432471 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5c9c1542e0 con 0x7f5c9c1538b0 2024-04-17T19:51:09.325 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:09.331+0000 7f5ca2600640 1 -- 172.21.15.44:0/4260432471 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5c9c075f10 con 0x7f5c9c1538b0 2024-04-17T19:51:09.325 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:09.335+0000 7f5c93400640 1 -- 172.21.15.44:0/4260432471 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f5c8801a020 con 0x7f5c9c1538b0 2024-04-17T19:51:09.326 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:09.335+0000 7f5c93400640 1 --2- 172.21.15.44:0/4260432471 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f5c7c068380 0x7f5c7c06a890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:51:09.326 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:09.335+0000 7f5c93400640 1 -- 172.21.15.44:0/4260432471 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 6139+0+0 (secure 0 0 0) 0x7f5c880863a0 con 0x7f5c9c1538b0 2024-04-17T19:51:09.327 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:09.335+0000 7f5c9b400640 1 --2- 172.21.15.44:0/4260432471 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f5c7c068380 0x7f5c7c06a890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:51:09.328 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:09.335+0000 7f5c9b400640 1 --2- 172.21.15.44:0/4260432471 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f5c7c068380 0x7f5c7c06a890 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f5c8c0b2000 tx=0x7f5c8c009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:51:09.331 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:09.339+0000 7f5c93400640 1 -- 172.21.15.44:0/4260432471 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f5c88056680 con 0x7f5c9c1538b0 2024-04-17T19:51:09.499 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:09.507+0000 7f5ca2600640 1 -- 172.21.15.44:0/4260432471 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true} v 0) -- 0x7f5c9c157090 con 0x7f5c9c1538b0 2024-04-17T19:51:10.119 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:10.127+0000 7f5c93400640 1 -- 172.21.15.44:0/4260432471 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data_ec' removed v31) ==== 178+0+0 (secure 0 0 0) 0x7f5c88055f80 con 0x7f5c9c1538b0 2024-04-17T19:51:10.119 INFO:teuthology.orchestra.run.smithi044.stderr:pool 'cephfs_data_ec' removed 2024-04-17T19:51:10.121 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:10.131+0000 7f5ca2600640 1 -- 172.21.15.44:0/4260432471 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f5c7c068380 msgr2=0x7f5c7c06a890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:51:10.122 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:10.131+0000 7f5ca2600640 1 --2- 172.21.15.44:0/4260432471 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f5c7c068380 0x7f5c7c06a890 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f5c8c0b2000 tx=0x7f5c8c009040 comp rx=0 tx=0).stop 2024-04-17T19:51:10.122 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:10.131+0000 7f5ca2600640 1 -- 172.21.15.44:0/4260432471 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5c9c1538b0 msgr2=0x7f5c9c15c190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:51:10.122 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:10.131+0000 7f5ca2600640 1 --2- 172.21.15.44:0/4260432471 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5c9c1538b0 0x7f5c9c15c190 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f5c8800c340 tx=0x7f5c8800c800 comp rx=0 tx=0).stop 2024-04-17T19:51:10.122 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:10.131+0000 7f5ca2600640 1 -- 172.21.15.44:0/4260432471 shutdown_connections 2024-04-17T19:51:10.122 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:10.131+0000 7f5ca2600640 1 --2- 172.21.15.44:0/4260432471 >> [v2:172.21.15.62:6832/1020159798,v1:172.21.15.62:6833/1020159798] conn(0x7f5c7c068380 0x7f5c7c06a890 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:51:10.122 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:10.131+0000 7f5ca2600640 1 --2- 172.21.15.44:0/4260432471 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5c9c15d7c0 0x7f5c9c1463f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:51:10.122 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:10.131+0000 7f5ca2600640 1 --2- 172.21.15.44:0/4260432471 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5c9c1538b0 0x7f5c9c15c190 unknown :-1 s=CLOSED pgs=484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:51:10.123 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:10.131+0000 7f5ca2600640 1 --2- 172.21.15.44:0/4260432471 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f5c9c0c60e0 0x7f5c9c1471d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:51:10.123 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:10.131+0000 7f5ca2600640 1 -- 172.21.15.44:0/4260432471 >> 172.21.15.44:0/4260432471 conn(0x7f5c9c0c9ad0 msgr2=0x7f5c9c1596e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:51:10.123 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:10.131+0000 7f5ca2600640 1 -- 172.21.15.44:0/4260432471 shutdown_connections 2024-04-17T19:51:10.123 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T19:51:10.131+0000 7f5ca2600640 1 -- 172.21.15.44:0/4260432471 wait complete. 2024-04-17T19:51:10.149 INFO:teuthology.misc:Shutting down mds daemons... 2024-04-17T19:51:10.149 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-04-17T19:51:10.149 INFO:teuthology.orchestra.run:waiting for 300 2024-04-17T19:51:10.161 INFO:tasks.ceph.mds.a:Stopped 2024-04-17T19:51:10.162 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-04-17T19:51:10.162 INFO:teuthology.orchestra.run:waiting for 300 2024-04-17T19:51:10.231 INFO:tasks.ceph.mds.c:Stopped 2024-04-17T19:51:10.231 DEBUG:tasks.ceph.mds.e:waiting for process to exit 2024-04-17T19:51:10.231 INFO:teuthology.orchestra.run:waiting for 300 2024-04-17T19:51:10.292 INFO:tasks.ceph.mds.e:Stopped 2024-04-17T19:51:10.293 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-04-17T19:51:10.293 INFO:teuthology.orchestra.run:waiting for 300 2024-04-17T19:51:10.310 INFO:tasks.ceph.mds.b:Stopped 2024-04-17T19:51:10.310 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-04-17T19:51:10.310 INFO:teuthology.orchestra.run:waiting for 300 2024-04-17T19:51:10.374 INFO:tasks.ceph.mds.d:Stopped 2024-04-17T19:51:10.375 DEBUG:tasks.ceph.mds.f:waiting for process to exit 2024-04-17T19:51:10.375 INFO:teuthology.orchestra.run:waiting for 300 2024-04-17T19:51:10.441 INFO:tasks.ceph.mds.f:Stopped 2024-04-17T19:51:10.441 INFO:teuthology.misc:Shutting down osd daemons... 2024-04-17T19:51:10.442 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2024-04-17T19:51:10.442 INFO:teuthology.orchestra.run:waiting for 300 2024-04-17T19:51:10.508 INFO:tasks.ceph.osd.0:Stopped 2024-04-17T19:51:10.508 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2024-04-17T19:51:10.508 INFO:teuthology.orchestra.run:waiting for 300 2024-04-17T19:51:16.407 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~0s 2024-04-17T19:51:16.610 INFO:tasks.ceph.osd.1:Stopped 2024-04-17T19:51:16.611 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2024-04-17T19:51:16.611 INFO:teuthology.orchestra.run:waiting for 300 2024-04-17T19:51:16.682 INFO:tasks.ceph.osd.2:Stopped 2024-04-17T19:51:16.683 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2024-04-17T19:51:16.683 INFO:teuthology.orchestra.run:waiting for 300 2024-04-17T19:51:22.315 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~0s 2024-04-17T19:51:22.315 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 has been restored 2024-04-17T19:51:22.784 INFO:tasks.ceph.osd.3:Stopped 2024-04-17T19:51:22.784 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2024-04-17T19:51:22.784 INFO:teuthology.orchestra.run:waiting for 300 2024-04-17T19:51:22.879 INFO:tasks.ceph.osd.4:Stopped 2024-04-17T19:51:22.880 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2024-04-17T19:51:22.880 INFO:teuthology.orchestra.run:waiting for 300 2024-04-17T19:51:24.250 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T19:51:24.254 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T19:51:28.021 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~0s 2024-04-17T19:51:28.022 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 has been restored 2024-04-17T19:51:28.981 INFO:tasks.ceph.osd.5:Stopped 2024-04-17T19:51:28.982 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2024-04-17T19:51:28.982 INFO:teuthology.orchestra.run:waiting for 300 2024-04-17T19:51:29.046 INFO:tasks.ceph.osd.6:Stopped 2024-04-17T19:51:29.046 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2024-04-17T19:51:29.046 INFO:teuthology.orchestra.run:waiting for 300 2024-04-17T19:51:29.139 INFO:tasks.ceph.osd.7:Stopped 2024-04-17T19:51:29.139 INFO:teuthology.misc:Shutting down mgr daemons... 2024-04-17T19:51:29.139 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2024-04-17T19:51:29.139 INFO:teuthology.orchestra.run:waiting for 300 2024-04-17T19:51:29.196 INFO:tasks.ceph.mgr.y:Stopped 2024-04-17T19:51:29.196 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2024-04-17T19:51:29.196 INFO:teuthology.orchestra.run:waiting for 300 2024-04-17T19:51:29.227 INFO:tasks.ceph.mgr.x:Stopped 2024-04-17T19:51:29.227 INFO:teuthology.misc:Shutting down mon daemons... 2024-04-17T19:51:29.227 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-04-17T19:51:29.228 INFO:teuthology.orchestra.run:waiting for 300 2024-04-17T19:51:29.247 INFO:tasks.ceph.mon.a:Stopped 2024-04-17T19:51:29.247 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2024-04-17T19:51:29.247 INFO:teuthology.orchestra.run:waiting for 300 2024-04-17T19:51:29.299 INFO:tasks.ceph.mon.b:Stopped 2024-04-17T19:51:29.299 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2024-04-17T19:51:29.299 INFO:teuthology.orchestra.run:waiting for 300 2024-04-17T19:51:29.372 INFO:tasks.ceph.mon.c:Stopped 2024-04-17T19:51:29.372 INFO:tasks.ceph:Checking cluster log for badness... 2024-04-17T19:51:29.372 DEBUG:teuthology.orchestra.run.smithi044:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v FS_DEGRADED | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v 'filesystem is online with fewer MDS than max_mds' | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'do not have an application enabled' | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v 'deprecated feature inline_data' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v PG_AVAILABILITY | egrep -v PG_DEGRADED | egrep -v 'Reduced data availability' | egrep -v 'overall HEALTH_' | egrep -v '\(OSDMAP_FLAGS\)' | egrep -v '\(OSD_' | egrep -v '\(PG_' | egrep -v '\(POOL_' | egrep -v '\(CACHE_POOL_' | egrep -v '\(SMALLER_PGP_NUM\)' | egrep -v '\(OBJECT_' | egrep -v '\(SLOW_OPS\)' | egrep -v '\(REQUEST_SLOW\)' | egrep -v '\(TOO_FEW_PGS\)' | egrep -v 'slow request' | egrep -v 'timeout on replica' | egrep -v 'late reservation from' | egrep -v MON_DOWN | egrep -v OSDMAP_FLAGS | egrep -v OSD_DOWN | egrep -v PG_DEGRADED | egrep -v PG_AVAILABILITY | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'mons down' | egrep -v 'mon down' | egrep -v 'out of quorum' | egrep -v 'overall HEALTH_' | egrep -v '\(MON_DOWN\)' | head -n 1 2024-04-17T19:51:29.421 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi044.front.sepia.ceph.com 2024-04-17T19:51:29.421 DEBUG:teuthology.orchestra.run.smithi044:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2024-04-17T19:51:29.856 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi044.front.sepia.ceph.com 2024-04-17T19:51:29.857 DEBUG:teuthology.orchestra.run.smithi044:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2024-04-17T19:51:30.043 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi044.front.sepia.ceph.com 2024-04-17T19:51:30.043 DEBUG:teuthology.orchestra.run.smithi044:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2024-04-17T19:51:30.209 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi044.front.sepia.ceph.com 2024-04-17T19:51:30.210 DEBUG:teuthology.orchestra.run.smithi044:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2024-04-17T19:51:30.500 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi062.front.sepia.ceph.com 2024-04-17T19:51:30.500 DEBUG:teuthology.orchestra.run.smithi062:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2024-04-17T19:51:30.784 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi062.front.sepia.ceph.com 2024-04-17T19:51:30.784 DEBUG:teuthology.orchestra.run.smithi062:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2024-04-17T19:51:30.989 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@smithi062.front.sepia.ceph.com 2024-04-17T19:51:30.990 DEBUG:teuthology.orchestra.run.smithi062:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2024-04-17T19:51:31.186 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi062.front.sepia.ceph.com 2024-04-17T19:51:31.186 DEBUG:teuthology.orchestra.run.smithi062:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2024-04-17T19:51:31.473 INFO:tasks.ceph:Archiving mon data... 2024-04-17T19:51:31.474 DEBUG:teuthology.misc:Transferring archived files from smithi044:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/pdonnell-2024-04-17_17:06:06-fs-wip-pdonnell-testing-20240417.021458-debug-distro-default-smithi/7660526/data/mon.a.tgz 2024-04-17T19:51:31.475 DEBUG:teuthology.orchestra.run.smithi044:> mktemp 2024-04-17T19:51:31.485 INFO:teuthology.orchestra.run.smithi044.stdout:/tmp/tmp.jENxKyRnE8 2024-04-17T19:51:31.485 DEBUG:teuthology.orchestra.run.smithi044:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.jENxKyRnE8 2024-04-17T19:51:31.620 DEBUG:teuthology.orchestra.run.smithi044:> sudo chmod 0666 /tmp/tmp.jENxKyRnE8 2024-04-17T19:51:31.695 DEBUG:teuthology.orchestra.remote:smithi044:/tmp/tmp.jENxKyRnE8 is 338KB 2024-04-17T19:51:31.760 DEBUG:teuthology.orchestra.run.smithi044:> rm -fr /tmp/tmp.jENxKyRnE8 2024-04-17T19:51:31.769 DEBUG:teuthology.misc:Transferring archived files from smithi062:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/pdonnell-2024-04-17_17:06:06-fs-wip-pdonnell-testing-20240417.021458-debug-distro-default-smithi/7660526/data/mon.b.tgz 2024-04-17T19:51:31.769 DEBUG:teuthology.orchestra.run.smithi062:> mktemp 2024-04-17T19:51:31.776 INFO:teuthology.orchestra.run.smithi062.stdout:/tmp/tmp.tdnrhoc8Ez 2024-04-17T19:51:31.776 DEBUG:teuthology.orchestra.run.smithi062:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.tdnrhoc8Ez 2024-04-17T19:51:31.914 DEBUG:teuthology.orchestra.run.smithi062:> sudo chmod 0666 /tmp/tmp.tdnrhoc8Ez 2024-04-17T19:51:31.980 DEBUG:teuthology.orchestra.remote:smithi062:/tmp/tmp.tdnrhoc8Ez is 383KB 2024-04-17T19:51:32.041 DEBUG:teuthology.orchestra.run.smithi062:> rm -fr /tmp/tmp.tdnrhoc8Ez 2024-04-17T19:51:32.046 DEBUG:teuthology.misc:Transferring archived files from smithi062:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/pdonnell-2024-04-17_17:06:06-fs-wip-pdonnell-testing-20240417.021458-debug-distro-default-smithi/7660526/data/mon.c.tgz 2024-04-17T19:51:32.047 DEBUG:teuthology.orchestra.run.smithi062:> mktemp 2024-04-17T19:51:32.095 INFO:teuthology.orchestra.run.smithi062.stdout:/tmp/tmp.VVboSdm4uN 2024-04-17T19:51:32.096 DEBUG:teuthology.orchestra.run.smithi062:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.VVboSdm4uN 2024-04-17T19:51:32.235 DEBUG:teuthology.orchestra.run.smithi062:> sudo chmod 0666 /tmp/tmp.VVboSdm4uN 2024-04-17T19:51:32.299 DEBUG:teuthology.orchestra.remote:smithi062:/tmp/tmp.VVboSdm4uN is 381KB 2024-04-17T19:51:32.360 DEBUG:teuthology.orchestra.run.smithi062:> rm -fr /tmp/tmp.VVboSdm4uN 2024-04-17T19:51:32.365 INFO:tasks.ceph:Cleaning ceph cluster... 2024-04-17T19:51:32.366 DEBUG:teuthology.orchestra.run.smithi044:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-04-17T19:51:32.369 DEBUG:teuthology.orchestra.run.smithi062:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-04-17T19:51:32.442 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-04-17T19:51:32.472 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-04-17T19:51:32.472 INFO:tasks.ceph:Archiving crash dumps... 2024-04-17T19:51:32.473 DEBUG:teuthology.misc:Transferring archived files from smithi044:/var/lib/ceph/crash to /home/teuthworker/archive/pdonnell-2024-04-17_17:06:06-fs-wip-pdonnell-testing-20240417.021458-debug-distro-default-smithi/7660526/remote/smithi044/crash 2024-04-17T19:51:32.474 DEBUG:teuthology.orchestra.run.smithi044:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-04-17T19:51:32.507 DEBUG:teuthology.misc:Transferring archived files from smithi062:/var/lib/ceph/crash to /home/teuthworker/archive/pdonnell-2024-04-17_17:06:06-fs-wip-pdonnell-testing-20240417.021458-debug-distro-default-smithi/7660526/remote/smithi062/crash 2024-04-17T19:51:32.507 DEBUG:teuthology.orchestra.run.smithi062:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-04-17T19:51:32.527 INFO:tasks.ceph:Shutting down logrotate 2024-04-17T19:51:32.527 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T19:51:32.556 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T19:51:32.745 DEBUG:teuthology.orchestra.run.smithi044:> sudo rm /etc/logrotate.d/ceph-test.conf 2024-04-17T19:51:32.768 DEBUG:teuthology.orchestra.run.smithi062:> sudo rm /etc/logrotate.d/ceph-test.conf 2024-04-17T19:51:32.780 INFO:tasks.ceph:Compressing logs... 2024-04-17T19:51:32.781 DEBUG:teuthology.orchestra.run.smithi044:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-04-17T19:51:32.816 DEBUG:teuthology.orchestra.run.smithi062:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-04-17T19:51:32.839 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35984.log 2024-04-17T19:51:32.839 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33091.log 2024-04-17T19:51:32.840 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.35984.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34180.log 2024-04-17T19:51:32.840 INFO:teuthology.orchestra.run.smithi044.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.35984.log.gz 2024-04-17T19:51:32.841 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.33091.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32204.log 2024-04-17T19:51:32.841 INFO:teuthology.orchestra.run.smithi044.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.33091.log.gz 2024-04-17T19:51:32.842 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.34180.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31489.log 2024-04-17T19:51:32.843 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.32204.log: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.34180.log.gz 2024-04-17T19:51:32.843 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35631.log 2024-04-17T19:51:32.843 INFO:teuthology.orchestra.run.smithi044.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.32204.log.gz 2024-04-17T19:51:32.843 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.31489.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33311.log 2024-04-17T19:51:32.844 INFO:teuthology.orchestra.run.smithi044.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.31489.log.gz 2024-04-17T19:51:32.844 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.35631.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.y.log 2024-04-17T19:51:32.845 INFO:teuthology.orchestra.run.smithi044.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.35631.log.gz 2024-04-17T19:51:32.845 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.33311.log: gzip -5 88.4% --verbose -- -- replaced with /var/log/ceph/ceph-client.admin.33311.log.gz /var/log/ceph/ceph-client.admin.35498.log 2024-04-17T19:51:32.846 INFO:teuthology.orchestra.run.smithi044.stderr: 2024-04-17T19:51:32.846 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-mgr.y.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34631.log 2024-04-17T19:51:32.847 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.35498.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27667.log 2024-04-17T19:51:32.848 INFO:teuthology.orchestra.run.smithi044.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.35498.log.gz 2024-04-17T19:51:32.848 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28143.log 2024-04-17T19:51:32.849 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.34631.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32334.log 2024-04-17T19:51:32.849 INFO:teuthology.orchestra.run.smithi044.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.34631.log.gz 2024-04-17T19:51:32.850 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.27667.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33313.log 2024-04-17T19:51:32.850 INFO:teuthology.orchestra.run.smithi044.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.27667.log.gz 2024-04-17T19:51:32.850 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.32334.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33103.log 2024-04-17T19:51:32.851 INFO:teuthology.orchestra.run.smithi044.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.32334.log.gz 2024-04-17T19:51:32.852 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.7.log 2024-04-17T19:51:32.852 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.28143.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.6.log 2024-04-17T19:51:32.853 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-osd.7.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.28143.log.gz 2024-04-17T19:51:32.853 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.5.log 2024-04-17T19:51:32.853 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-osd.6.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28191.log 2024-04-17T19:51:32.853 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28311.log 2024-04-17T19:51:32.853 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.28191.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2024-04-17T19:51:32.853 INFO:teuthology.orchestra.run.smithi062.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.28191.log.gz 2024-04-17T19:51:32.853 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.28311.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.f.log 2024-04-17T19:51:32.853 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-mgr.x.log: gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-04-17T19:51:32.853 INFO:teuthology.orchestra.run.smithi062.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.28311.log.gz 2024-04-17T19:51:32.853 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-mds.f.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28287.log 2024-04-17T19:51:32.858 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28167.log 2024-04-17T19:51:32.858 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.28287.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.c.log 2024-04-17T19:51:32.858 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.28167.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.28287.log.gz 2024-04-17T19:51:32.858 INFO:teuthology.orchestra.run.smithi062.stderr: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.28167.log.gz 2024-04-17T19:51:32.858 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28239.log 2024-04-17T19:51:32.858 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-mon.c.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-04-17T19:51:32.858 INFO:teuthology.orchestra.run.smithi062.stderr: 91.9% -- replaced with /var/log/ceph/ceph.log.gz 2024-04-17T19:51:32.858 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.28239.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.28239.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28215.log 2024-04-17T19:51:32.858 INFO:teuthology.orchestra.run.smithi062.stderr: 2024-04-17T19:51:32.858 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.d.log 2024-04-17T19:51:32.861 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.33313.log: 93.7% -- replaced with /var/log/ceph/ceph-mgr.y.log.gz 2024-04-17T19:51:32.861 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2024-04-17T19:51:32.861 INFO:teuthology.orchestra.run.smithi044.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.33313.log.gz 2024-04-17T19:51:32.861 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.33103.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36376.log 2024-04-17T19:51:32.861 INFO:teuthology.orchestra.run.smithi044.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.33103.log.gz 2024-04-17T19:51:32.861 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34027.log 2024-04-17T19:51:32.861 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.36376.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33923.log 2024-04-17T19:51:32.861 INFO:teuthology.orchestra.run.smithi044.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.36376.log.gz 2024-04-17T19:51:32.861 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.34027.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35551.log 2024-04-17T19:51:32.862 INFO:teuthology.orchestra.run.smithi044.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.34027.log.gz 2024-04-17T19:51:32.862 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.33923.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33599.log 2024-04-17T19:51:32.862 INFO:teuthology.orchestra.run.smithi044.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.33923.log.gz 2024-04-17T19:51:32.862 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.35551.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34877.log 2024-04-17T19:51:32.862 INFO:teuthology.orchestra.run.smithi044.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.35551.log.gz 2024-04-17T19:51:32.862 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.33599.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34475.log 2024-04-17T19:51:32.862 INFO:teuthology.orchestra.run.smithi044.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.33599.log.gz 2024-04-17T19:51:32.862 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.34877.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34796.log 2024-04-17T19:51:32.862 INFO:teuthology.orchestra.run.smithi044.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.34877.log.gz 2024-04-17T19:51:32.862 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.34475.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33286.log 2024-04-17T19:51:32.862 INFO:teuthology.orchestra.run.smithi044.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.34475.log.gz 2024-04-17T19:51:32.862 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.34796.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33740.log 2024-04-17T19:51:32.862 INFO:teuthology.orchestra.run.smithi044.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.34796.log.gz 2024-04-17T19:51:32.863 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.28215.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.28215.log.gz 2024-04-17T19:51:32.863 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28263.log 2024-04-17T19:51:32.863 INFO:teuthology.orchestra.run.smithi062.stderr: 93.7% -- replaced with /var/log/ceph/ceph.audit.log.gz/var/log/ceph/ceph-mds.d.log: 2024-04-17T19:51:32.863 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.b.log 2024-04-17T19:51:32.863 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.28263.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.28263.log.gz 2024-04-17T19:51:32.863 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.b.log 2024-04-17T19:51:32.865 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.33286.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33792.log 2024-04-17T19:51:32.865 INFO:teuthology.orchestra.run.smithi044.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.33286.log.gz 2024-04-17T19:51:32.865 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.33740.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36544.log 2024-04-17T19:51:32.865 INFO:teuthology.orchestra.run.smithi044.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.33740.log.gz 2024-04-17T19:51:32.865 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.33792.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32017.log 87.7% 2024-04-17T19:51:32.865 INFO:teuthology.orchestra.run.smithi044.stderr: -- replaced with /var/log/ceph/ceph-client.admin.33792.log.gz 2024-04-17T19:51:32.865 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.36544.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33766.log 2024-04-17T19:51:32.865 INFO:teuthology.orchestra.run.smithi044.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.36544.log.gz 2024-04-17T19:51:32.866 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.32017.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36062.log 2024-04-17T19:51:32.866 INFO:teuthology.orchestra.run.smithi044.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.32017.log.gz 2024-04-17T19:51:32.867 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.33766.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34579.log 2024-04-17T19:51:32.867 INFO:teuthology.orchestra.run.smithi044.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.33766.log.gz 2024-04-17T19:51:32.868 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.36062.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34825.log 2024-04-17T19:51:32.868 INFO:teuthology.orchestra.run.smithi044.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.36062.log.gz 2024-04-17T19:51:32.869 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.34579.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36571.log 2024-04-17T19:51:32.869 INFO:teuthology.orchestra.run.smithi044.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.34579.log.gz 2024-04-17T19:51:32.869 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.34825.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31313.log 2024-04-17T19:51:32.870 INFO:teuthology.orchestra.run.smithi044.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.34825.log.gz 2024-04-17T19:51:32.870 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.36571.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32574.log 2024-04-17T19:51:32.871 INFO:teuthology.orchestra.run.smithi044.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.36571.log.gz 2024-04-17T19:51:32.871 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.31313.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32888.log 2024-04-17T19:51:32.871 INFO:teuthology.orchestra.run.smithi044.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.31313.log.gz 2024-04-17T19:51:32.872 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.32574.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31837.log 2024-04-17T19:51:32.872 INFO:teuthology.orchestra.run.smithi044.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.32574.log.gz 2024-04-17T19:51:32.873 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.32888.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35605.log 2024-04-17T19:51:32.873 INFO:teuthology.orchestra.run.smithi044.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.32888.log.gz 2024-04-17T19:51:32.874 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.31837.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34905.log 2024-04-17T19:51:32.874 INFO:teuthology.orchestra.run.smithi044.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.31837.log.gz 2024-04-17T19:51:32.875 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-mds.b.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.4.log 2024-04-17T19:51:32.875 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.35605.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34683.log 2024-04-17T19:51:32.875 INFO:teuthology.orchestra.run.smithi044.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.35605.log.gz 2024-04-17T19:51:32.876 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.34905.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32600.log 2024-04-17T19:51:32.876 INFO:teuthology.orchestra.run.smithi044.stderr: 91.7% -- replaced with /var/log/ceph/ceph-client.admin.34905.log.gz 2024-04-17T19:51:32.877 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.34683.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35472.log 2024-04-17T19:51:32.877 INFO:teuthology.orchestra.run.smithi044.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.34683.log.gz 2024-04-17T19:51:32.878 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.32600.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35709.log 2024-04-17T19:51:32.878 INFO:teuthology.orchestra.run.smithi044.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.32600.log.gz 2024-04-17T19:51:32.879 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.35472.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2024-04-17T19:51:32.879 INFO:teuthology.orchestra.run.smithi044.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.35472.log.gz 2024-04-17T19:51:32.880 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.35709.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36326.log 2024-04-17T19:51:32.880 INFO:teuthology.orchestra.run.smithi044.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.35709.log.gz 2024-04-17T19:51:32.881 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31677.log 2024-04-17T19:51:32.882 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.36326.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35016.log 2024-04-17T19:51:32.882 INFO:teuthology.orchestra.run.smithi044.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.36326.log.gz 2024-04-17T19:51:32.882 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.31677.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36166.log 2024-04-17T19:51:32.883 INFO:teuthology.orchestra.run.smithi044.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.31677.log.gz 2024-04-17T19:51:32.884 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.35016.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34762.log 2024-04-17T19:51:32.884 INFO:teuthology.orchestra.run.smithi044.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.35016.log.gz 2024-04-17T19:51:32.885 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.36166.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34931.log 2024-04-17T19:51:32.885 INFO:teuthology.orchestra.run.smithi044.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.36166.log.gz 2024-04-17T19:51:32.886 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.34762.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33949.log 2024-04-17T19:51:32.886 INFO:teuthology.orchestra.run.smithi044.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.34762.log.gz 2024-04-17T19:51:32.887 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.34931.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31889.log 2024-04-17T19:51:32.887 INFO:teuthology.orchestra.run.smithi044.stderr: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.34931.log.gz 2024-04-17T19:51:32.888 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.33949.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35958.log 2024-04-17T19:51:32.888 INFO:teuthology.orchestra.run.smithi044.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.33949.log.gz 2024-04-17T19:51:32.889 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.31889.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33494.log 2024-04-17T19:51:32.889 INFO:teuthology.orchestra.run.smithi044.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.31889.log.gz 2024-04-17T19:51:32.890 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.35958.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32491.log 2024-04-17T19:51:32.890 INFO:teuthology.orchestra.run.smithi044.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.35958.log.gz 2024-04-17T19:51:32.891 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.33494.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34230.log 2024-04-17T19:51:32.891 INFO:teuthology.orchestra.run.smithi044.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.33494.log.gz 2024-04-17T19:51:32.892 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.32491.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33844.log 2024-04-17T19:51:32.892 INFO:teuthology.orchestra.run.smithi044.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.32491.log.gz 2024-04-17T19:51:32.893 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.34230.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32522.log 2024-04-17T19:51:32.893 INFO:teuthology.orchestra.run.smithi044.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.34230.log.gz 2024-04-17T19:51:32.894 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.33844.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32883.log 2024-04-17T19:51:32.894 INFO:teuthology.orchestra.run.smithi044.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.33844.log.gz 2024-04-17T19:51:32.895 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.32522.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35420.log 2024-04-17T19:51:32.895 INFO:teuthology.orchestra.run.smithi044.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.32522.log.gz 2024-04-17T19:51:32.896 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.32883.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2024-04-17T19:51:32.896 INFO:teuthology.orchestra.run.smithi044.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.32883.log.gz 2024-04-17T19:51:32.897 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.35420.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35525.log 2024-04-17T19:51:32.897 INFO:teuthology.orchestra.run.smithi044.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.35420.log.gz 2024-04-17T19:51:32.898 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-mon.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34001.log 2024-04-17T19:51:32.900 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.35525.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.35525.log.gz 2024-04-17T19:51:32.900 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32782.log 2024-04-17T19:51:32.900 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.34001.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36298.log 2024-04-17T19:51:32.901 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.32782.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.34001.log.gz 2024-04-17T19:51:32.902 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33299.log 2024-04-17T19:51:32.902 INFO:teuthology.orchestra.run.smithi044.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.32782.log.gz 2024-04-17T19:51:32.902 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.36298.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34553.log 2024-04-17T19:51:32.903 INFO:teuthology.orchestra.run.smithi044.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.36298.log.gz 2024-04-17T19:51:32.904 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.33299.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32146.log 2024-04-17T19:51:32.904 INFO:teuthology.orchestra.run.smithi044.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.33299.log.gz 2024-04-17T19:51:32.905 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.34553.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.34553.log.gzgzip 2024-04-17T19:51:32.905 INFO:teuthology.orchestra.run.smithi044.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.36428.log 2024-04-17T19:51:32.906 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.32146.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31595.log 2024-04-17T19:51:32.907 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.36428.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.36428.log.gz 2024-04-17T19:51:32.907 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36088.log 2024-04-17T19:51:32.908 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.31595.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36454.log 2024-04-17T19:51:32.908 INFO:teuthology.orchestra.run.smithi044.stderr: 92.7% -- replaced with /var/log/ceph/ceph-client.admin.32146.log.gz 2024-04-17T19:51:32.909 INFO:teuthology.orchestra.run.smithi044.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.31595.log.gz 2024-04-17T19:51:32.909 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.36088.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31941.log 2024-04-17T19:51:32.910 INFO:teuthology.orchestra.run.smithi044.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.36088.log.gz 2024-04-17T19:51:32.910 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-mon.b.log: /var/log/ceph/ceph-osd.4.log: 92.3% 92.8% -- replaced with /var/log/ceph/ceph-mds.f.log.gz 2024-04-17T19:51:32.911 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.36454.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31757.log 2024-04-17T19:51:32.911 INFO:teuthology.orchestra.run.smithi044.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.36454.log.gz 2024-04-17T19:51:32.911 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.31941.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34291.log 2024-04-17T19:51:32.912 INFO:teuthology.orchestra.run.smithi044.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.31941.log.gz 2024-04-17T19:51:32.912 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.31757.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33714.log 2024-04-17T19:51:32.913 INFO:teuthology.orchestra.run.smithi044.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.31757.log.gz 2024-04-17T19:51:32.914 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.34291.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32387.log 2024-04-17T19:51:32.914 INFO:teuthology.orchestra.run.smithi044.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.34291.log.gz 2024-04-17T19:51:32.914 INFO:teuthology.orchestra.run.smithi062.stderr: -- replaced with /var/log/ceph/ceph-mds.d.log.gz 2024-04-17T19:51:32.915 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.33714.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27561.log 2024-04-17T19:51:32.915 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.32387.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.33714.log.gz 2024-04-17T19:51:32.916 INFO:teuthology.orchestra.run.smithi044.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.32387.log.gz 2024-04-17T19:51:32.916 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35802.log 2024-04-17T19:51:32.917 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.27561.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.3.log 2024-04-17T19:51:32.917 INFO:teuthology.orchestra.run.smithi044.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.27561.log.gz 2024-04-17T19:51:32.918 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.35802.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32885.log 2024-04-17T19:51:32.918 INFO:teuthology.orchestra.run.smithi044.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.35802.log.gz 2024-04-17T19:51:32.919 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-osd.3.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32756.log 2024-04-17T19:51:32.921 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.32885.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36270.log 2024-04-17T19:51:32.921 INFO:teuthology.orchestra.run.smithi044.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.32885.log.gz 2024-04-17T19:51:32.922 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.32756.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35123.log 2024-04-17T19:51:32.922 INFO:teuthology.orchestra.run.smithi044.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.32756.log.gz 2024-04-17T19:51:32.923 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.36270.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32439.log 2024-04-17T19:51:32.923 INFO:teuthology.orchestra.run.smithi044.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.36270.log.gz 2024-04-17T19:51:32.924 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.35123.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33688.log 2024-04-17T19:51:32.924 INFO:teuthology.orchestra.run.smithi044.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.35123.log.gz 2024-04-17T19:51:32.925 INFO:teuthology.orchestra.run.smithi062.stderr: 91.7% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2024-04-17T19:51:32.925 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.32439.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35149.log 2024-04-17T19:51:32.926 INFO:teuthology.orchestra.run.smithi044.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.32439.log.gz 2024-04-17T19:51:32.927 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.33688.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31705.log 2024-04-17T19:51:32.927 INFO:teuthology.orchestra.run.smithi044.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.33688.log.gz 2024-04-17T19:51:32.928 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.35149.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34709.log 2024-04-17T19:51:32.928 INFO:teuthology.orchestra.run.smithi044.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.35149.log.gz 2024-04-17T19:51:32.928 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.31705.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35932.log 2024-04-17T19:51:32.929 INFO:teuthology.orchestra.run.smithi044.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.31705.log.gz 2024-04-17T19:51:32.930 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.34709.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34957.log 2024-04-17T19:51:32.930 INFO:teuthology.orchestra.run.smithi044.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.34709.log.gz 2024-04-17T19:51:32.931 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.35932.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35683.log 2024-04-17T19:51:32.931 INFO:teuthology.orchestra.run.smithi044.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.35932.log.gz 2024-04-17T19:51:32.932 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.34957.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32880.log 2024-04-17T19:51:32.932 INFO:teuthology.orchestra.run.smithi044.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.34957.log.gz 2024-04-17T19:51:32.934 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.35683.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32548.log 2024-04-17T19:51:32.934 INFO:teuthology.orchestra.run.smithi044.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.35683.log.gz 2024-04-17T19:51:32.935 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.32880.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31811.log 2024-04-17T19:51:32.935 INFO:teuthology.orchestra.run.smithi044.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.32880.log.gz 2024-04-17T19:51:32.936 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.32548.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32704.log 2024-04-17T19:51:32.936 INFO:teuthology.orchestra.run.smithi044.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.32548.log.gz 2024-04-17T19:51:32.937 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.31811.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2024-04-17T19:51:32.937 INFO:teuthology.orchestra.run.smithi044.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.31811.log.gz 2024-04-17T19:51:32.939 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.32704.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36140.log 2024-04-17T19:51:32.939 INFO:teuthology.orchestra.run.smithi044.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.32704.log.gz 2024-04-17T19:51:32.940 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31863.log 2024-04-17T19:51:32.941 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.36140.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35175.log 2024-04-17T19:51:32.941 INFO:teuthology.orchestra.run.smithi044.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.36140.log.gz 2024-04-17T19:51:32.943 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.31863.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.31863.log.gz 2024-04-17T19:51:32.944 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.35175.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.35175.log.gz 2024-04-17T19:51:32.944 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33636.log 2024-04-17T19:51:32.946 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35068.log 2024-04-17T19:51:32.947 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.33636.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32465.log 2024-04-17T19:51:32.947 INFO:teuthology.orchestra.run.smithi044.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.33636.log.gz 2024-04-17T19:51:32.948 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.35068.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.35068.log.gz 2024-04-17T19:51:32.949 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33087.log 2024-04-17T19:51:32.950 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.32465.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31731.log 2024-04-17T19:51:32.950 INFO:teuthology.orchestra.run.smithi044.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.32465.log.gz 2024-04-17T19:51:32.951 INFO:teuthology.orchestra.run.smithi062.stderr: 92.6% -- replaced with /var/log/ceph/ceph-mds.b.log.gz 2024-04-17T19:51:32.951 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.33087.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36036.log 2024-04-17T19:51:32.951 INFO:teuthology.orchestra.run.smithi044.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.33087.log.gz 2024-04-17T19:51:32.952 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.31731.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.31731.log.gz 2024-04-17T19:51:32.953 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31405.log 2024-04-17T19:51:32.953 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.36036.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.36036.log.gz 2024-04-17T19:51:32.954 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31543.log 2024-04-17T19:51:32.955 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.31405.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32256.log 2024-04-17T19:51:32.955 INFO:teuthology.orchestra.run.smithi044.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.31405.log.gz 2024-04-17T19:51:32.957 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.31543.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.31543.log.gz 2024-04-17T19:51:32.957 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.32256.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36350.log 2024-04-17T19:51:32.958 INFO:teuthology.orchestra.run.smithi044.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.32256.log.gz 2024-04-17T19:51:32.958 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32230.log 2024-04-17T19:51:32.960 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.36350.log: gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-04-17T19:51:32.961 INFO:teuthology.orchestra.run.smithi044.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.36350.log.gz 2024-04-17T19:51:32.961 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.32230.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33081.log 2024-04-17T19:51:32.961 INFO:teuthology.orchestra.run.smithi044.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.32230.log.gz 2024-04-17T19:51:32.963 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph.log: /var/log/ceph/ceph-client.admin.33081.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33104.log 2024-04-17T19:51:32.964 INFO:teuthology.orchestra.run.smithi044.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.33081.log.gz 2024-04-17T19:51:32.964 INFO:teuthology.orchestra.run.smithi044.stderr: 86.0% -- replaced with /var/log/ceph/ceph.log.gz 2024-04-17T19:51:32.964 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35394.log 2024-04-17T19:51:32.966 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.33104.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35579.log 2024-04-17T19:51:32.966 INFO:teuthology.orchestra.run.smithi044.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.33104.log.gz 2024-04-17T19:51:32.967 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.35394.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36480.log 2024-04-17T19:51:32.967 INFO:teuthology.orchestra.run.smithi044.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.35394.log.gz 2024-04-17T19:51:32.968 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.35579.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.35579.log.gz 2024-04-17T19:51:32.969 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.36480.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33100.log 2024-04-17T19:51:32.969 INFO:teuthology.orchestra.run.smithi044.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.36480.log.gz 2024-04-17T19:51:32.970 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36244.log 2024-04-17T19:51:32.972 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.33100.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.34407.log 2024-04-17T19:51:32.972 INFO:teuthology.orchestra.run.smithi044.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.33100.log.gz 2024-04-17T19:51:32.973 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.36244.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34657.log 2024-04-17T19:51:32.973 INFO:teuthology.orchestra.run.smithi044.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.36244.log.gz 2024-04-17T19:51:32.974 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.0.34407.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.34407.log.gz 2024-04-17T19:51:32.974 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36402.log 2024-04-17T19:51:32.976 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.34657.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35042.log 2024-04-17T19:51:32.976 INFO:teuthology.orchestra.run.smithi044.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.34657.log.gz 2024-04-17T19:51:32.977 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.36402.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33310.log 2024-04-17T19:51:32.977 INFO:teuthology.orchestra.run.smithi044.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.36402.log.gz 2024-04-17T19:51:32.978 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.35042.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.35042.log.gz 2024-04-17T19:51:32.979 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33818.log 2024-04-17T19:51:32.980 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.33310.log: gzip 87.3% -5 -- replaced with /var/log/ceph/ceph-client.admin.33310.log.gz --verbose 2024-04-17T19:51:32.980 INFO:teuthology.orchestra.run.smithi044.stderr: -- /var/log/ceph/ceph-client.admin.33314.log 2024-04-17T19:51:32.981 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.33818.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31967.log 2024-04-17T19:51:32.981 INFO:teuthology.orchestra.run.smithi044.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.33818.log.gz 2024-04-17T19:51:32.983 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.33314.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.33314.log.gz 2024-04-17T19:51:32.984 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.31967.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31915.log 2024-04-17T19:51:32.984 INFO:teuthology.orchestra.run.smithi044.stderr: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.31967.log.gz 2024-04-17T19:51:32.985 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36218.log 2024-04-17T19:51:32.987 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.31915.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32308.log 2024-04-17T19:51:32.987 INFO:teuthology.orchestra.run.smithi044.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.31915.log.gz 2024-04-17T19:51:32.987 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.36218.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.36218.log.gz 2024-04-17T19:51:32.989 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.32308.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.32308.log.gz 2024-04-17T19:51:32.989 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35776.log 2024-04-17T19:51:32.990 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34990.log 2024-04-17T19:51:32.992 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.35776.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31649.log 2024-04-17T19:51:32.992 INFO:teuthology.orchestra.run.smithi044.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.35776.log.gz 2024-04-17T19:51:32.993 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.34990.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34130.log 2024-04-17T19:51:32.993 INFO:teuthology.orchestra.run.smithi044.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.34990.log.gz 2024-04-17T19:51:32.994 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.31649.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32282.log 2024-04-17T19:51:32.994 INFO:teuthology.orchestra.run.smithi044.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.31649.log.gz 2024-04-17T19:51:32.995 INFO:teuthology.orchestra.run.smithi062.stderr: 91.9% -- replaced with /var/log/ceph/ceph-mon.c.log.gz 2024-04-17T19:51:32.996 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.34130.log: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.34130.log.gz 2024-04-17T19:51:32.996 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.32282.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35094.log 2024-04-17T19:51:32.997 INFO:teuthology.orchestra.run.smithi044.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.32282.log.gz 2024-04-17T19:51:32.997 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33301.log 2024-04-17T19:51:32.999 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.35094.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36114.log 2024-04-17T19:51:32.999 INFO:teuthology.orchestra.run.smithi044.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.35094.log.gz 2024-04-17T19:51:33.000 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.33301.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.33301.log.gz 2024-04-17T19:51:33.001 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.36114.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.36114.log.gz 2024-04-17T19:51:33.001 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35750.log 2024-04-17T19:51:33.002 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35906.log 2024-04-17T19:51:33.004 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.35750.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-04-17T19:51:33.004 INFO:teuthology.orchestra.run.smithi044.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.35750.log.gz 2024-04-17T19:51:33.005 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.35906.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.c.log 2024-04-17T19:51:33.005 INFO:teuthology.orchestra.run.smithi044.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.35906.log.gz 2024-04-17T19:51:33.007 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph.audit.log: /var/log/ceph/ceph-mds.c.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33093.log 2024-04-17T19:51:33.007 INFO:teuthology.orchestra.run.smithi044.stderr: 89.1% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-04-17T19:51:33.010 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.33093.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35828.log 2024-04-17T19:51:33.010 INFO:teuthology.orchestra.run.smithi044.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.33093.log.gz 2024-04-17T19:51:33.011 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.a.log 2024-04-17T19:51:33.012 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.35828.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.35828.log.gz 2024-04-17T19:51:33.013 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-mds.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32868.log 2024-04-17T19:51:33.014 INFO:teuthology.orchestra.run.smithi044.stderr: 93.2% -- replaced with /var/log/ceph/ceph-mds.a.log.gz 2024-04-17T19:51:33.016 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.32868.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.32868.log.gz 2024-04-17T19:51:33.016 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27448.log 2024-04-17T19:51:33.017 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36192.log 2024-04-17T19:51:33.019 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.27448.log: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.27448.log.gz 2024-04-17T19:51:33.020 INFO:teuthology.orchestra.run.smithi062.stderr: 91.8% -- replaced with /var/log/ceph/ceph-mon.b.log.gz 2024-04-17T19:51:33.020 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.36192.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.36192.log.gz 2024-04-17T19:51:33.020 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32873.log 2024-04-17T19:51:33.022 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33975.log 2024-04-17T19:51:33.022 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 has been restored 2024-04-17T19:51:33.023 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.32873.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.32873.log.gz 2024-04-17T19:51:33.024 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.33975.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.33975.log.gz 2024-04-17T19:51:33.024 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35362.log 2024-04-17T19:51:33.026 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33520.log 2024-04-17T19:51:33.027 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.35362.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.35362.log.gz 2024-04-17T19:51:33.028 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.33520.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.33520.log.gz 2024-04-17T19:51:33.029 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31621.log 2024-04-17T19:51:33.030 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32808.log 2024-04-17T19:51:33.032 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.31621.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.31621.log.gz 2024-04-17T19:51:33.033 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.32808.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34605.log 2024-04-17T19:51:33.033 INFO:teuthology.orchestra.run.smithi044.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.32808.log.gz 2024-04-17T19:51:33.033 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34735.log 2024-04-17T19:51:33.033 INFO:teuthology.orchestra.run.smithi044.stderr: 92.5% -- replaced with /var/log/ceph/ceph-mds.c.log.gz 2024-04-17T19:51:33.035 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.34605.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31569.log 2024-04-17T19:51:33.035 INFO:teuthology.orchestra.run.smithi044.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.34605.log.gz 2024-04-17T19:51:33.036 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.34735.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.34735.log.gz 2024-04-17T19:51:33.037 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35446.log 2024-04-17T19:51:33.037 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.31569.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.31569.log.gz 2024-04-17T19:51:33.037 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32652.log 2024-04-17T19:51:33.039 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.35446.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33573.log 2024-04-17T19:51:33.039 INFO:teuthology.orchestra.run.smithi044.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.35446.log.gz 2024-04-17T19:51:33.040 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.32652.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.32652.log.gz 2024-04-17T19:51:33.041 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31369.log 2024-04-17T19:51:33.041 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.33573.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.33573.log.gz 2024-04-17T19:51:33.042 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32678.log 2024-04-17T19:51:33.043 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.31369.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32361.log 2024-04-17T19:51:33.043 INFO:teuthology.orchestra.run.smithi044.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.31369.log.gz 2024-04-17T19:51:33.046 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.32678.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34851.log 2024-04-17T19:51:33.046 INFO:teuthology.orchestra.run.smithi044.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.32678.log.gz 2024-04-17T19:51:33.046 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.32361.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33871.log 2024-04-17T19:51:33.046 INFO:teuthology.orchestra.run.smithi044.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.32361.log.gz 2024-04-17T19:51:33.047 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.34851.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.34851.log.gz 2024-04-17T19:51:33.047 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.33871.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.33871.log.gz 2024-04-17T19:51:33.048 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31785.log 2024-04-17T19:51:33.049 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33307.log 2024-04-17T19:51:33.051 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.31785.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.31785.log.gz 2024-04-17T19:51:33.051 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33546.log 2024-04-17T19:51:33.052 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.33307.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.33307.log.gz 2024-04-17T19:51:33.052 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31515.log 2024-04-17T19:51:33.054 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.33546.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36010.log 2024-04-17T19:51:33.054 INFO:teuthology.orchestra.run.smithi044.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.33546.log.gz 2024-04-17T19:51:33.055 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.31515.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32626.log 2024-04-17T19:51:33.055 INFO:teuthology.orchestra.run.smithi044.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.31515.log.gz 2024-04-17T19:51:33.056 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.36010.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34449.log 2024-04-17T19:51:33.056 INFO:teuthology.orchestra.run.smithi044.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.36010.log.gz 2024-04-17T19:51:33.057 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.32626.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34080.log 2024-04-17T19:51:33.057 INFO:teuthology.orchestra.run.smithi044.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.32626.log.gz 2024-04-17T19:51:33.059 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.34449.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32834.log 2024-04-17T19:51:33.059 INFO:teuthology.orchestra.run.smithi044.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.34449.log.gz 2024-04-17T19:51:33.060 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.34080.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35336.log 2024-04-17T19:51:33.061 INFO:teuthology.orchestra.run.smithi044.stderr: 91.2%/var/log/ceph/ceph-client.admin.32834.log: -- replaced with /var/log/ceph/ceph-client.admin.34080.log.gz 2024-04-17T19:51:33.061 INFO:teuthology.orchestra.run.smithi044.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.32834.log.gz 2024-04-17T19:51:33.062 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36597.log 2024-04-17T19:51:33.063 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.35336.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34527.log 2024-04-17T19:51:33.063 INFO:teuthology.orchestra.run.smithi044.stderr: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.35336.log.gz 2024-04-17T19:51:33.064 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.36597.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35854.log 2024-04-17T19:51:33.064 INFO:teuthology.orchestra.run.smithi044.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.36597.log.gz 2024-04-17T19:51:33.065 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.34527.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.34527.log.gz 2024-04-17T19:51:33.066 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35271.log 2024-04-17T19:51:33.066 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.35854.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.35854.log.gz 2024-04-17T19:51:33.067 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32413.log 2024-04-17T19:51:33.069 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.35271.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32877.log 2024-04-17T19:51:33.069 INFO:teuthology.orchestra.run.smithi044.stderr: 91.7% -- replaced with /var/log/ceph/ceph-client.admin.35271.log.gz 2024-04-17T19:51:33.069 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.32413.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.32413.log.gz 2024-04-17T19:51:33.070 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32730.log 2024-04-17T19:51:33.071 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.32877.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.32877.log.gz 2024-04-17T19:51:33.071 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33662.log 2024-04-17T19:51:33.073 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.32730.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.e.log 2024-04-17T19:51:33.073 INFO:teuthology.orchestra.run.smithi044.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.32730.log.gz 2024-04-17T19:51:33.074 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.33662.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33897.log 2024-04-17T19:51:33.074 INFO:teuthology.orchestra.run.smithi044.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.33662.log.gz 2024-04-17T19:51:33.077 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-mds.e.log: /var/log/ceph/ceph-client.admin.33897.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.33897.log.gz 2024-04-17T19:51:33.077 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35657.log 2024-04-17T19:51:33.078 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.22643.log 2024-04-17T19:51:33.079 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.35657.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.35657.log.gz 2024-04-17T19:51:33.080 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph.tmp-client.admin.22643.log: 0.0% -- replaced with /var/log/ceph/ceph.tmp-client.admin.22643.log.gz 2024-04-17T19:51:33.080 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33101.log 2024-04-17T19:51:33.082 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34501.log 2024-04-17T19:51:33.083 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.33101.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.33101.log.gz 2024-04-17T19:51:33.084 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.34501.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.34501.log.gz 2024-04-17T19:51:33.084 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35201.log 2024-04-17T19:51:33.086 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32887.log 2024-04-17T19:51:33.088 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.35201.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.35201.log.gz 2024-04-17T19:51:33.088 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.32887.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.32887.log.gz 2024-04-17T19:51:33.089 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35880.log 2024-04-17T19:51:33.092 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.35880.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.35880.log.gz 2024-04-17T19:51:33.103 INFO:teuthology.orchestra.run.smithi044.stderr: 92.4% -- replaced with /var/log/ceph/ceph-mds.e.log.gz 2024-04-17T19:51:33.184 INFO:teuthology.orchestra.run.smithi044.stderr: 91.1% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2024-04-17T19:51:33.532 INFO:teuthology.orchestra.run.smithi062.stderr: 93.5% -- replaced with /var/log/ceph/ceph-osd.7.log.gz 2024-04-17T19:51:33.549 INFO:teuthology.orchestra.run.smithi062.stderr: 93.5% -- replaced with /var/log/ceph/ceph-osd.6.log.gz 2024-04-17T19:51:33.621 INFO:teuthology.orchestra.run.smithi062.stderr: 93.5% -- replaced with /var/log/ceph/ceph-osd.5.log.gz 2024-04-17T19:51:33.628 INFO:teuthology.orchestra.run.smithi044.stderr: 93.5% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2024-04-17T19:51:33.647 INFO:teuthology.orchestra.run.smithi062.stderr: 93.4% -- replaced with /var/log/ceph/ceph-osd.4.log.gz 2024-04-17T19:51:33.649 INFO:teuthology.orchestra.run.smithi062.stderr: 2024-04-17T19:51:33.649 INFO:teuthology.orchestra.run.smithi062.stderr:real 0m0.823s 2024-04-17T19:51:33.649 INFO:teuthology.orchestra.run.smithi062.stderr:user 0m3.336s 2024-04-17T19:51:33.649 INFO:teuthology.orchestra.run.smithi062.stderr:sys 0m0.120s 2024-04-17T19:51:33.671 INFO:teuthology.orchestra.run.smithi044.stderr: 93.6% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2024-04-17T19:51:33.721 INFO:teuthology.orchestra.run.smithi044.stderr: 93.6% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2024-04-17T19:51:33.732 INFO:teuthology.orchestra.run.smithi044.stderr: 93.5% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2024-04-17T19:51:33.735 INFO:teuthology.orchestra.run.smithi044.stderr: 2024-04-17T19:51:33.735 INFO:teuthology.orchestra.run.smithi044.stderr:real 0m0.915s 2024-04-17T19:51:33.735 INFO:teuthology.orchestra.run.smithi044.stderr:user 0m3.442s 2024-04-17T19:51:33.735 INFO:teuthology.orchestra.run.smithi044.stderr:sys 0m0.638s 2024-04-17T19:51:33.736 INFO:tasks.ceph:Archiving logs... 2024-04-17T19:51:33.736 DEBUG:teuthology.misc:Transferring archived files from smithi044:/var/log/ceph to /home/teuthworker/archive/pdonnell-2024-04-17_17:06:06-fs-wip-pdonnell-testing-20240417.021458-debug-distro-default-smithi/7660526/remote/smithi044/log 2024-04-17T19:51:33.737 DEBUG:teuthology.orchestra.run.smithi044:> sudo tar c -f - -C /var/log/ceph -- . 2024-04-17T19:51:34.352 DEBUG:teuthology.misc:Transferring archived files from smithi062:/var/log/ceph to /home/teuthworker/archive/pdonnell-2024-04-17_17:06:06-fs-wip-pdonnell-testing-20240417.021458-debug-distro-default-smithi/7660526/remote/smithi062/log 2024-04-17T19:51:34.353 DEBUG:teuthology.orchestra.run.smithi062:> sudo tar c -f - -C /var/log/ceph -- . 2024-04-17T19:51:34.757 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-04-17T19:51:34.767 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-04-17T19:51:34.767 DEBUG:teuthology.orchestra.run.smithi044:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-04-17T19:51:34.770 DEBUG:teuthology.orchestra.run.smithi062:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-04-17T19:51:34.853 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-04-17T19:51:34.863 INFO:teuthology.task.clock:Checking final clock skew... 2024-04-17T19:51:34.863 DEBUG:teuthology.orchestra.run.smithi044:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-17T19:51:34.866 DEBUG:teuthology.orchestra.run.smithi062:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-17T19:51:34.879 INFO:teuthology.orchestra.run.smithi044.stdout: remote refid st t when poll reach delay offset jitter 2024-04-17T19:51:34.881 INFO:teuthology.orchestra.run.smithi044.stdout:============================================================================== 2024-04-17T19:51:34.881 INFO:teuthology.orchestra.run.smithi044.stdout:+hv01.front.sepi 67.205.162.81 3 u 8 64 377 0.076 -2.042 0.527 2024-04-17T19:51:34.881 INFO:teuthology.orchestra.run.smithi044.stdout:+hv02.front.sepi 63.231.80.2 3 u 7 64 377 0.093 +0.759 0.440 2024-04-17T19:51:34.881 INFO:teuthology.orchestra.run.smithi044.stdout:*hv03.front.sepi 74.6.168.72 3 u 7 64 377 0.087 -0.560 0.369 2024-04-17T19:51:34.882 INFO:teuthology.orchestra.run.smithi044.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-04-17T19:51:34.883 INFO:teuthology.orchestra.run.smithi062.stdout: remote refid st t when poll reach delay offset jitter 2024-04-17T19:51:34.883 INFO:teuthology.orchestra.run.smithi062.stdout:============================================================================== 2024-04-17T19:51:34.883 INFO:teuthology.orchestra.run.smithi062.stdout:+hv01.front.sepi 67.205.162.81 3 u 8 64 377 0.074 -4.014 1.882 2024-04-17T19:51:34.883 INFO:teuthology.orchestra.run.smithi062.stdout:+hv02.front.sepi 63.231.80.2 3 u 11 64 377 0.079 +0.451 1.067 2024-04-17T19:51:34.883 INFO:teuthology.orchestra.run.smithi062.stdout:*hv03.front.sepi 74.6.168.72 3 u 15 64 377 0.076 -0.461 1.225 2024-04-17T19:51:34.883 INFO:teuthology.orchestra.run.smithi062.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-04-17T19:51:34.884 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-04-17T19:51:34.895 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-04-17T19:51:34.896 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-04-17T19:51:34.907 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-04-17T19:51:34.917 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-04-17T19:51:34.926 INFO:teuthology.task.internal:Duration was 1020.111932 seconds 2024-04-17T19:51:34.926 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-04-17T19:51:34.935 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-04-17T19:51:34.936 DEBUG:teuthology.orchestra.run.smithi044:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-04-17T19:51:34.939 DEBUG:teuthology.orchestra.run.smithi062:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-04-17T19:51:35.015 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-04-17T19:51:35.015 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi044.front.sepia.ceph.com 2024-04-17T19:51:35.015 DEBUG:teuthology.orchestra.run.smithi044:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-04-17T19:51:35.035 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi062.front.sepia.ceph.com 2024-04-17T19:51:35.035 DEBUG:teuthology.orchestra.run.smithi062:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-04-17T19:51:35.046 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-04-17T19:51:35.046 DEBUG:teuthology.orchestra.run.smithi044:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-04-17T19:51:35.080 DEBUG:teuthology.orchestra.run.smithi062:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-04-17T19:51:35.116 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-04-17T19:51:35.116 DEBUG:teuthology.orchestra.run.smithi044:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-04-17T19:51:35.160 DEBUG:teuthology.orchestra.run.smithi062:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-04-17T19:51:35.230 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-04-17T19:51:35.240 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-04-17T19:51:35.240 DEBUG:teuthology.orchestra.run.smithi044:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-04-17T19:51:35.261 DEBUG:teuthology.orchestra.run.smithi062:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-04-17T19:51:35.275 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-04-17T19:51:35.284 DEBUG:teuthology.orchestra.run.smithi044:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-04-17T19:51:35.312 DEBUG:teuthology.orchestra.run.smithi062:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-04-17T19:51:35.326 INFO:teuthology.orchestra.run.smithi044.stdout:kernel.core_pattern = core 2024-04-17T19:51:35.329 INFO:teuthology.orchestra.run.smithi062.stdout:kernel.core_pattern = core 2024-04-17T19:51:35.353 DEBUG:teuthology.orchestra.run.smithi044:> test -e /home/ubuntu/cephtest/archive/coredump 2024-04-17T19:51:35.391 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-17T19:51:35.392 DEBUG:teuthology.orchestra.run.smithi062:> test -e /home/ubuntu/cephtest/archive/coredump 2024-04-17T19:51:35.398 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-17T19:51:35.399 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-04-17T19:51:35.409 INFO:teuthology.task.internal:Transferring archived files... 2024-04-17T19:51:35.410 DEBUG:teuthology.misc:Transferring archived files from smithi044:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/pdonnell-2024-04-17_17:06:06-fs-wip-pdonnell-testing-20240417.021458-debug-distro-default-smithi/7660526/remote/smithi044 2024-04-17T19:51:35.410 DEBUG:teuthology.orchestra.run.smithi044:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-04-17T19:51:35.460 DEBUG:teuthology.misc:Transferring archived files from smithi062:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/pdonnell-2024-04-17_17:06:06-fs-wip-pdonnell-testing-20240417.021458-debug-distro-default-smithi/7660526/remote/smithi062 2024-04-17T19:51:35.460 DEBUG:teuthology.orchestra.run.smithi062:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-04-17T19:51:35.482 INFO:teuthology.task.internal:Removing archive directory... 2024-04-17T19:51:35.482 DEBUG:teuthology.orchestra.run.smithi044:> rm -rf -- /home/ubuntu/cephtest/archive 2024-04-17T19:51:35.502 DEBUG:teuthology.orchestra.run.smithi062:> rm -rf -- /home/ubuntu/cephtest/archive 2024-04-17T19:51:35.524 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-04-17T19:51:35.535 INFO:teuthology.task.internal:Not uploading archives. 2024-04-17T19:51:35.535 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-04-17T19:51:35.561 INFO:teuthology.task.internal:Tidying up after the test... 2024-04-17T19:51:35.561 DEBUG:teuthology.orchestra.run.smithi044:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-04-17T19:51:35.564 DEBUG:teuthology.orchestra.run.smithi062:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-04-17T19:51:35.570 INFO:teuthology.orchestra.run.smithi044.stdout: 658121 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Apr 17 19:51 /home/ubuntu/cephtest 2024-04-17T19:51:35.572 INFO:teuthology.orchestra.run.smithi062.stdout: 524291 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Apr 17 19:51 /home/ubuntu/cephtest 2024-04-17T19:51:35.574 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-04-17T19:51:35.584 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-04-17T19:51:35.609 INFO:teuthology.run:Summary data: client.0-kernel-sha1: 3f60ed14f7c110c7ce3c8d83dd2ed0d08e80d0c8 description: fs/thrash/workloads/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a5s-mds-1c-client conf/{client mds mgr mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} msgr-failures/none objectstore-ec/bluestore-comp-ec-root overrides/{client-shutdown frag ignorelist_health ignorelist_wrongly_marked_down pg_health prefetch_dirfrags/no prefetch_dirfrags/yes prefetch_entire_dirfrags/no prefetch_entire_dirfrags/yes races session_timeout thrashosds-health} ranks/5 tasks/{1-thrash/mon 2-workunit/fs/trivial_sync}} duration: 1020.1119322776794 flavor: default owner: scheduled_pdonnell@teuthology success: true 2024-04-17T19:51:35.609 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-17T19:51:35.692 INFO:teuthology.run:pass